2024-05-06T21:05:14.809 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-06T21:05:14.809 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_lflores@teuthology --verbose --name lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi --archive /home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568 --description upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568/orig.config.yaml 2024-05-06T21:05:14.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-06T21:05:14.955 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568 branch: wip-yuriw11-testing-20240501.200505-squid description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7694568' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuriw11-testing-20240501.200505-squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: f273489c6dcd4bc88409993babd09dd99491162c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f273489c6dcd4bc88409993babd09dd99491162c kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuriw11-testing-20240501.200505-squid sha1: f273489c6dcd4bc88409993babd09dd99491162c owner: scheduled_lflores@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3017 sha1: f273489c6dcd4bc88409993babd09dd99491162c sleep_before_teardown: 0 subset: 111/12000 suite: upgrade suite_branch: wip-yuriw11-testing-20240501.200505-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f273489c6dcd4bc88409993babd09dd99491162c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f273489c6dcd4bc88409993babd09dd99491162c targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNbBQhysr2ZNdchvALranI8mrXZVH627Y+CFr60qEPuRY/DL66bDB4yrR9VJLDewTvziMSBydhh8aR7kLV6Zziw= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvqmopsH+3IZd/XkjHnGn1ZG7jOLFSv/F3zd1q6Eg3IE0poXC0NidTIP/JH2VxzbbdAtT7I1uP5dAJnubE/ZU4= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/lflores/src/git.ceph.com_ceph-c_wip-yuriw11-testing-20240501.200505-squid/qa/suites/upgrade/cephfs/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-06_20:49:51 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: lflores verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-05-06T21:05:14.955 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f273489c6dcd4bc88409993babd09dd99491162c/qa; will attempt to use it 2024-05-06T21:05:14.956 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f273489c6dcd4bc88409993babd09dd99491162c/qa/tasks 2024-05-06T21:05:14.956 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-06T21:05:14.957 INFO:teuthology.task.internal:Checking packages... 2024-05-06T21:05:14.979 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f273489c6dcd4bc88409993babd09dd99491162c' 2024-05-06T21:05:14.980 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-06T21:05:14.980 INFO:teuthology.packaging:ref: None 2024-05-06T21:05:14.980 INFO:teuthology.packaging:tag: None 2024-05-06T21:05:14.980 INFO:teuthology.packaging:branch: wip-yuriw11-testing-20240501.200505-squid 2024-05-06T21:05:14.980 INFO:teuthology.packaging:sha1: f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:05:14.980 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuriw11-testing-20240501.200505-squid 2024-05-06T21:05:15.213 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2497.gf273489c 2024-05-06T21:05:15.215 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-06T21:05:15.222 INFO:teuthology.task.internal:no buildpackages task found 2024-05-06T21:05:15.222 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-06T21:05:15.245 INFO:teuthology.task.internal:Saving configuration 2024-05-06T21:05:15.264 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-06T21:05:15.273 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T21:05:15.299 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 20:59:57.571793', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNbBQhysr2ZNdchvALranI8mrXZVH627Y+CFr60qEPuRY/DL66bDB4yrR9VJLDewTvziMSBydhh8aR7kLV6Zziw='} 2024-05-06T21:05:15.317 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 20:59:57.570112', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvqmopsH+3IZd/XkjHnGn1ZG7jOLFSv/F3zd1q6Eg3IE0poXC0NidTIP/JH2VxzbbdAtT7I1uP5dAJnubE/ZU4='} 2024-05-06T21:05:15.317 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-06T21:05:15.328 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-05-06T21:05:15.328 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-05-06T21:05:15.328 INFO:teuthology.run_tasks:Running task console_log... 2024-05-06T21:05:15.416 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fef4c86c0d0>, signals=[15]) 2024-05-06T21:05:15.416 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-06T21:05:15.426 INFO:teuthology.task.internal:Opening connections... 2024-05-06T21:05:15.426 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:05:15.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:05:15.538 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-05-06T21:05:15.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:05:15.616 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-06T21:05:15.624 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-05-06T21:05:15.643 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-05-06T21:05:15.643 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-05-06T21:05:15.704 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2024-05-06T21:05:15.704 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2024-05-06T21:05:15.704 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2024-05-06T21:05:15.704 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2024-05-06T21:05:15.704 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2024-05-06T21:05:15.704 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2024-05-06T21:05:15.704 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-06T21:05:15.705 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2024-05-06T21:05:15.705 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2024-05-06T21:05:15.705 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-06T21:05:15.705 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2024-05-06T21:05:15.705 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-06T21:05:15.705 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-06T21:05:15.705 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-06T21:05:15.706 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-05-06T21:05:15.726 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-05-06T21:05:15.744 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-05-06T21:05:15.744 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-05-06T21:05:15.801 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-05-06T21:05:15.801 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-05-06T21:05:15.801 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-06T21:05:15.802 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-06T21:05:15.803 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-05-06T21:05:15.825 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-06T21:05:15.838 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-06T21:05:15.862 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-06T21:05:15.862 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-05-06T21:05:15.865 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-05-06T21:05:15.882 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-06T21:05:15.891 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-06T21:05:15.892 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-05-06T21:05:15.923 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-05-06T21:05:15.951 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-06T21:05:16.005 INFO:teuthology.run_tasks:Running task kernel... 2024-05-06T21:05:16.019 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-06T21:05:16.020 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-06T21:05:16.020 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-06T21:05:16.021 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-06T21:05:16.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:05:16.037 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-05-06T21:05:16.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:05:16.038 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-05-06T21:05:16.094 INFO:teuthology.orchestra.run.smithi032.stdout:5.14.0-437.el9.x86_64 2024-05-06T21:05:16.094 INFO:teuthology.task.kernel:Running kernel on smithi032: 5.14.0-437.el9.x86_64 2024-05-06T21:05:16.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum install -y kernel 2024-05-06T21:05:16.096 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-437.el9.x86_64 2024-05-06T21:05:16.096 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.14.0-437.el9.x86_64 2024-05-06T21:05:16.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2024-05-06T21:05:19.535 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.1 MB 00:01 2024-05-06T21:05:19.589 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.1 MB 00:01 2024-05-06T21:05:37.265 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-05-06T21:05:37.885 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:17 2024-05-06T21:05:43.020 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.2 MB 00:02 2024-05-06T21:05:43.190 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.2 MB 00:01 2024-05-06T21:05:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-05-06T21:05:44.945 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-05-06T21:05:46.746 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-06T21:05:52.044 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-06T21:05:54.117 INFO:teuthology.orchestra.run.smithi032.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-06T21:05:54.117 INFO:teuthology.orchestra.run.smithi032.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-06T21:05:54.215 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:05:54.222 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:05:54.222 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2024-05-06T21:05:54.222 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:05:54.222 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:05:54.222 INFO:teuthology.orchestra.run.smithi032.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-06T21:05:54.222 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-05-06T21:05:54.222 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-06T21:05:54.222 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-06T21:05:54.222 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-06T21:05:54.223 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:05:54.223 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:05:54.223 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:05:54.223 INFO:teuthology.orchestra.run.smithi032.stdout:Install 4 Packages 2024-05-06T21:05:54.223 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:05:54.223 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 78 M 2024-05-06T21:05:54.223 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 123 M 2024-05-06T21:05:54.224 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:05:54.461 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:05:54.462 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:05:54.464 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-modules-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:05:54.857 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-5.14.0-444.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:05:54.880 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:05:54.891 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-444.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-06T21:05:54.903 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-modules-5.14.0-444.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:05:54.929 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-modules-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-444.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-06T21:05:54.930 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-444.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-06T21:05:55.120 INFO:teuthology.orchestra.run.smithi032.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 564 kB/s | 484 kB 00:00 2024-05-06T21:05:55.230 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-modules-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:05:55.331 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] kernel-modules-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:05:55.947 INFO:teuthology.orchestra.run.smithi032.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 9.2 MB/s | 15 MB 00:01 2024-05-06T21:05:56.438 INFO:teuthology.orchestra.run.smithi032.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 16 MB/s | 34 MB 00:02 2024-05-06T21:05:57.038 INFO:teuthology.orchestra.run.smithi032.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 15 MB/s | 28 MB 00:01 2024-05-06T21:05:57.043 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:05:57.043 INFO:teuthology.orchestra.run.smithi032.stdout:Total 28 MB/s | 78 MB 00:02 2024-05-06T21:05:57.754 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:05:58.182 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:05:58.183 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:05:59.120 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:05:59.121 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:06:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:06:02.288 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-06T21:06:02.373 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-06T21:06:05.182 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-06T21:06:05.322 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-06T21:06:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-06T21:06:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:06:13.135 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 769 kB/s | 21 MB 00:28 2024-05-06T21:06:15.541 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:06:23.700 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 313 B/s | 1.7 kB 00:05 2024-05-06T21:06:25.673 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-06T21:06:25.673 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-06T21:06:25.765 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:06:25.777 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:06:25.777 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout:Install 4 Packages 2024-05-06T21:06:25.778 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:06:25.781 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 78 M 2024-05-06T21:06:25.781 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 123 M 2024-05-06T21:06:25.781 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:06:25.980 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-modules-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:06:25.981 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:06:25.981 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:06:26.326 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:06:26.350 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-5.14.0-444.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:06:26.377 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-444.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-06T21:06:26.379 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-modules-5.14.0-444.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:06:26.384 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-444.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-06T21:06:26.438 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-modules-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-444.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-06T21:06:26.535 INFO:teuthology.orchestra.run.smithi154.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 678 kB/s | 484 kB 00:00 2024-05-06T21:06:26.635 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-modules-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:06:26.723 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] kernel-modules-core-5.14.0-444.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-444.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-06T21:06:27.036 INFO:teuthology.orchestra.run.smithi154.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 13 MB/s | 15 MB 00:01 2024-05-06T21:06:27.994 INFO:teuthology.orchestra.run.smithi154.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 16 MB/s | 34 MB 00:02 2024-05-06T21:06:28.294 INFO:teuthology.orchestra.run.smithi154.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 16 MB/s | 28 MB 00:01 2024-05-06T21:06:28.300 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:06:28.300 INFO:teuthology.orchestra.run.smithi154.stdout:Total 31 MB/s | 78 MB 00:02 2024-05-06T21:06:28.986 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:06:29.319 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:06:29.320 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:06:30.232 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:06:30.233 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:06:32.656 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:06:33.321 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-06T21:06:33.404 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-06T21:06:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-06T21:06:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-06T21:06:40.973 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-06T21:06:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:06:45.871 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:06:46.575 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:06:46.615 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:06:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:06:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-06T21:06:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-06T21:06:46.970 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-06T21:06:47.748 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:06:47.748 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:06:47.748 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:06:47.748 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-06T21:06:47.748 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-06T21:06:47.748 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-06T21:06:47.748 INFO:teuthology.orchestra.run.smithi032.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-06T21:06:47.749 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:06:47.749 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:06:48.092 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q kernel | sort -rV | head -n 1 2024-05-06T21:06:48.163 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-06T21:06:48.163 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-06T21:06:48.163 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-06T21:06:48.164 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-06T21:06:48.164 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-06T21:06:48.164 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-05-06T21:06:48.164 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=None, version=distro) 2024-05-06T21:06:48.164 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q kernel | sort -rV | head -n 1 2024-05-06T21:06:48.214 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-06T21:06:48.214 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-06T21:06:48.214 DEBUG:teuthology.orchestra.run.smithi032:> sudo rpm -qi grub2-tools 2024-05-06T21:06:48.245 INFO:teuthology.orchestra.run.smithi032.stdout:Name : grub2-tools 2024-05-06T21:06:48.245 INFO:teuthology.orchestra.run.smithi032.stdout:Epoch : 1 2024-05-06T21:06:48.245 INFO:teuthology.orchestra.run.smithi032.stdout:Version : 2.06 2024-05-06T21:06:48.245 INFO:teuthology.orchestra.run.smithi032.stdout:Release : 68.el9 2024-05-06T21:06:48.245 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: x86_64 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Group : Unspecified 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Size : 8264254 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:License : GPLv3+ 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Packager : builder@centos.org 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Vendor : CentOS 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Summary : Support tools for GRUB. 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Description : 2024-05-06T21:06:48.246 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:06:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-06T21:06:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-06T21:06:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-06T21:06:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:hardware devices. 2024-05-06T21:06:48.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:06:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:This subpackage provides tools for support of all platforms. 2024-05-06T21:06:48.248 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-06T21:06:48.248 INFO:teuthology.task.kernel:Updating grub on smithi032 to boot 5.14.0-444.el9.x86_64 2024-05-06T21:06:48.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-06T21:06:48.944 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-05-06T21:06:50.323 INFO:teuthology.orchestra.run.smithi032.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-06T21:06:50.390 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-05-06T21:06:50.392 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-05-06T21:06:50.407 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.QbF16tx1N9 2024-05-06T21:06:50.407 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QbF16tx1N9 2024-05-06T21:06:50.474 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.QbF16tx1N9 2024-05-06T21:06:50.610 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.QbF16tx1N9 is 6KB 2024-05-06T21:06:50.659 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.QbF16tx1N9 2024-05-06T21:06:50.673 DEBUG:teuthology.orchestra.run.smithi032:> sudo /bin/ls /boot/loader/entries || true 2024-05-06T21:06:50.737 INFO:teuthology.orchestra.run.smithi032.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-06T21:06:50.737 INFO:teuthology.orchestra.run.smithi032.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-06T21:06:50.737 INFO:teuthology.orchestra.run.smithi032.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-06T21:06:50.737 INFO:teuthology.orchestra.run.smithi032.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-06T21:06:50.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-06T21:06:50.891 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2024-05-06T21:07:15.092 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:07:15.130 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:07:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:07:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-06T21:07:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-06T21:07:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-06T21:07:16.336 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-06T21:07:16.336 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:07:16.336 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:07:16.336 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-06T21:07:16.336 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-06T21:07:16.336 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-06T21:07:16.336 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-06T21:07:16.336 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:07:16.336 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:07:16.705 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-05-06T21:07:16.787 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-06T21:07:16.787 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-06T21:07:16.787 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-06T21:07:16.787 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-06T21:07:16.788 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-06T21:07:16.788 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-05-06T21:07:16.788 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-05-06T21:07:16.788 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-05-06T21:07:16.837 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-06T21:07:16.837 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-06T21:07:16.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -qi grub2-tools 2024-05-06T21:07:16.868 INFO:teuthology.orchestra.run.smithi154.stdout:Name : grub2-tools 2024-05-06T21:07:16.868 INFO:teuthology.orchestra.run.smithi154.stdout:Epoch : 1 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Version : 2.06 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Release : 68.el9 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: x86_64 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Group : Unspecified 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Size : 8264254 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:License : GPLv3+ 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Packager : builder@centos.org 2024-05-06T21:07:16.869 INFO:teuthology.orchestra.run.smithi154.stdout:Vendor : CentOS 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout:Summary : Support tools for GRUB. 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout:Description : 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout:hardware devices. 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:07:16.870 INFO:teuthology.orchestra.run.smithi154.stdout:This subpackage provides tools for support of all platforms. 2024-05-06T21:07:16.871 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-06T21:07:16.871 INFO:teuthology.task.kernel:Updating grub on smithi154 to boot 5.14.0-444.el9.x86_64 2024-05-06T21:07:16.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-06T21:07:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-05-06T21:07:18.890 INFO:teuthology.orchestra.run.smithi154.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-06T21:07:18.923 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-05-06T21:07:18.926 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-05-06T21:07:18.942 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.zX7bUxDVMj 2024-05-06T21:07:18.943 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zX7bUxDVMj 2024-05-06T21:07:19.007 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.zX7bUxDVMj 2024-05-06T21:07:19.149 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.zX7bUxDVMj is 6KB 2024-05-06T21:07:19.198 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.zX7bUxDVMj 2024-05-06T21:07:19.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo /bin/ls /boot/loader/entries || true 2024-05-06T21:07:19.280 INFO:teuthology.orchestra.run.smithi154.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-06T21:07:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-06T21:07:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-06T21:07:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-06T21:07:19.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-06T21:07:19.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-05-06T21:07:20.894 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-05-06T21:07:20.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-06T21:07:20.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:07:39.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-05-06T21:07:48.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-06T21:07:48.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:07:49.429 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-05-06T21:07:49.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-06T21:07:49.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:08:06.815 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-05-06T21:08:07.838 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-05-06T21:08:16.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-06T21:08:16.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:08:18.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-06T21:08:18.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:08:19.043 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-05-06T21:08:19.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-06T21:08:19.497 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-444.el9.x86_64"... 2024-05-06T21:08:19.497 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-05-06T21:08:19.514 INFO:teuthology.orchestra.run.smithi032.stdout:5.14.0-444.el9.x86_64 2024-05-06T21:08:19.514 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-06T21:08:19.515 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-06T21:08:19.515 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-06T21:08:19.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-05-06T21:08:20.516 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-05-06T21:08:20.516 DEBUG:teuthology.orchestra.run.smithi032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-06T21:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout:ttyS1 2024-05-06T21:08:20.619 DEBUG:teuthology.parallel:result is None 2024-05-06T21:08:31.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-06T21:08:31.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:08:50.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-05-06T21:09:05.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-06T21:09:05.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:09:06.895 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-05-06T21:09:07.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-06T21:09:07.282 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-444.el9.x86_64"... 2024-05-06T21:09:07.282 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-05-06T21:09:07.338 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-444.el9.x86_64 2024-05-06T21:09:07.338 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-06T21:09:07.338 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-06T21:09:07.338 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-06T21:09:08.339 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-05-06T21:09:08.340 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-06T21:09:08.421 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-05-06T21:09:08.458 DEBUG:teuthology.parallel:result is None 2024-05-06T21:09:08.458 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-06T21:09:08.466 INFO:teuthology.task.internal:Creating test directory... 2024-05-06T21:09:08.466 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-06T21:09:08.470 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-06T21:09:08.488 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-06T21:09:08.531 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-06T21:09:08.562 INFO:teuthology.task.internal:Creating archive directory... 2024-05-06T21:09:08.562 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-06T21:09:08.565 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-06T21:09:08.598 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-06T21:09:08.605 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-06T21:09:08.605 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-06T21:09:08.636 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-06T21:09:08.667 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T21:09:08.678 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T21:09:08.683 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T21:09:08.693 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T21:09:08.695 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-06T21:09:08.702 INFO:teuthology.task.internal:Configuring sudo... 2024-05-06T21:09:08.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-06T21:09:08.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-06T21:09:08.749 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-06T21:09:08.759 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-06T21:09:08.759 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-06T21:09:08.793 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-06T21:09:08.809 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T21:09:08.895 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T21:09:08.942 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T21:09:09.022 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T21:09:09.070 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:09:09.070 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-06T21:09:09.137 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T21:09:09.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T21:09:09.239 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T21:09:09.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T21:09:09.362 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:09:09.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-06T21:09:09.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-05-06T21:09:09.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-05-06T21:09:09.481 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T21:09:09.542 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T21:09:09.813 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-06T21:09:09.821 INFO:teuthology.task.internal:Starting timer... 2024-05-06T21:09:09.822 INFO:teuthology.run_tasks:Running task pcp... 2024-05-06T21:09:09.849 INFO:teuthology.run_tasks:Running task selinux... 2024-05-06T21:09:09.883 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-06T21:09:09.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo service auditd rotate 2024-05-06T21:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout:Rotating logs: 2024-05-06T21:09:09.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-05-06T21:09:10.018 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-05-06T21:09:10.019 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-06T21:09:10.020 DEBUG:teuthology.orchestra.run.smithi032:> /usr/sbin/getenforce 2024-05-06T21:09:10.052 INFO:teuthology.orchestra.run.smithi032.stdout:Permissive 2024-05-06T21:09:10.052 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-05-06T21:09:10.078 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-05-06T21:09:10.079 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi032.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2024-05-06T21:09:10.079 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-06T21:09:10.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:09:10.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-06T21:09:10.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:09:10.147 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-06T21:09:10.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo /usr/sbin/setenforce permissive 2024-05-06T21:09:10.196 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-05-06T21:09:10.222 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-06T21:09:10.232 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-06T21:09:10.248 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-06T21:09:10.250 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-06T21:13:14.306 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-05-06T21:13:14.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-06T21:13:14.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:13:14.387 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-05-06T21:13:14.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-06T21:13:14.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-06T21:13:14.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T21:13:14.510 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-05-06T21:13:14.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-06T21:13:14.602 INFO:teuthology.run_tasks:Running task clock... 2024-05-06T21:13:14.614 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-06T21:13:14.614 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-06T21:13:14.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T21:13:14.618 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-06T21:13:14.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T21:13:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-06T21:13:14.663 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-06T21:13:14.670 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-06T21:13:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-06T21:13:14.687 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: ntpd: command not found 2024-05-06T21:13:14.698 INFO:teuthology.orchestra.run.smithi032.stdout:506 Cannot talk to daemon 2024-05-06T21:13:14.708 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-05-06T21:13:14.713 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-06T21:13:14.719 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-05-06T21:13:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-06T21:13:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-06T21:13:14.747 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-06T21:13:14.784 INFO:teuthology.orchestra.run.smithi032.stderr:bash: line 1: ntpq: command not found 2024-05-06T21:13:14.787 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T21:13:14.787 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2024-05-06T21:13:14.787 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:13:14.787 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:13:14.787 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:13:14.788 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:13:14.802 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-05-06T21:13:14.806 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T21:13:14.806 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-05-06T21:13:14.806 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:13:14.806 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:13:14.806 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:13:14.806 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:13:14.807 INFO:teuthology.run_tasks:Running task install... 2024-05-06T21:13:14.815 DEBUG:teuthology.task.install:project ceph 2024-05-06T21:13:14.816 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f273489c6dcd4bc88409993babd09dd99491162c'}} 2024-05-06T21:13:14.816 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': 'f273489c6dcd4bc88409993babd09dd99491162c'} 2024-05-06T21:13:14.816 INFO:teuthology.task.install:Using flavor: default 2024-05-06T21:13:14.821 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-06T21:13:14.821 INFO:teuthology.task.install:extra packages: [] 2024-05-06T21:13:14.822 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f273489c6dcd4bc88409993babd09dd99491162c', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-05-06T21:13:14.822 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T21:13:14.822 INFO:teuthology.packaging:ref: None 2024-05-06T21:13:14.822 INFO:teuthology.packaging:tag: v18.2.0 2024-05-06T21:13:14.822 INFO:teuthology.packaging:branch: None 2024-05-06T21:13:14.823 INFO:teuthology.packaging:sha1: f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:13:15.245 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-05-06T21:13:15.246 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-05-06T21:13:15.249 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f273489c6dcd4bc88409993babd09dd99491162c', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-05-06T21:13:15.249 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T21:13:15.249 INFO:teuthology.packaging:ref: None 2024-05-06T21:13:15.249 INFO:teuthology.packaging:tag: v18.2.0 2024-05-06T21:13:15.249 INFO:teuthology.packaging:branch: None 2024-05-06T21:13:15.249 INFO:teuthology.packaging:sha1: f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:13:15.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-05-06T21:13:15.395 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-05-06T21:13:15.396 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-05-06T21:13:15.425 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-06T21:13:15.425 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:13:15.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-06T21:13:15.457 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-06T21:13:15.457 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T21:13:15.457 INFO:teuthology.packaging:ref: None 2024-05-06T21:13:15.457 INFO:teuthology.packaging:tag: v18.2.0 2024-05-06T21:13:15.457 INFO:teuthology.packaging:branch: None 2024-05-06T21:13:15.457 INFO:teuthology.packaging:sha1: f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:13:15.457 DEBUG:teuthology.orchestra.run.smithi032:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-06T21:13:15.477 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-05-06T21:13:15.477 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-05-06T21:13:15.503 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-06T21:13:15.503 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:13:15.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-06T21:13:15.526 DEBUG:teuthology.orchestra.run.smithi032:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-06T21:13:15.531 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-06T21:13:15.531 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T21:13:15.531 INFO:teuthology.packaging:ref: None 2024-05-06T21:13:15.531 INFO:teuthology.packaging:tag: v18.2.0 2024-05-06T21:13:15.531 INFO:teuthology.packaging:branch: None 2024-05-06T21:13:15.531 INFO:teuthology.packaging:sha1: f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:13:15.531 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-06T21:13:15.598 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-06T21:13:15.606 DEBUG:teuthology.orchestra.run.smithi032:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-06T21:13:15.673 INFO:teuthology.orchestra.run.smithi032.stdout:check_obsoletes = 1 2024-05-06T21:13:15.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum clean all 2024-05-06T21:13:15.675 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-06T21:13:15.740 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-05-06T21:13:15.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-05-06T21:13:15.914 INFO:teuthology.orchestra.run.smithi032.stdout:53 files removed 2024-05-06T21:13:15.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-radosgw 2024-05-06T21:13:15.976 INFO:teuthology.orchestra.run.smithi154.stdout:53 files removed 2024-05-06T21:13:16.003 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw 2024-05-06T21:13:16.401 INFO:teuthology.orchestra.run.smithi032.stdout:ceph packages for x86_64 439 kB/s | 76 kB 00:00 2024-05-06T21:13:16.437 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 505 kB/s | 76 kB 00:00 2024-05-06T21:13:16.626 INFO:teuthology.orchestra.run.smithi032.stdout:ceph noarch packages 54 kB/s | 9.3 kB 00:00 2024-05-06T21:13:16.638 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 64 kB/s | 9.3 kB 00:00 2024-05-06T21:13:16.844 INFO:teuthology.orchestra.run.smithi032.stdout:ceph source packages 12 kB/s | 2.2 kB 00:00 2024-05-06T21:13:16.863 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 12 kB/s | 2.2 kB 00:00 2024-05-06T21:13:19.255 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.1 MB 00:02 2024-05-06T21:13:19.686 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.1 MB 00:02 2024-05-06T21:13:35.179 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 19 MB 00:14 2024-05-06T21:13:36.952 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:16 2024-05-06T21:13:41.126 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.2 MB 00:02 2024-05-06T21:13:42.516 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-05-06T21:13:42.590 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-05-06T21:13:44.355 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 16 kB 00:00 2024-05-06T21:13:46.586 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 21 MB 00:03 2024-05-06T21:13:47.357 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 21 MB 00:02 2024-05-06T21:13:51.767 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-06T21:13:52.690 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-06T21:13:54.111 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:13:54.127 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:13:54.128 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-05-06T21:13:54.128 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:13:54.128 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:13:54.128 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-05-06T21:13:54.128 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-05-06T21:13:54.128 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-06T21:13:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-05-06T21:13:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-06T21:13:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-06T21:13:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-06T21:13:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-05-06T21:13:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-06T21:13:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:13:54.131 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:13:54.132 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:13:54.132 INFO:teuthology.orchestra.run.smithi154.stdout:Install 28 Packages 2024-05-06T21:13:54.132 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 2 Packages 2024-05-06T21:13:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:13:54.132 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 53 M 2024-05-06T21:13:54.132 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:13:54.459 INFO:teuthology.orchestra.run.smithi154.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 27 MB/s | 5.2 MB 00:00 2024-05-06T21:13:54.484 INFO:teuthology.orchestra.run.smithi154.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 971 kB/s | 24 kB 00:00 2024-05-06T21:13:54.518 INFO:teuthology.orchestra.run.smithi154.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 19 MB/s | 653 kB 00:00 2024-05-06T21:13:54.552 INFO:teuthology.orchestra.run.smithi154.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-05-06T21:13:54.669 INFO:teuthology.orchestra.run.smithi154.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 19 MB/s | 7.6 MB 00:00 2024-05-06T21:13:54.694 INFO:teuthology.orchestra.run.smithi154.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-05-06T21:13:54.711 INFO:teuthology.orchestra.run.smithi154.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 7.0 MB/s | 119 kB 00:00 2024-05-06T21:13:54.736 INFO:teuthology.orchestra.run.smithi154.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 6.1 MB/s | 155 kB 00:00 2024-05-06T21:13:54.762 INFO:teuthology.orchestra.run.smithi154.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-05-06T21:13:54.821 INFO:teuthology.orchestra.run.smithi154.stdout:(10/30): librgw2-18.2.0-0.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-05-06T21:13:54.846 INFO:teuthology.orchestra.run.smithi154.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 3.5 MB/s | 297 kB 00:00 2024-05-06T21:13:54.871 INFO:teuthology.orchestra.run.smithi154.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-05-06T21:13:55.088 INFO:teuthology.orchestra.run.smithi154.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 22 MB/s | 18 MB 00:00 2024-05-06T21:13:55.126 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:13:55.130 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:13:55.130 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-05-06T21:13:55.130 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:13:55.130 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:13:55.130 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-05-06T21:13:55.130 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrading: 2024-05-06T21:13:55.130 INFO:teuthology.orchestra.run.smithi032.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-05-06T21:13:55.130 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-06T21:13:55.131 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-06T21:13:55.132 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:13:55.133 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:13:55.133 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:13:55.133 INFO:teuthology.orchestra.run.smithi032.stdout:Install 28 Packages 2024-05-06T21:13:55.133 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrade 2 Packages 2024-05-06T21:13:55.133 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:13:55.134 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 53 M 2024-05-06T21:13:55.134 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:13:55.447 INFO:teuthology.orchestra.run.smithi154.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 126 kB/s | 45 kB 00:00 2024-05-06T21:13:55.480 INFO:teuthology.orchestra.run.smithi154.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 168 kB/s | 107 kB 00:00 2024-05-06T21:13:55.517 INFO:teuthology.orchestra.run.smithi032.stdout:(1/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 33 MB/s | 7.6 MB 00:00 2024-05-06T21:13:55.522 INFO:teuthology.orchestra.run.smithi154.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 246 kB/s | 160 kB 00:00 2024-05-06T21:13:55.542 INFO:teuthology.orchestra.run.smithi032.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 967 kB/s | 24 kB 00:00 2024-05-06T21:13:55.576 INFO:teuthology.orchestra.run.smithi032.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 19 MB/s | 653 kB 00:00 2024-05-06T21:13:55.610 INFO:teuthology.orchestra.run.smithi032.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-05-06T21:13:55.631 INFO:teuthology.orchestra.run.smithi154.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 390 kB/s | 42 kB 00:00 2024-05-06T21:13:55.677 INFO:teuthology.orchestra.run.smithi032.stdout:(5/30): ceph-base-18.2.0-0.el9.x86_64.rpm 13 MB/s | 5.2 MB 00:00 2024-05-06T21:13:55.702 INFO:teuthology.orchestra.run.smithi032.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-05-06T21:13:55.723 INFO:teuthology.orchestra.run.smithi154.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 1.2 MB/s | 111 kB 00:00 2024-05-06T21:13:55.736 INFO:teuthology.orchestra.run.smithi032.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 3.5 MB/s | 119 kB 00:00 2024-05-06T21:13:55.756 INFO:teuthology.orchestra.run.smithi154.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-05-06T21:13:55.782 INFO:teuthology.orchestra.run.smithi154.stdout:(20/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 5.2 MB/s | 309 kB 00:00 2024-05-06T21:13:55.790 INFO:teuthology.orchestra.run.smithi032.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 2.8 MB/s | 155 kB 00:00 2024-05-06T21:13:55.807 INFO:teuthology.orchestra.run.smithi154.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-05-06T21:13:55.820 INFO:teuthology.orchestra.run.smithi032.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 11 MB/s | 321 kB 00:00 2024-05-06T21:13:55.841 INFO:teuthology.orchestra.run.smithi154.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-05-06T21:13:55.845 INFO:teuthology.orchestra.run.smithi032.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 12 MB/s | 297 kB 00:00 2024-05-06T21:13:55.870 INFO:teuthology.orchestra.run.smithi032.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-05-06T21:13:55.874 INFO:teuthology.orchestra.run.smithi154.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-05-06T21:13:55.900 INFO:teuthology.orchestra.run.smithi154.stdout:(24/30): librdkafka-1.6.1-102.el9.x86_64.rpm 1.4 MB/s | 662 kB 00:00 2024-05-06T21:13:55.942 INFO:teuthology.orchestra.run.smithi154.stdout:(25/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-05-06T21:13:55.946 INFO:teuthology.orchestra.run.smithi032.stdout:(12/30): librgw2-18.2.0-0.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-06T21:13:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:(26/30): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-05-06T21:13:56.067 INFO:teuthology.orchestra.run.smithi154.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-06T21:13:56.093 INFO:teuthology.orchestra.run.smithi154.stdout:(28/30): re2-20211101-3.el9.x86_64.rpm 996 kB/s | 192 kB 00:00 2024-05-06T21:13:56.168 INFO:teuthology.orchestra.run.smithi154.stdout:(29/30): librados2-18.2.0-0.el9.x86_64.rpm 23 MB/s | 3.3 MB 00:00 2024-05-06T21:13:56.171 INFO:teuthology.orchestra.run.smithi032.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 21 MB/s | 18 MB 00:00 2024-05-06T21:13:56.218 INFO:teuthology.orchestra.run.smithi154.stdout:(30/30): librbd1-18.2.0-0.el9.x86_64.rpm 20 MB/s | 3.0 MB 00:00 2024-05-06T21:13:56.220 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:13:56.221 INFO:teuthology.orchestra.run.smithi154.stdout:Total 25 MB/s | 53 MB 00:02 2024-05-06T21:13:56.297 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:13:56.333 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:13:56.333 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:13:56.396 INFO:teuthology.orchestra.run.smithi032.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 203 kB/s | 107 kB 00:00 2024-05-06T21:13:56.538 INFO:teuthology.orchestra.run.smithi032.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 123 kB/s | 45 kB 00:00 2024-05-06T21:13:56.630 INFO:teuthology.orchestra.run.smithi032.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 234 kB/s | 160 kB 00:00 2024-05-06T21:13:56.730 INFO:teuthology.orchestra.run.smithi032.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 423 kB/s | 42 kB 00:00 2024-05-06T21:13:56.915 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:13:56.915 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:13:56.964 INFO:teuthology.orchestra.run.smithi032.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-05-06T21:13:57.023 INFO:teuthology.orchestra.run.smithi032.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 604 kB/s | 292 kB 00:00 2024-05-06T21:13:57.465 INFO:teuthology.orchestra.run.smithi032.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 151 kB/s | 111 kB 00:00 2024-05-06T21:13:57.598 INFO:teuthology.orchestra.run.smithi032.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-05-06T21:13:57.665 INFO:teuthology.orchestra.run.smithi032.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 459 kB/s | 309 kB 00:00 2024-05-06T21:13:57.716 INFO:teuthology.orchestra.run.smithi032.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-05-06T21:13:57.783 INFO:teuthology.orchestra.run.smithi032.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 576 kB/s | 67 kB 00:00 2024-05-06T21:13:57.924 INFO:teuthology.orchestra.run.smithi032.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-05-06T21:13:58.058 INFO:teuthology.orchestra.run.smithi032.stdout:(26/30): libarrow-9.0.0-11.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-05-06T21:13:58.125 INFO:teuthology.orchestra.run.smithi032.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 49 MB/s | 3.3 MB 00:00 2024-05-06T21:13:58.159 INFO:teuthology.orchestra.run.smithi032.stdout:(28/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.9 MB/s | 839 kB 00:00 2024-05-06T21:13:58.234 INFO:teuthology.orchestra.run.smithi032.stdout:(29/30): librbd1-18.2.0-0.el9.x86_64.rpm 28 MB/s | 3.0 MB 00:00 2024-05-06T21:13:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:13:58.326 INFO:teuthology.orchestra.run.smithi032.stdout:(30/30): thrift-0.15.0-2.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-05-06T21:13:58.330 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:13:58.330 INFO:teuthology.orchestra.run.smithi032.stdout:Total 16 MB/s | 53 MB 00:03 2024-05-06T21:13:58.394 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-05-06T21:13:58.404 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:13:58.424 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-05-06T21:13:58.443 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:13:58.444 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:13:58.474 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-05-06T21:13:58.862 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-05-06T21:13:58.914 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-05-06T21:13:59.006 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-05-06T21:13:59.030 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:13:59.030 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:13:59.094 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-05-06T21:13:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-05-06T21:13:59.187 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-05-06T21:13:59.224 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-05-06T21:13:59.267 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-05-06T21:13:59.334 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-05-06T21:13:59.360 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-05-06T21:13:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-05-06T21:13:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-05-06T21:13:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-05-06T21:13:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-05-06T21:13:59.641 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-05-06T21:13:59.668 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-05-06T21:13:59.704 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-05-06T21:13:59.737 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-05-06T21:14:00.035 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-05-06T21:14:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-05-06T21:14:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-05-06T21:14:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-05-06T21:14:00.232 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-05-06T21:14:00.486 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:14:00.572 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-05-06T21:14:00.607 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-05-06T21:14:00.619 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-05-06T21:14:00.652 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-05-06T21:14:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-05-06T21:14:00.707 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-05-06T21:14:00.783 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-05-06T21:14:00.813 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-05-06T21:14:01.062 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-05-06T21:14:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-05-06T21:14:01.215 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-05-06T21:14:01.306 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-05-06T21:14:01.341 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-05-06T21:14:01.404 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-05-06T21:14:01.441 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-05-06T21:14:01.491 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-05-06T21:14:01.560 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-05-06T21:14:01.585 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-05-06T21:14:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-05-06T21:14:01.761 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-05-06T21:14:01.793 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-05-06T21:14:01.842 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-05-06T21:14:01.899 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-05-06T21:14:01.926 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-05-06T21:14:01.971 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-05-06T21:14:02.004 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-05-06T21:14:02.318 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-05-06T21:14:02.358 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-05-06T21:14:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-05-06T21:14:02.480 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-05-06T21:14:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-05-06T21:14:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-05-06T21:14:02.932 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-05-06T21:14:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-05-06T21:14:02.961 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-05-06T21:14:03.025 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-05-06T21:14:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-05-06T21:14:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-05-06T21:14:03.501 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-05-06T21:14:03.548 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-05-06T21:14:03.646 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-05-06T21:14:03.646 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-06T21:14:03.646 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-06T21:14:03.646 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:03.691 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-05-06T21:14:05.290 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-05-06T21:14:05.319 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-05-06T21:14:05.906 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-05-06T21:14:05.940 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-05-06T21:14:06.050 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-05-06T21:14:06.050 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-06T21:14:06.050 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-06T21:14:06.050 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:06.091 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-05-06T21:14:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-05-06T21:14:13.214 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-05-06T21:14:13.214 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-05-06T21:14:13.214 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-05-06T21:14:13.214 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-05-06T21:14:13.214 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-05-06T21:14:13.215 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-05-06T21:14:13.215 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-05-06T21:14:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:13.976 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-05-06T21:14:14.002 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-05-06T21:14:14.002 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:14.002 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-06T21:14:14.002 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-06T21:14:14.002 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-06T21:14:14.002 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:14.004 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-05-06T21:14:14.088 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-05-06T21:14:14.088 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T21:14:15.249 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T21:14:15.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-05-06T21:14:15.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-05-06T21:14:15.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-05-06T21:14:15.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-05-06T21:14:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-05-06T21:14:15.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-05-06T21:14:16.024 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-05-06T21:14:16.024 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /sys 2024-05-06T21:14:16.024 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /proc 2024-05-06T21:14:16.024 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /mnt 2024-05-06T21:14:16.024 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /var/tmp 2024-05-06T21:14:16.025 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /home 2024-05-06T21:14:16.025 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /root 2024-05-06T21:14:16.025 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /tmp 2024-05-06T21:14:16.025 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: fmt-8.1.1-5.el9.x86_64 2024-05-06T21:14:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-06T21:14:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-3.el9.x86_64 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:16.068 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:14:16.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-test 2024-05-06T21:14:16.904 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-05-06T21:14:16.930 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-05-06T21:14:16.930 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:16.930 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-06T21:14:16.931 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-06T21:14:16.931 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-06T21:14:16.931 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:16.932 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-05-06T21:14:16.985 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:25 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:14:17.023 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-05-06T21:14:17.023 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T21:14:17.105 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:14:17.106 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:17.106 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-06T21:14:17.106 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:17.106 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:14:17.106 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-05-06T21:14:17.106 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-06T21:14:17.106 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-05-06T21:14:17.106 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-06T21:14:17.107 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-06T21:14:17.107 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:17.107 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:14:17.107 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:17.107 INFO:teuthology.orchestra.run.smithi154.stdout:Install 4 Packages 2024-05-06T21:14:17.107 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:17.107 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 40 M 2024-05-06T21:14:17.108 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 165 M 2024-05-06T21:14:17.108 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:14:17.589 INFO:teuthology.orchestra.run.smithi154.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.2 MB/s | 161 kB 00:00 2024-05-06T21:14:18.062 INFO:teuthology.orchestra.run.smithi154.stdout:(2/4): ceph-test-18.2.0-0.el9.x86_64.rpm 66 MB/s | 40 MB 00:00 2024-05-06T21:14:18.087 INFO:teuthology.orchestra.run.smithi154.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 128 kB/s | 64 kB 00:00 2024-05-06T21:14:18.172 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T21:14:18.172 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-05-06T21:14:18.172 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-05-06T21:14:18.172 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-05-06T21:14:18.172 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-05-06T21:14:18.172 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-05-06T21:14:18.172 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-05-06T21:14:18.172 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-05-06T21:14:18.172 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-05-06T21:14:18.173 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-05-06T21:14:18.174 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-05-06T21:14:18.174 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-05-06T21:14:18.174 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-05-06T21:14:18.174 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-05-06T21:14:18.174 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-05-06T21:14:18.174 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-05-06T21:14:18.174 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-05-06T21:14:18.174 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-05-06T21:14:18.174 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-05-06T21:14:18.495 INFO:teuthology.orchestra.run.smithi154.stdout:(4/4): socat-1.7.4.1-5.el9.x86_64.rpm 295 kB/s | 305 kB 00:01 2024-05-06T21:14:18.497 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:18.498 INFO:teuthology.orchestra.run.smithi154.stdout:Total 29 MB/s | 40 MB 00:01 2024-05-06T21:14:18.525 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:14:18.546 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:14:18.546 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:14:18.866 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:14:18.866 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout:Upgraded: 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: fmt-8.1.1-5.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: re2-1:20211101-3.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:18.971 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:14:19.318 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-test 2024-05-06T21:14:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:14:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-06T21:14:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-06T21:14:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-05-06T21:14:19.902 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:27 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:14:20.026 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:14:20.026 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout:Install 4 Packages 2024-05-06T21:14:20.027 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:20.028 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 40 M 2024-05-06T21:14:20.028 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 165 M 2024-05-06T21:14:20.028 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:14:20.198 INFO:teuthology.orchestra.run.smithi032.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.5 MB/s | 161 kB 00:00 2024-05-06T21:14:20.290 INFO:teuthology.orchestra.run.smithi032.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-05-06T21:14:20.315 INFO:teuthology.orchestra.run.smithi032.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 545 kB/s | 64 kB 00:00 2024-05-06T21:14:20.741 INFO:teuthology.orchestra.run.smithi032.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 61 MB/s | 40 MB 00:00 2024-05-06T21:14:20.743 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:20.743 INFO:teuthology.orchestra.run.smithi032.stdout:Total 56 MB/s | 40 MB 00:00 2024-05-06T21:14:20.772 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:14:20.794 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:14:20.794 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:14:21.130 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:14:21.130 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:14:21.620 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:14:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-06T21:14:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-06T21:14:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-05-06T21:14:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-05-06T21:14:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-05-06T21:14:25.363 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-05-06T21:14:25.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-05-06T21:14:25.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-05-06T21:14:25.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-06T21:14:25.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-06T21:14:25.650 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:25.650 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:14:25.650 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:25.650 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-05-06T21:14:25.650 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:25.651 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:14:25.720 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-05-06T21:14:25.803 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-05-06T21:14:25.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph 2024-05-06T21:14:26.479 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:35 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:14:26.606 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-05-06T21:14:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-06T21:14:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-06T21:14:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-06T21:14:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:26.612 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:14:26.612 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:26.612 INFO:teuthology.orchestra.run.smithi154.stdout:Install 33 Packages 2024-05-06T21:14:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:26.613 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 30 M 2024-05-06T21:14:26.613 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 109 M 2024-05-06T21:14:26.613 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:14:27.140 INFO:teuthology.orchestra.run.smithi154.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 64 kB/s | 6.4 kB 00:00 2024-05-06T21:14:27.182 INFO:teuthology.orchestra.run.smithi154.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-05-06T21:14:27.241 INFO:teuthology.orchestra.run.smithi154.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 10 MB/s | 2.1 MB 00:00 2024-05-06T21:14:27.266 INFO:teuthology.orchestra.run.smithi154.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.5 MB/s | 240 kB 00:00 2024-05-06T21:14:27.350 INFO:teuthology.orchestra.run.smithi154.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-05-06T21:14:27.575 INFO:teuthology.orchestra.run.smithi154.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 45 MB/s | 18 MB 00:00 2024-05-06T21:14:27.851 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-05-06T21:14:27.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-05-06T21:14:27.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-05-06T21:14:27.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-06T21:14:27.942 INFO:teuthology.orchestra.run.smithi154.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 375 kB/s | 253 kB 00:00 2024-05-06T21:14:28.067 INFO:teuthology.orchestra.run.smithi154.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 217 kB/s | 106 kB 00:00 2024-05-06T21:14:28.093 INFO:teuthology.orchestra.run.smithi154.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 898 kB/s | 135 kB 00:00 2024-05-06T21:14:28.154 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-06T21:14:28.155 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:28.155 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:14:28.155 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:28.155 INFO:teuthology.orchestra.run.smithi032.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-05-06T21:14:28.155 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:28.155 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:14:28.210 INFO:teuthology.orchestra.run.smithi154.stdout:(10/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-05-06T21:14:28.243 INFO:teuthology.orchestra.run.smithi154.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 711 kB/s | 125 kB 00:00 2024-05-06T21:14:28.319 INFO:teuthology.orchestra.run.smithi154.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 463 kB/s | 35 kB 00:00 2024-05-06T21:14:28.343 INFO:teuthology.orchestra.run.smithi154.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-05-06T21:14:28.377 INFO:teuthology.orchestra.run.smithi154.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2024-05-06T21:14:28.403 INFO:teuthology.orchestra.run.smithi154.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-05-06T21:14:28.428 INFO:teuthology.orchestra.run.smithi154.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 496 kB/s | 42 kB 00:00 2024-05-06T21:14:28.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph 2024-05-06T21:14:28.520 INFO:teuthology.orchestra.run.smithi154.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 306 kB/s | 43 kB 00:00 2024-05-06T21:14:28.570 INFO:teuthology.orchestra.run.smithi154.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-05-06T21:14:28.595 INFO:teuthology.orchestra.run.smithi154.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 142 kB/s | 11 kB 00:00 2024-05-06T21:14:28.621 INFO:teuthology.orchestra.run.smithi154.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-05-06T21:14:28.646 INFO:teuthology.orchestra.run.smithi154.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-05-06T21:14:28.671 INFO:teuthology.orchestra.run.smithi154.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2024-05-06T21:14:28.696 INFO:teuthology.orchestra.run.smithi154.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-05-06T21:14:28.722 INFO:teuthology.orchestra.run.smithi154.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-05-06T21:14:28.747 INFO:teuthology.orchestra.run.smithi154.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 613 kB/s | 46 kB 00:00 2024-05-06T21:14:28.764 INFO:teuthology.orchestra.run.smithi154.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-05-06T21:14:28.789 INFO:teuthology.orchestra.run.smithi154.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-06T21:14:28.814 INFO:teuthology.orchestra.run.smithi154.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 244 kB/s | 16 kB 00:00 2024-05-06T21:14:28.840 INFO:teuthology.orchestra.run.smithi154.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-05-06T21:14:28.865 INFO:teuthology.orchestra.run.smithi154.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 891 kB/s | 90 kB 00:00 2024-05-06T21:14:28.917 INFO:teuthology.orchestra.run.smithi154.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 400 kB/s | 20 kB 00:00 2024-05-06T21:14:28.940 INFO:teuthology.orchestra.run.smithi154.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-05-06T21:14:28.966 INFO:teuthology.orchestra.run.smithi154.stdout:(33/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-05-06T21:14:28.967 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:28.967 INFO:teuthology.orchestra.run.smithi154.stdout:Total 13 MB/s | 30 MB 00:02 2024-05-06T21:14:29.029 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:37 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:14:29.090 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:14:29.128 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:14:29.128 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:14:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:14:29.161 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:29.161 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-05-06T21:14:29.161 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-06T21:14:29.162 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-06T21:14:29.163 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:14:29.164 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:29.165 INFO:teuthology.orchestra.run.smithi032.stdout:Install 33 Packages 2024-05-06T21:14:29.165 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:29.165 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 30 M 2024-05-06T21:14:29.165 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 109 M 2024-05-06T21:14:29.165 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:14:29.511 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:14:29.512 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:14:29.812 INFO:teuthology.orchestra.run.smithi032.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 56 kB/s | 6.4 kB 00:00 2024-05-06T21:14:29.862 INFO:teuthology.orchestra.run.smithi032.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 8.7 MB/s | 1.4 MB 00:00 2024-05-06T21:14:29.912 INFO:teuthology.orchestra.run.smithi032.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 9.7 MB/s | 2.1 MB 00:00 2024-05-06T21:14:29.937 INFO:teuthology.orchestra.run.smithi032.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.5 MB/s | 240 kB 00:00 2024-05-06T21:14:30.021 INFO:teuthology.orchestra.run.smithi032.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-05-06T21:14:30.255 INFO:teuthology.orchestra.run.smithi032.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 45 MB/s | 18 MB 00:00 2024-05-06T21:14:30.605 INFO:teuthology.orchestra.run.smithi032.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 379 kB/s | 253 kB 00:00 2024-05-06T21:14:30.677 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:14:30.680 INFO:teuthology.orchestra.run.smithi032.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 250 kB/s | 106 kB 00:00 2024-05-06T21:14:30.713 INFO:teuthology.orchestra.run.smithi032.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-05-06T21:14:30.751 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-05-06T21:14:30.784 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-05-06T21:14:30.817 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-05-06T21:14:30.822 INFO:teuthology.orchestra.run.smithi032.stdout:(10/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-05-06T21:14:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 679 kB/s | 125 kB 00:00 2024-05-06T21:14:30.910 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-05-06T21:14:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-05-06T21:14:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 377 kB/s | 35 kB 00:00 2024-05-06T21:14:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-05-06T21:14:31.023 INFO:teuthology.orchestra.run.smithi032.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-05-06T21:14:31.049 INFO:teuthology.orchestra.run.smithi032.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-05-06T21:14:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-05-06T21:14:31.088 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-05-06T21:14:31.107 INFO:teuthology.orchestra.run.smithi032.stdout:(16/33): python3-cryptography-36.0.1-4.el9.x86_ 1.1 MB/s | 1.2 MB 00:01 2024-05-06T21:14:31.118 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-05-06T21:14:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-05-06T21:14:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-05-06T21:14:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-05-06T21:14:31.261 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-05-06T21:14:31.295 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-05-06T21:14:31.341 INFO:teuthology.orchestra.run.smithi032.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 137 kB/s | 43 kB 00:00 2024-05-06T21:14:31.342 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-05-06T21:14:31.424 INFO:teuthology.orchestra.run.smithi032.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-05-06T21:14:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-05-06T21:14:31.508 INFO:teuthology.orchestra.run.smithi032.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 212 kB/s | 18 kB 00:00 2024-05-06T21:14:31.533 INFO:teuthology.orchestra.run.smithi032.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 355 kB/s | 172 kB 00:00 2024-05-06T21:14:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-05-06T21:14:31.592 INFO:teuthology.orchestra.run.smithi032.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 278 kB/s | 23 kB 00:00 2024-05-06T21:14:31.609 INFO:teuthology.orchestra.run.smithi032.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-05-06T21:14:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-05-06T21:14:31.684 INFO:teuthology.orchestra.run.smithi032.stdout:(23/33): python3-cherrypy-18.6.1-2.el9.noarch.r 686 kB/s | 358 kB 00:00 2024-05-06T21:14:31.709 INFO:teuthology.orchestra.run.smithi032.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 168 kB/s | 20 kB 00:00 2024-05-06T21:14:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-05-06T21:14:31.743 INFO:teuthology.orchestra.run.smithi032.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 345 kB/s | 46 kB 00:00 2024-05-06T21:14:31.751 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-05-06T21:14:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-05-06T21:14:31.810 INFO:teuthology.orchestra.run.smithi032.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-05-06T21:14:31.835 INFO:teuthology.orchestra.run.smithi032.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 522 kB/s | 79 kB 00:00 2024-05-06T21:14:31.861 INFO:teuthology.orchestra.run.smithi032.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 140 kB/s | 16 kB 00:00 2024-05-06T21:14:31.882 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-05-06T21:14:31.886 INFO:teuthology.orchestra.run.smithi032.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-05-06T21:14:31.945 INFO:teuthology.orchestra.run.smithi032.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 430 kB/s | 36 kB 00:00 2024-05-06T21:14:31.987 INFO:teuthology.orchestra.run.smithi032.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-05-06T21:14:32.012 INFO:teuthology.orchestra.run.smithi032.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-05-06T21:14:32.037 INFO:teuthology.orchestra.run.smithi032.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 217 kB/s | 20 kB 00:00 2024-05-06T21:14:32.042 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:32.042 INFO:teuthology.orchestra.run.smithi032.stdout:Total 10 MB/s | 30 MB 00:02 2024-05-06T21:14:32.078 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-05-06T21:14:32.130 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-05-06T21:14:32.169 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:14:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-05-06T21:14:32.210 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:14:32.210 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:14:32.290 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-05-06T21:14:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-05-06T21:14:32.446 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-05-06T21:14:32.599 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-05-06T21:14:32.603 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:14:32.603 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:14:32.623 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-05-06T21:14:32.648 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-05-06T21:14:32.648 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:32.648 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-06T21:14:32.648 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-06T21:14:32.648 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-06T21:14:32.648 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:33.805 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:14:33.874 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-05-06T21:14:33.906 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-05-06T21:14:33.939 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-05-06T21:14:34.036 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-05-06T21:14:34.120 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-05-06T21:14:34.167 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-05-06T21:14:34.216 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-05-06T21:14:34.219 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-05-06T21:14:34.246 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-05-06T21:14:34.246 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:34.246 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-06T21:14:34.246 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-06T21:14:34.246 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-06T21:14:34.246 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:34.248 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-05-06T21:14:34.283 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-05-06T21:14:34.317 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-05-06T21:14:34.358 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-05-06T21:14:34.402 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-05-06T21:14:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-05-06T21:14:34.474 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-05-06T21:14:34.550 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-05-06T21:14:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-05-06T21:14:34.710 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-05-06T21:14:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-05-06T21:14:34.725 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:34.725 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-06T21:14:34.725 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-06T21:14:34.725 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-06T21:14:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:34.793 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-05-06T21:14:34.854 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-05-06T21:14:34.891 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-05-06T21:14:34.935 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-05-06T21:14:34.950 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-05-06T21:14:34.958 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-05-06T21:14:34.958 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:34.958 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-06T21:14:34.958 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-06T21:14:34.959 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-06T21:14:34.959 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:35.022 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-05-06T21:14:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-05-06T21:14:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-05-06T21:14:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-05-06T21:14:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-05-06T21:14:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-05-06T21:14:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-05-06T21:14:35.650 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-05-06T21:14:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-05-06T21:14:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-05-06T21:14:35.874 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-05-06T21:14:35.874 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:35.874 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-06T21:14:35.874 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-06T21:14:35.874 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-06T21:14:35.874 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:36.738 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-05-06T21:14:36.738 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-05-06T21:14:36.738 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-05-06T21:14:36.738 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-05-06T21:14:36.738 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-05-06T21:14:36.738 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-05-06T21:14:36.739 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-05-06T21:14:36.740 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-05-06T21:14:36.741 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-05-06T21:14:37.482 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-05-06T21:14:37.513 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-05-06T21:14:37.513 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:37.513 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-06T21:14:37.513 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-06T21:14:37.513 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-06T21:14:37.513 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:37.546 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-05-06T21:14:37.546 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-06T21:14:37.547 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-06T21:14:37.548 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-06T21:14:37.549 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-06T21:14:37.549 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-06T21:14:37.549 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-06T21:14:37.549 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-06T21:14:37.549 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-06T21:14:37.549 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:37.549 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:14:37.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-base 2024-05-06T21:14:37.983 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-05-06T21:14:38.008 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-05-06T21:14:38.008 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:38.009 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-06T21:14:38.009 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-06T21:14:38.009 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-06T21:14:38.009 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:38.225 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-05-06T21:14:38.250 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-05-06T21:14:38.250 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:38.250 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-06T21:14:38.251 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-06T21:14:38.251 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-06T21:14:38.251 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:38.316 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-05-06T21:14:38.491 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:47 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:14:38.572 INFO:teuthology.orchestra.run.smithi154.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:14:38.613 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:14:38.614 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-05-06T21:14:38.614 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:14:38.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install cephadm 2024-05-06T21:14:39.237 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:48 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:14:39.359 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:14:39.359 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 209 k 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 200 k 2024-05-06T21:14:39.360 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:14:39.433 INFO:teuthology.orchestra.run.smithi154.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.8 MB/s | 209 kB 00:00 2024-05-06T21:14:39.434 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:39.434 INFO:teuthology.orchestra.run.smithi154.stdout:Total 2.7 MB/s | 209 kB 00:00 2024-05-06T21:14:39.434 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:14:39.439 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:14:39.439 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:14:39.442 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:14:39.442 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:14:39.509 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:14:39.955 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-05-06T21:14:40.046 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-05-06T21:14:40.112 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-05-06T21:14:40.112 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-05-06T21:14:40.112 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-05-06T21:14:40.112 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-05-06T21:14:40.112 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-05-06T21:14:40.112 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-05-06T21:14:40.112 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-05-06T21:14:40.112 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-05-06T21:14:40.113 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-05-06T21:14:40.114 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-05-06T21:14:40.114 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-05-06T21:14:40.114 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-05-06T21:14:40.115 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-05-06T21:14:40.115 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-05-06T21:14:40.115 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-05-06T21:14:40.115 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-05-06T21:14:40.115 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-05-06T21:14:40.115 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-05-06T21:14:40.115 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-05-06T21:14:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-05-06T21:14:40.616 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-05-06T21:14:40.616 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:40.616 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:14:40.616 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-05-06T21:14:40.616 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:40.616 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:14:40.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-immutable-object-cache 2024-05-06T21:14:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-05-06T21:14:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:41.008 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-06T21:14:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ply-3.11-14.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-06T21:14:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-06T21:14:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-06T21:14:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-06T21:14:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-06T21:14:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-06T21:14:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-06T21:14:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:41.011 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:14:41.383 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-base 2024-05-06T21:14:41.428 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:50 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:14:41.553 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:14:41.553 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:41.553 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repo Size 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 142 k 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 399 k 2024-05-06T21:14:41.554 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:14:41.616 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.3 MB/s | 142 kB 00:00 2024-05-06T21:14:41.616 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:41.616 INFO:teuthology.orchestra.run.smithi154.stdout:Total 2.2 MB/s | 142 kB 00:00 2024-05-06T21:14:41.617 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:14:41.624 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:14:41.624 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:14:41.682 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:14:41.683 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:14:41.821 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:14:41.900 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:14:41.925 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:14:41.925 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:41.925 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-06T21:14:41.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:41.972 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:49 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:14:42.055 INFO:teuthology.orchestra.run.smithi032.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:14:42.099 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:14:42.100 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-05-06T21:14:42.100 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:14:42.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install cephadm 2024-05-06T21:14:42.761 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:50 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:14:42.765 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:14:42.765 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:42.765 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:14:42.765 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:42.765 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:42.766 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:14:42.887 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:Install 1 Package 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 209 k 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 200 k 2024-05-06T21:14:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:14:42.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr 2024-05-06T21:14:42.960 INFO:teuthology.orchestra.run.smithi032.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.8 MB/s | 209 kB 00:00 2024-05-06T21:14:42.961 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:42.961 INFO:teuthology.orchestra.run.smithi032.stdout:Total 2.8 MB/s | 209 kB 00:00 2024-05-06T21:14:42.961 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:14:42.967 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:14:42.967 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:14:42.970 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:14:42.970 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:14:43.039 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:14:43.507 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-05-06T21:14:43.519 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:52 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:14:43.601 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-05-06T21:14:43.603 INFO:teuthology.orchestra.run.smithi154.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:14:43.644 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:14:43.645 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-05-06T21:14:43.645 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:14:43.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr-dashboard 2024-05-06T21:14:43.931 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-05-06T21:14:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-05-06T21:14:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:44.201 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:14:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-05-06T21:14:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:44.202 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:14:44.281 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:53 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:14:44.420 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-06T21:14:44.421 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-05-06T21:14:44.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-05-06T21:14:44.422 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:44.422 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:14:44.422 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:44.422 INFO:teuthology.orchestra.run.smithi154.stdout:Install 7 Packages 2024-05-06T21:14:44.422 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:44.422 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 2.0 M 2024-05-06T21:14:44.423 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 8.1 M 2024-05-06T21:14:44.423 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:14:44.447 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-immutable-object-cache 2024-05-06T21:14:44.612 INFO:teuthology.orchestra.run.smithi154.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 214 kB/s | 23 kB 00:00 2024-05-06T21:14:44.637 INFO:teuthology.orchestra.run.smithi154.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 110 kB/s | 15 kB 00:00 2024-05-06T21:14:44.688 INFO:teuthology.orchestra.run.smithi154.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 9.3 MB/s | 1.7 MB 00:00 2024-05-06T21:14:44.780 INFO:teuthology.orchestra.run.smithi154.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 54 kB/s | 9.0 kB 00:00 2024-05-06T21:14:44.882 INFO:teuthology.orchestra.run.smithi154.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 169 kB/s | 41 kB 00:00 2024-05-06T21:14:44.905 INFO:teuthology.orchestra.run.smithi154.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 142 kB/s | 31 kB 00:00 2024-05-06T21:14:45.040 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:53 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:14:45.122 INFO:teuthology.orchestra.run.smithi154.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 551 kB/s | 188 kB 00:00 2024-05-06T21:14:45.124 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:45.124 INFO:teuthology.orchestra.run.smithi154.stdout:Total 2.8 MB/s | 2.0 MB 00:00 2024-05-06T21:14:45.124 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:14:45.132 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:14:45.133 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:14:45.168 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repo Size 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout:Install 1 Package 2024-05-06T21:14:45.169 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:45.170 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 142 k 2024-05-06T21:14:45.170 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 399 k 2024-05-06T21:14:45.170 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:14:45.188 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:14:45.189 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:14:45.242 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 1.9 MB/s | 142 kB 00:00 2024-05-06T21:14:45.243 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:45.243 INFO:teuthology.orchestra.run.smithi032.stdout:Total 1.9 MB/s | 142 kB 00:00 2024-05-06T21:14:45.243 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:14:45.251 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:14:45.251 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:14:45.313 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:14:45.313 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:14:45.464 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:14:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:14:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-05-06T21:14:45.544 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:14:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-05-06T21:14:45.571 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:14:45.571 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:14:45.571 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-06T21:14:45.571 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-05-06T21:14:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-05-06T21:14:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-05-06T21:14:45.903 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-05-06T21:14:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-05-06T21:14:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-05-06T21:14:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-05-06T21:14:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-05-06T21:14:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-05-06T21:14:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-05-06T21:14:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-05-06T21:14:46.418 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-05-06T21:14:46.441 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:14:46.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:46.441 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:14:46.441 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-05-06T21:14:46.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:46.441 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:46.689 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:14:46.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-mgr 2024-05-06T21:14:46.943 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-06T21:14:47.311 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:55 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:14:47.395 INFO:teuthology.orchestra.run.smithi032.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:14:47.439 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:14:47.440 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-05-06T21:14:47.440 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:14:47.507 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:56 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:14:47.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-mgr-dashboard 2024-05-06T21:14:47.631 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:14:47.632 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:47.632 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-05-06T21:14:47.632 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-06T21:14:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-06T21:14:47.634 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-06T21:14:47.634 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-06T21:14:47.634 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-06T21:14:47.634 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-06T21:14:47.634 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:47.634 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:14:47.634 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:14:47.634 INFO:teuthology.orchestra.run.smithi154.stdout:Install 12 Packages 2024-05-06T21:14:47.635 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:14:47.635 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 38 M 2024-05-06T21:14:47.635 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 209 M 2024-05-06T21:14:47.635 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:14:48.021 INFO:teuthology.orchestra.run.smithi154.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 49 MB/s | 7.4 MB 00:00 2024-05-06T21:14:48.116 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:56 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:14:48.245 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:Installing weak dependencies: 2024-05-06T21:14:48.246 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-05-06T21:14:48.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:14:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:Install 7 Packages 2024-05-06T21:14:48.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 2.0 M 2024-05-06T21:14:48.247 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 8.1 M 2024-05-06T21:14:48.248 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:14:48.296 INFO:teuthology.orchestra.run.smithi154.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 119 kB/s | 33 kB 00:00 2024-05-06T21:14:48.455 INFO:teuthology.orchestra.run.smithi154.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 333 kB/s | 195 kB 00:00 2024-05-06T21:14:48.556 INFO:teuthology.orchestra.run.smithi032.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 214 kB/s | 23 kB 00:00 2024-05-06T21:14:48.566 INFO:teuthology.orchestra.run.smithi154.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-05-06T21:14:48.572 INFO:teuthology.orchestra.run.smithi032.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 117 kB/s | 15 kB 00:00 2024-05-06T21:14:48.623 INFO:teuthology.orchestra.run.smithi032.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 9.7 MB/s | 1.7 MB 00:00 2024-05-06T21:14:48.657 INFO:teuthology.orchestra.run.smithi032.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 90 kB/s | 9.0 kB 00:00 2024-05-06T21:14:48.672 INFO:teuthology.orchestra.run.smithi154.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 325 kB/s | 35 kB 00:00 2024-05-06T21:14:48.698 INFO:teuthology.orchestra.run.smithi032.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 325 kB/s | 41 kB 00:00 2024-05-06T21:14:48.715 INFO:teuthology.orchestra.run.smithi032.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 334 kB/s | 31 kB 00:00 2024-05-06T21:14:48.742 INFO:teuthology.orchestra.run.smithi154.stdout:(6/12): libgfortran-11.4.1-3.el9.x86_64.rpm 923 kB/s | 803 kB 00:00 2024-05-06T21:14:48.841 INFO:teuthology.orchestra.run.smithi032.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2024-05-06T21:14:48.842 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:48.843 INFO:teuthology.orchestra.run.smithi032.stdout:Total 3.3 MB/s | 2.0 MB 00:00 2024-05-06T21:14:48.843 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:14:48.851 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:14:48.852 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:14:48.869 INFO:teuthology.orchestra.run.smithi154.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-05-06T21:14:48.916 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:14:48.916 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:14:49.217 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:14:49.239 INFO:teuthology.orchestra.run.smithi154.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.2 MB/s | 3.0 MB 00:00 2024-05-06T21:14:49.283 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-05-06T21:14:49.318 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-05-06T21:14:49.365 INFO:teuthology.orchestra.run.smithi154.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-05-06T21:14:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-05-06T21:14:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-05-06T21:14:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-05-06T21:14:49.678 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-05-06T21:14:49.713 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-05-06T21:14:49.915 INFO:teuthology.orchestra.run.smithi154.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.9 MB/s | 5.1 MB 00:01 2024-05-06T21:14:50.229 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-05-06T21:14:50.229 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-05-06T21:14:50.229 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-05-06T21:14:50.229 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-05-06T21:14:50.229 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-05-06T21:14:50.229 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-05-06T21:14:50.229 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-05-06T21:14:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:50.507 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:14:50.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-06T21:14:51.324 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:59 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:14:51.454 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:14:51.455 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:51.455 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-05-06T21:14:51.455 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:51.456 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:14:51.456 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-05-06T21:14:51.456 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-05-06T21:14:51.456 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-06T21:14:51.456 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-06T21:14:51.456 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-06T21:14:51.456 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-06T21:14:51.456 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-06T21:14:51.457 INFO:teuthology.orchestra.run.smithi032.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-06T21:14:51.457 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-06T21:14:51.457 INFO:teuthology.orchestra.run.smithi032.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-06T21:14:51.457 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-06T21:14:51.457 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-06T21:14:51.457 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-06T21:14:51.457 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:51.458 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:14:51.458 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:14:51.458 INFO:teuthology.orchestra.run.smithi032.stdout:Install 12 Packages 2024-05-06T21:14:51.458 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:14:51.459 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 38 M 2024-05-06T21:14:51.459 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 209 M 2024-05-06T21:14:51.459 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:14:51.783 INFO:teuthology.orchestra.run.smithi032.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 44 MB/s | 7.4 MB 00:00 2024-05-06T21:14:51.859 INFO:teuthology.orchestra.run.smithi032.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 799 kB/s | 195 kB 00:00 2024-05-06T21:14:51.884 INFO:teuthology.orchestra.run.smithi032.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-05-06T21:14:51.909 INFO:teuthology.orchestra.run.smithi032.stdout:(4/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-05-06T21:14:51.934 INFO:teuthology.orchestra.run.smithi032.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 362 kB/s | 18 kB 00:00 2024-05-06T21:14:52.001 INFO:teuthology.orchestra.run.smithi032.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 383 kB/s | 35 kB 00:00 2024-05-06T21:14:52.131 INFO:teuthology.orchestra.run.smithi154.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 1.4 MB/s | 4.7 MB 00:03 2024-05-06T21:14:52.152 INFO:teuthology.orchestra.run.smithi032.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-05-06T21:14:52.177 INFO:teuthology.orchestra.run.smithi032.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-05-06T21:14:52.252 INFO:teuthology.orchestra.run.smithi032.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2024-05-06T21:14:52.294 INFO:teuthology.orchestra.run.smithi032.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-05-06T21:14:52.361 INFO:teuthology.orchestra.run.smithi032.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-05-06T21:14:52.712 INFO:teuthology.orchestra.run.smithi032.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-05-06T21:14:52.712 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:14:52.712 INFO:teuthology.orchestra.run.smithi032.stdout:Total 30 MB/s | 38 MB 00:01 2024-05-06T21:14:53.075 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:14:53.104 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:14:53.104 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:14:53.628 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:14:53.629 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:14:54.467 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:14:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-06T21:14:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-06T21:14:54.698 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-06T21:14:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-06T21:14:54.928 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-06T21:14:54.960 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-06T21:14:55.052 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-06T21:14:55.744 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-06T21:14:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-06T21:14:57.172 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-06T21:14:58.257 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-06T21:14:58.293 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-06T21:15:00.852 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-06T21:15:01.282 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-06T21:15:01.283 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-06T21:15:01.283 INFO:teuthology.orchestra.run.smithi032.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-06T21:15:01.283 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-06T21:15:01.283 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-06T21:15:01.283 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-06T21:15:01.283 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:01.283 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:01.665 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-mgr-rook 2024-05-06T21:15:02.257 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:10 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:02.385 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:02.386 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:02.386 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-05-06T21:15:02.386 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:02.386 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:15:02.386 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-05-06T21:15:02.386 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-05-06T21:15:02.386 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:15:02.387 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:02.388 INFO:teuthology.orchestra.run.smithi032.stdout:Install 13 Packages 2024-05-06T21:15:02.388 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:02.388 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 2.2 M 2024-05-06T21:15:02.388 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 26 M 2024-05-06T21:15:02.388 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:15:02.926 INFO:teuthology.orchestra.run.smithi032.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 729 kB/s | 47 kB 00:00 2024-05-06T21:15:02.951 INFO:teuthology.orchestra.run.smithi032.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 212 kB/s | 19 kB 00:00 2024-05-06T21:15:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 222 kB/s | 26 kB 00:00 2024-05-06T21:15:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-05-06T21:15:03.086 INFO:teuthology.orchestra.run.smithi032.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-05-06T21:15:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-05-06T21:15:03.136 INFO:teuthology.orchestra.run.smithi032.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.7 MB/s | 279 kB 00:00 2024-05-06T21:15:03.378 INFO:teuthology.orchestra.run.smithi032.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 110 kB/s | 32 kB 00:00 2024-05-06T21:15:03.403 INFO:teuthology.orchestra.run.smithi032.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 51 kB/s | 15 kB 00:00 2024-05-06T21:15:03.546 INFO:teuthology.orchestra.run.smithi032.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 503 kB/s | 206 kB 00:00 2024-05-06T21:15:03.570 INFO:teuthology.orchestra.run.smithi032.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 353 kB/s | 59 kB 00:00 2024-05-06T21:15:03.762 INFO:teuthology.orchestra.run.smithi032.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 414 kB/s | 90 kB 00:00 2024-05-06T21:15:03.938 INFO:teuthology.orchestra.run.smithi032.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2024-05-06T21:15:03.940 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:03.941 INFO:teuthology.orchestra.run.smithi032.stdout:Total 1.4 MB/s | 2.2 MB 00:01 2024-05-06T21:15:04.011 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:15:04.028 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:15:04.028 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:15:04.123 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:15:04.123 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:15:04.732 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:15:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-06T21:15:04.982 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-06T21:15:05.046 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-06T21:15:05.082 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-06T21:15:05.127 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-06T21:15:05.229 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-06T21:15:05.348 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-06T21:15:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-06T21:15:06.173 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-06T21:15:06.223 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-06T21:15:06.257 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-06T21:15:06.303 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-06T21:15:06.326 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-06T21:15:07.056 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-06T21:15:07.057 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-06T21:15:07.057 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-06T21:15:07.057 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-06T21:15:07.389 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-06T21:15:07.389 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:07.389 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:15:07.389 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-05-06T21:15:07.389 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:07.390 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:07.631 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-mgr-cephadm 2024-05-06T21:15:08.232 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:16 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:08.360 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:08.361 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-05-06T21:15:08.361 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:08.361 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:15:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout:Install 6 Packages 2024-05-06T21:15:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:08.363 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 7.0 M 2024-05-06T21:15:08.363 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 33 M 2024-05-06T21:15:08.363 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:15:08.691 INFO:teuthology.orchestra.run.smithi032.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.9 MB/s | 127 kB 00:00 2024-05-06T21:15:08.991 INFO:teuthology.orchestra.run.smithi032.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.8 MB/s | 548 kB 00:00 2024-05-06T21:15:09.049 INFO:teuthology.orchestra.run.smithi032.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 989 kB/s | 58 kB 00:00 2024-05-06T21:15:09.100 INFO:teuthology.orchestra.run.smithi032.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 1.0 MB/s | 51 kB 00:00 2024-05-06T21:15:09.175 INFO:teuthology.orchestra.run.smithi032.stdout:(5/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 450 kB/s | 248 kB 00:00 2024-05-06T21:15:10.904 INFO:teuthology.orchestra.run.smithi154.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 773 kB/s | 16 MB 00:21 2024-05-06T21:15:10.905 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:10.905 INFO:teuthology.orchestra.run.smithi154.stdout:Total 1.6 MB/s | 38 MB 00:23 2024-05-06T21:15:11.259 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:15:11.286 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:15:11.286 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:15:11.793 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:15:11.793 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:15:12.142 INFO:teuthology.orchestra.run.smithi032.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 1.7 MB/s | 6.0 MB 00:03 2024-05-06T21:15:12.143 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:12.143 INFO:teuthology.orchestra.run.smithi032.stdout:Total 1.8 MB/s | 7.0 MB 00:03 2024-05-06T21:15:12.220 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:15:12.232 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:15:12.232 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:15:12.336 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:15:12.338 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:15:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:15:12.647 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:15:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-06T21:15:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-06T21:15:12.840 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-06T21:15:12.846 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-06T21:15:12.889 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-06T21:15:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-06T21:15:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-06T21:15:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-06T21:15:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-06T21:15:13.444 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-06T21:15:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-06T21:15:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-06T21:15:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-05-06T21:15:13.855 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-06T21:15:13.978 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-06T21:15:14.411 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-05-06T21:15:14.411 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-05-06T21:15:14.411 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-06T21:15:14.412 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-06T21:15:14.412 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-06T21:15:14.412 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-06T21:15:14.678 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-06T21:15:14.678 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:14.679 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:15:14.679 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-05-06T21:15:14.679 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-06T21:15:14.679 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-06T21:15:14.679 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-06T21:15:14.680 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-06T21:15:14.680 INFO:teuthology.orchestra.run.smithi032.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-06T21:15:14.680 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:14.680 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:14.947 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-fuse 2024-05-06T21:15:15.227 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-06T21:15:15.540 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:23 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:15.669 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:15.669 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:15.669 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:Install 2 Packages 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 915 k 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 2.7 M 2024-05-06T21:15:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:15:16.019 INFO:teuthology.orchestra.run.smithi032.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 11 MB/s | 835 kB 00:00 2024-05-06T21:15:16.275 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-06T21:15:16.285 INFO:teuthology.orchestra.run.smithi032.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 236 kB/s | 80 kB 00:00 2024-05-06T21:15:16.286 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:16.286 INFO:teuthology.orchestra.run.smithi032.stdout:Total 1.4 MB/s | 915 kB 00:00 2024-05-06T21:15:16.299 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:15:16.305 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-05-06T21:15:16.322 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:15:16.322 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:15:16.408 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:15:16.408 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:15:16.601 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:15:16.762 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-06T21:15:16.837 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-05-06T21:15:17.505 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-05-06T21:15:17.506 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-05-06T21:15:17.770 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-06T21:15:17.770 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:17.771 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:15:17.771 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-06T21:15:17.771 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:17.771 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:18.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install librados-devel 2024-05-06T21:15:18.622 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:26 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:18.750 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:18.751 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:18.751 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:18.751 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:18.751 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:15:18.751 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-05-06T21:15:18.751 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:18.751 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:15:18.752 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:18.752 INFO:teuthology.orchestra.run.smithi032.stdout:Install 1 Package 2024-05-06T21:15:18.752 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:18.752 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 126 k 2024-05-06T21:15:18.752 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 456 k 2024-05-06T21:15:18.752 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:15:18.824 INFO:teuthology.orchestra.run.smithi032.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.7 MB/s | 126 kB 00:00 2024-05-06T21:15:18.825 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:18.825 INFO:teuthology.orchestra.run.smithi032.stdout:Total 1.7 MB/s | 126 kB 00:00 2024-05-06T21:15:18.825 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:15:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-05-06T21:15:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-05-06T21:15:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-06T21:15:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-06T21:15:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-06T21:15:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-06T21:15:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-06T21:15:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-06T21:15:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-06T21:15:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-06T21:15:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-06T21:15:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-06T21:15:18.832 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:15:18.832 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:15:18.898 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:15:18.898 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:15:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:15:19.175 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-06T21:15:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:19.263 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:15:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:19.264 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:19.588 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:19.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr-rook 2024-05-06T21:15:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:19.860 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:15:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:19.860 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:20.094 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install libcephfs2 2024-05-06T21:15:20.257 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:29 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:20.382 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:20.382 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-05-06T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-05-06T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-06T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-06T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-06T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-06T21:15:20.384 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:20.385 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:15:20.385 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:20.385 INFO:teuthology.orchestra.run.smithi154.stdout:Install 13 Packages 2024-05-06T21:15:20.385 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:20.386 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 2.2 M 2024-05-06T21:15:20.386 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 26 M 2024-05-06T21:15:20.386 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:15:20.693 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:28 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:20.765 INFO:teuthology.orchestra.run.smithi154.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 719 kB/s | 47 kB 00:00 2024-05-06T21:15:20.778 INFO:teuthology.orchestra.run.smithi032.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:20.791 INFO:teuthology.orchestra.run.smithi154.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 280 kB/s | 26 kB 00:00 2024-05-06T21:15:20.816 INFO:teuthology.orchestra.run.smithi154.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 164 kB/s | 19 kB 00:00 2024-05-06T21:15:20.820 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:20.822 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-05-06T21:15:20.822 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:20.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install libcephfs-devel 2024-05-06T21:15:20.916 INFO:teuthology.orchestra.run.smithi154.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-05-06T21:15:20.941 INFO:teuthology.orchestra.run.smithi154.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-05-06T21:15:20.966 INFO:teuthology.orchestra.run.smithi154.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 279 kB 00:00 2024-05-06T21:15:20.993 INFO:teuthology.orchestra.run.smithi154.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 712 kB/s | 54 kB 00:00 2024-05-06T21:15:21.111 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] python3-certifi-2021.10.8-2.el9.noarch.rpm: Curl error (60): SSL peer certificate or SSH remote key was not OK for https://mirror-mci.yuki.net.uk/fedora-epel/9/Everything/x86_64/Packages/p/python3-certifi-2021.10.8-2.el9.noarch.rpm [SSL certificate problem: certificate has expired] 2024-05-06T21:15:21.131 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] python3-google-auth-2.29.0-1.el9.noarch.rpm: Curl error (60): SSL peer certificate or SSH remote key was not OK for https://mirror-mci.yuki.net.uk/fedora-epel/9/Everything/x86_64/Packages/p/python3-google-auth-2.29.0-1.el9.noarch.rpm [SSL certificate problem: certificate has expired] 2024-05-06T21:15:21.159 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] python3-cachetools-4.2.4-1.el9.noarch.rpm: Curl error (60): SSL peer certificate or SSH remote key was not OK for https://mirror-mci.yuki.net.uk/fedora-epel/9/Everything/x86_64/Packages/p/python3-cachetools-4.2.4-1.el9.noarch.rpm [SSL certificate problem: certificate has expired] 2024-05-06T21:15:21.284 INFO:teuthology.orchestra.run.smithi154.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 47 kB/s | 15 kB 00:00 2024-05-06T21:15:21.342 INFO:teuthology.orchestra.run.smithi154.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 86 kB/s | 32 kB 00:00 2024-05-06T21:15:21.451 INFO:teuthology.orchestra.run.smithi154.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 448 kB/s | 206 kB 00:00 2024-05-06T21:15:21.486 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:29 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:21.518 INFO:teuthology.orchestra.run.smithi154.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 337 kB/s | 59 kB 00:00 2024-05-06T21:15:21.560 INFO:teuthology.orchestra.run.smithi154.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 826 kB/s | 90 kB 00:00 2024-05-06T21:15:21.612 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout:Install 1 Package 2024-05-06T21:15:21.613 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:21.614 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 30 k 2024-05-06T21:15:21.614 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 137 k 2024-05-06T21:15:21.614 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:15:21.668 INFO:teuthology.orchestra.run.smithi154.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.7 MB/s | 1.0 MB 00:00 2024-05-06T21:15:21.669 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:21.669 INFO:teuthology.orchestra.run.smithi154.stdout:Total 1.7 MB/s | 2.2 MB 00:01 2024-05-06T21:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 424 kB/s | 30 kB 00:00 2024-05-06T21:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout:Total 415 kB/s | 30 kB 00:00 2024-05-06T21:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:15:21.734 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:15:21.749 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:15:21.749 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:15:21.834 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:15:21.834 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:15:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:22.252 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:15:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:15:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:22.520 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-06T21:15:22.570 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-06T21:15:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-06T21:15:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-06T21:15:22.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install librados2 2024-05-06T21:15:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-06T21:15:22.799 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-06T21:15:22.918 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-06T21:15:22.973 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-06T21:15:23.271 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:31 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:23.358 INFO:teuthology.orchestra.run.smithi032.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:23.400 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:23.401 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-05-06T21:15:23.402 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:23.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install librbd1 2024-05-06T21:15:23.703 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-06T21:15:23.753 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-06T21:15:23.786 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-06T21:15:23.832 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-06T21:15:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-05-06T21:15:24.068 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:32 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:24.195 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:24.196 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-05-06T21:15:24.196 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:24.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install python3-rados 2024-05-06T21:15:24.650 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-05-06T21:15:24.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-05-06T21:15:24.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-06T21:15:24.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-06T21:15:24.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-06T21:15:24.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-06T21:15:24.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-06T21:15:24.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-06T21:15:24.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-06T21:15:24.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-06T21:15:24.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-06T21:15:24.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-06T21:15:24.651 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-06T21:15:24.862 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:32 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:24.946 INFO:teuthology.orchestra.run.smithi032.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:24.976 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-06T21:15:24.976 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:24.976 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:15:24.976 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-05-06T21:15:24.976 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-06T21:15:24.976 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-06T21:15:24.976 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:24.977 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:24.989 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:24.990 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-05-06T21:15:24.991 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:25.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install python3-rgw 2024-05-06T21:15:25.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr-cephadm 2024-05-06T21:15:25.652 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:33 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:25.736 INFO:teuthology.orchestra.run.smithi032.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:25.779 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:25.780 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-05-06T21:15:25.780 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:25.812 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:34 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:25.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install python3-cephfs 2024-05-06T21:15:25.934 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:25.935 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:25.935 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-05-06T21:15:25.935 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:25.935 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:15:25.935 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-05-06T21:15:25.935 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-06T21:15:25.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-06T21:15:25.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-06T21:15:25.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-06T21:15:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-06T21:15:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-06T21:15:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:25.936 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:15:25.936 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:25.936 INFO:teuthology.orchestra.run.smithi154.stdout:Install 6 Packages 2024-05-06T21:15:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:25.937 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 7.0 M 2024-05-06T21:15:25.937 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 33 M 2024-05-06T21:15:25.937 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:15:26.412 INFO:teuthology.orchestra.run.smithi154.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 2.2 MB/s | 127 kB 00:00 2024-05-06T21:15:26.452 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:34 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:26.537 INFO:teuthology.orchestra.run.smithi032.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:26.580 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:26.581 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-05-06T21:15:26.581 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:26.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install python3-rbd 2024-05-06T21:15:26.946 INFO:teuthology.orchestra.run.smithi154.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 419 kB/s | 248 kB 00:00 2024-05-06T21:15:27.247 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:35 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:27.332 INFO:teuthology.orchestra.run.smithi032.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:27.338 INFO:teuthology.orchestra.run.smithi154.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 147 kB/s | 58 kB 00:00 2024-05-06T21:15:27.377 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:27.378 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-05-06T21:15:27.378 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:27.455 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install rbd-fuse 2024-05-06T21:15:27.538 INFO:teuthology.orchestra.run.smithi154.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 255 kB/s | 51 kB 00:00 2024-05-06T21:15:28.048 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:36 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:28.175 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:28.176 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:28.176 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:28.176 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout:Install 1 Package 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 86 k 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 230 k 2024-05-06T21:15:28.177 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:15:28.188 INFO:teuthology.orchestra.run.smithi154.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 309 kB/s | 548 kB 00:01 2024-05-06T21:15:28.248 INFO:teuthology.orchestra.run.smithi032.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2024-05-06T21:15:28.249 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:28.249 INFO:teuthology.orchestra.run.smithi032.stdout:Total 1.2 MB/s | 86 kB 00:00 2024-05-06T21:15:28.249 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:15:28.257 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:15:28.257 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:15:28.323 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:15:28.323 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:15:28.476 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:15:28.598 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:28.993 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:29.180 INFO:teuthology.orchestra.run.smithi154.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.1 MB/s | 6.0 MB 00:02 2024-05-06T21:15:29.181 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:29.181 INFO:teuthology.orchestra.run.smithi154.stdout:Total 2.1 MB/s | 7.0 MB 00:03 2024-05-06T21:15:29.251 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:15:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:29.261 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:15:29.261 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:29.262 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:29.262 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:29.262 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:15:29.262 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:15:29.360 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:15:29.361 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:15:29.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install rbd-mirror 2024-05-06T21:15:29.657 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:15:29.831 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-06T21:15:29.890 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-06T21:15:30.144 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:38 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:30.272 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:30.273 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:30.273 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:30.273 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:30.273 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:15:30.273 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-05-06T21:15:30.273 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:30.274 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:15:30.274 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:30.274 INFO:teuthology.orchestra.run.smithi032.stdout:Install 1 Package 2024-05-06T21:15:30.274 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:30.274 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 3.0 M 2024-05-06T21:15:30.274 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 12 M 2024-05-06T21:15:30.274 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:15:30.384 INFO:teuthology.orchestra.run.smithi032.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 27 MB/s | 3.0 MB 00:00 2024-05-06T21:15:30.384 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:30.385 INFO:teuthology.orchestra.run.smithi032.stdout:Total 27 MB/s | 3.0 MB 00:00 2024-05-06T21:15:30.385 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:15:30.395 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:15:30.395 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:15:30.418 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-06T21:15:30.479 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:15:30.479 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:15:30.511 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-06T21:15:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-06T21:15:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-05-06T21:15:30.913 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:15:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:31.012 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:15:31.012 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-06T21:15:31.012 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-06T21:15:31.012 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-06T21:15:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:31.347 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-05-06T21:15:31.347 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-05-06T21:15:31.347 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-06T21:15:31.347 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-06T21:15:31.347 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-06T21:15:31.347 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-06T21:15:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-06T21:15:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:31.616 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:15:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-05-06T21:15:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-06T21:15:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-06T21:15:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-06T21:15:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-06T21:15:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-06T21:15:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:31.617 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:31.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-fuse 2024-05-06T21:15:32.043 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:32.043 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:32.043 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:15:32.043 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:32.043 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:32.043 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:32.308 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install rbd-nbd 2024-05-06T21:15:32.489 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:41 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:32.612 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:32.613 INFO:teuthology.orchestra.run.smithi154.stdout:Install 2 Packages 2024-05-06T21:15:32.614 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:32.614 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 915 k 2024-05-06T21:15:32.614 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 2.7 M 2024-05-06T21:15:32.614 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:15:32.883 INFO:teuthology.orchestra.run.smithi154.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 9.7 MB/s | 835 kB 00:00 2024-05-06T21:15:32.905 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:40 ago on Mon 06 May 2024 09:13:52 PM UTC. 2024-05-06T21:15:32.924 INFO:teuthology.orchestra.run.smithi154.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-05-06T21:15:32.925 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:32.925 INFO:teuthology.orchestra.run.smithi154.stdout:Total 2.9 MB/s | 915 kB 00:00 2024-05-06T21:15:32.938 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:15:32.960 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:15:32.960 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:15:33.035 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout:Install 1 Package 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:33.036 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 169 k 2024-05-06T21:15:33.037 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 490 k 2024-05-06T21:15:33.037 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-05-06T21:15:33.042 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:15:33.043 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:15:33.113 INFO:teuthology.orchestra.run.smithi032.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.2 MB/s | 169 kB 00:00 2024-05-06T21:15:33.113 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:33.113 INFO:teuthology.orchestra.run.smithi032.stdout:Total 2.1 MB/s | 169 kB 00:00 2024-05-06T21:15:33.114 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-05-06T21:15:33.122 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-05-06T21:15:33.122 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-05-06T21:15:33.189 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-05-06T21:15:33.189 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-05-06T21:15:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:15:33.364 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-05-06T21:15:33.380 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-06T21:15:33.449 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-05-06T21:15:33.463 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:33.861 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:34.078 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-05-06T21:15:34.078 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-05-06T21:15:34.111 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:34.111 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:34.111 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-05-06T21:15:34.111 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:34.111 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:15:34.112 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-05-06T21:15:34.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-06T21:15:34.358 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:34.358 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:15:34.358 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-06T21:15:34.358 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:34.358 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:34.367 DEBUG:teuthology.parallel:result is None 2024-05-06T21:15:34.623 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install librados-devel 2024-05-06T21:15:35.213 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:44 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:35.338 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:35.339 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:35.339 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:15:35.339 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-05-06T21:15:35.340 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:35.340 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:15:35.340 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:35.340 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2024-05-06T21:15:35.340 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:35.340 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 126 k 2024-05-06T21:15:35.340 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 456 k 2024-05-06T21:15:35.340 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:15:35.404 INFO:teuthology.orchestra.run.smithi154.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 126 kB 00:00 2024-05-06T21:15:35.405 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:35.405 INFO:teuthology.orchestra.run.smithi154.stdout:Total 1.9 MB/s | 126 kB 00:00 2024-05-06T21:15:35.405 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:15:35.411 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:15:35.411 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:15:35.474 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:15:35.474 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:15:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:15:35.727 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:36.148 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:36.380 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:36.380 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:36.380 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:15:36.380 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:36.381 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:36.381 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:36.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install libcephfs2 2024-05-06T21:15:37.211 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:46 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:37.294 INFO:teuthology.orchestra.run.smithi154.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:37.337 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:37.338 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-05-06T21:15:37.338 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:37.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install libcephfs-devel 2024-05-06T21:15:37.991 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:46 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:38.112 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:38.113 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:38.113 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:38.113 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:38.113 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:15:38.114 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-05-06T21:15:38.114 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:38.114 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:15:38.114 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:38.114 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2024-05-06T21:15:38.114 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:38.114 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 30 k 2024-05-06T21:15:38.114 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 137 k 2024-05-06T21:15:38.114 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:15:38.184 INFO:teuthology.orchestra.run.smithi154.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 438 kB/s | 30 kB 00:00 2024-05-06T21:15:38.185 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:38.185 INFO:teuthology.orchestra.run.smithi154.stdout:Total 428 kB/s | 30 kB 00:00 2024-05-06T21:15:38.186 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:15:38.188 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:15:38.189 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:15:38.206 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:15:38.207 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:15:38.288 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:38.734 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:38.979 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:38.979 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:38.979 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:15:38.980 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:38.980 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:38.980 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:39.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install librados2 2024-05-06T21:15:39.745 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:48 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:39.826 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:39.867 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:39.868 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-05-06T21:15:39.868 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:39.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install librbd1 2024-05-06T21:15:40.508 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:49 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:40.589 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:40.629 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:40.630 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-05-06T21:15:40.631 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:40.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install python3-rados 2024-05-06T21:15:41.287 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:50 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:41.368 INFO:teuthology.orchestra.run.smithi154.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:41.409 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:41.410 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-05-06T21:15:41.410 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:41.479 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install python3-rgw 2024-05-06T21:15:42.049 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:51 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:42.130 INFO:teuthology.orchestra.run.smithi154.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:42.172 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:42.173 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-05-06T21:15:42.173 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:42.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install python3-cephfs 2024-05-06T21:15:42.820 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:51 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:42.902 INFO:teuthology.orchestra.run.smithi154.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:42.942 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:42.943 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-05-06T21:15:42.944 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:43.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install python3-rbd 2024-05-06T21:15:43.593 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:52 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:43.674 INFO:teuthology.orchestra.run.smithi154.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-05-06T21:15:43.714 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:43.715 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-05-06T21:15:43.715 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:43.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install rbd-fuse 2024-05-06T21:15:44.373 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:53 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:44.496 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:44.497 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:44.497 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:44.497 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 86 k 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 230 k 2024-05-06T21:15:44.498 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:15:44.570 INFO:teuthology.orchestra.run.smithi154.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2024-05-06T21:15:44.571 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:44.571 INFO:teuthology.orchestra.run.smithi154.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-05-06T21:15:44.571 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:15:44.578 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:15:44.578 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:15:44.642 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:15:44.642 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:15:44.793 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:15:44.892 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:45.496 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:15:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:45.496 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:45.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install rbd-mirror 2024-05-06T21:15:46.393 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:55 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:46.525 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:46.526 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:46.526 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:46.526 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:46.526 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:15:46.526 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-05-06T21:15:46.526 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:46.526 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:15:46.527 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:46.527 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2024-05-06T21:15:46.527 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:46.527 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 3.0 M 2024-05-06T21:15:46.527 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 12 M 2024-05-06T21:15:46.527 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:15:46.634 INFO:teuthology.orchestra.run.smithi154.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 28 MB/s | 3.0 MB 00:00 2024-05-06T21:15:46.634 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:46.635 INFO:teuthology.orchestra.run.smithi154.stdout:Total 28 MB/s | 3.0 MB 00:00 2024-05-06T21:15:46.635 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:15:46.644 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:15:46.645 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:15:46.728 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:15:46.728 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:15:47.157 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:15:47.218 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:47.245 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:47.245 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-06T21:15:47.245 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-06T21:15:47.245 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-06T21:15:47.246 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-06T21:15:47.246 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:48.320 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:48.321 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:48.321 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:15:48.321 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:48.321 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:48.321 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:48.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install rbd-nbd 2024-05-06T21:15:49.137 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:58 ago on Mon 06 May 2024 09:13:51 PM UTC. 2024-05-06T21:15:49.262 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-06T21:15:49.263 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:49.263 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-06T21:15:49.263 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:49.263 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-06T21:15:49.263 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-05-06T21:15:49.263 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:49.264 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-06T21:15:49.264 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-06T21:15:49.264 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2024-05-06T21:15:49.264 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:49.264 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 169 k 2024-05-06T21:15:49.264 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 490 k 2024-05-06T21:15:49.264 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-06T21:15:49.327 INFO:teuthology.orchestra.run.smithi154.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.6 MB/s | 169 kB 00:00 2024-05-06T21:15:49.328 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:15:49.328 INFO:teuthology.orchestra.run.smithi154.stdout:Total 2.6 MB/s | 169 kB 00:00 2024-05-06T21:15:49.328 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-06T21:15:49.336 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-06T21:15:49.336 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-06T21:15:49.399 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-06T21:15:49.399 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-06T21:15:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-06T21:15:49.658 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-05-06T21:15:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:50.345 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-06T21:15:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-05-06T21:15:50.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:15:50.345 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-06T21:15:50.598 DEBUG:teuthology.parallel:result is None 2024-05-06T21:15:50.598 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T21:15:50.599 INFO:teuthology.packaging:ref: None 2024-05-06T21:15:50.599 INFO:teuthology.packaging:tag: v18.2.0 2024-05-06T21:15:50.599 INFO:teuthology.packaging:branch: None 2024-05-06T21:15:50.599 INFO:teuthology.packaging:sha1: f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:15:50.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-05-06T21:15:50.750 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-06T21:15:50.776 INFO:teuthology.orchestra.run.smithi032.stdout:18.2.0-0.el9 2024-05-06T21:15:50.777 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-05-06T21:15:50.777 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-05-06T21:15:50.779 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-05-06T21:15:50.779 INFO:teuthology.packaging:ref: None 2024-05-06T21:15:50.779 INFO:teuthology.packaging:tag: v18.2.0 2024-05-06T21:15:50.779 INFO:teuthology.packaging:branch: None 2024-05-06T21:15:50.779 INFO:teuthology.packaging:sha1: f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:15:50.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-05-06T21:15:51.074 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-06T21:15:51.095 INFO:teuthology.orchestra.run.smithi154.stdout:18.2.0-0.el9 2024-05-06T21:15:51.096 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-05-06T21:15:51.096 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-05-06T21:15:51.097 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-06T21:15:51.098 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:15:51.098 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-06T21:15:51.130 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:15:51.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-06T21:15:51.161 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-06T21:15:51.162 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:15:51.162 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-05-06T21:15:51.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-06T21:15:51.270 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:15:51.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-05-06T21:15:51.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-06T21:15:51.360 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-06T21:15:51.360 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:15:51.360 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-06T21:15:51.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-06T21:15:51.458 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:15:51.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-06T21:15:51.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-06T21:15:51.548 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-06T21:15:51.548 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:15:51.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-05-06T21:15:51.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-06T21:15:51.640 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:15:51.640 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-05-06T21:15:51.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-06T21:15:51.730 INFO:teuthology.run_tasks:Running task print... 2024-05-06T21:15:51.743 INFO:teuthology.task.print:**** done install task... 2024-05-06T21:15:51.743 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-06T21:15:51.899 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'f273489c6dcd4bc88409993babd09dd99491162c'} 2024-05-06T21:15:51.899 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-05-06T21:15:51.900 INFO:tasks.cephadm:Cluster fsid is d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:15:51.900 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-06T21:15:51.900 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-05-06T21:15:51.900 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi032': '172.21.15.32', 'mon.smithi154': '172.21.15.154'} 2024-05-06T21:15:51.900 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-06T21:15:51.901 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname $(hostname -s) 2024-05-06T21:15:51.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-05-06T21:15:51.953 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-05-06T21:15:51.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:15:52.100 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f273489c6dcd4bc88409993babd09dd99491162c', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79064/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2497-gf273489c', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2497.gf273489c'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-yuriw11-testing-20240501.200505-squid/f273489c6dcd4bc88409993babd09dd99491162c/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-02 23:14:46.866319', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-yuriw11-testing-20240501.200505-squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-yuriw11-testing-20240501.200505-squid/f273489c6dcd4bc88409993babd09dd99491162c/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-06T21:15:52.367 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 bf64272e3d7edf5c7f8706082e690401a7a11750 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-05-06T21:15:52.368 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/bf64272e3d7edf5c7f8706082e690401a7a11750/centos/9/x86_64/flavors/default/cephadm 2024-05-06T21:15:52.369 DEBUG:teuthology.orchestra.run.smithi032:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/bf64272e3d7edf5c7f8706082e690401a7a11750/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-06T21:15:52.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r--. 1 ubuntu ubuntu 215333 May 6 21:15 /home/ubuntu/cephtest/cephadm 2024-05-06T21:15:52.894 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/bf64272e3d7edf5c7f8706082e690401a7a11750/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-06T21:15:53.236 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r--. 1 ubuntu ubuntu 215333 May 6 21:15 /home/ubuntu/cephtest/cephadm 2024-05-06T21:15:53.236 DEBUG:teuthology.orchestra.run.smithi032:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-06T21:15:53.256 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-06T21:15:53.293 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-05-06T21:15:53.293 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-05-06T21:15:53.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-05-06T21:15:54.790 INFO:teuthology.orchestra.run.smithi032.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-05-06T21:15:54.906 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-05-06T21:16:21.542 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-06T21:16:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-05-06T21:16:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-05-06T21:16:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-05-06T21:16:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-05-06T21:16:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-05-06T21:16:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-05-06T21:16:21.543 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-06T21:16:24.396 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:16:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-05-06T21:16:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-05-06T21:16:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "repo_digests": [ 2024-05-06T21:16:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-05-06T21:16:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-05-06T21:16:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-06T21:16:24.397 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:16:24.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph 2024-05-06T21:16:24.479 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-05-06T21:16:24.514 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /etc/ceph 2024-05-06T21:16:24.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-05-06T21:16:24.582 INFO:tasks.cephadm:Writing seed config... 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-06T21:16:24.584 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-05-06T21:16:24.585 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-06T21:16:24.586 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-06T21:16:24.587 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-06T21:16:24.587 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-06T21:16:24.587 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-06T21:16:24.587 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:16:24.587 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-06T21:16:24.604 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d155ff30-0bed-11ef-bc97-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-06T21:16:24.604 DEBUG:teuthology.orchestra.run.smithi032:mon.smithi032> sudo journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032.service 2024-05-06T21:16:24.646 INFO:tasks.cephadm:Bootstrapping... 2024-05-06T21:16:24.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid d155ff30-0bed-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.32 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-06T21:16:24.807 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-05-06T21:16:24.807 INFO:teuthology.orchestra.run.smithi032.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', 'd155ff30-0bed-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.32', '--skip-admin-label'] 2024-05-06T21:16:24.832 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-06T21:16:24.833 INFO:teuthology.orchestra.run.smithi032.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-06T21:16:24.833 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying podman|docker is present... 2024-05-06T21:16:24.857 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-06T21:16:24.857 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying lvm2 is present... 2024-05-06T21:16:24.857 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying time synchronization is in place... 2024-05-06T21:16:24.865 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-06T21:16:24.865 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-06T21:16:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-06T21:16:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout inactive 2024-05-06T21:16:24.879 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout enabled 2024-05-06T21:16:24.885 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout active 2024-05-06T21:16:24.885 INFO:teuthology.orchestra.run.smithi032.stdout:Unit chronyd.service is enabled and running 2024-05-06T21:16:24.885 INFO:teuthology.orchestra.run.smithi032.stdout:Repeating the final host check... 2024-05-06T21:16:24.910 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-06T21:16:24.910 INFO:teuthology.orchestra.run.smithi032.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-06T21:16:24.910 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl is present 2024-05-06T21:16:24.910 INFO:teuthology.orchestra.run.smithi032.stdout:lvcreate is present 2024-05-06T21:16:24.917 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-06T21:16:24.917 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-06T21:16:24.923 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-06T21:16:24.923 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout inactive 2024-05-06T21:16:24.930 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout enabled 2024-05-06T21:16:24.936 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout active 2024-05-06T21:16:24.936 INFO:teuthology.orchestra.run.smithi032.stdout:Unit chronyd.service is enabled and running 2024-05-06T21:16:24.937 INFO:teuthology.orchestra.run.smithi032.stdout:Host looks OK 2024-05-06T21:16:24.937 INFO:teuthology.orchestra.run.smithi032.stdout:Cluster fsid: d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:16:24.937 INFO:teuthology.orchestra.run.smithi032.stdout:Acquiring lock 140632950069424 on /run/cephadm/d155ff30-0bed-11ef-bc97-c7b262605968.lock 2024-05-06T21:16:24.937 INFO:teuthology.orchestra.run.smithi032.stdout:Lock 140632950069424 acquired on /run/cephadm/d155ff30-0bed-11ef-bc97-c7b262605968.lock 2024-05-06T21:16:24.937 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying IP 172.21.15.32 port 3300 ... 2024-05-06T21:16:24.937 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying IP 172.21.15.32 port 6789 ... 2024-05-06T21:16:24.938 INFO:teuthology.orchestra.run.smithi032.stdout:Base mon IP(s) is [172.21.15.32:3300, 172.21.15.32:6789], mon addrv is [v2:172.21.15.32:3300,v1:172.21.15.32:6789] 2024-05-06T21:16:24.941 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.32 metric 100 2024-05-06T21:16:24.941 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.32 metric 100 2024-05-06T21:16:24.944 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-06T21:16:24.944 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-05-06T21:16:24.944 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-05-06T21:16:24.946 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-06T21:16:24.946 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-06T21:16:24.946 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-06T21:16:24.947 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-05-06T21:16:24.947 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:2602/64 scope link noprefixroute 2024-05-06T21:16:24.947 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-06T21:16:24.947 INFO:teuthology.orchestra.run.smithi032.stdout:Mon IP `172.21.15.32` is in CIDR network `172.21.0.0/20` 2024-05-06T21:16:24.947 INFO:teuthology.orchestra.run.smithi032.stdout:Mon IP `172.21.15.32` is in CIDR network `172.21.0.0/20` 2024-05-06T21:16:24.947 INFO:teuthology.orchestra.run.smithi032.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-06T21:16:24.948 INFO:teuthology.orchestra.run.smithi032.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-06T21:16:24.949 INFO:teuthology.orchestra.run.smithi032.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-05-06T21:16:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-05-06T21:16:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-05-06T21:16:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stderr Getting image source signatures 2024-05-06T21:16:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-05-06T21:16:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-05-06T21:16:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-05-06T21:16:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-06T21:16:27.186 INFO:teuthology.orchestra.run.smithi032.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-05-06T21:16:27.187 INFO:teuthology.orchestra.run.smithi032.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-05-06T21:16:27.187 INFO:teuthology.orchestra.run.smithi032.stdout:Extracting ceph user uid/gid from container image... 2024-05-06T21:16:28.091 INFO:teuthology.orchestra.run.smithi032.stdout:stat: stdout 167 167 2024-05-06T21:16:28.091 INFO:teuthology.orchestra.run.smithi032.stdout:Creating initial keys... 2024-05-06T21:16:29.038 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph-authtool: stdout AQCsSDlmBN1uFxAAx/pKDDwFjwyHJ5SLj6U9lA== 2024-05-06T21:16:29.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph-authtool: stdout AQCtSDlm+lOvEhAACeoY1T79hJzACjuqTo6TNg== 2024-05-06T21:16:35.642 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph-authtool: stdout AQCuSDlmArgWFBAAIAt/SLsGkQHupoXl5JdHlQ== 2024-05-06T21:16:35.643 INFO:teuthology.orchestra.run.smithi032.stdout:Creating initial monmap... 2024-05-06T21:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-06T21:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-05-06T21:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-06T21:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool for smithi032 [v2:172.21.15.32:3300,v1:172.21.15.32:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-06T21:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = pacific 2024-05-06T21:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/monmaptool: set fsid to d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-06T21:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout:Creating mon... 2024-05-06T21:16:42.376 INFO:teuthology.orchestra.run.smithi032.stdout:create mon.smithi032 on 2024-05-06T21:16:42.613 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-06T21:16:42.769 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-06T21:16:42.955 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d155ff30-0bed-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-d155ff30-0bed-11ef-bc97-c7b262605968.target. 2024-05-06T21:16:42.955 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d155ff30-0bed-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-d155ff30-0bed-11ef-bc97-c7b262605968.target. 2024-05-06T21:16:43.202 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032 2024-05-06T21:16:43.202 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032.service: Unit ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032.service not loaded. 2024-05-06T21:16:43.377 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d155ff30-0bed-11ef-bc97-c7b262605968.target.wants/ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032.service → /etc/systemd/system/ceph-d155ff30-0bed-11ef-bc97-c7b262605968@.service. 2024-05-06T21:16:43.890 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:43 smithi032 podman[26788]: 2024-05-06 21:16:43.84620437 +0000 UTC m=+0.339228854 container start ac3c2b0c833b39489d44130b0b06fe13603f0146147a32c24e68ca1d1df39771 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-05-06T21:16:43.950 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-06T21:16:43.950 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout disabled 2024-05-06T21:16:43.957 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-06T21:16:43.957 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout inactive 2024-05-06T21:16:43.957 INFO:teuthology.orchestra.run.smithi032.stdout:firewalld.service is not enabled 2024-05-06T21:16:43.957 INFO:teuthology.orchestra.run.smithi032.stdout:Not possible to enable service . firewalld.service is not available 2024-05-06T21:16:43.958 INFO:teuthology.orchestra.run.smithi032.stdout:Waiting for mon to start... 2024-05-06T21:16:43.958 INFO:teuthology.orchestra.run.smithi032.stdout:Waiting for mon... 2024-05-06T21:16:44.173 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:43 smithi032 ceph-mon[26807]: mkfs d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:16:44.173 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:43 smithi032 ceph-mon[26807]: mon.smithi032 is new leader, mons smithi032 in quorum (ranks 0) 2024-05-06T21:16:44.174 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:43 smithi032 bash[26788]: ac3c2b0c833b39489d44130b0b06fe13603f0146147a32c24e68ca1d1df39771 2024-05-06T21:16:44.174 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:43 smithi032 systemd[1]: Started Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:16:44.979 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout cluster: 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout id: d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout services: 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi032 (age 0.578753s) 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout data: 2024-05-06T21:16:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout pgs: 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.381+0000 7fbd9d3b4700 1 Processor -- start 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.381+0000 7fbd9d3b4700 1 -- start start 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.381+0000 7fbd9d3b4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98104e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.381+0000 7fbd9d3b4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98105350 con 0x7fbd98104a00 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.382+0000 7fbd96ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.382+0000 7fbd96ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34846/0 (socket says 172.21.15.32:34846) 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.382+0000 7fbd96ffd700 1 -- 172.21.15.32:0/1326151930 learned_addr learned my addr 172.21.15.32:0/1326151930 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:44.986 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.382+0000 7fbd96ffd700 1 -- 172.21.15.32:0/1326151930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd98105490 con 0x7fbd98104a00 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.382+0000 7fbd96ffd700 1 --2- 172.21.15.32:0/1326151930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98104e10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd880098a0 tx=0x7fbd88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17480a421813169c server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.382+0000 7fbd95ffb700 1 -- 172.21.15.32:0/1326151930 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd88004180 con 0x7fbd98104a00 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.382+0000 7fbd95ffb700 1 -- 172.21.15.32:0/1326151930 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd880042e0 con 0x7fbd98104a00 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.382+0000 7fbd95ffb700 1 -- 172.21.15.32:0/1326151930 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd880036a0 con 0x7fbd98104a00 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.383+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1326151930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 msgr2=0x7fbd98104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.383+0000 7fbd9d3b4700 1 --2- 172.21.15.32:0/1326151930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98104e10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd880098a0 tx=0x7fbd88009bb0 comp rx=0 tx=0).stop 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.383+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1326151930 shutdown_connections 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.383+0000 7fbd9d3b4700 1 --2- 172.21.15.32:0/1326151930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98104e10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.383+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1326151930 >> 172.21.15.32:0/1326151930 conn(0x7fbd98100070 msgr2=0x7fbd98102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.383+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1326151930 shutdown_connections 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.383+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1326151930 wait complete. 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.383+0000 7fbd9d3b4700 1 Processor -- start 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.384+0000 7fbd9d3b4700 1 -- start start 2024-05-06T21:16:44.987 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.384+0000 7fbd9d3b4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.384+0000 7fbd9d3b4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98199550 con 0x7fbd98104a00 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.384+0000 7fbd96ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.384+0000 7fbd96ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34848/0 (socket says 172.21.15.32:34848) 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.384+0000 7fbd96ffd700 1 -- 172.21.15.32:0/1747156666 learned_addr learned my addr 172.21.15.32:0/1747156666 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.384+0000 7fbd96ffd700 1 -- 172.21.15.32:0/1747156666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd88009550 con 0x7fbd98104a00 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.384+0000 7fbd96ffd700 1 --2- 172.21.15.32:0/1747156666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98199010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbd98105730 tx=0x7fbd88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.385+0000 7fbd7ffff700 1 -- 172.21.15.32:0/1747156666 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd88003ce0 con 0x7fbd98104a00 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.385+0000 7fbd7ffff700 1 -- 172.21.15.32:0/1747156666 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd88020070 con 0x7fbd98104a00 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.385+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1747156666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd98199750 con 0x7fbd98104a00 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.385+0000 7fbd7ffff700 1 -- 172.21.15.32:0/1747156666 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd88011630 con 0x7fbd98104a00 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.385+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1747156666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd98199b70 con 0x7fbd98104a00 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.385+0000 7fbd7ffff700 1 -- 172.21.15.32:0/1747156666 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbd88022030 con 0x7fbd98104a00 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.385+0000 7fbd7ffff700 1 -- 172.21.15.32:0/1747156666 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbd88025d10 con 0x7fbd98104a00 2024-05-06T21:16:44.988 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.386+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1747156666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd981927b0 con 0x7fbd98104a00 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.388+0000 7fbd7ffff700 1 -- 172.21.15.32:0/1747156666 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fbd88025480 con 0x7fbd98104a00 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.463+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1747156666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fbd9802cd90 con 0x7fbd98104a00 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.463+0000 7fbd7ffff700 1 -- 172.21.15.32:0/1747156666 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fbd88011bd0 con 0x7fbd98104a00 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.464+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1747156666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 msgr2=0x7fbd98199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.464+0000 7fbd9d3b4700 1 --2- 172.21.15.32:0/1747156666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98199010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbd98105730 tx=0x7fbd88004750 comp rx=0 tx=0).stop 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.464+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1747156666 shutdown_connections 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.464+0000 7fbd9d3b4700 1 --2- 172.21.15.32:0/1747156666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd98104a00 0x7fbd98199010 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.464+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1747156666 >> 172.21.15.32:0/1747156666 conn(0x7fbd98100070 msgr2=0x7fbd98073ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.464+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1747156666 shutdown_connections 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:44.464+0000 7fbd9d3b4700 1 -- 172.21.15.32:0/1747156666 wait complete. 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:mon is available 2024-05-06T21:16:44.989 INFO:teuthology.orchestra.run.smithi032.stdout:Assimilating anything we can from ceph.conf... 2024-05-06T21:16:45.101 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:44 smithi032 ceph-mon[26807]: mon.smithi032 is new leader, mons smithi032 in quorum (ranks 0) 2024-05-06T21:16:45.101 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:44 smithi032 ceph-mon[26807]: monmap e1: 1 mons at {smithi032=[v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0]} removed_ranks: {} 2024-05-06T21:16:45.101 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:44 smithi032 ceph-mon[26807]: fsmap 2024-05-06T21:16:45.101 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:44 smithi032 ceph-mon[26807]: osdmap e1: 0 total, 0 up, 0 in 2024-05-06T21:16:45.101 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:44 smithi032 ceph-mon[26807]: mgrmap e1: no daemons active 2024-05-06T21:16:45.101 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:44 smithi032 ceph-mon[26807]: from='client.? 172.21.15.32:0/1747156666' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-06T21:16:46.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:45 smithi032 ceph-mon[26807]: from='client.? 172.21.15.32:0/2983323806' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-06T21:16:46.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:45 smithi032 ceph-mon[26807]: from='client.? 172.21.15.32:0/2983323806' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-06T21:16:46.058 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:16:46.058 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout [global] 2024-05-06T21:16:46.058 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout fsid = d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:16:46.058 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.32:3300,v1:172.21.15.32:6789] 2024-05-06T21:16:46.058 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-06T21:16:46.058 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-06T21:16:46.058 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-06T21:16:46.058 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-06T21:16:46.058 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout [osd] 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.428+0000 7ffb22ad6700 1 Processor -- start 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.428+0000 7ffb22ad6700 1 -- start start 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.429+0000 7ffb22ad6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c104e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:46.059 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.429+0000 7ffb22ad6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c105350 con 0x7ffb1c104a00 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.429+0000 7ffb20872700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.429+0000 7ffb20872700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34850/0 (socket says 172.21.15.32:34850) 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.429+0000 7ffb20872700 1 -- 172.21.15.32:0/2962059001 learned_addr learned my addr 172.21.15.32:0/2962059001 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.429+0000 7ffb20872700 1 -- 172.21.15.32:0/2962059001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c105490 con 0x7ffb1c104a00 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.429+0000 7ffb20872700 1 --2- 172.21.15.32:0/2962059001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c104e10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ffb100098a0 tx=0x7ffb10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd39b27479331e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb1b7fe700 1 -- 172.21.15.32:0/2962059001 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb10004180 con 0x7ffb1c104a00 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb1b7fe700 1 -- 172.21.15.32:0/2962059001 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb100042e0 con 0x7ffb1c104a00 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb1b7fe700 1 -- 172.21.15.32:0/2962059001 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb100036a0 con 0x7ffb1c104a00 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2962059001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 msgr2=0x7ffb1c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb22ad6700 1 --2- 172.21.15.32:0/2962059001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c104e10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ffb100098a0 tx=0x7ffb10009bb0 comp rx=0 tx=0).stop 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2962059001 shutdown_connections 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb22ad6700 1 --2- 172.21.15.32:0/2962059001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c104e10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:46.060 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2962059001 >> 172.21.15.32:0/2962059001 conn(0x7ffb1c100070 msgr2=0x7ffb1c102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2962059001 shutdown_connections 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.430+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2962059001 wait complete. 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.431+0000 7ffb22ad6700 1 Processor -- start 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.431+0000 7ffb22ad6700 1 -- start start 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.431+0000 7ffb22ad6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.431+0000 7ffb22ad6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c199550 con 0x7ffb1c104a00 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.431+0000 7ffb20872700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.431+0000 7ffb20872700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34852/0 (socket says 172.21.15.32:34852) 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.431+0000 7ffb20872700 1 -- 172.21.15.32:0/2983323806 learned_addr learned my addr 172.21.15.32:0/2983323806 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.432+0000 7ffb20872700 1 -- 172.21.15.32:0/2983323806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10009550 con 0x7ffb1c104a00 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.432+0000 7ffb20872700 1 --2- 172.21.15.32:0/2983323806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c199010 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c105730 tx=0x7ffb10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.432+0000 7ffb19ffb700 1 -- 172.21.15.32:0/2983323806 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb10003ce0 con 0x7ffb1c104a00 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.432+0000 7ffb19ffb700 1 -- 172.21.15.32:0/2983323806 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb10020070 con 0x7ffb1c104a00 2024-05-06T21:16:46.061 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.432+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2983323806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c199750 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.432+0000 7ffb19ffb700 1 -- 172.21.15.32:0/2983323806 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb10011630 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.432+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2983323806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c199b70 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.432+0000 7ffb19ffb700 1 -- 172.21.15.32:0/2983323806 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffb10022030 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.432+0000 7ffb19ffb700 1 -- 172.21.15.32:0/2983323806 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffb10025d00 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.433+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2983323806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c1927b0 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.435+0000 7ffb19ffb700 1 -- 172.21.15.32:0/2983323806 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ffb10025480 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.507+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2983323806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ffb1c02ce60 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.510+0000 7ffb19ffb700 1 -- 172.21.15.32:0/2983323806 <== mon.0 v2:172.21.15.32:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ffb10011c20 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.510+0000 7ffb19ffb700 1 -- 172.21.15.32:0/2983323806 <== mon.0 v2:172.21.15.32:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7ffb1001c500 con 0x7ffb1c104a00 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.511+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2983323806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 msgr2=0x7ffb1c199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.511+0000 7ffb22ad6700 1 --2- 172.21.15.32:0/2983323806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c199010 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c105730 tx=0x7ffb10004750 comp rx=0 tx=0).stop 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.511+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2983323806 shutdown_connections 2024-05-06T21:16:46.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.511+0000 7ffb22ad6700 1 --2- 172.21.15.32:0/2983323806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c104a00 0x7ffb1c199010 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:46.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.511+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2983323806 >> 172.21.15.32:0/2983323806 conn(0x7ffb1c100070 msgr2=0x7ffb1c073ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:46.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.511+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2983323806 shutdown_connections 2024-05-06T21:16:46.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:45.511+0000 7ffb22ad6700 1 -- 172.21.15.32:0/2983323806 wait complete. 2024-05-06T21:16:46.063 INFO:teuthology.orchestra.run.smithi032.stdout:Generating new minimal ceph.conf... 2024-05-06T21:16:47.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:47 smithi032 ceph-mon[26807]: from='client.? 172.21.15.32:0/3209376430' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.476+0000 7f6d4d9e4700 1 Processor -- start 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.476+0000 7f6d4d9e4700 1 -- start start 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d4d9e4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d48105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d4d9e4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48106460 con 0x7f6d48105b10 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d46ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d48105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d46ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d48105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34868/0 (socket says 172.21.15.32:34868) 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d46ffd700 1 -- 172.21.15.32:0/656380026 learned_addr learned my addr 172.21.15.32:0/656380026 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d46ffd700 1 -- 172.21.15.32:0/656380026 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d481065a0 con 0x7f6d48105b10 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d46ffd700 1 --2- 172.21.15.32:0/656380026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d48105f20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6d380098a0 tx=0x7f6d38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858f5626f48a030 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:48.126 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d45ffb700 1 -- 172.21.15.32:0/656380026 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d38004180 con 0x7f6d48105b10 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d45ffb700 1 -- 172.21.15.32:0/656380026 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6d380042e0 con 0x7f6d48105b10 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.477+0000 7f6d45ffb700 1 -- 172.21.15.32:0/656380026 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d38011a50 con 0x7f6d48105b10 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.478+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/656380026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 msgr2=0x7f6d48105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.478+0000 7f6d4d9e4700 1 --2- 172.21.15.32:0/656380026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d48105f20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6d380098a0 tx=0x7f6d38009bb0 comp rx=0 tx=0).stop 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.478+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/656380026 shutdown_connections 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.478+0000 7f6d4d9e4700 1 --2- 172.21.15.32:0/656380026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d48105f20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.478+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/656380026 >> 172.21.15.32:0/656380026 conn(0x7f6d48101180 msgr2=0x7f6d48103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.478+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/656380026 shutdown_connections 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.478+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/656380026 wait complete. 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.479+0000 7f6d4d9e4700 1 Processor -- start 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.479+0000 7f6d4d9e4700 1 -- start start 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.479+0000 7f6d4d9e4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d4807bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.479+0000 7f6d4d9e4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4807c180 con 0x7f6d48105b10 2024-05-06T21:16:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.479+0000 7f6d46ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d4807bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.479+0000 7f6d46ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d4807bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34874/0 (socket says 172.21.15.32:34874) 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.479+0000 7f6d46ffd700 1 -- 172.21.15.32:0/3209376430 learned_addr learned my addr 172.21.15.32:0/3209376430 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.480+0000 7f6d46ffd700 1 -- 172.21.15.32:0/3209376430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38009550 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.480+0000 7f6d46ffd700 1 --2- 172.21.15.32:0/3209376430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d4807bc40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6d380119e0 tx=0x7f6d38011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.480+0000 7f6d4c9e2700 1 -- 172.21.15.32:0/3209376430 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d38003b90 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.480+0000 7f6d4c9e2700 1 -- 172.21.15.32:0/3209376430 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6d3801a8a0 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.480+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/3209376430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4807a290 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.480+0000 7f6d4c9e2700 1 -- 172.21.15.32:0/3209376430 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d38019930 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.480+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/3209376430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4807a6b0 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.481+0000 7f6d4c9e2700 1 -- 172.21.15.32:0/3209376430 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6d3801a430 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.481+0000 7f6d4c9e2700 1 -- 172.21.15.32:0/3209376430 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6d38024730 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.481+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/3209376430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d48062380 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.484+0000 7f6d4c9e2700 1 -- 172.21.15.32:0/3209376430 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6d3802dd00 con 0x7f6d48105b10 2024-05-06T21:16:48.128 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.555+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/3209376430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f6d4807ad10 con 0x7f6d48105b10 2024-05-06T21:16:48.129 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.556+0000 7f6d4c9e2700 1 -- 172.21.15.32:0/3209376430 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f6d4807ad10 con 0x7f6d48105b10 2024-05-06T21:16:48.129 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.556+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/3209376430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 msgr2=0x7f6d4807bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:48.129 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.556+0000 7f6d4d9e4700 1 --2- 172.21.15.32:0/3209376430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d4807bc40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6d380119e0 tx=0x7f6d38011ac0 comp rx=0 tx=0).stop 2024-05-06T21:16:48.129 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.557+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/3209376430 shutdown_connections 2024-05-06T21:16:48.129 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.557+0000 7f6d4d9e4700 1 --2- 172.21.15.32:0/3209376430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d48105b10 0x7f6d4807bc40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:48.129 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.557+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/3209376430 >> 172.21.15.32:0/3209376430 conn(0x7f6d48101180 msgr2=0x7f6d48101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:48.129 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.557+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/3209376430 shutdown_connections 2024-05-06T21:16:48.129 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:47.557+0000 7f6d4d9e4700 1 -- 172.21.15.32:0/3209376430 wait complete. 2024-05-06T21:16:48.129 INFO:teuthology.orchestra.run.smithi032.stdout:Restarting the monitor... 2024-05-06T21:16:48.405 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:48 smithi032 systemd[1]: Stopping Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:16:48.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:48 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032[26803]: 2024-05-06T21:16:48.403+0000 7f7781ff4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi032 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:16:48.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:48 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032[26803]: 2024-05-06T21:16:48.403+0000 7f7781ff4700 -1 mon.smithi032@0(leader) e1 *** Got Signal Terminated *** 2024-05-06T21:16:48.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:48 smithi032 podman[27052]: 2024-05-06 21:16:48.515764358 +0000 UTC m=+0.220756329 container died ac3c2b0c833b39489d44130b0b06fe13603f0146147a32c24e68ca1d1df39771 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1) 2024-05-06T21:16:49.057 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:48 smithi032 podman[27052]: 2024-05-06 21:16:48.894089479 +0000 UTC m=+0.599081458 container cleanup ac3c2b0c833b39489d44130b0b06fe13603f0146147a32c24e68ca1d1df39771 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0) 2024-05-06T21:16:49.058 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:48 smithi032 bash[27052]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032 2024-05-06T21:16:49.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 podman[27066]: 2024-05-06 21:16:49.170231624 +0000 UTC m=+0.650951638 container remove ac3c2b0c833b39489d44130b0b06fe13603f0146147a32c24e68ca1d1df39771 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, ceph=True, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-06T21:16:49.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032.service: Deactivated successfully. 2024-05-06T21:16:49.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 systemd[1]: Stopped Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:16:49.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 systemd[1]: Starting Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:16:49.759 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 podman[27160]: 2024-05-06 21:16:49.399792996 +0000 UTC m=+0.018277911 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-05-06T21:16:49.760 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 podman[27160]: 2024-05-06 21:16:49.504118345 +0000 UTC m=+0.122603240 container create b06a214f4520aaf7f5d13e1f511b6714213190207c21135a394cb2ee6fdd5787 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-06T21:16:49.760 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 podman[27160]: 2024-05-06 21:16:49.731544584 +0000 UTC m=+0.350029489 container init b06a214f4520aaf7f5d13e1f511b6714213190207c21135a394cb2ee6fdd5787 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1) 2024-05-06T21:16:49.760 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 podman[27160]: 2024-05-06 21:16:49.734724088 +0000 UTC m=+0.353208983 container start b06a214f4520aaf7f5d13e1f511b6714213190207c21135a394cb2ee6fdd5787 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=HEAD, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1) 2024-05-06T21:16:49.812 INFO:teuthology.orchestra.run.smithi032.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-06T21:16:50.026 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: pidfile_write: ignore empty --pid-file 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: load: jerasure load: lrc 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: RocksDB version: 7.9.2 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Git sha 0 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Compile date 2023-08-03 19:21:13 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: DB SUMMARY 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: DB Session ID: IAASGB0YT4PCXWXJE77Z 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: CURRENT file: CURRENT 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-06T21:16:50.027 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi032/store.db dir, Total Num: 1, files: 000008.sst 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi032/store.db: 000009.log size: 98264 ; 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.error_if_exists: 0 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.create_if_missing: 0 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.paranoid_checks: 1 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.env: 0x5618f25d1720 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.info_log: 0x5618f4eed2c0 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.statistics: (nil) 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.use_fsync: 0 2024-05-06T21:16:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_log_file_size: 0 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.allow_fallocate: 1 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.use_direct_reads: 0 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.db_log_dir: 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.wal_dir: 2024-05-06T21:16:50.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.write_buffer_manager: 0x5618f415e3c0 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T21:16:50.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.unordered_write: 0 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.row_cache: None 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.wal_filter: None 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T21:16:50.032 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.two_write_queues: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.wal_compression: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.atomic_flush: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.log_readahead_size: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T21:16:50.033 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_background_jobs: 2 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_background_compactions: -1 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_subcompactions: 1 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_open_files: -1 2024-05-06T21:16:50.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_background_flushes: -1 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Compression algorithms supported: 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: kZSTD supported: 0 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: kXpressCompression supported: 0 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: kZlibCompression supported: 1 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: kSnappyCompression supported: 1 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: kLZ4Compression supported: 1 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: kBZip2Compression supported: 0 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T21:16:50.035 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi032/store.db/MANIFEST-000010 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.merge_operator: 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_filter: None 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5618f4eed3c0) 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: cache_index_and_filter_blocks: 1 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T21:16:50.036 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: pin_top_level_index_and_filter: 1 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: index_type: 0 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: data_block_index_type: 0 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: index_shortening: 1 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: checksum: 4 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: no_block_cache: 0 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_cache: 0x5618f41ff1f0 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_cache_name: BinnedLRUCache 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_cache_options: 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: capacity : 536870912 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: num_shard_bits : 4 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: strict_capacity_limit : 0 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: high_pri_pool_ratio: 0.000 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_cache_compressed: (nil) 2024-05-06T21:16:50.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: persistent_cache: (nil) 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_size: 4096 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_size_deviation: 10 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_restart_interval: 16 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: index_block_restart_interval: 1 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: metadata_block_size: 4096 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: partition_filters: 0 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: use_delta_encoding: 1 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: filter_policy: bloomfilter 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: whole_key_filtering: 1 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: verify_compression: 0 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: read_amp_bytes_per_bit: 0 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: format_version: 5 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: enable_index_compression: 1 2024-05-06T21:16:50.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_align: 0 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: max_auto_readahead_size: 262144 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: prepopulate_block_cache: 0 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: initial_auto_readahead_size: 8192 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression: NoCompression 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.num_levels: 7 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T21:16:50.039 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T21:16:50.040 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T21:16:50.041 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T21:16:50.042 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.table_properties_collectors: 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.inplace_update_support: 0 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T21:16:50.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.bloom_locality: 0 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.max_successive_merges: 0 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.ttl: 2592000 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.enable_blob_files: false 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.min_blob_size: 0 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T21:16:50.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi032/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 41af0929-26e0-4f22-9c84-6f8f66308b02 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030209764387, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030209765524, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93515, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 314, "table_properties": {"data_size": 91537, "index_size": 260, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84146, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 273, "num_filter_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715030209, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "41af0929-26e0-4f22-9c84-6f8f66308b02", "db_session_id": "IAASGB0YT4PCXWXJE77Z", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030209765585, "job": 1, "event": "recovery_finished"} 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-06T21:16:50.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi032/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5618f429c000 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: DB pointer 0x5618f4288000 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ** DB Stats ** 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:16:50.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ** Compaction Stats [default] ** 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: L0 2/0 93.20 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Sum 2/0 93.20 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ** Compaction Stats [default] ** 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 133.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T21:16:50.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Cumulative compaction: 0.00 GB write, 27.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Interval compaction: 0.00 GB write, 27.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Block cache BinnedLRUCache@0x5618f41ff1f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T21:16:50.048 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: starting mon.smithi032 rank 0 at public addrs [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] at bind addrs [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi032 fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mon.smithi032@-1(???) e1 preinit fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mon.smithi032@-1(???).mds e1 new map 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mon.smithi032@-1(???).mds e1 print_map 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: e1 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: legacy client fscid: -1 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: No filesystems configured 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mon.smithi032@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mon.smithi032@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mon.smithi032@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mon.smithi032@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mon.smithi032@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-06T21:16:50.049 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 bash[27160]: b06a214f4520aaf7f5d13e1f511b6714213190207c21135a394cb2ee6fdd5787 2024-05-06T21:16:50.050 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 systemd[1]: Started Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:16:50.050 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mon.smithi032 is new leader, mons smithi032 in quorum (ranks 0) 2024-05-06T21:16:50.050 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: monmap e1: 1 mons at {smithi032=[v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0]} removed_ranks: {} 2024-05-06T21:16:50.050 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: fsmap 2024-05-06T21:16:50.050 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: osdmap e1: 0 total, 0 up, 0 in 2024-05-06T21:16:50.050 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:49 smithi032 ceph-mon[27179]: mgrmap e1: no daemons active 2024-05-06T21:16:50.925 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.241+0000 7f1fcce2e700 1 Processor -- start 2024-05-06T21:16:50.931 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.241+0000 7f1fcce2e700 1 -- start start 2024-05-06T21:16:50.931 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.241+0000 7f1fcce2e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8108a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:50.931 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.241+0000 7f1fcce2e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8079d30 con 0x7f1fc8106660 2024-05-06T21:16:50.931 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.241+0000 7f1fc659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8108a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:50.931 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.241+0000 7f1fc659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8108a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34878/0 (socket says 172.21.15.32:34878) 2024-05-06T21:16:50.931 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.241+0000 7f1fc659c700 1 -- 172.21.15.32:0/307684869 learned_addr learned my addr 172.21.15.32:0/307684869 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:50.931 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.242+0000 7f1fc659c700 1 -- 172.21.15.32:0/307684869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc8079e70 con 0x7f1fc8106660 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.242+0000 7f1fc659c700 1 --2- 172.21.15.32:0/307684869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8108a40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80098a0 tx=0x7f1fb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3b3f248471b6c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.242+0000 7f1fc559a700 1 -- 172.21.15.32:0/307684869 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fb8004180 con 0x7f1fc8106660 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.242+0000 7f1fc559a700 1 -- 172.21.15.32:0/307684869 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1fb80042e0 con 0x7f1fc8106660 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.242+0000 7f1fc559a700 1 -- 172.21.15.32:0/307684869 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fb8011a50 con 0x7f1fc8106660 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.243+0000 7f1fcce2e700 1 -- 172.21.15.32:0/307684869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 msgr2=0x7f1fc8108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.243+0000 7f1fcce2e700 1 --2- 172.21.15.32:0/307684869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8108a40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80098a0 tx=0x7f1fb8009bb0 comp rx=0 tx=0).stop 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.243+0000 7f1fcce2e700 1 -- 172.21.15.32:0/307684869 shutdown_connections 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.243+0000 7f1fcce2e700 1 --2- 172.21.15.32:0/307684869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8108a40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.243+0000 7f1fcce2e700 1 -- 172.21.15.32:0/307684869 >> 172.21.15.32:0/307684869 conn(0x7f1fc8100060 msgr2=0x7f1fc8102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.243+0000 7f1fcce2e700 1 -- 172.21.15.32:0/307684869 shutdown_connections 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.243+0000 7f1fcce2e700 1 -- 172.21.15.32:0/307684869 wait complete. 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fcce2e700 1 Processor -- start 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fcce2e700 1 -- start start 2024-05-06T21:16:50.932 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fcce2e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fcce2e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8199d40 con 0x7f1fc8106660 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fc659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fc659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34886/0 (socket says 172.21.15.32:34886) 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fc659c700 1 -- 172.21.15.32:0/1615793333 learned_addr learned my addr 172.21.15.32:0/1615793333 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fc659c700 1 -- 172.21.15.32:0/1615793333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb8009550 con 0x7f1fc8106660 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fc659c700 1 --2- 172.21.15.32:0/1615793333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8199800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8000c00 tx=0x7f1fb8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.244+0000 7f1fb77fe700 1 -- 172.21.15.32:0/1615793333 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fb8003b90 con 0x7f1fc8106660 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.245+0000 7f1fb77fe700 1 -- 172.21.15.32:0/1615793333 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1fb80248b0 con 0x7f1fc8106660 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.245+0000 7f1fcce2e700 1 -- 172.21.15.32:0/1615793333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc8199fa0 con 0x7f1fc8106660 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.245+0000 7f1fb77fe700 1 -- 172.21.15.32:0/1615793333 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fb801a8e0 con 0x7f1fc8106660 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.245+0000 7f1fcce2e700 1 -- 172.21.15.32:0/1615793333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc819a420 con 0x7f1fc8106660 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.245+0000 7f1fb77fe700 1 -- 172.21.15.32:0/1615793333 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1fb802d3f0 con 0x7f1fc8106660 2024-05-06T21:16:50.933 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.245+0000 7f1fb77fe700 1 -- 172.21.15.32:0/1615793333 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1fb80193c0 con 0x7f1fc8106660 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.246+0000 7f1fcce2e700 1 -- 172.21.15.32:0/1615793333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc8109b40 con 0x7f1fc8106660 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.248+0000 7f1fb77fe700 1 -- 172.21.15.32:0/1615793333 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1fb8024a20 con 0x7f1fc8106660 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.318+0000 7f1fcce2e700 1 -- 172.21.15.32:0/1615793333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f1fc819d1c0 con 0x7f1fc8106660 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.321+0000 7f1fb77fe700 1 -- 172.21.15.32:0/1615793333 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1fb80350c0 con 0x7f1fc8106660 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.322+0000 7f1fcce2e700 1 -- 172.21.15.32:0/1615793333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 msgr2=0x7f1fc8199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.322+0000 7f1fcce2e700 1 --2- 172.21.15.32:0/1615793333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8199800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8000c00 tx=0x7f1fb8011ab0 comp rx=0 tx=0).stop 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.322+0000 7f1fcce2e700 1 -- 172.21.15.32:0/1615793333 shutdown_connections 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.322+0000 7f1fcce2e700 1 --2- 172.21.15.32:0/1615793333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc8106660 0x7f1fc8199800 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.322+0000 7f1fcce2e700 1 -- 172.21.15.32:0/1615793333 >> 172.21.15.32:0/1615793333 conn(0x7f1fc8100060 msgr2=0x7f1fc8101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:50.934 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.322+0000 7f1fcce2e700 1 -- 172.21.15.32:0/1615793333 shutdown_connections 2024-05-06T21:16:50.935 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:50.322+0000 7f1fcce2e700 1 -- 172.21.15.32:0/1615793333 wait complete. 2024-05-06T21:16:50.935 INFO:teuthology.orchestra.run.smithi032.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-06T21:16:50.946 INFO:teuthology.orchestra.run.smithi032.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-06T21:16:50.947 INFO:teuthology.orchestra.run.smithi032.stdout:Creating mgr... 2024-05-06T21:16:50.947 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-06T21:16:50.947 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-06T21:16:50.947 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying port 0.0.0.0:8443 ... 2024-05-06T21:16:51.190 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mgr.smithi032.ecoohh 2024-05-06T21:16:51.191 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mgr.smithi032.ecoohh.service: Unit ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mgr.smithi032.ecoohh.service not loaded. 2024-05-06T21:16:51.352 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d155ff30-0bed-11ef-bc97-c7b262605968.target.wants/ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mgr.smithi032.ecoohh.service → /etc/systemd/system/ceph-d155ff30-0bed-11ef-bc97-c7b262605968@.service. 2024-05-06T21:16:51.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:51 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1615793333' entity='client.admin' 2024-05-06T21:16:51.866 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-06T21:16:51.866 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout disabled 2024-05-06T21:16:51.873 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-06T21:16:51.873 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout inactive 2024-05-06T21:16:51.873 INFO:teuthology.orchestra.run.smithi032.stdout:firewalld.service is not enabled 2024-05-06T21:16:51.873 INFO:teuthology.orchestra.run.smithi032.stdout:Not possible to enable service . firewalld.service is not available 2024-05-06T21:16:51.882 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-06T21:16:51.882 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout disabled 2024-05-06T21:16:51.890 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-06T21:16:51.890 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout inactive 2024-05-06T21:16:51.890 INFO:teuthology.orchestra.run.smithi032.stdout:firewalld.service is not enabled 2024-05-06T21:16:51.890 INFO:teuthology.orchestra.run.smithi032.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-05-06T21:16:51.891 INFO:teuthology.orchestra.run.smithi032.stdout:Waiting for mgr to start... 2024-05-06T21:16:51.891 INFO:teuthology.orchestra.run.smithi032.stdout:Waiting for mgr... 2024-05-06T21:16:52.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:52 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/4087373133' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T21:16:53.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:16:53.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout { 2024-05-06T21:16:53.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "fsid": "d155ff30-0bed-11ef-bc97-c7b262605968", 2024-05-06T21:16:53.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "health": { 2024-05-06T21:16:53.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-06T21:16:53.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-06T21:16:53.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-06T21:16:53.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 0 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "smithi032" 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:16:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-06T21:16:53.590 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-06T21:16:53.590 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:53.590 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-06T21:16:53.590 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:16:53.590 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-06T21:16:53.590 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-06T21:16:53.590 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-06T21:16:53.598 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-06T21:16:53.598 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-06T21:16:53.598 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-06T21:16:53.598 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:53.598 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-06T21:16:53.598 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-06T21:16:53.598 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-06T21:16:53.599 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "restful" 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "modified": "2024-05-06T21:16:43.887159+0000", 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-06T21:16:53.601 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout } 2024-05-06T21:16:53.601 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.438+0000 7fea0588e700 1 Processor -- start 2024-05-06T21:16:53.601 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.439+0000 7fea0588e700 1 -- start start 2024-05-06T21:16:53.601 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.439+0000 7fea0588e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00104e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:53.601 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.439+0000 7fea0588e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea00105380 con 0x7fea00104a30 2024-05-06T21:16:53.601 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.439+0000 7fe9feffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00104e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:53.601 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.439+0000 7fe9feffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00104e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52624/0 (socket says 172.21.15.32:52624) 2024-05-06T21:16:53.601 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.439+0000 7fe9feffd700 1 -- 172.21.15.32:0/3057376836 learned_addr learned my addr 172.21.15.32:0/3057376836 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.439+0000 7fe9feffd700 1 -- 172.21.15.32:0/3057376836 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea001054c0 con 0x7fea00104a30 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.440+0000 7fe9feffd700 1 --2- 172.21.15.32:0/3057376836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00104e40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00098a0 tx=0x7fe9f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760d6291f950f58a server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.440+0000 7fe9fdffb700 1 -- 172.21.15.32:0/3057376836 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9f0004180 con 0x7fea00104a30 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.440+0000 7fe9fdffb700 1 -- 172.21.15.32:0/3057376836 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe9f00042e0 con 0x7fea00104a30 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.440+0000 7fe9fdffb700 1 -- 172.21.15.32:0/3057376836 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9f0011a50 con 0x7fea00104a30 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.441+0000 7fea0588e700 1 -- 172.21.15.32:0/3057376836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 msgr2=0x7fea00104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.441+0000 7fea0588e700 1 --2- 172.21.15.32:0/3057376836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00104e40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00098a0 tx=0x7fe9f0009bb0 comp rx=0 tx=0).stop 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.441+0000 7fea0588e700 1 -- 172.21.15.32:0/3057376836 shutdown_connections 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.441+0000 7fea0588e700 1 --2- 172.21.15.32:0/3057376836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00104e40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.441+0000 7fea0588e700 1 -- 172.21.15.32:0/3057376836 >> 172.21.15.32:0/3057376836 conn(0x7fea00100060 msgr2=0x7fea001024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.441+0000 7fea0588e700 1 -- 172.21.15.32:0/3057376836 shutdown_connections 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.441+0000 7fea0588e700 1 -- 172.21.15.32:0/3057376836 wait complete. 2024-05-06T21:16:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.442+0000 7fea0588e700 1 Processor -- start 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.442+0000 7fea0588e700 1 -- start start 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.442+0000 7fea0588e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00079b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.442+0000 7fea0588e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0019c600 con 0x7fea00104a30 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.442+0000 7fe9feffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00079b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.442+0000 7fe9feffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00079b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52638/0 (socket says 172.21.15.32:52638) 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.442+0000 7fe9feffd700 1 -- 172.21.15.32:0/4087373133 learned_addr learned my addr 172.21.15.32:0/4087373133 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.443+0000 7fe9feffd700 1 -- 172.21.15.32:0/4087373133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f0009550 con 0x7fea00104a30 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.443+0000 7fe9feffd700 1 --2- 172.21.15.32:0/4087373133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00079b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0003f80 tx=0x7fe9f0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.443+0000 7fea0488c700 1 -- 172.21.15.32:0/4087373133 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9f0003a80 con 0x7fea00104a30 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.443+0000 7fea0488c700 1 -- 172.21.15.32:0/4087373133 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe9f0003be0 con 0x7fea00104a30 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.443+0000 7fea0588e700 1 -- 172.21.15.32:0/4087373133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0019c740 con 0x7fea00104a30 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.443+0000 7fea0588e700 1 -- 172.21.15.32:0/4087373133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0019cb60 con 0x7fea00104a30 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.443+0000 7fea0488c700 1 -- 172.21.15.32:0/4087373133 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9f0019820 con 0x7fea00104a30 2024-05-06T21:16:53.603 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.443+0000 7fea0488c700 1 -- 172.21.15.32:0/4087373133 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe9f002d440 con 0x7fea00104a30 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.443+0000 7fea0488c700 1 -- 172.21.15.32:0/4087373133 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe9f0024810 con 0x7fea00104a30 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.444+0000 7fea0588e700 1 -- 172.21.15.32:0/4087373133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea00062380 con 0x7fea00104a30 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.446+0000 7fea0488c700 1 -- 172.21.15.32:0/4087373133 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe9f001acc0 con 0x7fea00104a30 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.602+0000 7fea0588e700 1 -- 172.21.15.32:0/4087373133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fea001068a0 con 0x7fea00104a30 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.602+0000 7fea0488c700 1 -- 172.21.15.32:0/4087373133 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fe9f0024b20 con 0x7fea00104a30 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.603+0000 7fea0588e700 1 -- 172.21.15.32:0/4087373133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 msgr2=0x7fea00079b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.603+0000 7fea0588e700 1 --2- 172.21.15.32:0/4087373133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00079b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0003f80 tx=0x7fe9f0011ab0 comp rx=0 tx=0).stop 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.603+0000 7fea0588e700 1 -- 172.21.15.32:0/4087373133 shutdown_connections 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.603+0000 7fea0588e700 1 --2- 172.21.15.32:0/4087373133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea00104a30 0x7fea00079b20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.603+0000 7fea0588e700 1 -- 172.21.15.32:0/4087373133 >> 172.21.15.32:0/4087373133 conn(0x7fea00100060 msgr2=0x7fea001017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.604+0000 7fea0588e700 1 -- 172.21.15.32:0/4087373133 shutdown_connections 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:52.604+0000 7fea0588e700 1 -- 172.21.15.32:0/4087373133 wait complete. 2024-05-06T21:16:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:mgr not available, waiting (1/15)... 2024-05-06T21:16:56.430 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:56 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/675214261' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T21:16:57.070 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:16:57.070 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout { 2024-05-06T21:16:57.070 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "fsid": "d155ff30-0bed-11ef-bc97-c7b262605968", 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "health": { 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 0 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "smithi032" 2024-05-06T21:16:57.071 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-06T21:16:57.072 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-06T21:16:57.083 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-06T21:16:57.083 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-06T21:16:57.083 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-06T21:16:57.083 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:57.083 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-06T21:16:57.084 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-06T21:16:57.084 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-06T21:16:57.084 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-06T21:16:57.084 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-06T21:16:57.084 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-06T21:16:57.084 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-06T21:16:57.084 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-06T21:16:57.084 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-06T21:16:57.084 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-06T21:16:57.085 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-06T21:16:57.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "restful" 2024-05-06T21:16:57.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:16:57.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T21:16:57.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:57.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-06T21:16:57.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:16:57.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "modified": "2024-05-06T21:16:43.887159+0000", 2024-05-06T21:16:57.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T21:16:57.086 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout } 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.119+0000 7faee0024700 1 Processor -- start 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.120+0000 7faee0024700 1 -- start start 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.120+0000 7faee0024700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8108a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.120+0000 7faee0024700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed8079d70 con 0x7faed8106640 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.120+0000 7faedddc0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8108a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.120+0000 7faedddc0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8108a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52646/0 (socket says 172.21.15.32:52646) 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.120+0000 7faedddc0700 1 -- 172.21.15.32:0/731978150 learned_addr learned my addr 172.21.15.32:0/731978150 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:57.087 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.121+0000 7faedddc0700 1 -- 172.21.15.32:0/731978150 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8079eb0 con 0x7faed8106640 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.121+0000 7faedddc0700 1 --2- 172.21.15.32:0/731978150 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8108a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faed40098a0 tx=0x7faed4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ff37643f1fd063 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.121+0000 7faedcdbe700 1 -- 172.21.15.32:0/731978150 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faed4004180 con 0x7faed8106640 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.121+0000 7faedcdbe700 1 -- 172.21.15.32:0/731978150 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7faed40042e0 con 0x7faed8106640 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.121+0000 7faedcdbe700 1 -- 172.21.15.32:0/731978150 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faed4011a50 con 0x7faed8106640 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.122+0000 7faee0024700 1 -- 172.21.15.32:0/731978150 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 msgr2=0x7faed8108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.122+0000 7faee0024700 1 --2- 172.21.15.32:0/731978150 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8108a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faed40098a0 tx=0x7faed4009bb0 comp rx=0 tx=0).stop 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.122+0000 7faee0024700 1 -- 172.21.15.32:0/731978150 shutdown_connections 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.122+0000 7faee0024700 1 --2- 172.21.15.32:0/731978150 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8108a20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.122+0000 7faee0024700 1 -- 172.21.15.32:0/731978150 >> 172.21.15.32:0/731978150 conn(0x7faed8100060 msgr2=0x7faed81024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:57.088 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.122+0000 7faee0024700 1 -- 172.21.15.32:0/731978150 shutdown_connections 2024-05-06T21:16:57.089 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.122+0000 7faee0024700 1 -- 172.21.15.32:0/731978150 wait complete. 2024-05-06T21:16:57.089 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.122+0000 7faee0024700 1 Processor -- start 2024-05-06T21:16:57.089 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.123+0000 7faee0024700 1 -- start start 2024-05-06T21:16:57.089 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.123+0000 7faee0024700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:16:57.089 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.123+0000 7faee0024700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed81064e0 con 0x7faed8106640 2024-05-06T21:16:57.089 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.123+0000 7faedddc0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:16:57.089 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.123+0000 7faedddc0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8105fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52660/0 (socket says 172.21.15.32:52660) 2024-05-06T21:16:57.089 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.123+0000 7faedddc0700 1 -- 172.21.15.32:0/675214261 learned_addr learned my addr 172.21.15.32:0/675214261 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:16:57.090 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.123+0000 7faedddc0700 1 -- 172.21.15.32:0/675214261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed4009550 con 0x7faed8106640 2024-05-06T21:16:57.090 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.123+0000 7faedddc0700 1 --2- 172.21.15.32:0/675214261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8105fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faed4009520 tx=0x7faed4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:16:57.090 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.124+0000 7faeceffd700 1 -- 172.21.15.32:0/675214261 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faed4003a80 con 0x7faed8106640 2024-05-06T21:16:57.090 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.124+0000 7faeceffd700 1 -- 172.21.15.32:0/675214261 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7faed4003be0 con 0x7faed8106640 2024-05-06T21:16:57.090 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.124+0000 7faee0024700 1 -- 172.21.15.32:0/675214261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed81045f0 con 0x7faed8106640 2024-05-06T21:16:57.090 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.124+0000 7faeceffd700 1 -- 172.21.15.32:0/675214261 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faed40197b0 con 0x7faed8106640 2024-05-06T21:16:57.090 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.124+0000 7faee0024700 1 -- 172.21.15.32:0/675214261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed8104a10 con 0x7faed8106640 2024-05-06T21:16:57.090 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.124+0000 7faeceffd700 1 -- 172.21.15.32:0/675214261 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faed4019d40 con 0x7faed8106640 2024-05-06T21:16:57.090 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.124+0000 7faeceffd700 1 -- 172.21.15.32:0/675214261 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faed40248a0 con 0x7faed8106640 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.125+0000 7faee0024700 1 -- 172.21.15.32:0/675214261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed8109bb0 con 0x7faed8106640 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.127+0000 7faeceffd700 1 -- 172.21.15.32:0/675214261 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7faed401ac30 con 0x7faed8106640 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.202+0000 7faee0024700 1 -- 172.21.15.32:0/675214261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7faed8109dd0 con 0x7faed8106640 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.202+0000 7faeceffd700 1 -- 172.21.15.32:0/675214261 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7faed4024a60 con 0x7faed8106640 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.203+0000 7faee0024700 1 -- 172.21.15.32:0/675214261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 msgr2=0x7faed8105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.203+0000 7faee0024700 1 --2- 172.21.15.32:0/675214261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8105fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faed4009520 tx=0x7faed4011ab0 comp rx=0 tx=0).stop 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.203+0000 7faee0024700 1 -- 172.21.15.32:0/675214261 shutdown_connections 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.203+0000 7faee0024700 1 --2- 172.21.15.32:0/675214261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed8106640 0x7faed8105fa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.203+0000 7faee0024700 1 -- 172.21.15.32:0/675214261 >> 172.21.15.32:0/675214261 conn(0x7faed8100060 msgr2=0x7faed81017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:16:57.091 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.204+0000 7faee0024700 1 -- 172.21.15.32:0/675214261 shutdown_connections 2024-05-06T21:16:57.092 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:56.204+0000 7faee0024700 1 -- 172.21.15.32:0/675214261 wait complete. 2024-05-06T21:16:57.092 INFO:teuthology.orchestra.run.smithi032.stdout:mgr not available, waiting (2/15)... 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: Activating manager daemon smithi032.ecoohh 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: mgrmap e2: smithi032.ecoohh(active, starting, since 0.00312089s) 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: Manager daemon smithi032.ecoohh is now available 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' 2024-05-06T21:16:59.198 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' 2024-05-06T21:16:59.199 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:58 smithi032 ceph-mon[27179]: from='mgr.14100 172.21.15.32:0/1186607963' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:00.203 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:59 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3420995464' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T21:17:00.203 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:16:59 smithi032 ceph-mon[27179]: mgrmap e3: smithi032.ecoohh(active, since 1.00605s) 2024-05-06T21:17:00.208 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:17:00.208 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout { 2024-05-06T21:17:00.208 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "fsid": "d155ff30-0bed-11ef-bc97-c7b262605968", 2024-05-06T21:17:00.208 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "health": { 2024-05-06T21:17:00.208 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-06T21:17:00.208 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-06T21:17:00.208 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-06T21:17:00.208 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:00.208 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 0 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "smithi032" 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:17:00.209 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-06T21:17:00.210 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-06T21:17:00.210 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-06T21:17:00.217 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-06T21:17:00.217 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-06T21:17:00.218 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "restful" 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-06T21:17:00.219 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "modified": "2024-05-06T21:16:43.887159+0000", 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout } 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.486+0000 7f1c57ffd700 1 Processor -- start 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.487+0000 7f1c57ffd700 1 -- start start 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.487+0000 7f1c57ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c50105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.487+0000 7f1c57ffd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50106460 con 0x7f1c50105b10 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.487+0000 7f1c55d99700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c50105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.487+0000 7f1c55d99700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c50105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52718/0 (socket says 172.21.15.32:52718) 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.487+0000 7f1c55d99700 1 -- 172.21.15.32:0/2808256720 learned_addr learned my addr 172.21.15.32:0/2808256720 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.487+0000 7f1c55d99700 1 -- 172.21.15.32:0/2808256720 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c501065a0 con 0x7f1c50105b10 2024-05-06T21:17:00.220 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.487+0000 7f1c55d99700 1 --2- 172.21.15.32:0/2808256720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c50105f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1c400098a0 tx=0x7f1c40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ec31b311b75f25 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c54d97700 1 -- 172.21.15.32:0/2808256720 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c40004180 con 0x7f1c50105b10 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c54d97700 1 -- 172.21.15.32:0/2808256720 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1c400042e0 con 0x7f1c50105b10 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c54d97700 1 -- 172.21.15.32:0/2808256720 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c40011a50 con 0x7f1c50105b10 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c57ffd700 1 -- 172.21.15.32:0/2808256720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 msgr2=0x7f1c50105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c57ffd700 1 --2- 172.21.15.32:0/2808256720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c50105f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1c400098a0 tx=0x7f1c40009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c57ffd700 1 -- 172.21.15.32:0/2808256720 shutdown_connections 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c57ffd700 1 --2- 172.21.15.32:0/2808256720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c50105f20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c57ffd700 1 -- 172.21.15.32:0/2808256720 >> 172.21.15.32:0/2808256720 conn(0x7f1c50101180 msgr2=0x7f1c50103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c57ffd700 1 -- 172.21.15.32:0/2808256720 shutdown_connections 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.488+0000 7f1c57ffd700 1 -- 172.21.15.32:0/2808256720 wait complete. 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.489+0000 7f1c57ffd700 1 Processor -- start 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.489+0000 7f1c57ffd700 1 -- start start 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.489+0000 7f1c57ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c5007bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:00.221 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.489+0000 7f1c57ffd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5007c180 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.489+0000 7f1c55d99700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c5007bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.489+0000 7f1c55d99700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c5007bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52732/0 (socket says 172.21.15.32:52732) 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.489+0000 7f1c55d99700 1 -- 172.21.15.32:0/3420995464 learned_addr learned my addr 172.21.15.32:0/3420995464 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.490+0000 7f1c55d99700 1 -- 172.21.15.32:0/3420995464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c40009550 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.490+0000 7f1c55d99700 1 --2- 172.21.15.32:0/3420995464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c5007bc40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1c40000c00 tx=0x7f1c40011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.490+0000 7f1c4effd700 1 -- 172.21.15.32:0/3420995464 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c40003b90 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.490+0000 7f1c4effd700 1 -- 172.21.15.32:0/3420995464 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1c400248b0 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.490+0000 7f1c57ffd700 1 -- 172.21.15.32:0/3420995464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5007a290 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.490+0000 7f1c4effd700 1 -- 172.21.15.32:0/3420995464 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c4001a8e0 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.490+0000 7f1c57ffd700 1 -- 172.21.15.32:0/3420995464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5007a6b0 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.491+0000 7f1c4effd700 1 -- 172.21.15.32:0/3420995464 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 2) v1 ==== 44840+0+0 (secure 0 0 0) 0x7f1c4001aba0 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.491+0000 7f1c57ffd700 1 -- 172.21.15.32:0/3420995464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50062380 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.491+0000 7f1c4effd700 1 -- 172.21.15.32:0/3420995464 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1c4004bcc0 con 0x7f1c50105b10 2024-05-06T21:17:00.222 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.493+0000 7f1c4effd700 1 -- 172.21.15.32:0/3420995464 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1c40051020 con 0x7f1c50105b10 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.567+0000 7f1c57ffd700 1 -- 172.21.15.32:0/3420995464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1c501079d0 con 0x7f1c50105b10 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.567+0000 7f1c4effd700 1 -- 172.21.15.32:0/3420995464 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f1c400233a0 con 0x7f1c50105b10 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.568+0000 7f1c57ffd700 1 -- 172.21.15.32:0/3420995464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 msgr2=0x7f1c5007bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.568+0000 7f1c57ffd700 1 --2- 172.21.15.32:0/3420995464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c5007bc40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1c40000c00 tx=0x7f1c40011ab0 comp rx=0 tx=0).stop 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.568+0000 7f1c57ffd700 1 -- 172.21.15.32:0/3420995464 shutdown_connections 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.568+0000 7f1c57ffd700 1 --2- 172.21.15.32:0/3420995464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50105b10 0x7f1c5007bc40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.568+0000 7f1c57ffd700 1 -- 172.21.15.32:0/3420995464 >> 172.21.15.32:0/3420995464 conn(0x7f1c50101180 msgr2=0x7f1c50101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.568+0000 7f1c57ffd700 1 -- 172.21.15.32:0/3420995464 shutdown_connections 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:16:59.568+0000 7f1c57ffd700 1 -- 172.21.15.32:0/3420995464 wait complete. 2024-05-06T21:17:00.223 INFO:teuthology.orchestra.run.smithi032.stdout:mgr not available, waiting (3/15)... 2024-05-06T21:17:02.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:01 smithi032 ceph-mon[27179]: mgrmap e4: smithi032.ecoohh(active, since 2s) 2024-05-06T21:17:03.356 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:03 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2367912277' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T21:17:03.497 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:17:03.497 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout { 2024-05-06T21:17:03.497 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "fsid": "d155ff30-0bed-11ef-bc97-c7b262605968", 2024-05-06T21:17:03.497 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "health": { 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 0 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "smithi032" 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:17:03.498 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-05-06T21:17:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-06T21:17:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:17:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-06T21:17:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-06T21:17:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-06T21:17:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:17:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-06T21:17:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-06T21:17:03.509 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-06T21:17:03.509 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-06T21:17:03.509 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-06T21:17:03.509 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-06T21:17:03.509 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:03.509 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:17:03.510 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "restful" 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ], 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-06T21:17:03.511 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "modified": "2024-05-06T21:16:43.887159+0000", 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout }, 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout } 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.683+0000 7ff4894da700 1 Processor -- start 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.683+0000 7ff4894da700 1 -- start start 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.683+0000 7ff4894da700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.683+0000 7ff4894da700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff484106460 con 0x7ff484105b10 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.684+0000 7ff482ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:03.512 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.684+0000 7ff482ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36622/0 (socket says 172.21.15.32:36622) 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.684+0000 7ff482ffd700 1 -- 172.21.15.32:0/4270147747 learned_addr learned my addr 172.21.15.32:0/4270147747 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.684+0000 7ff482ffd700 1 -- 172.21.15.32:0/4270147747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4841065a0 con 0x7ff484105b10 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.684+0000 7ff482ffd700 1 --2- 172.21.15.32:0/4270147747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484105f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff4740098a0 tx=0x7ff474009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5570b2e15e52035 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.684+0000 7ff481ffb700 1 -- 172.21.15.32:0/4270147747 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff474004180 con 0x7ff484105b10 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.684+0000 7ff481ffb700 1 -- 172.21.15.32:0/4270147747 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff4740042e0 con 0x7ff484105b10 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.684+0000 7ff481ffb700 1 -- 172.21.15.32:0/4270147747 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff474011a50 con 0x7ff484105b10 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.685+0000 7ff4894da700 1 -- 172.21.15.32:0/4270147747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 msgr2=0x7ff484105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.685+0000 7ff4894da700 1 --2- 172.21.15.32:0/4270147747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484105f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff4740098a0 tx=0x7ff474009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.685+0000 7ff4894da700 1 -- 172.21.15.32:0/4270147747 shutdown_connections 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.685+0000 7ff4894da700 1 --2- 172.21.15.32:0/4270147747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484105f20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.685+0000 7ff4894da700 1 -- 172.21.15.32:0/4270147747 >> 172.21.15.32:0/4270147747 conn(0x7ff484101180 msgr2=0x7ff484103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.685+0000 7ff4894da700 1 -- 172.21.15.32:0/4270147747 shutdown_connections 2024-05-06T21:17:03.513 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.685+0000 7ff4894da700 1 -- 172.21.15.32:0/4270147747 wait complete. 2024-05-06T21:17:03.514 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.686+0000 7ff4894da700 1 Processor -- start 2024-05-06T21:17:03.514 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.686+0000 7ff4894da700 1 -- start start 2024-05-06T21:17:03.514 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.686+0000 7ff4894da700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:03.514 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.686+0000 7ff4894da700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff484199d90 con 0x7ff484105b10 2024-05-06T21:17:03.514 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.686+0000 7ff482ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:03.514 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.686+0000 7ff482ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36634/0 (socket says 172.21.15.32:36634) 2024-05-06T21:17:03.514 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.686+0000 7ff482ffd700 1 -- 172.21.15.32:0/2367912277 learned_addr learned my addr 172.21.15.32:0/2367912277 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:03.514 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.687+0000 7ff482ffd700 1 -- 172.21.15.32:0/2367912277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474009550 con 0x7ff484105b10 2024-05-06T21:17:03.515 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.687+0000 7ff482ffd700 1 --2- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484199850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff474000c00 tx=0x7ff474011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:03.515 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.687+0000 7ff46bfff700 1 -- 172.21.15.32:0/2367912277 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff474003b90 con 0x7ff484105b10 2024-05-06T21:17:03.515 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.687+0000 7ff46bfff700 1 -- 172.21.15.32:0/2367912277 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff4740248b0 con 0x7ff484105b10 2024-05-06T21:17:03.515 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.687+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff484199f90 con 0x7ff484105b10 2024-05-06T21:17:03.515 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.687+0000 7ff46bfff700 1 -- 172.21.15.32:0/2367912277 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff47401a8e0 con 0x7ff484105b10 2024-05-06T21:17:03.515 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.687+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48419a3b0 con 0x7ff484105b10 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.688+0000 7ff46bfff700 1 -- 172.21.15.32:0/2367912277 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7ff474024a20 con 0x7ff484105b10 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.688+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff484062380 con 0x7ff484105b10 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.688+0000 7ff46bfff700 1 --2- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7ff46c0383a0 0x7ff46c03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.688+0000 7ff46bfff700 1 -- 172.21.15.32:0/2367912277 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff47404c1b0 con 0x7ff484105b10 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.688+0000 7ff4827fc700 1 --2- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7ff46c0383a0 0x7ff46c03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.689+0000 7ff4827fc700 1 --2- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7ff46c0383a0 0x7ff46c03a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff478006fd0 tx=0x7ff478006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.693+0000 7ff46bfff700 1 -- 172.21.15.32:0/2367912277 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff474024db0 con 0x7ff484105b10 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.975+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff48419d550 con 0x7ff484105b10 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.975+0000 7ff46bfff700 1 -- 172.21.15.32:0/2367912277 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7ff474018350 con 0x7ff484105b10 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.977+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7ff46c0383a0 msgr2=0x7ff46c03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.977+0000 7ff4894da700 1 --2- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7ff46c0383a0 0x7ff46c03a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff478006fd0 tx=0x7ff478006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.977+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 msgr2=0x7ff484199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:03.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.977+0000 7ff4894da700 1 --2- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484199850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff474000c00 tx=0x7ff474011ab0 comp rx=0 tx=0).stop 2024-05-06T21:17:03.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.977+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 shutdown_connections 2024-05-06T21:17:03.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.977+0000 7ff4894da700 1 --2- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7ff46c0383a0 0x7ff46c03a850 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:03.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.977+0000 7ff4894da700 1 --2- 172.21.15.32:0/2367912277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff484105b10 0x7ff484199850 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:03.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.977+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 >> 172.21.15.32:0/2367912277 conn(0x7ff484101180 msgr2=0x7ff484101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:03.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.978+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 shutdown_connections 2024-05-06T21:17:03.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:02.978+0000 7ff4894da700 1 -- 172.21.15.32:0/2367912277 wait complete. 2024-05-06T21:17:03.517 INFO:teuthology.orchestra.run.smithi032.stdout:mgr is available 2024-05-06T21:17:04.415 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:04 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2408065938' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-06T21:17:04.683 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:17:04.683 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout [global] 2024-05-06T21:17:04.683 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout fsid = d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:17:04.683 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-06T21:17:04.683 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-06T21:17:04.683 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-06T21:17:04.683 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-06T21:17:04.683 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout [osd] 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.894+0000 7f8665440700 1 Processor -- start 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.894+0000 7f8665440700 1 -- start start 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.894+0000 7f8665440700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660104e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:04.684 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.894+0000 7f8665440700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660105360 con 0x7f8660104a10 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.894+0000 7f865effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660104e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.894+0000 7f865effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660104e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36636/0 (socket says 172.21.15.32:36636) 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.894+0000 7f865effd700 1 -- 172.21.15.32:0/1489481713 learned_addr learned my addr 172.21.15.32:0/1489481713 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.894+0000 7f865effd700 1 -- 172.21.15.32:0/1489481713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86601054a0 con 0x7f8660104a10 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.894+0000 7f865effd700 1 --2- 172.21.15.32:0/1489481713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660104e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f86500098a0 tx=0x7f8650009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b073ecce555c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f865dffb700 1 -- 172.21.15.32:0/1489481713 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8650004180 con 0x7f8660104a10 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f865dffb700 1 -- 172.21.15.32:0/1489481713 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f86500042e0 con 0x7f8660104a10 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f865dffb700 1 -- 172.21.15.32:0/1489481713 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8650011a50 con 0x7f8660104a10 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f8665440700 1 -- 172.21.15.32:0/1489481713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 msgr2=0x7f8660104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f8665440700 1 --2- 172.21.15.32:0/1489481713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660104e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f86500098a0 tx=0x7f8650009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f8665440700 1 -- 172.21.15.32:0/1489481713 shutdown_connections 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f8665440700 1 --2- 172.21.15.32:0/1489481713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660104e20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f8665440700 1 -- 172.21.15.32:0/1489481713 >> 172.21.15.32:0/1489481713 conn(0x7f8660100060 msgr2=0x7f8660102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f8665440700 1 -- 172.21.15.32:0/1489481713 shutdown_connections 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.895+0000 7f8665440700 1 -- 172.21.15.32:0/1489481713 wait complete. 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.896+0000 7f8665440700 1 Processor -- start 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.896+0000 7f8665440700 1 -- start start 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.896+0000 7f8665440700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.896+0000 7f8665440700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660198c70 con 0x7f8660104a10 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.896+0000 7f865effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.896+0000 7f865effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36650/0 (socket says 172.21.15.32:36650) 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.896+0000 7f865effd700 1 -- 172.21.15.32:0/2408065938 learned_addr learned my addr 172.21.15.32:0/2408065938 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.897+0000 7f865effd700 1 -- 172.21.15.32:0/2408065938 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8650009550 con 0x7f8660104a10 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.897+0000 7f865effd700 1 --2- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660198730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f86500119e0 tx=0x7f8650011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.897+0000 7f8647fff700 1 -- 172.21.15.32:0/2408065938 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8650003b90 con 0x7f8660104a10 2024-05-06T21:17:04.686 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.897+0000 7f8647fff700 1 -- 172.21.15.32:0/2408065938 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f865001a8a0 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.897+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8660198e70 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.897+0000 7f8647fff700 1 -- 172.21.15.32:0/2408065938 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8650019930 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.897+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8660199290 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.898+0000 7f8647fff700 1 -- 172.21.15.32:0/2408065938 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f8650019ba0 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.898+0000 7f8647fff700 1 --2- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f86480383b0 0x7f864803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.898+0000 7f8647fff700 1 -- 172.21.15.32:0/2408065938 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f865004c7f0 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.898+0000 7f865e7fc700 1 --2- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f86480383b0 0x7f864803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.898+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8660062380 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.899+0000 7f865e7fc700 1 --2- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f86480383b0 0x7f864803a860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8654006fd0 tx=0x7f8654006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:03.903+0000 7f8647fff700 1 -- 172.21.15.32:0/2408065938 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f865002c3a0 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.101+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f866019d440 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.102+0000 7f8647fff700 1 -- 172.21.15.32:0/2408065938 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f8650049020 con 0x7f8660104a10 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f86480383b0 msgr2=0x7f864803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 --2- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f86480383b0 0x7f864803a860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8654006fd0 tx=0x7f8654006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 msgr2=0x7f8660198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 --2- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660198730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f86500119e0 tx=0x7f8650011ac0 comp rx=0 tx=0).stop 2024-05-06T21:17:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 shutdown_connections 2024-05-06T21:17:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 --2- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f86480383b0 0x7f864803a860 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 --2- 172.21.15.32:0/2408065938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8660104a10 0x7f8660198730 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 >> 172.21.15.32:0/2408065938 conn(0x7f8660100060 msgr2=0x7f8660100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 shutdown_connections 2024-05-06T21:17:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:04.105+0000 7f8665440700 1 -- 172.21.15.32:0/2408065938 wait complete. 2024-05-06T21:17:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:Enabling cephadm module... 2024-05-06T21:17:06.105 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:05 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2592889492' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-06T21:17:06.425 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.157+0000 7f5cbe08e700 1 Processor -- start 2024-05-06T21:17:06.425 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.157+0000 7f5cbe08e700 1 -- start start 2024-05-06T21:17:06.425 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.157+0000 7f5cbe08e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:06.425 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.157+0000 7f5cbe08e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8106460 con 0x7f5cb8105b10 2024-05-06T21:17:06.425 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.157+0000 7f5cb77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:06.425 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.158+0000 7f5cb77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36652/0 (socket says 172.21.15.32:36652) 2024-05-06T21:17:06.425 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.158+0000 7f5cb77fe700 1 -- 172.21.15.32:0/821774211 learned_addr learned my addr 172.21.15.32:0/821774211 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.158+0000 7f5cb77fe700 1 -- 172.21.15.32:0/821774211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb81065a0 con 0x7f5cb8105b10 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.158+0000 7f5cb77fe700 1 --2- 172.21.15.32:0/821774211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8105f20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80098a0 tx=0x7f5ca8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a65b6a0edf6983 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.158+0000 7f5cb67fc700 1 -- 172.21.15.32:0/821774211 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ca8004180 con 0x7f5cb8105b10 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.158+0000 7f5cb67fc700 1 -- 172.21.15.32:0/821774211 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5ca80042e0 con 0x7f5cb8105b10 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.158+0000 7f5cb67fc700 1 -- 172.21.15.32:0/821774211 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ca8011a50 con 0x7f5cb8105b10 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.159+0000 7f5cbe08e700 1 -- 172.21.15.32:0/821774211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 msgr2=0x7f5cb8105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.159+0000 7f5cbe08e700 1 --2- 172.21.15.32:0/821774211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8105f20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80098a0 tx=0x7f5ca8009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.159+0000 7f5cbe08e700 1 -- 172.21.15.32:0/821774211 shutdown_connections 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.159+0000 7f5cbe08e700 1 --2- 172.21.15.32:0/821774211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8105f20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.159+0000 7f5cbe08e700 1 -- 172.21.15.32:0/821774211 >> 172.21.15.32:0/821774211 conn(0x7f5cb8101180 msgr2=0x7f5cb8103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.159+0000 7f5cbe08e700 1 -- 172.21.15.32:0/821774211 shutdown_connections 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.159+0000 7f5cbe08e700 1 -- 172.21.15.32:0/821774211 wait complete. 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.159+0000 7f5cbe08e700 1 Processor -- start 2024-05-06T21:17:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.160+0000 7f5cbe08e700 1 -- start start 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.160+0000 7f5cbe08e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.160+0000 7f5cbe08e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8199da0 con 0x7f5cb8105b10 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.160+0000 7f5cb77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.160+0000 7f5cb77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36658/0 (socket says 172.21.15.32:36658) 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.160+0000 7f5cb77fe700 1 -- 172.21.15.32:0/2592889492 learned_addr learned my addr 172.21.15.32:0/2592889492 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.160+0000 7f5cb77fe700 1 -- 172.21.15.32:0/2592889492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca8009550 con 0x7f5cb8105b10 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.160+0000 7f5cb77fe700 1 --2- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8199860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80119e0 tx=0x7f5ca8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.160+0000 7f5cb4ff9700 1 -- 172.21.15.32:0/2592889492 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ca8003b90 con 0x7f5cb8105b10 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.161+0000 7f5cb4ff9700 1 -- 172.21.15.32:0/2592889492 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5ca801a8a0 con 0x7f5cb8105b10 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.161+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb8199fa0 con 0x7f5cb8105b10 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.161+0000 7f5cb4ff9700 1 -- 172.21.15.32:0/2592889492 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ca8019930 con 0x7f5cb8105b10 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.161+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb819a3c0 con 0x7f5cb8105b10 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.161+0000 7f5cb4ff9700 1 -- 172.21.15.32:0/2592889492 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f5ca8019ba0 con 0x7f5cb8105b10 2024-05-06T21:17:06.427 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.162+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb8062380 con 0x7f5cb8105b10 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.162+0000 7f5cb4ff9700 1 --2- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f5ca40383b0 0x7f5ca403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.162+0000 7f5cb4ff9700 1 -- 172.21.15.32:0/2592889492 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5ca804c850 con 0x7f5cb8105b10 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.162+0000 7f5cb6ffd700 1 --2- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f5ca40383b0 0x7f5ca403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.162+0000 7f5cb6ffd700 1 --2- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f5ca40383b0 0x7f5ca403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0006fd0 tx=0x7f5ca0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.167+0000 7f5cb4ff9700 1 -- 172.21.15.32:0/2592889492 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5ca802b340 con 0x7f5cb8105b10 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.445+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f5cb8107980 con 0x7f5cb8105b10 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.776+0000 7f5cb4ff9700 1 -- 172.21.15.32:0/2592889492 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f5ca8018350 con 0x7f5cb8105b10 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.777+0000 7f5cb4ff9700 1 -- 172.21.15.32:0/2592889492 <== mon.0 v2:172.21.15.32:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f5ca800be30 con 0x7f5cb8105b10 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f5ca40383b0 msgr2=0x7f5ca403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 --2- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f5ca40383b0 0x7f5ca403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0006fd0 tx=0x7f5ca0006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 msgr2=0x7f5cb8199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 --2- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8199860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80119e0 tx=0x7f5ca8011ac0 comp rx=0 tx=0).stop 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 shutdown_connections 2024-05-06T21:17:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 --2- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f5ca40383b0 0x7f5ca403a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:06.429 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 --2- 172.21.15.32:0/2592889492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb8105b10 0x7f5cb8199860 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:06.429 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 >> 172.21.15.32:0/2592889492 conn(0x7f5cb8101180 msgr2=0x7f5cb81027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:06.429 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 shutdown_connections 2024-05-06T21:17:06.429 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:05.779+0000 7f5cbe08e700 1 -- 172.21.15.32:0/2592889492 wait complete. 2024-05-06T21:17:07.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:06 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2592889492' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-06T21:17:07.044 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:06 smithi032 ceph-mon[27179]: mgrmap e5: smithi032.ecoohh(active, since 7s) 2024-05-06T21:17:07.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:07 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2006315761' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-06T21:17:08.019 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout { 2024-05-06T21:17:08.062 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "active_name": "smithi032.ecoohh", 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout } 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.834+0000 7f1c56cb3700 1 Processor -- start 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.834+0000 7f1c56cb3700 1 -- start start 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.835+0000 7f1c56cb3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50104e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.835+0000 7f1c56cb3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50105350 con 0x7f1c50104a00 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.835+0000 7f1c54a4f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.835+0000 7f1c54a4f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36682/0 (socket says 172.21.15.32:36682) 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.835+0000 7f1c54a4f700 1 -- 172.21.15.32:0/4010997979 learned_addr learned my addr 172.21.15.32:0/4010997979 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:08.063 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.835+0000 7f1c54a4f700 1 -- 172.21.15.32:0/4010997979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50105490 con 0x7f1c50104a00 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.835+0000 7f1c54a4f700 1 --2- 172.21.15.32:0/4010997979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50104e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098a0 tx=0x7f1c44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9049b5af6d7d7fd server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.835+0000 7f1c4f7fe700 1 -- 172.21.15.32:0/4010997979 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c44004180 con 0x7f1c50104a00 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.835+0000 7f1c4f7fe700 1 -- 172.21.15.32:0/4010997979 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1c440042e0 con 0x7f1c50104a00 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.836+0000 7f1c4f7fe700 1 -- 172.21.15.32:0/4010997979 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c44011a50 con 0x7f1c50104a00 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.836+0000 7f1c56cb3700 1 -- 172.21.15.32:0/4010997979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 msgr2=0x7f1c50104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.836+0000 7f1c56cb3700 1 --2- 172.21.15.32:0/4010997979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50104e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098a0 tx=0x7f1c44009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.836+0000 7f1c56cb3700 1 -- 172.21.15.32:0/4010997979 shutdown_connections 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.836+0000 7f1c56cb3700 1 --2- 172.21.15.32:0/4010997979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50104e10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.836+0000 7f1c56cb3700 1 -- 172.21.15.32:0/4010997979 >> 172.21.15.32:0/4010997979 conn(0x7f1c50100070 msgr2=0x7f1c50102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.836+0000 7f1c56cb3700 1 -- 172.21.15.32:0/4010997979 shutdown_connections 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.836+0000 7f1c56cb3700 1 -- 172.21.15.32:0/4010997979 wait complete. 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.837+0000 7f1c56cb3700 1 Processor -- start 2024-05-06T21:17:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.837+0000 7f1c56cb3700 1 -- start start 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.837+0000 7f1c56cb3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.837+0000 7f1c56cb3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50198c80 con 0x7f1c50104a00 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.837+0000 7f1c54a4f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.837+0000 7f1c54a4f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36688/0 (socket says 172.21.15.32:36688) 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.837+0000 7f1c54a4f700 1 -- 172.21.15.32:0/2006315761 learned_addr learned my addr 172.21.15.32:0/2006315761 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.838+0000 7f1c54a4f700 1 -- 172.21.15.32:0/2006315761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009550 con 0x7f1c50104a00 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.838+0000 7f1c54a4f700 1 --2- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50198740 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c440119e0 tx=0x7f1c44011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.838+0000 7f1c4dffb700 1 -- 172.21.15.32:0/2006315761 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c44003b90 con 0x7f1c50104a00 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.838+0000 7f1c4dffb700 1 -- 172.21.15.32:0/2006315761 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1c4401a8a0 con 0x7f1c50104a00 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.838+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c50198e80 con 0x7f1c50104a00 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.838+0000 7f1c4dffb700 1 -- 172.21.15.32:0/2006315761 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c44019930 con 0x7f1c50104a00 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.838+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c501992a0 con 0x7f1c50104a00 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.839+0000 7f1c4dffb700 1 -- 172.21.15.32:0/2006315761 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1c44019bf0 con 0x7f1c50104a00 2024-05-06T21:17:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.839+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50062380 con 0x7f1c50104a00 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.839+0000 7f1c4dffb700 1 --2- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f1c400383b0 0x7f1c4003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.840+0000 7f1c4dffb700 1 -- 172.21.15.32:0/2006315761 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1c4404c720 con 0x7f1c50104a00 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.840+0000 7f1c4ffff700 1 -- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f1c400383b0 msgr2=0x7f1c4003a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2729651169 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.840+0000 7f1c4ffff700 1 --2- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f1c400383b0 0x7f1c4003a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:06.844+0000 7f1c4dffb700 1 -- 172.21.15.32:0/2006315761 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1c4402b700 con 0x7f1c50104a00 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.041+0000 7f1c4ffff700 1 -- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f1c400383b0 msgr2=0x7f1c4003a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2729651169 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.041+0000 7f1c4ffff700 1 --2- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f1c400383b0 0x7f1c4003a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.145+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f1c5019c420 con 0x7f1c50104a00 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.145+0000 7f1c4dffb700 1 -- 172.21.15.32:0/2006315761 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f1c440172b0 con 0x7f1c50104a00 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.147+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f1c400383b0 msgr2=0x7f1c4003a860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.147+0000 7f1c56cb3700 1 --2- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f1c400383b0 0x7f1c4003a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.147+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 msgr2=0x7f1c50198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.147+0000 7f1c56cb3700 1 --2- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50198740 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c440119e0 tx=0x7f1c44011ac0 comp rx=0 tx=0).stop 2024-05-06T21:17:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.147+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 shutdown_connections 2024-05-06T21:17:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.147+0000 7f1c56cb3700 1 --2- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7f1c400383b0 0x7f1c4003a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.147+0000 7f1c56cb3700 1 --2- 172.21.15.32:0/2006315761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c50104a00 0x7f1c50198740 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.148+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 >> 172.21.15.32:0/2006315761 conn(0x7f1c50100070 msgr2=0x7f1c50100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.148+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 shutdown_connections 2024-05-06T21:17:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:07.148+0000 7f1c56cb3700 1 -- 172.21.15.32:0/2006315761 wait complete. 2024-05-06T21:17:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:Waiting for the mgr to restart... 2024-05-06T21:17:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:Waiting for mgr epoch 5... 2024-05-06T21:17:13.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: Active manager daemon smithi032.ecoohh restarted 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: Activating manager daemon smithi032.ecoohh 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: osdmap e2: 0 total, 0 up, 0 in 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: mgrmap e6: smithi032.ecoohh(active, starting, since 0.00363387s) 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: Manager daemon smithi032.ecoohh is now available 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:17:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:17:13.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:17:13.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:17:13.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:12 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:17:13.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:13 smithi032 ceph-mon[27179]: Found migration_current of "None". Setting to last migration. 2024-05-06T21:17:13.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:13 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:13.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:13 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:13.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:13 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:17:13.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:13 smithi032 ceph-mon[27179]: mgrmap e7: smithi032.ecoohh(active, since 1.00615s) 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout { 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout } 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.507+0000 7fd770950700 1 Processor -- start 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.507+0000 7fd770950700 1 -- start start 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.507+0000 7fd770950700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c104e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.507+0000 7fd770950700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c105350 con 0x7fd76c104a00 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.507+0000 7fd76a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.507+0000 7fd76a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36704/0 (socket says 172.21.15.32:36704) 2024-05-06T21:17:14.304 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.507+0000 7fd76a59c700 1 -- 172.21.15.32:0/2365672004 learned_addr learned my addr 172.21.15.32:0/2365672004 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.508+0000 7fd76a59c700 1 -- 172.21.15.32:0/2365672004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c105490 con 0x7fd76c104a00 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.508+0000 7fd76a59c700 1 --2- 172.21.15.32:0/2365672004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c104e10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0098a0 tx=0x7fd75c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739fb04ba361572b server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.508+0000 7fd76959a700 1 -- 172.21.15.32:0/2365672004 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd75c004180 con 0x7fd76c104a00 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.508+0000 7fd76959a700 1 -- 172.21.15.32:0/2365672004 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd75c0042e0 con 0x7fd76c104a00 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.508+0000 7fd76959a700 1 -- 172.21.15.32:0/2365672004 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd75c011a50 con 0x7fd76c104a00 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.508+0000 7fd770950700 1 -- 172.21.15.32:0/2365672004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 msgr2=0x7fd76c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.509+0000 7fd770950700 1 --2- 172.21.15.32:0/2365672004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c104e10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0098a0 tx=0x7fd75c009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.509+0000 7fd770950700 1 -- 172.21.15.32:0/2365672004 shutdown_connections 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.509+0000 7fd770950700 1 --2- 172.21.15.32:0/2365672004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c104e10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.509+0000 7fd770950700 1 -- 172.21.15.32:0/2365672004 >> 172.21.15.32:0/2365672004 conn(0x7fd76c100070 msgr2=0x7fd76c102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.509+0000 7fd770950700 1 -- 172.21.15.32:0/2365672004 shutdown_connections 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.509+0000 7fd770950700 1 -- 172.21.15.32:0/2365672004 wait complete. 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.510+0000 7fd770950700 1 Processor -- start 2024-05-06T21:17:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.510+0000 7fd770950700 1 -- start start 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.510+0000 7fd770950700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c0742e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.510+0000 7fd770950700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c19c570 con 0x7fd76c104a00 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.510+0000 7fd76a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c0742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.510+0000 7fd76a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c0742e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36706/0 (socket says 172.21.15.32:36706) 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.510+0000 7fd76a59c700 1 -- 172.21.15.32:0/1648770624 learned_addr learned my addr 172.21.15.32:0/1648770624 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.510+0000 7fd76a59c700 1 -- 172.21.15.32:0/1648770624 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c009550 con 0x7fd76c104a00 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.510+0000 7fd76a59c700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c0742e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000c00 tx=0x7fd75c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.511+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd75c003b90 con 0x7fd76c104a00 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.511+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd75c0248b0 con 0x7fd76c104a00 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.511+0000 7fd770950700 1 -- 172.21.15.32:0/1648770624 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c19c6b0 con 0x7fd76c104a00 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.511+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd75c01a8e0 con 0x7fd76c104a00 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.511+0000 7fd770950700 1 -- 172.21.15.32:0/1648770624 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c19cad0 con 0x7fd76c104a00 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.512+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fd75c024a20 con 0x7fd76c104a00 2024-05-06T21:17:14.306 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.512+0000 7fd75b7fe700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 0x7fd75403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.512+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 --> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd75403afb0 con 0x7fd7540383f0 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.512+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd75c04c230 con 0x7fd76c104a00 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.512+0000 7fd769d9b700 1 -- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 msgr2=0x7fd75403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2729651169 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.512+0000 7fd769d9b700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 0x7fd75403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.713+0000 7fd769d9b700 1 -- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 msgr2=0x7fd75403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2729651169 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:08.713+0000 7fd769d9b700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 0x7fd75403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:09.114+0000 7fd769d9b700 1 -- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 msgr2=0x7fd75403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2729651169 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:09.114+0000 7fd769d9b700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 0x7fd75403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:09.915+0000 7fd769d9b700 1 -- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 msgr2=0x7fd75403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2729651169 2024-05-06T21:17:14.307 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:09.915+0000 7fd769d9b700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 0x7fd75403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:11.516+0000 7fd769d9b700 1 -- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 msgr2=0x7fd75403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2729651169 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:11.516+0000 7fd769d9b700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 0x7fd75403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:12.682+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7fd75c024440 con 0x7fd76c104a00 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:12.682+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 msgr2=0x7fd75403a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:12.682+0000 7fd75b7fe700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 0x7fd75403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.684+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7fd75c016d40 con 0x7fd76c104a00 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.684+0000 7fd75b7fe700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fd75403bcc0 0x7fd75403e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.684+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd75403afb0 con 0x7fd75403bcc0 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.685+0000 7fd769d9b700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fd75403bcc0 0x7fd75403e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.686+0000 7fd769d9b700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fd75403bcc0 0x7fd75403e0a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd760003a10 tx=0x7fd760009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.686+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fd75403afb0 con 0x7fd75403bcc0 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.693+0000 7fd770950700 1 -- 172.21.15.32:0/1648770624 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd76c073e80 con 0x7fd75403bcc0 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.693+0000 7fd75b7fe700 1 -- 172.21.15.32:0/1648770624 <== mgr.14120 v2:172.21.15.32:6800/3609229440 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd76c073e80 con 0x7fd75403bcc0 2024-05-06T21:17:14.308 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 -- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fd75403bcc0 msgr2=0x7fd75403e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fd75403bcc0 0x7fd75403e0a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd760003a10 tx=0x7fd760009290 comp rx=0 tx=0).stop 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 -- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 msgr2=0x7fd76c0742e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c0742e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000c00 tx=0x7fd75c011ab0 comp rx=0 tx=0).stop 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 -- 172.21.15.32:0/1648770624 shutdown_connections 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fd75403bcc0 0x7fd75403e0a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c104a00 0x7fd76c0742e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 --2- 172.21.15.32:0/1648770624 >> [v2:172.21.15.32:6800/2729651169,v1:172.21.15.32:6801/2729651169] conn(0x7fd7540383f0 0x7fd75403a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 -- 172.21.15.32:0/1648770624 >> 172.21.15.32:0/1648770624 conn(0x7fd76c100070 msgr2=0x7fd76c100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 -- 172.21.15.32:0/1648770624 shutdown_connections 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:13.694+0000 7fd770950700 1 -- 172.21.15.32:0/1648770624 wait complete. 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:mgr epoch 5 is available 2024-05-06T21:17:14.309 INFO:teuthology.orchestra.run.smithi032.stdout:Setting orchestrator backend to cephadm... 2024-05-06T21:17:14.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:14 smithi032 ceph-mon[27179]: [06/May/2024:21:17:13] ENGINE Bus STARTING 2024-05-06T21:17:14.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:14 smithi032 ceph-mon[27179]: [06/May/2024:21:17:13] ENGINE Serving on http://172.21.15.32:8765 2024-05-06T21:17:14.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:14 smithi032 ceph-mon[27179]: [06/May/2024:21:17:13] ENGINE Serving on https://172.21.15.32:7150 2024-05-06T21:17:14.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:14 smithi032 ceph-mon[27179]: [06/May/2024:21:17:13] ENGINE Bus STARTED 2024-05-06T21:17:14.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:14 smithi032 ceph-mon[27179]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-06T21:17:14.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:14 smithi032 ceph-mon[27179]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-06T21:17:15.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.742+0000 7fe4b11b1700 1 Processor -- start 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.743+0000 7fe4b11b1700 1 -- start start 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.743+0000 7fe4b11b1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.743+0000 7fe4b11b1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac07a830 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.743+0000 7fe4aad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.743+0000 7fe4aad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57282/0 (socket says 172.21.15.32:57282) 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.743+0000 7fe4aad9d700 1 -- 172.21.15.32:0/2620221184 learned_addr learned my addr 172.21.15.32:0/2620221184 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.743+0000 7fe4aad9d700 1 -- 172.21.15.32:0/2620221184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac07a970 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4aad9d700 1 --2- 172.21.15.32:0/2620221184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac07a2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0098a0 tx=0x7fe49c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3d291dabbbae0c server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4aa59c700 1 -- 172.21.15.32:0/2620221184 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe49c004180 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4aa59c700 1 -- 172.21.15.32:0/2620221184 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe49c0042e0 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4aa59c700 1 -- 172.21.15.32:0/2620221184 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe49c011a50 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4b11b1700 1 -- 172.21.15.32:0/2620221184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 msgr2=0x7fe4ac07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:15.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4b11b1700 1 --2- 172.21.15.32:0/2620221184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac07a2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0098a0 tx=0x7fe49c009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4b11b1700 1 -- 172.21.15.32:0/2620221184 shutdown_connections 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4b11b1700 1 --2- 172.21.15.32:0/2620221184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac07a2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4b11b1700 1 -- 172.21.15.32:0/2620221184 >> 172.21.15.32:0/2620221184 conn(0x7fe4ac101180 msgr2=0x7fe4ac103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.744+0000 7fe4b11b1700 1 -- 172.21.15.32:0/2620221184 shutdown_connections 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.745+0000 7fe4b11b1700 1 -- 172.21.15.32:0/2620221184 wait complete. 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.745+0000 7fe4b11b1700 1 Processor -- start 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.745+0000 7fe4b11b1700 1 -- start start 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4b11b1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4b11b1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac19bfb0 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4aad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4aad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac19ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57294/0 (socket says 172.21.15.32:57294) 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4aad9d700 1 -- 172.21.15.32:0/3108183650 learned_addr learned my addr 172.21.15.32:0/3108183650 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4aad9d700 1 -- 172.21.15.32:0/3108183650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009550 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4aad9d700 1 --2- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac19ba70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe49c000c00 tx=0x7fe49c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4a8d99700 1 -- 172.21.15.32:0/3108183650 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe49c003b90 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4a8d99700 1 -- 172.21.15.32:0/3108183650 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe49c0248b0 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4a8d99700 1 -- 172.21.15.32:0/3108183650 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe49c01a8e0 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac19c1b0 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.746+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac19c5d0 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.747+0000 7fe4a8d99700 1 -- 172.21.15.32:0/3108183650 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe49c024a20 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.747+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac062380 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.747+0000 7fe4a8d99700 1 --2- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe498038440 0x7fe49803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.748+0000 7fe4a8d99700 1 -- 172.21.15.32:0/3108183650 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe49c04c390 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.748+0000 7fe4a3fff700 1 --2- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe498038440 0x7fe49803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.748+0000 7fe4a3fff700 1 --2- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe498038440 0x7fe49803a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe494006fd0 tx=0x7fe494006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.753+0000 7fe4a8d99700 1 -- 172.21.15.32:0/3108183650 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe49c018b80 con 0x7fe4ac07bdf0 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.968+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4ac103480 con 0x7fe498038440 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.975+0000 7fe4a8d99700 1 -- 172.21.15.32:0/3108183650 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe4ac103480 con 0x7fe498038440 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe498038440 msgr2=0x7fe49803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 --2- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe498038440 0x7fe49803a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe494006fd0 tx=0x7fe494006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 msgr2=0x7fe4ac19ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 --2- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac19ba70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe49c000c00 tx=0x7fe49c011ab0 comp rx=0 tx=0).stop 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 shutdown_connections 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 --2- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe498038440 0x7fe49803a8f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 --2- 172.21.15.32:0/3108183650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4ac07bdf0 0x7fe4ac19ba70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 >> 172.21.15.32:0/3108183650 conn(0x7fe4ac101180 msgr2=0x7fe4ac102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 shutdown_connections 2024-05-06T21:17:15.551 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:14.978+0000 7fe4b11b1700 1 -- 172.21.15.32:0/3108183650 wait complete. 2024-05-06T21:17:15.917 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:15 smithi032 ceph-mon[27179]: mgrmap e8: smithi032.ecoohh(active, since 2s) 2024-05-06T21:17:15.917 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:15 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:15.917 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:15 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:17:16.787 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:16 smithi032 ceph-mon[27179]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:16.796 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-06T21:17:16.796 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.946+0000 7fed9020b700 1 Processor -- start 2024-05-06T21:17:16.796 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.946+0000 7fed9020b700 1 -- start start 2024-05-06T21:17:16.796 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.946+0000 7fed9020b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed88105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:16.796 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.946+0000 7fed9020b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed88106460 con 0x7fed88105b10 2024-05-06T21:17:16.796 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.946+0000 7fed8dfa7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed88105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:16.796 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.946+0000 7fed8dfa7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed88105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57296/0 (socket says 172.21.15.32:57296) 2024-05-06T21:17:16.797 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.947+0000 7fed8dfa7700 1 -- 172.21.15.32:0/2232355884 learned_addr learned my addr 172.21.15.32:0/2232355884 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:16.797 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.947+0000 7fed8dfa7700 1 -- 172.21.15.32:0/2232355884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed881065a0 con 0x7fed88105b10 2024-05-06T21:17:16.797 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.947+0000 7fed8dfa7700 1 --2- 172.21.15.32:0/2232355884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed88105f20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fed840098a0 tx=0x7fed84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e070d3559cc58f92 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:16.797 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.947+0000 7fed8cfa5700 1 -- 172.21.15.32:0/2232355884 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed84004180 con 0x7fed88105b10 2024-05-06T21:17:16.797 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.947+0000 7fed8cfa5700 1 -- 172.21.15.32:0/2232355884 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fed840042e0 con 0x7fed88105b10 2024-05-06T21:17:16.797 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.947+0000 7fed8cfa5700 1 -- 172.21.15.32:0/2232355884 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed84011a50 con 0x7fed88105b10 2024-05-06T21:17:16.797 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.948+0000 7fed9020b700 1 -- 172.21.15.32:0/2232355884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 msgr2=0x7fed88105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:16.797 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.948+0000 7fed9020b700 1 --2- 172.21.15.32:0/2232355884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed88105f20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fed840098a0 tx=0x7fed84009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.948+0000 7fed9020b700 1 -- 172.21.15.32:0/2232355884 shutdown_connections 2024-05-06T21:17:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.948+0000 7fed9020b700 1 --2- 172.21.15.32:0/2232355884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed88105f20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.948+0000 7fed9020b700 1 -- 172.21.15.32:0/2232355884 >> 172.21.15.32:0/2232355884 conn(0x7fed88101180 msgr2=0x7fed88103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.948+0000 7fed9020b700 1 -- 172.21.15.32:0/2232355884 shutdown_connections 2024-05-06T21:17:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.948+0000 7fed9020b700 1 -- 172.21.15.32:0/2232355884 wait complete. 2024-05-06T21:17:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.949+0000 7fed9020b700 1 Processor -- start 2024-05-06T21:17:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.949+0000 7fed9020b700 1 -- start start 2024-05-06T21:17:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.949+0000 7fed9020b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed8807bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.949+0000 7fed9020b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8807c180 con 0x7fed88105b10 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.949+0000 7fed8dfa7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed8807bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.949+0000 7fed8dfa7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed8807bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57312/0 (socket says 172.21.15.32:57312) 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.949+0000 7fed8dfa7700 1 -- 172.21.15.32:0/3687191324 learned_addr learned my addr 172.21.15.32:0/3687191324 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.949+0000 7fed8dfa7700 1 -- 172.21.15.32:0/3687191324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84009550 con 0x7fed88105b10 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.950+0000 7fed8dfa7700 1 --2- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed8807bc40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed84000c00 tx=0x7fed84011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.950+0000 7fed7effd700 1 -- 172.21.15.32:0/3687191324 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed84003b90 con 0x7fed88105b10 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.950+0000 7fed7effd700 1 -- 172.21.15.32:0/3687191324 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fed840248b0 con 0x7fed88105b10 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.950+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8807a290 con 0x7fed88105b10 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.950+0000 7fed7effd700 1 -- 172.21.15.32:0/3687191324 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed8401a8e0 con 0x7fed88105b10 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.950+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8807a6b0 con 0x7fed88105b10 2024-05-06T21:17:16.799 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.951+0000 7fed7effd700 1 -- 172.21.15.32:0/3687191324 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fed8401aba0 con 0x7fed88105b10 2024-05-06T21:17:16.800 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.951+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed88062380 con 0x7fed88105b10 2024-05-06T21:17:16.800 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.951+0000 7fed7effd700 1 --2- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed740383f0 0x7fed7403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:16.800 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.951+0000 7fed7effd700 1 -- 172.21.15.32:0/3687191324 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fed8404c460 con 0x7fed88105b10 2024-05-06T21:17:16.800 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.951+0000 7fed8d7a6700 1 --2- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed740383f0 0x7fed7403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:16.800 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.952+0000 7fed8d7a6700 1 --2- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed740383f0 0x7fed7403a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fed78006fd0 tx=0x7fed78006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:16.800 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:15.956+0000 7fed7effd700 1 -- 172.21.15.32:0/3687191324 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fed840233a0 con 0x7fed88105b10 2024-05-06T21:17:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.159+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fed88102610 con 0x7fed740383f0 2024-05-06T21:17:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.160+0000 7fed7effd700 1 -- 172.21.15.32:0/3687191324 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fed88102610 con 0x7fed740383f0 2024-05-06T21:17:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed740383f0 msgr2=0x7fed7403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 --2- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed740383f0 0x7fed7403a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fed78006fd0 tx=0x7fed78006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 msgr2=0x7fed8807bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 --2- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed8807bc40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed84000c00 tx=0x7fed84011ab0 comp rx=0 tx=0).stop 2024-05-06T21:17:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 shutdown_connections 2024-05-06T21:17:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 --2- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed740383f0 0x7fed7403a8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 --2- 172.21.15.32:0/3687191324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed88105b10 0x7fed8807bc40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:16.802 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 >> 172.21.15.32:0/3687191324 conn(0x7fed88101180 msgr2=0x7fed88101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:16.802 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 shutdown_connections 2024-05-06T21:17:16.802 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:16.162+0000 7fed9020b700 1 -- 172.21.15.32:0/3687191324 wait complete. 2024-05-06T21:17:16.802 INFO:teuthology.orchestra.run.smithi032.stdout:Generating ssh key... 2024-05-06T21:17:17.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:17 smithi032 ceph-mon[27179]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:17.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:17 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:17.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:17 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:18.252 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.225+0000 7f7f536ce700 1 Processor -- start 2024-05-06T21:17:18.252 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.226+0000 7f7f536ce700 1 -- start start 2024-05-06T21:17:18.252 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.226+0000 7f7f536ce700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c1064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:18.252 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.226+0000 7f7f536ce700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c1069f0 con 0x7f7f4c1060a0 2024-05-06T21:17:18.252 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.226+0000 7f7f5146a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c1064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:18.252 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.226+0000 7f7f5146a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c1064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57320/0 (socket says 172.21.15.32:57320) 2024-05-06T21:17:18.252 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.226+0000 7f7f5146a700 1 -- 172.21.15.32:0/780762258 learned_addr learned my addr 172.21.15.32:0/780762258 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.226+0000 7f7f5146a700 1 -- 172.21.15.32:0/780762258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c106b30 con 0x7f7f4c1060a0 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.227+0000 7f7f5146a700 1 --2- 172.21.15.32:0/780762258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c1064b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f480098a0 tx=0x7f7f48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc057cd5487a7655 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.227+0000 7f7f3ffff700 1 -- 172.21.15.32:0/780762258 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f48004180 con 0x7f7f4c1060a0 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.227+0000 7f7f3ffff700 1 -- 172.21.15.32:0/780762258 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f480042e0 con 0x7f7f4c1060a0 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.227+0000 7f7f3ffff700 1 -- 172.21.15.32:0/780762258 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f48011a50 con 0x7f7f4c1060a0 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.227+0000 7f7f536ce700 1 -- 172.21.15.32:0/780762258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 msgr2=0x7f7f4c1064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.227+0000 7f7f536ce700 1 --2- 172.21.15.32:0/780762258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c1064b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f480098a0 tx=0x7f7f48009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.227+0000 7f7f536ce700 1 -- 172.21.15.32:0/780762258 shutdown_connections 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.227+0000 7f7f536ce700 1 --2- 172.21.15.32:0/780762258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c1064b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.227+0000 7f7f536ce700 1 -- 172.21.15.32:0/780762258 >> 172.21.15.32:0/780762258 conn(0x7f7f4c0ff7e0 msgr2=0x7f7f4c101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:18.253 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.228+0000 7f7f536ce700 1 -- 172.21.15.32:0/780762258 shutdown_connections 2024-05-06T21:17:18.254 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.228+0000 7f7f536ce700 1 -- 172.21.15.32:0/780762258 wait complete. 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.228+0000 7f7f536ce700 1 Processor -- start 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.228+0000 7f7f536ce700 1 -- start start 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.228+0000 7f7f536ce700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f536ce700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c19bf80 con 0x7f7f4c1060a0 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f5146a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f5146a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c19ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57330/0 (socket says 172.21.15.32:57330) 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f5146a700 1 -- 172.21.15.32:0/2533454807 learned_addr learned my addr 172.21.15.32:0/2533454807 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f5146a700 1 -- 172.21.15.32:0/2533454807 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48009550 con 0x7f7f4c1060a0 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f5146a700 1 --2- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c19ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c00 tx=0x7f7f48011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:18.255 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f3e7fc700 1 -- 172.21.15.32:0/2533454807 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f48003b90 con 0x7f7f4c1060a0 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f3e7fc700 1 -- 172.21.15.32:0/2533454807 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f480248b0 con 0x7f7f4c1060a0 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4c19c180 con 0x7f7f4c1060a0 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f3e7fc700 1 -- 172.21.15.32:0/2533454807 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f4801a8e0 con 0x7f7f4c1060a0 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.229+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4c19c5a0 con 0x7f7f4c1060a0 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.230+0000 7f7f3e7fc700 1 -- 172.21.15.32:0/2533454807 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7f4801ab50 con 0x7f7f4c1060a0 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.230+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4c10bdc0 con 0x7f7f4c1060a0 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.230+0000 7f7f3e7fc700 1 --2- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f7f38038440 0x7f7f3803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.230+0000 7f7f3e7fc700 1 -- 172.21.15.32:0/2533454807 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7f4804c590 con 0x7f7f4c1060a0 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.230+0000 7f7f50c69700 1 --2- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f7f38038440 0x7f7f3803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.231+0000 7f7f50c69700 1 --2- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f7f38038440 0x7f7f3803a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7f40006fd0 tx=0x7f7f40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.235+0000 7f7f3e7fc700 1 -- 172.21.15.32:0/2533454807 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7f4801ae00 con 0x7f7f4c1060a0 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.440+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f4c19f400 con 0x7f7f38038440 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.699+0000 7f7f3e7fc700 1 -- 172.21.15.32:0/2533454807 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7f4c19f400 con 0x7f7f38038440 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.701+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f7f38038440 msgr2=0x7f7f3803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.701+0000 7f7f536ce700 1 --2- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f7f38038440 0x7f7f3803a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7f40006fd0 tx=0x7f7f40006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.701+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 msgr2=0x7f7f4c19ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.701+0000 7f7f536ce700 1 --2- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c19ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c00 tx=0x7f7f48011ab0 comp rx=0 tx=0).stop 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.701+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 shutdown_connections 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.701+0000 7f7f536ce700 1 --2- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f7f38038440 0x7f7f3803a8f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:18.257 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.701+0000 7f7f536ce700 1 --2- 172.21.15.32:0/2533454807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4c1060a0 0x7f7f4c19ba40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:18.258 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.701+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 >> 172.21.15.32:0/2533454807 conn(0x7f7f4c0ff7e0 msgr2=0x7f7f4c100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:18.258 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.702+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 shutdown_connections 2024-05-06T21:17:18.258 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:17.702+0000 7f7f536ce700 1 -- 172.21.15.32:0/2533454807 wait complete. 2024-05-06T21:17:18.944 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:18 smithi032 ceph-mon[27179]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:18.945 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:18 smithi032 ceph-mon[27179]: Generating ssh key... 2024-05-06T21:17:19.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+B3R6A7gLEx2tZTi+T6+L/NY2LZ7621BPWzLnqMUD1x3YFGaro+n2lAAlS2D1biusPxbZwx/H0SWEMdL5sVi99pGYk+Yk770y5lHA/9kfBaS2PyzrHaecKdn5EZJzIp+B90DGprMIpUNOxuX2UKbjrQofPC9ihryMIMAz3fQDTvM1xCnRzZBC6c63HlnTj/puSeFN8C4W/rLpzL+Cu+SqiOEZRS3cOVLzGERfRkayYoMxcVicd6/UwNfVZeiaFZ9+5GGzpPg5K96bHhefDyZqMrrKk5qM2CqDCAHuiJ6i5C1U0Xy2EWwAkKb82KYbYzOljsmFLCGLT37R4ylKAYp1sX/ty03XTTYULI8+j2bHuN1laIkcbLO3BOdYQZAn8VsGHpmtH6jCzwmQ61fAZIEAHPx1SQoRdItzucHO1wHq6RI5jsbQZKB/dMmb147W82J0n+RNoX2oyOMYAdknK0HIpmnUBLrp6v/yH0lkbTAtVV2nu2GpxbjFufUzv/zsDak= ceph-d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:17:19.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.716+0000 7f2490811700 1 Processor -- start 2024-05-06T21:17:19.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.716+0000 7f2490811700 1 -- start start 2024-05-06T21:17:19.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.716+0000 7f2490811700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c104e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:19.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.716+0000 7f2490811700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c105350 con 0x7f248c104a00 2024-05-06T21:17:19.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.717+0000 7f248a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:19.516 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.717+0000 7f248a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57334/0 (socket says 172.21.15.32:57334) 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.717+0000 7f248a59c700 1 -- 172.21.15.32:0/3258530578 learned_addr learned my addr 172.21.15.32:0/3258530578 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.717+0000 7f248a59c700 1 -- 172.21.15.32:0/3258530578 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c105490 con 0x7f248c104a00 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.717+0000 7f248a59c700 1 --2- 172.21.15.32:0/3258530578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c104e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f247c0098a0 tx=0x7f247c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f2ad98dcfef48f server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.717+0000 7f248959a700 1 -- 172.21.15.32:0/3258530578 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f247c004180 con 0x7f248c104a00 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.717+0000 7f248959a700 1 -- 172.21.15.32:0/3258530578 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f247c0042e0 con 0x7f248c104a00 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.717+0000 7f248959a700 1 -- 172.21.15.32:0/3258530578 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f247c011a50 con 0x7f248c104a00 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.718+0000 7f2490811700 1 -- 172.21.15.32:0/3258530578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 msgr2=0x7f248c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.718+0000 7f2490811700 1 --2- 172.21.15.32:0/3258530578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c104e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f247c0098a0 tx=0x7f247c009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.718+0000 7f2490811700 1 -- 172.21.15.32:0/3258530578 shutdown_connections 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.718+0000 7f2490811700 1 --2- 172.21.15.32:0/3258530578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c104e10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.718+0000 7f2490811700 1 -- 172.21.15.32:0/3258530578 >> 172.21.15.32:0/3258530578 conn(0x7f248c100070 msgr2=0x7f248c102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.718+0000 7f2490811700 1 -- 172.21.15.32:0/3258530578 shutdown_connections 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.718+0000 7f2490811700 1 -- 172.21.15.32:0/3258530578 wait complete. 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.719+0000 7f2490811700 1 Processor -- start 2024-05-06T21:17:19.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.719+0000 7f2490811700 1 -- start start 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.719+0000 7f2490811700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c18fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.719+0000 7f2490811700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1900e0 con 0x7f248c104a00 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.719+0000 7f248a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c18fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.719+0000 7f248a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c18fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57348/0 (socket says 172.21.15.32:57348) 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.719+0000 7f248a59c700 1 -- 172.21.15.32:0/3147861605 learned_addr learned my addr 172.21.15.32:0/3147861605 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.719+0000 7f248a59c700 1 -- 172.21.15.32:0/3147861605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c009550 con 0x7f248c104a00 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.720+0000 7f248a59c700 1 --2- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c18fba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f247c000c00 tx=0x7f247c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.720+0000 7f247b7fe700 1 -- 172.21.15.32:0/3147861605 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f247c003b90 con 0x7f248c104a00 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.720+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c18e1f0 con 0x7f248c104a00 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.720+0000 7f247b7fe700 1 -- 172.21.15.32:0/3147861605 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f247c0248b0 con 0x7f248c104a00 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.720+0000 7f247b7fe700 1 -- 172.21.15.32:0/3147861605 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f247c01a8e0 con 0x7f248c104a00 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.720+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c18e610 con 0x7f248c104a00 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.721+0000 7f247b7fe700 1 -- 172.21.15.32:0/3147861605 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f247c01aba0 con 0x7f248c104a00 2024-05-06T21:17:19.518 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.721+0000 7f247b7fe700 1 --2- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f24740383f0 0x7f247403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.721+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248c062380 con 0x7f248c104a00 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.721+0000 7f247b7fe700 1 -- 172.21.15.32:0/3147861605 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f247c04c400 con 0x7f248c104a00 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.721+0000 7f2489d9b700 1 --2- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f24740383f0 0x7f247403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.721+0000 7f2489d9b700 1 --2- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f24740383f0 0x7f247403a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2480006fd0 tx=0x7f2480006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.726+0000 7f247b7fe700 1 -- 172.21.15.32:0/3147861605 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f247c023580 con 0x7f248c104a00 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.929+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f248c102210 con 0x7f24740383f0 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.929+0000 7f247b7fe700 1 -- 172.21.15.32:0/3147861605 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f248c102210 con 0x7f24740383f0 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f24740383f0 msgr2=0x7f247403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 --2- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f24740383f0 0x7f247403a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2480006fd0 tx=0x7f2480006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 msgr2=0x7f248c18fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 --2- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c18fba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f247c000c00 tx=0x7f247c011ab0 comp rx=0 tx=0).stop 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 shutdown_connections 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 --2- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f24740383f0 0x7f247403a8a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:19.519 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 --2- 172.21.15.32:0/3147861605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f248c104a00 0x7f248c18fba0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:19.520 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 >> 172.21.15.32:0/3147861605 conn(0x7f248c100070 msgr2=0x7f248c074070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:19.520 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 shutdown_connections 2024-05-06T21:17:19.520 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:18.931+0000 7f2490811700 1 -- 172.21.15.32:0/3147861605 wait complete. 2024-05-06T21:17:19.520 INFO:teuthology.orchestra.run.smithi032.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-06T21:17:19.520 INFO:teuthology.orchestra.run.smithi032.stdout:Adding key to root@localhost authorized_keys... 2024-05-06T21:17:19.520 INFO:teuthology.orchestra.run.smithi032.stdout:Adding host smithi032... 2024-05-06T21:17:21.085 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:20 smithi032 ceph-mon[27179]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:22.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:21 smithi032 ceph-mon[27179]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi032", "addr": "172.21.15.32", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:22.034 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:21 smithi032 ceph-mon[27179]: Deploying cephadm binary to smithi032 2024-05-06T21:17:23.242 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Added host 'smithi032' with addr '172.21.15.32' 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.975+0000 7fa552572700 1 Processor -- start 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.975+0000 7fa552572700 1 -- start start 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.976+0000 7fa552572700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c1089f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.976+0000 7fa552572700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c074510 con 0x7fa54c106610 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.976+0000 7fa54bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c1089f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.976+0000 7fa54bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c1089f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57362/0 (socket says 172.21.15.32:57362) 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.976+0000 7fa54bfff700 1 -- 172.21.15.32:0/4236367019 learned_addr learned my addr 172.21.15.32:0/4236367019 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.976+0000 7fa54bfff700 1 -- 172.21.15.32:0/4236367019 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c074650 con 0x7fa54c106610 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.976+0000 7fa54bfff700 1 --2- 172.21.15.32:0/4236367019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c1089f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0098a0 tx=0x7fa53c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ceea528db810e5d server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa54b7fe700 1 -- 172.21.15.32:0/4236367019 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa53c004180 con 0x7fa54c106610 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa54b7fe700 1 -- 172.21.15.32:0/4236367019 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa53c0042e0 con 0x7fa54c106610 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa54b7fe700 1 -- 172.21.15.32:0/4236367019 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa53c011a50 con 0x7fa54c106610 2024-05-06T21:17:23.246 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa552572700 1 -- 172.21.15.32:0/4236367019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 msgr2=0x7fa54c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa552572700 1 --2- 172.21.15.32:0/4236367019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c1089f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0098a0 tx=0x7fa53c009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa552572700 1 -- 172.21.15.32:0/4236367019 shutdown_connections 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa552572700 1 --2- 172.21.15.32:0/4236367019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c1089f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa552572700 1 -- 172.21.15.32:0/4236367019 >> 172.21.15.32:0/4236367019 conn(0x7fa54c100070 msgr2=0x7fa54c102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa552572700 1 -- 172.21.15.32:0/4236367019 shutdown_connections 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.977+0000 7fa552572700 1 -- 172.21.15.32:0/4236367019 wait complete. 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.978+0000 7fa552572700 1 Processor -- start 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.978+0000 7fa552572700 1 -- start start 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.978+0000 7fa552572700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c105f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.978+0000 7fa552572700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c1064b0 con 0x7fa54c106610 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.978+0000 7fa54bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c105f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.978+0000 7fa54bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c105f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57372/0 (socket says 172.21.15.32:57372) 2024-05-06T21:17:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.978+0000 7fa54bfff700 1 -- 172.21.15.32:0/2707211483 learned_addr learned my addr 172.21.15.32:0/2707211483 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.979+0000 7fa54bfff700 1 -- 172.21.15.32:0/2707211483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c009550 con 0x7fa54c106610 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.979+0000 7fa54bfff700 1 --2- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c105f70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa53c000c00 tx=0x7fa53c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.979+0000 7fa549ffb700 1 -- 172.21.15.32:0/2707211483 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa53c003b90 con 0x7fa54c106610 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.979+0000 7fa549ffb700 1 -- 172.21.15.32:0/2707211483 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa53c0248b0 con 0x7fa54c106610 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.979+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c1045c0 con 0x7fa54c106610 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.979+0000 7fa549ffb700 1 -- 172.21.15.32:0/2707211483 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa53c01a8e0 con 0x7fa54c106610 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.979+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c1049e0 con 0x7fa54c106610 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.980+0000 7fa549ffb700 1 -- 172.21.15.32:0/2707211483 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fa53c01aba0 con 0x7fa54c106610 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.980+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c109b80 con 0x7fa54c106610 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.980+0000 7fa549ffb700 1 --2- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa5380383f0 0x7fa53803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.980+0000 7fa549ffb700 1 -- 172.21.15.32:0/2707211483 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa53c04c410 con 0x7fa54c106610 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.980+0000 7fa543fff700 1 --2- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa5380383f0 0x7fa53803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:23.248 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.981+0000 7fa543fff700 1 --2- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa5380383f0 0x7fa53803a8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa534006fd0 tx=0x7fa534006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:19.985+0000 7fa549ffb700 1 -- 172.21.15.32:0/2707211483 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa53c0233a0 con 0x7fa54c106610 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:20.192+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi032", "addr": "172.21.15.32", "target": ["mon-mgr", ""]}) v1 -- 0x7fa54c102370 con 0x7fa5380383f0 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.591+0000 7fa549ffb700 1 -- 172.21.15.32:0/2707211483 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fa54c102370 con 0x7fa5380383f0 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa5380383f0 msgr2=0x7fa53803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 --2- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa5380383f0 0x7fa53803a8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa534006fd0 tx=0x7fa534006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 msgr2=0x7fa54c105f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 --2- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c105f70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa53c000c00 tx=0x7fa53c011ab0 comp rx=0 tx=0).stop 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 shutdown_connections 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 --2- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa5380383f0 0x7fa53803a8a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 --2- 172.21.15.32:0/2707211483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa54c106610 0x7fa54c105f70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 >> 172.21.15.32:0/2707211483 conn(0x7fa54c100070 msgr2=0x7fa54c101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 shutdown_connections 2024-05-06T21:17:23.249 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:22.594+0000 7fa552572700 1 -- 172.21.15.32:0/2707211483 wait complete. 2024-05-06T21:17:23.250 INFO:teuthology.orchestra.run.smithi032.stdout:Deploying mon service with default placement... 2024-05-06T21:17:23.781 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:23 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:23.781 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:23 smithi032 ceph-mon[27179]: Added host smithi032 2024-05-06T21:17:23.781 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:23 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:17:24.870 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-06T21:17:24.870 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.885+0000 7f9e0addd700 1 Processor -- start 2024-05-06T21:17:24.870 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.885+0000 7f9e0addd700 1 -- start start 2024-05-06T21:17:24.870 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.885+0000 7f9e0addd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:24.870 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.885+0000 7f9e0addd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04106460 con 0x7f9e04105b10 2024-05-06T21:17:24.870 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.885+0000 7f9e08b79700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.885+0000 7f9e08b79700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50600/0 (socket says 172.21.15.32:50600) 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.885+0000 7f9e08b79700 1 -- 172.21.15.32:0/2448551787 learned_addr learned my addr 172.21.15.32:0/2448551787 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.886+0000 7f9e08b79700 1 -- 172.21.15.32:0/2448551787 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e041065a0 con 0x7f9e04105b10 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.886+0000 7f9e08b79700 1 --2- 172.21.15.32:0/2448551787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04105f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9df40098a0 tx=0x7f9df4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3eea8c3037bd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.886+0000 7f9e037fe700 1 -- 172.21.15.32:0/2448551787 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df4004180 con 0x7f9e04105b10 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.886+0000 7f9e037fe700 1 -- 172.21.15.32:0/2448551787 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9df40042e0 con 0x7f9e04105b10 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.886+0000 7f9e037fe700 1 -- 172.21.15.32:0/2448551787 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df4011a50 con 0x7f9e04105b10 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.886+0000 7f9e0addd700 1 -- 172.21.15.32:0/2448551787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 msgr2=0x7f9e04105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.886+0000 7f9e0addd700 1 --2- 172.21.15.32:0/2448551787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04105f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9df40098a0 tx=0x7f9df4009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.887+0000 7f9e0addd700 1 -- 172.21.15.32:0/2448551787 shutdown_connections 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.887+0000 7f9e0addd700 1 --2- 172.21.15.32:0/2448551787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04105f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:24.871 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.887+0000 7f9e0addd700 1 -- 172.21.15.32:0/2448551787 >> 172.21.15.32:0/2448551787 conn(0x7f9e04101180 msgr2=0x7f9e04103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.887+0000 7f9e0addd700 1 -- 172.21.15.32:0/2448551787 shutdown_connections 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.887+0000 7f9e0addd700 1 -- 172.21.15.32:0/2448551787 wait complete. 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.887+0000 7f9e0addd700 1 Processor -- start 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.887+0000 7f9e0addd700 1 -- start start 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.887+0000 7f9e0addd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.887+0000 7f9e0addd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04199d50 con 0x7f9e04105b10 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e08b79700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e08b79700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50602/0 (socket says 172.21.15.32:50602) 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e08b79700 1 -- 172.21.15.32:0/797373886 learned_addr learned my addr 172.21.15.32:0/797373886 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e08b79700 1 -- 172.21.15.32:0/797373886 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4009550 con 0x7f9e04105b10 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e08b79700 1 --2- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04199810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9df40119e0 tx=0x7f9df4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:24.872 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e01ffb700 1 -- 172.21.15.32:0/797373886 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df4003b90 con 0x7f9e04105b10 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e01ffb700 1 -- 172.21.15.32:0/797373886 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9df401a8a0 con 0x7f9e04105b10 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e04199f50 con 0x7f9e04105b10 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e01ffb700 1 -- 172.21.15.32:0/797373886 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df4019930 con 0x7f9e04105b10 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.888+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0419a370 con 0x7f9e04105b10 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.889+0000 7f9e01ffb700 1 -- 172.21.15.32:0/797373886 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9df4019bf0 con 0x7f9e04105b10 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.889+0000 7f9e01ffb700 1 --2- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9df00383b0 0x7f9df003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.890+0000 7f9e01ffb700 1 -- 172.21.15.32:0/797373886 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9df404c6d0 con 0x7f9e04105b10 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.890+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e04062380 con 0x7f9e04105b10 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.890+0000 7f9e03fff700 1 --2- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9df00383b0 0x7f9df003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.890+0000 7f9e03fff700 1 --2- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9df00383b0 0x7f9df003a860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006fd0 tx=0x7f9dec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:24.873 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:23.894+0000 7f9e01ffb700 1 -- 172.21.15.32:0/797373886 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9df402d440 con 0x7f9e04105b10 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.107+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e04102610 con 0x7f9df00383b0 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.113+0000 7f9e01ffb700 1 -- 172.21.15.32:0/797373886 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9e04102610 con 0x7f9df00383b0 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9df00383b0 msgr2=0x7f9df003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 --2- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9df00383b0 0x7f9df003a860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006fd0 tx=0x7f9dec006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 msgr2=0x7f9e04199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 --2- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04199810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9df40119e0 tx=0x7f9df4011ac0 comp rx=0 tx=0).stop 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 shutdown_connections 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 --2- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9df00383b0 0x7f9df003a860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 --2- 172.21.15.32:0/797373886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9e04105b10 0x7f9e04199810 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 >> 172.21.15.32:0/797373886 conn(0x7f9e04101180 msgr2=0x7f9e04101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 shutdown_connections 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:24.115+0000 7f9e0addd700 1 -- 172.21.15.32:0/797373886 wait complete. 2024-05-06T21:17:24.874 INFO:teuthology.orchestra.run.smithi032.stdout:Deploying mgr service with default placement... 2024-05-06T21:17:25.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:25 smithi032 ceph-mon[27179]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:25.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:25 smithi032 ceph-mon[27179]: Saving service mon spec with placement count:5 2024-05-06T21:17:25.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:25 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:26.403 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-06T21:17:26.403 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.330+0000 7fdaa994b700 1 Processor -- start 2024-05-06T21:17:26.403 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.330+0000 7fdaa994b700 1 -- start start 2024-05-06T21:17:26.403 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.330+0000 7fdaa994b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa41063d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:26.403 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.330+0000 7fdaa994b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4106910 con 0x7fdaa4105fc0 2024-05-06T21:17:26.403 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.330+0000 7fdaa2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa41063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:26.403 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.330+0000 7fdaa2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa41063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50610/0 (socket says 172.21.15.32:50610) 2024-05-06T21:17:26.403 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.330+0000 7fdaa2ffd700 1 -- 172.21.15.32:0/2859264411 learned_addr learned my addr 172.21.15.32:0/2859264411 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:26.403 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.331+0000 7fdaa2ffd700 1 -- 172.21.15.32:0/2859264411 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4106a50 con 0x7fdaa4105fc0 2024-05-06T21:17:26.404 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.331+0000 7fdaa2ffd700 1 --2- 172.21.15.32:0/2859264411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa41063d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda940098a0 tx=0x7fda94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1152cf0261e1023 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.331+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2859264411 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda94004180 con 0x7fdaa4105fc0 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.331+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2859264411 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fda940042e0 con 0x7fdaa4105fc0 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.331+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2859264411 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda94011a50 con 0x7fdaa4105fc0 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.332+0000 7fdaa994b700 1 -- 172.21.15.32:0/2859264411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 msgr2=0x7fdaa41063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.332+0000 7fdaa994b700 1 --2- 172.21.15.32:0/2859264411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa41063d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda940098a0 tx=0x7fda94009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.332+0000 7fdaa994b700 1 -- 172.21.15.32:0/2859264411 shutdown_connections 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.332+0000 7fdaa994b700 1 --2- 172.21.15.32:0/2859264411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa41063d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.332+0000 7fdaa994b700 1 -- 172.21.15.32:0/2859264411 >> 172.21.15.32:0/2859264411 conn(0x7fdaa40ff7e0 msgr2=0x7fdaa4101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.332+0000 7fdaa994b700 1 -- 172.21.15.32:0/2859264411 shutdown_connections 2024-05-06T21:17:26.407 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.332+0000 7fdaa994b700 1 -- 172.21.15.32:0/2859264411 wait complete. 2024-05-06T21:17:26.408 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.333+0000 7fdaa994b700 1 Processor -- start 2024-05-06T21:17:26.408 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.333+0000 7fdaa994b700 1 -- start start 2024-05-06T21:17:26.408 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.333+0000 7fdaa994b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:26.408 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.333+0000 7fdaa994b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4199db0 con 0x7fdaa4105fc0 2024-05-06T21:17:26.408 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.333+0000 7fdaa2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:26.408 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.333+0000 7fdaa2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa4199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50616/0 (socket says 172.21.15.32:50616) 2024-05-06T21:17:26.408 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.333+0000 7fdaa2ffd700 1 -- 172.21.15.32:0/435484699 learned_addr learned my addr 172.21.15.32:0/435484699 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:26.408 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.334+0000 7fdaa2ffd700 1 -- 172.21.15.32:0/435484699 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94009550 con 0x7fdaa4105fc0 2024-05-06T21:17:26.408 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.334+0000 7fdaa2ffd700 1 --2- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa4199870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fda94006af0 tx=0x7fda94011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.334+0000 7fdaa8949700 1 -- 172.21.15.32:0/435484699 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda94003b90 con 0x7fdaa4105fc0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.334+0000 7fdaa8949700 1 -- 172.21.15.32:0/435484699 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fda9401a8a0 con 0x7fdaa4105fc0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.334+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa4199fb0 con 0x7fdaa4105fc0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.334+0000 7fdaa8949700 1 -- 172.21.15.32:0/435484699 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda94019880 con 0x7fdaa4105fc0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.334+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa419a3d0 con 0x7fdaa4105fc0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.335+0000 7fdaa8949700 1 -- 172.21.15.32:0/435484699 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fda94019b40 con 0x7fdaa4105fc0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.335+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa4062380 con 0x7fdaa4105fc0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.335+0000 7fdaa8949700 1 --2- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fda900383b0 0x7fda9003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.335+0000 7fdaa8949700 1 -- 172.21.15.32:0/435484699 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fda9404c790 con 0x7fdaa4105fc0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.335+0000 7fda9bfff700 1 --2- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fda900383b0 0x7fda9003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.336+0000 7fda9bfff700 1 --2- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fda900383b0 0x7fda9003a860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda8c006fd0 tx=0x7fda8c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.343+0000 7fdaa8949700 1 -- 172.21.15.32:0/435484699 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fda9402b730 con 0x7fdaa4105fc0 2024-05-06T21:17:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.555+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaa41019a0 con 0x7fda900383b0 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.559+0000 7fdaa8949700 1 -- 172.21.15.32:0/435484699 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdaa41019a0 con 0x7fda900383b0 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.561+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fda900383b0 msgr2=0x7fda9003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.561+0000 7fdaa994b700 1 --2- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fda900383b0 0x7fda9003a860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda8c006fd0 tx=0x7fda8c006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.561+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 msgr2=0x7fdaa4199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.561+0000 7fdaa994b700 1 --2- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa4199870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fda94006af0 tx=0x7fda94011a90 comp rx=0 tx=0).stop 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.561+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 shutdown_connections 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.561+0000 7fdaa994b700 1 --2- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fda900383b0 0x7fda9003a860 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.561+0000 7fdaa994b700 1 --2- 172.21.15.32:0/435484699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa4105fc0 0x7fdaa4199870 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.561+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 >> 172.21.15.32:0/435484699 conn(0x7fdaa40ff7e0 msgr2=0x7fdaa4104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.561+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 shutdown_connections 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:25.562+0000 7fdaa994b700 1 -- 172.21.15.32:0/435484699 wait complete. 2024-05-06T21:17:26.410 INFO:teuthology.orchestra.run.smithi032.stdout:Deploying crash service with default placement... 2024-05-06T21:17:26.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:26 smithi032 ceph-mon[27179]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:26.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:26 smithi032 ceph-mon[27179]: Saving service mgr spec with placement count:2 2024-05-06T21:17:26.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:26 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:26.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:26 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:27.659 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-05-06T21:17:27.659 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.814+0000 7fa038342700 1 Processor -- start 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.814+0000 7fa038342700 1 -- start start 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.814+0000 7fa038342700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03007a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.814+0000 7fa038342700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03007a830 con 0x7fa03007bdf0 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.814+0000 7fa0360de700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03007a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.814+0000 7fa0360de700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03007a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50632/0 (socket says 172.21.15.32:50632) 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.814+0000 7fa0360de700 1 -- 172.21.15.32:0/1811630875 learned_addr learned my addr 172.21.15.32:0/1811630875 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.815+0000 7fa0360de700 1 -- 172.21.15.32:0/1811630875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03007a970 con 0x7fa03007bdf0 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.815+0000 7fa0360de700 1 --2- 172.21.15.32:0/1811630875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03007a2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0098a0 tx=0x7fa02c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe6b86fe1156e4e server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.815+0000 7fa0350dc700 1 -- 172.21.15.32:0/1811630875 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa02c004180 con 0x7fa03007bdf0 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.815+0000 7fa0350dc700 1 -- 172.21.15.32:0/1811630875 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa02c0042e0 con 0x7fa03007bdf0 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.815+0000 7fa0350dc700 1 -- 172.21.15.32:0/1811630875 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa02c011af0 con 0x7fa03007bdf0 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.816+0000 7fa038342700 1 -- 172.21.15.32:0/1811630875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 msgr2=0x7fa03007a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:27.660 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.816+0000 7fa038342700 1 --2- 172.21.15.32:0/1811630875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03007a2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0098a0 tx=0x7fa02c009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.816+0000 7fa038342700 1 -- 172.21.15.32:0/1811630875 shutdown_connections 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.816+0000 7fa038342700 1 --2- 172.21.15.32:0/1811630875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03007a2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.816+0000 7fa038342700 1 -- 172.21.15.32:0/1811630875 >> 172.21.15.32:0/1811630875 conn(0x7fa030101180 msgr2=0x7fa030103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.816+0000 7fa038342700 1 -- 172.21.15.32:0/1811630875 shutdown_connections 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.816+0000 7fa038342700 1 -- 172.21.15.32:0/1811630875 wait complete. 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.816+0000 7fa038342700 1 Processor -- start 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.816+0000 7fa038342700 1 -- start start 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa038342700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa038342700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03019c030 con 0x7fa03007bdf0 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa0360de700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa0360de700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03019baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50648/0 (socket says 172.21.15.32:50648) 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa0360de700 1 -- 172.21.15.32:0/3106961626 learned_addr learned my addr 172.21.15.32:0/3106961626 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa0360de700 1 -- 172.21.15.32:0/3106961626 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c009550 con 0x7fa03007bdf0 2024-05-06T21:17:27.661 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa0360de700 1 --2- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03019baf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa02c000c00 tx=0x7fa02c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa0277fe700 1 -- 172.21.15.32:0/3106961626 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa02c003a70 con 0x7fa03007bdf0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa0277fe700 1 -- 172.21.15.32:0/3106961626 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa02c003bd0 con 0x7fa03007bdf0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03019c230 con 0x7fa03007bdf0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa0277fe700 1 -- 172.21.15.32:0/3106961626 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa02c023700 con 0x7fa03007bdf0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.817+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03019c650 con 0x7fa03007bdf0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.818+0000 7fa0277fe700 1 -- 172.21.15.32:0/3106961626 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fa02c0239c0 con 0x7fa03007bdf0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.818+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa030062380 con 0x7fa03007bdf0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.818+0000 7fa0277fe700 1 --2- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa01c0383f0 0x7fa01c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.818+0000 7fa0277fe700 1 -- 172.21.15.32:0/3106961626 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa02c04c2f0 con 0x7fa03007bdf0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.819+0000 7fa0358dd700 1 --2- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa01c0383f0 0x7fa01c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.819+0000 7fa0358dd700 1 --2- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa01c0383f0 0x7fa01c03a8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa020006fd0 tx=0x7fa020006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:26.823+0000 7fa0277fe700 1 -- 172.21.15.32:0/3106961626 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa02c010700 con 0x7fa03007bdf0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.059+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fa030103440 con 0x7fa01c0383f0 2024-05-06T21:17:27.662 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.063+0000 7fa0277fe700 1 -- 172.21.15.32:0/3106961626 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fa030103440 con 0x7fa01c0383f0 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa01c0383f0 msgr2=0x7fa01c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 --2- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa01c0383f0 0x7fa01c03a8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa020006fd0 tx=0x7fa020006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 msgr2=0x7fa03019baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 --2- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03019baf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa02c000c00 tx=0x7fa02c011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 shutdown_connections 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 --2- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa01c0383f0 0x7fa01c03a8a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 --2- 172.21.15.32:0/3106961626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa03007bdf0 0x7fa03019baf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 >> 172.21.15.32:0/3106961626 conn(0x7fa030101180 msgr2=0x7fa030102820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 shutdown_connections 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:27.065+0000 7fa038342700 1 -- 172.21.15.32:0/3106961626 wait complete. 2024-05-06T21:17:27.663 INFO:teuthology.orchestra.run.smithi032.stdout:Deploying ceph-exporter service with default placement... 2024-05-06T21:17:28.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:27 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:28.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:27 smithi032 ceph-mon[27179]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:28.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:27 smithi032 ceph-mon[27179]: Saving service crash spec with placement * 2024-05-06T21:17:28.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:27 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:29.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:29 smithi032 ceph-mon[27179]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:29.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:29 smithi032 ceph-mon[27179]: Saving service ceph-exporter spec with placement * 2024-05-06T21:17:29.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:29 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:29.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:29 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:29.486 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-05-06T21:17:29.486 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.100+0000 7fb97a194700 1 Processor -- start 2024-05-06T21:17:29.486 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.100+0000 7fb97a194700 1 -- start start 2024-05-06T21:17:29.486 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.100+0000 7fb97a194700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb974105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:29.486 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.100+0000 7fb97a194700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974106460 con 0x7fb974105b10 2024-05-06T21:17:29.486 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.101+0000 7fb9737fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb974105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:29.486 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.101+0000 7fb9737fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb974105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50664/0 (socket says 172.21.15.32:50664) 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.101+0000 7fb9737fe700 1 -- 172.21.15.32:0/333452180 learned_addr learned my addr 172.21.15.32:0/333452180 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.101+0000 7fb9737fe700 1 -- 172.21.15.32:0/333452180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9741065a0 con 0x7fb974105b10 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.101+0000 7fb9737fe700 1 --2- 172.21.15.32:0/333452180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb974105f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9640098a0 tx=0x7fb964009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de96b5d9f6a293d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.101+0000 7fb9727fc700 1 -- 172.21.15.32:0/333452180 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb964004180 con 0x7fb974105b10 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.101+0000 7fb9727fc700 1 -- 172.21.15.32:0/333452180 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb9640042e0 con 0x7fb974105b10 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.101+0000 7fb9727fc700 1 -- 172.21.15.32:0/333452180 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb964011af0 con 0x7fb974105b10 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.102+0000 7fb97a194700 1 -- 172.21.15.32:0/333452180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 msgr2=0x7fb974105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.102+0000 7fb97a194700 1 --2- 172.21.15.32:0/333452180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb974105f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9640098a0 tx=0x7fb964009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.102+0000 7fb97a194700 1 -- 172.21.15.32:0/333452180 shutdown_connections 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.102+0000 7fb97a194700 1 --2- 172.21.15.32:0/333452180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb974105f20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.102+0000 7fb97a194700 1 -- 172.21.15.32:0/333452180 >> 172.21.15.32:0/333452180 conn(0x7fb974101180 msgr2=0x7fb974103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.102+0000 7fb97a194700 1 -- 172.21.15.32:0/333452180 shutdown_connections 2024-05-06T21:17:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.102+0000 7fb97a194700 1 -- 172.21.15.32:0/333452180 wait complete. 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.103+0000 7fb97a194700 1 Processor -- start 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.103+0000 7fb97a194700 1 -- start start 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.103+0000 7fb97a194700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb97407bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.103+0000 7fb97a194700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97407c180 con 0x7fb974105b10 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.103+0000 7fb9737fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb97407bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.103+0000 7fb9737fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb97407bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50674/0 (socket says 172.21.15.32:50674) 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.103+0000 7fb9737fe700 1 -- 172.21.15.32:0/2325009737 learned_addr learned my addr 172.21.15.32:0/2325009737 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.103+0000 7fb9737fe700 1 -- 172.21.15.32:0/2325009737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964009550 con 0x7fb974105b10 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.104+0000 7fb9737fe700 1 --2- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb97407bc40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb964006ba0 tx=0x7fb964011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.104+0000 7fb970ff9700 1 -- 172.21.15.32:0/2325009737 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb964003b00 con 0x7fb974105b10 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.104+0000 7fb970ff9700 1 -- 172.21.15.32:0/2325009737 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb96401a8e0 con 0x7fb974105b10 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.104+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97407a290 con 0x7fb974105b10 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.104+0000 7fb970ff9700 1 -- 172.21.15.32:0/2325009737 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9640199c0 con 0x7fb974105b10 2024-05-06T21:17:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.104+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97407a6b0 con 0x7fb974105b10 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.105+0000 7fb970ff9700 1 -- 172.21.15.32:0/2325009737 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fb964019c30 con 0x7fb974105b10 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.105+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb974062380 con 0x7fb974105b10 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.105+0000 7fb970ff9700 1 --2- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fb95c0383f0 0x7fb95c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.105+0000 7fb970ff9700 1 -- 172.21.15.32:0/2325009737 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb96404c560 con 0x7fb974105b10 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.105+0000 7fb972ffd700 1 --2- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fb95c0383f0 0x7fb95c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.105+0000 7fb972ffd700 1 --2- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fb95c0383f0 0x7fb95c03a8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb968006fd0 tx=0x7fb968006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.110+0000 7fb970ff9700 1 -- 172.21.15.32:0/2325009737 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb964018710 con 0x7fb974105b10 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.329+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fb974102610 con 0x7fb95c0383f0 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.334+0000 7fb970ff9700 1 -- 172.21.15.32:0/2325009737 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fb974102610 con 0x7fb95c0383f0 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fb95c0383f0 msgr2=0x7fb95c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 --2- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fb95c0383f0 0x7fb95c03a8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb968006fd0 tx=0x7fb968006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 msgr2=0x7fb97407bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 --2- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb97407bc40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb964006ba0 tx=0x7fb964011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:29.490 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 shutdown_connections 2024-05-06T21:17:29.490 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 --2- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fb95c0383f0 0x7fb95c03a8a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:29.490 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 --2- 172.21.15.32:0/2325009737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb974105b10 0x7fb97407bc40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:29.490 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 >> 172.21.15.32:0/2325009737 conn(0x7fb974101180 msgr2=0x7fb974101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:29.490 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 shutdown_connections 2024-05-06T21:17:29.490 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:28.336+0000 7fb97a194700 1 -- 172.21.15.32:0/2325009737 wait complete. 2024-05-06T21:17:29.490 INFO:teuthology.orchestra.run.smithi032.stdout:Deploying prometheus service with default placement... 2024-05-06T21:17:30.751 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-05-06T21:17:30.751 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.906+0000 7f47889a0700 1 Processor -- start 2024-05-06T21:17:30.751 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.906+0000 7f47889a0700 1 -- start start 2024-05-06T21:17:30.751 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.906+0000 7f47889a0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f4784105d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:30.751 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.906+0000 7f47889a0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47841062d0 con 0x7f4784105980 2024-05-06T21:17:30.751 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.907+0000 7f47837fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f4784105d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:30.751 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.907+0000 7f47837fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f4784105d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50690/0 (socket says 172.21.15.32:50690) 2024-05-06T21:17:30.751 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.907+0000 7f47837fe700 1 -- 172.21.15.32:0/3758048851 learned_addr learned my addr 172.21.15.32:0/3758048851 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:30.751 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.907+0000 7f47837fe700 1 -- 172.21.15.32:0/3758048851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784106410 con 0x7f4784105980 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.907+0000 7f47837fe700 1 --2- 172.21.15.32:0/3758048851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f4784105d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47740098a0 tx=0x7f4774009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd4c082b4030e18 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.907+0000 7f4782ffd700 1 -- 172.21.15.32:0/3758048851 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4774004180 con 0x7f4784105980 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.907+0000 7f4782ffd700 1 -- 172.21.15.32:0/3758048851 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47740042e0 con 0x7f4784105980 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.907+0000 7f4782ffd700 1 -- 172.21.15.32:0/3758048851 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4774011af0 con 0x7f4784105980 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.908+0000 7f47889a0700 1 -- 172.21.15.32:0/3758048851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 msgr2=0x7f4784105d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.908+0000 7f47889a0700 1 --2- 172.21.15.32:0/3758048851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f4784105d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47740098a0 tx=0x7f4774009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.908+0000 7f47889a0700 1 -- 172.21.15.32:0/3758048851 shutdown_connections 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.908+0000 7f47889a0700 1 --2- 172.21.15.32:0/3758048851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f4784105d90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.908+0000 7f47889a0700 1 -- 172.21.15.32:0/3758048851 >> 172.21.15.32:0/3758048851 conn(0x7f4784100ff0 msgr2=0x7f4784103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.908+0000 7f47889a0700 1 -- 172.21.15.32:0/3758048851 shutdown_connections 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.908+0000 7f47889a0700 1 -- 172.21.15.32:0/3758048851 wait complete. 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.909+0000 7f47889a0700 1 Processor -- start 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.909+0000 7f47889a0700 1 -- start start 2024-05-06T21:17:30.752 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.909+0000 7f47889a0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f478406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.909+0000 7f47889a0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478406b0a0 con 0x7f4784105980 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47837fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f478406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47837fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f478406ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50694/0 (socket says 172.21.15.32:50694) 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47837fe700 1 -- 172.21.15.32:0/1851363110 learned_addr learned my addr 172.21.15.32:0/1851363110 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47837fe700 1 -- 172.21.15.32:0/1851363110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4774009550 con 0x7f4784105980 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47837fe700 1 --2- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f478406ab60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4774006ba0 tx=0x7f4774011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47817fa700 1 -- 172.21.15.32:0/1851363110 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4774003b00 con 0x7f4784105980 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478406b2a0 con 0x7f4784105980 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47817fa700 1 -- 172.21.15.32:0/1851363110 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f477401a8e0 con 0x7f4784105980 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47817fa700 1 -- 172.21.15.32:0/1851363110 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f47740199c0 con 0x7f4784105980 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.910+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478406b6c0 con 0x7f4784105980 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.911+0000 7f47817fa700 1 -- 172.21.15.32:0/1851363110 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f4774019c30 con 0x7f4784105980 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.911+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4784062380 con 0x7f4784105980 2024-05-06T21:17:30.753 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.911+0000 7f47817fa700 1 --2- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47700383f0 0x7f477003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.911+0000 7f47817fa700 1 -- 172.21.15.32:0/1851363110 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f477404c580 con 0x7f4784105980 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.912+0000 7f477affd700 1 --2- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47700383f0 0x7f477003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.912+0000 7f477affd700 1 --2- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47700383f0 0x7f477003a8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f476c006fd0 tx=0x7f476c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:29.917+0000 7f47817fa700 1 -- 172.21.15.32:0/1851363110 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f477402d440 con 0x7f4784105980 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.133+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f4784102480 con 0x7f47700383f0 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.138+0000 7f47817fa700 1 -- 172.21.15.32:0/1851363110 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f4784102480 con 0x7f47700383f0 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47700383f0 msgr2=0x7f477003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 --2- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47700383f0 0x7f477003a8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f476c006fd0 tx=0x7f476c006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 msgr2=0x7f478406ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 --2- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f478406ab60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4774006ba0 tx=0x7f4774011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 shutdown_connections 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 --2- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47700383f0 0x7f477003a8a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:30.754 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 --2- 172.21.15.32:0/1851363110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4784105980 0x7f478406ab60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:30.755 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 >> 172.21.15.32:0/1851363110 conn(0x7f4784100ff0 msgr2=0x7f4784101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:30.755 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 shutdown_connections 2024-05-06T21:17:30.755 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:30.141+0000 7f47889a0700 1 -- 172.21.15.32:0/1851363110 wait complete. 2024-05-06T21:17:30.755 INFO:teuthology.orchestra.run.smithi032.stdout:Deploying grafana service with default placement... 2024-05-06T21:17:31.006 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:30 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:31.006 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:30 smithi032 ceph-mon[27179]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:31.007 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:30 smithi032 ceph-mon[27179]: Saving service prometheus spec with placement count:1 2024-05-06T21:17:31.007 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:30 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:32.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-05-06T21:17:32.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.219+0000 7fe53fb9c700 1 Processor -- start 2024-05-06T21:17:32.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.219+0000 7fe53fb9c700 1 -- start start 2024-05-06T21:17:32.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.220+0000 7fe53fb9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538104210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:32.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.220+0000 7fe53fb9c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538104750 con 0x7fe538103e00 2024-05-06T21:17:32.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.220+0000 7fe53d938700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538104210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:32.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.220+0000 7fe53d938700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538104210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50696/0 (socket says 172.21.15.32:50696) 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.220+0000 7fe53d938700 1 -- 172.21.15.32:0/2936914393 learned_addr learned my addr 172.21.15.32:0/2936914393 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.220+0000 7fe53d938700 1 -- 172.21.15.32:0/2936914393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe538104890 con 0x7fe538103e00 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.220+0000 7fe53d938700 1 --2- 172.21.15.32:0/2936914393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538104210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe5340098a0 tx=0x7fe534009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9f5f379fcd4647 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.221+0000 7fe53c936700 1 -- 172.21.15.32:0/2936914393 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe534004180 con 0x7fe538103e00 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.221+0000 7fe53c936700 1 -- 172.21.15.32:0/2936914393 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe5340042e0 con 0x7fe538103e00 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.221+0000 7fe53c936700 1 -- 172.21.15.32:0/2936914393 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe534011af0 con 0x7fe538103e00 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.221+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2936914393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 msgr2=0x7fe538104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.221+0000 7fe53fb9c700 1 --2- 172.21.15.32:0/2936914393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538104210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe5340098a0 tx=0x7fe534009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.221+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2936914393 shutdown_connections 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.221+0000 7fe53fb9c700 1 --2- 172.21.15.32:0/2936914393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538104210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:32.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.221+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2936914393 >> 172.21.15.32:0/2936914393 conn(0x7fe5380ff7e0 msgr2=0x7fe538101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.222+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2936914393 shutdown_connections 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.222+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2936914393 wait complete. 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.222+0000 7fe53fb9c700 1 Processor -- start 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.222+0000 7fe53fb9c700 1 -- start start 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.222+0000 7fe53fb9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538106790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.222+0000 7fe53fb9c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538106cd0 con 0x7fe538103e00 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe53d938700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538106790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe53d938700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538106790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50712/0 (socket says 172.21.15.32:50712) 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe53d938700 1 -- 172.21.15.32:0/2611139400 learned_addr learned my addr 172.21.15.32:0/2611139400 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe53d938700 1 -- 172.21.15.32:0/2611139400 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe534009550 con 0x7fe538103e00 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe53d938700 1 --2- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538106790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe534006ba0 tx=0x7fe534011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:32.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe52effd700 1 -- 172.21.15.32:0/2611139400 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe534003b00 con 0x7fe538103e00 2024-05-06T21:17:32.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe52effd700 1 -- 172.21.15.32:0/2611139400 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe53401a8e0 con 0x7fe538103e00 2024-05-06T21:17:32.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe538104de0 con 0x7fe538103e00 2024-05-06T21:17:32.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe52effd700 1 -- 172.21.15.32:0/2611139400 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe534019990 con 0x7fe538103e00 2024-05-06T21:17:32.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.223+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe538105200 con 0x7fe538103e00 2024-05-06T21:17:32.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.224+0000 7fe52effd700 1 -- 172.21.15.32:0/2611139400 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe534019c50 con 0x7fe538103e00 2024-05-06T21:17:32.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.224+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe538062380 con 0x7fe538103e00 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.225+0000 7fe52effd700 1 --2- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe5240383a0 0x7fe52403a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.225+0000 7fe52effd700 1 -- 172.21.15.32:0/2611139400 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe53404c5f0 con 0x7fe538103e00 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.225+0000 7fe53d137700 1 --2- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe5240383a0 0x7fe52403a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.225+0000 7fe53d137700 1 --2- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe5240383a0 0x7fe52403a850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe528006fd0 tx=0x7fe528006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.233+0000 7fe52effd700 1 -- 172.21.15.32:0/2611139400 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe53402d440 con 0x7fe538103e00 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.453+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fe538101ab0 con 0x7fe5240383a0 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.457+0000 7fe52effd700 1 -- 172.21.15.32:0/2611139400 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fe538101ab0 con 0x7fe5240383a0 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe5240383a0 msgr2=0x7fe52403a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 --2- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe5240383a0 0x7fe52403a850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe528006fd0 tx=0x7fe528006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:32.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 msgr2=0x7fe538106790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:32.484 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 --2- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538106790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe534006ba0 tx=0x7fe534011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:32.484 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 shutdown_connections 2024-05-06T21:17:32.484 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 --2- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fe5240383a0 0x7fe52403a850 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:32.484 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 --2- 172.21.15.32:0/2611139400 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe538103e00 0x7fe538106790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:32.484 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 >> 172.21.15.32:0/2611139400 conn(0x7fe5380ff7e0 msgr2=0x7fe538100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:32.484 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 shutdown_connections 2024-05-06T21:17:32.484 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:31.459+0000 7fe53fb9c700 1 -- 172.21.15.32:0/2611139400 wait complete. 2024-05-06T21:17:32.484 INFO:teuthology.orchestra.run.smithi032.stdout:Deploying node-exporter service with default placement... 2024-05-06T21:17:32.716 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:32 smithi032 ceph-mon[27179]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:32.716 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:32 smithi032 ceph-mon[27179]: Saving service grafana spec with placement count:1 2024-05-06T21:17:32.716 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:32 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:33.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:33 smithi032 ceph-mon[27179]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:17:33.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:33 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.356+0000 7fed4797b700 1 Processor -- start 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.356+0000 7fed4797b700 1 -- start start 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.356+0000 7fed4797b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40108a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.356+0000 7fed4797b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed40079d10 con 0x7fed40106680 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.357+0000 7fed45717700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40108a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.357+0000 7fed45717700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40108a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58476/0 (socket says 172.21.15.32:58476) 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.357+0000 7fed45717700 1 -- 172.21.15.32:0/2988507867 learned_addr learned my addr 172.21.15.32:0/2988507867 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.357+0000 7fed45717700 1 -- 172.21.15.32:0/2988507867 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40079e50 con 0x7fed40106680 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.357+0000 7fed45717700 1 --2- 172.21.15.32:0/2988507867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40108a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0098a0 tx=0x7fed3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf37d5957885de7 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.357+0000 7fed37fff700 1 -- 172.21.15.32:0/2988507867 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed3c004180 con 0x7fed40106680 2024-05-06T21:17:34.196 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.357+0000 7fed37fff700 1 -- 172.21.15.32:0/2988507867 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed3c0042e0 con 0x7fed40106680 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.357+0000 7fed37fff700 1 -- 172.21.15.32:0/2988507867 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed3c011af0 con 0x7fed40106680 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.358+0000 7fed4797b700 1 -- 172.21.15.32:0/2988507867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 msgr2=0x7fed40108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.358+0000 7fed4797b700 1 --2- 172.21.15.32:0/2988507867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40108a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0098a0 tx=0x7fed3c009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.358+0000 7fed4797b700 1 -- 172.21.15.32:0/2988507867 shutdown_connections 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.358+0000 7fed4797b700 1 --2- 172.21.15.32:0/2988507867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40108a60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.358+0000 7fed4797b700 1 -- 172.21.15.32:0/2988507867 >> 172.21.15.32:0/2988507867 conn(0x7fed40100060 msgr2=0x7fed40102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.358+0000 7fed4797b700 1 -- 172.21.15.32:0/2988507867 shutdown_connections 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.358+0000 7fed4797b700 1 -- 172.21.15.32:0/2988507867 wait complete. 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.359+0000 7fed4797b700 1 Processor -- start 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.359+0000 7fed4797b700 1 -- start start 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.359+0000 7fed4797b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.359+0000 7fed4797b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed40199dd0 con 0x7fed40106680 2024-05-06T21:17:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.359+0000 7fed45717700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.359+0000 7fed45717700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58482/0 (socket says 172.21.15.32:58482) 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.359+0000 7fed45717700 1 -- 172.21.15.32:0/3039264818 learned_addr learned my addr 172.21.15.32:0/3039264818 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.359+0000 7fed45717700 1 -- 172.21.15.32:0/3039264818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c009550 con 0x7fed40106680 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.360+0000 7fed45717700 1 --2- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40199890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed3c000c00 tx=0x7fed3c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.360+0000 7fed367fc700 1 -- 172.21.15.32:0/3039264818 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed3c003a70 con 0x7fed40106680 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.360+0000 7fed367fc700 1 -- 172.21.15.32:0/3039264818 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed3c003bd0 con 0x7fed40106680 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.360+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed40199fd0 con 0x7fed40106680 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.360+0000 7fed367fc700 1 -- 172.21.15.32:0/3039264818 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed3c0238c0 con 0x7fed40106680 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.360+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4019a3f0 con 0x7fed40106680 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.361+0000 7fed367fc700 1 -- 172.21.15.32:0/3039264818 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fed3c01a430 con 0x7fed40106680 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.361+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed40062380 con 0x7fed40106680 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.361+0000 7fed367fc700 1 --2- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed2c038440 0x7fed2c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:34.198 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.361+0000 7fed367fc700 1 -- 172.21.15.32:0/3039264818 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fed3c04c170 con 0x7fed40106680 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.361+0000 7fed44f16700 1 --2- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed2c038440 0x7fed2c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.362+0000 7fed44f16700 1 --2- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed2c038440 0x7fed2c03a8f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed30006fd0 tx=0x7fed30006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.366+0000 7fed367fc700 1 -- 172.21.15.32:0/3039264818 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fed3c010560 con 0x7fed40106680 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.576+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fed40102360 con 0x7fed2c038440 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.581+0000 7fed367fc700 1 -- 172.21.15.32:0/3039264818 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fed40102360 con 0x7fed2c038440 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.582+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed2c038440 msgr2=0x7fed2c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.582+0000 7fed4797b700 1 --2- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed2c038440 0x7fed2c03a8f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed30006fd0 tx=0x7fed30006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.582+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 msgr2=0x7fed40199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.582+0000 7fed4797b700 1 --2- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40199890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed3c000c00 tx=0x7fed3c011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.583+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 shutdown_connections 2024-05-06T21:17:34.200 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.583+0000 7fed4797b700 1 --2- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fed2c038440 0x7fed2c03a8f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:34.200 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.583+0000 7fed4797b700 1 --2- 172.21.15.32:0/3039264818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed40106680 0x7fed40199890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:34.200 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.583+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 >> 172.21.15.32:0/3039264818 conn(0x7fed40100060 msgr2=0x7fed40101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:34.200 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.583+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 shutdown_connections 2024-05-06T21:17:34.200 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:33.583+0000 7fed4797b700 1 -- 172.21.15.32:0/3039264818 wait complete. 2024-05-06T21:17:34.200 INFO:teuthology.orchestra.run.smithi032.stdout:Deploying alertmanager service with default placement... 2024-05-06T21:17:34.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:34 smithi032 ceph-mon[27179]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:34.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:34 smithi032 ceph-mon[27179]: Saving service node-exporter spec with placement * 2024-05-06T21:17:35.476 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-05-06T21:17:35.477 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.619+0000 7fa2e6967700 1 Processor -- start 2024-05-06T21:17:35.477 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.619+0000 7fa2e6967700 1 -- start start 2024-05-06T21:17:35.477 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.619+0000 7fa2e6967700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:35.477 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.619+0000 7fa2e6967700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e0106460 con 0x7fa2e0105b10 2024-05-06T21:17:35.478 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.619+0000 7fa2dffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:35.478 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.619+0000 7fa2dffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58488/0 (socket says 172.21.15.32:58488) 2024-05-06T21:17:35.478 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.619+0000 7fa2dffff700 1 -- 172.21.15.32:0/1821100701 learned_addr learned my addr 172.21.15.32:0/1821100701 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:35.478 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.620+0000 7fa2dffff700 1 -- 172.21.15.32:0/1821100701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e01065a0 con 0x7fa2e0105b10 2024-05-06T21:17:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.620+0000 7fa2dffff700 1 --2- 172.21.15.32:0/1821100701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0105f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00098a0 tx=0x7fa2d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe64b16d0fea293c server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.620+0000 7fa2deffd700 1 -- 172.21.15.32:0/1821100701 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2d0004180 con 0x7fa2e0105b10 2024-05-06T21:17:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.620+0000 7fa2deffd700 1 -- 172.21.15.32:0/1821100701 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2d00042e0 con 0x7fa2e0105b10 2024-05-06T21:17:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.620+0000 7fa2deffd700 1 -- 172.21.15.32:0/1821100701 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2d0011af0 con 0x7fa2e0105b10 2024-05-06T21:17:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.621+0000 7fa2e6967700 1 -- 172.21.15.32:0/1821100701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 msgr2=0x7fa2e0105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.621+0000 7fa2e6967700 1 --2- 172.21.15.32:0/1821100701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0105f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00098a0 tx=0x7fa2d0009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.621+0000 7fa2e6967700 1 -- 172.21.15.32:0/1821100701 shutdown_connections 2024-05-06T21:17:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.621+0000 7fa2e6967700 1 --2- 172.21.15.32:0/1821100701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0105f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.621+0000 7fa2e6967700 1 -- 172.21.15.32:0/1821100701 >> 172.21.15.32:0/1821100701 conn(0x7fa2e0101180 msgr2=0x7fa2e0103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.621+0000 7fa2e6967700 1 -- 172.21.15.32:0/1821100701 shutdown_connections 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.621+0000 7fa2e6967700 1 -- 172.21.15.32:0/1821100701 wait complete. 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.621+0000 7fa2e6967700 1 Processor -- start 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.621+0000 7fa2e6967700 1 -- start start 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2e6967700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2e6967700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e0199d90 con 0x7fa2e0105b10 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2dffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2dffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58490/0 (socket says 172.21.15.32:58490) 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2dffff700 1 -- 172.21.15.32:0/896564181 learned_addr learned my addr 172.21.15.32:0/896564181 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2dffff700 1 -- 172.21.15.32:0/896564181 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0009550 con 0x7fa2e0105b10 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2dffff700 1 --2- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0199850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0006ba0 tx=0x7fa2d0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2dd7fa700 1 -- 172.21.15.32:0/896564181 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2d0003b00 con 0x7fa2e0105b10 2024-05-06T21:17:35.480 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e0199f90 con 0x7fa2e0105b10 2024-05-06T21:17:35.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2dd7fa700 1 -- 172.21.15.32:0/896564181 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2d001a8e0 con 0x7fa2e0105b10 2024-05-06T21:17:35.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2dd7fa700 1 -- 172.21.15.32:0/896564181 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2d00199c0 con 0x7fa2e0105b10 2024-05-06T21:17:35.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.622+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e019a3b0 con 0x7fa2e0105b10 2024-05-06T21:17:35.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.623+0000 7fa2dd7fa700 1 -- 172.21.15.32:0/896564181 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fa2d0019c80 con 0x7fa2e0105b10 2024-05-06T21:17:35.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.623+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e0062380 con 0x7fa2e0105b10 2024-05-06T21:17:35.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.624+0000 7fa2dd7fa700 1 --2- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa2c80383a0 0x7fa2c803a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:35.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.624+0000 7fa2dd7fa700 1 -- 172.21.15.32:0/896564181 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa2d004c820 con 0x7fa2e0105b10 2024-05-06T21:17:35.481 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.624+0000 7fa2df7fe700 1 --2- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa2c80383a0 0x7fa2c803a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:35.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.624+0000 7fa2df7fe700 1 --2- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa2c80383a0 0x7fa2c803a850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4006fd0 tx=0x7fa2d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:35.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.628+0000 7fa2dd7fa700 1 -- 172.21.15.32:0/896564181 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa2d002b700 con 0x7fa2e0105b10 2024-05-06T21:17:35.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.842+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2e0102610 con 0x7fa2c80383a0 2024-05-06T21:17:35.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.846+0000 7fa2dd7fa700 1 -- 172.21.15.32:0/896564181 <== mgr.14120 v2:172.21.15.32:6800/3609229440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fa2e0102610 con 0x7fa2c80383a0 2024-05-06T21:17:35.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa2c80383a0 msgr2=0x7fa2c803a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:35.482 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 --2- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa2c80383a0 0x7fa2c803a850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4006fd0 tx=0x7fa2d4006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 msgr2=0x7fa2e0199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 --2- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0199850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0006ba0 tx=0x7fa2d0011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 shutdown_connections 2024-05-06T21:17:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 --2- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fa2c80383a0 0x7fa2c803a850 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 --2- 172.21.15.32:0/896564181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e0105b10 0x7fa2e0199850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 >> 172.21.15.32:0/896564181 conn(0x7fa2e0101180 msgr2=0x7fa2e0101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 shutdown_connections 2024-05-06T21:17:35.483 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:34.849+0000 7fa2e6967700 1 -- 172.21.15.32:0/896564181 wait complete. 2024-05-06T21:17:36.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:35 smithi032 ceph-mon[27179]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:17:36.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:35 smithi032 ceph-mon[27179]: from='mgr.14120 172.21.15.32:0/1132540593' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:36.700 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 Processor -- start 2024-05-06T21:17:36.700 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 -- start start 2024-05-06T21:17:36.700 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:36.700 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c106460 con 0x7ff39c105b10 2024-05-06T21:17:36.700 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a0e74700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:36.700 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a0e74700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58494/0 (socket says 172.21.15.32:58494) 2024-05-06T21:17:36.700 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a0e74700 1 -- 172.21.15.32:0/1253053535 learned_addr learned my addr 172.21.15.32:0/1253053535 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:36.700 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a0e74700 1 -- 172.21.15.32:0/1253053535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c1065a0 con 0x7ff39c105b10 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a0e74700 1 --2- 172.21.15.32:0/1253053535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c105f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3900098a0 tx=0x7ff390009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2b3a546158de05 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff39b7fe700 1 -- 172.21.15.32:0/1253053535 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff390004180 con 0x7ff39c105b10 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff39b7fe700 1 -- 172.21.15.32:0/1253053535 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff3900042e0 con 0x7ff39c105b10 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff39b7fe700 1 -- 172.21.15.32:0/1253053535 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff390011af0 con 0x7ff39c105b10 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 -- 172.21.15.32:0/1253053535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 msgr2=0x7ff39c105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 --2- 172.21.15.32:0/1253053535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c105f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3900098a0 tx=0x7ff390009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 -- 172.21.15.32:0/1253053535 shutdown_connections 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 --2- 172.21.15.32:0/1253053535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c105f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 -- 172.21.15.32:0/1253053535 >> 172.21.15.32:0/1253053535 conn(0x7ff39c101180 msgr2=0x7ff39c103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 -- 172.21.15.32:0/1253053535 shutdown_connections 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.933+0000 7ff3a30d8700 1 -- 172.21.15.32:0/1253053535 wait complete. 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.934+0000 7ff3a30d8700 1 Processor -- start 2024-05-06T21:17:36.701 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.934+0000 7ff3a30d8700 1 -- start start 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.934+0000 7ff3a30d8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.934+0000 7ff3a30d8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c199dd0 con 0x7ff39c105b10 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.934+0000 7ff3a0e74700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.934+0000 7ff3a0e74700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58500/0 (socket says 172.21.15.32:58500) 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.934+0000 7ff3a0e74700 1 -- 172.21.15.32:0/2761009051 learned_addr learned my addr 172.21.15.32:0/2761009051 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.935+0000 7ff3a0e74700 1 -- 172.21.15.32:0/2761009051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390009550 con 0x7ff39c105b10 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.935+0000 7ff3a0e74700 1 --2- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c199890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff390011ad0 tx=0x7ff390011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.935+0000 7ff399ffb700 1 -- 172.21.15.32:0/2761009051 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff390003ab0 con 0x7ff39c105b10 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.935+0000 7ff399ffb700 1 -- 172.21.15.32:0/2761009051 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff390003c10 con 0x7ff39c105b10 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.935+0000 7ff399ffb700 1 -- 172.21.15.32:0/2761009051 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3900198e0 con 0x7ff39c105b10 2024-05-06T21:17:36.702 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.935+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c199fd0 con 0x7ff39c105b10 2024-05-06T21:17:36.703 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.935+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c19a3f0 con 0x7ff39c105b10 2024-05-06T21:17:36.703 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.936+0000 7ff399ffb700 1 -- 172.21.15.32:0/2761009051 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff390019ba0 con 0x7ff39c105b10 2024-05-06T21:17:36.703 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.936+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39c062380 con 0x7ff39c105b10 2024-05-06T21:17:36.703 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.936+0000 7ff399ffb700 1 --2- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7ff38c0383f0 0x7ff38c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:36.703 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.936+0000 7ff399ffb700 1 -- 172.21.15.32:0/2761009051 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff39004c190 con 0x7ff39c105b10 2024-05-06T21:17:36.703 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.936+0000 7ff39bfff700 1 --2- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7ff38c0383f0 0x7ff38c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:36.704 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.937+0000 7ff39bfff700 1 --2- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7ff38c0383f0 0x7ff38c03a8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff388006fd0 tx=0x7ff388006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:36.704 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:35.942+0000 7ff399ffb700 1 -- 172.21.15.32:0/2761009051 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff39001a430 con 0x7ff39c105b10 2024-05-06T21:17:36.704 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.142+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7ff39c19d590 con 0x7ff39c105b10 2024-05-06T21:17:36.704 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.145+0000 7ff399ffb700 1 -- 172.21.15.32:0/2761009051 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7ff390018ab0 con 0x7ff39c105b10 2024-05-06T21:17:36.704 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.147+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7ff38c0383f0 msgr2=0x7ff38c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:36.705 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.147+0000 7ff3a30d8700 1 --2- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7ff38c0383f0 0x7ff38c03a8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff388006fd0 tx=0x7ff388006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:36.705 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.148+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 msgr2=0x7ff39c199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:36.705 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.148+0000 7ff3a30d8700 1 --2- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c199890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff390011ad0 tx=0x7ff390011bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:36.705 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.148+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 shutdown_connections 2024-05-06T21:17:36.705 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.148+0000 7ff3a30d8700 1 --2- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7ff38c0383f0 0x7ff38c03a8a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:36.705 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.148+0000 7ff3a30d8700 1 --2- 172.21.15.32:0/2761009051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff39c105b10 0x7ff39c199890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:36.706 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.148+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 >> 172.21.15.32:0/2761009051 conn(0x7ff39c101180 msgr2=0x7ff39c101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:36.706 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.148+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 shutdown_connections 2024-05-06T21:17:36.706 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:36.148+0000 7ff3a30d8700 1 -- 172.21.15.32:0/2761009051 wait complete. 2024-05-06T21:17:37.053 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:36 smithi032 ceph-mon[27179]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:37.053 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:36 smithi032 ceph-mon[27179]: Saving service alertmanager spec with placement count:1 2024-05-06T21:17:37.053 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:36 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2761009051' entity='client.admin' 2024-05-06T21:17:37.955 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:37 smithi032 ceph-mon[27179]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:17:37.955 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:37 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3751652520' entity='client.admin' 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.164+0000 7f753f381700 1 Processor -- start 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.165+0000 7f753f381700 1 -- start start 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.165+0000 7f753f381700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538108a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.165+0000 7f753f381700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7538079d10 con 0x7f7538106680 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.165+0000 7f753d11d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538108a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.165+0000 7f753d11d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538108a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58502/0 (socket says 172.21.15.32:58502) 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.165+0000 7f753d11d700 1 -- 172.21.15.32:0/997457604 learned_addr learned my addr 172.21.15.32:0/997457604 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.165+0000 7f753d11d700 1 -- 172.21.15.32:0/997457604 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538079e50 con 0x7f7538106680 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f753d11d700 1 --2- 172.21.15.32:0/997457604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538108a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75340098a0 tx=0x7f7534009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23712cce28a50533 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:37.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f752ffff700 1 -- 172.21.15.32:0/997457604 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7534004180 con 0x7f7538106680 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f752ffff700 1 -- 172.21.15.32:0/997457604 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75340042e0 con 0x7f7538106680 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f752ffff700 1 -- 172.21.15.32:0/997457604 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7534011af0 con 0x7f7538106680 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f753f381700 1 -- 172.21.15.32:0/997457604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 msgr2=0x7f7538108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f753f381700 1 --2- 172.21.15.32:0/997457604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538108a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75340098a0 tx=0x7f7534009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f753f381700 1 -- 172.21.15.32:0/997457604 shutdown_connections 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f753f381700 1 --2- 172.21.15.32:0/997457604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538108a60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f753f381700 1 -- 172.21.15.32:0/997457604 >> 172.21.15.32:0/997457604 conn(0x7f7538100060 msgr2=0x7f7538102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f753f381700 1 -- 172.21.15.32:0/997457604 shutdown_connections 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.166+0000 7f753f381700 1 -- 172.21.15.32:0/997457604 wait complete. 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.167+0000 7f753f381700 1 Processor -- start 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.167+0000 7f753f381700 1 -- start start 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.167+0000 7f753f381700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.167+0000 7f753f381700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7538199dd0 con 0x7f7538106680 2024-05-06T21:17:37.964 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.167+0000 7f753d11d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.167+0000 7f753d11d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58508/0 (socket says 172.21.15.32:58508) 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.167+0000 7f753d11d700 1 -- 172.21.15.32:0/3751652520 learned_addr learned my addr 172.21.15.32:0/3751652520 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.168+0000 7f753d11d700 1 -- 172.21.15.32:0/3751652520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534009550 con 0x7f7538106680 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.168+0000 7f753d11d700 1 --2- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538199890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7534006ba0 tx=0x7f7534011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.168+0000 7f752e7fc700 1 -- 172.21.15.32:0/3751652520 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7534003b00 con 0x7f7538106680 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.168+0000 7f752e7fc700 1 -- 172.21.15.32:0/3751652520 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f753401a8e0 con 0x7f7538106680 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.168+0000 7f752e7fc700 1 -- 172.21.15.32:0/3751652520 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7534019990 con 0x7f7538106680 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.168+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7538199fd0 con 0x7f7538106680 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.168+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753819a3f0 con 0x7f7538106680 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.169+0000 7f752e7fc700 1 -- 172.21.15.32:0/3751652520 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7534019c00 con 0x7f7538106680 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.169+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7538062380 con 0x7f7538106680 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.169+0000 7f752e7fc700 1 --2- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f75240383f0 0x7f752403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:37.965 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.169+0000 7f752e7fc700 1 -- 172.21.15.32:0/3751652520 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f753404c530 con 0x7f7538106680 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.169+0000 7f753c91c700 1 --2- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f75240383f0 0x7f752403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.170+0000 7f753c91c700 1 --2- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f75240383f0 0x7f752403a8a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7528006fd0 tx=0x7f7528006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.174+0000 7f752e7fc700 1 -- 172.21.15.32:0/3751652520 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7534018710 con 0x7f7538106680 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.371+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f753819d2c0 con 0x7f7538106680 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.374+0000 7f752e7fc700 1 -- 172.21.15.32:0/3751652520 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f7534018350 con 0x7f7538106680 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.376+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f75240383f0 msgr2=0x7f752403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.376+0000 7f753f381700 1 --2- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f75240383f0 0x7f752403a8a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7528006fd0 tx=0x7f7528006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.376+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 msgr2=0x7f7538199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.376+0000 7f753f381700 1 --2- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538199890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7534006ba0 tx=0x7f7534011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.376+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 shutdown_connections 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.376+0000 7f753f381700 1 --2- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f75240383f0 0x7f752403a8a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.376+0000 7f753f381700 1 --2- 172.21.15.32:0/3751652520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7538106680 0x7f7538199890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.376+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 >> 172.21.15.32:0/3751652520 conn(0x7f7538100060 msgr2=0x7f7538101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:37.966 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.377+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 shutdown_connections 2024-05-06T21:17:37.967 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:37.377+0000 7f753f381700 1 -- 172.21.15.32:0/3751652520 wait complete. 2024-05-06T21:17:37.967 INFO:teuthology.orchestra.run.smithi032.stdout:Enabling the dashboard module... 2024-05-06T21:17:38.965 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:38 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/764142846' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-06T21:17:39.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.367+0000 7f47a3808700 1 Processor -- start 2024-05-06T21:17:39.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.367+0000 7f47a3808700 1 -- start start 2024-05-06T21:17:39.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.367+0000 7f47a3808700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c1089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:39.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.367+0000 7f47a3808700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c079d70 con 0x7f479c106600 2024-05-06T21:17:39.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.367+0000 7f47a15a4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c1089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:39.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.367+0000 7f47a15a4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c1089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58512/0 (socket says 172.21.15.32:58512) 2024-05-06T21:17:39.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.368+0000 7f47a15a4700 1 -- 172.21.15.32:0/881688370 learned_addr learned my addr 172.21.15.32:0/881688370 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:39.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.368+0000 7f47a15a4700 1 -- 172.21.15.32:0/881688370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c079eb0 con 0x7f479c106600 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.368+0000 7f47a15a4700 1 --2- 172.21.15.32:0/881688370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c1089e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47980098a0 tx=0x7f4798009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259274c64e17bd12 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.368+0000 7f4793fff700 1 -- 172.21.15.32:0/881688370 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4798004180 con 0x7f479c106600 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.368+0000 7f4793fff700 1 -- 172.21.15.32:0/881688370 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47980042e0 con 0x7f479c106600 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.368+0000 7f4793fff700 1 -- 172.21.15.32:0/881688370 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4798011af0 con 0x7f479c106600 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.369+0000 7f47a3808700 1 -- 172.21.15.32:0/881688370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 msgr2=0x7f479c1089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.369+0000 7f47a3808700 1 --2- 172.21.15.32:0/881688370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c1089e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47980098a0 tx=0x7f4798009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.369+0000 7f47a3808700 1 -- 172.21.15.32:0/881688370 shutdown_connections 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.369+0000 7f47a3808700 1 --2- 172.21.15.32:0/881688370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c1089e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.369+0000 7f47a3808700 1 -- 172.21.15.32:0/881688370 >> 172.21.15.32:0/881688370 conn(0x7f479c100080 msgr2=0x7f479c102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.369+0000 7f47a3808700 1 -- 172.21.15.32:0/881688370 shutdown_connections 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.369+0000 7f47a3808700 1 -- 172.21.15.32:0/881688370 wait complete. 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.369+0000 7f47a3808700 1 Processor -- start 2024-05-06T21:17:39.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a3808700 1 -- start start 2024-05-06T21:17:39.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a3808700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:39.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a3808700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c199dc0 con 0x7f479c106600 2024-05-06T21:17:39.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a15a4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:39.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a15a4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58516/0 (socket says 172.21.15.32:58516) 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a15a4700 1 -- 172.21.15.32:0/764142846 learned_addr learned my addr 172.21.15.32:0/764142846 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a15a4700 1 -- 172.21.15.32:0/764142846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798009550 con 0x7f479c106600 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a15a4700 1 --2- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c199880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4798000c00 tx=0x7f4798011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47927fc700 1 -- 172.21.15.32:0/764142846 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4798003a70 con 0x7f479c106600 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47927fc700 1 -- 172.21.15.32:0/764142846 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4798003bd0 con 0x7f479c106600 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47927fc700 1 -- 172.21.15.32:0/764142846 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f47980238c0 con 0x7f479c106600 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c199fc0 con 0x7f479c106600 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.370+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c19a3e0 con 0x7f479c106600 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.371+0000 7f47927fc700 1 -- 172.21.15.32:0/764142846 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f4798023b80 con 0x7f479c106600 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.371+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c109be0 con 0x7f479c106600 2024-05-06T21:17:39.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.372+0000 7f47927fc700 1 --2- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47880383f0 0x7f478803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.372+0000 7f47927fc700 1 -- 172.21.15.32:0/764142846 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f479804c1d0 con 0x7f479c106600 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.372+0000 7f47a0da3700 1 --2- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47880383f0 0x7f478803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.372+0000 7f47a0da3700 1 --2- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47880383f0 0x7f478803a8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f478c006fd0 tx=0x7f478c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.376+0000 7f47927fc700 1 -- 172.21.15.32:0/764142846 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4798023e30 con 0x7f479c106600 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.632+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f479c109dd0 con 0x7f479c106600 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.783+0000 7f47927fc700 1 -- 172.21.15.32:0/764142846 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f479801a430 con 0x7f479c106600 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.784+0000 7f47927fc700 1 -- 172.21.15.32:0/764142846 <== mon.0 v2:172.21.15.32:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f479802c350 con 0x7f479c106600 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47880383f0 msgr2=0x7f478803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 --2- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47880383f0 0x7f478803a8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f478c006fd0 tx=0x7f478c006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 msgr2=0x7f479c199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 --2- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c199880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4798000c00 tx=0x7f4798011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 shutdown_connections 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 --2- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f47880383f0 0x7f478803a8a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:39.549 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 --2- 172.21.15.32:0/764142846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f479c106600 0x7f479c199880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:39.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 >> 172.21.15.32:0/764142846 conn(0x7f479c100080 msgr2=0x7f479c101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:39.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 shutdown_connections 2024-05-06T21:17:39.550 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:38.787+0000 7f47a3808700 1 -- 172.21.15.32:0/764142846 wait complete. 2024-05-06T21:17:39.802 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:39 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/764142846' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-06T21:17:39.803 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:39 smithi032 ceph-mon[27179]: mgrmap e9: smithi032.ecoohh(active, since 26s) 2024-05-06T21:17:40.943 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:40 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1955469849' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-06T21:17:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout { 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "active_name": "smithi032.ecoohh", 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout } 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.984+0000 7f95b1bfd700 1 Processor -- start 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.984+0000 7f95b1bfd700 1 -- start start 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.984+0000 7f95b1bfd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.984+0000 7f95b1bfd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac106460 con 0x7f95ac105b10 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.984+0000 7f95ab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.984+0000 7f95ab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58546/0 (socket says 172.21.15.32:58546) 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.984+0000 7f95ab7fe700 1 -- 172.21.15.32:0/1309222420 learned_addr learned my addr 172.21.15.32:0/1309222420 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.985+0000 7f95ab7fe700 1 -- 172.21.15.32:0/1309222420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac1065a0 con 0x7f95ac105b10 2024-05-06T21:17:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.985+0000 7f95ab7fe700 1 --2- 172.21.15.32:0/1309222420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac105f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f959c0098a0 tx=0x7f959c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140efecc78b8a2d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.985+0000 7f95aa7fc700 1 -- 172.21.15.32:0/1309222420 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f959c004180 con 0x7f95ac105b10 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.985+0000 7f95aa7fc700 1 -- 172.21.15.32:0/1309222420 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f959c0042e0 con 0x7f95ac105b10 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.985+0000 7f95aa7fc700 1 -- 172.21.15.32:0/1309222420 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f959c011af0 con 0x7f95ac105b10 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.986+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1309222420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 msgr2=0x7f95ac105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.986+0000 7f95b1bfd700 1 --2- 172.21.15.32:0/1309222420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac105f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f959c0098a0 tx=0x7f959c009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.986+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1309222420 shutdown_connections 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.986+0000 7f95b1bfd700 1 --2- 172.21.15.32:0/1309222420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac105f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.986+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1309222420 >> 172.21.15.32:0/1309222420 conn(0x7f95ac101180 msgr2=0x7f95ac103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.986+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1309222420 shutdown_connections 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.986+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1309222420 wait complete. 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.986+0000 7f95b1bfd700 1 Processor -- start 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.987+0000 7f95b1bfd700 1 -- start start 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.987+0000 7f95b1bfd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.987+0000 7f95b1bfd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac199dd0 con 0x7f95ac105b10 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.987+0000 7f95ab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.987+0000 7f95ab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58552/0 (socket says 172.21.15.32:58552) 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.987+0000 7f95ab7fe700 1 -- 172.21.15.32:0/1955469849 learned_addr learned my addr 172.21.15.32:0/1955469849 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.987+0000 7f95ab7fe700 1 -- 172.21.15.32:0/1955469849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c009550 con 0x7f95ac105b10 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.987+0000 7f95ab7fe700 1 --2- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac199890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f959c011ad0 tx=0x7f959c011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.988+0000 7f95a8ff9700 1 -- 172.21.15.32:0/1955469849 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f959c003ab0 con 0x7f95ac105b10 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.988+0000 7f95a8ff9700 1 -- 172.21.15.32:0/1955469849 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f959c003c10 con 0x7f95ac105b10 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.988+0000 7f95a8ff9700 1 -- 172.21.15.32:0/1955469849 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f959c0198e0 con 0x7f95ac105b10 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.988+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac199fd0 con 0x7f95ac105b10 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.988+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac19a3f0 con 0x7f95ac105b10 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.989+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac062380 con 0x7f95ac105b10 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.989+0000 7f95a8ff9700 1 -- 172.21.15.32:0/1955469849 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f959c019ba0 con 0x7f95ac105b10 2024-05-06T21:17:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.990+0000 7f95a8ff9700 1 --2- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9598038440 0x7f959803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.990+0000 7f95a8ff9700 1 -- 172.21.15.32:0/1955469849 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f959c04c430 con 0x7f95ac105b10 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.990+0000 7f95aaffd700 1 -- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9598038440 msgr2=0x7f959803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/3609229440 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.990+0000 7f95aaffd700 1 --2- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9598038440 0x7f959803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:39.994+0000 7f95a8ff9700 1 -- 172.21.15.32:0/1955469849 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f959c01a430 con 0x7f95ac105b10 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.191+0000 7f95aaffd700 1 -- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9598038440 msgr2=0x7f959803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/3609229440 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.191+0000 7f95aaffd700 1 --2- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9598038440 0x7f959803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.299+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f95ac1079c0 con 0x7f95ac105b10 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.299+0000 7f95a8ff9700 1 -- 172.21.15.32:0/1955469849 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f959c029030 con 0x7f95ac105b10 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.301+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9598038440 msgr2=0x7f959803a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.301+0000 7f95b1bfd700 1 --2- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9598038440 0x7f959803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.301+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 msgr2=0x7f95ac199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.301+0000 7f95b1bfd700 1 --2- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac199890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f959c011ad0 tx=0x7f959c011bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.302+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 shutdown_connections 2024-05-06T21:17:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.302+0000 7f95b1bfd700 1 --2- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7f9598038440 0x7f959803a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:40.956 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.302+0000 7f95b1bfd700 1 --2- 172.21.15.32:0/1955469849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95ac105b10 0x7f95ac199890 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:40.956 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.302+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 >> 172.21.15.32:0/1955469849 conn(0x7f95ac101180 msgr2=0x7f95ac101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:40.956 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.302+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 shutdown_connections 2024-05-06T21:17:40.956 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:40.302+0000 7f95b1bfd700 1 -- 172.21.15.32:0/1955469849 wait complete. 2024-05-06T21:17:40.956 INFO:teuthology.orchestra.run.smithi032.stdout:Waiting for the mgr to restart... 2024-05-06T21:17:40.956 INFO:teuthology.orchestra.run.smithi032.stdout:Waiting for mgr epoch 9... 2024-05-06T21:17:46.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: Active manager daemon smithi032.ecoohh restarted 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: Activating manager daemon smithi032.ecoohh 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: osdmap e3: 0 total, 0 up, 0 in 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: mgrmap e10: smithi032.ecoohh(active, starting, since 0.00348079s) 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: Manager daemon smithi032.ecoohh is now available 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:17:46.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:17:46.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:17:46.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:45 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:17:47.579 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout { 2024-05-06T21:17:47.579 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-06T21:17:47.579 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-06T21:17:47.579 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout } 2024-05-06T21:17:47.579 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.415+0000 7fec9220c700 1 Processor -- start 2024-05-06T21:17:47.579 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.415+0000 7fec9220c700 1 -- start start 2024-05-06T21:17:47.579 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.415+0000 7fec9220c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c104e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:47.579 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.415+0000 7fec9220c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c105380 con 0x7fec8c104a30 2024-05-06T21:17:47.580 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.415+0000 7fec8b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c104e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:47.580 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.415+0000 7fec8b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c104e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58554/0 (socket says 172.21.15.32:58554) 2024-05-06T21:17:47.580 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.415+0000 7fec8b7fe700 1 -- 172.21.15.32:0/801892258 learned_addr learned my addr 172.21.15.32:0/801892258 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:47.580 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.416+0000 7fec8b7fe700 1 -- 172.21.15.32:0/801892258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c1054c0 con 0x7fec8c104a30 2024-05-06T21:17:47.580 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.416+0000 7fec8b7fe700 1 --2- 172.21.15.32:0/801892258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c104e40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00bb40 tx=0x7fec7c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4d8e217c280502 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:47.580 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.416+0000 7fec8a7fc700 1 -- 172.21.15.32:0/801892258 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec7c00dc00 con 0x7fec8c104a30 2024-05-06T21:17:47.580 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.416+0000 7fec8a7fc700 1 -- 172.21.15.32:0/801892258 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec7c0044e0 con 0x7fec8c104a30 2024-05-06T21:17:47.580 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.416+0000 7fec8a7fc700 1 -- 172.21.15.32:0/801892258 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec7c010470 con 0x7fec8c104a30 2024-05-06T21:17:47.581 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.417+0000 7fec9220c700 1 -- 172.21.15.32:0/801892258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 msgr2=0x7fec8c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:47.581 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.417+0000 7fec9220c700 1 --2- 172.21.15.32:0/801892258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c104e40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00bb40 tx=0x7fec7c00be50 comp rx=0 tx=0).stop 2024-05-06T21:17:47.581 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.417+0000 7fec9220c700 1 -- 172.21.15.32:0/801892258 shutdown_connections 2024-05-06T21:17:47.581 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.417+0000 7fec9220c700 1 --2- 172.21.15.32:0/801892258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c104e40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:47.581 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.417+0000 7fec9220c700 1 -- 172.21.15.32:0/801892258 >> 172.21.15.32:0/801892258 conn(0x7fec8c100060 msgr2=0x7fec8c1024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:47.581 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.417+0000 7fec9220c700 1 -- 172.21.15.32:0/801892258 shutdown_connections 2024-05-06T21:17:47.581 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.417+0000 7fec9220c700 1 -- 172.21.15.32:0/801892258 wait complete. 2024-05-06T21:17:47.582 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.417+0000 7fec9220c700 1 Processor -- start 2024-05-06T21:17:47.582 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.418+0000 7fec9220c700 1 -- start start 2024-05-06T21:17:47.582 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.418+0000 7fec9220c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:47.582 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.418+0000 7fec9220c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c19c000 con 0x7fec8c104a30 2024-05-06T21:17:47.582 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.418+0000 7fec8b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:47.582 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.418+0000 7fec8b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c19bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58562/0 (socket says 172.21.15.32:58562) 2024-05-06T21:17:47.582 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.418+0000 7fec8b7fe700 1 -- 172.21.15.32:0/4147503843 learned_addr learned my addr 172.21.15.32:0/4147503843 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:47.583 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.418+0000 7fec8b7fe700 1 -- 172.21.15.32:0/4147503843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c00b7f0 con 0x7fec8c104a30 2024-05-06T21:17:47.583 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.418+0000 7fec8b7fe700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c19bac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec7c003ff0 tx=0x7fec7c0040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:47.583 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.418+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec7c00de20 con 0x7fec8c104a30 2024-05-06T21:17:47.584 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.419+0000 7fec9220c700 1 -- 172.21.15.32:0/4147503843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c19c200 con 0x7fec8c104a30 2024-05-06T21:17:47.584 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.419+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec7c0042e0 con 0x7fec8c104a30 2024-05-06T21:17:47.584 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.419+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec7c021c70 con 0x7fec8c104a30 2024-05-06T21:17:47.584 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.419+0000 7fec9220c700 1 -- 172.21.15.32:0/4147503843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c19c5c0 con 0x7fec8c104a30 2024-05-06T21:17:47.584 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.420+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fec7c0193f0 con 0x7fec8c104a30 2024-05-06T21:17:47.584 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.420+0000 7fec88ff9700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 0x7fec7403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:47.584 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.420+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 --> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec7403afb0 con 0x7fec740383f0 2024-05-06T21:17:47.585 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.420+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fec7c04c570 con 0x7fec8c104a30 2024-05-06T21:17:47.585 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.420+0000 7fec8affd700 1 -- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 msgr2=0x7fec7403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/3609229440 2024-05-06T21:17:47.585 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.420+0000 7fec8affd700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 0x7fec7403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T21:17:47.585 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.621+0000 7fec8affd700 1 -- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 msgr2=0x7fec7403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/3609229440 2024-05-06T21:17:47.585 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:41.621+0000 7fec8affd700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 0x7fec7403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T21:17:47.585 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:42.022+0000 7fec8affd700 1 -- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 msgr2=0x7fec7403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/3609229440 2024-05-06T21:17:47.586 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:42.022+0000 7fec8affd700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 0x7fec7403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-06T21:17:47.586 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:42.823+0000 7fec8affd700 1 -- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 msgr2=0x7fec7403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/3609229440 2024-05-06T21:17:47.586 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:42.823+0000 7fec8affd700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 0x7fec7403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-06T21:17:47.586 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:44.424+0000 7fec8affd700 1 -- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 msgr2=0x7fec7403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/3609229440 2024-05-06T21:17:47.586 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:44.424+0000 7fec8affd700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 0x7fec7403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-06T21:17:47.586 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:45.721+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7fec7c019740 con 0x7fec8c104a30 2024-05-06T21:17:47.586 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:45.721+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 msgr2=0x7fec7403a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T21:17:47.587 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:45.721+0000 7fec88ff9700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 0x7fec7403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:47.587 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.722+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7fec7c0203c0 con 0x7fec8c104a30 2024-05-06T21:17:47.587 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.722+0000 7fec88ff9700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fec7403be50 0x7fec7403e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:47.587 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.723+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 --> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec7403afb0 con 0x7fec7403be50 2024-05-06T21:17:47.587 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.723+0000 7fec8affd700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fec7403be50 0x7fec7403e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:47.587 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.724+0000 7fec8affd700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fec7403be50 0x7fec7403e230 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fec80003a10 tx=0x7fec800092b0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:47.587 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.724+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 <== mgr.14164 v2:172.21.15.32:6800/2414450865 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fec7403afb0 con 0x7fec7403be50 2024-05-06T21:17:47.587 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.730+0000 7fec9220c700 1 -- 172.21.15.32:0/4147503843 --> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fec8c19ce00 con 0x7fec7403be50 2024-05-06T21:17:47.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec88ff9700 1 -- 172.21.15.32:0/4147503843 <== mgr.14164 v2:172.21.15.32:6800/2414450865 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fec8c19ce00 con 0x7fec7403be50 2024-05-06T21:17:47.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 -- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fec7403be50 msgr2=0x7fec7403e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:47.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fec7403be50 0x7fec7403e230 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fec80003a10 tx=0x7fec800092b0 comp rx=0 tx=0).stop 2024-05-06T21:17:47.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 -- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 msgr2=0x7fec8c19bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:47.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c19bac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec7c003ff0 tx=0x7fec7c0040d0 comp rx=0 tx=0).stop 2024-05-06T21:17:47.588 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 -- 172.21.15.32:0/4147503843 shutdown_connections 2024-05-06T21:17:47.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fec7403be50 0x7fec7403e230 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:47.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec8c104a30 0x7fec8c19bac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:47.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 --2- 172.21.15.32:0/4147503843 >> [v2:172.21.15.32:6800/3609229440,v1:172.21.15.32:6801/3609229440] conn(0x7fec740383f0 0x7fec7403a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:47.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 -- 172.21.15.32:0/4147503843 >> 172.21.15.32:0/4147503843 conn(0x7fec8c100060 msgr2=0x7fec8c18e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:47.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 -- 172.21.15.32:0/4147503843 shutdown_connections 2024-05-06T21:17:47.589 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:46.731+0000 7fec9220c700 1 -- 172.21.15.32:0/4147503843 wait complete. 2024-05-06T21:17:47.590 INFO:teuthology.orchestra.run.smithi032.stdout:mgr epoch 9 is available 2024-05-06T21:17:47.590 INFO:teuthology.orchestra.run.smithi032.stdout:Generating a dashboard self-signed certificate... 2024-05-06T21:17:47.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:47 smithi032 ceph-mon[27179]: [06/May/2024:21:17:46] ENGINE Bus STARTING 2024-05-06T21:17:47.824 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:47 smithi032 ceph-mon[27179]: [06/May/2024:21:17:46] ENGINE Serving on http://172.21.15.32:8765 2024-05-06T21:17:47.824 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:47 smithi032 ceph-mon[27179]: [06/May/2024:21:17:46] ENGINE Serving on https://172.21.15.32:7150 2024-05-06T21:17:47.824 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:47 smithi032 ceph-mon[27179]: [06/May/2024:21:17:46] ENGINE Bus STARTED 2024-05-06T21:17:47.824 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:47 smithi032 ceph-mon[27179]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-06T21:17:47.824 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:47 smithi032 ceph-mon[27179]: mgrmap e11: smithi032.ecoohh(active, since 1.00585s) 2024-05-06T21:17:47.824 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:47 smithi032 ceph-mon[27179]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-06T21:17:47.824 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:47 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:48.939 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-06T21:17:48.939 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.017+0000 7fefc917d700 1 Processor -- start 2024-05-06T21:17:48.939 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.017+0000 7fefc917d700 1 -- start start 2024-05-06T21:17:48.939 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.017+0000 7fefc917d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc407a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:48.939 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.017+0000 7fefc917d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc407a870 con 0x7fefc407be30 2024-05-06T21:17:48.939 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.018+0000 7fefc2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc407a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:48.939 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.018+0000 7fefc2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc407a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44766/0 (socket says 172.21.15.32:44766) 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.018+0000 7fefc2d9d700 1 -- 172.21.15.32:0/1929293660 learned_addr learned my addr 172.21.15.32:0/1929293660 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.018+0000 7fefc2d9d700 1 -- 172.21.15.32:0/1929293660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc407a9b0 con 0x7fefc407be30 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.018+0000 7fefc2d9d700 1 --2- 172.21.15.32:0/1929293660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc407a330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fefb40098a0 tx=0x7fefb4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f13ecf30e042ef4 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.018+0000 7fefc1d9b700 1 -- 172.21.15.32:0/1929293660 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefb4004180 con 0x7fefc407be30 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.018+0000 7fefc1d9b700 1 -- 172.21.15.32:0/1929293660 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fefb40042e0 con 0x7fefc407be30 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.018+0000 7fefc1d9b700 1 -- 172.21.15.32:0/1929293660 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefb4011af0 con 0x7fefc407be30 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.019+0000 7fefc917d700 1 -- 172.21.15.32:0/1929293660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 msgr2=0x7fefc407a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.019+0000 7fefc917d700 1 --2- 172.21.15.32:0/1929293660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc407a330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fefb40098a0 tx=0x7fefb4009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.019+0000 7fefc917d700 1 -- 172.21.15.32:0/1929293660 shutdown_connections 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.019+0000 7fefc917d700 1 --2- 172.21.15.32:0/1929293660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc407a330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.019+0000 7fefc917d700 1 -- 172.21.15.32:0/1929293660 >> 172.21.15.32:0/1929293660 conn(0x7fefc4101180 msgr2=0x7fefc4103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.019+0000 7fefc917d700 1 -- 172.21.15.32:0/1929293660 shutdown_connections 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.019+0000 7fefc917d700 1 -- 172.21.15.32:0/1929293660 wait complete. 2024-05-06T21:17:48.940 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.020+0000 7fefc917d700 1 Processor -- start 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.020+0000 7fefc917d700 1 -- start start 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.020+0000 7fefc917d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.020+0000 7fefc917d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc419c020 con 0x7fefc407be30 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefc2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefc2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc419bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44780/0 (socket says 172.21.15.32:44780) 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefc2d9d700 1 -- 172.21.15.32:0/2136016903 learned_addr learned my addr 172.21.15.32:0/2136016903 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefc2d9d700 1 -- 172.21.15.32:0/2136016903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb4009550 con 0x7fefc407be30 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefc2d9d700 1 --2- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc419bae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fefb4006ba0 tx=0x7fefb4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefabfff700 1 -- 172.21.15.32:0/2136016903 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefb4003b00 con 0x7fefc407be30 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc419c220 con 0x7fefc407be30 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefabfff700 1 -- 172.21.15.32:0/2136016903 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fefb401a8e0 con 0x7fefc407be30 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefabfff700 1 -- 172.21.15.32:0/2136016903 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefb4019990 con 0x7fefc407be30 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.021+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc419c640 con 0x7fefc407be30 2024-05-06T21:17:48.941 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.022+0000 7fefabfff700 1 -- 172.21.15.32:0/2136016903 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7fefb4019c00 con 0x7fefc407be30 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.022+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc4062380 con 0x7fefc407be30 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.023+0000 7fefabfff700 1 --2- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fefac038310 0x7fefac03a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.023+0000 7fefabfff700 1 -- 172.21.15.32:0/2136016903 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fefb404c500 con 0x7fefc407be30 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.023+0000 7fefc259c700 1 --2- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fefac038310 0x7fefac03a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.023+0000 7fefc259c700 1 --2- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fefac038310 0x7fefac03a7c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fefb8006fd0 tx=0x7fefb8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.028+0000 7fefabfff700 1 -- 172.21.15.32:0/2136016903 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fefb402d440 con 0x7fefc407be30 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.174+0000 7fefabfff700 1 -- 172.21.15.32:0/2136016903 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fefb402c3a0 con 0x7fefc407be30 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.251+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 --> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fefc41034a0 con 0x7fefac038310 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.317+0000 7fefabfff700 1 -- 172.21.15.32:0/2136016903 <== mgr.14164 v2:172.21.15.32:6800/2414450865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fefc41034a0 con 0x7fefac038310 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fefac038310 msgr2=0x7fefac03a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 --2- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fefac038310 0x7fefac03a7c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fefb8006fd0 tx=0x7fefb8006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 msgr2=0x7fefc419bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 --2- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc419bae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fefb4006ba0 tx=0x7fefb4011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:48.943 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 shutdown_connections 2024-05-06T21:17:48.943 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 --2- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fefac038310 0x7fefac03a7c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:48.943 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 --2- 172.21.15.32:0/2136016903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc407be30 0x7fefc419bae0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:48.943 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 >> 172.21.15.32:0/2136016903 conn(0x7fefc4101180 msgr2=0x7fefc4102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:48.943 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 shutdown_connections 2024-05-06T21:17:48.943 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:48.319+0000 7fefc917d700 1 -- 172.21.15.32:0/2136016903 wait complete. 2024-05-06T21:17:48.943 INFO:teuthology.orchestra.run.smithi032.stdout:Creating initial admin user... 2024-05-06T21:17:49.178 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:49 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:49.178 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:49 smithi032 ceph-mon[27179]: mgrmap e12: smithi032.ecoohh(active, since 2s) 2024-05-06T21:17:49.178 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:49 smithi032 ceph-mon[27179]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:49.178 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:49 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:49.178 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:49 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:50.544 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0r2AbsZgQnYYwCwVg5tzBOeB3.rFJCHrFSMuOc3tA3sTm9Wd63ZY6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715030269, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-06T21:17:50.544 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.394+0000 7f6a27fb9700 1 Processor -- start 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.395+0000 7f6a27fb9700 1 -- start start 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.395+0000 7f6a27fb9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2010ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.395+0000 7f6a27fb9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2010f210 con 0x7f6a20080300 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.395+0000 7f6a25d55700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2010ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.395+0000 7f6a25d55700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2010ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44790/0 (socket says 172.21.15.32:44790) 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.395+0000 7f6a25d55700 1 -- 172.21.15.32:0/789764667 learned_addr learned my addr 172.21.15.32:0/789764667 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.395+0000 7f6a25d55700 1 -- 172.21.15.32:0/789764667 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2010f350 con 0x7f6a20080300 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.395+0000 7f6a25d55700 1 --2- 172.21.15.32:0/789764667 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2010ecd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0098a0 tx=0x7f6a1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a81e484219453a server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.396+0000 7f6a24d53700 1 -- 172.21.15.32:0/789764667 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a1c004180 con 0x7f6a20080300 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.396+0000 7f6a24d53700 1 -- 172.21.15.32:0/789764667 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6a1c0042e0 con 0x7f6a20080300 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.396+0000 7f6a24d53700 1 -- 172.21.15.32:0/789764667 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a1c011af0 con 0x7f6a20080300 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.397+0000 7f6a27fb9700 1 -- 172.21.15.32:0/789764667 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 msgr2=0x7f6a2010ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.397+0000 7f6a27fb9700 1 --2- 172.21.15.32:0/789764667 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2010ecd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0098a0 tx=0x7f6a1c009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:50.545 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.397+0000 7f6a27fb9700 1 -- 172.21.15.32:0/789764667 shutdown_connections 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.397+0000 7f6a27fb9700 1 --2- 172.21.15.32:0/789764667 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2010ecd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.397+0000 7f6a27fb9700 1 -- 172.21.15.32:0/789764667 >> 172.21.15.32:0/789764667 conn(0x7f6a2007b220 msgr2=0x7f6a2007d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.397+0000 7f6a27fb9700 1 -- 172.21.15.32:0/789764667 shutdown_connections 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.397+0000 7f6a27fb9700 1 -- 172.21.15.32:0/789764667 wait complete. 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.398+0000 7f6a27fb9700 1 Processor -- start 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.398+0000 7f6a27fb9700 1 -- start start 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.398+0000 7f6a27fb9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2019ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.398+0000 7f6a27fb9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a201a0460 con 0x7f6a20080300 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.398+0000 7f6a25d55700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2019ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.398+0000 7f6a25d55700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2019ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44804/0 (socket says 172.21.15.32:44804) 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.398+0000 7f6a25d55700 1 -- 172.21.15.32:0/4104233823 learned_addr learned my addr 172.21.15.32:0/4104233823 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.398+0000 7f6a25d55700 1 -- 172.21.15.32:0/4104233823 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c009550 con 0x7f6a20080300 2024-05-06T21:17:50.546 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.399+0000 7f6a25d55700 1 --2- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2019ff20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c011670 tx=0x7f6a1c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.399+0000 7f6a16ffd700 1 -- 172.21.15.32:0/4104233823 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a1c0039f0 con 0x7f6a20080300 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.399+0000 7f6a16ffd700 1 -- 172.21.15.32:0/4104233823 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6a1c003b50 con 0x7f6a20080300 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.399+0000 7f6a16ffd700 1 -- 172.21.15.32:0/4104233823 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a1c0247c0 con 0x7f6a20080300 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.400+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a201a0660 con 0x7f6a20080300 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.400+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a201a0a80 con 0x7f6a20080300 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.401+0000 7f6a16ffd700 1 -- 172.21.15.32:0/4104233823 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f6a1c01ac00 con 0x7f6a20080300 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.401+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a20199f40 con 0x7f6a20080300 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.401+0000 7f6a16ffd700 1 --2- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f6a0c038490 0x7f6a0c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.401+0000 7f6a16ffd700 1 -- 172.21.15.32:0/4104233823 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6a1c04c470 con 0x7f6a20080300 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.401+0000 7f6a25554700 1 --2- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f6a0c038490 0x7f6a0c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.402+0000 7f6a25554700 1 --2- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f6a0c038490 0x7f6a0c03a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a10006fd0 tx=0x7f6a10006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.406+0000 7f6a16ffd700 1 -- 172.21.15.32:0/4104233823 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6a1c01a430 con 0x7f6a20080300 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.627+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 --> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6a200621a0 con 0x7f6a0c038490 2024-05-06T21:17:50.547 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.873+0000 7f6a16ffd700 1 -- 172.21.15.32:0/4104233823 <== mgr.14164 v2:172.21.15.32:6800/2414450865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f6a200621a0 con 0x7f6a0c038490 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f6a0c038490 msgr2=0x7f6a0c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 --2- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f6a0c038490 0x7f6a0c03a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a10006fd0 tx=0x7f6a10006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 msgr2=0x7f6a2019ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 --2- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2019ff20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c011670 tx=0x7f6a1c011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 shutdown_connections 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 --2- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f6a0c038490 0x7f6a0c03a940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 --2- 172.21.15.32:0/4104233823 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a20080300 0x7f6a2019ff20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 >> 172.21.15.32:0/4104233823 conn(0x7f6a2007b220 msgr2=0x7f6a2007c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 shutdown_connections 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:49.875+0000 7f6a27fb9700 1 -- 172.21.15.32:0/4104233823 wait complete. 2024-05-06T21:17:50.548 INFO:teuthology.orchestra.run.smithi032.stdout:Fetching dashboard port number... 2024-05-06T21:17:50.818 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:50 smithi032 ceph-mon[27179]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:17:50.819 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:50 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:51.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:51 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/4191924926' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-06T21:17:52.285 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stdout 8443 2024-05-06T21:17:52.285 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.474+0000 7f0d2b2c6700 1 Processor -- start 2024-05-06T21:17:52.285 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.475+0000 7f0d2b2c6700 1 -- start start 2024-05-06T21:17:52.285 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.475+0000 7f0d2b2c6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d24108a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:52.285 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.475+0000 7f0d2b2c6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24079d30 con 0x7f0d24106660 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.475+0000 7f0d29062700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d24108a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.475+0000 7f0d29062700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d24108a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44820/0 (socket says 172.21.15.32:44820) 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.475+0000 7f0d29062700 1 -- 172.21.15.32:0/4034726418 learned_addr learned my addr 172.21.15.32:0/4034726418 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.475+0000 7f0d29062700 1 -- 172.21.15.32:0/4034726418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24079e70 con 0x7f0d24106660 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d29062700 1 --2- 172.21.15.32:0/4034726418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d24108a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d200098a0 tx=0x7f0d20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf9e497aa3859f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d1bfff700 1 -- 172.21.15.32:0/4034726418 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d20004180 con 0x7f0d24106660 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d1bfff700 1 -- 172.21.15.32:0/4034726418 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d200042e0 con 0x7f0d24106660 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d1bfff700 1 -- 172.21.15.32:0/4034726418 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d20011af0 con 0x7f0d24106660 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4034726418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 msgr2=0x7f0d24108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d2b2c6700 1 --2- 172.21.15.32:0/4034726418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d24108a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d200098a0 tx=0x7f0d20009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4034726418 shutdown_connections 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d2b2c6700 1 --2- 172.21.15.32:0/4034726418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d24108a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:52.286 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4034726418 >> 172.21.15.32:0/4034726418 conn(0x7f0d24100060 msgr2=0x7f0d24102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.476+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4034726418 shutdown_connections 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.477+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4034726418 wait complete. 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.477+0000 7f0d2b2c6700 1 Processor -- start 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.477+0000 7f0d2b2c6700 1 -- start start 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.477+0000 7f0d2b2c6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d241997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.477+0000 7f0d2b2c6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24199d10 con 0x7f0d24106660 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.477+0000 7f0d29062700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d241997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.477+0000 7f0d29062700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d241997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44822/0 (socket says 172.21.15.32:44822) 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.477+0000 7f0d29062700 1 -- 172.21.15.32:0/4191924926 learned_addr learned my addr 172.21.15.32:0/4191924926 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.478+0000 7f0d29062700 1 -- 172.21.15.32:0/4191924926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20009550 con 0x7f0d24106660 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.478+0000 7f0d29062700 1 --2- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d241997d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0d20000c00 tx=0x7f0d20011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.478+0000 7f0d1a7fc700 1 -- 172.21.15.32:0/4191924926 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d20003a70 con 0x7f0d24106660 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.478+0000 7f0d1a7fc700 1 -- 172.21.15.32:0/4191924926 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d20003bd0 con 0x7f0d24106660 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.478+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d24199f70 con 0x7f0d24106660 2024-05-06T21:17:52.287 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.478+0000 7f0d1a7fc700 1 -- 172.21.15.32:0/4191924926 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d200238c0 con 0x7f0d24106660 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.478+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2419a3f0 con 0x7f0d24106660 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.479+0000 7f0d1a7fc700 1 -- 172.21.15.32:0/4191924926 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f0d20023b30 con 0x7f0d24106660 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.479+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d24109b80 con 0x7f0d24106660 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.479+0000 7f0d1a7fc700 1 --2- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f0d10038490 0x7f0d1003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.479+0000 7f0d1a7fc700 1 -- 172.21.15.32:0/4191924926 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0d2004c420 con 0x7f0d24106660 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.479+0000 7f0d28861700 1 --2- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f0d10038490 0x7f0d1003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.480+0000 7f0d28861700 1 --2- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f0d10038490 0x7f0d1003a940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d14006fd0 tx=0x7f0d14006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.484+0000 7f0d1a7fc700 1 -- 172.21.15.32:0/4191924926 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0d200109d0 con 0x7f0d24106660 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.685+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f0d24109d40 con 0x7f0d24106660 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.686+0000 7f0d1a7fc700 1 -- 172.21.15.32:0/4191924926 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f0d20010380 con 0x7f0d24106660 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.688+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f0d10038490 msgr2=0x7f0d1003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.688+0000 7f0d2b2c6700 1 --2- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f0d10038490 0x7f0d1003a940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d14006fd0 tx=0x7f0d14006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:52.288 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.688+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 msgr2=0x7f0d241997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:52.289 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.688+0000 7f0d2b2c6700 1 --2- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d241997d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0d20000c00 tx=0x7f0d20011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:52.289 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.688+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 shutdown_connections 2024-05-06T21:17:52.289 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.688+0000 7f0d2b2c6700 1 --2- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f0d10038490 0x7f0d1003a940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:52.289 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.688+0000 7f0d2b2c6700 1 --2- 172.21.15.32:0/4191924926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d24106660 0x7f0d241997d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:52.289 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.689+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 >> 172.21.15.32:0/4191924926 conn(0x7f0d24100060 msgr2=0x7f0d24101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:52.289 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.689+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 shutdown_connections 2024-05-06T21:17:52.289 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:51.689+0000 7f0d2b2c6700 1 -- 172.21.15.32:0/4191924926 wait complete. 2024-05-06T21:17:52.293 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-06T21:17:52.294 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout disabled 2024-05-06T21:17:52.302 INFO:teuthology.orchestra.run.smithi032.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-06T21:17:52.302 INFO:teuthology.orchestra.run.smithi032.stdout:systemctl: stdout inactive 2024-05-06T21:17:52.302 INFO:teuthology.orchestra.run.smithi032.stdout:firewalld.service is not enabled 2024-05-06T21:17:52.302 INFO:teuthology.orchestra.run.smithi032.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-06T21:17:52.304 INFO:teuthology.orchestra.run.smithi032.stdout:Ceph Dashboard is now available at: 2024-05-06T21:17:52.304 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:52.304 INFO:teuthology.orchestra.run.smithi032.stdout: URL: https://smithi032.front.sepia.ceph.com:8443/ 2024-05-06T21:17:52.304 INFO:teuthology.orchestra.run.smithi032.stdout: User: admin 2024-05-06T21:17:52.304 INFO:teuthology.orchestra.run.smithi032.stdout: Password: d93gnkul56 2024-05-06T21:17:52.304 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:52.304 INFO:teuthology.orchestra.run.smithi032.stdout:Saving cluster configuration to /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config directory 2024-05-06T21:17:52.304 INFO:teuthology.orchestra.run.smithi032.stdout:Enabling autotune for osd_memory_target 2024-05-06T21:17:52.924 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:52 smithi032 ceph-mon[27179]: mgrmap e13: smithi032.ecoohh(active, since 6s) 2024-05-06T21:17:53.501 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.712+0000 7ff6a9f4f700 1 Processor -- start 2024-05-06T21:17:53.501 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.712+0000 7ff6a9f4f700 1 -- start start 2024-05-06T21:17:53.501 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.712+0000 7ff6a9f4f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4108a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:53.501 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.712+0000 7ff6a9f4f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40744b0 con 0x7ff6a4106670 2024-05-06T21:17:53.501 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.712+0000 7ff6a37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4108a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:53.501 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.712+0000 7ff6a37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4108a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35168/0 (socket says 172.21.15.32:35168) 2024-05-06T21:17:53.501 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.712+0000 7ff6a37fe700 1 -- 172.21.15.32:0/1292659432 learned_addr learned my addr 172.21.15.32:0/1292659432 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:53.501 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.713+0000 7ff6a37fe700 1 -- 172.21.15.32:0/1292659432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a40745f0 con 0x7ff6a4106670 2024-05-06T21:17:53.501 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.713+0000 7ff6a37fe700 1 --2- 172.21.15.32:0/1292659432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4108a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff6940098a0 tx=0x7ff694009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd8b2b4f016a589 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.713+0000 7ff6a27fc700 1 -- 172.21.15.32:0/1292659432 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff694004180 con 0x7ff6a4106670 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.713+0000 7ff6a27fc700 1 -- 172.21.15.32:0/1292659432 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff6940042e0 con 0x7ff6a4106670 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.713+0000 7ff6a27fc700 1 -- 172.21.15.32:0/1292659432 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff694011af0 con 0x7ff6a4106670 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.713+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/1292659432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 msgr2=0x7ff6a4108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.713+0000 7ff6a9f4f700 1 --2- 172.21.15.32:0/1292659432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4108a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff6940098a0 tx=0x7ff694009bb0 comp rx=0 tx=0).stop 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.714+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/1292659432 shutdown_connections 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.714+0000 7ff6a9f4f700 1 --2- 172.21.15.32:0/1292659432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4108a50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.714+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/1292659432 >> 172.21.15.32:0/1292659432 conn(0x7ff6a4100070 msgr2=0x7ff6a4102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.714+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/1292659432 shutdown_connections 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.714+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/1292659432 wait complete. 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.714+0000 7ff6a9f4f700 1 Processor -- start 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.714+0000 7ff6a9f4f700 1 -- start start 2024-05-06T21:17:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a9f4f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a9f4f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4199db0 con 0x7ff6a4106670 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35176/0 (socket says 172.21.15.32:35176) 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a37fe700 1 -- 172.21.15.32:0/91659953 learned_addr learned my addr 172.21.15.32:0/91659953 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a37fe700 1 -- 172.21.15.32:0/91659953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009550 con 0x7ff6a4106670 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a37fe700 1 --2- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4199870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff694000c00 tx=0x7ff694011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a0ff9700 1 -- 172.21.15.32:0/91659953 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff694003a70 con 0x7ff6a4106670 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a0ff9700 1 -- 172.21.15.32:0/91659953 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff694003bd0 con 0x7ff6a4106670 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a0ff9700 1 -- 172.21.15.32:0/91659953 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6940238c0 con 0x7ff6a4106670 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a4199fb0 con 0x7ff6a4106670 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.715+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a419a3d0 con 0x7ff6a4106670 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.716+0000 7ff6a0ff9700 1 -- 172.21.15.32:0/91659953 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ff694023b30 con 0x7ff6a4106670 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.716+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a4109bf0 con 0x7ff6a4106670 2024-05-06T21:17:53.503 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.717+0000 7ff6a0ff9700 1 --2- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7ff68c038530 0x7ff68c03a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.717+0000 7ff6a0ff9700 1 -- 172.21.15.32:0/91659953 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff69404c490 con 0x7ff6a4106670 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.717+0000 7ff6a2ffd700 1 --2- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7ff68c038530 0x7ff68c03a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.717+0000 7ff6a2ffd700 1 --2- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7ff68c038530 0x7ff68c03a9e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff698006fd0 tx=0x7ff698006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.721+0000 7ff6a0ff9700 1 -- 172.21.15.32:0/91659953 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff694010970 con 0x7ff6a4106670 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.922+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff6a4109de0 con 0x7ff6a4106670 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.922+0000 7ff6a0ff9700 1 -- 172.21.15.32:0/91659953 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff69402c350 con 0x7ff6a4106670 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.924+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7ff68c038530 msgr2=0x7ff68c03a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.924+0000 7ff6a9f4f700 1 --2- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7ff68c038530 0x7ff68c03a9e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff698006fd0 tx=0x7ff698006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.924+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 msgr2=0x7ff6a4199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.924+0000 7ff6a9f4f700 1 --2- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4199870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff694000c00 tx=0x7ff694011b50 comp rx=0 tx=0).stop 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.924+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 shutdown_connections 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.924+0000 7ff6a9f4f700 1 --2- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7ff68c038530 0x7ff68c03a9e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.924+0000 7ff6a9f4f700 1 --2- 172.21.15.32:0/91659953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6a4106670 0x7ff6a4199870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:53.504 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.924+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 >> 172.21.15.32:0/91659953 conn(0x7ff6a4100070 msgr2=0x7ff6a4101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:53.505 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.924+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 shutdown_connections 2024-05-06T21:17:53.505 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:52.925+0000 7ff6a9f4f700 1 -- 172.21.15.32:0/91659953 wait complete. 2024-05-06T21:17:54.849 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.935+0000 7f11e49dd700 1 Processor -- start 2024-05-06T21:17:54.849 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.935+0000 7f11e49dd700 1 -- start start 2024-05-06T21:17:54.849 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.935+0000 7f11e49dd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e0105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:54.849 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.935+0000 7f11e49dd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0106460 con 0x7f11e0105b10 2024-05-06T21:17:54.849 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.936+0000 7f11de59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e0105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:54.849 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.936+0000 7f11de59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e0105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35184/0 (socket says 172.21.15.32:35184) 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.936+0000 7f11de59c700 1 -- 172.21.15.32:0/2244497308 learned_addr learned my addr 172.21.15.32:0/2244497308 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.936+0000 7f11de59c700 1 -- 172.21.15.32:0/2244497308 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e01065a0 con 0x7f11e0105b10 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.936+0000 7f11de59c700 1 --2- 172.21.15.32:0/2244497308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e0105f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009e80 tx=0x7f11d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5e2c55e3e9319c server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.936+0000 7f11ddd9b700 1 -- 172.21.15.32:0/2244497308 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11d000e070 con 0x7f11e0105b10 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.936+0000 7f11ddd9b700 1 -- 172.21.15.32:0/2244497308 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f11d000b8c0 con 0x7f11e0105b10 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.936+0000 7f11ddd9b700 1 -- 172.21.15.32:0/2244497308 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11d00044d0 con 0x7f11e0105b10 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.937+0000 7f11e49dd700 1 -- 172.21.15.32:0/2244497308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 msgr2=0x7f11e0105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.937+0000 7f11e49dd700 1 --2- 172.21.15.32:0/2244497308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e0105f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009e80 tx=0x7f11d000b330 comp rx=0 tx=0).stop 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.937+0000 7f11e49dd700 1 -- 172.21.15.32:0/2244497308 shutdown_connections 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.937+0000 7f11e49dd700 1 --2- 172.21.15.32:0/2244497308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e0105f20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.937+0000 7f11e49dd700 1 -- 172.21.15.32:0/2244497308 >> 172.21.15.32:0/2244497308 conn(0x7f11e0101180 msgr2=0x7f11e0103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.937+0000 7f11e49dd700 1 -- 172.21.15.32:0/2244497308 shutdown_connections 2024-05-06T21:17:54.850 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.937+0000 7f11e49dd700 1 -- 172.21.15.32:0/2244497308 wait complete. 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.938+0000 7f11e49dd700 1 Processor -- start 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.938+0000 7f11e49dd700 1 -- start start 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.938+0000 7f11e49dd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e007bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.938+0000 7f11e49dd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e007c180 con 0x7f11e0105b10 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.938+0000 7f11de59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e007bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.938+0000 7f11de59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e007bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35192/0 (socket says 172.21.15.32:35192) 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.938+0000 7f11de59c700 1 -- 172.21.15.32:0/2814081401 learned_addr learned my addr 172.21.15.32:0/2814081401 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.938+0000 7f11de59c700 1 -- 172.21.15.32:0/2814081401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0009b30 con 0x7f11e0105b10 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.938+0000 7f11de59c700 1 --2- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e007bc40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11d00072a0 tx=0x7f11d00049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.939+0000 7f11d7fff700 1 -- 172.21.15.32:0/2814081401 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11d000e040 con 0x7f11e0105b10 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.939+0000 7f11d7fff700 1 -- 172.21.15.32:0/2814081401 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f11d000bd80 con 0x7f11e0105b10 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.939+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e007a290 con 0x7f11e0105b10 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.939+0000 7f11d7fff700 1 -- 172.21.15.32:0/2814081401 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11d00126c0 con 0x7f11e0105b10 2024-05-06T21:17:54.851 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.939+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e007a710 con 0x7f11e0105b10 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.940+0000 7f11d7fff700 1 -- 172.21.15.32:0/2814081401 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f11d0019040 con 0x7f11e0105b10 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.940+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e0062380 con 0x7f11e0105b10 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.940+0000 7f11d7fff700 1 --2- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11cc0384a0 0x7f11cc03a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.940+0000 7f11d7fff700 1 -- 172.21.15.32:0/2814081401 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f11d004bfe0 con 0x7f11e0105b10 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.940+0000 7f11d5d9b700 1 --2- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11cc0384a0 0x7f11cc03a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.940+0000 7f11d5d9b700 1 --2- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11cc0384a0 0x7f11cc03a950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11c8006fd0 tx=0x7f11c8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:53.945+0000 7f11d7fff700 1 -- 172.21.15.32:0/2814081401 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f11d001a9e0 con 0x7f11e0105b10 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.258+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f11e007afc0 con 0x7f11e0105b10 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.260+0000 7f11d7fff700 1 -- 172.21.15.32:0/2814081401 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f11d001f070 con 0x7f11e0105b10 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11cc0384a0 msgr2=0x7f11cc03a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 --2- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11cc0384a0 0x7f11cc03a950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11c8006fd0 tx=0x7f11c8006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:54.852 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 msgr2=0x7f11e007bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 --2- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e007bc40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11d00072a0 tx=0x7f11d00049f0 comp rx=0 tx=0).stop 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 shutdown_connections 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 --2- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11cc0384a0 0x7f11cc03a950 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 --2- 172.21.15.32:0/2814081401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e0105b10 0x7f11e007bc40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 >> 172.21.15.32:0/2814081401 conn(0x7f11e0101180 msgr2=0x7f11e0101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 shutdown_connections 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr 2024-05-06T21:17:54.262+0000 7f11e49dd700 1 -- 172.21.15.32:0/2814081401 wait complete. 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout:Or, if you are only running a single cluster on this host: 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:54.853 INFO:teuthology.orchestra.run.smithi032.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout: ceph telemetry on 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout:For more information see: 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:17:54.854 INFO:teuthology.orchestra.run.smithi032.stdout:Bootstrap complete. 2024-05-06T21:17:54.880 INFO:tasks.cephadm:Fetching config... 2024-05-06T21:17:54.880 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:17:54.880 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-06T21:17:54.897 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-06T21:17:54.897 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:17:54.897 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-06T21:17:54.955 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-06T21:17:54.955 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:17:54.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/keyring of=/dev/stdout 2024-05-06T21:17:55.022 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-06T21:17:55.023 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:17:55.023 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-06T21:17:55.079 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-06T21:17:55.079 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+B3R6A7gLEx2tZTi+T6+L/NY2LZ7621BPWzLnqMUD1x3YFGaro+n2lAAlS2D1biusPxbZwx/H0SWEMdL5sVi99pGYk+Yk770y5lHA/9kfBaS2PyzrHaecKdn5EZJzIp+B90DGprMIpUNOxuX2UKbjrQofPC9ihryMIMAz3fQDTvM1xCnRzZBC6c63HlnTj/puSeFN8C4W/rLpzL+Cu+SqiOEZRS3cOVLzGERfRkayYoMxcVicd6/UwNfVZeiaFZ9+5GGzpPg5K96bHhefDyZqMrrKk5qM2CqDCAHuiJ6i5C1U0Xy2EWwAkKb82KYbYzOljsmFLCGLT37R4ylKAYp1sX/ty03XTTYULI8+j2bHuN1laIkcbLO3BOdYQZAn8VsGHpmtH6jCzwmQ61fAZIEAHPx1SQoRdItzucHO1wHq6RI5jsbQZKB/dMmb147W82J0n+RNoX2oyOMYAdknK0HIpmnUBLrp6v/yH0lkbTAtVV2nu2GpxbjFufUzv/zsDak= ceph-d155ff30-0bed-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-06T21:17:55.155 INFO:teuthology.orchestra.run.smithi032.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+B3R6A7gLEx2tZTi+T6+L/NY2LZ7621BPWzLnqMUD1x3YFGaro+n2lAAlS2D1biusPxbZwx/H0SWEMdL5sVi99pGYk+Yk770y5lHA/9kfBaS2PyzrHaecKdn5EZJzIp+B90DGprMIpUNOxuX2UKbjrQofPC9ihryMIMAz3fQDTvM1xCnRzZBC6c63HlnTj/puSeFN8C4W/rLpzL+Cu+SqiOEZRS3cOVLzGERfRkayYoMxcVicd6/UwNfVZeiaFZ9+5GGzpPg5K96bHhefDyZqMrrKk5qM2CqDCAHuiJ6i5C1U0Xy2EWwAkKb82KYbYzOljsmFLCGLT37R4ylKAYp1sX/ty03XTTYULI8+j2bHuN1laIkcbLO3BOdYQZAn8VsGHpmtH6jCzwmQ61fAZIEAHPx1SQoRdItzucHO1wHq6RI5jsbQZKB/dMmb147W82J0n+RNoX2oyOMYAdknK0HIpmnUBLrp6v/yH0lkbTAtVV2nu2GpxbjFufUzv/zsDak= ceph-d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:17:55.167 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+B3R6A7gLEx2tZTi+T6+L/NY2LZ7621BPWzLnqMUD1x3YFGaro+n2lAAlS2D1biusPxbZwx/H0SWEMdL5sVi99pGYk+Yk770y5lHA/9kfBaS2PyzrHaecKdn5EZJzIp+B90DGprMIpUNOxuX2UKbjrQofPC9ihryMIMAz3fQDTvM1xCnRzZBC6c63HlnTj/puSeFN8C4W/rLpzL+Cu+SqiOEZRS3cOVLzGERfRkayYoMxcVicd6/UwNfVZeiaFZ9+5GGzpPg5K96bHhefDyZqMrrKk5qM2CqDCAHuiJ6i5C1U0Xy2EWwAkKb82KYbYzOljsmFLCGLT37R4ylKAYp1sX/ty03XTTYULI8+j2bHuN1laIkcbLO3BOdYQZAn8VsGHpmtH6jCzwmQ61fAZIEAHPx1SQoRdItzucHO1wHq6RI5jsbQZKB/dMmb147W82J0n+RNoX2oyOMYAdknK0HIpmnUBLrp6v/yH0lkbTAtVV2nu2GpxbjFufUzv/zsDak= ceph-d155ff30-0bed-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-06T21:17:55.208 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+B3R6A7gLEx2tZTi+T6+L/NY2LZ7621BPWzLnqMUD1x3YFGaro+n2lAAlS2D1biusPxbZwx/H0SWEMdL5sVi99pGYk+Yk770y5lHA/9kfBaS2PyzrHaecKdn5EZJzIp+B90DGprMIpUNOxuX2UKbjrQofPC9ihryMIMAz3fQDTvM1xCnRzZBC6c63HlnTj/puSeFN8C4W/rLpzL+Cu+SqiOEZRS3cOVLzGERfRkayYoMxcVicd6/UwNfVZeiaFZ9+5GGzpPg5K96bHhefDyZqMrrKk5qM2CqDCAHuiJ6i5C1U0Xy2EWwAkKb82KYbYzOljsmFLCGLT37R4ylKAYp1sX/ty03XTTYULI8+j2bHuN1laIkcbLO3BOdYQZAn8VsGHpmtH6jCzwmQ61fAZIEAHPx1SQoRdItzucHO1wHq6RI5jsbQZKB/dMmb147W82J0n+RNoX2oyOMYAdknK0HIpmnUBLrp6v/yH0lkbTAtVV2nu2GpxbjFufUzv/zsDak= ceph-d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:17:55.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-06T21:17:55.440 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:17:55.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:55 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2814081401' entity='client.admin' 2024-05-06T21:17:57.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.587+0000 7f15f289f700 1 -- 172.21.15.32:0/1969266463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 msgr2=0x7f15ec0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:57.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.587+0000 7f15f289f700 1 --2- 172.21.15.32:0/1969266463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 0x7f15ec0ff130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009910 tx=0x7f15dc009c20 comp rx=0 tx=0).stop 2024-05-06T21:17:57.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.587+0000 7f15f289f700 1 -- 172.21.15.32:0/1969266463 shutdown_connections 2024-05-06T21:17:57.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.587+0000 7f15f289f700 1 --2- 172.21.15.32:0/1969266463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 0x7f15ec0ff130 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:57.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.587+0000 7f15f289f700 1 -- 172.21.15.32:0/1969266463 >> 172.21.15.32:0/1969266463 conn(0x7f15ec0fa2b0 msgr2=0x7f15ec0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:57.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.587+0000 7f15f289f700 1 -- 172.21.15.32:0/1969266463 shutdown_connections 2024-05-06T21:17:57.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.587+0000 7f15f289f700 1 -- 172.21.15.32:0/1969266463 wait complete. 2024-05-06T21:17:57.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.588+0000 7f15f289f700 1 Processor -- start 2024-05-06T21:17:57.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.588+0000 7f15f289f700 1 -- start start 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.588+0000 7f15f289f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 0x7f15ec0fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.588+0000 7f15f289f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0fc7a0 con 0x7f15ec0fed20 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.588+0000 7f15ebfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 0x7f15ec0fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.588+0000 7f15ebfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 0x7f15ec0fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35202/0 (socket says 172.21.15.32:35202) 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.588+0000 7f15ebfff700 1 -- 172.21.15.32:0/1489550170 learned_addr learned my addr 172.21.15.32:0/1489550170 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.589+0000 7f15ebfff700 1 -- 172.21.15.32:0/1489550170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc0095f0 con 0x7f15ec0fed20 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.589+0000 7f15ebfff700 1 --2- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 0x7f15ec0fc260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f15dc005950 tx=0x7f15dc009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.589+0000 7f15e97fa700 1 -- 172.21.15.32:0/1489550170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15dc01d070 con 0x7f15ec0fed20 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.589+0000 7f15e97fa700 1 -- 172.21.15.32:0/1489550170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f15dc00be10 con 0x7f15ec0fed20 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.589+0000 7f15e97fa700 1 -- 172.21.15.32:0/1489550170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15dc00f460 con 0x7f15ec0fed20 2024-05-06T21:17:57.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.589+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec0fa8b0 con 0x7f15ec0fed20 2024-05-06T21:17:57.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.589+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec0fad50 con 0x7f15ec0fed20 2024-05-06T21:17:57.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.590+0000 7f15e97fa700 1 -- 172.21.15.32:0/1489550170 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f15dc0227c0 con 0x7f15ec0fed20 2024-05-06T21:17:57.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.590+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec062380 con 0x7f15ec0fed20 2024-05-06T21:17:57.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.590+0000 7f15e97fa700 1 --2- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15d80384e0 0x7f15d803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:17:57.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.590+0000 7f15e97fa700 1 -- 172.21.15.32:0/1489550170 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f15dc04c430 con 0x7f15ec0fed20 2024-05-06T21:17:57.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.590+0000 7f15eb7fe700 1 --2- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15d80384e0 0x7f15d803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:17:57.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.591+0000 7f15eb7fe700 1 --2- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15d80384e0 0x7f15d803a990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15d4006fd0 tx=0x7f15d4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:17:57.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.596+0000 7f15e97fa700 1 -- 172.21.15.32:0/1489550170 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f15dc02ba00 con 0x7f15ec0fed20 2024-05-06T21:17:57.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.798+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f15ec18e840 con 0x7f15ec0fed20 2024-05-06T21:17:57.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.801+0000 7f15e97fa700 1 -- 172.21.15.32:0/1489550170 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f15dc027030 con 0x7f15ec0fed20 2024-05-06T21:17:57.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.803+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15d80384e0 msgr2=0x7f15d803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.803+0000 7f15f289f700 1 --2- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15d80384e0 0x7f15d803a990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15d4006fd0 tx=0x7f15d4006e40 comp rx=0 tx=0).stop 2024-05-06T21:17:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.803+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 msgr2=0x7f15ec0fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:17:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.803+0000 7f15f289f700 1 --2- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 0x7f15ec0fc260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f15dc005950 tx=0x7f15dc009e60 comp rx=0 tx=0).stop 2024-05-06T21:17:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.804+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 shutdown_connections 2024-05-06T21:17:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.804+0000 7f15f289f700 1 --2- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15d80384e0 0x7f15d803a990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.804+0000 7f15f289f700 1 --2- 172.21.15.32:0/1489550170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15ec0fed20 0x7f15ec0fc260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:17:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.804+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 >> 172.21.15.32:0/1489550170 conn(0x7f15ec0fa2b0 msgr2=0x7f15ec0687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:17:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.804+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 shutdown_connections 2024-05-06T21:17:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:17:57.804+0000 7f15f289f700 1 -- 172.21.15.32:0/1489550170 wait complete. 2024-05-06T21:17:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:57 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:57 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:57 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd/host:smithi032", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:17:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:57 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:17:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:57 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:17:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:57 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-05-06T21:17:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:57 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:17:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:57 smithi032 ceph-mon[27179]: Deploying daemon ceph-exporter.smithi032 on smithi032 2024-05-06T21:17:58.586 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-06T21:17:58.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-06T21:17:59.167 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:17:58 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1489550170' entity='client.admin' 2024-05-06T21:17:59.257 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:18:01.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.935+0000 7f612962e700 1 -- 172.21.15.32:0/4128882478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 msgr2=0x7f61240ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:01.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.935+0000 7f612962e700 1 --2- 172.21.15.32:0/4128882478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 0x7f61240ff140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6114009910 tx=0x7f6114009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:01.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.935+0000 7f612962e700 1 -- 172.21.15.32:0/4128882478 shutdown_connections 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.935+0000 7f612962e700 1 --2- 172.21.15.32:0/4128882478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 0x7f61240ff140 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.935+0000 7f612962e700 1 -- 172.21.15.32:0/4128882478 >> 172.21.15.32:0/4128882478 conn(0x7f61240fa2c0 msgr2=0x7f61240fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.935+0000 7f612962e700 1 -- 172.21.15.32:0/4128882478 shutdown_connections 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.935+0000 7f612962e700 1 -- 172.21.15.32:0/4128882478 wait complete. 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.936+0000 7f612962e700 1 Processor -- start 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.936+0000 7f612962e700 1 -- start start 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.936+0000 7f612962e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 0x7f61240693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.936+0000 7f612962e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6124197cc0 con 0x7f61240fed30 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.936+0000 7f6122ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 0x7f61240693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.937+0000 7f6122ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 0x7f61240693a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35042/0 (socket says 172.21.15.32:35042) 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.937+0000 7f6122ffd700 1 -- 172.21.15.32:0/1633241544 learned_addr learned my addr 172.21.15.32:0/1633241544 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.937+0000 7f6122ffd700 1 -- 172.21.15.32:0/1633241544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140095f0 con 0x7f61240fed30 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.937+0000 7f6122ffd700 1 --2- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 0x7f61240693a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6114005b40 tx=0x7f6114004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:01.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.937+0000 7f6120ff9700 1 -- 172.21.15.32:0/1633241544 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f611401d070 con 0x7f61240fed30 2024-05-06T21:18:01.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.937+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6124197e00 con 0x7f61240fed30 2024-05-06T21:18:01.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.937+0000 7f6120ff9700 1 -- 172.21.15.32:0/1633241544 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f611400be10 con 0x7f61240fed30 2024-05-06T21:18:01.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.937+0000 7f6120ff9700 1 -- 172.21.15.32:0/1633241544 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f611400f460 con 0x7f61240fed30 2024-05-06T21:18:01.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.937+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61241982a0 con 0x7f61240fed30 2024-05-06T21:18:01.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.938+0000 7f6120ff9700 1 -- 172.21.15.32:0/1633241544 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f611400f5c0 con 0x7f61240fed30 2024-05-06T21:18:01.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.938+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612418da10 con 0x7f61240fed30 2024-05-06T21:18:01.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.939+0000 7f6120ff9700 1 --2- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f61100384e0 0x7f611003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:01.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.939+0000 7f6120ff9700 1 -- 172.21.15.32:0/1633241544 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f611404c3c0 con 0x7f61240fed30 2024-05-06T21:18:01.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.939+0000 7f611a7fc700 1 --2- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f61100384e0 0x7f611003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:01.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.939+0000 7f611a7fc700 1 --2- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f61100384e0 0x7f611003a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f610c006fd0 tx=0x7f610c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:01.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:01.943+0000 7f6120ff9700 1 -- 172.21.15.32:0/1633241544 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f611402a360 con 0x7f61240fed30 2024-05-06T21:18:02.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.152+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 --> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f6124061220 con 0x7f61100384e0 2024-05-06T21:18:02.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.155+0000 7f6120ff9700 1 -- 172.21.15.32:0/1633241544 <== mgr.14164 v2:172.21.15.32:6800/2414450865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6124061220 con 0x7f61100384e0 2024-05-06T21:18:02.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.157+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f61100384e0 msgr2=0x7f611003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:02.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.157+0000 7f612962e700 1 --2- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f61100384e0 0x7f611003a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f610c006fd0 tx=0x7f610c006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:02.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.157+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 msgr2=0x7f61240693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:02.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.157+0000 7f612962e700 1 --2- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 0x7f61240693a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6114005b40 tx=0x7f6114004740 comp rx=0 tx=0).stop 2024-05-06T21:18:02.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.157+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 shutdown_connections 2024-05-06T21:18:02.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.157+0000 7f612962e700 1 --2- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f61100384e0 0x7f611003a990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:02.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.157+0000 7f612962e700 1 --2- 172.21.15.32:0/1633241544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61240fed30 0x7f61240693a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:02.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.157+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 >> 172.21.15.32:0/1633241544 conn(0x7f61240fa2c0 msgr2=0x7f61240faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:02.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.158+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 shutdown_connections 2024-05-06T21:18:02.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:02.158+0000 7f612962e700 1 -- 172.21.15.32:0/1633241544 wait complete. 2024-05-06T21:18:02.746 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-05-06T21:18:02.746 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:18:02.746 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-05-06T21:18:02.765 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:18:02.765 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:18:02.823 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-05-06T21:18:02.824 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch host add smithi154 2024-05-06T21:18:03.045 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:18:03.191 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:03 smithi032 ceph-mon[27179]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:18:03.192 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:03 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:03.192 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:03 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:03.192 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:03 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:03.192 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:03 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:03.192 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:03 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:03.192 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:03 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi032", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:18:03.192 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:03 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi032", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-06T21:18:03.192 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:03 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:18:04.393 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:04 smithi032 ceph-mon[27179]: Deploying daemon crash.smithi032 on smithi032 2024-05-06T21:18:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.729+0000 7f44fa152700 1 -- 172.21.15.32:0/372469921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 msgr2=0x7f44f40ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.729+0000 7f44fa152700 1 --2- 172.21.15.32:0/372469921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 0x7f44f40ff140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009910 tx=0x7f44e4009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.729+0000 7f44fa152700 1 -- 172.21.15.32:0/372469921 shutdown_connections 2024-05-06T21:18:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.729+0000 7f44fa152700 1 --2- 172.21.15.32:0/372469921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 0x7f44f40ff140 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.729+0000 7f44fa152700 1 -- 172.21.15.32:0/372469921 >> 172.21.15.32:0/372469921 conn(0x7f44f40fa2c0 msgr2=0x7f44f40fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.729+0000 7f44fa152700 1 -- 172.21.15.32:0/372469921 shutdown_connections 2024-05-06T21:18:04.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.730+0000 7f44fa152700 1 -- 172.21.15.32:0/372469921 wait complete. 2024-05-06T21:18:04.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.730+0000 7f44fa152700 1 Processor -- start 2024-05-06T21:18:04.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.730+0000 7f44fa152700 1 -- start start 2024-05-06T21:18:04.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.730+0000 7f44fa152700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 0x7f44f4069340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:04.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.730+0000 7f44fa152700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f4197d20 con 0x7f44f40fed30 2024-05-06T21:18:04.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.730+0000 7f44f37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 0x7f44f4069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:04.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.730+0000 7f44f37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 0x7f44f4069340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35078/0 (socket says 172.21.15.32:35078) 2024-05-06T21:18:04.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.730+0000 7f44f37fe700 1 -- 172.21.15.32:0/186163348 learned_addr learned my addr 172.21.15.32:0/186163348 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.731+0000 7f44f37fe700 1 -- 172.21.15.32:0/186163348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e40095f0 con 0x7f44f40fed30 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.731+0000 7f44f37fe700 1 --2- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 0x7f44f4069340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f44e4005950 tx=0x7f44e4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.731+0000 7f44f17fa700 1 -- 172.21.15.32:0/186163348 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44e401d070 con 0x7f44f40fed30 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.731+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f4197e60 con 0x7f44f40fed30 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.731+0000 7f44f17fa700 1 -- 172.21.15.32:0/186163348 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44e400be10 con 0x7f44f40fed30 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.731+0000 7f44f17fa700 1 -- 172.21.15.32:0/186163348 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44e400f460 con 0x7f44f40fed30 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.731+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f41982a0 con 0x7f44f40fed30 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.732+0000 7f44f17fa700 1 -- 172.21.15.32:0/186163348 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f44e400f690 con 0x7f44f40fed30 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.732+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f40623f0 con 0x7f44f40fed30 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.732+0000 7f44f17fa700 1 --2- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f44e0038490 0x7f44e003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:04.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.732+0000 7f44f17fa700 1 -- 172.21.15.32:0/186163348 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f44e404c610 con 0x7f44f40fed30 2024-05-06T21:18:04.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.732+0000 7f44ebfff700 1 --2- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f44e0038490 0x7f44e003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:04.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.733+0000 7f44ebfff700 1 --2- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f44e0038490 0x7f44e003a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f44dc006fd0 tx=0x7f44dc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:04.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.737+0000 7f44f17fa700 1 -- 172.21.15.32:0/186163348 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f44f40623f0 con 0x7f44f40fed30 2024-05-06T21:18:04.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:04.945+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 --> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}) v1 -- 0x7f44f40623f0 con 0x7f44e0038490 2024-05-06T21:18:06.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:06 smithi032 ceph-mon[27179]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:18:06.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:06 smithi032 ceph-mon[27179]: Deploying cephadm binary to smithi154 2024-05-06T21:18:06.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:06 smithi032 ceph-mon[27179]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:06.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:06 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:07.418 INFO:teuthology.orchestra.run.smithi032.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-05-06T21:18:07.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.414+0000 7f44f17fa700 1 -- 172.21.15.32:0/186163348 <== mgr.14164 v2:172.21.15.32:6800/2414450865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f44f40623f0 con 0x7f44e0038490 2024-05-06T21:18:07.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f44e0038490 msgr2=0x7f44e003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:07.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 --2- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f44e0038490 0x7f44e003a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f44dc006fd0 tx=0x7f44dc006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:07.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 msgr2=0x7f44f4069340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:07.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 --2- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 0x7f44f4069340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f44e4005950 tx=0x7f44e4009e60 comp rx=0 tx=0).stop 2024-05-06T21:18:07.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 shutdown_connections 2024-05-06T21:18:07.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 --2- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f44e0038490 0x7f44e003a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:07.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 --2- 172.21.15.32:0/186163348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44f40fed30 0x7f44f4069340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:07.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 >> 172.21.15.32:0/186163348 conn(0x7f44f40fa2c0 msgr2=0x7f44f40faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:07.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 shutdown_connections 2024-05-06T21:18:07.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:07.417+0000 7f44fa152700 1 -- 172.21.15.32:0/186163348 wait complete. 2024-05-06T21:18:08.052 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-06T21:18:08.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:07 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:08.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:07 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:08.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:07 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:08.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:07 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:08.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:07 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:08.278 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:18:08.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:08 smithi032 ceph-mon[27179]: Deploying daemon node-exporter.smithi032 on smithi032 2024-05-06T21:18:08.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:08 smithi032 ceph-mon[27179]: Added host smithi154 2024-05-06T21:18:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:08 smithi032 ceph-mon[27179]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:10.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.473+0000 7f11beb44700 1 -- 172.21.15.32:0/1391361959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 msgr2=0x7f11b8100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:10.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.473+0000 7f11beb44700 1 --2- 172.21.15.32:0/1391361959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 0x7f11b8100230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009910 tx=0x7f11b4009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:10.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.473+0000 7f11beb44700 1 -- 172.21.15.32:0/1391361959 shutdown_connections 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.473+0000 7f11beb44700 1 --2- 172.21.15.32:0/1391361959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 0x7f11b8100230 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.473+0000 7f11beb44700 1 -- 172.21.15.32:0/1391361959 >> 172.21.15.32:0/1391361959 conn(0x7f11b80fb3d0 msgr2=0x7f11b80fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.473+0000 7f11beb44700 1 -- 172.21.15.32:0/1391361959 shutdown_connections 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.473+0000 7f11beb44700 1 -- 172.21.15.32:0/1391361959 wait complete. 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11beb44700 1 Processor -- start 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11beb44700 1 -- start start 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11beb44700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 0x7f11b8197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11beb44700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b81976b0 con 0x7f11b80ffe20 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11bc8e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 0x7f11b8197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11bc8e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 0x7f11b8197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35108/0 (socket says 172.21.15.32:35108) 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11bc8e0700 1 -- 172.21.15.32:0/3740128614 learned_addr learned my addr 172.21.15.32:0/3740128614 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11bc8e0700 1 -- 172.21.15.32:0/3740128614 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b40095f0 con 0x7f11b80ffe20 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11bc8e0700 1 --2- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 0x7f11b8197170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11b4005b40 tx=0x7f11b4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.474+0000 7f11adffb700 1 -- 172.21.15.32:0/3740128614 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11b401d070 con 0x7f11b80ffe20 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.475+0000 7f11adffb700 1 -- 172.21.15.32:0/3740128614 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f11b400be10 con 0x7f11b80ffe20 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.475+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b81978b0 con 0x7f11b80ffe20 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.475+0000 7f11adffb700 1 -- 172.21.15.32:0/3740128614 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11b400f460 con 0x7f11b80ffe20 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.475+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b8197d50 con 0x7f11b80ffe20 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.476+0000 7f11adffb700 1 -- 172.21.15.32:0/3740128614 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f11b400f5c0 con 0x7f11b80ffe20 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.476+0000 7f11adffb700 1 --2- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11a00384e0 0x7f11a003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.476+0000 7f11adffb700 1 -- 172.21.15.32:0/3740128614 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f11b404c210 con 0x7f11b80ffe20 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.476+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b8190e80 con 0x7f11b80ffe20 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.476+0000 7f11affff700 1 --2- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11a00384e0 0x7f11a003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.476+0000 7f11affff700 1 --2- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11a00384e0 0x7f11a003a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f11a8006fd0 tx=0x7f11a8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.481+0000 7f11adffb700 1 -- 172.21.15.32:0/3740128614 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f11b4027030 con 0x7f11b80ffe20 2024-05-06T21:18:10.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.725+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 --> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11b8062380 con 0x7f11a00384e0 2024-05-06T21:18:10.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.726+0000 7f11adffb700 1 -- 172.21.15.32:0/3740128614 <== mgr.14164 v2:172.21.15.32:6800/2414450865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f11b8062380 con 0x7f11a00384e0 2024-05-06T21:18:10.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:18:10.729 INFO:teuthology.orchestra.run.smithi032.stdout:[{"addr": "172.21.15.32", "hostname": "smithi032", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11a00384e0 msgr2=0x7f11a003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 --2- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11a00384e0 0x7f11a003a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f11a8006fd0 tx=0x7f11a8006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 msgr2=0x7f11b8197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 --2- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 0x7f11b8197170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11b4005b40 tx=0x7f11b4004740 comp rx=0 tx=0).stop 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 shutdown_connections 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 --2- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f11a00384e0 0x7f11a003a990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 --2- 172.21.15.32:0/3740128614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b80ffe20 0x7f11b8197170 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 >> 172.21.15.32:0/3740128614 conn(0x7f11b80fb3d0 msgr2=0x7f11b80fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 shutdown_connections 2024-05-06T21:18:10.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:10.728+0000 7f11beb44700 1 -- 172.21.15.32:0/3740128614 wait complete. 2024-05-06T21:18:11.001 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:10 smithi032 ceph-mon[27179]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:11.001 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:10 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:11.795 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-06T21:18:11.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-06T21:18:11.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:11 smithi032 ceph-mon[27179]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T21:18:12.236 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:18:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:12 smithi032 ceph-mon[27179]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:12 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:12 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:12 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:12 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.876+0000 7f9d908a2700 1 -- 172.21.15.32:0/513248035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 msgr2=0x7f9d8c100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.876+0000 7f9d908a2700 1 --2- 172.21.15.32:0/513248035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 0x7f9d8c100240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00b0a0 tx=0x7f9d7c00b3b0 comp rx=0 tx=0).stop 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.876+0000 7f9d908a2700 1 -- 172.21.15.32:0/513248035 shutdown_connections 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.876+0000 7f9d908a2700 1 --2- 172.21.15.32:0/513248035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 0x7f9d8c100240 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.876+0000 7f9d908a2700 1 -- 172.21.15.32:0/513248035 >> 172.21.15.32:0/513248035 conn(0x7f9d8c0fb3c0 msgr2=0x7f9d8c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.876+0000 7f9d908a2700 1 -- 172.21.15.32:0/513248035 shutdown_connections 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.876+0000 7f9d908a2700 1 -- 172.21.15.32:0/513248035 wait complete. 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.877+0000 7f9d908a2700 1 Processor -- start 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.877+0000 7f9d908a2700 1 -- start start 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.877+0000 7f9d908a2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 0x7f9d8c194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:13.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.877+0000 7f9d908a2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1954c0 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.877+0000 7f9d8a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 0x7f9d8c194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.877+0000 7f9d8a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 0x7f9d8c194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51172/0 (socket says 172.21.15.32:51172) 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.877+0000 7f9d8a59c700 1 -- 172.21.15.32:0/1160680869 learned_addr learned my addr 172.21.15.32:0/1160680869 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.877+0000 7f9d8a59c700 1 -- 172.21.15.32:0/1160680869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c009d00 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.877+0000 7f9d8a59c700 1 --2- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 0x7f9d8c194f80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c015040 tx=0x7f9d7c00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.878+0000 7f9d837fe700 1 -- 172.21.15.32:0/1160680869 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d7c00e040 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.878+0000 7f9d837fe700 1 -- 172.21.15.32:0/1160680869 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d7c01d930 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.878+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c1956c0 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.878+0000 7f9d837fe700 1 -- 172.21.15.32:0/1160680869 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d7c0129d0 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.878+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c195ae0 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.879+0000 7f9d837fe700 1 -- 172.21.15.32:0/1160680869 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f9d7c012c90 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.879+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c18ea90 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.879+0000 7f9d837fe700 1 --2- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9d78038490 0x7f9d7803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.879+0000 7f9d837fe700 1 -- 172.21.15.32:0/1160680869 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9d7c04c720 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.879+0000 7f9d89d9b700 1 --2- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9d78038490 0x7f9d7803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:13.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.879+0000 7f9d89d9b700 1 --2- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9d78038490 0x7f9d7803a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d74006fd0 tx=0x7f9d74006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:13.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:13.884+0000 7f9d837fe700 1 -- 172.21.15.32:0/1160680869 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9d7c027a20 con 0x7f9d8c0ffe30 2024-05-06T21:18:13.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:13 smithi032 ceph-mon[27179]: Deploying daemon alertmanager.smithi032 on smithi032 2024-05-06T21:18:14.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.094+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9d8c062380 con 0x7f9d8c0ffe30 2024-05-06T21:18:14.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.837+0000 7f9d837fe700 1 -- 172.21.15.32:0/1160680869 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9d7c01aba0 con 0x7f9d8c0ffe30 2024-05-06T21:18:14.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9d78038490 msgr2=0x7f9d7803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 --2- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9d78038490 0x7f9d7803a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d74006fd0 tx=0x7f9d74006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 msgr2=0x7f9d8c194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 --2- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 0x7f9d8c194f80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c015040 tx=0x7f9d7c00bb10 comp rx=0 tx=0).stop 2024-05-06T21:18:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 shutdown_connections 2024-05-06T21:18:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 --2- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9d78038490 0x7f9d7803a940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 --2- 172.21.15.32:0/1160680869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d8c0ffe30 0x7f9d8c194f80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 >> 172.21.15.32:0/1160680869 conn(0x7f9d8c0fb3c0 msgr2=0x7f9d8c0fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 shutdown_connections 2024-05-06T21:18:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:18:14.840+0000 7f9d908a2700 1 -- 172.21.15.32:0/1160680869 wait complete. 2024-05-06T21:18:14.844 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2024-05-06T21:18:15.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:14 smithi032 ceph-mon[27179]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:15.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:14 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1160680869' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-06T21:18:15.806 INFO:tasks.cephadm:Adding mon.smithi032 on smithi032 2024-05-06T21:18:15.806 INFO:tasks.cephadm:Adding mon.smithi154 on smithi154 2024-05-06T21:18:15.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch apply mon '2;smithi032:172.21.15.32=smithi032;smithi154:172.21.15.154=smithi154' 2024-05-06T21:18:16.021 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:16.081 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:16.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:15 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1160680869' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-06T21:18:16.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:15 smithi032 ceph-mon[27179]: osdmap e4: 0 total, 0 up, 0 in 2024-05-06T21:18:16.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:15 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:17.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:16 smithi032 ceph-mon[27179]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.704+0000 7f919f82a700 1 -- 172.21.15.154:0/3136580798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 msgr2=0x7f9198102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.704+0000 7f919f82a700 1 --2- 172.21.15.154:0/3136580798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 0x7f9198102d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9194009910 tx=0x7f9194009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.704+0000 7f919f82a700 1 -- 172.21.15.154:0/3136580798 shutdown_connections 2024-05-06T21:18:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.704+0000 7f919f82a700 1 --2- 172.21.15.154:0/3136580798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 0x7f9198102d20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.704+0000 7f919f82a700 1 -- 172.21.15.154:0/3136580798 >> 172.21.15.154:0/3136580798 conn(0x7f91980fa380 msgr2=0x7f91980fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.704+0000 7f919f82a700 1 -- 172.21.15.154:0/3136580798 shutdown_connections 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.704+0000 7f919f82a700 1 -- 172.21.15.154:0/3136580798 wait complete. 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.705+0000 7f919f82a700 1 Processor -- start 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.705+0000 7f919f82a700 1 -- start start 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.705+0000 7f919f82a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 0x7f91981002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.705+0000 7f919f82a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91981007e0 con 0x7f9198100940 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.705+0000 7f919d5c6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 0x7f91981002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.705+0000 7f919d5c6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 0x7f91981002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:39954/0 (socket says 172.21.15.154:39954) 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.705+0000 7f919d5c6700 1 -- 172.21.15.154:0/3094788384 learned_addr learned my addr 172.21.15.154:0/3094788384 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.706+0000 7f919d5c6700 1 -- 172.21.15.154:0/3094788384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940095f0 con 0x7f9198100940 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.706+0000 7f919d5c6700 1 --2- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 0x7f91981002a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9194005950 tx=0x7f9194009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.706+0000 7f918e7fc700 1 -- 172.21.15.154:0/3094788384 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f919401d070 con 0x7f9198100940 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.706+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91980fe8f0 con 0x7f9198100940 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.706+0000 7f918e7fc700 1 -- 172.21.15.154:0/3094788384 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f919400be10 con 0x7f9198100940 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.706+0000 7f918e7fc700 1 -- 172.21.15.154:0/3094788384 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f919400f460 con 0x7f9198100940 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.706+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91980fed90 con 0x7f9198100940 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.707+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9198062380 con 0x7f9198100940 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.707+0000 7f918e7fc700 1 -- 172.21.15.154:0/3094788384 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f91940227c0 con 0x7f9198100940 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.707+0000 7f918e7fc700 1 --2- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9184038490 0x7f918403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.707+0000 7f918e7fc700 1 -- 172.21.15.154:0/3094788384 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f919404c430 con 0x7f9198100940 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.708+0000 7f919cdc5700 1 --2- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9184038490 0x7f918403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.708+0000 7f919cdc5700 1 --2- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9184038490 0x7f918403a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9188006fd0 tx=0x7f9188006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.713+0000 7f918e7fc700 1 -- 172.21.15.154:0/3094788384 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f919402bba0 con 0x7f9198100940 2024-05-06T21:18:17.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.913+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 --> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi032:172.21.15.32=smithi032;smithi154:172.21.15.154=smithi154", "target": ["mon-mgr", ""]}) v1 -- 0x7f91980ff200 con 0x7f9184038490 2024-05-06T21:18:17.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.920+0000 7f918e7fc700 1 -- 172.21.15.154:0/3094788384 <== mgr.14164 v2:172.21.15.32:6800/2414450865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f91980ff200 con 0x7f9184038490 2024-05-06T21:18:17.923 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mon update... 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9184038490 msgr2=0x7f918403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 --2- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9184038490 0x7f918403a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9188006fd0 tx=0x7f9188006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 msgr2=0x7f91981002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 --2- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 0x7f91981002a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9194005950 tx=0x7f9194009e60 comp rx=0 tx=0).stop 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 shutdown_connections 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 --2- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9184038490 0x7f918403a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 --2- 172.21.15.154:0/3094788384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9198100940 0x7f91981002a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 >> 172.21.15.154:0/3094788384 conn(0x7f91980fa380 msgr2=0x7f91980fafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 shutdown_connections 2024-05-06T21:18:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:17.921+0000 7f919f82a700 1 -- 172.21.15.154:0/3094788384 wait complete. 2024-05-06T21:18:18.486 DEBUG:teuthology.orchestra.run.smithi154:mon.smithi154> sudo journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi154.service 2024-05-06T21:18:18.489 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:18.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:18.719 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:18.769 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:18.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:18 smithi032 ceph-mon[27179]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:18.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:18 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:20.130 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:19 smithi032 ceph-mon[27179]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi032:172.21.15.32=smithi032;smithi154:172.21.15.154=smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:18:20.130 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:19 smithi032 ceph-mon[27179]: Saving service mon spec with placement smithi032:172.21.15.32=smithi032;smithi154:172.21.15.154=smithi154;count:2 2024-05-06T21:18:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.182+0000 7fc8fe743700 1 -- 172.21.15.154:0/2405962117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 msgr2=0x7fc8f80ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.182+0000 7fc8fe743700 1 --2- 172.21.15.154:0/2405962117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 0x7fc8f80ff130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009910 tx=0x7fc8e0009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.183+0000 7fc8fe743700 1 -- 172.21.15.154:0/2405962117 shutdown_connections 2024-05-06T21:18:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.183+0000 7fc8fe743700 1 --2- 172.21.15.154:0/2405962117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 0x7fc8f80ff130 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.183+0000 7fc8fe743700 1 -- 172.21.15.154:0/2405962117 >> 172.21.15.154:0/2405962117 conn(0x7fc8f80fa2b0 msgr2=0x7fc8f80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.183+0000 7fc8fe743700 1 -- 172.21.15.154:0/2405962117 shutdown_connections 2024-05-06T21:18:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.183+0000 7fc8fe743700 1 -- 172.21.15.154:0/2405962117 wait complete. 2024-05-06T21:18:20.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.183+0000 7fc8fe743700 1 Processor -- start 2024-05-06T21:18:20.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.183+0000 7fc8fe743700 1 -- start start 2024-05-06T21:18:20.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.183+0000 7fc8fe743700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 0x7fc8f8194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:20.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.183+0000 7fc8fe743700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8195500 con 0x7fc8f80fed20 2024-05-06T21:18:20.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.184+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 0x7fc8f8194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:20.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.184+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 0x7fc8f8194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:52590/0 (socket says 172.21.15.154:52590) 2024-05-06T21:18:20.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.184+0000 7fc8f7fff700 1 -- 172.21.15.154:0/56596334 learned_addr learned my addr 172.21.15.154:0/56596334 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:20.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.184+0000 7fc8f7fff700 1 -- 172.21.15.154:0/56596334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00095f0 con 0x7fc8f80fed20 2024-05-06T21:18:20.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.184+0000 7fc8f7fff700 1 --2- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 0x7fc8f8194fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0005b40 tx=0x7fc8e0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:20.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.185+0000 7fc8f57fa700 1 -- 172.21.15.154:0/56596334 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8e001d070 con 0x7fc8f80fed20 2024-05-06T21:18:20.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.185+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f8195700 con 0x7fc8f80fed20 2024-05-06T21:18:20.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.185+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f8195ba0 con 0x7fc8f80fed20 2024-05-06T21:18:20.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.185+0000 7fc8f57fa700 1 -- 172.21.15.154:0/56596334 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8e000be10 con 0x7fc8f80fed20 2024-05-06T21:18:20.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.185+0000 7fc8f57fa700 1 -- 172.21.15.154:0/56596334 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8e000f460 con 0x7fc8f80fed20 2024-05-06T21:18:20.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.186+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f818ea10 con 0x7fc8f80fed20 2024-05-06T21:18:20.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.186+0000 7fc8f57fa700 1 -- 172.21.15.154:0/56596334 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fc8e00227c0 con 0x7fc8f80fed20 2024-05-06T21:18:20.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.186+0000 7fc8f57fa700 1 --2- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fc8e4038490 0x7fc8e403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:20.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.186+0000 7fc8f57fa700 1 -- 172.21.15.154:0/56596334 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc8e004c330 con 0x7fc8f80fed20 2024-05-06T21:18:20.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.186+0000 7fc8f77fe700 1 --2- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fc8e4038490 0x7fc8e403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:20.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.187+0000 7fc8f77fe700 1 --2- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fc8e4038490 0x7fc8e403a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8006fd0 tx=0x7fc8e8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:20.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.191+0000 7fc8f57fa700 1 -- 172.21.15.154:0/56596334 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc8e000b960 con 0x7fc8f80fed20 2024-05-06T21:18:20.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.462+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc8f802cc30 con 0x7fc8f80fed20 2024-05-06T21:18:20.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.462+0000 7fc8f57fa700 1 -- 172.21.15.154:0/56596334 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc8e0027030 con 0x7fc8f80fed20 2024-05-06T21:18:20.465 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:20.465 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:20.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.464+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fc8e4038490 msgr2=0x7fc8e403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:20.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.464+0000 7fc8fe743700 1 --2- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fc8e4038490 0x7fc8e403a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8006fd0 tx=0x7fc8e8006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:20.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.464+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 msgr2=0x7fc8f8194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:20.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.464+0000 7fc8fe743700 1 --2- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 0x7fc8f8194fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0005b40 tx=0x7fc8e0004740 comp rx=0 tx=0).stop 2024-05-06T21:18:20.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.465+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 shutdown_connections 2024-05-06T21:18:20.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.465+0000 7fc8fe743700 1 --2- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fc8e4038490 0x7fc8e403a940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:20.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.465+0000 7fc8fe743700 1 --2- 172.21.15.154:0/56596334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f80fed20 0x7fc8f8194fc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:20.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.465+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 >> 172.21.15.154:0/56596334 conn(0x7fc8f80fa2b0 msgr2=0x7fc8f80687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:20.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.465+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 shutdown_connections 2024-05-06T21:18:20.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:20.465+0000 7fc8fe743700 1 -- 172.21.15.154:0/56596334 wait complete. 2024-05-06T21:18:20.468 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:21.124 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:20 smithi032 ceph-mon[27179]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:21.124 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:20 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/56596334' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:22.051 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:22.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:22.256 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:22.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: Regenerating cephadm self-signed grafana TLS certificates 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:22 smithi032 ceph-mon[27179]: Deploying daemon grafana.smithi032 on smithi032 2024-05-06T21:18:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.876+0000 7fe6d505f700 1 -- 172.21.15.154:0/4292069945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 msgr2=0x7fe6d00ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.876+0000 7fe6d505f700 1 --2- 172.21.15.154:0/4292069945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 0x7fe6d00ff130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009910 tx=0x7fe6c4009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.876+0000 7fe6d505f700 1 -- 172.21.15.154:0/4292069945 shutdown_connections 2024-05-06T21:18:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.876+0000 7fe6d505f700 1 --2- 172.21.15.154:0/4292069945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 0x7fe6d00ff130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.876+0000 7fe6d505f700 1 -- 172.21.15.154:0/4292069945 >> 172.21.15.154:0/4292069945 conn(0x7fe6d00fa2b0 msgr2=0x7fe6d00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.876+0000 7fe6d505f700 1 -- 172.21.15.154:0/4292069945 shutdown_connections 2024-05-06T21:18:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.876+0000 7fe6d505f700 1 -- 172.21.15.154:0/4292069945 wait complete. 2024-05-06T21:18:23.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.877+0000 7fe6d505f700 1 Processor -- start 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.877+0000 7fe6d505f700 1 -- start start 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.878+0000 7fe6d505f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 0x7fe6d0193ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.878+0000 7fe6d505f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01943e0 con 0x7fe6d00fed20 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.878+0000 7fe6ced9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 0x7fe6d0193ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.878+0000 7fe6ced9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 0x7fe6d0193ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:52600/0 (socket says 172.21.15.154:52600) 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.878+0000 7fe6ced9d700 1 -- 172.21.15.154:0/1257691819 learned_addr learned my addr 172.21.15.154:0/1257691819 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.878+0000 7fe6ced9d700 1 -- 172.21.15.154:0/1257691819 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c40095f0 con 0x7fe6d00fed20 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.878+0000 7fe6ced9d700 1 --2- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 0x7fe6d0193ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4005b40 tx=0x7fe6c4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.879+0000 7fe6b7fff700 1 -- 172.21.15.154:0/1257691819 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6c401d070 con 0x7fe6d00fed20 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.879+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d01945e0 con 0x7fe6d00fed20 2024-05-06T21:18:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.879+0000 7fe6b7fff700 1 -- 172.21.15.154:0/1257691819 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe6c400be10 con 0x7fe6d00fed20 2024-05-06T21:18:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.879+0000 7fe6b7fff700 1 -- 172.21.15.154:0/1257691819 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6c400f460 con 0x7fe6d00fed20 2024-05-06T21:18:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.879+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d0194a80 con 0x7fe6d00fed20 2024-05-06T21:18:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.880+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d0104b50 con 0x7fe6d00fed20 2024-05-06T21:18:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.880+0000 7fe6b7fff700 1 -- 172.21.15.154:0/1257691819 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fe6c40227e0 con 0x7fe6d00fed20 2024-05-06T21:18:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.880+0000 7fe6b7fff700 1 --2- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fe6b803a6a0 0x7fe6b803cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.880+0000 7fe6b7fff700 1 -- 172.21.15.154:0/1257691819 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe6c404cd60 con 0x7fe6d00fed20 2024-05-06T21:18:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.881+0000 7fe6ce59c700 1 --2- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fe6b803a6a0 0x7fe6b803cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.885+0000 7fe6ce59c700 1 --2- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fe6b803a6a0 0x7fe6b803cb50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0006fd0 tx=0x7fe6c0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:23.885+0000 7fe6b7fff700 1 -- 172.21.15.154:0/1257691819 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe6c402bba0 con 0x7fe6d00fed20 2024-05-06T21:18:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.151+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe6d018d800 con 0x7fe6d00fed20 2024-05-06T21:18:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.151+0000 7fe6b7fff700 1 -- 172.21.15.154:0/1257691819 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe6c4027030 con 0x7fe6d00fed20 2024-05-06T21:18:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:24.154 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.153+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fe6b803a6a0 msgr2=0x7fe6b803cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.153+0000 7fe6d505f700 1 --2- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fe6b803a6a0 0x7fe6b803cb50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0006fd0 tx=0x7fe6c0006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.153+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 msgr2=0x7fe6d0193ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.153+0000 7fe6d505f700 1 --2- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 0x7fe6d0193ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4005b40 tx=0x7fe6c4004740 comp rx=0 tx=0).stop 2024-05-06T21:18:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.154+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 shutdown_connections 2024-05-06T21:18:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.154+0000 7fe6d505f700 1 --2- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fe6b803a6a0 0x7fe6b803cb50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.154+0000 7fe6d505f700 1 --2- 172.21.15.154:0/1257691819 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d00fed20 0x7fe6d0193ea0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.154+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 >> 172.21.15.154:0/1257691819 conn(0x7fe6d00fa2b0 msgr2=0x7fe6d00faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.154+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 shutdown_connections 2024-05-06T21:18:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:24.154+0000 7fe6d505f700 1 -- 172.21.15.154:0/1257691819 wait complete. 2024-05-06T21:18:24.158 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:25.183 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:24 smithi032 ceph-mon[27179]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:25.183 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:24 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/1257691819' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:25.751 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:25.812 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:26.064 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:27.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:26 smithi032 ceph-mon[27179]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:27.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:26 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.592+0000 7fd167e42700 1 -- 172.21.15.154:0/2874188838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 msgr2=0x7fd160100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.592+0000 7fd167e42700 1 --2- 172.21.15.154:0/2874188838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 0x7fd160100230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009910 tx=0x7fd15c009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.592+0000 7fd167e42700 1 -- 172.21.15.154:0/2874188838 shutdown_connections 2024-05-06T21:18:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.592+0000 7fd167e42700 1 --2- 172.21.15.154:0/2874188838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 0x7fd160100230 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.592+0000 7fd167e42700 1 -- 172.21.15.154:0/2874188838 >> 172.21.15.154:0/2874188838 conn(0x7fd1600fb3d0 msgr2=0x7fd1600fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.592+0000 7fd167e42700 1 -- 172.21.15.154:0/2874188838 shutdown_connections 2024-05-06T21:18:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.592+0000 7fd167e42700 1 -- 172.21.15.154:0/2874188838 wait complete. 2024-05-06T21:18:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.593+0000 7fd167e42700 1 Processor -- start 2024-05-06T21:18:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.593+0000 7fd167e42700 1 -- start start 2024-05-06T21:18:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.593+0000 7fd167e42700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 0x7fd160074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.593+0000 7fd167e42700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd160075030 con 0x7fd1600ffe20 2024-05-06T21:18:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.593+0000 7fd165bde700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 0x7fd160074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.593+0000 7fd165bde700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 0x7fd160074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:52608/0 (socket says 172.21.15.154:52608) 2024-05-06T21:18:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.593+0000 7fd165bde700 1 -- 172.21.15.154:0/2274090648 learned_addr learned my addr 172.21.15.154:0/2274090648 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.594+0000 7fd165bde700 1 -- 172.21.15.154:0/2274090648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c0095f0 con 0x7fd1600ffe20 2024-05-06T21:18:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.594+0000 7fd165bde700 1 --2- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 0x7fd160074af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd15c005b40 tx=0x7fd15c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.594+0000 7fd156ffd700 1 -- 172.21.15.154:0/2274090648 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd15c01d070 con 0x7fd1600ffe20 2024-05-06T21:18:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.594+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd160073140 con 0x7fd1600ffe20 2024-05-06T21:18:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.594+0000 7fd156ffd700 1 -- 172.21.15.154:0/2274090648 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd15c00be10 con 0x7fd1600ffe20 2024-05-06T21:18:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.594+0000 7fd156ffd700 1 -- 172.21.15.154:0/2274090648 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd15c00f460 con 0x7fd1600ffe20 2024-05-06T21:18:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.594+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1600735e0 con 0x7fd1600ffe20 2024-05-06T21:18:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.595+0000 7fd156ffd700 1 -- 172.21.15.154:0/2274090648 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd15c00b960 con 0x7fd1600ffe20 2024-05-06T21:18:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.595+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd160062380 con 0x7fd1600ffe20 2024-05-06T21:18:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.595+0000 7fd156ffd700 1 --2- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd14c038490 0x7fd14c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.595+0000 7fd156ffd700 1 -- 172.21.15.154:0/2274090648 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd15c04c280 con 0x7fd1600ffe20 2024-05-06T21:18:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.597+0000 7fd1653dd700 1 --2- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd14c038490 0x7fd14c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:27.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.601+0000 7fd156ffd700 1 -- 172.21.15.154:0/2274090648 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd15c02bba0 con 0x7fd1600ffe20 2024-05-06T21:18:27.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.601+0000 7fd1653dd700 1 --2- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd14c038490 0x7fd14c03a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd150006fd0 tx=0x7fd150006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:27.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.863+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd16018e460 con 0x7fd1600ffe20 2024-05-06T21:18:27.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.864+0000 7fd156ffd700 1 -- 172.21.15.154:0/2274090648 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd15c027070 con 0x7fd1600ffe20 2024-05-06T21:18:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:27.867 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:27.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd14c038490 msgr2=0x7fd14c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:27.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 --2- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd14c038490 0x7fd14c03a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd150006fd0 tx=0x7fd150006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:27.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 msgr2=0x7fd160074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 --2- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 0x7fd160074af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd15c005b40 tx=0x7fd15c004740 comp rx=0 tx=0).stop 2024-05-06T21:18:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 shutdown_connections 2024-05-06T21:18:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 --2- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd14c038490 0x7fd14c03a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 --2- 172.21.15.154:0/2274090648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1600ffe20 0x7fd160074af0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 >> 172.21.15.154:0/2274090648 conn(0x7fd1600fb3d0 msgr2=0x7fd1600fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 shutdown_connections 2024-05-06T21:18:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:27.867+0000 7fd167e42700 1 -- 172.21.15.154:0/2274090648 wait complete. 2024-05-06T21:18:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:29.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:28 smithi032 ceph-mon[27179]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:29.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:28 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/2274090648' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:29.407 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:29.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:29.663 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:31.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.106+0000 7fa8472bc700 1 -- 172.21.15.154:0/245833287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 msgr2=0x7fa8400ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:31.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.106+0000 7fa8472bc700 1 --2- 172.21.15.154:0/245833287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 0x7fa8400ff130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa830009910 tx=0x7fa830009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:31.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.107+0000 7fa8472bc700 1 -- 172.21.15.154:0/245833287 shutdown_connections 2024-05-06T21:18:31.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.107+0000 7fa8472bc700 1 --2- 172.21.15.154:0/245833287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 0x7fa8400ff130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:31.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.107+0000 7fa8472bc700 1 -- 172.21.15.154:0/245833287 >> 172.21.15.154:0/245833287 conn(0x7fa8400fa2b0 msgr2=0x7fa8400fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:31.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.107+0000 7fa8472bc700 1 -- 172.21.15.154:0/245833287 shutdown_connections 2024-05-06T21:18:31.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.107+0000 7fa8472bc700 1 -- 172.21.15.154:0/245833287 wait complete. 2024-05-06T21:18:31.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.107+0000 7fa8472bc700 1 Processor -- start 2024-05-06T21:18:31.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.107+0000 7fa8472bc700 1 -- start start 2024-05-06T21:18:31.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.107+0000 7fa8472bc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 0x7fa8401971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:31.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.107+0000 7fa8472bc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8401976f0 con 0x7fa8400fed20 2024-05-06T21:18:31.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.108+0000 7fa845058700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 0x7fa8401971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:31.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.108+0000 7fa845058700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 0x7fa8401971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:60124/0 (socket says 172.21.15.154:60124) 2024-05-06T21:18:31.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.108+0000 7fa845058700 1 -- 172.21.15.154:0/1113874929 learned_addr learned my addr 172.21.15.154:0/1113874929 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:31.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.108+0000 7fa845058700 1 -- 172.21.15.154:0/1113874929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300095f0 con 0x7fa8400fed20 2024-05-06T21:18:31.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.109+0000 7fa845058700 1 --2- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 0x7fa8401971b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa830005950 tx=0x7fa830009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:31.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.109+0000 7fa8367fc700 1 -- 172.21.15.154:0/1113874929 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa83001d070 con 0x7fa8400fed20 2024-05-06T21:18:31.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.109+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8401978f0 con 0x7fa8400fed20 2024-05-06T21:18:31.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.109+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa840197d90 con 0x7fa8400fed20 2024-05-06T21:18:31.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.109+0000 7fa8367fc700 1 -- 172.21.15.154:0/1113874929 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa830005c00 con 0x7fa8400fed20 2024-05-06T21:18:31.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.109+0000 7fa8367fc700 1 -- 172.21.15.154:0/1113874929 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa83000fbb0 con 0x7fa8400fed20 2024-05-06T21:18:31.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.110+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa824005320 con 0x7fa8400fed20 2024-05-06T21:18:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.110+0000 7fa8367fc700 1 -- 172.21.15.154:0/1113874929 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fa83000fd10 con 0x7fa8400fed20 2024-05-06T21:18:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.110+0000 7fa8367fc700 1 --2- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fa82c038490 0x7fa82c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.110+0000 7fa8367fc700 1 -- 172.21.15.154:0/1113874929 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa83004c270 con 0x7fa8400fed20 2024-05-06T21:18:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.110+0000 7fa844857700 1 --2- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fa82c038490 0x7fa82c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.111+0000 7fa844857700 1 --2- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fa82c038490 0x7fa82c03a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa83c006fd0 tx=0x7fa83c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:31.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.115+0000 7fa8367fc700 1 -- 172.21.15.154:0/1113874929 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa830017440 con 0x7fa8400fed20 2024-05-06T21:18:31.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:30 smithi032 ceph-mon[27179]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:31.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.381+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa824005190 con 0x7fa8400fed20 2024-05-06T21:18:31.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.382+0000 7fa8367fc700 1 -- 172.21.15.154:0/1113874929 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa830027070 con 0x7fa8400fed20 2024-05-06T21:18:31.385 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:31.385 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.384+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fa82c038490 msgr2=0x7fa82c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.384+0000 7fa8472bc700 1 --2- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fa82c038490 0x7fa82c03a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa83c006fd0 tx=0x7fa83c006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.384+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 msgr2=0x7fa8401971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.384+0000 7fa8472bc700 1 --2- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 0x7fa8401971b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa830005950 tx=0x7fa830009e60 comp rx=0 tx=0).stop 2024-05-06T21:18:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.384+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 shutdown_connections 2024-05-06T21:18:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.384+0000 7fa8472bc700 1 --2- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fa82c038490 0x7fa82c03a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.384+0000 7fa8472bc700 1 --2- 172.21.15.154:0/1113874929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8400fed20 0x7fa8401971b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.384+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 >> 172.21.15.154:0/1113874929 conn(0x7fa8400fa2b0 msgr2=0x7fa8400687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.385+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 shutdown_connections 2024-05-06T21:18:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:31.385+0000 7fa8472bc700 1 -- 172.21.15.154:0/1113874929 wait complete. 2024-05-06T21:18:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:32.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:31 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/1113874929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:32.984 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:32.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:33.188 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:33.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:32 smithi032 ceph-mon[27179]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:33.238 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:34.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.569+0000 7f53d32eb700 1 -- 172.21.15.154:0/3365540887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 msgr2=0x7f53cc0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:34.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.569+0000 7f53d32eb700 1 --2- 172.21.15.154:0/3365540887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 0x7f53cc0ff130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009910 tx=0x7f53bc009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:34.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.569+0000 7f53d32eb700 1 -- 172.21.15.154:0/3365540887 shutdown_connections 2024-05-06T21:18:34.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.569+0000 7f53d32eb700 1 --2- 172.21.15.154:0/3365540887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 0x7f53cc0ff130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:34.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.569+0000 7f53d32eb700 1 -- 172.21.15.154:0/3365540887 >> 172.21.15.154:0/3365540887 conn(0x7f53cc0fa2b0 msgr2=0x7f53cc0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:34.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.569+0000 7f53d32eb700 1 -- 172.21.15.154:0/3365540887 shutdown_connections 2024-05-06T21:18:34.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.569+0000 7f53d32eb700 1 -- 172.21.15.154:0/3365540887 wait complete. 2024-05-06T21:18:34.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.569+0000 7f53d32eb700 1 Processor -- start 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.570+0000 7f53d32eb700 1 -- start start 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.570+0000 7f53d32eb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 0x7f53cc068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.570+0000 7f53d32eb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc197d30 con 0x7f53cc0fed20 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.570+0000 7f53d1087700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 0x7f53cc068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.570+0000 7f53d1087700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 0x7f53cc068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:60152/0 (socket says 172.21.15.154:60152) 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.570+0000 7f53d1087700 1 -- 172.21.15.154:0/3807881550 learned_addr learned my addr 172.21.15.154:0/3807881550 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.570+0000 7f53d1087700 1 -- 172.21.15.154:0/3807881550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc0095f0 con 0x7f53cc0fed20 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.570+0000 7f53d1087700 1 --2- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 0x7f53cc068ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f53bc005b40 tx=0x7f53bc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.570+0000 7f53c27fc700 1 -- 172.21.15.154:0/3807881550 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53bc01d070 con 0x7f53cc0fed20 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.571+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc197e70 con 0x7f53cc0fed20 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.571+0000 7f53c27fc700 1 -- 172.21.15.154:0/3807881550 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f53bc00be10 con 0x7f53cc0fed20 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.571+0000 7f53c27fc700 1 -- 172.21.15.154:0/3807881550 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53bc00f460 con 0x7f53cc0fed20 2024-05-06T21:18:34.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.571+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc1982b0 con 0x7f53cc0fed20 2024-05-06T21:18:34.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.571+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc18da00 con 0x7f53cc0fed20 2024-05-06T21:18:34.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.572+0000 7f53c27fc700 1 -- 172.21.15.154:0/3807881550 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f53bc0227e0 con 0x7f53cc0fed20 2024-05-06T21:18:34.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.572+0000 7f53c27fc700 1 --2- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f53b8038490 0x7f53b803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:34.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.572+0000 7f53c27fc700 1 -- 172.21.15.154:0/3807881550 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f53bc04c460 con 0x7f53cc0fed20 2024-05-06T21:18:34.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.572+0000 7f53d0886700 1 --2- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f53b8038490 0x7f53b803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:34.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.573+0000 7f53d0886700 1 --2- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f53b8038490 0x7f53b803a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53c8006fd0 tx=0x7f53c8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:34.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.577+0000 7f53c27fc700 1 -- 172.21.15.154:0/3807881550 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f53bc02bba0 con 0x7f53cc0fed20 2024-05-06T21:18:34.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.839+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f53cc02cc30 con 0x7f53cc0fed20 2024-05-06T21:18:34.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.840+0000 7f53c27fc700 1 -- 172.21.15.154:0/3807881550 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f53bc027030 con 0x7f53cc0fed20 2024-05-06T21:18:34.844 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:34.844 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:34.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f53b8038490 msgr2=0x7f53b803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:34.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 --2- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f53b8038490 0x7f53b803a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53c8006fd0 tx=0x7f53c8006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:34.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 msgr2=0x7f53cc068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 --2- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 0x7f53cc068ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f53bc005b40 tx=0x7f53bc004740 comp rx=0 tx=0).stop 2024-05-06T21:18:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 shutdown_connections 2024-05-06T21:18:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 --2- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f53b8038490 0x7f53b803a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 --2- 172.21.15.154:0/3807881550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53cc0fed20 0x7f53cc068ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 >> 172.21.15.154:0/3807881550 conn(0x7f53cc0fa2b0 msgr2=0x7f53cc0faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 shutdown_connections 2024-05-06T21:18:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:34.843+0000 7f53d32eb700 1 -- 172.21.15.154:0/3807881550 wait complete. 2024-05-06T21:18:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:35.051 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:34 smithi032 ceph-mon[27179]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:35.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:35 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/3807881550' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:36.345 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:36.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:36.544 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:36.592 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:37.011 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:36 smithi032 ceph-mon[27179]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:37.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.972+0000 7f9083389700 1 -- 172.21.15.154:0/3425963566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 msgr2=0x7f907c0feac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.972+0000 7f9083389700 1 --2- 172.21.15.154:0/3425963566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 0x7f907c0feac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f906c00b0a0 tx=0x7f906c00b3b0 comp rx=0 tx=0).stop 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.972+0000 7f9083389700 1 -- 172.21.15.154:0/3425963566 shutdown_connections 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.972+0000 7f9083389700 1 --2- 172.21.15.154:0/3425963566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 0x7f907c0feac0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.972+0000 7f9083389700 1 -- 172.21.15.154:0/3425963566 >> 172.21.15.154:0/3425963566 conn(0x7f907c0fa2c0 msgr2=0x7f907c0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.972+0000 7f9083389700 1 -- 172.21.15.154:0/3425963566 shutdown_connections 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.972+0000 7f9083389700 1 -- 172.21.15.154:0/3425963566 wait complete. 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.973+0000 7f9083389700 1 Processor -- start 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.973+0000 7f9083389700 1 -- start start 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.973+0000 7f9083389700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 0x7f907c1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.973+0000 7f9083389700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c1976f0 con 0x7f907c0fe6b0 2024-05-06T21:18:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.974+0000 7f9081125700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 0x7f907c1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.974+0000 7f9081125700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 0x7f907c1971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:60168/0 (socket says 172.21.15.154:60168) 2024-05-06T21:18:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.974+0000 7f9081125700 1 -- 172.21.15.154:0/3874525307 learned_addr learned my addr 172.21.15.154:0/3874525307 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:37.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.976+0000 7f9081125700 1 -- 172.21.15.154:0/3874525307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c009d00 con 0x7f907c0fe6b0 2024-05-06T21:18:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.976+0000 7f9081125700 1 --2- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 0x7f907c1971b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f906c015040 tx=0x7f906c00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.976+0000 7f907a7fc700 1 -- 172.21.15.154:0/3874525307 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f906c00e040 con 0x7f907c0fe6b0 2024-05-06T21:18:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.976+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907c1978f0 con 0x7f907c0fe6b0 2024-05-06T21:18:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.976+0000 7f907a7fc700 1 -- 172.21.15.154:0/3874525307 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f906c01d930 con 0x7f907c0fe6b0 2024-05-06T21:18:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.976+0000 7f907a7fc700 1 -- 172.21.15.154:0/3874525307 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f906c0129d0 con 0x7f907c0fe6b0 2024-05-06T21:18:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.976+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907c197d10 con 0x7f907c0fe6b0 2024-05-06T21:18:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.977+0000 7f907a7fc700 1 -- 172.21.15.154:0/3874525307 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f906c012c90 con 0x7f907c0fe6b0 2024-05-06T21:18:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.977+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907c190d00 con 0x7f907c0fe6b0 2024-05-06T21:18:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.977+0000 7f907a7fc700 1 --2- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9064038490 0x7f906403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.977+0000 7f907a7fc700 1 -- 172.21.15.154:0/3874525307 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f906c04c970 con 0x7f907c0fe6b0 2024-05-06T21:18:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.977+0000 7f9080924700 1 --2- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9064038490 0x7f906403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.978+0000 7f9080924700 1 --2- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9064038490 0x7f906403a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9070006fd0 tx=0x7f9070006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:37.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:37.985+0000 7f907a7fc700 1 -- 172.21.15.154:0/3874525307 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f906c025770 con 0x7f907c0fe6b0 2024-05-06T21:18:38.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.250+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f907c02cc30 con 0x7f907c0fe6b0 2024-05-06T21:18:38.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.250+0000 7f907a7fc700 1 -- 172.21.15.154:0/3874525307 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f906c025360 con 0x7f907c0fe6b0 2024-05-06T21:18:38.253 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:38.253 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:38.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9064038490 msgr2=0x7f906403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:38.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 --2- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9064038490 0x7f906403a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9070006fd0 tx=0x7f9070006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:38.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 msgr2=0x7f907c1971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:38.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 --2- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 0x7f907c1971b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f906c015040 tx=0x7f906c00bb10 comp rx=0 tx=0).stop 2024-05-06T21:18:38.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 shutdown_connections 2024-05-06T21:18:38.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 --2- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f9064038490 0x7f906403a940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:38.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 --2- 172.21.15.154:0/3874525307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f907c0fe6b0 0x7f907c1971b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:38.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 >> 172.21.15.154:0/3874525307 conn(0x7f907c0fa2c0 msgr2=0x7f907c0faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:38.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 shutdown_connections 2024-05-06T21:18:38.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:38.252+0000 7f9083389700 1 -- 172.21.15.154:0/3874525307 wait complete. 2024-05-06T21:18:38.256 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:38.512 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:38 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:38.512 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:38 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:38.512 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:38 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:38.512 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:38 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:38.512 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:38 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:38.512 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:38 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:38.512 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:38 smithi032 ceph-mon[27179]: Deploying daemon prometheus.smithi032 on smithi032 2024-05-06T21:18:38.512 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:38 smithi032 ceph-mon[27179]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:39.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:39 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/3874525307' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:39.831 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:39.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:40.086 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:41.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:40 smithi032 ceph-mon[27179]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:41.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:40 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:41.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.392+0000 7fb01be7e700 1 -- 172.21.15.154:0/11682679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 msgr2=0x7fb014100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:41.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.392+0000 7fb01be7e700 1 --2- 172.21.15.154:0/11682679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 0x7fb014100280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb010009910 tx=0x7fb010009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:41.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.392+0000 7fb01be7e700 1 -- 172.21.15.154:0/11682679 shutdown_connections 2024-05-06T21:18:41.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.392+0000 7fb01be7e700 1 --2- 172.21.15.154:0/11682679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 0x7fb014100280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:41.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.392+0000 7fb01be7e700 1 -- 172.21.15.154:0/11682679 >> 172.21.15.154:0/11682679 conn(0x7fb0140fb470 msgr2=0x7fb0140fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.392+0000 7fb01be7e700 1 -- 172.21.15.154:0/11682679 shutdown_connections 2024-05-06T21:18:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.392+0000 7fb01be7e700 1 -- 172.21.15.154:0/11682679 wait complete. 2024-05-06T21:18:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.392+0000 7fb01be7e700 1 Processor -- start 2024-05-06T21:18:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.392+0000 7fb01be7e700 1 -- start start 2024-05-06T21:18:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.393+0000 7fb01be7e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 0x7fb014074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.393+0000 7fb01be7e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014075030 con 0x7fb0140ffe70 2024-05-06T21:18:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.393+0000 7fb019c1a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 0x7fb014074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.393+0000 7fb019c1a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 0x7fb014074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:53766/0 (socket says 172.21.15.154:53766) 2024-05-06T21:18:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.393+0000 7fb019c1a700 1 -- 172.21.15.154:0/1876563401 learned_addr learned my addr 172.21.15.154:0/1876563401 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:41.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.393+0000 7fb019c1a700 1 -- 172.21.15.154:0/1876563401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0100095f0 con 0x7fb0140ffe70 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.393+0000 7fb019c1a700 1 --2- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 0x7fb014074af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb010005b40 tx=0x7fb010004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.394+0000 7fb00affd700 1 -- 172.21.15.154:0/1876563401 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb01001d070 con 0x7fb0140ffe70 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.394+0000 7fb00affd700 1 -- 172.21.15.154:0/1876563401 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb01000be10 con 0x7fb0140ffe70 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.394+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb014073140 con 0x7fb0140ffe70 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.394+0000 7fb00affd700 1 -- 172.21.15.154:0/1876563401 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb01000f460 con 0x7fb0140ffe70 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.394+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0140735e0 con 0x7fb0140ffe70 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.394+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb014062380 con 0x7fb0140ffe70 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.395+0000 7fb00affd700 1 -- 172.21.15.154:0/1876563401 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fb0100227e0 con 0x7fb0140ffe70 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.395+0000 7fb00affd700 1 --2- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fb000038490 0x7fb00003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.395+0000 7fb00affd700 1 -- 172.21.15.154:0/1876563401 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb01004c460 con 0x7fb0140ffe70 2024-05-06T21:18:41.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.395+0000 7fb019419700 1 --2- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fb000038490 0x7fb00003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:41.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.396+0000 7fb019419700 1 --2- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fb000038490 0x7fb00003a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb004006fd0 tx=0x7fb004006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:41.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.402+0000 7fb00affd700 1 -- 172.21.15.154:0/1876563401 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb01002bba0 con 0x7fb0140ffe70 2024-05-06T21:18:41.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.668+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb01418e450 con 0x7fb0140ffe70 2024-05-06T21:18:41.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.668+0000 7fb00affd700 1 -- 172.21.15.154:0/1876563401 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb010027030 con 0x7fb0140ffe70 2024-05-06T21:18:41.671 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:41.672 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:41.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.670+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fb000038490 msgr2=0x7fb00003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:41.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.670+0000 7fb01be7e700 1 --2- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fb000038490 0x7fb00003a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb004006fd0 tx=0x7fb004006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:41.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.670+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 msgr2=0x7fb014074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:41.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.670+0000 7fb01be7e700 1 --2- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 0x7fb014074af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb010005b40 tx=0x7fb010004740 comp rx=0 tx=0).stop 2024-05-06T21:18:41.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.670+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 shutdown_connections 2024-05-06T21:18:41.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.670+0000 7fb01be7e700 1 --2- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fb000038490 0x7fb00003a940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:41.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.671+0000 7fb01be7e700 1 --2- 172.21.15.154:0/1876563401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0140ffe70 0x7fb014074af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:41.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.671+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 >> 172.21.15.154:0/1876563401 conn(0x7fb0140fb470 msgr2=0x7fb0140fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:41.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.671+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 shutdown_connections 2024-05-06T21:18:41.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:41.671+0000 7fb01be7e700 1 -- 172.21.15.154:0/1876563401 wait complete. 2024-05-06T21:18:41.674 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:42.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:41 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/1876563401' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:43.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:42 smithi032 ceph-mon[27179]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:43.235 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:43.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:43.441 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:43.491 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:44.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.827+0000 7fd839db2700 1 -- 172.21.15.154:0/446775765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 msgr2=0x7fd834102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.827+0000 7fd839db2700 1 --2- 172.21.15.154:0/446775765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 0x7fd834102c90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd824009910 tx=0x7fd824009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.827+0000 7fd839db2700 1 -- 172.21.15.154:0/446775765 shutdown_connections 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.827+0000 7fd839db2700 1 --2- 172.21.15.154:0/446775765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 0x7fd834102c90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.827+0000 7fd839db2700 1 -- 172.21.15.154:0/446775765 >> 172.21.15.154:0/446775765 conn(0x7fd8340fa2b0 msgr2=0x7fd8340fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.827+0000 7fd839db2700 1 -- 172.21.15.154:0/446775765 shutdown_connections 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.827+0000 7fd839db2700 1 -- 172.21.15.154:0/446775765 wait complete. 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.828+0000 7fd839db2700 1 Processor -- start 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.828+0000 7fd839db2700 1 -- start start 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.828+0000 7fd839db2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 0x7fd834194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.828+0000 7fd839db2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834195490 con 0x7fd8341008b0 2024-05-06T21:18:44.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.829+0000 7fd8337fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 0x7fd834194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:44.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.829+0000 7fd8337fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 0x7fd834194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:53784/0 (socket says 172.21.15.154:53784) 2024-05-06T21:18:44.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.829+0000 7fd8337fe700 1 -- 172.21.15.154:0/227959970 learned_addr learned my addr 172.21.15.154:0/227959970 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:44.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.830+0000 7fd8337fe700 1 -- 172.21.15.154:0/227959970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8240095f0 con 0x7fd8341008b0 2024-05-06T21:18:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.831+0000 7fd8337fe700 1 --2- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 0x7fd834194f50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd824005b40 tx=0x7fd824004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.831+0000 7fd8317fa700 1 -- 172.21.15.154:0/227959970 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd82401d070 con 0x7fd8341008b0 2024-05-06T21:18:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.831+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd834195690 con 0x7fd8341008b0 2024-05-06T21:18:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.831+0000 7fd8317fa700 1 -- 172.21.15.154:0/227959970 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd82400be10 con 0x7fd8341008b0 2024-05-06T21:18:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.831+0000 7fd8317fa700 1 -- 172.21.15.154:0/227959970 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd82400f460 con 0x7fd8341008b0 2024-05-06T21:18:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.831+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd834195b30 con 0x7fd8341008b0 2024-05-06T21:18:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.832+0000 7fd8317fa700 1 -- 172.21.15.154:0/227959970 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd82400b960 con 0x7fd8341008b0 2024-05-06T21:18:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.832+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83418eb00 con 0x7fd8341008b0 2024-05-06T21:18:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.832+0000 7fd8317fa700 1 --2- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd820038490 0x7fd82003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.832+0000 7fd8317fa700 1 -- 172.21.15.154:0/227959970 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd82404c400 con 0x7fd8341008b0 2024-05-06T21:18:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.832+0000 7fd82bfff700 1 --2- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd820038490 0x7fd82003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.833+0000 7fd82bfff700 1 --2- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd820038490 0x7fd82003a940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd81c006fd0 tx=0x7fd81c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:44.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:44.843+0000 7fd8317fa700 1 -- 172.21.15.154:0/227959970 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd82402a360 con 0x7fd8341008b0 2024-05-06T21:18:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.109+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd83402cc30 con 0x7fd8341008b0 2024-05-06T21:18:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.109+0000 7fd8317fa700 1 -- 172.21.15.154:0/227959970 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd824027030 con 0x7fd8341008b0 2024-05-06T21:18:45.112 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:45.112 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:45.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd820038490 msgr2=0x7fd82003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:45.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 --2- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd820038490 0x7fd82003a940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd81c006fd0 tx=0x7fd81c006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:45.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 msgr2=0x7fd834194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:45.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 --2- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 0x7fd834194f50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd824005b40 tx=0x7fd824004740 comp rx=0 tx=0).stop 2024-05-06T21:18:45.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 shutdown_connections 2024-05-06T21:18:45.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 --2- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7fd820038490 0x7fd82003a940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:45.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 --2- 172.21.15.154:0/227959970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8341008b0 0x7fd834194f50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:45.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 >> 172.21.15.154:0/227959970 conn(0x7fd8340fa2b0 msgr2=0x7fd8340faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:45.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 shutdown_connections 2024-05-06T21:18:45.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:45.112+0000 7fd839db2700 1 -- 172.21.15.154:0/227959970 wait complete. 2024-05-06T21:18:45.116 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:45.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:44 smithi032 ceph-mon[27179]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:46.065 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:45 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/227959970' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:46.683 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:46.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:46.938 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:47.065 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:46 smithi032 ceph-mon[27179]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.341+0000 7f22ffbc8700 1 -- 172.21.15.154:0/612330585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 msgr2=0x7f22f80ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.341+0000 7f22ffbc8700 1 --2- 172.21.15.154:0/612330585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 0x7f22f80ff130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009910 tx=0x7f22e8009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.341+0000 7f22ffbc8700 1 -- 172.21.15.154:0/612330585 shutdown_connections 2024-05-06T21:18:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.341+0000 7f22ffbc8700 1 --2- 172.21.15.154:0/612330585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 0x7f22f80ff130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.341+0000 7f22ffbc8700 1 -- 172.21.15.154:0/612330585 >> 172.21.15.154:0/612330585 conn(0x7f22f80fa2b0 msgr2=0x7f22f80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.341+0000 7f22ffbc8700 1 -- 172.21.15.154:0/612330585 shutdown_connections 2024-05-06T21:18:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.341+0000 7f22ffbc8700 1 -- 172.21.15.154:0/612330585 wait complete. 2024-05-06T21:18:48.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.342+0000 7f22ffbc8700 1 Processor -- start 2024-05-06T21:18:48.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.342+0000 7f22ffbc8700 1 -- start start 2024-05-06T21:18:48.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.342+0000 7f22ffbc8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 0x7f22f8194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:48.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.342+0000 7f22ffbc8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8195500 con 0x7f22f80fed20 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22fd964700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 0x7f22f8194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22fd964700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 0x7f22f8194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:53802/0 (socket says 172.21.15.154:53802) 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22fd964700 1 -- 172.21.15.154:0/1507495329 learned_addr learned my addr 172.21.15.154:0/1507495329 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22fd964700 1 -- 172.21.15.154:0/1507495329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80095f0 con 0x7f22f80fed20 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22fd964700 1 --2- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 0x7f22f8194fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22e8005950 tx=0x7f22e8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22eeffd700 1 -- 172.21.15.154:0/1507495329 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22e801d070 con 0x7f22f80fed20 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f8195700 con 0x7f22f80fed20 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22eeffd700 1 -- 172.21.15.154:0/1507495329 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f22e800be10 con 0x7f22f80fed20 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22eeffd700 1 -- 172.21.15.154:0/1507495329 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22e800f460 con 0x7f22f80fed20 2024-05-06T21:18:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.343+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f8195ba0 con 0x7f22f80fed20 2024-05-06T21:18:48.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.344+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f818ea10 con 0x7f22f80fed20 2024-05-06T21:18:48.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.344+0000 7f22eeffd700 1 -- 172.21.15.154:0/1507495329 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f22e80227c0 con 0x7f22f80fed20 2024-05-06T21:18:48.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.344+0000 7f22eeffd700 1 --2- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f22e4038490 0x7f22e403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:48.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.344+0000 7f22eeffd700 1 -- 172.21.15.154:0/1507495329 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f22e804c4f0 con 0x7f22f80fed20 2024-05-06T21:18:48.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.345+0000 7f22fd163700 1 --2- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f22e4038490 0x7f22e403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:48.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.345+0000 7f22fd163700 1 --2- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f22e4038490 0x7f22e403a940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f22f4006fd0 tx=0x7f22f4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:48.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.350+0000 7f22eeffd700 1 -- 172.21.15.154:0/1507495329 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f22e802bba0 con 0x7f22f80fed20 2024-05-06T21:18:48.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.617+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f22f802cc30 con 0x7f22f80fed20 2024-05-06T21:18:48.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.618+0000 7f22eeffd700 1 -- 172.21.15.154:0/1507495329 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f22e8027070 con 0x7f22f80fed20 2024-05-06T21:18:48.620 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:48.621 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f22e4038490 msgr2=0x7f22e403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 --2- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f22e4038490 0x7f22e403a940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f22f4006fd0 tx=0x7f22f4006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 msgr2=0x7f22f8194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 --2- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 0x7f22f8194fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22e8005950 tx=0x7f22e8009e60 comp rx=0 tx=0).stop 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 shutdown_connections 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 --2- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f22e4038490 0x7f22e403a940 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 --2- 172.21.15.154:0/1507495329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f80fed20 0x7f22f8194fc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 >> 172.21.15.154:0/1507495329 conn(0x7f22f80fa2b0 msgr2=0x7f22f80687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 shutdown_connections 2024-05-06T21:18:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:48.620+0000 7f22ffbc8700 1 -- 172.21.15.154:0/1507495329 wait complete. 2024-05-06T21:18:48.624 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:49.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:48 smithi032 ceph-mon[27179]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:49.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:48 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/1507495329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:50.135 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:50.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:50.340 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:50.389 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:50.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:50 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:50.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:50 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:50.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:50 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:50.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:50 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T21:18:50.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:50 smithi032 ceph-mon[27179]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:18:51.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:51 smithi032 ceph-mon[27179]: from='mgr.14164 172.21.15.32:0/3169347651' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-06T21:18:51.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:51 smithi032 ceph-mon[27179]: mgrmap e14: smithi032.ecoohh(active, since 64s) 2024-05-06T21:18:51.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.844+0000 7f15cdbda700 1 -- 172.21.15.154:0/47640826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 msgr2=0x7f15c80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.844+0000 7f15cdbda700 1 --2- 172.21.15.154:0/47640826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 0x7f15c80ff140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f15b800b0a0 tx=0x7f15b800b3b0 comp rx=0 tx=0).stop 2024-05-06T21:18:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.844+0000 7f15cdbda700 1 -- 172.21.15.154:0/47640826 shutdown_connections 2024-05-06T21:18:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.844+0000 7f15cdbda700 1 --2- 172.21.15.154:0/47640826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 0x7f15c80ff140 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.844+0000 7f15cdbda700 1 -- 172.21.15.154:0/47640826 >> 172.21.15.154:0/47640826 conn(0x7f15c80fa2c0 msgr2=0x7f15c80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.844+0000 7f15cdbda700 1 -- 172.21.15.154:0/47640826 shutdown_connections 2024-05-06T21:18:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.844+0000 7f15cdbda700 1 -- 172.21.15.154:0/47640826 wait complete. 2024-05-06T21:18:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.844+0000 7f15cdbda700 1 Processor -- start 2024-05-06T21:18:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.845+0000 7f15cdbda700 1 -- start start 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.845+0000 7f15cdbda700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 0x7f15c80693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.845+0000 7f15cdbda700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8197cc0 con 0x7f15c80fed30 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.845+0000 7f15c77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 0x7f15c80693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.845+0000 7f15c77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 0x7f15c80693a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:48602/0 (socket says 172.21.15.154:48602) 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.845+0000 7f15c77fe700 1 -- 172.21.15.154:0/1887465517 learned_addr learned my addr 172.21.15.154:0/1887465517 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.845+0000 7f15c77fe700 1 -- 172.21.15.154:0/1887465517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8009d00 con 0x7f15c80fed30 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.845+0000 7f15c77fe700 1 --2- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 0x7f15c80693a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f15b800b830 tx=0x7f15b800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.846+0000 7f15c4ff9700 1 -- 172.21.15.154:0/1887465517 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15b800e040 con 0x7f15c80fed30 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.846+0000 7f15c4ff9700 1 -- 172.21.15.154:0/1887465517 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f15b8012af0 con 0x7f15c80fed30 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.846+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c8197e00 con 0x7f15c80fed30 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.846+0000 7f15c4ff9700 1 -- 172.21.15.154:0/1887465517 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15b801d9f0 con 0x7f15c80fed30 2024-05-06T21:18:51.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.846+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c8198220 con 0x7f15c80fed30 2024-05-06T21:18:51.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.847+0000 7f15c4ff9700 1 -- 172.21.15.154:0/1887465517 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f15b801dcb0 con 0x7f15c80fed30 2024-05-06T21:18:51.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.847+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c818da10 con 0x7f15c80fed30 2024-05-06T21:18:51.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.847+0000 7f15c4ff9700 1 --2- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15b00384e0 0x7f15b003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:51.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.847+0000 7f15c4ff9700 1 -- 172.21.15.154:0/1887465517 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f15b804c980 con 0x7f15c80fed30 2024-05-06T21:18:51.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.847+0000 7f15c6ffd700 1 -- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15b00384e0 msgr2=0x7f15b003a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2414450865 2024-05-06T21:18:51.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.847+0000 7f15c6ffd700 1 --2- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15b00384e0 0x7f15b003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T21:18:51.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:51.852+0000 7f15c4ff9700 1 -- 172.21.15.154:0/1887465517 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f15b801ae20 con 0x7f15c80fed30 2024-05-06T21:18:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.048+0000 7f15c6ffd700 1 -- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15b00384e0 msgr2=0x7f15b003a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2414450865 2024-05-06T21:18:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.048+0000 7f15c6ffd700 1 --2- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15b00384e0 0x7f15b003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T21:18:52.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.116+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f15c802cc30 con 0x7f15c80fed30 2024-05-06T21:18:52.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.116+0000 7f15c4ff9700 1 -- 172.21.15.154:0/1887465517 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f15b801ac40 con 0x7f15c80fed30 2024-05-06T21:18:52.119 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:52.120 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.118+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15b00384e0 msgr2=0x7f15b003a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T21:18:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.118+0000 7f15cdbda700 1 --2- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15b00384e0 0x7f15b003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.118+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 msgr2=0x7f15c80693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.118+0000 7f15cdbda700 1 --2- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 0x7f15c80693a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f15b800b830 tx=0x7f15b800bd40 comp rx=0 tx=0).stop 2024-05-06T21:18:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.119+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 shutdown_connections 2024-05-06T21:18:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.119+0000 7f15cdbda700 1 --2- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f15b00384e0 0x7f15b003a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.119+0000 7f15cdbda700 1 --2- 172.21.15.154:0/1887465517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15c80fed30 0x7f15c80693a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.119+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 >> 172.21.15.154:0/1887465517 conn(0x7f15c80fa2c0 msgr2=0x7f15c80faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.119+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 shutdown_connections 2024-05-06T21:18:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:52.119+0000 7f15cdbda700 1 -- 172.21.15.154:0/1887465517 wait complete. 2024-05-06T21:18:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:52.908 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:52 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/1887465517' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:53.713 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:53.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:53.919 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:53.968 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:55.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.420+0000 7f958d647700 1 -- 172.21.15.154:0/3436805114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 msgr2=0x7f9588100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:55.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.420+0000 7f958d647700 1 --2- 172.21.15.154:0/3436805114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 0x7f9588100230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9578009910 tx=0x7f9578009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:55.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.420+0000 7f958d647700 1 -- 172.21.15.154:0/3436805114 shutdown_connections 2024-05-06T21:18:55.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.420+0000 7f958d647700 1 --2- 172.21.15.154:0/3436805114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 0x7f9588100230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:55.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.420+0000 7f958d647700 1 -- 172.21.15.154:0/3436805114 >> 172.21.15.154:0/3436805114 conn(0x7f95880fb3d0 msgr2=0x7f95880fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:55.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.420+0000 7f958d647700 1 -- 172.21.15.154:0/3436805114 shutdown_connections 2024-05-06T21:18:55.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.420+0000 7f958d647700 1 -- 172.21.15.154:0/3436805114 wait complete. 2024-05-06T21:18:55.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.421+0000 7f958d647700 1 Processor -- start 2024-05-06T21:18:55.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.421+0000 7f958d647700 1 -- start start 2024-05-06T21:18:55.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.421+0000 7f958d647700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 0x7f9588197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:55.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.421+0000 7f958d647700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95881976b0 con 0x7f95880ffe20 2024-05-06T21:18:55.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.421+0000 7f9586ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 0x7f9588197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:55.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.421+0000 7f9586ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 0x7f9588197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:48618/0 (socket says 172.21.15.154:48618) 2024-05-06T21:18:55.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.421+0000 7f9586ffd700 1 -- 172.21.15.154:0/850022884 learned_addr learned my addr 172.21.15.154:0/850022884 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.422+0000 7f9586ffd700 1 -- 172.21.15.154:0/850022884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95780095f0 con 0x7f95880ffe20 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.422+0000 7f9586ffd700 1 --2- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 0x7f9588197170 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9578005b40 tx=0x7f9578004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.422+0000 7f956ffff700 1 -- 172.21.15.154:0/850022884 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f957801d070 con 0x7f95880ffe20 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.422+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95881978b0 con 0x7f95880ffe20 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.422+0000 7f956ffff700 1 -- 172.21.15.154:0/850022884 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f957800be10 con 0x7f95880ffe20 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.422+0000 7f956ffff700 1 -- 172.21.15.154:0/850022884 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f957800f460 con 0x7f95880ffe20 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.422+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9588197d50 con 0x7f95880ffe20 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.423+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95881910b0 con 0x7f95880ffe20 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.423+0000 7f956ffff700 1 -- 172.21.15.154:0/850022884 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f95780227e0 con 0x7f95880ffe20 2024-05-06T21:18:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.423+0000 7f956ffff700 1 --2- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f95700384e0 0x7f957003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.423+0000 7f956ffff700 1 -- 172.21.15.154:0/850022884 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f957804c2d0 con 0x7f95880ffe20 2024-05-06T21:18:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.423+0000 7f95867fc700 1 -- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f95700384e0 msgr2=0x7f957003a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2414450865 2024-05-06T21:18:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.423+0000 7f95867fc700 1 --2- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f95700384e0 0x7f957003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T21:18:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.430+0000 7f956ffff700 1 -- 172.21.15.154:0/850022884 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f957802b590 con 0x7f95880ffe20 2024-05-06T21:18:55.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.624+0000 7f95867fc700 1 -- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f95700384e0 msgr2=0x7f957003a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.32:6800/2414450865 2024-05-06T21:18:55.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.624+0000 7f95867fc700 1 --2- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f95700384e0 0x7f957003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-06T21:18:55.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.694+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f958802cc30 con 0x7f95880ffe20 2024-05-06T21:18:55.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.694+0000 7f956ffff700 1 -- 172.21.15.154:0/850022884 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f9578027030 con 0x7f95880ffe20 2024-05-06T21:18:55.697 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:55.697 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:55.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f95700384e0 msgr2=0x7f957003a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T21:18:55.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 --2- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f95700384e0 0x7f957003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:55.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 msgr2=0x7f9588197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:55.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 --2- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 0x7f9588197170 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9578005b40 tx=0x7f9578004740 comp rx=0 tx=0).stop 2024-05-06T21:18:55.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 shutdown_connections 2024-05-06T21:18:55.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 --2- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:6800/2414450865,v1:172.21.15.32:6801/2414450865] conn(0x7f95700384e0 0x7f957003a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:55.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 --2- 172.21.15.154:0/850022884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95880ffe20 0x7f9588197170 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:55.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 >> 172.21.15.154:0/850022884 conn(0x7f95880fb3d0 msgr2=0x7f95880fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:55.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 shutdown_connections 2024-05-06T21:18:55.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:55.697+0000 7f958d647700 1 -- 172.21.15.154:0/850022884 wait complete. 2024-05-06T21:18:55.700 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:55.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:55 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/850022884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:18:57.318 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:18:57.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:18:57.517 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:57.567 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: Active manager daemon smithi032.ecoohh restarted 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: Activating manager daemon smithi032.ecoohh 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: osdmap e5: 0 total, 0 up, 0 in 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: mgrmap e15: smithi032.ecoohh(active, starting, since 0.00314895s) 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: Manager daemon smithi032.ecoohh is now available 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:18:57.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:18:57.938 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:57.938 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:18:58.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:18:58.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:18:58.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:58.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:58 smithi032 ceph-mon[27179]: mgrmap e16: smithi032.ecoohh(active, since 1.0055s) 2024-05-06T21:18:59.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.113+0000 7f30169c3700 1 -- 172.21.15.154:0/3405963016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 msgr2=0x7f3010102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:59.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.113+0000 7f30169c3700 1 --2- 172.21.15.154:0/3405963016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 0x7f3010102ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3000009910 tx=0x7f3000009c20 comp rx=0 tx=0).stop 2024-05-06T21:18:59.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.113+0000 7f30169c3700 1 -- 172.21.15.154:0/3405963016 shutdown_connections 2024-05-06T21:18:59.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.113+0000 7f30169c3700 1 --2- 172.21.15.154:0/3405963016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 0x7f3010102ca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:59.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.113+0000 7f30169c3700 1 -- 172.21.15.154:0/3405963016 >> 172.21.15.154:0/3405963016 conn(0x7f30100fa2c0 msgr2=0x7f30100fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:59.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.113+0000 7f30169c3700 1 -- 172.21.15.154:0/3405963016 shutdown_connections 2024-05-06T21:18:59.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.113+0000 7f30169c3700 1 -- 172.21.15.154:0/3405963016 wait complete. 2024-05-06T21:18:59.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.114+0000 7f30169c3700 1 Processor -- start 2024-05-06T21:18:59.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.114+0000 7f30169c3700 1 -- start start 2024-05-06T21:18:59.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.114+0000 7f30169c3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 0x7f3010100220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:59.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.114+0000 7f30169c3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010100760 con 0x7f30101008c0 2024-05-06T21:18:59.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.114+0000 7f300ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 0x7f3010100220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:59.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.114+0000 7f300ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 0x7f3010100220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:48632/0 (socket says 172.21.15.154:48632) 2024-05-06T21:18:59.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.114+0000 7f300ffff700 1 -- 172.21.15.154:0/2242412170 learned_addr learned my addr 172.21.15.154:0/2242412170 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:18:59.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.115+0000 7f300ffff700 1 -- 172.21.15.154:0/2242412170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000095f0 con 0x7f30101008c0 2024-05-06T21:18:59.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.115+0000 7f300ffff700 1 --2- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 0x7f3010100220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3000005b40 tx=0x7f3000004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:59.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.115+0000 7f300d7fa700 1 -- 172.21.15.154:0/2242412170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f300001d070 con 0x7f30101008c0 2024-05-06T21:18:59.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.115+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30100fe870 con 0x7f30101008c0 2024-05-06T21:18:59.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.115+0000 7f300d7fa700 1 -- 172.21.15.154:0/2242412170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f300000be10 con 0x7f30101008c0 2024-05-06T21:18:59.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.115+0000 7f300d7fa700 1 -- 172.21.15.154:0/2242412170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f300000f460 con 0x7f30101008c0 2024-05-06T21:18:59.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.115+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30100fed10 con 0x7f30101008c0 2024-05-06T21:18:59.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.116+0000 7f300d7fa700 1 -- 172.21.15.154:0/2242412170 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 45005+0+0 (secure 0 0 0) 0x7f300000b960 con 0x7f30101008c0 2024-05-06T21:18:59.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.116+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3010062380 con 0x7f30101008c0 2024-05-06T21:18:59.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.116+0000 7f300d7fa700 1 --2- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f2ff8038340 0x7f2ff803a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:18:59.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.116+0000 7f300d7fa700 1 -- 172.21.15.154:0/2242412170 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f300004c320 con 0x7f30101008c0 2024-05-06T21:18:59.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.116+0000 7f300f7fe700 1 --2- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f2ff8038340 0x7f2ff803a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:18:59.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.117+0000 7f300f7fe700 1 --2- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f2ff8038340 0x7f2ff803a7f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3004006fd0 tx=0x7f3004006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:18:59.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.121+0000 7f300d7fa700 1 -- 172.21.15.154:0/2242412170 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f300002bba0 con 0x7f30101008c0 2024-05-06T21:18:59.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.399+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f301018e4f0 con 0x7f30101008c0 2024-05-06T21:18:59.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.400+0000 7f300d7fa700 1 -- 172.21.15.154:0/2242412170 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f3000027030 con 0x7f30101008c0 2024-05-06T21:18:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:18:59.403 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f2ff8038340 msgr2=0x7f2ff803a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 --2- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f2ff8038340 0x7f2ff803a7f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3004006fd0 tx=0x7f3004006e40 comp rx=0 tx=0).stop 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 msgr2=0x7f3010100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 --2- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 0x7f3010100220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3000005b40 tx=0x7f3000004740 comp rx=0 tx=0).stop 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 shutdown_connections 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 --2- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f2ff8038340 0x7f2ff803a7f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 --2- 172.21.15.154:0/2242412170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30101008c0 0x7f3010100220 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 >> 172.21.15.154:0/2242412170 conn(0x7f30100fa2c0 msgr2=0x7f30100faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 shutdown_connections 2024-05-06T21:18:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:18:59.402+0000 7f30169c3700 1 -- 172.21.15.154:0/2242412170 wait complete. 2024-05-06T21:18:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:18:59.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:59 smithi032 ceph-mon[27179]: [06/May/2024:21:18:58] ENGINE Bus STARTING 2024-05-06T21:18:59.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:59 smithi032 ceph-mon[27179]: [06/May/2024:21:18:58] ENGINE Serving on https://172.21.15.32:7150 2024-05-06T21:18:59.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:59 smithi032 ceph-mon[27179]: [06/May/2024:21:18:58] ENGINE Serving on http://172.21.15.32:8765 2024-05-06T21:18:59.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:59 smithi032 ceph-mon[27179]: [06/May/2024:21:18:58] ENGINE Bus STARTED 2024-05-06T21:18:59.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:59 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:18:59.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:18:59 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/2242412170' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:19:00.949 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:00 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:00.949 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:00 smithi032 ceph-mon[27179]: mgrmap e17: smithi032.ecoohh(active, since 2s) 2024-05-06T21:19:01.000 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:19:01.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:19:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:19:01.440 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-06T21:19:03.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd/host:smithi032", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:03.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:19:03.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.484+0000 7f4c24854700 1 -- 172.21.15.154:0/676767541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 msgr2=0x7f4c20102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:03.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.484+0000 7f4c24854700 1 --2- 172.21.15.154:0/676767541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 0x7f4c20102d20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009910 tx=0x7f4c10009c20 comp rx=0 tx=0).stop 2024-05-06T21:19:03.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.484+0000 7f4c24854700 1 -- 172.21.15.154:0/676767541 shutdown_connections 2024-05-06T21:19:03.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.484+0000 7f4c24854700 1 --2- 172.21.15.154:0/676767541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 0x7f4c20102d20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.484+0000 7f4c24854700 1 -- 172.21.15.154:0/676767541 >> 172.21.15.154:0/676767541 conn(0x7f4c200fa2c0 msgr2=0x7f4c200fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.484+0000 7f4c24854700 1 -- 172.21.15.154:0/676767541 shutdown_connections 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.484+0000 7f4c24854700 1 -- 172.21.15.154:0/676767541 wait complete. 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.485+0000 7f4c24854700 1 Processor -- start 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.485+0000 7f4c24854700 1 -- start start 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.485+0000 7f4c24854700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 0x7f4c201002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.485+0000 7f4c24854700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c201007e0 con 0x7f4c20100940 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.485+0000 7f4c1e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 0x7f4c201002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.485+0000 7f4c1e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 0x7f4c201002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:39744/0 (socket says 172.21.15.154:39744) 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.485+0000 7f4c1e59c700 1 -- 172.21.15.154:0/2866490008 learned_addr learned my addr 172.21.15.154:0/2866490008 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.485+0000 7f4c1e59c700 1 -- 172.21.15.154:0/2866490008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100095f0 con 0x7f4c20100940 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.486+0000 7f4c1e59c700 1 --2- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 0x7f4c201002a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4c10005b40 tx=0x7f4c10004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.486+0000 7f4c0f7fe700 1 -- 172.21.15.154:0/2866490008 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c1001d070 con 0x7f4c20100940 2024-05-06T21:19:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.486+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c200fe8f0 con 0x7f4c20100940 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.486+0000 7f4c0f7fe700 1 -- 172.21.15.154:0/2866490008 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c1000be10 con 0x7f4c20100940 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.486+0000 7f4c0f7fe700 1 -- 172.21.15.154:0/2866490008 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c1000f460 con 0x7f4c20100940 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.486+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c200fed90 con 0x7f4c20100940 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.487+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c20062380 con 0x7f4c20100940 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.487+0000 7f4c0f7fe700 1 -- 172.21.15.154:0/2866490008 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f4c1000b960 con 0x7f4c20100940 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.487+0000 7f4c0f7fe700 1 --2- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f4c08038580 0x7f4c0803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.487+0000 7f4c0f7fe700 1 -- 172.21.15.154:0/2866490008 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4c1004c6b0 con 0x7f4c20100940 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.487+0000 7f4c1dd9b700 1 --2- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f4c08038580 0x7f4c0803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.488+0000 7f4c1dd9b700 1 --2- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f4c08038580 0x7f4c0803aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c14006fd0 tx=0x7f4c14006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.492+0000 7f4c0f7fe700 1 -- 172.21.15.154:0/2866490008 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4c1002a360 con 0x7f4c20100940 2024-05-06T21:19:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.777+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4c2018e4f0 con 0x7f4c20100940 2024-05-06T21:19:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.778+0000 7f4c0f7fe700 1 -- 172.21.15.154:0/2866490008 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f4c10027070 con 0x7f4c20100940 2024-05-06T21:19:03.781 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:19:03.781 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:19:03.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f4c08038580 msgr2=0x7f4c0803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 --2- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f4c08038580 0x7f4c0803aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c14006fd0 tx=0x7f4c14006e40 comp rx=0 tx=0).stop 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 msgr2=0x7f4c201002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 --2- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 0x7f4c201002a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4c10005b40 tx=0x7f4c10004740 comp rx=0 tx=0).stop 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 shutdown_connections 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 --2- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f4c08038580 0x7f4c0803aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 --2- 172.21.15.154:0/2866490008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c20100940 0x7f4c201002a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 >> 172.21.15.154:0/2866490008 conn(0x7f4c200fa2c0 msgr2=0x7f4c200faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 shutdown_connections 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:03.780+0000 7f4c24854700 1 -- 172.21.15.154:0/2866490008 wait complete. 2024-05-06T21:19:03.783 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:19:04.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:04 smithi032 ceph-mon[27179]: Updating smithi032:/etc/ceph/ceph.conf 2024-05-06T21:19:04.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:04 smithi032 ceph-mon[27179]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-06T21:19:04.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:04 smithi032 ceph-mon[27179]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:04.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:04 smithi032 ceph-mon[27179]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:04.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:04 smithi032 ceph-mon[27179]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:19:04.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:04 smithi032 ceph-mon[27179]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:19:04.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:04 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/2866490008' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:19:05.427 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:19:05.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:19:05.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:19:05.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:19:05.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:05.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:05.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:05.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:05.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:05.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:19:05.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-05-06T21:19:05.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:05.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:05 smithi032 ceph-mon[27179]: Deploying daemon ceph-exporter.smithi154 on smithi154 2024-05-06T21:19:05.683 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:07.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.297+0000 7fa4e95b1700 1 -- 172.21.15.154:0/4025147193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 msgr2=0x7fa4e40ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:07.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.297+0000 7fa4e95b1700 1 --2- 172.21.15.154:0/4025147193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 0x7fa4e40ff060 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009910 tx=0x7fa4d4009c20 comp rx=0 tx=0).stop 2024-05-06T21:19:07.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.297+0000 7fa4e95b1700 1 -- 172.21.15.154:0/4025147193 shutdown_connections 2024-05-06T21:19:07.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.297+0000 7fa4e95b1700 1 --2- 172.21.15.154:0/4025147193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 0x7fa4e40ff060 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:07.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.297+0000 7fa4e95b1700 1 -- 172.21.15.154:0/4025147193 >> 172.21.15.154:0/4025147193 conn(0x7fa4e4074af0 msgr2=0x7fa4e4074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:07.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.297+0000 7fa4e95b1700 1 -- 172.21.15.154:0/4025147193 shutdown_connections 2024-05-06T21:19:07.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.297+0000 7fa4e95b1700 1 -- 172.21.15.154:0/4025147193 wait complete. 2024-05-06T21:19:07.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.297+0000 7fa4e95b1700 1 Processor -- start 2024-05-06T21:19:07.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.298+0000 7fa4e95b1700 1 -- start start 2024-05-06T21:19:07.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.298+0000 7fa4e95b1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 0x7fa4e4197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:07.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.298+0000 7fa4e95b1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e4197ad0 con 0x7fa4e40fec90 2024-05-06T21:19:07.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.298+0000 7fa4e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 0x7fa4e4197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:07.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.298+0000 7fa4e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 0x7fa4e4197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:39776/0 (socket says 172.21.15.154:39776) 2024-05-06T21:19:07.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.298+0000 7fa4e2ffd700 1 -- 172.21.15.154:0/1996772442 learned_addr learned my addr 172.21.15.154:0/1996772442 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:19:07.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.299+0000 7fa4e2ffd700 1 -- 172.21.15.154:0/1996772442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40095f0 con 0x7fa4e40fec90 2024-05-06T21:19:07.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.299+0000 7fa4e2ffd700 1 --2- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 0x7fa4e4197590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40092e0 tx=0x7fa4d4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:07.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.299+0000 7fa4e0ff9700 1 -- 172.21.15.154:0/1996772442 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4d401d070 con 0x7fa4e40fec90 2024-05-06T21:19:07.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.299+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e4197cd0 con 0x7fa4e40fec90 2024-05-06T21:19:07.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.299+0000 7fa4e0ff9700 1 -- 172.21.15.154:0/1996772442 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4d400be10 con 0x7fa4e40fec90 2024-05-06T21:19:07.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.299+0000 7fa4e0ff9700 1 -- 172.21.15.154:0/1996772442 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4d4022e10 con 0x7fa4e40fec90 2024-05-06T21:19:07.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.299+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e41980f0 con 0x7fa4e40fec90 2024-05-06T21:19:07.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.300+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e4062380 con 0x7fa4e40fec90 2024-05-06T21:19:07.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.300+0000 7fa4e0ff9700 1 -- 172.21.15.154:0/1996772442 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fa4d400b960 con 0x7fa4e40fec90 2024-05-06T21:19:07.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.301+0000 7fa4e0ff9700 1 --2- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa4d0038530 0x7fa4d003a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:07.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.301+0000 7fa4e0ff9700 1 -- 172.21.15.154:0/1996772442 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa4d404c480 con 0x7fa4e40fec90 2024-05-06T21:19:07.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.301+0000 7fa4da7fc700 1 --2- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa4d0038530 0x7fa4d003a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:07.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.302+0000 7fa4da7fc700 1 --2- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa4d0038530 0x7fa4d003a9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc006fd0 tx=0x7fa4cc006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:07.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.306+0000 7fa4e0ff9700 1 -- 172.21.15.154:0/1996772442 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa4d402a540 con 0x7fa4e40fec90 2024-05-06T21:19:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.592+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa4e4109550 con 0x7fa4e40fec90 2024-05-06T21:19:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:19:07.596 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:19:07.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.592+0000 7fa4e0ff9700 1 -- 172.21.15.154:0/1996772442 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa4d4027030 con 0x7fa4e40fec90 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa4d0038530 msgr2=0x7fa4d003a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 --2- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa4d0038530 0x7fa4d003a9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc006fd0 tx=0x7fa4cc006e40 comp rx=0 tx=0).stop 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 msgr2=0x7fa4e4197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 --2- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 0x7fa4e4197590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40092e0 tx=0x7fa4d4004c80 comp rx=0 tx=0).stop 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 shutdown_connections 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 --2- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa4d0038530 0x7fa4d003a9e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 --2- 172.21.15.154:0/1996772442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4e40fec90 0x7fa4e4197590 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 >> 172.21.15.154:0/1996772442 conn(0x7fa4e4074af0 msgr2=0x7fa4e40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 shutdown_connections 2024-05-06T21:19:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:07.595+0000 7fa4e95b1700 1 -- 172.21.15.154:0/1996772442 wait complete. 2024-05-06T21:19:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:19:07.950 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:07 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/1996772442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:19:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi154", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:19:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi154", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-06T21:19:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:09.274 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:19:09.274 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:19:09.526 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:09.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:09 smithi032 ceph-mon[27179]: Deploying daemon crash.smithi154 on smithi154 2024-05-06T21:19:11.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.001+0000 7f7578a86700 1 -- 172.21.15.154:0/3014179425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 msgr2=0x7f75740ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.001+0000 7f7578a86700 1 --2- 172.21.15.154:0/3014179425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 0x7f75740ff4b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f756400aa20 tx=0x7f756400ad30 comp rx=0 tx=0).stop 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.001+0000 7f7578a86700 1 -- 172.21.15.154:0/3014179425 shutdown_connections 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.001+0000 7f7578a86700 1 --2- 172.21.15.154:0/3014179425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 0x7f75740ff4b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.001+0000 7f7578a86700 1 -- 172.21.15.154:0/3014179425 >> 172.21.15.154:0/3014179425 conn(0x7f7574075550 msgr2=0x7f7574075950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.002+0000 7f7578a86700 1 -- 172.21.15.154:0/3014179425 shutdown_connections 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.002+0000 7f7578a86700 1 -- 172.21.15.154:0/3014179425 wait complete. 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.002+0000 7f7578a86700 1 Processor -- start 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.002+0000 7f7578a86700 1 -- start start 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.003+0000 7f7578a86700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 0x7f75741931e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.003+0000 7f7578a86700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574193720 con 0x7f75740ff0e0 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.003+0000 7f757259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 0x7f75741931e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.003+0000 7f757259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 0x7f75741931e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:59440/0 (socket says 172.21.15.154:59440) 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.003+0000 7f757259c700 1 -- 172.21.15.154:0/3298368276 learned_addr learned my addr 172.21.15.154:0/3298368276 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:19:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.003+0000 7f757259c700 1 -- 172.21.15.154:0/3298368276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756400a700 con 0x7f75740ff0e0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.003+0000 7f757259c700 1 --2- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 0x7f75741931e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f756400cf80 tx=0x7f7564004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.004+0000 7f756b7fe700 1 -- 172.21.15.154:0/3298368276 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7564005310 con 0x7f75740ff0e0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.004+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574193920 con 0x7f75740ff0e0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.004+0000 7f756b7fe700 1 -- 172.21.15.154:0/3298368276 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7564005470 con 0x7f75740ff0e0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.004+0000 7f756b7fe700 1 -- 172.21.15.154:0/3298368276 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f756400e740 con 0x7f75740ff0e0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.004+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7574193d40 con 0x7f75740ff0e0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.004+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7574062380 con 0x7f75740ff0e0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.005+0000 7f756b7fe700 1 -- 172.21.15.154:0/3298368276 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f7564016470 con 0x7f75740ff0e0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.005+0000 7f756b7fe700 1 --2- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7560038580 0x7f756003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.005+0000 7f756b7fe700 1 -- 172.21.15.154:0/3298368276 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f7564012070 con 0x7f75740ff0e0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.005+0000 7f756bfff700 1 --2- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7560038580 0x7f756003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.005+0000 7f756bfff700 1 --2- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7560038580 0x7f756003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f755c006fd0 tx=0x7f755c006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:11.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.010+0000 7f756b7fe700 1 -- 172.21.15.154:0/3298368276 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7564005c00 con 0x7f75740ff0e0 2024-05-06T21:19:11.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.315+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7574106550 con 0x7f75740ff0e0 2024-05-06T21:19:11.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.316+0000 7f756b7fe700 1 -- 172.21.15.154:0/3298368276 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f7564026070 con 0x7f75740ff0e0 2024-05-06T21:19:11.319 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:19:11.319 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:19:11.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7560038580 msgr2=0x7f756003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:11.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 --2- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7560038580 0x7f756003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f755c006fd0 tx=0x7f755c006e40 comp rx=0 tx=0).stop 2024-05-06T21:19:11.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 msgr2=0x7f75741931e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:11.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 --2- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 0x7f75741931e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f756400cf80 tx=0x7f7564004d10 comp rx=0 tx=0).stop 2024-05-06T21:19:11.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 shutdown_connections 2024-05-06T21:19:11.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 --2- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7560038580 0x7f756003aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:11.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 --2- 172.21.15.154:0/3298368276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75740ff0e0 0x7f75741931e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:11.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 >> 172.21.15.154:0/3298368276 conn(0x7f7574075550 msgr2=0x7f75741029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:11.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 shutdown_connections 2024-05-06T21:19:11.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:11.318+0000 7f7578a86700 1 -- 172.21.15.154:0/3298368276 wait complete. 2024-05-06T21:19:11.322 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:19:11.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:11 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/3298368276' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:19:13.132 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:19:13.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:19:13.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:12 smithi032 ceph-mon[27179]: Deploying daemon node-exporter.smithi154 on smithi154 2024-05-06T21:19:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:13.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:19:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:16.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.209+0000 7f92b2c31700 1 -- 172.21.15.154:0/4035020504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 msgr2=0x7f92ac100360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.209+0000 7f92b2c31700 1 --2- 172.21.15.154:0/4035020504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 0x7f92ac100360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9294009910 tx=0x7f9294009c20 comp rx=0 tx=0).stop 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.209+0000 7f92b2c31700 1 -- 172.21.15.154:0/4035020504 shutdown_connections 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.209+0000 7f92b2c31700 1 --2- 172.21.15.154:0/4035020504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 0x7f92ac100360 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.209+0000 7f92b2c31700 1 -- 172.21.15.154:0/4035020504 >> 172.21.15.154:0/4035020504 conn(0x7f92ac075550 msgr2=0x7f92ac075950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.209+0000 7f92b2c31700 1 -- 172.21.15.154:0/4035020504 shutdown_connections 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.209+0000 7f92b2c31700 1 -- 172.21.15.154:0/4035020504 wait complete. 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.210+0000 7f92b2c31700 1 Processor -- start 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.210+0000 7f92b2c31700 1 -- start start 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.210+0000 7f92b2c31700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 0x7f92ac1952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:16.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.210+0000 7f92b2c31700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac195800 con 0x7f92ac0fff90 2024-05-06T21:19:16.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.210+0000 7f92b09cd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 0x7f92ac1952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:16.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.210+0000 7f92b09cd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 0x7f92ac1952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:59466/0 (socket says 172.21.15.154:59466) 2024-05-06T21:19:16.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.210+0000 7f92b09cd700 1 -- 172.21.15.154:0/4173941091 learned_addr learned my addr 172.21.15.154:0/4173941091 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:19:16.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.211+0000 7f92b09cd700 1 -- 172.21.15.154:0/4173941091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92940095f0 con 0x7f92ac0fff90 2024-05-06T21:19:16.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.211+0000 7f92b09cd700 1 --2- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 0x7f92ac1952c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9294005b40 tx=0x7f9294004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:16.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.211+0000 7f92a9ffb700 1 -- 172.21.15.154:0/4173941091 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f929401d070 con 0x7f92ac0fff90 2024-05-06T21:19:16.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.211+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac195a00 con 0x7f92ac0fff90 2024-05-06T21:19:16.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.211+0000 7f92a9ffb700 1 -- 172.21.15.154:0/4173941091 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92940044d0 con 0x7f92ac0fff90 2024-05-06T21:19:16.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.211+0000 7f92a9ffb700 1 -- 172.21.15.154:0/4173941091 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9294003930 con 0x7f92ac0fff90 2024-05-06T21:19:16.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.211+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac195e40 con 0x7f92ac0fff90 2024-05-06T21:19:16.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.212+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac062380 con 0x7f92ac0fff90 2024-05-06T21:19:16.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.212+0000 7f92a9ffb700 1 -- 172.21.15.154:0/4173941091 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f929400b960 con 0x7f92ac0fff90 2024-05-06T21:19:16.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.212+0000 7f92a9ffb700 1 --2- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9298038580 0x7f929803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:16.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.212+0000 7f92a9ffb700 1 -- 172.21.15.154:0/4173941091 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f929404c4b0 con 0x7f92ac0fff90 2024-05-06T21:19:16.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.213+0000 7f92abfff700 1 --2- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9298038580 0x7f929803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:16.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.213+0000 7f92abfff700 1 --2- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9298038580 0x7f929803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f929c00ad30 tx=0x7f929c0093f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:16.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.218+0000 7f92a9ffb700 1 -- 172.21.15.154:0/4173941091 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f929402a540 con 0x7f92ac0fff90 2024-05-06T21:19:16.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.502+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f92ac196620 con 0x7f92ac0fff90 2024-05-06T21:19:16.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.502+0000 7f92a9ffb700 1 -- 172.21.15.154:0/4173941091 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f929402a360 con 0x7f92ac0fff90 2024-05-06T21:19:16.505 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:19:16.506 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:19:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.504+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9298038580 msgr2=0x7f929803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.504+0000 7f92b2c31700 1 --2- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9298038580 0x7f929803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f929c00ad30 tx=0x7f929c0093f0 comp rx=0 tx=0).stop 2024-05-06T21:19:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.504+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 msgr2=0x7f92ac1952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.504+0000 7f92b2c31700 1 --2- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 0x7f92ac1952c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9294005b40 tx=0x7f9294004c80 comp rx=0 tx=0).stop 2024-05-06T21:19:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.504+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 shutdown_connections 2024-05-06T21:19:16.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.504+0000 7f92b2c31700 1 --2- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9298038580 0x7f929803aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:16.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.504+0000 7f92b2c31700 1 --2- 172.21.15.154:0/4173941091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92ac0fff90 0x7f92ac1952c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:16.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.504+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 >> 172.21.15.154:0/4173941091 conn(0x7f92ac075550 msgr2=0x7f92ac0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:16.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.504+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 shutdown_connections 2024-05-06T21:19:16.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:16.505+0000 7f92b2c31700 1 -- 172.21.15.154:0/4173941091 wait complete. 2024-05-06T21:19:16.508 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:19:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:19:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-06T21:19:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:19:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:17.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: Deploying daemon mgr.smithi154.kilvol on smithi154 2024-05-06T21:19:17.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:16 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/4173941091' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:19:18.412 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:19:18.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:19:18.810 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:18.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:18 smithi032 ceph-mon[27179]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:18.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:18 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:20.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:20.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:20.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:20.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:20.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:19:20.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:20.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:19 smithi032 ceph-mon[27179]: Deploying daemon mon.smithi154 on smithi154 2024-05-06T21:19:20.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:19 smithi032 ceph-mon[27179]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.301+0000 7f8fdee76700 1 -- 172.21.15.154:0/1222010328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 msgr2=0x7f8fd80ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.301+0000 7f8fdee76700 1 --2- 172.21.15.154:0/1222010328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 0x7f8fd80ff390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009910 tx=0x7f8fcc009c20 comp rx=0 tx=0).stop 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.301+0000 7f8fdee76700 1 -- 172.21.15.154:0/1222010328 shutdown_connections 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.301+0000 7f8fdee76700 1 --2- 172.21.15.154:0/1222010328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 0x7f8fd80ff390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.301+0000 7f8fdee76700 1 -- 172.21.15.154:0/1222010328 >> 172.21.15.154:0/1222010328 conn(0x7f8fd8074af0 msgr2=0x7f8fd8074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.301+0000 7f8fdee76700 1 -- 172.21.15.154:0/1222010328 shutdown_connections 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.301+0000 7f8fdee76700 1 -- 172.21.15.154:0/1222010328 wait complete. 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.302+0000 7f8fdee76700 1 Processor -- start 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.302+0000 7f8fdee76700 1 -- start start 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.302+0000 7f8fdee76700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 0x7f8fd8194350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.302+0000 7f8fdee76700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8194890 con 0x7f8fd80fefc0 2024-05-06T21:19:20.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.303+0000 7f8fdcc12700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 0x7f8fd8194350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.303+0000 7f8fdcc12700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 0x7f8fd8194350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:34390/0 (socket says 172.21.15.154:34390) 2024-05-06T21:19:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.303+0000 7f8fdcc12700 1 -- 172.21.15.154:0/76501369 learned_addr learned my addr 172.21.15.154:0/76501369 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:19:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.303+0000 7f8fdcc12700 1 -- 172.21.15.154:0/76501369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0095f0 con 0x7f8fd80fefc0 2024-05-06T21:19:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.303+0000 7f8fdcc12700 1 --2- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 0x7f8fd8194350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc005b40 tx=0x7f8fcc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.303+0000 7f8fd5ffb700 1 -- 172.21.15.154:0/76501369 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fcc01d070 con 0x7f8fd80fefc0 2024-05-06T21:19:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.303+0000 7f8fd5ffb700 1 -- 172.21.15.154:0/76501369 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8fcc0044d0 con 0x7f8fd80fefc0 2024-05-06T21:19:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.303+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd8194a90 con 0x7f8fd80fefc0 2024-05-06T21:19:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.303+0000 7f8fd5ffb700 1 -- 172.21.15.154:0/76501369 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fcc003930 con 0x7f8fd80fefc0 2024-05-06T21:19:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.304+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd8194e50 con 0x7f8fd80fefc0 2024-05-06T21:19:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.304+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd8062380 con 0x7f8fd80fefc0 2024-05-06T21:19:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.304+0000 7f8fd5ffb700 1 -- 172.21.15.154:0/76501369 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f8fcc003bf0 con 0x7f8fd80fefc0 2024-05-06T21:19:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.305+0000 7f8fd5ffb700 1 --2- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f8fc8038580 0x7f8fc803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.305+0000 7f8fd5ffb700 1 -- 172.21.15.154:0/76501369 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f8fcc04c480 con 0x7f8fd80fefc0 2024-05-06T21:19:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.305+0000 7f8fd7fff700 1 --2- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f8fc8038580 0x7f8fc803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.305+0000 7f8fd7fff700 1 --2- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f8fc8038580 0x7f8fc803aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4006fd0 tx=0x7f8fc4006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:20.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.310+0000 7f8fd5ffb700 1 -- 172.21.15.154:0/76501369 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8fcc02a540 con 0x7f8fd80fefc0 2024-05-06T21:19:20.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.591+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8fd8106c50 con 0x7f8fd80fefc0 2024-05-06T21:19:20.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.592+0000 7f8fd5ffb700 1 -- 172.21.15.154:0/76501369 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8fcc02a360 con 0x7f8fd80fefc0 2024-05-06T21:19:20.595 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:19:20.595 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:16:38.421123Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T21:19:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f8fc8038580 msgr2=0x7f8fc803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 --2- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f8fc8038580 0x7f8fc803aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4006fd0 tx=0x7f8fc4006e40 comp rx=0 tx=0).stop 2024-05-06T21:19:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 msgr2=0x7f8fd8194350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 --2- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 0x7f8fd8194350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc005b40 tx=0x7f8fcc004c80 comp rx=0 tx=0).stop 2024-05-06T21:19:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 shutdown_connections 2024-05-06T21:19:20.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 --2- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f8fc8038580 0x7f8fc803aa30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:20.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 --2- 172.21.15.154:0/76501369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fd80fefc0 0x7f8fd8194350 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:20.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 >> 172.21.15.154:0/76501369 conn(0x7f8fd8074af0 msgr2=0x7f8fd81031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:20.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 shutdown_connections 2024-05-06T21:19:20.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:20.594+0000 7f8fdee76700 1 -- 172.21.15.154:0/76501369 wait complete. 2024-05-06T21:19:20.598 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-06T21:19:21.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:20 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/76501369' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:19:22.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:21 smithi032 ceph-mon[27179]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:22.810 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:22 smithi154 systemd[1]: Starting Ceph mon.smithi154 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:19:23.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 podman[32857]: 2024-05-06 21:19:22.913524836 +0000 UTC m=+0.019817452 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007 2024-05-06T21:19:23.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 podman[32857]: 2024-05-06 21:19:23.025050042 +0000 UTC m=+0.131342643 container create 8a37ef7f53f908f8bf98f76bf238a5723421c86071a2f43d7be5fb93ed3602ac (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, RELEASE=HEAD, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-06T21:19:23.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 podman[32857]: 2024-05-06 21:19:23.235804953 +0000 UTC m=+0.342097565 container init 8a37ef7f53f908f8bf98f76bf238a5723421c86071a2f43d7be5fb93ed3602ac (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0) 2024-05-06T21:19:23.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 podman[32857]: 2024-05-06 21:19:23.239771791 +0000 UTC m=+0.346064392 container start 8a37ef7f53f908f8bf98f76bf238a5723421c86071a2f43d7be5fb93ed3602ac (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0) 2024-05-06T21:19:23.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T21:19:23.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-05-06T21:19:23.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: pidfile_write: ignore empty --pid-file 2024-05-06T21:19:23.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: load: jerasure load: lrc 2024-05-06T21:19:23.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: RocksDB version: 7.9.2 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Git sha 0 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Compile date 2023-08-03 19:21:13 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: DB SUMMARY 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: DB Session ID: HO347P2QJ1SDXHNCJS44 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: CURRENT file: CURRENT 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi154/store.db dir, Total Num: 0, files: 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi154/store.db: 000004.log size: 511 ; 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.error_if_exists: 0 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.create_if_missing: 0 2024-05-06T21:19:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.paranoid_checks: 1 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.env: 0x55e93c68f720 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.info_log: 0x55e93eebf2c0 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.statistics: (nil) 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.use_fsync: 0 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_log_file_size: 0 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T21:19:23.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.allow_fallocate: 1 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.use_direct_reads: 0 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.db_log_dir: 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.wal_dir: 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T21:19:23.624 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.write_buffer_manager: 0x55e93e1303c0 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.unordered_write: 0 2024-05-06T21:19:23.625 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T21:19:23.626 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T21:19:23.626 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T21:19:23.626 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T21:19:23.626 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.row_cache: None 2024-05-06T21:19:23.626 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.wal_filter: None 2024-05-06T21:19:23.626 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T21:19:23.627 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T21:19:23.627 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.two_write_queues: 0 2024-05-06T21:19:23.627 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T21:19:23.627 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.wal_compression: 0 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.atomic_flush: 0 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.log_readahead_size: 0 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T21:19:23.628 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_background_jobs: 2 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_background_compactions: -1 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_subcompactions: 1 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_open_files: -1 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T21:19:23.629 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_background_flushes: -1 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Compression algorithms supported: 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: kZSTD supported: 0 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: kXpressCompression supported: 0 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: kZlibCompression supported: 1 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: kSnappyCompression supported: 1 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: kLZ4Compression supported: 1 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: kBZip2Compression supported: 0 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T21:19:23.630 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi154/store.db/MANIFEST-000005 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.merge_operator: 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_filter: None 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e93eebf3c0) 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: cache_index_and_filter_blocks: 1 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: pin_top_level_index_and_filter: 1 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: index_type: 0 2024-05-06T21:19:23.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: data_block_index_type: 0 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: index_shortening: 1 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: checksum: 4 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: no_block_cache: 0 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_cache: 0x55e93e1d11f0 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_cache_name: BinnedLRUCache 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_cache_options: 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: capacity : 536870912 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: num_shard_bits : 4 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: strict_capacity_limit : 0 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: high_pri_pool_ratio: 0.000 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_cache_compressed: (nil) 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: persistent_cache: (nil) 2024-05-06T21:19:23.632 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_size: 4096 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_size_deviation: 10 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_restart_interval: 16 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: index_block_restart_interval: 1 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: metadata_block_size: 4096 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: partition_filters: 0 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: use_delta_encoding: 1 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: filter_policy: bloomfilter 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: whole_key_filtering: 1 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: verify_compression: 0 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: read_amp_bytes_per_bit: 0 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: format_version: 5 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: enable_index_compression: 1 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_align: 0 2024-05-06T21:19:23.633 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: max_auto_readahead_size: 262144 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: prepopulate_block_cache: 0 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: initial_auto_readahead_size: 8192 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression: NoCompression 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.num_levels: 7 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T21:19:23.634 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T21:19:23.635 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T21:19:23.636 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T21:19:23.637 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.table_properties_collectors: 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.inplace_update_support: 0 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T21:19:23.638 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.bloom_locality: 0 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.max_successive_merges: 0 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.ttl: 2592000 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.enable_blob_files: false 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.min_blob_size: 0 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T21:19:23.639 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi154/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9c3f6e81-7f76-418c-8040-903bef5d9c86 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030363268498, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030363268931, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715030363, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9c3f6e81-7f76-418c-8040-903bef5d9c86", "db_session_id": "HO347P2QJ1SDXHNCJS44", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030363269018, "job": 1, "event": "recovery_finished"} 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-06T21:19:23.640 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi154/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e93e26e000 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: DB pointer 0x55e93e25a000 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ** DB Stats ** 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:19:23.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ** Compaction Stats [default] ** 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ** Compaction Stats [default] ** 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:19:23.642 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Block cache BinnedLRUCache@0x55e93e1d11f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154 does not exist in monmap, will attempt to join an existing cluster 2024-05-06T21:19:23.643 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: using public_addr v2:172.21.15.154:0/0 -> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: starting mon.smithi154 rank -1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi154 fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(???) e0 preinit fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).mds e1 new map 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).mds e1 print_map 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: e1 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: legacy client fscid: -1 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: No filesystems configured 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-06T21:19:23.644 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: Deploying daemon mon.smithi154 on smithi154 2024-05-06T21:19:23.645 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: from='client.? 172.21.15.154:0/76501369' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta expand map: {default=false} 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta from 'false' to 'false' 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta expanded map: {default=false} 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta expand map: {default=info} 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta from 'info' to 'info' 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta expanded map: {default=info} 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta expand map: {default=daemon} 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta from 'daemon' to 'daemon' 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta expanded map: {default=daemon} 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta expand map: {default=debug} 2024-05-06T21:19:23.646 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta from 'debug' to 'debug' 2024-05-06T21:19:23.647 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: expand_channel_meta expanded map: {default=debug} 2024-05-06T21:19:23.647 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 ceph-mon[32880]: mon.smithi154@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-05-06T21:19:23.647 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 bash[32857]: 8a37ef7f53f908f8bf98f76bf238a5723421c86071a2f43d7be5fb93ed3602ac 2024-05-06T21:19:23.647 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:23 smithi154 systemd[1]: Started Ceph mon.smithi154 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:19:23.846 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-06T21:19:23.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T21:19:24.060 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi154/config 2024-05-06T21:19:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:19:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: mon.smithi032 calling monitor election 2024-05-06T21:19:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: mon.smithi154 calling monitor election 2024-05-06T21:19:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/1212212565' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:19:28.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:28.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:28.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:19:28.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: mon.smithi032 is new leader, mons smithi032,smithi154 in quorum (ranks 0,1) 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: monmap e2: 2 mons at {smithi032=[v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0],smithi154=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: fsmap 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: osdmap e5: 0 total, 0 up, 0 in 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: mgrmap e17: smithi032.ecoohh(active, since 30s) 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/1212212565' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: overall HEALTH_OK 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/1212212565' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/1212212565' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:19:28.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.624+0000 7fb62681b700 1 -- 172.21.15.154:0/3570335626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 msgr2=0x7fb60c005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.624+0000 7fb62681b700 1 --2- 172.21.15.154:0/3570335626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 0x7fb60c005a40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb6200ffea0 tx=0x7fb61000feb0 comp rx=0 tx=0).stop 2024-05-06T21:19:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.625+0000 7fb62681b700 1 -- 172.21.15.154:0/3570335626 shutdown_connections 2024-05-06T21:19:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.625+0000 7fb62681b700 1 --2- 172.21.15.154:0/3570335626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 0x7fb60c005a40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.625+0000 7fb62681b700 1 -- 172.21.15.154:0/3570335626 >> 172.21.15.154:0/3570335626 conn(0x7fb6200fba50 msgr2=0x7fb6200fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.625+0000 7fb62681b700 1 -- 172.21.15.154:0/3570335626 shutdown_connections 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.625+0000 7fb62681b700 1 -- 172.21.15.154:0/3570335626 wait complete. 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.625+0000 7fb62681b700 1 Processor -- start 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb62681b700 1 -- start start 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb62681b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 0x7fb620195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb62681b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620195b40 0x7fb620199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb62681b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb620196150 con 0x7fb60c0035c0 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb62681b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6201962c0 con 0x7fb620195b40 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb61ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 0x7fb620195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb617fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620195b40 0x7fb620199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb61ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 0x7fb620195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.154:34450/0 (socket says 172.21.15.154:34450) 2024-05-06T21:19:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb61ffff700 1 -- 172.21.15.154:0/2015307108 learned_addr learned my addr 172.21.15.154:0/2015307108 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:19:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb617fff700 1 -- 172.21.15.154:0/2015307108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620195b40 msgr2=0x7fb620199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-06T21:19:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb617fff700 1 -- 172.21.15.154:0/2015307108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620195b40 msgr2=0x7fb620199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T21:19:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb617fff700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620195b40 0x7fb620199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-06T21:19:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb617fff700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620195b40 0x7fb620199fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T21:19:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb61ffff700 1 -- 172.21.15.154:0/2015307108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620195b40 msgr2=0x7fb620199fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T21:19:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb61ffff700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620195b40 0x7fb620199fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb61ffff700 1 -- 172.21.15.154:0/2015307108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61000f900 con 0x7fb60c0035c0 2024-05-06T21:19:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.626+0000 7fb61ffff700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 0x7fb620195600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb610001eb0 tx=0x7fb610011590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.627+0000 7fb61dffb700 1 -- 172.21.15.154:0/2015307108 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb610013b30 con 0x7fb60c0035c0 2024-05-06T21:19:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.627+0000 7fb61dffb700 1 -- 172.21.15.154:0/2015307108 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb6100044e0 con 0x7fb60c0035c0 2024-05-06T21:19:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.627+0000 7fb61dffb700 1 -- 172.21.15.154:0/2015307108 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb610011d30 con 0x7fb60c0035c0 2024-05-06T21:19:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.627+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62019a5b0 con 0x7fb60c0035c0 2024-05-06T21:19:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.627+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62019ab00 con 0x7fb60c0035c0 2024-05-06T21:19:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.628+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb620062380 con 0x7fb60c0035c0 2024-05-06T21:19:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.628+0000 7fb61dffb700 1 -- 172.21.15.154:0/2015307108 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fb610004030 con 0x7fb60c0035c0 2024-05-06T21:19:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.629+0000 7fb61dffb700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb60006c750 0x7fb60006ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.629+0000 7fb61dffb700 1 -- 172.21.15.154:0/2015307108 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb610000e40 con 0x7fb60c0035c0 2024-05-06T21:19:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.629+0000 7fb617fff700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb60006c750 0x7fb60006ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.630+0000 7fb617fff700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb60006c750 0x7fb60006ec00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb608009850 tx=0x7fb608008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.634+0000 7fb61dffb700 1 -- 172.21.15.154:0/2015307108 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb610058ed0 con 0x7fb60c0035c0 2024-05-06T21:19:28.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:19:28.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: mon.smithi032 calling monitor election 2024-05-06T21:19:28.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:28.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: mon.smithi154 calling monitor election 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/1212212565' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: mon.smithi032 is new leader, mons smithi032,smithi154 in quorum (ranks 0,1) 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: monmap e2: 2 mons at {smithi032=[v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0],smithi154=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: fsmap 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: osdmap e5: 0 total, 0 up, 0 in 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: mgrmap e17: smithi032.ecoohh(active, since 30s) 2024-05-06T21:19:28.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:19:28.728 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/1212212565' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:19:28.728 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: overall HEALTH_OK 2024-05-06T21:19:28.728 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/1212212565' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:19:28.728 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:28.728 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/1212212565' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:19:28.728 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:28.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.924+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb62019ad70 con 0x7fb60c0035c0 2024-05-06T21:19:28.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.924+0000 7fb61dffb700 1 -- 172.21.15.154:0/2015307108 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7fb61005c4f0 con 0x7fb60c0035c0 2024-05-06T21:19:28.927 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-06T21:19:28.927 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","modified":"2024-05-06T21:19:23.294060Z","created":"2024-05-06T21:16:38.421123Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi032","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi154","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb60006c750 msgr2=0x7fb60006ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb60006c750 0x7fb60006ec00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb608009850 tx=0x7fb608008040 comp rx=0 tx=0).stop 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 msgr2=0x7fb620195600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 0x7fb620195600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb610001eb0 tx=0x7fb610011590 comp rx=0 tx=0).stop 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 shutdown_connections 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb60006c750 0x7fb60006ec00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb60c0035c0 0x7fb620195600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 --2- 172.21.15.154:0/2015307108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620195b40 0x7fb620199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 >> 172.21.15.154:0/2015307108 conn(0x7fb6200fba50 msgr2=0x7fb62018d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 shutdown_connections 2024-05-06T21:19:28.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:19:28.927+0000 7fb62681b700 1 -- 172.21.15.154:0/2015307108 wait complete. 2024-05-06T21:19:28.931 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 2 2024-05-06T21:19:29.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:29 smithi154 ceph-mon[32880]: mgrmap e18: smithi032.ecoohh(active, since 30s), standbys: smithi154.kilvol 2024-05-06T21:19:29.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:29 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi154.kilvol", "id": "smithi154.kilvol"}]: dispatch 2024-05-06T21:19:29.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:29 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:29.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:29 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:29.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:29 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:29.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:29 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:19:29.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:29 smithi154 ceph-mon[32880]: from='client.? 172.21.15.154:0/2015307108' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:19:29.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:29 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:29.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:29 smithi032 ceph-mon[27179]: mgrmap e18: smithi032.ecoohh(active, since 30s), standbys: smithi154.kilvol 2024-05-06T21:19:29.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:29 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi154.kilvol", "id": "smithi154.kilvol"}]: dispatch 2024-05-06T21:19:29.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:29 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:29.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:29 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:29.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:29 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:29.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:29 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:19:29.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:29 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/2015307108' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T21:19:29.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:29 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:19:30.116 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-06T21:19:30.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-06T21:19:30.442 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:19:30.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:30 smithi032 ceph-mon[27179]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:30.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:30 smithi154 ceph-mon[32880]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:32.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:32.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:19:32.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: Updating smithi032:/etc/ceph/ceph.conf 2024-05-06T21:19:32.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: Reconfiguring mon.smithi032 (unknown last config time)... 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:32.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:31 smithi032 ceph-mon[27179]: Reconfiguring daemon mon.smithi032 on smithi032 2024-05-06T21:19:32.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.243+0000 7fe2273cf700 1 -- 172.21.15.32:0/2906186534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200fefc0 msgr2=0x7fe2200ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:32.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.243+0000 7fe2273cf700 1 --2- 172.21.15.32:0/2906186534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200fefc0 0x7fe2200ff390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00b0a0 tx=0x7fe21c00b3b0 comp rx=0 tx=0).stop 2024-05-06T21:19:32.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.243+0000 7fe2273cf700 1 -- 172.21.15.32:0/2906186534 shutdown_connections 2024-05-06T21:19:32.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.243+0000 7fe2273cf700 1 --2- 172.21.15.32:0/2906186534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200fefc0 0x7fe2200ff390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:32.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.243+0000 7fe2273cf700 1 -- 172.21.15.32:0/2906186534 >> 172.21.15.32:0/2906186534 conn(0x7fe220074af0 msgr2=0x7fe220074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.243+0000 7fe2273cf700 1 -- 172.21.15.32:0/2906186534 shutdown_connections 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.243+0000 7fe2273cf700 1 -- 172.21.15.32:0/2906186534 wait complete. 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.244+0000 7fe2273cf700 1 Processor -- start 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.244+0000 7fe2273cf700 1 -- start start 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.244+0000 7fe2273cf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200fefc0 0x7fe220194380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.244+0000 7fe2273cf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2201948c0 0x7fe220198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.244+0000 7fe2273cf700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220194ed0 con 0x7fe2201948c0 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.244+0000 7fe2273cf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220195040 con 0x7fe2200fefc0 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.244+0000 7fe22496a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2201948c0 0x7fe220198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.244+0000 7fe22496a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2201948c0 0x7fe220198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52154/0 (socket says 172.21.15.32:52154) 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.244+0000 7fe22496a700 1 -- 172.21.15.32:0/2346554600 learned_addr learned my addr 172.21.15.32:0/2346554600 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.245+0000 7fe22496a700 1 -- 172.21.15.32:0/2346554600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200fefc0 msgr2=0x7fe220194380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:32.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.245+0000 7fe22496a700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200fefc0 0x7fe220194380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.245+0000 7fe22496a700 1 -- 172.21.15.32:0/2346554600 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c009d00 con 0x7fe2201948c0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.245+0000 7fe22496a700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2201948c0 0x7fe220198d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe21000da80 tx=0x7fe21000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.245+0000 7fe2167fc700 1 -- 172.21.15.32:0/2346554600 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21000eca0 con 0x7fe2201948c0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.245+0000 7fe2167fc700 1 -- 172.21.15.32:0/2346554600 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe21000ee00 con 0x7fe2201948c0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.245+0000 7fe2167fc700 1 -- 172.21.15.32:0/2346554600 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2100148a0 con 0x7fe2201948c0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.245+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe220199330 con 0x7fe2201948c0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.245+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe220199880 con 0x7fe2201948c0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.246+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe220199b60 con 0x7fe2201948c0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.246+0000 7fe2167fc700 1 -- 172.21.15.32:0/2346554600 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fe210014a00 con 0x7fe2201948c0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.247+0000 7fe2167fc700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c760 0x7fe20c06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.247+0000 7fe22516b700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c760 0x7fe20c06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.247+0000 7fe2167fc700 1 -- 172.21.15.32:0/2346554600 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe21008c180 con 0x7fe2201948c0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.247+0000 7fe22516b700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c760 0x7fe20c06ec10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009480 tx=0x7fe21c00b7b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:32.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.252+0000 7fe2167fc700 1 -- 172.21.15.32:0/2346554600 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe210050720 con 0x7fe2201948c0 2024-05-06T21:19:32.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: Updating smithi032:/etc/ceph/ceph.conf 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:32.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: Reconfiguring mon.smithi032 (unknown last config time)... 2024-05-06T21:19:32.372 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:19:32.372 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:19:32.372 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:32.372 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:31 smithi154 ceph-mon[32880]: Reconfiguring daemon mon.smithi032 on smithi032 2024-05-06T21:19:32.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.464+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe220195890 con 0x7fe2201948c0 2024-05-06T21:19:32.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.464+0000 7fe2167fc700 1 -- 172.21.15.32:0/2346554600 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7fe220195890 con 0x7fe2201948c0 2024-05-06T21:19:32.467 INFO:teuthology.orchestra.run.smithi032.stdout:# minimal ceph.conf for d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:19:32.467 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-05-06T21:19:32.467 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:19:32.468 INFO:teuthology.orchestra.run.smithi032.stdout: mon_host = [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-05-06T21:19:32.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.466+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c760 msgr2=0x7fe20c06ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:32.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.466+0000 7fe2273cf700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c760 0x7fe20c06ec10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009480 tx=0x7fe21c00b7b0 comp rx=0 tx=0).stop 2024-05-06T21:19:32.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.466+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2201948c0 msgr2=0x7fe220198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:32.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.466+0000 7fe2273cf700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2201948c0 0x7fe220198d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe21000da80 tx=0x7fe21000de40 comp rx=0 tx=0).stop 2024-05-06T21:19:32.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.466+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 shutdown_connections 2024-05-06T21:19:32.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.466+0000 7fe2273cf700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c760 0x7fe20c06ec10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:32.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.466+0000 7fe2273cf700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200fefc0 0x7fe220194380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:32.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.466+0000 7fe2273cf700 1 --2- 172.21.15.32:0/2346554600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2201948c0 0x7fe220198d30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:32.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.466+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 >> 172.21.15.32:0/2346554600 conn(0x7fe220074af0 msgr2=0x7fe220104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:32.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.467+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 shutdown_connections 2024-05-06T21:19:32.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:32.467+0000 7fe2273cf700 1 -- 172.21.15.32:0/2346554600 wait complete. 2024-05-06T21:19:33.215 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:32 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2346554600' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:33.216 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:33.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:32 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2346554600' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:33.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:34.149 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-06T21:19:34.149 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:19:34.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.conf 2024-05-06T21:19:34.178 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:19:34.178 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:19:34.245 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:19:34.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-05-06T21:19:34.278 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:19:34.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:19:34.347 INFO:tasks.cephadm:Deploying OSDs... 2024-05-06T21:19:34.347 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:19:34.347 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-05-06T21:19:34.364 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-06T21:19:34.364 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-05-06T21:19:34.421 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-06T21:19:34.421 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T21:19:34.421 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-06T21:19:34.421 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:19:34.421 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T21:19:34.421 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-05-06 21:18:48.931690727 +0000 2024-05-06T21:19:34.421 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-05-06 21:12:55.132170916 +0000 2024-05-06T21:19:34.421 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-05-06 21:12:55.132170916 +0000 2024-05-06T21:19:34.421 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-05-06 21:12:55.132170916 +0000 2024-05-06T21:19:34.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-06T21:19:34.486 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-05-06T21:19:34.487 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-05-06T21:19:34.487 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.00010393 s, 4.9 MB/s 2024-05-06T21:19:34.488 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-06T21:19:34.545 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-05-06T21:19:34.602 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-06T21:19:34.603 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T21:19:34.603 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-06T21:19:34.603 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:19:34.603 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T21:19:34.603 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-05-06 21:18:48.931690727 +0000 2024-05-06T21:19:34.603 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-05-06 21:12:55.487163570 +0000 2024-05-06T21:19:34.603 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-05-06 21:12:55.487163570 +0000 2024-05-06T21:19:34.603 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-05-06 21:12:55.487163570 +0000 2024-05-06T21:19:34.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-06T21:19:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-05-06T21:19:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-05-06T21:19:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000105764 s, 4.8 MB/s 2024-05-06T21:19:34.669 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-06T21:19:34.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:34 smithi032 ceph-mon[27179]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:34.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:34 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:34.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:34 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:34.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:34 smithi032 ceph-mon[27179]: Reconfiguring mgr.smithi032.ecoohh (unknown last config time)... 2024-05-06T21:19:34.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:34 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi032.ecoohh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:19:34.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:34 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:19:34.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:34 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:34.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:34 smithi032 ceph-mon[27179]: Reconfiguring daemon mgr.smithi032.ecoohh on smithi032 2024-05-06T21:19:34.727 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-05-06T21:19:34.783 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-06T21:19:34.783 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T21:19:34.783 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-06T21:19:34.783 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:19:34.783 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T21:19:34.783 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-05-06 21:18:48.931690727 +0000 2024-05-06T21:19:34.783 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-05-06 21:12:55.834156390 +0000 2024-05-06T21:19:34.783 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-05-06 21:12:55.834156390 +0000 2024-05-06T21:19:34.783 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-05-06 21:12:55.834156390 +0000 2024-05-06T21:19:34.783 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-06T21:19:34.847 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-05-06T21:19:34.847 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-05-06T21:19:34.847 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.00010746 s, 4.8 MB/s 2024-05-06T21:19:34.848 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-06T21:19:34.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:34 smithi154 ceph-mon[32880]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:34.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:34 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:34.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:34 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:34.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:34 smithi154 ceph-mon[32880]: Reconfiguring mgr.smithi032.ecoohh (unknown last config time)... 2024-05-06T21:19:34.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:34 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi032.ecoohh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:19:34.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:34 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:19:34.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:34 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:34.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:34 smithi154 ceph-mon[32880]: Reconfiguring daemon mgr.smithi032.ecoohh on smithi032 2024-05-06T21:19:34.905 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-05-06T21:19:34.961 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-06T21:19:34.962 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T21:19:34.962 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-06T21:19:34.962 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:19:34.962 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T21:19:34.962 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-05-06 21:18:48.932690706 +0000 2024-05-06T21:19:34.962 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-05-06 21:12:56.208148651 +0000 2024-05-06T21:19:34.962 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-05-06 21:12:56.208148651 +0000 2024-05-06T21:19:34.962 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-05-06 21:12:56.208148651 +0000 2024-05-06T21:19:34.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-06T21:19:35.026 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-05-06T21:19:35.026 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-05-06T21:19:35.026 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000102477 s, 5.0 MB/s 2024-05-06T21:19:35.027 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-06T21:19:35.084 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:19:35.085 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-05-06T21:19:35.104 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-06T21:19:35.105 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-05-06T21:19:35.164 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-06T21:19:35.164 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T21:19:35.164 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-06T21:19:35.164 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:19:35.165 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T21:19:35.165 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-06 21:19:22.591297213 +0000 2024-05-06T21:19:35.165 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-06 21:12:50.459163605 +0000 2024-05-06T21:19:35.165 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-06 21:12:50.459163605 +0000 2024-05-06T21:19:35.165 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-05-06 21:12:50.459163605 +0000 2024-05-06T21:19:35.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-06T21:19:35.232 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-06T21:19:35.233 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-06T21:19:35.233 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00025695 s, 2.0 MB/s 2024-05-06T21:19:35.234 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-06T21:19:35.294 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-05-06T21:19:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-06T21:19:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T21:19:35.352 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-06T21:19:35.352 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:19:35.352 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T21:19:35.353 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-06 21:19:22.591297213 +0000 2024-05-06T21:19:35.353 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-06 21:12:50.817154213 +0000 2024-05-06T21:19:35.353 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-06 21:12:50.817154213 +0000 2024-05-06T21:19:35.353 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-05-06 21:12:50.817154213 +0000 2024-05-06T21:19:35.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-06T21:19:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-06T21:19:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-06T21:19:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000212394 s, 2.4 MB/s 2024-05-06T21:19:35.420 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-06T21:19:35.478 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-05-06T21:19:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-06T21:19:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T21:19:35.535 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-06T21:19:35.535 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:19:35.535 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T21:19:35.535 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-06 21:19:22.592297186 +0000 2024-05-06T21:19:35.536 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-06 21:12:51.171144930 +0000 2024-05-06T21:19:35.536 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-06 21:12:51.171144930 +0000 2024-05-06T21:19:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-05-06 21:12:51.171144930 +0000 2024-05-06T21:19:35.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-06T21:19:35.605 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-06T21:19:35.605 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-06T21:19:35.605 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000216495 s, 2.4 MB/s 2024-05-06T21:19:35.605 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-06T21:19:35.663 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-05-06T21:19:35.720 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-06T21:19:35.720 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T21:19:35.720 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-06T21:19:35.720 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:19:35.720 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T21:19:35.720 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-06 21:19:22.592297186 +0000 2024-05-06T21:19:35.720 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-06 21:12:51.507136120 +0000 2024-05-06T21:19:35.720 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-06 21:12:51.507136120 +0000 2024-05-06T21:19:35.720 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-05-06 21:12:51.507136120 +0000 2024-05-06T21:19:35.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-06T21:19:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-06T21:19:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-06T21:19:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000217357 s, 2.4 MB/s 2024-05-06T21:19:35.785 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-06T21:19:35.842 INFO:tasks.cephadm:Deploying osd.0 on smithi032 with /dev/vg_nvme/lv_4... 2024-05-06T21:19:35.842 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-06T21:19:36.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:36 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:36.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:36 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:36.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:36 smithi032 ceph-mon[27179]: Reconfiguring ceph-exporter.smithi032 (monmap changed)... 2024-05-06T21:19:36.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:36 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:19:36.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:36 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:36.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:36 smithi032 ceph-mon[27179]: Reconfiguring daemon ceph-exporter.smithi032 on smithi032 2024-05-06T21:19:36.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:36 smithi032 ceph-mon[27179]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:36.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:36 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:36.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:36 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:36.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:36 smithi154 ceph-mon[32880]: Reconfiguring ceph-exporter.smithi032 (monmap changed)... 2024-05-06T21:19:36.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:36 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:19:36.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:36 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:36.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:36 smithi154 ceph-mon[32880]: Reconfiguring daemon ceph-exporter.smithi032 on smithi032 2024-05-06T21:19:36.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:36 smithi154 ceph-mon[32880]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:36.928 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:19:38.139 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:37 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:38.139 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:37 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:38.139 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:37 smithi032 ceph-mon[27179]: Reconfiguring crash.smithi032 (monmap changed)... 2024-05-06T21:19:38.139 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:37 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi032", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:19:38.139 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:37 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:38.139 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:37 smithi032 ceph-mon[27179]: Reconfiguring daemon crash.smithi032 on smithi032 2024-05-06T21:19:38.139 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:37 smithi032 ceph-mon[27179]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:38.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:37 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:38.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:37 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:38.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:37 smithi154 ceph-mon[32880]: Reconfiguring crash.smithi032 (monmap changed)... 2024-05-06T21:19:38.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:37 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi032", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:19:38.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:37 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:38.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:37 smithi154 ceph-mon[32880]: Reconfiguring daemon crash.smithi032 on smithi032 2024-05-06T21:19:38.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:37 smithi154 ceph-mon[32880]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-06T21:19:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-06T21:19:40.036 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10+0 records in 2024-05-06T21:19:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:10+0 records out 2024-05-06T21:19:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00838424 s, 1.3 GB/s 2024-05-06T21:19:40.037 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping successful for: 2024-05-06T21:19:40.689 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:40.689 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:40.689 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:40 smithi032 ceph-mon[27179]: Reconfiguring alertmanager.smithi032 (dependencies changed)... 2024-05-06T21:19:40.689 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:40 smithi032 ceph-mon[27179]: Reconfiguring daemon alertmanager.smithi032 on smithi032 2024-05-06T21:19:40.689 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:40 smithi032 ceph-mon[27179]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:40.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:40.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:40.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:40 smithi154 ceph-mon[32880]: Reconfiguring alertmanager.smithi032 (dependencies changed)... 2024-05-06T21:19:40.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:40 smithi154 ceph-mon[32880]: Reconfiguring daemon alertmanager.smithi032 on smithi032 2024-05-06T21:19:40.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:40 smithi154 ceph-mon[32880]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:41.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi032:vg_nvme/lv_4 2024-05-06T21:19:42.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:42 smithi154 ceph-mon[32880]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:42.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:19:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:42 smithi032 ceph-mon[27179]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:19:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:19:44.931 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:44 smithi032 ceph-mon[27179]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:45.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:44 smithi154 ceph-mon[32880]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:45.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.808+0000 7f432fc37700 1 -- 172.21.15.32:0/4265286776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328103680 msgr2=0x7f4328105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:45.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.808+0000 7f432fc37700 1 --2- 172.21.15.32:0/4265286776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328103680 0x7f4328105a60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4318009910 tx=0x7f4318009c20 comp rx=0 tx=0).stop 2024-05-06T21:19:45.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.808+0000 7f432fc37700 1 -- 172.21.15.32:0/4265286776 shutdown_connections 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.808+0000 7f432fc37700 1 --2- 172.21.15.32:0/4265286776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328103680 0x7f4328105a60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.808+0000 7f432fc37700 1 --2- 172.21.15.32:0/4265286776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328100d60 0x7f4328103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.808+0000 7f432fc37700 1 -- 172.21.15.32:0/4265286776 >> 172.21.15.32:0/4265286776 conn(0x7f43280fa780 msgr2=0x7f43280fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.808+0000 7f432fc37700 1 -- 172.21.15.32:0/4265286776 shutdown_connections 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.808+0000 7f432fc37700 1 -- 172.21.15.32:0/4265286776 wait complete. 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.809+0000 7f432fc37700 1 Processor -- start 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.809+0000 7f432fc37700 1 -- start start 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.809+0000 7f432fc37700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328100d60 0x7f43281006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.809+0000 7f432fc37700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328103680 0x7f43280fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.809+0000 7f432fc37700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280ff250 con 0x7f4328100d60 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.809+0000 7f432fc37700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280ff390 con 0x7f4328103680 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.809+0000 7f432d9d3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328100d60 0x7f43281006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:45.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432d9d3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328100d60 0x7f43281006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46028/0 (socket says 172.21.15.32:46028) 2024-05-06T21:19:45.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432d9d3700 1 -- 172.21.15.32:0/3315734866 learned_addr learned my addr 172.21.15.32:0/3315734866 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:19:45.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432d1d2700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328103680 0x7f43280fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:45.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432d9d3700 1 -- 172.21.15.32:0/3315734866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328103680 msgr2=0x7f43280fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:19:45.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432d9d3700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328103680 0x7f43280fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:19:45.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432d9d3700 1 -- 172.21.15.32:0/3315734866 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43180095f0 con 0x7f4328100d60 2024-05-06T21:19:45.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432d1d2700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328103680 0x7f43280fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:19:45.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432d9d3700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328100d60 0x7f43281006c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f432400d900 tx=0x7f432400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:45.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f431effd700 1 -- 172.21.15.32:0/3315734866 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4324009900 con 0x7f4328100d60 2024-05-06T21:19:45.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43280ff670 con 0x7f4328100d60 2024-05-06T21:19:45.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f431effd700 1 -- 172.21.15.32:0/3315734866 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4324010460 con 0x7f4328100d60 2024-05-06T21:19:45.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f431effd700 1 -- 172.21.15.32:0/3315734866 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f432400f5f0 con 0x7f4328100d60 2024-05-06T21:19:45.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.810+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432819db40 con 0x7f4328100d60 2024-05-06T21:19:45.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.811+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432818fbe0 con 0x7f4328100d60 2024-05-06T21:19:45.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.812+0000 7f431effd700 1 -- 172.21.15.32:0/3315734866 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f432400fa80 con 0x7f4328100d60 2024-05-06T21:19:45.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.813+0000 7f431effd700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f431406c610 0x7f431406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:19:45.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.813+0000 7f431effd700 1 -- 172.21.15.32:0/3315734866 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f432408a630 con 0x7f4328100d60 2024-05-06T21:19:45.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.813+0000 7f432d1d2700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f431406c610 0x7f431406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:19:45.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.813+0000 7f432d1d2700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f431406c610 0x7f431406eac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4318006010 tx=0x7f431800b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:19:45.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:45.817+0000 7f431effd700 1 -- 172.21.15.32:0/3315734866 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4324059a40 con 0x7f4328100d60 2024-05-06T21:19:45.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:45 smithi032 ceph-mon[27179]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:46.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:19:46.037+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4328061190 con 0x7f431406c610 2024-05-06T21:19:46.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:45 smithi154 ceph-mon[32880]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:47.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:46 smithi154 ceph-mon[32880]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:19:47.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:46 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:19:47.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:46 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:19:47.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:46 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:47.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:46 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:47.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:46 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:47.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:46 smithi032 ceph-mon[27179]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:19:47.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:46 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:19:47.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:46 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:19:47.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:46 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:19:47.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:46 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:47.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:46 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:47.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:47 smithi154 ceph-mon[32880]: Reconfiguring grafana.smithi032 (dependencies changed)... 2024-05-06T21:19:47.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:47 smithi154 ceph-mon[32880]: Reconfiguring daemon grafana.smithi032 on smithi032 2024-05-06T21:19:47.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:47 smithi154 ceph-mon[32880]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:48.072 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:47 smithi032 ceph-mon[27179]: Reconfiguring grafana.smithi032 (dependencies changed)... 2024-05-06T21:19:48.072 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:47 smithi032 ceph-mon[27179]: Reconfiguring daemon grafana.smithi032 on smithi032 2024-05-06T21:19:48.072 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:47 smithi032 ceph-mon[27179]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:49.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:48 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/4134660343' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0095c3fd-9b90-4d23-b192-98fd9a06c20a"}]: dispatch 2024-05-06T21:19:49.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:48 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/4134660343' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0095c3fd-9b90-4d23-b192-98fd9a06c20a"}]': finished 2024-05-06T21:19:49.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:48 smithi032 ceph-mon[27179]: osdmap e6: 1 total, 0 up, 1 in 2024-05-06T21:19:49.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:48 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:19:49.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:48 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/4134660343' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0095c3fd-9b90-4d23-b192-98fd9a06c20a"}]: dispatch 2024-05-06T21:19:49.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:48 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/4134660343' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0095c3fd-9b90-4d23-b192-98fd9a06c20a"}]': finished 2024-05-06T21:19:49.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:48 smithi154 ceph-mon[32880]: osdmap e6: 1 total, 0 up, 1 in 2024-05-06T21:19:49.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:48 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:19:50.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:49 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1088920048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:19:50.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:49 smithi032 ceph-mon[27179]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:50.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:49 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1088920048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:19:50.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:49 smithi154 ceph-mon[32880]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:52.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:52 smithi154 ceph-mon[32880]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:52.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:52 smithi032 ceph-mon[27179]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:54.867 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:54 smithi032 ceph-mon[27179]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:55.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:54 smithi154 ceph-mon[32880]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:55.916 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:55 smithi032 ceph-mon[27179]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:56.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:55 smithi154 ceph-mon[32880]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:57.857 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:19:57.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:57 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:19:58.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:58 smithi032 ceph-mon[27179]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:58.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:58.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:59.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:58 smithi154 ceph-mon[32880]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:19:59.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:59.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:19:59.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:59 smithi032 ceph-mon[27179]: Reconfiguring prometheus.smithi032 (dependencies changed)... 2024-05-06T21:19:59.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:19:59 smithi032 ceph-mon[27179]: Reconfiguring daemon prometheus.smithi032 on smithi032 2024-05-06T21:20:00.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:59 smithi154 ceph-mon[32880]: Reconfiguring prometheus.smithi032 (dependencies changed)... 2024-05-06T21:20:00.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:19:59 smithi154 ceph-mon[32880]: Reconfiguring daemon prometheus.smithi032 on smithi032 2024-05-06T21:20:00.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:00 smithi032 ceph-mon[27179]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:00.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:00 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T21:20:00.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:00 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:00.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:00 smithi032 ceph-mon[27179]: overall HEALTH_OK 2024-05-06T21:20:01.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:00 smithi154 ceph-mon[32880]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:01.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:00 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T21:20:01.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:00 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:01.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:00 smithi154 ceph-mon[32880]: overall HEALTH_OK 2024-05-06T21:20:01.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:01 smithi032 ceph-mon[27179]: Deploying daemon osd.0 on smithi032 2024-05-06T21:20:02.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:01 smithi154 ceph-mon[32880]: Deploying daemon osd.0 on smithi032 2024-05-06T21:20:02.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:02 smithi154 ceph-mon[32880]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:02 smithi032 ceph-mon[27179]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:03.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:03 smithi032 ceph-mon[27179]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:04.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:03 smithi154 ceph-mon[32880]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:05.344 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:05.344 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:05.344 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:05 smithi032 ceph-mon[27179]: Reconfiguring ceph-exporter.smithi154 (monmap changed)... 2024-05-06T21:20:05.344 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:20:05.344 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:05.344 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:05 smithi032 ceph-mon[27179]: Reconfiguring daemon ceph-exporter.smithi154 on smithi154 2024-05-06T21:20:05.602 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:05.602 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:05.603 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:05 smithi154 ceph-mon[32880]: Reconfiguring ceph-exporter.smithi154 (monmap changed)... 2024-05-06T21:20:05.603 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:20:05.603 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:05.603 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:05 smithi154 ceph-mon[32880]: Reconfiguring daemon ceph-exporter.smithi154 on smithi154 2024-05-06T21:20:06.885 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:06 smithi154 ceph-mon[32880]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:06.885 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:06 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:06.885 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:06 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:06.885 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:06 smithi154 ceph-mon[32880]: Reconfiguring crash.smithi154 (monmap changed)... 2024-05-06T21:20:06.886 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:06 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi154", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:20:06.886 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:06 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:06.886 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:06 smithi154 ceph-mon[32880]: Reconfiguring daemon crash.smithi154 on smithi154 2024-05-06T21:20:06.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:06 smithi032 ceph-mon[27179]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:06.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:06 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:06.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:06 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:06.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:06 smithi032 ceph-mon[27179]: Reconfiguring crash.smithi154 (monmap changed)... 2024-05-06T21:20:06.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:06 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi154", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:20:06.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:06 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:06.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:06 smithi032 ceph-mon[27179]: Reconfiguring daemon crash.smithi154 on smithi154 2024-05-06T21:20:07.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:07 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:07.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:07 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:07.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:07 smithi032 ceph-mon[27179]: Reconfiguring mgr.smithi154.kilvol (monmap changed)... 2024-05-06T21:20:07.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:07 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:20:07.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:07 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:20:07.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:07 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:07.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:07 smithi032 ceph-mon[27179]: Reconfiguring daemon mgr.smithi154.kilvol on smithi154 2024-05-06T21:20:07.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:07 smithi032 ceph-mon[27179]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:08.291 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:07 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:08.291 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:07 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:08.292 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:07 smithi154 ceph-mon[32880]: Reconfiguring mgr.smithi154.kilvol (monmap changed)... 2024-05-06T21:20:08.292 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:07 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:20:08.292 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:07 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:20:08.292 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:07 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:08.292 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:07 smithi154 ceph-mon[32880]: Reconfiguring daemon mgr.smithi154.kilvol on smithi154 2024-05-06T21:20:08.292 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:07 smithi154 ceph-mon[32880]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:09.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:09 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:09.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:09 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:09.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:09 smithi154 ceph-mon[32880]: Reconfiguring mon.smithi154 (monmap changed)... 2024-05-06T21:20:09.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:09 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:20:09.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:09 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:20:09.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:09 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:09.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:09 smithi154 ceph-mon[32880]: Reconfiguring daemon mon.smithi154 on smithi154 2024-05-06T21:20:09.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:09 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:09.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:09 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:09.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:09 smithi032 ceph-mon[27179]: Reconfiguring mon.smithi154 (monmap changed)... 2024-05-06T21:20:09.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:09 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:20:09.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:09 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:20:09.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:09 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:09.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:09 smithi032 ceph-mon[27179]: Reconfiguring daemon mon.smithi154 on smithi154 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi032.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi032.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T21:20:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T21:20:10.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T21:20:10.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi032.front.sepia.ceph.com:3000"}]: dispatch 2024-05-06T21:20:10.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:20:10.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi032.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T21:20:10.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:10 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:20:10.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:10.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T21:20:10.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi032.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi032.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi032.front.sepia.ceph.com:3000"}]: dispatch 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi032.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:10.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:10 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:20:11.303 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:11 smithi154 ceph-mon[32880]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi032.front.sepia.ceph.com:3000"}]: dispatch 2024-05-06T21:20:11.303 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:11 smithi154 ceph-mon[32880]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:20:11.303 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:11 smithi154 ceph-mon[32880]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi032.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T21:20:11.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:11 smithi032 ceph-mon[27179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi032.front.sepia.ceph.com:3000"}]: dispatch 2024-05-06T21:20:11.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:11 smithi032 ceph-mon[27179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:20:11.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:11 smithi032 ceph-mon[27179]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi032.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T21:20:12.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.373+0000 7f431effd700 1 -- 172.21.15.32:0/3315734866 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4328061190 con 0x7f431406c610 2024-05-06T21:20:12.376 INFO:teuthology.orchestra.run.smithi032.stdout:Created osd(s) 0 on host 'smithi032' 2024-05-06T21:20:12.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f431406c610 msgr2=0x7f431406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:20:12.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f431406c610 0x7f431406eac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4318006010 tx=0x7f431800b540 comp rx=0 tx=0).stop 2024-05-06T21:20:12.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328100d60 msgr2=0x7f43281006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:20:12.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328100d60 0x7f43281006c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f432400d900 tx=0x7f432400dcc0 comp rx=0 tx=0).stop 2024-05-06T21:20:12.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 shutdown_connections 2024-05-06T21:20:12.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f431406c610 0x7f431406eac0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:12.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4328100d60 0x7f43281006c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:12.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 --2- 172.21.15.32:0/3315734866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328103680 0x7f43280fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:12.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 >> 172.21.15.32:0/3315734866 conn(0x7f43280fa780 msgr2=0x7f43280fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:20:12.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 shutdown_connections 2024-05-06T21:20:12.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:12.375+0000 7f432fc37700 1 -- 172.21.15.32:0/3315734866 wait complete. 2024-05-06T21:20:12.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:12 smithi154 ceph-mon[32880]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:12.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:12 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:12.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:12 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:12.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:12 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:12.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:12 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:12 smithi032 ceph-mon[27179]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:13.353 DEBUG:teuthology.orchestra.run.smithi032:osd.0> sudo journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.0.service 2024-05-06T21:20:13.358 INFO:tasks.cephadm:Deploying osd.1 on smithi032 with /dev/vg_nvme/lv_3... 2024-05-06T21:20:13.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-06T21:20:13.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:13 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:20:13.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:13 smithi154 ceph-mon[32880]: from='osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T21:20:13.951 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:13 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:20:13.951 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:13 smithi032 ceph-mon[27179]: from='osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T21:20:14.268 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:20:14.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:14 smithi032 ceph-mon[27179]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:14.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:14 smithi032 ceph-mon[27179]: from='osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T21:20:14.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:14 smithi032 ceph-mon[27179]: osdmap e7: 1 total, 0 up, 1 in 2024-05-06T21:20:14.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:14 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:20:14.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:14 smithi032 ceph-mon[27179]: from='osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:20:14.727 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:20:14 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[42179]: 2024-05-06T21:20:14.609+0000 7f4cdaf9c700 -1 osd.0 0 waiting for initial osdmap 2024-05-06T21:20:14.727 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:20:14 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[42179]: 2024-05-06T21:20:14.612+0000 7f4cd458c700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:20:14.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:14 smithi154 ceph-mon[32880]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:14.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:14 smithi154 ceph-mon[32880]: from='osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T21:20:14.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:14 smithi154 ceph-mon[32880]: osdmap e7: 1 total, 0 up, 1 in 2024-05-06T21:20:14.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:14 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:20:14.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:14 smithi154 ceph-mon[32880]: from='osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:20:15.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:15 smithi032 ceph-mon[27179]: from='osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2024-05-06T21:20:15.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:15 smithi032 ceph-mon[27179]: osdmap e8: 1 total, 0 up, 1 in 2024-05-06T21:20:15.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:15 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:20:15.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:15 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:20:15.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:15 smithi154 ceph-mon[32880]: from='osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2024-05-06T21:20:15.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:15 smithi154 ceph-mon[32880]: osdmap e8: 1 total, 0 up, 1 in 2024-05-06T21:20:15.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:15 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:20:15.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:15 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:20:16.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:16 smithi154 ceph-mon[32880]: purged_snaps scrub starts 2024-05-06T21:20:16.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:16 smithi154 ceph-mon[32880]: purged_snaps scrub ok 2024-05-06T21:20:16.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:16 smithi154 ceph-mon[32880]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:16.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:16 smithi154 ceph-mon[32880]: osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] boot 2024-05-06T21:20:16.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:16 smithi154 ceph-mon[32880]: osdmap e9: 1 total, 1 up, 1 in 2024-05-06T21:20:16.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:16 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:20:16.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:16 smithi032 ceph-mon[27179]: purged_snaps scrub starts 2024-05-06T21:20:16.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:16 smithi032 ceph-mon[27179]: purged_snaps scrub ok 2024-05-06T21:20:16.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:16 smithi032 ceph-mon[27179]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T21:20:16.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:16 smithi032 ceph-mon[27179]: osd.0 [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] boot 2024-05-06T21:20:16.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:16 smithi032 ceph-mon[27179]: osdmap e9: 1 total, 1 up, 1 in 2024-05-06T21:20:16.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:20:17.209 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-06T21:20:17.209 INFO:teuthology.orchestra.run.smithi032.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-06T21:20:17.209 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10+0 records in 2024-05-06T21:20:17.209 INFO:teuthology.orchestra.run.smithi032.stderr:10+0 records out 2024-05-06T21:20:17.209 INFO:teuthology.orchestra.run.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00965006 s, 1.1 GB/s 2024-05-06T21:20:17.210 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping successful for: 2024-05-06T21:20:17.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:17 smithi154 ceph-mon[32880]: osdmap e10: 1 total, 1 up, 1 in 2024-05-06T21:20:17.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:17 smithi154 ceph-mon[32880]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:17.905 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:17 smithi032 ceph-mon[27179]: osdmap e10: 1 total, 1 up, 1 in 2024-05-06T21:20:17.905 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:17 smithi032 ceph-mon[27179]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:17.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi032:vg_nvme/lv_3 2024-05-06T21:20:18.788 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:20:20.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:20.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:20.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:19 smithi154 ceph-mon[32880]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:20.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:20.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:20.145 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:19 smithi032 ceph-mon[27179]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:20.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.492+0000 7f3121c2c700 1 -- 172.21.15.32:0/3758932527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c100240 msgr2=0x7f311c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:20:20.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.492+0000 7f3121c2c700 1 --2- 172.21.15.32:0/3758932527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c100240 0x7f311c100650 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f310c009910 tx=0x7f310c009c20 comp rx=0 tx=0).stop 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.492+0000 7f3121c2c700 1 -- 172.21.15.32:0/3758932527 shutdown_connections 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.492+0000 7f3121c2c700 1 --2- 172.21.15.32:0/3758932527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f311c101440 0x7f311c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.492+0000 7f3121c2c700 1 --2- 172.21.15.32:0/3758932527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c100240 0x7f311c100650 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.492+0000 7f3121c2c700 1 -- 172.21.15.32:0/3758932527 >> 172.21.15.32:0/3758932527 conn(0x7f311c0fb7f0 msgr2=0x7f311c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.492+0000 7f3121c2c700 1 -- 172.21.15.32:0/3758932527 shutdown_connections 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.492+0000 7f3121c2c700 1 -- 172.21.15.32:0/3758932527 wait complete. 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.493+0000 7f3121c2c700 1 Processor -- start 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.493+0000 7f3121c2c700 1 -- start start 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.493+0000 7f3121c2c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f311c100240 0x7f311c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.493+0000 7f3121c2c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c101440 0x7f311c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.493+0000 7f3121c2c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c196610 con 0x7f311c101440 2024-05-06T21:20:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.493+0000 7f3121c2c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c196750 con 0x7f311c100240 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.493+0000 7f311affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c101440 0x7f311c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.493+0000 7f311affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c101440 0x7f311c195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47240/0 (socket says 172.21.15.32:47240) 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.493+0000 7f311affd700 1 -- 172.21.15.32:0/3997684461 learned_addr learned my addr 172.21.15.32:0/3997684461 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f311b7fe700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f311c100240 0x7f311c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f311affd700 1 -- 172.21.15.32:0/3997684461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f311c100240 msgr2=0x7f311c195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f311affd700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f311c100240 0x7f311c195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f311affd700 1 -- 172.21.15.32:0/3997684461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c0095f0 con 0x7f311c101440 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f311affd700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c101440 0x7f311c195ff0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f311000d8d0 tx=0x7f311000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f3118ff9700 1 -- 172.21.15.32:0/3997684461 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3110009940 con 0x7f311c101440 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311c19b200 con 0x7f311c101440 2024-05-06T21:20:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f3118ff9700 1 -- 172.21.15.32:0/3997684461 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3110010460 con 0x7f311c101440 2024-05-06T21:20:20.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f3118ff9700 1 -- 172.21.15.32:0/3997684461 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f311000f5f0 con 0x7f311c101440 2024-05-06T21:20:20.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.494+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c19b750 con 0x7f311c101440 2024-05-06T21:20:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.495+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311c108d90 con 0x7f311c101440 2024-05-06T21:20:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.496+0000 7f3118ff9700 1 -- 172.21.15.32:0/3997684461 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f31100105d0 con 0x7f311c101440 2024-05-06T21:20:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.497+0000 7f3118ff9700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f310406c650 0x7f310406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:20:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.497+0000 7f311b7fe700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f310406c650 0x7f310406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:20:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.497+0000 7f3118ff9700 1 -- 172.21.15.32:0/3997684461 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f311008aa70 con 0x7f311c101440 2024-05-06T21:20:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.497+0000 7f311b7fe700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f310406c650 0x7f310406eb00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f310c006010 tx=0x7f310c005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:20:20.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.501+0000 7f3118ff9700 1 -- 172.21.15.32:0/3997684461 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f31100599c0 con 0x7f311c101440 2024-05-06T21:20:20.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:20.713+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f311c105d90 con 0x7f310406c650 2024-05-06T21:20:21.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:20 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:20:21.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:20 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:20:21.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:20 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:21.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:20 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:20:21.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:20 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:20:21.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:20 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:21.886 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:21 smithi032 ceph-mon[27179]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:20:21.886 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:21 smithi032 ceph-mon[27179]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:22.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:21 smithi154 ceph-mon[32880]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:20:22.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:21 smithi154 ceph-mon[32880]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:24.932 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:24 smithi032 ceph-mon[27179]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:24.932 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:24.932 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:24.932 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:20:24.932 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:24.932 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:24.932 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:20:24.932 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:24.932 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:20:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:24 smithi154 ceph-mon[32880]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:20:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:20:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:20:25.659 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:25 smithi154 ceph-mon[32880]: Detected new or changed devices on smithi032 2024-05-06T21:20:25.659 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:25 smithi154 ceph-mon[32880]: Adjusting osd_memory_target on smithi032 to 11845M 2024-05-06T21:20:25.659 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:25 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2760154567' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d37de85-e43f-4094-ba6a-00a09047798a"}]: dispatch 2024-05-06T21:20:25.659 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:25 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2760154567' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d37de85-e43f-4094-ba6a-00a09047798a"}]': finished 2024-05-06T21:20:25.659 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:25 smithi154 ceph-mon[32880]: osdmap e11: 2 total, 1 up, 2 in 2024-05-06T21:20:25.659 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:25 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:25.948 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:25 smithi032 ceph-mon[27179]: Detected new or changed devices on smithi032 2024-05-06T21:20:25.948 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:25 smithi032 ceph-mon[27179]: Adjusting osd_memory_target on smithi032 to 11845M 2024-05-06T21:20:25.948 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:25 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2760154567' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d37de85-e43f-4094-ba6a-00a09047798a"}]: dispatch 2024-05-06T21:20:25.948 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:25 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2760154567' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d37de85-e43f-4094-ba6a-00a09047798a"}]': finished 2024-05-06T21:20:25.948 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:25 smithi032 ceph-mon[27179]: osdmap e11: 2 total, 1 up, 2 in 2024-05-06T21:20:25.948 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:25 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:26.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:26 smithi032 ceph-mon[27179]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:26.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:26 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1907893060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:20:26.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:26 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:26.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:26 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:27.022 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:26 smithi154 ceph-mon[32880]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:27.022 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:26 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1907893060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:20:27.022 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:26 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:27.022 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:26 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:27.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:27 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:20:27.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:27 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:20:28.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:28 smithi032 ceph-mon[27179]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:28.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:28.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:28.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:28.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:20:28.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:29.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:28 smithi154 ceph-mon[32880]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:29.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:29.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:29.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:29.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:20:29.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:30.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:30 smithi032 ceph-mon[27179]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:31.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:30 smithi154 ceph-mon[32880]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:32.859 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:32 smithi032 ceph-mon[27179]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:33.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:32 smithi154 ceph-mon[32880]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:33.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:33 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T21:20:33.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:33 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:34.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:33 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T21:20:34.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:33 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:34.960 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:34 smithi032 ceph-mon[27179]: Deploying daemon osd.1 on smithi032 2024-05-06T21:20:34.960 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:34 smithi032 ceph-mon[27179]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:34 smithi154 ceph-mon[32880]: Deploying daemon osd.1 on smithi032 2024-05-06T21:20:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:34 smithi154 ceph-mon[32880]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:35.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:35 smithi032 ceph-mon[27179]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:36.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:35 smithi154 ceph-mon[32880]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:38.911 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:38 smithi032 ceph-mon[27179]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:38.911 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:38 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:38.911 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:38 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:38.911 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:38 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:20:39.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:38 smithi154 ceph-mon[32880]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:39.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:38 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:39.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:38 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:39.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:38 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:20:40.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:40 smithi032 ceph-mon[27179]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:40.853 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:40.853 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:41.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:40 smithi154 ceph-mon[32880]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:42 smithi032 ceph-mon[27179]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:42 smithi032 ceph-mon[27179]: from='osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T21:20:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:20:43.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.079+0000 7f3118ff9700 1 -- 172.21.15.32:0/3997684461 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f311c105d90 con 0x7f310406c650 2024-05-06T21:20:43.083 INFO:teuthology.orchestra.run.smithi032.stdout:Created osd(s) 1 on host 'smithi032' 2024-05-06T21:20:43.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f310406c650 msgr2=0x7f310406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:20:43.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f310406c650 0x7f310406eb00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f310c006010 tx=0x7f310c005a90 comp rx=0 tx=0).stop 2024-05-06T21:20:43.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c101440 msgr2=0x7f311c195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:20:43.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c101440 0x7f311c195ff0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f311000d8d0 tx=0x7f311000dc90 comp rx=0 tx=0).stop 2024-05-06T21:20:43.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 shutdown_connections 2024-05-06T21:20:43.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f310406c650 0x7f310406eb00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f311c100240 0x7f311c195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 --2- 172.21.15.32:0/3997684461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f311c101440 0x7f311c195ff0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 >> 172.21.15.32:0/3997684461 conn(0x7f311c0fb7f0 msgr2=0x7f311c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:20:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 shutdown_connections 2024-05-06T21:20:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:43.082+0000 7f3121c2c700 1 -- 172.21.15.32:0/3997684461 wait complete. 2024-05-06T21:20:43.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:42 smithi154 ceph-mon[32880]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:42 smithi154 ceph-mon[32880]: from='osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T21:20:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:20:43.782 DEBUG:teuthology.orchestra.run.smithi032:osd.1> sudo journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.1.service 2024-05-06T21:20:43.785 INFO:tasks.cephadm:Deploying osd.2 on smithi032 with /dev/vg_nvme/lv_2... 2024-05-06T21:20:43.785 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-06T21:20:43.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:43 smithi032 ceph-mon[27179]: from='osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T21:20:43.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:43 smithi032 ceph-mon[27179]: osdmap e12: 2 total, 1 up, 2 in 2024-05-06T21:20:43.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:43 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:43.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:43 smithi032 ceph-mon[27179]: from='osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:20:43.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:43 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:43.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:43 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:44.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:43 smithi154 ceph-mon[32880]: from='osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T21:20:44.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:43 smithi154 ceph-mon[32880]: osdmap e12: 2 total, 1 up, 2 in 2024-05-06T21:20:44.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:43 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:44.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:43 smithi154 ceph-mon[32880]: from='osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:20:44.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:43 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:44.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:43 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:20:44.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:44 smithi032 ceph-mon[27179]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:44.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:44 smithi032 ceph-mon[27179]: from='osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2024-05-06T21:20:44.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:44 smithi032 ceph-mon[27179]: osdmap e13: 2 total, 1 up, 2 in 2024-05-06T21:20:44.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:44 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:44.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:44 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:45.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:44 smithi154 ceph-mon[32880]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:44 smithi154 ceph-mon[32880]: from='osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2024-05-06T21:20:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:44 smithi154 ceph-mon[32880]: osdmap e13: 2 total, 1 up, 2 in 2024-05-06T21:20:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:44 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:44 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:45.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:45 smithi032 ceph-mon[27179]: purged_snaps scrub starts 2024-05-06T21:20:45.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:45 smithi032 ceph-mon[27179]: purged_snaps scrub ok 2024-05-06T21:20:45.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:45 smithi032 ceph-mon[27179]: osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] boot 2024-05-06T21:20:45.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:45 smithi032 ceph-mon[27179]: osdmap e14: 2 total, 2 up, 2 in 2024-05-06T21:20:45.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:45 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:46.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:45 smithi154 ceph-mon[32880]: purged_snaps scrub starts 2024-05-06T21:20:46.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:45 smithi154 ceph-mon[32880]: purged_snaps scrub ok 2024-05-06T21:20:46.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:45 smithi154 ceph-mon[32880]: osd.1 [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] boot 2024-05-06T21:20:46.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:45 smithi154 ceph-mon[32880]: osdmap e14: 2 total, 2 up, 2 in 2024-05-06T21:20:46.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:45 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:20:46.890 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:46 smithi032 ceph-mon[27179]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:46.891 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:46 smithi032 ceph-mon[27179]: osdmap e15: 2 total, 2 up, 2 in 2024-05-06T21:20:47.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:46 smithi154 ceph-mon[32880]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-06T21:20:47.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:46 smithi154 ceph-mon[32880]: osdmap e15: 2 total, 2 up, 2 in 2024-05-06T21:20:47.189 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-06T21:20:47.189 INFO:teuthology.orchestra.run.smithi032.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-06T21:20:47.189 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10+0 records in 2024-05-06T21:20:47.189 INFO:teuthology.orchestra.run.smithi032.stderr:10+0 records out 2024-05-06T21:20:47.189 INFO:teuthology.orchestra.run.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00845844 s, 1.2 GB/s 2024-05-06T21:20:47.189 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping successful for: 2024-05-06T21:20:47.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi032:vg_nvme/lv_2 2024-05-06T21:20:48.247 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:20:48.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:48 smithi032 ceph-mon[27179]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:48.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:48 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:48.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:48 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:49.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:48 smithi154 ceph-mon[32880]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:49.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:48 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:49.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:48 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:50.841 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:50 smithi032 ceph-mon[27179]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:51.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:50 smithi154 ceph-mon[32880]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:51.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.426+0000 7f5fd4588700 1 -- 172.21.15.32:0/1900020579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 msgr2=0x7f5fcc0ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:20:51.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.426+0000 7f5fd4588700 1 --2- 172.21.15.32:0/1900020579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 0x7f5fcc0ff550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009910 tx=0x7f5fc8009c20 comp rx=0 tx=0).stop 2024-05-06T21:20:51.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.427+0000 7f5fd4588700 1 -- 172.21.15.32:0/1900020579 shutdown_connections 2024-05-06T21:20:51.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.427+0000 7f5fd4588700 1 --2- 172.21.15.32:0/1900020579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc100340 0x7f5fcc100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:51.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.427+0000 7f5fd4588700 1 --2- 172.21.15.32:0/1900020579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 0x7f5fcc0ff550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:51.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.427+0000 7f5fd4588700 1 -- 172.21.15.32:0/1900020579 >> 172.21.15.32:0/1900020579 conn(0x7f5fcc0fa6d0 msgr2=0x7f5fcc0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:20:51.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.427+0000 7f5fd4588700 1 -- 172.21.15.32:0/1900020579 shutdown_connections 2024-05-06T21:20:51.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.427+0000 7f5fd4588700 1 -- 172.21.15.32:0/1900020579 wait complete. 2024-05-06T21:20:51.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd4588700 1 Processor -- start 2024-05-06T21:20:51.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd4588700 1 -- start start 2024-05-06T21:20:51.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd4588700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 0x7f5fcc069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:20:51.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd4588700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc100340 0x7f5fcc19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:20:51.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd4588700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc19ad30 con 0x7f5fcc0ff140 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd4588700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc19aea0 con 0x7f5fcc100340 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd2324700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 0x7f5fcc069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd2324700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 0x7f5fcc069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53316/0 (socket says 172.21.15.32:53316) 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd2324700 1 -- 172.21.15.32:0/1005526053 learned_addr learned my addr 172.21.15.32:0/1005526053 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.428+0000 7f5fd1b23700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc100340 0x7f5fcc19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.429+0000 7f5fd2324700 1 -- 172.21.15.32:0/1005526053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc100340 msgr2=0x7f5fcc19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.429+0000 7f5fd2324700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc100340 0x7f5fcc19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.429+0000 7f5fd2324700 1 -- 172.21.15.32:0/1005526053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc80095f0 con 0x7f5fcc0ff140 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.429+0000 7f5fd2324700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 0x7f5fcc069990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800bda0 tx=0x7f5fc800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.429+0000 7f5fc37fe700 1 -- 172.21.15.32:0/1005526053 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fc801d070 con 0x7f5fcc0ff140 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.429+0000 7f5fc37fe700 1 -- 172.21.15.32:0/1005526053 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fc8022470 con 0x7f5fcc0ff140 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.429+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc19b120 con 0x7f5fcc0ff140 2024-05-06T21:20:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.429+0000 7f5fc37fe700 1 -- 172.21.15.32:0/1005526053 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fc800f670 con 0x7f5fcc0ff140 2024-05-06T21:20:51.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.429+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc19b610 con 0x7f5fcc0ff140 2024-05-06T21:20:51.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.430+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc107c90 con 0x7f5fcc0ff140 2024-05-06T21:20:51.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.431+0000 7f5fc37fe700 1 -- 172.21.15.32:0/1005526053 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f5fc8004af0 con 0x7f5fcc0ff140 2024-05-06T21:20:51.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.431+0000 7f5fc37fe700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5fb806c600 0x7f5fb806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:20:51.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.431+0000 7f5fd1b23700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5fb806c600 0x7f5fb806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:20:51.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.431+0000 7f5fc37fe700 1 -- 172.21.15.32:0/1005526053 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f5fc808c160 con 0x7f5fcc0ff140 2024-05-06T21:20:51.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.432+0000 7f5fd1b23700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5fb806c600 0x7f5fb806eab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc069ef0 tx=0x7f5fbc00a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:20:51.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.436+0000 7f5fc37fe700 1 -- 172.21.15.32:0/1005526053 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5fc805b050 con 0x7f5fcc0ff140 2024-05-06T21:20:51.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:20:51.646+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fcc104c90 con 0x7f5fb806c600 2024-05-06T21:20:51.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:20:51.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:20:51.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:52.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:20:52.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:20:52.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:52.869 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:52 smithi032 ceph-mon[27179]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:52.869 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:52 smithi032 ceph-mon[27179]: from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:20:52.869 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:52 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:53.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:52 smithi154 ceph-mon[32880]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:53.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:52 smithi154 ceph-mon[32880]: from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:20:53.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:52 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: Detected new or changed devices on smithi032 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: Adjusting osd_memory_target on smithi032 to 5922M 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:53.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:53 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:20:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: Detected new or changed devices on smithi032 2024-05-06T21:20:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:20:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:20:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: Adjusting osd_memory_target on smithi032 to 5922M 2024-05-06T21:20:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:20:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:53.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:53 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:20:54.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:54 smithi032 ceph-mon[27179]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:55.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:54 smithi154 ceph-mon[32880]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:55.897 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:55.897 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:55.897 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:55 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2633171082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e41022aa-de8c-45d9-aa0e-a1918b23fb86"}]: dispatch 2024-05-06T21:20:55.897 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:55 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2633171082' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e41022aa-de8c-45d9-aa0e-a1918b23fb86"}]': finished 2024-05-06T21:20:55.898 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:55 smithi032 ceph-mon[27179]: osdmap e16: 3 total, 2 up, 3 in 2024-05-06T21:20:55.898 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:20:55.898 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:55 smithi032 ceph-mon[27179]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:55.898 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:55 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/888790502' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:20:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:55 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2633171082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e41022aa-de8c-45d9-aa0e-a1918b23fb86"}]: dispatch 2024-05-06T21:20:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:55 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2633171082' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e41022aa-de8c-45d9-aa0e-a1918b23fb86"}]': finished 2024-05-06T21:20:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:55 smithi154 ceph-mon[32880]: osdmap e16: 3 total, 2 up, 3 in 2024-05-06T21:20:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:20:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:55 smithi154 ceph-mon[32880]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:55 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/888790502' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:20:57.923 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:57 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:20:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:20:58.701 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:58 smithi032 ceph-mon[27179]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:58.701 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:58.701 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:58.701 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:58.701 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:20:58.701 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:20:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:58.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:58 smithi154 ceph-mon[32880]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:20:58.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:58.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:20:58.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:20:58.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:20:58.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:20:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:00.948 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:00 smithi032 ceph-mon[27179]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:01.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:00 smithi154 ceph-mon[32880]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:02.959 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:02 smithi032 ceph-mon[27179]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:02.960 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T21:21:02.960 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:03.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:02 smithi154 ceph-mon[32880]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:03.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T21:21:03.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:03.947 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:03 smithi032 ceph-mon[27179]: Deploying daemon osd.2 on smithi032 2024-05-06T21:21:04.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:03 smithi154 ceph-mon[32880]: Deploying daemon osd.2 on smithi032 2024-05-06T21:21:04.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:04 smithi032 ceph-mon[27179]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:05.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:04 smithi154 ceph-mon[32880]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:06.099 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:05 smithi032 ceph-mon[27179]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:06.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:05 smithi154 ceph-mon[32880]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:08 smithi032 ceph-mon[27179]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:08.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:09.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:08 smithi154 ceph-mon[32880]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:09.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:09.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:09.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:10.869 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:10 smithi032 ceph-mon[27179]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:10.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.901+0000 7f5fc37fe700 1 -- 172.21.15.32:0/1005526053 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5fcc104c90 con 0x7f5fb806c600 2024-05-06T21:21:10.905 INFO:teuthology.orchestra.run.smithi032.stdout:Created osd(s) 2 on host 'smithi032' 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.903+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5fb806c600 msgr2=0x7f5fb806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.903+0000 7f5fd4588700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5fb806c600 0x7f5fb806eab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc069ef0 tx=0x7f5fbc00a380 comp rx=0 tx=0).stop 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.903+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 msgr2=0x7f5fcc069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.903+0000 7f5fd4588700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 0x7f5fcc069990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800bda0 tx=0x7f5fc800bdd0 comp rx=0 tx=0).stop 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.904+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 shutdown_connections 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.904+0000 7f5fd4588700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5fb806c600 0x7f5fb806eab0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.904+0000 7f5fd4588700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fcc0ff140 0x7f5fcc069990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.904+0000 7f5fd4588700 1 --2- 172.21.15.32:0/1005526053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc100340 0x7f5fcc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.904+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 >> 172.21.15.32:0/1005526053 conn(0x7f5fcc0fa6d0 msgr2=0x7f5fcc103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:21:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.904+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 shutdown_connections 2024-05-06T21:21:10.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:21:10.904+0000 7f5fd4588700 1 -- 172.21.15.32:0/1005526053 wait complete. 2024-05-06T21:21:11.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:10 smithi154 ceph-mon[32880]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:11.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:11 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:11 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:11 smithi032 ceph-mon[27179]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:11 smithi032 ceph-mon[27179]: from='osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T21:21:12.050 DEBUG:teuthology.orchestra.run.smithi032:osd.2> sudo journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.2.service 2024-05-06T21:21:12.052 INFO:tasks.cephadm:Deploying osd.3 on smithi154 with /dev/vg_nvme/lv_4... 2024-05-06T21:21:12.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-06T21:21:12.271 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi154/config 2024-05-06T21:21:12.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:11 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:12.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:11 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:12.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:11 smithi154 ceph-mon[32880]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:12.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:11 smithi154 ceph-mon[32880]: from='osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T21:21:13.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:12 smithi154 ceph-mon[32880]: from='osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T21:21:13.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:12 smithi154 ceph-mon[32880]: osdmap e17: 3 total, 2 up, 3 in 2024-05-06T21:21:13.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:12 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:13.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:12 smithi154 ceph-mon[32880]: from='osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:21:13.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:12 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:21:13.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:12 smithi032 ceph-mon[27179]: from='osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T21:21:13.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:12 smithi032 ceph-mon[27179]: osdmap e17: 3 total, 2 up, 3 in 2024-05-06T21:21:13.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:13.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:12 smithi032 ceph-mon[27179]: from='osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:21:13.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:21:13.224 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:12 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[53260]: 2024-05-06T21:21:12.910+0000 7f4730d78700 -1 osd.2 0 waiting for initial osdmap 2024-05-06T21:21:13.224 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:12 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[53260]: 2024-05-06T21:21:12.917+0000 7f472b36a700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:21:13.995 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-06T21:21:13.995 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-06T21:21:13.995 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-05-06T21:21:13.995 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-05-06T21:21:13.995 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127805 s, 820 MB/s 2024-05-06T21:21:13.995 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-05-06T21:21:14.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:13 smithi032 ceph-mon[27179]: from='osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2024-05-06T21:21:14.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:13 smithi032 ceph-mon[27179]: osdmap e18: 3 total, 2 up, 3 in 2024-05-06T21:21:14.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:13 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:14.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:13 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:14.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:13 smithi032 ceph-mon[27179]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:14.283 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:13 smithi154 ceph-mon[32880]: from='osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2024-05-06T21:21:14.284 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:13 smithi154 ceph-mon[32880]: osdmap e18: 3 total, 2 up, 3 in 2024-05-06T21:21:14.284 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:13 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:14.284 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:13 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:14.284 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:13 smithi154 ceph-mon[32880]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-06T21:21:14.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-05-06T21:21:14.788 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi154/config 2024-05-06T21:21:14.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:14 smithi032 ceph-mon[27179]: purged_snaps scrub starts 2024-05-06T21:21:14.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:14 smithi032 ceph-mon[27179]: purged_snaps scrub ok 2024-05-06T21:21:14.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:14 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:14.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:14 smithi032 ceph-mon[27179]: osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] boot 2024-05-06T21:21:14.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:14 smithi032 ceph-mon[27179]: osdmap e19: 3 total, 3 up, 3 in 2024-05-06T21:21:14.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:14 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:15.193 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:14 smithi154 ceph-mon[32880]: purged_snaps scrub starts 2024-05-06T21:21:15.193 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:14 smithi154 ceph-mon[32880]: purged_snaps scrub ok 2024-05-06T21:21:15.193 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:14 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:15.194 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:14 smithi154 ceph-mon[32880]: osd.2 [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] boot 2024-05-06T21:21:15.194 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:14 smithi154 ceph-mon[32880]: osdmap e19: 3 total, 3 up, 3 in 2024-05-06T21:21:15.194 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:14 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:21:16.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:16 smithi032 ceph-mon[27179]: osdmap e20: 3 total, 3 up, 3 in 2024-05-06T21:21:16.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:16.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:16 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:16.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.234+0000 7fc8d150a700 1 -- 172.21.15.154:0/3091383338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 msgr2=0x7fc8cc0ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:21:16.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.234+0000 7fc8d150a700 1 --2- 172.21.15.154:0/3091383338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 0x7fc8cc0ff550 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009910 tx=0x7fc8bc009c20 comp rx=0 tx=0).stop 2024-05-06T21:21:16.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.234+0000 7fc8d150a700 1 -- 172.21.15.154:0/3091383338 shutdown_connections 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.234+0000 7fc8d150a700 1 --2- 172.21.15.154:0/3091383338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8cc100340 0x7fc8cc100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.234+0000 7fc8d150a700 1 --2- 172.21.15.154:0/3091383338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 0x7fc8cc0ff550 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.234+0000 7fc8d150a700 1 -- 172.21.15.154:0/3091383338 >> 172.21.15.154:0/3091383338 conn(0x7fc8cc0fa6d0 msgr2=0x7fc8cc0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.234+0000 7fc8d150a700 1 -- 172.21.15.154:0/3091383338 shutdown_connections 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.234+0000 7fc8d150a700 1 -- 172.21.15.154:0/3091383338 wait complete. 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8d150a700 1 Processor -- start 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8d150a700 1 -- start start 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8d150a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 0x7fc8cc197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8d150a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8cc100340 0x7fc8cc198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8d150a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc198870 con 0x7fc8cc100340 2024-05-06T21:21:16.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8d150a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc19d280 con 0x7fc8cc0ff140 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8caffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 0x7fc8cc197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8caffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 0x7fc8cc197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47692/0 (socket says 172.21.15.154:47692) 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8caffd700 1 -- 172.21.15.154:0/2395359144 learned_addr learned my addr 172.21.15.154:0/2395359144 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8c27fc700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8cc100340 0x7fc8cc198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8caffd700 1 -- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8cc100340 msgr2=0x7fc8cc198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8caffd700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8cc100340 0x7fc8cc198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.235+0000 7fc8caffd700 1 -- 172.21.15.154:0/2395359144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0095f0 con 0x7fc8cc0ff140 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.236+0000 7fc8caffd700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 0x7fc8cc197d10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc000c00 tx=0x7fc8bc00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.236+0000 7fc8c8ff9700 1 -- 172.21.15.154:0/2395359144 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8bc01d070 con 0x7fc8cc0ff140 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.236+0000 7fc8c8ff9700 1 -- 172.21.15.154:0/2395359144 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8bc005dc0 con 0x7fc8cc0ff140 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.236+0000 7fc8c8ff9700 1 -- 172.21.15.154:0/2395359144 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8bc022470 con 0x7fc8cc0ff140 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.236+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc19d420 con 0x7fc8cc0ff140 2024-05-06T21:21:16.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.236+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc19d8e0 con 0x7fc8cc0ff140 2024-05-06T21:21:16.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.237+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc107cb0 con 0x7fc8cc0ff140 2024-05-06T21:21:16.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.237+0000 7fc8c8ff9700 1 -- 172.21.15.154:0/2395359144 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fc8bc003810 con 0x7fc8cc0ff140 2024-05-06T21:21:16.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.238+0000 7fc8c8ff9700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc8b806c600 0x7fc8b806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:21:16.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.238+0000 7fc8c8ff9700 1 -- 172.21.15.154:0/2395359144 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2846+0+0 (secure 0 0 0) 0x7fc8bc08c230 con 0x7fc8cc0ff140 2024-05-06T21:21:16.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.238+0000 7fc8c27fc700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc8b806c600 0x7fc8b806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:21:16.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.238+0000 7fc8c27fc700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc8b806c600 0x7fc8b806eab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009c60 tx=0x7fc8b4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:21:16.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.242+0000 7fc8c8ff9700 1 -- 172.21.15.154:0/2395359144 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc8bc057430 con 0x7fc8cc0ff140 2024-05-06T21:21:16.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:16 smithi154 ceph-mon[32880]: osdmap e20: 3 total, 3 up, 3 in 2024-05-06T21:21:16.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:16 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:16.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:16 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:16.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:16.438+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8cc19def0 con 0x7fc8b806c600 2024-05-06T21:21:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:17 smithi032 ceph-mon[27179]: pgmap v77: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:17.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:17 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-06T21:21:17.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:17 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-06T21:21:17.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:17 smithi032 ceph-mon[27179]: osdmap e21: 3 total, 3 up, 3 in 2024-05-06T21:21:17.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:17 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-06T21:21:17.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:17 smithi032 ceph-mon[27179]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:21:17.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:17 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:21:17.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:17 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:21:17.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:17 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:17.228 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:17 smithi154 ceph-mon[32880]: pgmap v77: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:17.228 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:17 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-06T21:21:17.228 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:17 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-06T21:21:17.228 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:17 smithi154 ceph-mon[32880]: osdmap e21: 3 total, 3 up, 3 in 2024-05-06T21:21:17.228 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:17 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-06T21:21:17.228 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:17 smithi154 ceph-mon[32880]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:21:17.228 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:17 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:21:17.229 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:17 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:21:17.229 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:17 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:18.620 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:18 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-06T21:21:18.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:18 smithi154 ceph-mon[32880]: osdmap e22: 3 total, 3 up, 3 in 2024-05-06T21:21:18.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:18 smithi154 ceph-mon[32880]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:18.691 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:18 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-06T21:21:18.691 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:18 smithi032 ceph-mon[27179]: osdmap e22: 3 total, 3 up, 3 in 2024-05-06T21:21:18.691 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:18 smithi032 ceph-mon[27179]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:18.976 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:21:18 smithi032 sudo[55532]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T21:21:18.976 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:21:18 smithi032 sudo[55532]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:18.976 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:21:18 smithi032 sudo[55532]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:18.976 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:21:18 smithi032 sudo[55532]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:19.476 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:21:19 smithi032 sudo[55671]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T21:21:19.476 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:21:19 smithi032 sudo[55671]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:19.476 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:21:19 smithi032 sudo[55671]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:19.476 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:21:19 smithi032 sudo[55671]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:19.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: osdmap e23: 3 total, 3 up, 3 in 2024-05-06T21:21:19.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: Detected new or changed devices on smithi032 2024-05-06T21:21:19.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: Adjusting osd_memory_target on smithi032 to 3948M 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/1796386063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11e127c4-f415-4261-9584-b53b7bfa8b06"}]: dispatch 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11e127c4-f415-4261-9584-b53b7bfa8b06"}]: dispatch 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11e127c4-f415-4261-9584-b53b7bfa8b06"}]': finished 2024-05-06T21:21:19.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: osdmap e24: 4 total, 3 up, 4 in 2024-05-06T21:21:19.478 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:19.478 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:19 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: osdmap e23: 3 total, 3 up, 3 in 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: Detected new or changed devices on smithi032 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: Adjusting osd_memory_target on smithi032 to 3948M 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:19.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:21:19.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:19.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='client.? 172.21.15.154:0/1796386063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11e127c4-f415-4261-9584-b53b7bfa8b06"}]: dispatch 2024-05-06T21:21:19.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11e127c4-f415-4261-9584-b53b7bfa8b06"}]: dispatch 2024-05-06T21:21:19.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11e127c4-f415-4261-9584-b53b7bfa8b06"}]': finished 2024-05-06T21:21:19.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: osdmap e24: 4 total, 3 up, 4 in 2024-05-06T21:21:19.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:19.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:19 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:19.976 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:21:19 smithi032 sudo[55696]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T21:21:19.976 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:21:19 smithi032 sudo[55696]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:19.976 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:21:19 smithi032 sudo[55696]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:19.976 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:21:19 smithi032 sudo[55696]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:20.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:20 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/2968397407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:21:20.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:20 smithi032 ceph-mon[27179]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:20.401 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:21:20 smithi032 sudo[55801]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T21:21:20.401 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:21:20 smithi032 sudo[55801]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:20.401 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:21:20 smithi032 sudo[55801]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:20.401 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:21:20 smithi032 sudo[55801]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:20.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:20.404+0000 7fc8c8ff9700 1 -- 172.21.15.154:0/2395359144 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc8bc057800 con 0x7fc8cc0ff140 2024-05-06T21:21:20.726 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:20 smithi032 sudo[55826]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T21:21:20.726 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:20 smithi032 sudo[55826]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:20.726 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:20 smithi032 sudo[55826]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:20.726 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:20 smithi032 sudo[55826]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:20.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:20 smithi154 ceph-mon[32880]: from='client.? 172.21.15.154:0/2968397407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:21:20.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:20 smithi154 ceph-mon[32880]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:21.466 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55885]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T21:21:21.466 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55885]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:21.466 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55885]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:21.466 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55885]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:21.716 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55921]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T21:21:21.716 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55921]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:21.717 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55921]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:21.717 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55921]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:21.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55981]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T21:21:21.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55981]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:21.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55981]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:21.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 sudo[55981]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:21.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 ceph-mon[27179]: mgrmap e19: smithi032.ecoohh(active, since 2m), standbys: smithi154.kilvol 2024-05-06T21:21:21.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:21 smithi032 ceph-mon[27179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T21:21:22.189 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:21 smithi154 ceph-mon[32880]: mgrmap e19: smithi032.ecoohh(active, since 2m), standbys: smithi154.kilvol 2024-05-06T21:21:22.189 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:21 smithi154 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T21:21:22.189 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 sudo[37890]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T21:21:22.190 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 sudo[37890]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:22.190 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 sudo[37890]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:22.190 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 sudo[37890]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:22.620 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 sudo[38084]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T21:21:22.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 sudo[38084]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-06T21:21:22.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 sudo[38084]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T21:21:22.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 sudo[38084]: pam_unix(sudo:session): session closed for user root 2024-05-06T21:21:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:22 smithi032 ceph-mon[27179]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:22 smithi032 ceph-mon[27179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T21:21:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:21:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:21:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:22 smithi032 ceph-mon[27179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T21:21:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:21:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:21:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:22 smithi032 ceph-mon[27179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T21:21:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:23.273 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 ceph-mon[32880]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:23.274 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T21:21:23.274 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:21:23.274 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:21:23.274 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T21:21:23.274 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:21:23.274 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:21:23.274 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T21:21:23.274 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:24.456 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:24.456 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:24.457 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:24 smithi154 ceph-mon[32880]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:24.457 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:24.457 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:21:24.457 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:24.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:24.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:24.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:24 smithi032 ceph-mon[27179]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:24.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:24.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:21:24.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:26.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:25 smithi154 ceph-mon[32880]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:26.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:25 smithi032 ceph-mon[27179]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:27.098 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:26 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T21:21:27.098 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:26 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:27.098 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:26 smithi154 ceph-mon[32880]: Deploying daemon osd.3 on smithi154 2024-05-06T21:21:27.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:26 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T21:21:27.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:26 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:27.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:26 smithi032 ceph-mon[27179]: Deploying daemon osd.3 on smithi154 2024-05-06T21:21:27.957 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:27 smithi154 ceph-mon[32880]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-06T21:21:27.957 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:27 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:21:28.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:27 smithi032 ceph-mon[27179]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-06T21:21:28.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:27 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:21:30.761 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:30 smithi154 ceph-mon[32880]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-05-06T21:21:30.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:30 smithi032 ceph-mon[27179]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-05-06T21:21:32.915 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:32 smithi154 ceph-mon[32880]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-06T21:21:32.916 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:32.916 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:32.916 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:32.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:32 smithi032 ceph-mon[27179]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-06T21:21:32.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:32.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:32.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:34.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:34 smithi032 ceph-mon[27179]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T21:21:34.767 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:34 smithi154 ceph-mon[32880]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T21:21:34.811 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 3 on host 'smithi154' 2024-05-06T21:21:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.807+0000 7fc8c8ff9700 1 -- 172.21.15.154:0/2395359144 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc8cc19def0 con 0x7fc8b806c600 2024-05-06T21:21:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc8b806c600 msgr2=0x7fc8b806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:21:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc8b806c600 0x7fc8b806eab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009c60 tx=0x7fc8b4009260 comp rx=0 tx=0).stop 2024-05-06T21:21:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 msgr2=0x7fc8cc197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:21:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 0x7fc8cc197d10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc000c00 tx=0x7fc8bc00f690 comp rx=0 tx=0).stop 2024-05-06T21:21:34.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 shutdown_connections 2024-05-06T21:21:34.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc8b806c600 0x7fc8b806eab0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:34.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8cc0ff140 0x7fc8cc197d10 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:34.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 --2- 172.21.15.154:0/2395359144 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8cc100340 0x7fc8cc198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:34.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 >> 172.21.15.154:0/2395359144 conn(0x7fc8cc0fa6d0 msgr2=0x7fc8cc068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:21:34.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 shutdown_connections 2024-05-06T21:21:34.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:34.811+0000 7fc8d150a700 1 -- 172.21.15.154:0/2395359144 wait complete. 2024-05-06T21:21:35.442 DEBUG:teuthology.orchestra.run.smithi154:osd.3> sudo journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.3.service 2024-05-06T21:21:35.445 INFO:tasks.cephadm:Deploying osd.4 on smithi154 with /dev/vg_nvme/lv_3... 2024-05-06T21:21:35.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-06T21:21:35.692 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:21:35 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[38981]: 2024-05-06T21:21:35.530+0000 7f2ce1dae640 -1 osd.3 0 log_to_monitors true 2024-05-06T21:21:36.114 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:35 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:36.114 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:35 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:36.114 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:35 smithi032 ceph-mon[27179]: from='osd.3 [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T21:21:36.114 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:35 smithi032 ceph-mon[27179]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T21:21:36.114 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:35 smithi032 ceph-mon[27179]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T21:21:36.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:35 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:36.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:35 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:36.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:35 smithi154 ceph-mon[32880]: from='osd.3 [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T21:21:36.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:35 smithi154 ceph-mon[32880]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T21:21:36.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:35 smithi154 ceph-mon[32880]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T21:21:36.183 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi154/config 2024-05-06T21:21:36.914 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:21:36 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[38981]: 2024-05-06T21:21:36.840+0000 7f2cd6c24700 -1 osd.3 0 waiting for initial osdmap 2024-05-06T21:21:36.914 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:21:36 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[38981]: 2024-05-06T21:21:36.846+0000 7f2cd1216700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:21:36.915 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:36 smithi154 ceph-mon[32880]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T21:21:36.915 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:36 smithi154 ceph-mon[32880]: osdmap e25: 4 total, 3 up, 4 in 2024-05-06T21:21:36.915 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:36 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:36.915 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:36 smithi154 ceph-mon[32880]: from='osd.3 [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:21:36.915 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:36 smithi154 ceph-mon[32880]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:21:36.915 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:36 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:36.915 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:36 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:37.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:36 smithi032 ceph-mon[27179]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T21:21:37.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:36 smithi032 ceph-mon[27179]: osdmap e25: 4 total, 3 up, 4 in 2024-05-06T21:21:37.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:36 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:37.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:36 smithi032 ceph-mon[27179]: from='osd.3 [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:21:37.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:36 smithi032 ceph-mon[27179]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:21:37.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:36 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:37.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:36 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-06T21:21:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-06T21:21:37.980 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-05-06T21:21:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-05-06T21:21:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0140029 s, 749 MB/s 2024-05-06T21:21:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-05-06T21:21:37.980 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:37 smithi154 ceph-mon[32880]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-06T21:21:37.980 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:37 smithi154 ceph-mon[32880]: osdmap e26: 4 total, 3 up, 4 in 2024-05-06T21:21:37.980 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:37 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:37.980 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:37 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:37.980 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:37 smithi154 ceph-mon[32880]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:38.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:37 smithi032 ceph-mon[27179]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-06T21:21:38.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:37 smithi032 ceph-mon[27179]: osdmap e26: 4 total, 3 up, 4 in 2024-05-06T21:21:38.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:37 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:38.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:37 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:38.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:37 smithi032 ceph-mon[27179]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-06T21:21:38.943 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:38 smithi154 ceph-mon[32880]: purged_snaps scrub starts 2024-05-06T21:21:38.943 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:38 smithi154 ceph-mon[32880]: purged_snaps scrub ok 2024-05-06T21:21:38.943 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:38 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:38.944 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:38 smithi154 ceph-mon[32880]: osd.3 [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] boot 2024-05-06T21:21:38.944 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:38 smithi154 ceph-mon[32880]: osdmap e27: 4 total, 4 up, 4 in 2024-05-06T21:21:38.944 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:38 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:38.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-05-06T21:21:39.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:38 smithi032 ceph-mon[27179]: purged_snaps scrub starts 2024-05-06T21:21:39.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:38 smithi032 ceph-mon[27179]: purged_snaps scrub ok 2024-05-06T21:21:39.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:38 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:39.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:38 smithi032 ceph-mon[27179]: osd.3 [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] boot 2024-05-06T21:21:39.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:38 smithi032 ceph-mon[27179]: osdmap e27: 4 total, 4 up, 4 in 2024-05-06T21:21:39.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:38 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:21:39.279 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi154/config 2024-05-06T21:21:40.066 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:39 smithi154 ceph-mon[32880]: osdmap e28: 4 total, 4 up, 4 in 2024-05-06T21:21:40.067 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:39 smithi154 ceph-mon[32880]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:40.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:39 smithi032 ceph-mon[27179]: osdmap e28: 4 total, 4 up, 4 in 2024-05-06T21:21:40.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:39 smithi032 ceph-mon[27179]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:41.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:40 smithi154 ceph-mon[32880]: osdmap e29: 4 total, 4 up, 4 in 2024-05-06T21:21:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:21:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:21:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:40 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:41.152 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:40 smithi032 ceph-mon[27179]: osdmap e29: 4 total, 4 up, 4 in 2024-05-06T21:21:41.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:41.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:41.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:21:41.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:41.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:41.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:21:41.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:40 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.890+0000 7f98630fe700 1 -- 172.21.15.154:0/1256720723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 msgr2=0x7f985c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:21:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.890+0000 7f98630fe700 1 --2- 172.21.15.154:0/1256720723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 0x7f985c100860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9848009910 tx=0x7f9848009c20 comp rx=0 tx=0).stop 2024-05-06T21:21:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.890+0000 7f98630fe700 1 -- 172.21.15.154:0/1256720723 shutdown_connections 2024-05-06T21:21:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.890+0000 7f98630fe700 1 --2- 172.21.15.154:0/1256720723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 0x7f985c100860 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.890+0000 7f98630fe700 1 --2- 172.21.15.154:0/1256720723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f985c0ff150 0x7f985c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.890+0000 7f98630fe700 1 -- 172.21.15.154:0/1256720723 >> 172.21.15.154:0/1256720723 conn(0x7f985c0fa7a0 msgr2=0x7f985c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f98630fe700 1 -- 172.21.15.154:0/1256720723 shutdown_connections 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f98630fe700 1 -- 172.21.15.154:0/1256720723 wait complete. 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f98630fe700 1 Processor -- start 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f98630fe700 1 -- start start 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f98630fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f985c0ff150 0x7f985c103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f98630fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 0x7f985c1017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f98630fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c101d10 con 0x7f985c0ff150 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f98630fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c101e50 con 0x7f985c1003f0 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f985bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 0x7f985c1017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f985bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 0x7f985c1017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55078/0 (socket says 172.21.15.154:55078) 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.891+0000 7f985bfff700 1 -- 172.21.15.154:0/23927703 learned_addr learned my addr 172.21.15.154:0/23927703 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:21:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f9860e9a700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f985c0ff150 0x7f985c103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:21:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f985bfff700 1 -- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f985c0ff150 msgr2=0x7f985c103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:21:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f985bfff700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f985c0ff150 0x7f985c103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:21:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f985bfff700 1 -- 172.21.15.154:0/23927703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98480095f0 con 0x7f985c1003f0 2024-05-06T21:21:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f985bfff700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 0x7f985c1017d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f984800b5c0 tx=0x7f984800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:21:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f9859ffb700 1 -- 172.21.15.154:0/23927703 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984801d070 con 0x7f985c1003f0 2024-05-06T21:21:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c1020d0 con 0x7f985c1003f0 2024-05-06T21:21:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f9859ffb700 1 -- 172.21.15.154:0/23927703 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9848022470 con 0x7f985c1003f0 2024-05-06T21:21:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f9859ffb700 1 -- 172.21.15.154:0/23927703 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984800f690 con 0x7f985c1003f0 2024-05-06T21:21:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.892+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c1025c0 con 0x7f985c1003f0 2024-05-06T21:21:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.893+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c068ab0 con 0x7f985c1003f0 2024-05-06T21:21:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.894+0000 7f9859ffb700 1 -- 172.21.15.154:0/23927703 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9848004b70 con 0x7f985c1003f0 2024-05-06T21:21:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.894+0000 7f9859ffb700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f984c06c680 0x7f984c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:21:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.895+0000 7f9859ffb700 1 -- 172.21.15.154:0/23927703 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f984808c930 con 0x7f985c1003f0 2024-05-06T21:21:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.895+0000 7f9860e9a700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f984c06c680 0x7f984c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:21:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.895+0000 7f9860e9a700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f984c06c680 0x7f984c06eb30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9850006fd0 tx=0x7f9850008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:21:41.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:41.899+0000 7f9859ffb700 1 -- 172.21.15.154:0/23927703 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f984805b1f0 con 0x7f985c1003f0 2024-05-06T21:21:42.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:21:42.097+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f985c0694e0 con 0x7f984c06c680 2024-05-06T21:21:42.100 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:41 smithi154 ceph-mon[32880]: Detected new or changed devices on smithi154 2024-05-06T21:21:42.100 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:41 smithi154 ceph-mon[32880]: Adjusting osd_memory_target on smithi154 to 14912M 2024-05-06T21:21:42.100 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:41 smithi154 ceph-mon[32880]: osdmap e30: 4 total, 4 up, 4 in 2024-05-06T21:21:42.100 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:41 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:42.101 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:41 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:42.101 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:41 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:21:42.101 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:41 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:42.101 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:41 smithi154 ceph-mon[32880]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-06T21:21:42.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:41 smithi032 ceph-mon[27179]: Detected new or changed devices on smithi154 2024-05-06T21:21:42.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:41 smithi032 ceph-mon[27179]: Adjusting osd_memory_target on smithi154 to 14912M 2024-05-06T21:21:42.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:41 smithi032 ceph-mon[27179]: osdmap e30: 4 total, 4 up, 4 in 2024-05-06T21:21:42.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:41 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:42.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:41 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:42.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:41 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:21:42.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:41 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:42.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:41 smithi032 ceph-mon[27179]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-06T21:21:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:42 smithi154 ceph-mon[32880]: osdmap e31: 4 total, 4 up, 4 in 2024-05-06T21:21:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:42 smithi154 ceph-mon[32880]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:21:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:21:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:21:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:21:43.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:42 smithi032 ceph-mon[27179]: osdmap e31: 4 total, 4 up, 4 in 2024-05-06T21:21:43.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:42 smithi032 ceph-mon[27179]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:21:43.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:21:43.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:21:43.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:43.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:21:44.039 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:43 smithi154 ceph-mon[32880]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-05-06T21:21:44.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:43 smithi032 ceph-mon[27179]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-05-06T21:21:45.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:44 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/4017972030' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190cd663-20cb-49b3-84b0-345f665e068e"}]: dispatch 2024-05-06T21:21:45.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:44 smithi032 ceph-mon[27179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190cd663-20cb-49b3-84b0-345f665e068e"}]: dispatch 2024-05-06T21:21:45.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:44 smithi032 ceph-mon[27179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "190cd663-20cb-49b3-84b0-345f665e068e"}]': finished 2024-05-06T21:21:45.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:44 smithi032 ceph-mon[27179]: osdmap e32: 5 total, 4 up, 5 in 2024-05-06T21:21:45.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:44 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:21:45.270 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:44 smithi154 ceph-mon[32880]: from='client.? 172.21.15.154:0/4017972030' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190cd663-20cb-49b3-84b0-345f665e068e"}]: dispatch 2024-05-06T21:21:45.270 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:44 smithi154 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190cd663-20cb-49b3-84b0-345f665e068e"}]: dispatch 2024-05-06T21:21:45.270 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:44 smithi154 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "190cd663-20cb-49b3-84b0-345f665e068e"}]': finished 2024-05-06T21:21:45.270 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:44 smithi154 ceph-mon[32880]: osdmap e32: 5 total, 4 up, 5 in 2024-05-06T21:21:45.270 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:44 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:21:46.189 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:45 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/3501330184' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:21:46.189 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:45 smithi032 ceph-mon[27179]: pgmap v104: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-06T21:21:46.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:45 smithi154 ceph-mon[32880]: from='client.? 172.21.15.154:0/3501330184' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:21:46.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:45 smithi154 ceph-mon[32880]: pgmap v104: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-06T21:21:48.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:48 smithi154 ceph-mon[32880]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:48.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:48 smithi032 ceph-mon[27179]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:50.928 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:50 smithi154 ceph-mon[32880]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:50.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:50 smithi032 ceph-mon[27179]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:52.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:52 smithi032 ceph-mon[27179]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:52.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:52 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T21:21:52.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:52 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:53.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:52 smithi154 ceph-mon[32880]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:53.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:52 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T21:21:53.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:52 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:21:53.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:53 smithi032 ceph-mon[27179]: Deploying daemon osd.4 on smithi154 2024-05-06T21:21:53.980 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:53 smithi154 ceph-mon[32880]: Deploying daemon osd.4 on smithi154 2024-05-06T21:21:54.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:54 smithi032 ceph-mon[27179]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:54.991 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:54 smithi154 ceph-mon[32880]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:55 smithi154 ceph-mon[32880]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:56.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:55 smithi032 ceph-mon[27179]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:58.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:58.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:58.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:58.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:58 smithi154 ceph-mon[32880]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:58.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:21:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:21:58.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:58.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:21:58.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:21:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:58 smithi032 ceph-mon[27179]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:21:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:21:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:22:00.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:00 smithi154 ceph-mon[32880]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:22:00.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:00 smithi032 ceph-mon[27179]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:22:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.315+0000 7f9859ffb700 1 -- 172.21.15.154:0/23927703 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f985c0694e0 con 0x7f984c06c680 2024-05-06T21:22:01.319 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 4 on host 'smithi154' 2024-05-06T21:22:01.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f984c06c680 msgr2=0x7f984c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:01.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f984c06c680 0x7f984c06eb30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9850006fd0 tx=0x7f9850008040 comp rx=0 tx=0).stop 2024-05-06T21:22:01.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 msgr2=0x7f985c1017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:01.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 0x7f985c1017d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f984800b5c0 tx=0x7f984800be20 comp rx=0 tx=0).stop 2024-05-06T21:22:01.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 shutdown_connections 2024-05-06T21:22:01.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f984c06c680 0x7f984c06eb30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:01.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f985c0ff150 0x7f985c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 --2- 172.21.15.154:0/23927703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f985c1003f0 0x7f985c1017d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 >> 172.21.15.154:0/23927703 conn(0x7f985c0fa7a0 msgr2=0x7f985c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 shutdown_connections 2024-05-06T21:22:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:01.318+0000 7f98630fe700 1 -- 172.21.15.154:0/23927703 wait complete. 2024-05-06T21:22:01.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:01 smithi154 ceph-mon[32880]: from='osd.4 [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T21:22:01.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:01 smithi154 ceph-mon[32880]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T21:22:01.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:01 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:01.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:01 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:01.887 DEBUG:teuthology.orchestra.run.smithi154:osd.4> sudo journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.4.service 2024-05-06T21:22:01.890 INFO:tasks.cephadm:Deploying osd.5 on smithi154 with /dev/vg_nvme/lv_2... 2024-05-06T21:22:01.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-06T21:22:01.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:01 smithi032 ceph-mon[27179]: from='osd.4 [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T21:22:01.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:01 smithi032 ceph-mon[27179]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T21:22:01.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:01 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:01.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:01 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:02.148 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi154/config 2024-05-06T21:22:02.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:02 smithi154 ceph-mon[32880]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:22:02.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:02 smithi154 ceph-mon[32880]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T21:22:02.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:02 smithi154 ceph-mon[32880]: osdmap e33: 5 total, 4 up, 5 in 2024-05-06T21:22:02.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:22:02.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:02 smithi154 ceph-mon[32880]: from='osd.4 [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:22:02.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:02 smithi154 ceph-mon[32880]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:22:02.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:02.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:02.872 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:22:02 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[43600]: 2024-05-06T21:22:02.679+0000 7f4600d11700 -1 osd.4 0 waiting for initial osdmap 2024-05-06T21:22:02.872 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:22:02 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[43600]: 2024-05-06T21:22:02.686+0000 7f45f82fd700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:22:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:02 smithi032 ceph-mon[27179]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:22:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:02 smithi032 ceph-mon[27179]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T21:22:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:02 smithi032 ceph-mon[27179]: osdmap e33: 5 total, 4 up, 5 in 2024-05-06T21:22:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:22:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:02 smithi032 ceph-mon[27179]: from='osd.4 [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:22:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:02 smithi032 ceph-mon[27179]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:22:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:03.906 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:03 smithi154 ceph-mon[32880]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-06T21:22:03.906 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:03 smithi154 ceph-mon[32880]: osdmap e34: 5 total, 4 up, 5 in 2024-05-06T21:22:03.907 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:03 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:22:03.907 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:03 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:22:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-06T21:22:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-06T21:22:03.951 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-05-06T21:22:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-05-06T21:22:03.951 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123514 s, 849 MB/s 2024-05-06T21:22:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-05-06T21:22:03.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:03 smithi032 ceph-mon[27179]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-06T21:22:03.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:03 smithi032 ceph-mon[27179]: osdmap e34: 5 total, 4 up, 5 in 2024-05-06T21:22:03.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:22:03.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:22:04.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-05-06T21:22:04.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:04 smithi032 ceph-mon[27179]: purged_snaps scrub starts 2024-05-06T21:22:04.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:04 smithi032 ceph-mon[27179]: purged_snaps scrub ok 2024-05-06T21:22:04.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:04 smithi032 ceph-mon[27179]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:22:04.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:04 smithi032 ceph-mon[27179]: osd.4 [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] boot 2024-05-06T21:22:04.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:04 smithi032 ceph-mon[27179]: osdmap e35: 5 total, 5 up, 5 in 2024-05-06T21:22:04.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:04 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:22:05.060 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:04 smithi154 ceph-mon[32880]: purged_snaps scrub starts 2024-05-06T21:22:05.060 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:04 smithi154 ceph-mon[32880]: purged_snaps scrub ok 2024-05-06T21:22:05.060 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:04 smithi154 ceph-mon[32880]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-06T21:22:05.060 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:04 smithi154 ceph-mon[32880]: osd.4 [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] boot 2024-05-06T21:22:05.060 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:04 smithi154 ceph-mon[32880]: osdmap e35: 5 total, 5 up, 5 in 2024-05-06T21:22:05.060 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:04 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:22:05.671 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi154/config 2024-05-06T21:22:05.956 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:05 smithi154 ceph-mon[32880]: osdmap e36: 5 total, 5 up, 5 in 2024-05-06T21:22:05.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:05 smithi032 ceph-mon[27179]: osdmap e36: 5 total, 5 up, 5 in 2024-05-06T21:22:06.946 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:06 smithi154 ceph-mon[32880]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:06.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:06 smithi032 ceph-mon[27179]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.163+0000 7f99ebcb4700 1 -- 172.21.15.154:0/3626933000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e40ff130 msgr2=0x7f99e40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.163+0000 7f99ebcb4700 1 --2- 172.21.15.154:0/3626933000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e40ff130 0x7f99e40ff540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009910 tx=0x7f99d4009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.163+0000 7f99ebcb4700 1 -- 172.21.15.154:0/3626933000 shutdown_connections 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.163+0000 7f99ebcb4700 1 --2- 172.21.15.154:0/3626933000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99e41003d0 0x7f99e4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.163+0000 7f99ebcb4700 1 --2- 172.21.15.154:0/3626933000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e40ff130 0x7f99e40ff540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.163+0000 7f99ebcb4700 1 -- 172.21.15.154:0/3626933000 >> 172.21.15.154:0/3626933000 conn(0x7f99e40fa780 msgr2=0x7f99e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.163+0000 7f99ebcb4700 1 -- 172.21.15.154:0/3626933000 shutdown_connections 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.163+0000 7f99ebcb4700 1 -- 172.21.15.154:0/3626933000 wait complete. 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99ebcb4700 1 Processor -- start 2024-05-06T21:22:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99ebcb4700 1 -- start start 2024-05-06T21:22:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99ebcb4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99e40ff130 0x7f99e40690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99ebcb4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e41003d0 0x7f99e419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99ebcb4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e419ad30 con 0x7f99e40ff130 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99ebcb4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e419aea0 con 0x7f99e41003d0 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99e924f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e41003d0 0x7f99e419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99e924f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e41003d0 0x7f99e419a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38256/0 (socket says 172.21.15.154:38256) 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99e924f700 1 -- 172.21.15.154:0/48054592 learned_addr learned my addr 172.21.15.154:0/48054592 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.164+0000 7f99e9a50700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99e40ff130 0x7f99e40690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.165+0000 7f99e924f700 1 -- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99e40ff130 msgr2=0x7f99e40690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.165+0000 7f99e924f700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99e40ff130 0x7f99e40690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.165+0000 7f99e924f700 1 -- 172.21.15.154:0/48054592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40095f0 con 0x7f99e41003d0 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.165+0000 7f99e924f700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e41003d0 0x7f99e419a7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c930 tx=0x7f99e000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.165+0000 7f99daffd700 1 -- 172.21.15.154:0/48054592 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e0007ad0 con 0x7f99e41003d0 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.165+0000 7f99daffd700 1 -- 172.21.15.154:0/48054592 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f99e000ce80 con 0x7f99e41003d0 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.165+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e419b180 con 0x7f99e41003d0 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.165+0000 7f99daffd700 1 -- 172.21.15.154:0/48054592 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e0018630 con 0x7f99e41003d0 2024-05-06T21:22:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.165+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e419b6d0 con 0x7f99e41003d0 2024-05-06T21:22:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.166+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e4107c10 con 0x7f99e41003d0 2024-05-06T21:22:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.166+0000 7f99daffd700 1 -- 172.21.15.154:0/48054592 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f99e0007c30 con 0x7f99e41003d0 2024-05-06T21:22:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.167+0000 7f99daffd700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f99d006c680 0x7f99d006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.167+0000 7f99daffd700 1 -- 172.21.15.154:0/48054592 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f99e008b340 con 0x7f99e41003d0 2024-05-06T21:22:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.167+0000 7f99e9a50700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f99d006c680 0x7f99d006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:08.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.168+0000 7f99e9a50700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f99d006c680 0x7f99d006eb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99d400b5c0 tx=0x7f99d40052a0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.171+0000 7f99daffd700 1 -- 172.21.15.154:0/48054592 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f99e00599a0 con 0x7f99e41003d0 2024-05-06T21:22:08.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:08.371+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f99e419bdd0 con 0x7f99d006c680 2024-05-06T21:22:08.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: Detected new or changed devices on smithi154 2024-05-06T21:22:08.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: Adjusting osd_memory_target on smithi154 to 7456M 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:08.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:22:08.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.623 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:08 smithi154 ceph-mon[32880]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:08.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: Detected new or changed devices on smithi154 2024-05-06T21:22:08.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:08.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:08.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: Adjusting osd_memory_target on smithi154 to 7456M 2024-05-06T21:22:08.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:08.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:22:08.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:22:08.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:08.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:22:08.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:08.727 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:08 smithi032 ceph-mon[27179]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:09.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:09 smithi154 ceph-mon[32880]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:22:09.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:09 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:22:09.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:09 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:22:09.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:09 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:09.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:09 smithi032 ceph-mon[27179]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:22:09.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:09 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T21:22:09.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:09 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T21:22:09.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:09 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:10.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:10 smithi154 ceph-mon[32880]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:10.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:10 smithi032 ceph-mon[27179]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:11.620 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:11 smithi154 ceph-mon[32880]: from='client.? 172.21.15.154:0/2070067246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7655488e-f7b9-4902-b6d3-28f762d44a2d"}]: dispatch 2024-05-06T21:22:11.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:11 smithi154 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7655488e-f7b9-4902-b6d3-28f762d44a2d"}]: dispatch 2024-05-06T21:22:11.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:11 smithi154 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7655488e-f7b9-4902-b6d3-28f762d44a2d"}]': finished 2024-05-06T21:22:11.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:11 smithi154 ceph-mon[32880]: osdmap e37: 6 total, 5 up, 6 in 2024-05-06T21:22:11.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:11 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:11.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:11 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/2070067246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7655488e-f7b9-4902-b6d3-28f762d44a2d"}]: dispatch 2024-05-06T21:22:11.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:11 smithi032 ceph-mon[27179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7655488e-f7b9-4902-b6d3-28f762d44a2d"}]: dispatch 2024-05-06T21:22:11.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:11 smithi032 ceph-mon[27179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7655488e-f7b9-4902-b6d3-28f762d44a2d"}]': finished 2024-05-06T21:22:11.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:11 smithi032 ceph-mon[27179]: osdmap e37: 6 total, 5 up, 6 in 2024-05-06T21:22:11.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:11 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:12.620 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:12 smithi154 ceph-mon[32880]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:12.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:12 smithi154 ceph-mon[32880]: from='client.? 172.21.15.154:0/3636310990' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:22:12.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:12 smithi032 ceph-mon[27179]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:12.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:12 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/3636310990' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T21:22:13.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:13 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:22:13.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:13 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:22:14.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:14 smithi154 ceph-mon[32880]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:14.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:14 smithi032 ceph-mon[27179]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:16.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:15 smithi154 ceph-mon[32880]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:16.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:15 smithi032 ceph-mon[27179]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:18.827 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:18 smithi154 ceph-mon[32880]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:18.827 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:18 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T21:22:18.828 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:18 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:18.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:18 smithi032 ceph-mon[27179]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:18.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:18 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T21:22:18.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:18 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:19.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:19 smithi032 ceph-mon[27179]: Deploying daemon osd.5 on smithi154 2024-05-06T21:22:20.030 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:19 smithi154 ceph-mon[32880]: Deploying daemon osd.5 on smithi154 2024-05-06T21:22:20.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:20 smithi032 ceph-mon[27179]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:21.001 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:20 smithi154 ceph-mon[32880]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:22.931 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:22 smithi154 ceph-mon[32880]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:22 smithi032 ceph-mon[27179]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:24.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:24 smithi032 ceph-mon[27179]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:24.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:24.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:24.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:24 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:22:25.035 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:24 smithi154 ceph-mon[32880]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:25.036 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:25.036 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:25.036 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:24 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:22:26.051 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:25 smithi154 ceph-mon[32880]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:26.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:25 smithi032 ceph-mon[27179]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.296+0000 7f99daffd700 1 -- 172.21.15.154:0/48054592 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f99e419bdd0 con 0x7f99d006c680 2024-05-06T21:22:27.300 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 5 on host 'smithi154' 2024-05-06T21:22:27.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f99d006c680 msgr2=0x7f99d006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:27.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f99d006c680 0x7f99d006eb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99d400b5c0 tx=0x7f99d40052a0 comp rx=0 tx=0).stop 2024-05-06T21:22:27.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e41003d0 msgr2=0x7f99e419a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:27.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e41003d0 0x7f99e419a7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c930 tx=0x7f99e000cc40 comp rx=0 tx=0).stop 2024-05-06T21:22:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 shutdown_connections 2024-05-06T21:22:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f99d006c680 0x7f99d006eb30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99e40ff130 0x7f99e40690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 --2- 172.21.15.154:0/48054592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99e41003d0 0x7f99e419a7f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 >> 172.21.15.154:0/48054592 conn(0x7f99e40fa780 msgr2=0x7f99e4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 shutdown_connections 2024-05-06T21:22:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:27.299+0000 7f99ebcb4700 1 -- 172.21.15.154:0/48054592 wait complete. 2024-05-06T21:22:28.150 DEBUG:teuthology.orchestra.run.smithi154:osd.5> sudo journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.5.service 2024-05-06T21:22:28.153 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-05-06T21:22:28.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-06T21:22:28.386 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:28.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:28.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:28.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:28 smithi032 ceph-mon[27179]: from='osd.5 [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T21:22:28.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:28 smithi032 ceph-mon[27179]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T21:22:28.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:28 smithi032 ceph-mon[27179]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:28.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:28 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:22:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:28 smithi154 ceph-mon[32880]: from='osd.5 [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T21:22:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:28 smithi154 ceph-mon[32880]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T21:22:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:28 smithi154 ceph-mon[32880]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:28.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:28 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:22:29.538 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:29 smithi032 ceph-mon[27179]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T21:22:29.538 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:29 smithi032 ceph-mon[27179]: osdmap e38: 6 total, 5 up, 6 in 2024-05-06T21:22:29.538 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:29 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:29.538 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:29 smithi032 ceph-mon[27179]: from='osd.5 [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:22:29.538 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:29 smithi032 ceph-mon[27179]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:22:29.538 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:29 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:29.538 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:29 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:29.540 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:29 smithi154 ceph-mon[32880]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T21:22:29.540 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:29 smithi154 ceph-mon[32880]: osdmap e38: 6 total, 5 up, 6 in 2024-05-06T21:22:29.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:29 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:29.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:29 smithi154 ceph-mon[32880]: from='osd.5 [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:22:29.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:29 smithi154 ceph-mon[32880]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:22:29.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:29 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:29.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:29 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:29.541 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:22:29 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[48279]: 2024-05-06T21:22:29.282+0000 7f3377db7700 -1 osd.5 0 waiting for initial osdmap 2024-05-06T21:22:29.541 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:22:29 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[48279]: 2024-05-06T21:22:29.290+0000 7f336eba2700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:22:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.316+0000 7f4842f9a700 1 -- 172.21.15.32:0/4201328093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 msgr2=0x7f483c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.316+0000 7f4842f9a700 1 --2- 172.21.15.32:0/4201328093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 0x7f483c0ff540 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f482c009910 tx=0x7f482c009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.316+0000 7f4842f9a700 1 -- 172.21.15.32:0/4201328093 shutdown_connections 2024-05-06T21:22:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.316+0000 7f4842f9a700 1 --2- 172.21.15.32:0/4201328093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f483c1003d0 0x7f483c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.316+0000 7f4842f9a700 1 --2- 172.21.15.32:0/4201328093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 0x7f483c0ff540 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.316+0000 7f4842f9a700 1 -- 172.21.15.32:0/4201328093 >> 172.21.15.32:0/4201328093 conn(0x7f483c0fa780 msgr2=0x7f483c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.316+0000 7f4842f9a700 1 -- 172.21.15.32:0/4201328093 shutdown_connections 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.316+0000 7f4842f9a700 1 -- 172.21.15.32:0/4201328093 wait complete. 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4842f9a700 1 Processor -- start 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4842f9a700 1 -- start start 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4842f9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 0x7f483c1949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4842f9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f483c1003d0 0x7f483c194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4842f9a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c195510 con 0x7f483c0ff130 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4842f9a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c195650 con 0x7f483c1003d0 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4840d36700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 0x7f483c1949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4840d36700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 0x7f483c1949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54560/0 (socket says 172.21.15.32:54560) 2024-05-06T21:22:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4840d36700 1 -- 172.21.15.32:0/625015796 learned_addr learned my addr 172.21.15.32:0/625015796 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f483bfff700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f483c1003d0 0x7f483c194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.317+0000 7f4840d36700 1 -- 172.21.15.32:0/625015796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f483c1003d0 msgr2=0x7f483c194ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.318+0000 7f4840d36700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f483c1003d0 0x7f483c194ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.318+0000 7f4840d36700 1 -- 172.21.15.32:0/625015796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0095f0 con 0x7f483c0ff130 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.318+0000 7f4840d36700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 0x7f483c1949b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f482c006010 tx=0x7f482c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.318+0000 7f4839ffb700 1 -- 172.21.15.32:0/625015796 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f482c01d070 con 0x7f483c0ff130 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.318+0000 7f4839ffb700 1 -- 172.21.15.32:0/625015796 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f482c00f460 con 0x7f483c0ff130 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.318+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c19a0a0 con 0x7f483c0ff130 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.318+0000 7f4839ffb700 1 -- 172.21.15.32:0/625015796 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f482c021640 con 0x7f483c0ff130 2024-05-06T21:22:30.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.318+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c19a590 con 0x7f483c0ff130 2024-05-06T21:22:30.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.319+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c107c10 con 0x7f483c0ff130 2024-05-06T21:22:30.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.320+0000 7f4839ffb700 1 -- 172.21.15.32:0/625015796 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f482c00fab0 con 0x7f483c0ff130 2024-05-06T21:22:30.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.320+0000 7f4839ffb700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f482806c680 0x7f482806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:30.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.320+0000 7f4839ffb700 1 -- 172.21.15.32:0/625015796 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f482c08c7c0 con 0x7f483c0ff130 2024-05-06T21:22:30.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.320+0000 7f483bfff700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f482806c680 0x7f482806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:30.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.321+0000 7f483bfff700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f482806c680 0x7f482806eb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4824009550 tx=0x7f48240091b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:30.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.325+0000 7f4839ffb700 1 -- 172.21.15.32:0/625015796 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f482c05ac70 con 0x7f483c0ff130 2024-05-06T21:22:30.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:30 smithi032 ceph-mon[27179]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-06T21:22:30.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:30 smithi032 ceph-mon[27179]: osdmap e39: 6 total, 5 up, 6 in 2024-05-06T21:22:30.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:30 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:30.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:30 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:30.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:30 smithi032 ceph-mon[27179]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:30.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.527+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f483c107dd0 con 0x7f483c0ff130 2024-05-06T21:22:30.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.528+0000 7f4839ffb700 1 -- 172.21.15.32:0/625015796 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f482c05a800 con 0x7f483c0ff130 2024-05-06T21:22:30.530 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:22:30.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.529+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f482806c680 msgr2=0x7f482806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:30.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.529+0000 7f4842f9a700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f482806c680 0x7f482806eb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4824009550 tx=0x7f48240091b0 comp rx=0 tx=0).stop 2024-05-06T21:22:30.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.530+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 msgr2=0x7f483c1949b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:30.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.530+0000 7f4842f9a700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 0x7f483c1949b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f482c006010 tx=0x7f482c00bd70 comp rx=0 tx=0).stop 2024-05-06T21:22:30.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.530+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 shutdown_connections 2024-05-06T21:22:30.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.530+0000 7f4842f9a700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f482806c680 0x7f482806eb30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:30.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.530+0000 7f4842f9a700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f483c0ff130 0x7f483c1949b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:30.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.530+0000 7f4842f9a700 1 --2- 172.21.15.32:0/625015796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f483c1003d0 0x7f483c194ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:30.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.530+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 >> 172.21.15.32:0/625015796 conn(0x7f483c0fa780 msgr2=0x7f483c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:30.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.530+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 shutdown_connections 2024-05-06T21:22:30.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:30.530+0000 7f4842f9a700 1 -- 172.21.15.32:0/625015796 wait complete. 2024-05-06T21:22:30.545 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:30 smithi154 ceph-mon[32880]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-06T21:22:30.545 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:30 smithi154 ceph-mon[32880]: osdmap e39: 6 total, 5 up, 6 in 2024-05-06T21:22:30.545 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:30 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:30.545 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:30 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:30.545 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:30 smithi154 ceph-mon[32880]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-05-06T21:22:31.363 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1715030550,"num_in_osds":6,"osd_in_since":1715030530,"num_remapped_pgs":0} 2024-05-06T21:22:31.363 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-06T21:22:31.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:31 smithi154 ceph-mon[32880]: purged_snaps scrub starts 2024-05-06T21:22:31.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:31 smithi154 ceph-mon[32880]: purged_snaps scrub ok 2024-05-06T21:22:31.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:31 smithi154 ceph-mon[32880]: osd.5 [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] boot 2024-05-06T21:22:31.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:31 smithi154 ceph-mon[32880]: osdmap e40: 6 total, 6 up, 6 in 2024-05-06T21:22:31.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:31 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:31.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:31 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/625015796' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-06T21:22:31.585 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:31.707 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:31 smithi032 ceph-mon[27179]: purged_snaps scrub starts 2024-05-06T21:22:31.708 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:31 smithi032 ceph-mon[27179]: purged_snaps scrub ok 2024-05-06T21:22:31.708 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:31 smithi032 ceph-mon[27179]: osd.5 [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] boot 2024-05-06T21:22:31.708 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:31 smithi032 ceph-mon[27179]: osdmap e40: 6 total, 6 up, 6 in 2024-05-06T21:22:31.708 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:31 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:22:31.708 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:31 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/625015796' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-06T21:22:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: osdmap e41: 6 total, 6 up, 6 in 2024-05-06T21:22:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:32.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:32.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:32.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:22:32.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:32.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:22:32.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:32.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:22:32.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:32.696 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: osdmap e41: 6 total, 6 up, 6 in 2024-05-06T21:22:32.696 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:32.696 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:32.696 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:32.696 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:22:32.697 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:22:33.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.319+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1154437385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d8100e60 msgr2=0x7fb1d8104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:33.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.319+0000 7fb1dd50a700 1 --2- 172.21.15.32:0/1154437385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d8100e60 0x7fb1d8104e30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009910 tx=0x7fb1cc009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:33.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.319+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1154437385 shutdown_connections 2024-05-06T21:22:33.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.319+0000 7fb1dd50a700 1 --2- 172.21.15.32:0/1154437385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d8100e60 0x7fb1d8104e30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:33.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.319+0000 7fb1dd50a700 1 --2- 172.21.15.32:0/1154437385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d81004c0 0x7fb1d8100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:33.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.319+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1154437385 >> 172.21.15.32:0/1154437385 conn(0x7fb1d80fbd80 msgr2=0x7fb1d80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:33.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.319+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1154437385 shutdown_connections 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.319+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1154437385 wait complete. 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.320+0000 7fb1dd50a700 1 Processor -- start 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.320+0000 7fb1dd50a700 1 -- start start 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.320+0000 7fb1dd50a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81004c0 0x7fb1d8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.320+0000 7fb1dd50a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d8100e60 0x7fb1d8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.320+0000 7fb1dd50a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8073ad0 con 0x7fb1d81004c0 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.320+0000 7fb1dd50a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8073c10 con 0x7fb1d8100e60 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.320+0000 7fb1d6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81004c0 0x7fb1d8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.320+0000 7fb1d6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81004c0 0x7fb1d8073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48104/0 (socket says 172.21.15.32:48104) 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.320+0000 7fb1d6ffd700 1 -- 172.21.15.32:0/1483617849 learned_addr learned my addr 172.21.15.32:0/1483617849 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1d67fc700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d8100e60 0x7fb1d8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1d6ffd700 1 -- 172.21.15.32:0/1483617849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d8100e60 msgr2=0x7fb1d8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1d6ffd700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d8100e60 0x7fb1d8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:33.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1d6ffd700 1 -- 172.21.15.32:0/1483617849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc0095f0 con 0x7fb1d81004c0 2024-05-06T21:22:33.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1d6ffd700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81004c0 0x7fb1d8073050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800cfd0 tx=0x7fb1c800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:33.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1bffff700 1 -- 172.21.15.32:0/1483617849 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c800ad70 con 0x7fb1d81004c0 2024-05-06T21:22:33.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1bffff700 1 -- 172.21.15.32:0/1483617849 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb1c8007e70 con 0x7fb1d81004c0 2024-05-06T21:22:33.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d81a20c0 con 0x7fb1d81004c0 2024-05-06T21:22:33.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1bffff700 1 -- 172.21.15.32:0/1483617849 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c8011810 con 0x7fb1d81004c0 2024-05-06T21:22:33.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.321+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d81a2420 con 0x7fb1d81004c0 2024-05-06T21:22:33.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.322+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d8108830 con 0x7fb1d81004c0 2024-05-06T21:22:33.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.323+0000 7fb1bffff700 1 -- 172.21.15.32:0/1483617849 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb1c8012420 con 0x7fb1d81004c0 2024-05-06T21:22:33.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.323+0000 7fb1bffff700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb1c006c680 0x7fb1c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:33.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.323+0000 7fb1bffff700 1 -- 172.21.15.32:0/1483617849 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb1c808b5a0 con 0x7fb1d81004c0 2024-05-06T21:22:33.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.323+0000 7fb1d67fc700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb1c006c680 0x7fb1c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:33.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.324+0000 7fb1d67fc700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb1c006c680 0x7fb1c006eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8074840 tx=0x7fb1cc01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:33.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.328+0000 7fb1bffff700 1 -- 172.21.15.32:0/1483617849 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb1c8055fc0 con 0x7fb1d81004c0 2024-05-06T21:22:33.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.530+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1d804f2a0 con 0x7fb1d81004c0 2024-05-06T21:22:33.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.531+0000 7fb1bffff700 1 -- 172.21.15.32:0/1483617849 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11327 (secure 0 0 0) 0x7fb1c80595e0 con 0x7fb1d81004c0 2024-05-06T21:22:33.533 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:22:33.533 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":41,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","created":"2024-05-06T21:16:43.886575+0000","modified":"2024-05-06T21:22:31.285629+0000","last_up_change":"2024-05-06T21:22:30.280541+0000","last_in_change":"2024-05-06T21:22:10.894148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T21:21:16.105413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0095c3fd-9b90-4d23-b192-98fd9a06c20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6803","nonce":1973178361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6805","nonce":1973178361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6809","nonce":1973178361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6807","nonce":1973178361}]},"public_addr":"172.21.15.32:6803/1973178361","cluster_addr":"172.21.15.32:6805/1973178361","heartbeat_back_addr":"172.21.15.32:6809/1973178361","heartbeat_front_addr":"172.21.15.32:6807/1973178361","state":["exists","up"]},{"osd":1,"uuid":"0d37de85-e43f-4094-ba6a-00a09047798a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6811","nonce":3464551315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6813","nonce":3464551315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6817","nonce":3464551315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6815","nonce":3464551315}]},"public_addr":"172.21.15.32:6811/3464551315","cluster_addr":"172.21.15.32:6813/3464551315","heartbeat_back_addr":"172.21.15.32:6817/3464551315","heartbeat_front_addr":"172.21.15.32:6815/3464551315","state":["exists","up"]},{"osd":2,"uuid":"e41022aa-de8c-45d9-aa0e-a1918b23fb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6819","nonce":317848821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6821","nonce":317848821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6825","nonce":317848821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6823","nonce":317848821}]},"public_addr":"172.21.15.32:6819/317848821","cluster_addr":"172.21.15.32:6821/317848821","heartbeat_back_addr":"172.21.15.32:6825/317848821","heartbeat_front_addr":"172.21.15.32:6823/317848821","state":["exists","up"]},{"osd":3,"uuid":"11e127c4-f415-4261-9584-b53b7bfa8b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6801","nonce":2326216039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6803","nonce":2326216039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6807","nonce":2326216039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6805","nonce":2326216039}]},"public_addr":"172.21.15.154:6801/2326216039","cluster_addr":"172.21.15.154:6803/2326216039","heartbeat_back_addr":"172.21.15.154:6807/2326216039","heartbeat_front_addr":"172.21.15.154:6805/2326216039","state":["exists","up"]},{"osd":4,"uuid":"190cd663-20cb-49b3-84b0-345f665e068e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6809","nonce":662519611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6811","nonce":662519611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6815","nonce":662519611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6813","nonce":662519611}]},"public_addr":"172.21.15.154:6809/662519611","cluster_addr":"172.21.15.154:6811/662519611","heartbeat_back_addr":"172.21.15.154:6815/662519611","heartbeat_front_addr":"172.21.15.154:6813/662519611","state":["exists","up"]},{"osd":5,"uuid":"7655488e-f7b9-4902-b6d3-28f762d44a2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6817","nonce":1788446264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6819","nonce":1788446264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6823","nonce":1788446264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6821","nonce":1788446264}]},"public_addr":"172.21.15.154:6817/1788446264","cluster_addr":"172.21.15.154:6819/1788446264","heartbeat_back_addr":"172.21.15.154:6823/1788446264","heartbeat_front_addr":"172.21.15.154:6821/1788446264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:14.221856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:43.419480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:12.732797+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:36.574751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:02.167660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:28.497477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:0/2913247857":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/1723093349":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/3998200556":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6801/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/1223764907":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/2720610700":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/2077354807":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1230396006":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6801/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1406133666":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6800/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6800/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6801/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/2104181876":"2024-05-07T21:17:45.720027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T21:22:33.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb1c006c680 msgr2=0x7fb1c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:33.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb1c006c680 0x7fb1c006eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8074840 tx=0x7fb1cc01a040 comp rx=0 tx=0).stop 2024-05-06T21:22:33.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81004c0 msgr2=0x7fb1d8073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:33.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81004c0 0x7fb1d8073050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800cfd0 tx=0x7fb1c800a340 comp rx=0 tx=0).stop 2024-05-06T21:22:33.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 shutdown_connections 2024-05-06T21:22:33.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb1c006c680 0x7fb1c006eb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:33.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81004c0 0x7fb1d8073050 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:33.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 --2- 172.21.15.32:0/1483617849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d8100e60 0x7fb1d8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:33.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 >> 172.21.15.32:0/1483617849 conn(0x7fb1d80fbd80 msgr2=0x7fb1d80fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:33.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 shutdown_connections 2024-05-06T21:22:33.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:33.533+0000 7fb1dd50a700 1 -- 172.21.15.32:0/1483617849 wait complete. 2024-05-06T21:22:33.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:33 smithi154 ceph-mon[32880]: Detected new or changed devices on smithi154 2024-05-06T21:22:33.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:33 smithi154 ceph-mon[32880]: Adjusting osd_memory_target on smithi154 to 4970M 2024-05-06T21:22:33.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:33 smithi032 ceph-mon[27179]: Detected new or changed devices on smithi154 2024-05-06T21:22:33.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:33 smithi032 ceph-mon[27179]: Adjusting osd_memory_target on smithi154 to 4970M 2024-05-06T21:22:34.288 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-06T21:21:16.105413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-06T21:22:34.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-06T21:22:34.511 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:34.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:34 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1483617849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:22:34.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:34 smithi154 ceph-mon[32880]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:34.634 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:34 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1483617849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:22:34.634 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:34 smithi032 ceph-mon[27179]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:36.110 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:35 smithi032 ceph-mon[27179]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:36.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:35 smithi154 ceph-mon[32880]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 -- 172.21.15.32:0/698381816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 msgr2=0x7fd76c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 --2- 172.21.15.32:0/698381816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 0x7fd76c100890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd760009910 tx=0x7fd760009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 -- 172.21.15.32:0/698381816 shutdown_connections 2024-05-06T21:22:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 --2- 172.21.15.32:0/698381816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd76c100e60 0x7fd76c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 --2- 172.21.15.32:0/698381816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 0x7fd76c100890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 -- 172.21.15.32:0/698381816 >> 172.21.15.32:0/698381816 conn(0x7fd76c0fbd80 msgr2=0x7fd76c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 -- 172.21.15.32:0/698381816 shutdown_connections 2024-05-06T21:22:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 -- 172.21.15.32:0/698381816 wait complete. 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 Processor -- start 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.477+0000 7fd772c55700 1 -- start start 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd772c55700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 0x7fd76c195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd772c55700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd76c100e60 0x7fd76c1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd772c55700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c196ab0 con 0x7fd76c1004c0 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd772c55700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c19a840 con 0x7fd76c100e60 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd7709f1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 0x7fd76c195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd7709f1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 0x7fd76c195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48118/0 (socket says 172.21.15.32:48118) 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd7709f1700 1 -- 172.21.15.32:0/73980189 learned_addr learned my addr 172.21.15.32:0/73980189 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd76bfff700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd76c100e60 0x7fd76c1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd7709f1700 1 -- 172.21.15.32:0/73980189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd76c100e60 msgr2=0x7fd76c1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd7709f1700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd76c100e60 0x7fd76c1963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd7709f1700 1 -- 172.21.15.32:0/73980189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600095f0 con 0x7fd76c1004c0 2024-05-06T21:22:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.478+0000 7fd7709f1700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 0x7fd76c195e90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd76000b5c0 tx=0x7fd76000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.479+0000 7fd769ffb700 1 -- 172.21.15.32:0/73980189 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd76001d070 con 0x7fd76c1004c0 2024-05-06T21:22:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.479+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c19aac0 con 0x7fd76c1004c0 2024-05-06T21:22:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.479+0000 7fd769ffb700 1 -- 172.21.15.32:0/73980189 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd760005e00 con 0x7fd76c1004c0 2024-05-06T21:22:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.479+0000 7fd769ffb700 1 -- 172.21.15.32:0/73980189 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd760017400 con 0x7fd76c1004c0 2024-05-06T21:22:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.479+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c19afb0 con 0x7fd76c1004c0 2024-05-06T21:22:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.480+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c1087d0 con 0x7fd76c1004c0 2024-05-06T21:22:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.480+0000 7fd769ffb700 1 -- 172.21.15.32:0/73980189 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd76000f460 con 0x7fd76c1004c0 2024-05-06T21:22:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.481+0000 7fd769ffb700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd75c06c680 0x7fd75c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.481+0000 7fd769ffb700 1 -- 172.21.15.32:0/73980189 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd76008c960 con 0x7fd76c1004c0 2024-05-06T21:22:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.481+0000 7fd76bfff700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd75c06c680 0x7fd75c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:36.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.481+0000 7fd76bfff700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd75c06c680 0x7fd75c06eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd76c1974b0 tx=0x7fd75800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:36.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.486+0000 7fd769ffb700 1 -- 172.21.15.32:0/73980189 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd760057400 con 0x7fd76c1004c0 2024-05-06T21:22:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.683+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd76c02cc30 con 0x7fd76c1004c0 2024-05-06T21:22:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.684+0000 7fd769ffb700 1 -- 172.21.15.32:0/73980189 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd76005aa20 con 0x7fd76c1004c0 2024-05-06T21:22:36.686 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd75c06c680 msgr2=0x7fd75c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd75c06c680 0x7fd75c06eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd76c1974b0 tx=0x7fd75800b410 comp rx=0 tx=0).stop 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 msgr2=0x7fd76c195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 0x7fd76c195e90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd76000b5c0 tx=0x7fd76000bd70 comp rx=0 tx=0).stop 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 shutdown_connections 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd75c06c680 0x7fd75c06eb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd76c1004c0 0x7fd76c195e90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 --2- 172.21.15.32:0/73980189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd76c100e60 0x7fd76c1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 >> 172.21.15.32:0/73980189 conn(0x7fd76c0fbd80 msgr2=0x7fd76c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 shutdown_connections 2024-05-06T21:22:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:36.686+0000 7fd772c55700 1 -- 172.21.15.32:0/73980189 wait complete. 2024-05-06T21:22:36.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:36 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/73980189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:22:37.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:36 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/73980189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:22:37.393 INFO:tasks.cephadm:Setting up client nodes... 2024-05-06T21:22:37.394 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-06T21:22:37.612 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:38.069 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:37 smithi032 ceph-mon[27179]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:38.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:37 smithi154 ceph-mon[32880]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.358+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2905852609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b281003f0 msgr2=0x7f5b28100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.358+0000 7f5b2ea17700 1 --2- 172.21.15.32:0/2905852609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b281003f0 0x7f5b28100860 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009910 tx=0x7f5b10009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.358+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2905852609 shutdown_connections 2024-05-06T21:22:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.358+0000 7f5b2ea17700 1 --2- 172.21.15.32:0/2905852609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b281003f0 0x7f5b28100860 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.358+0000 7f5b2ea17700 1 --2- 172.21.15.32:0/2905852609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b280ff150 0x7f5b280ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.358+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2905852609 >> 172.21.15.32:0/2905852609 conn(0x7f5b280fa7a0 msgr2=0x7f5b280fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.358+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2905852609 shutdown_connections 2024-05-06T21:22:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.358+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2905852609 wait complete. 2024-05-06T21:22:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b2ea17700 1 Processor -- start 2024-05-06T21:22:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b2ea17700 1 -- start start 2024-05-06T21:22:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b2ea17700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b280ff150 0x7f5b28194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b2ea17700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b281003f0 0x7f5b281951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b2ea17700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b281957f0 con 0x7f5b280ff150 2024-05-06T21:22:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b2ea17700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b28195960 con 0x7f5b281003f0 2024-05-06T21:22:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b27fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b280ff150 0x7f5b28194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b27fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b280ff150 0x7f5b28194cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48126/0 (socket says 172.21.15.32:48126) 2024-05-06T21:22:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b27fff700 1 -- 172.21.15.32:0/2879970952 learned_addr learned my addr 172.21.15.32:0/2879970952 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.359+0000 7f5b1ffff700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b281003f0 0x7f5b281951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.360+0000 7f5b27fff700 1 -- 172.21.15.32:0/2879970952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b281003f0 msgr2=0x7f5b281951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.360+0000 7f5b27fff700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b281003f0 0x7f5b281951f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.360+0000 7f5b27fff700 1 -- 172.21.15.32:0/2879970952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100095f0 con 0x7f5b280ff150 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.360+0000 7f5b27fff700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b280ff150 0x7f5b28194cb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800c8a0 tx=0x7f5b1800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.360+0000 7f5b25ffb700 1 -- 172.21.15.32:0/2879970952 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1800cea0 con 0x7f5b280ff150 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.360+0000 7f5b25ffb700 1 -- 172.21.15.32:0/2879970952 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b18004830 con 0x7f5b280ff150 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.360+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2819a3f0 con 0x7f5b280ff150 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.360+0000 7f5b25ffb700 1 -- 172.21.15.32:0/2879970952 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b180055b0 con 0x7f5b280ff150 2024-05-06T21:22:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.360+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2819a940 con 0x7f5b280ff150 2024-05-06T21:22:39.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.361+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b28068ab0 con 0x7f5b280ff150 2024-05-06T21:22:39.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.362+0000 7f5b25ffb700 1 -- 172.21.15.32:0/2879970952 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5b18007ad0 con 0x7f5b280ff150 2024-05-06T21:22:39.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.362+0000 7f5b25ffb700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5b1406c6d0 0x7f5b1406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:39.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.363+0000 7f5b25ffb700 1 -- 172.21.15.32:0/2879970952 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5b1808b6f0 con 0x7f5b280ff150 2024-05-06T21:22:39.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.363+0000 7f5b1ffff700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5b1406c6d0 0x7f5b1406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:39.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.363+0000 7f5b1ffff700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5b1406c6d0 0x7f5b1406eb80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5b281961c0 tx=0x7f5b10005920 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:39.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.366+0000 7f5b25ffb700 1 -- 172.21.15.32:0/2879970952 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5b18056170 con 0x7f5b280ff150 2024-05-06T21:22:39.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.645+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f5b2819ac70 con 0x7f5b280ff150 2024-05-06T21:22:39.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.649+0000 7f5b25ffb700 1 -- 172.21.15.32:0/2879970952 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f5b1801d020 con 0x7f5b280ff150 2024-05-06T21:22:39.652 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-05-06T21:22:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAfSjlm3T6YJhAA+/GeFV4lymdf/b0gfufDFg== 2024-05-06T21:22:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5b1406c6d0 msgr2=0x7f5b1406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5b1406c6d0 0x7f5b1406eb80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5b281961c0 tx=0x7f5b10005920 comp rx=0 tx=0).stop 2024-05-06T21:22:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b280ff150 msgr2=0x7f5b28194cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b280ff150 0x7f5b28194cb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800c8a0 tx=0x7f5b1800cc60 comp rx=0 tx=0).stop 2024-05-06T21:22:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 shutdown_connections 2024-05-06T21:22:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5b1406c6d0 0x7f5b1406eb80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b280ff150 0x7f5b28194cb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 --2- 172.21.15.32:0/2879970952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b281003f0 0x7f5b281951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 >> 172.21.15.32:0/2879970952 conn(0x7f5b280fa7a0 msgr2=0x7f5b28103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:39.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 shutdown_connections 2024-05-06T21:22:39.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:39.651+0000 7f5b2ea17700 1 -- 172.21.15.32:0/2879970952 wait complete. 2024-05-06T21:22:39.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:39 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2879970952' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T21:22:39.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:39 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2879970952' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T21:22:40.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:39 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2879970952' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T21:22:40.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:39 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2879970952' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T21:22:40.331 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:22:40.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-06T21:22:40.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-06T21:22:40.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-06T21:22:40.595 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi154/config 2024-05-06T21:22:40.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:40 smithi032 ceph-mon[27179]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:41.045 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:40 smithi154 ceph-mon[32880]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:42.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.135+0000 7fb04a6ec700 1 -- 172.21.15.154:0/1719787077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044103310 msgr2=0x7fb044105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:42.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.135+0000 7fb04a6ec700 1 --2- 172.21.15.154:0/1719787077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044103310 0x7fb044105790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb038009910 tx=0x7fb038009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:42.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.135+0000 7fb04a6ec700 1 -- 172.21.15.154:0/1719787077 shutdown_connections 2024-05-06T21:22:42.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.135+0000 7fb04a6ec700 1 --2- 172.21.15.154:0/1719787077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044103310 0x7fb044105790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:42.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.135+0000 7fb04a6ec700 1 --2- 172.21.15.154:0/1719787077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb044069270 0x7fb044102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:42.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.135+0000 7fb04a6ec700 1 -- 172.21.15.154:0/1719787077 >> 172.21.15.154:0/1719787077 conn(0x7fb0440fa780 msgr2=0x7fb0440fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:42.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.135+0000 7fb04a6ec700 1 -- 172.21.15.154:0/1719787077 shutdown_connections 2024-05-06T21:22:42.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.135+0000 7fb04a6ec700 1 -- 172.21.15.154:0/1719787077 wait complete. 2024-05-06T21:22:42.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb04a6ec700 1 Processor -- start 2024-05-06T21:22:42.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb04a6ec700 1 -- start start 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb04a6ec700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb044103310 0x7fb044195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb04a6ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044196090 0x7fb04419b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb04a6ec700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044196590 con 0x7fb044103310 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb04a6ec700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044196700 con 0x7fb044196090 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb0437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044196090 0x7fb04419b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb0437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044196090 0x7fb04419b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60410/0 (socket says 172.21.15.154:60410) 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb0437fe700 1 -- 172.21.15.154:0/4058330673 learned_addr learned my addr 172.21.15.154:0/4058330673 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb043fff700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb044103310 0x7fb044195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb0437fe700 1 -- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb044103310 msgr2=0x7fb044195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.136+0000 7fb0437fe700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb044103310 0x7fb044195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:42.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.137+0000 7fb0437fe700 1 -- 172.21.15.154:0/4058330673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380095f0 con 0x7fb044196090 2024-05-06T21:22:42.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.137+0000 7fb0437fe700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044196090 0x7fb04419b100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb038006010 tx=0x7fb03800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:42.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.137+0000 7fb0417fa700 1 -- 172.21.15.154:0/4058330673 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb03801d070 con 0x7fb044196090 2024-05-06T21:22:42.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.137+0000 7fb0417fa700 1 -- 172.21.15.154:0/4058330673 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb03800f460 con 0x7fb044196090 2024-05-06T21:22:42.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.137+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04419b640 con 0x7fb044196090 2024-05-06T21:22:42.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.137+0000 7fb0417fa700 1 -- 172.21.15.154:0/4058330673 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb038021640 con 0x7fb044196090 2024-05-06T21:22:42.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.137+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04419bb00 con 0x7fb044196090 2024-05-06T21:22:42.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.138+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04418fc70 con 0x7fb044196090 2024-05-06T21:22:42.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.138+0000 7fb0417fa700 1 -- 172.21.15.154:0/4058330673 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb03800fab0 con 0x7fb044196090 2024-05-06T21:22:42.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.139+0000 7fb0417fa700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb02c06c680 0x7fb02c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:42.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.139+0000 7fb0417fa700 1 -- 172.21.15.154:0/4058330673 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb03808ca20 con 0x7fb044196090 2024-05-06T21:22:42.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.139+0000 7fb043fff700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb02c06c680 0x7fb02c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:42.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.139+0000 7fb043fff700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb02c06c680 0x7fb02c06eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb034006fd0 tx=0x7fb034008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:42.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.143+0000 7fb0417fa700 1 -- 172.21.15.154:0/4058330673 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb03805aed0 con 0x7fb044196090 2024-05-06T21:22:42.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.408+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb044069270 con 0x7fb044196090 2024-05-06T21:22:42.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.413+0000 7fb0417fa700 1 -- 172.21.15.154:0/4058330673 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb0380260f0 con 0x7fb044196090 2024-05-06T21:22:42.416 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2024-05-06T21:22:42.416 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAiSjlmFZFzGBAAN5uMgMTQyLJvRZUq7BBv3Q== 2024-05-06T21:22:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb02c06c680 msgr2=0x7fb02c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb02c06c680 0x7fb02c06eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb034006fd0 tx=0x7fb034008040 comp rx=0 tx=0).stop 2024-05-06T21:22:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044196090 msgr2=0x7fb04419b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044196090 0x7fb04419b100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb038006010 tx=0x7fb03800be20 comp rx=0 tx=0).stop 2024-05-06T21:22:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 shutdown_connections 2024-05-06T21:22:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb02c06c680 0x7fb02c06eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb044103310 0x7fb044195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 --2- 172.21.15.154:0/4058330673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb044196090 0x7fb04419b100 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 >> 172.21.15.154:0/4058330673 conn(0x7fb0440fa780 msgr2=0x7fb0440fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 shutdown_connections 2024-05-06T21:22:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:22:42.415+0000 7fb04a6ec700 1 -- 172.21.15.154:0/4058330673 wait complete. 2024-05-06T21:22:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:42 smithi032 ceph-mon[27179]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:42 smithi032 ceph-mon[27179]: from='client.? 172.21.15.154:0/4058330673' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T21:22:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:42 smithi032 ceph-mon[27179]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T21:22:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:42 smithi032 ceph-mon[27179]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T21:22:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:22:42.997 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:42 smithi154 ceph-mon[32880]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:42.998 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:42 smithi154 ceph-mon[32880]: from='client.? 172.21.15.154:0/4058330673' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T21:22:42.998 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:42 smithi154 ceph-mon[32880]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T21:22:42.998 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:42 smithi154 ceph-mon[32880]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T21:22:42.998 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:22:43.019 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:22:43.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-05-06T21:22:43.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-06T21:22:43.055 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-06T21:22:43.056 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-06T21:22:43.056 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-06T21:22:43.281 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:44.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.870+0000 7f9d9498b700 1 -- 172.21.15.32:0/1991618019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101300 msgr2=0x7f9d901016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.870+0000 7f9d9498b700 1 --2- 172.21.15.32:0/1991618019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101300 0x7f9d901016d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009910 tx=0x7f9d80009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.870+0000 7f9d9498b700 1 -- 172.21.15.32:0/1991618019 shutdown_connections 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.870+0000 7f9d9498b700 1 --2- 172.21.15.32:0/1991618019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d90101c10 0x7f9d9010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.870+0000 7f9d9498b700 1 --2- 172.21.15.32:0/1991618019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101300 0x7f9d901016d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.870+0000 7f9d9498b700 1 -- 172.21.15.32:0/1991618019 >> 172.21.15.32:0/1991618019 conn(0x7f9d900fac90 msgr2=0x7f9d900fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.871+0000 7f9d9498b700 1 -- 172.21.15.32:0/1991618019 shutdown_connections 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.871+0000 7f9d9498b700 1 -- 172.21.15.32:0/1991618019 wait complete. 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.871+0000 7f9d9498b700 1 Processor -- start 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.871+0000 7f9d9498b700 1 -- start start 2024-05-06T21:22:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d9498b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d90101300 0x7f9d90195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d9498b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101c10 0x7f9d90196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d9498b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90196a60 con 0x7f9d90101c10 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d9498b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90196ba0 con 0x7f9d90101300 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d8dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101c10 0x7f9d90196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d8dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101c10 0x7f9d90196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51816/0 (socket says 172.21.15.32:51816) 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d8dd9b700 1 -- 172.21.15.32:0/1340610192 learned_addr learned my addr 172.21.15.32:0/1340610192 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d8e59c700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d90101300 0x7f9d90195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d8dd9b700 1 -- 172.21.15.32:0/1340610192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d90101300 msgr2=0x7f9d90195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d8dd9b700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d90101300 0x7f9d90195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d8dd9b700 1 -- 172.21.15.32:0/1340610192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800095f0 con 0x7f9d90101c10 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d8dd9b700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101c10 0x7f9d90196410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c930 tx=0x7f9d7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d877fe700 1 -- 172.21.15.32:0/1340610192 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d78007ad0 con 0x7f9d90101c10 2024-05-06T21:22:44.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9019a9f0 con 0x7f9d90101c10 2024-05-06T21:22:44.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.872+0000 7f9d877fe700 1 -- 172.21.15.32:0/1340610192 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d7800ce80 con 0x7f9d90101c10 2024-05-06T21:22:44.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.873+0000 7f9d877fe700 1 -- 172.21.15.32:0/1340610192 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d78018630 con 0x7f9d90101c10 2024-05-06T21:22:44.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.873+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9019af40 con 0x7f9d90101c10 2024-05-06T21:22:44.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.873+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d901079e0 con 0x7f9d90101c10 2024-05-06T21:22:44.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.874+0000 7f9d877fe700 1 -- 172.21.15.32:0/1340610192 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9d78007c30 con 0x7f9d90101c10 2024-05-06T21:22:44.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.875+0000 7f9d877fe700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d7c06c680 0x7f9d7c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:44.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.875+0000 7f9d877fe700 1 -- 172.21.15.32:0/1340610192 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9d7808b4f0 con 0x7f9d90101c10 2024-05-06T21:22:44.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.875+0000 7f9d8e59c700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d7c06c680 0x7f9d7c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:44.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.875+0000 7f9d8e59c700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d7c06c680 0x7f9d7c06eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d80006010 tx=0x7f9d8000b770 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:44.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:44.879+0000 7f9d877fe700 1 -- 172.21.15.32:0/1340610192 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9d78055f10 con 0x7f9d90101c10 2024-05-06T21:22:44.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:44 smithi032 ceph-mon[27179]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:44 smithi154 ceph-mon[32880]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.138+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9d901073c0 con 0x7f9d90101c10 2024-05-06T21:22:45.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.141+0000 7f9d877fe700 1 -- 172.21.15.32:0/1340610192 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172854 (secure 0 0 0) 0x7f9d78059530 con 0x7f9d90101c10 2024-05-06T21:22:45.147 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:22:45.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d7c06c680 msgr2=0x7f9d7c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:45.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d7c06c680 0x7f9d7c06eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d80006010 tx=0x7f9d8000b770 comp rx=0 tx=0).stop 2024-05-06T21:22:45.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101c10 msgr2=0x7f9d90196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:45.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101c10 0x7f9d90196410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c930 tx=0x7f9d7800cc40 comp rx=0 tx=0).stop 2024-05-06T21:22:45.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 shutdown_connections 2024-05-06T21:22:45.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d7c06c680 0x7f9d7c06eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:45.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d90101300 0x7f9d90195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:45.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 --2- 172.21.15.32:0/1340610192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d90101c10 0x7f9d90196410 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:45.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 >> 172.21.15.32:0/1340610192 conn(0x7f9d900fac90 msgr2=0x7f9d90104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:45.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.144+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 shutdown_connections 2024-05-06T21:22:45.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:45.145+0000 7f9d9498b700 1 -- 172.21.15.32:0/1340610192 wait complete. 2024-05-06T21:22:45.794 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":19,"active_gid":14217,"active_name":"smithi032.ecoohh","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2162274499},{"type":"v1","addr":"172.21.15.32:6801","nonce":2162274499}]},"active_addr":"172.21.15.32:6801/2162274499","active_change":"2024-05-06T21:18:57.579690+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14240,"name":"smithi154.kilvol","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.32:8443/","prometheus":"http://172.21.15.32:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":928947970}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":1033156191}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":3536478886}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":3688348585}]}]} 2024-05-06T21:22:45.798 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-06T21:22:45.798 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-06T21:22:45.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-06T21:22:46.015 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:46.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:45 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1340610192' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-06T21:22:46.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:45 smithi154 ceph-mon[32880]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:46.138 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:45 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1340610192' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-06T21:22:46.138 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:45 smithi032 ceph-mon[27179]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.702+0000 7fc6817f3700 1 -- 172.21.15.32:0/891279924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 msgr2=0x7fc67c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.702+0000 7fc6817f3700 1 --2- 172.21.15.32:0/891279924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 0x7fc67c104e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc664009910 tx=0x7fc664009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.702+0000 7fc6817f3700 1 -- 172.21.15.32:0/891279924 shutdown_connections 2024-05-06T21:22:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.702+0000 7fc6817f3700 1 --2- 172.21.15.32:0/891279924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 0x7fc67c104e50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.702+0000 7fc6817f3700 1 --2- 172.21.15.32:0/891279924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc67c1004e0 0x7fc67c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.702+0000 7fc6817f3700 1 -- 172.21.15.32:0/891279924 >> 172.21.15.32:0/891279924 conn(0x7fc67c0fbda0 msgr2=0x7fc67c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.702+0000 7fc6817f3700 1 -- 172.21.15.32:0/891279924 shutdown_connections 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.702+0000 7fc6817f3700 1 -- 172.21.15.32:0/891279924 wait complete. 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc6817f3700 1 Processor -- start 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc6817f3700 1 -- start start 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc6817f3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc67c1004e0 0x7fc67c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc6817f3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 0x7fc67c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc6817f3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c196b30 con 0x7fc67c100e80 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc6817f3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c19a8c0 con 0x7fc67c1004e0 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc67a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 0x7fc67c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc67a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 0x7fc67c196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51840/0 (socket says 172.21.15.32:51840) 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc67a7fc700 1 -- 172.21.15.32:0/3031531417 learned_addr learned my addr 172.21.15.32:0/3031531417 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:22:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc67a7fc700 1 -- 172.21.15.32:0/3031531417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc67c1004e0 msgr2=0x7fc67c195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc67affd700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc67c1004e0 0x7fc67c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc67a7fc700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc67c1004e0 0x7fc67c195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.703+0000 7fc67a7fc700 1 -- 172.21.15.32:0/3031531417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640095f0 con 0x7fc67c100e80 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.704+0000 7fc67a7fc700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 0x7fc67c196450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc6640092e0 tx=0x7fc66400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.704+0000 7fc673fff700 1 -- 172.21.15.32:0/3031531417 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc66401d070 con 0x7fc67c100e80 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.704+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c19ab40 con 0x7fc67c100e80 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.704+0000 7fc673fff700 1 -- 172.21.15.32:0/3031531417 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc66400f460 con 0x7fc67c100e80 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.704+0000 7fc673fff700 1 -- 172.21.15.32:0/3031531417 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc664017630 con 0x7fc67c100e80 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.704+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c19b030 con 0x7fc67c100e80 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.705+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c108850 con 0x7fc67c100e80 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.705+0000 7fc673fff700 1 -- 172.21.15.32:0/3031531417 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc66400f5d0 con 0x7fc67c100e80 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.706+0000 7fc673fff700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc66806c6d0 0x7fc66806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.706+0000 7fc67affd700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc66806c6d0 0x7fc66806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.706+0000 7fc673fff700 1 -- 172.21.15.32:0/3031531417 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc66408c960 con 0x7fc67c100e80 2024-05-06T21:22:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.706+0000 7fc67affd700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc66806c6d0 0x7fc66806eb80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009c10 tx=0x7fc66c009040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.710+0000 7fc673fff700 1 -- 172.21.15.32:0/3031531417 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc664057410 con 0x7fc67c100e80 2024-05-06T21:22:47.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.911+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc67c04f2a0 con 0x7fc67c100e80 2024-05-06T21:22:47.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.912+0000 7fc673fff700 1 -- 172.21.15.32:0/3031531417 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11327 (secure 0 0 0) 0x7fc66405aa30 con 0x7fc67c100e80 2024-05-06T21:22:47.915 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:22:47.916 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":41,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","created":"2024-05-06T21:16:43.886575+0000","modified":"2024-05-06T21:22:31.285629+0000","last_up_change":"2024-05-06T21:22:30.280541+0000","last_in_change":"2024-05-06T21:22:10.894148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T21:21:16.105413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0095c3fd-9b90-4d23-b192-98fd9a06c20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6803","nonce":1973178361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6805","nonce":1973178361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6809","nonce":1973178361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6807","nonce":1973178361}]},"public_addr":"172.21.15.32:6803/1973178361","cluster_addr":"172.21.15.32:6805/1973178361","heartbeat_back_addr":"172.21.15.32:6809/1973178361","heartbeat_front_addr":"172.21.15.32:6807/1973178361","state":["exists","up"]},{"osd":1,"uuid":"0d37de85-e43f-4094-ba6a-00a09047798a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6811","nonce":3464551315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6813","nonce":3464551315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6817","nonce":3464551315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6815","nonce":3464551315}]},"public_addr":"172.21.15.32:6811/3464551315","cluster_addr":"172.21.15.32:6813/3464551315","heartbeat_back_addr":"172.21.15.32:6817/3464551315","heartbeat_front_addr":"172.21.15.32:6815/3464551315","state":["exists","up"]},{"osd":2,"uuid":"e41022aa-de8c-45d9-aa0e-a1918b23fb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6819","nonce":317848821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6821","nonce":317848821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6825","nonce":317848821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6823","nonce":317848821}]},"public_addr":"172.21.15.32:6819/317848821","cluster_addr":"172.21.15.32:6821/317848821","heartbeat_back_addr":"172.21.15.32:6825/317848821","heartbeat_front_addr":"172.21.15.32:6823/317848821","state":["exists","up"]},{"osd":3,"uuid":"11e127c4-f415-4261-9584-b53b7bfa8b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6801","nonce":2326216039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6803","nonce":2326216039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6807","nonce":2326216039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6805","nonce":2326216039}]},"public_addr":"172.21.15.154:6801/2326216039","cluster_addr":"172.21.15.154:6803/2326216039","heartbeat_back_addr":"172.21.15.154:6807/2326216039","heartbeat_front_addr":"172.21.15.154:6805/2326216039","state":["exists","up"]},{"osd":4,"uuid":"190cd663-20cb-49b3-84b0-345f665e068e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6809","nonce":662519611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6811","nonce":662519611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6815","nonce":662519611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6813","nonce":662519611}]},"public_addr":"172.21.15.154:6809/662519611","cluster_addr":"172.21.15.154:6811/662519611","heartbeat_back_addr":"172.21.15.154:6815/662519611","heartbeat_front_addr":"172.21.15.154:6813/662519611","state":["exists","up"]},{"osd":5,"uuid":"7655488e-f7b9-4902-b6d3-28f762d44a2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6817","nonce":1788446264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6819","nonce":1788446264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6823","nonce":1788446264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6821","nonce":1788446264}]},"public_addr":"172.21.15.154:6817/1788446264","cluster_addr":"172.21.15.154:6819/1788446264","heartbeat_back_addr":"172.21.15.154:6823/1788446264","heartbeat_front_addr":"172.21.15.154:6821/1788446264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:14.221856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:43.419480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:12.732797+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:36.574751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:02.167660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:28.497477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:0/2913247857":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/1723093349":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/3998200556":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6801/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/1223764907":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/2720610700":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/2077354807":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1230396006":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6801/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1406133666":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6800/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6800/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6801/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/2104181876":"2024-05-07T21:17:45.720027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T21:22:47.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc66806c6d0 msgr2=0x7fc66806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:47.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc66806c6d0 0x7fc66806eb80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009c10 tx=0x7fc66c009040 comp rx=0 tx=0).stop 2024-05-06T21:22:47.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 msgr2=0x7fc67c196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:47.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 0x7fc67c196450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc6640092e0 tx=0x7fc66400be20 comp rx=0 tx=0).stop 2024-05-06T21:22:47.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 shutdown_connections 2024-05-06T21:22:47.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc66806c6d0 0x7fc66806eb80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:47.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc67c1004e0 0x7fc67c195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:47.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 --2- 172.21.15.32:0/3031531417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc67c100e80 0x7fc67c196450 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:47.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 >> 172.21.15.32:0/3031531417 conn(0x7fc67c0fbda0 msgr2=0x7fc67c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:47.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 shutdown_connections 2024-05-06T21:22:47.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:47.914+0000 7fc6817f3700 1 -- 172.21.15.32:0/3031531417 wait complete. 2024-05-06T21:22:48.628 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-06T21:22:48.629 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-06T21:22:48.851 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:48.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:48 smithi032 ceph-mon[27179]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:48.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:48 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3031531417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:22:49.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:48 smithi154 ceph-mon[32880]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:49.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:48 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3031531417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:22:50.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.555+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/882681953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 msgr2=0x7fcf840ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:50.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.555+0000 7fcf8ae0e700 1 --2- 172.21.15.32:0/882681953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 0x7fcf840ff7c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009910 tx=0x7fcf74009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:50.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.555+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/882681953 shutdown_connections 2024-05-06T21:22:50.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.555+0000 7fcf8ae0e700 1 --2- 172.21.15.32:0/882681953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 0x7fcf840ff7c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:50.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.555+0000 7fcf8ae0e700 1 --2- 172.21.15.32:0/882681953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf841038b0 0x7fcf84103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:50.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.555+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/882681953 >> 172.21.15.32:0/882681953 conn(0x7fcf840748b0 msgr2=0x7fcf84074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:50.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.555+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/882681953 shutdown_connections 2024-05-06T21:22:50.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.555+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/882681953 wait complete. 2024-05-06T21:22:50.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.556+0000 7fcf8ae0e700 1 Processor -- start 2024-05-06T21:22:50.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.556+0000 7fcf8ae0e700 1 -- start start 2024-05-06T21:22:50.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.556+0000 7fcf8ae0e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 0x7fcf84196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:50.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.556+0000 7fcf8ae0e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf841038b0 0x7fcf84197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:50.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.556+0000 7fcf8ae0e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf84197960 con 0x7fcf840ff350 2024-05-06T21:22:50.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.556+0000 7fcf8ae0e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf84197ad0 con 0x7fcf841038b0 2024-05-06T21:22:50.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf88baa700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 0x7fcf84196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:50.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf88baa700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 0x7fcf84196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51866/0 (socket says 172.21.15.32:51866) 2024-05-06T21:22:50.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf88baa700 1 -- 172.21.15.32:0/4206220921 learned_addr learned my addr 172.21.15.32:0/4206220921 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf83fff700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf841038b0 0x7fcf84197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf88baa700 1 -- 172.21.15.32:0/4206220921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf841038b0 msgr2=0x7fcf84197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf88baa700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf841038b0 0x7fcf84197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf88baa700 1 -- 172.21.15.32:0/4206220921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740095f0 con 0x7fcf840ff350 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf88baa700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 0x7fcf84196d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00b4b0 tx=0x7fcf6c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf81ffb700 1 -- 172.21.15.32:0/4206220921 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6c011800 con 0x7fcf840ff350 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf81ffb700 1 -- 172.21.15.32:0/4206220921 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf6c011e10 con 0x7fcf840ff350 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8419fdb0 con 0x7fcf840ff350 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.557+0000 7fcf81ffb700 1 -- 172.21.15.32:0/4206220921 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6c00f2e0 con 0x7fcf840ff350 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.558+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf841a02d0 con 0x7fcf840ff350 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.558+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf84106e20 con 0x7fcf840ff350 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.559+0000 7fcf81ffb700 1 -- 172.21.15.32:0/4206220921 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcf6c010380 con 0x7fcf840ff350 2024-05-06T21:22:50.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.559+0000 7fcf81ffb700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcf7006c680 0x7fcf7006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:50.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.560+0000 7fcf83fff700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcf7006c680 0x7fcf7006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:50.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.560+0000 7fcf81ffb700 1 -- 172.21.15.32:0/4206220921 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcf6c08b070 con 0x7fcf840ff350 2024-05-06T21:22:50.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.560+0000 7fcf83fff700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcf7006c680 0x7fcf7006eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400b5c0 tx=0x7fcf74005460 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:50.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.564+0000 7fcf81ffb700 1 -- 172.21.15.32:0/4206220921 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcf6c055b10 con 0x7fcf840ff350 2024-05-06T21:22:50.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.766+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf84106800 con 0x7fcf840ff350 2024-05-06T21:22:50.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.766+0000 7fcf81ffb700 1 -- 172.21.15.32:0/4206220921 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11327 (secure 0 0 0) 0x7fcf6c059130 con 0x7fcf840ff350 2024-05-06T21:22:50.770 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:22:50.770 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":41,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","created":"2024-05-06T21:16:43.886575+0000","modified":"2024-05-06T21:22:31.285629+0000","last_up_change":"2024-05-06T21:22:30.280541+0000","last_in_change":"2024-05-06T21:22:10.894148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T21:21:16.105413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0095c3fd-9b90-4d23-b192-98fd9a06c20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6803","nonce":1973178361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6805","nonce":1973178361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6809","nonce":1973178361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6807","nonce":1973178361}]},"public_addr":"172.21.15.32:6803/1973178361","cluster_addr":"172.21.15.32:6805/1973178361","heartbeat_back_addr":"172.21.15.32:6809/1973178361","heartbeat_front_addr":"172.21.15.32:6807/1973178361","state":["exists","up"]},{"osd":1,"uuid":"0d37de85-e43f-4094-ba6a-00a09047798a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6811","nonce":3464551315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6813","nonce":3464551315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6817","nonce":3464551315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6815","nonce":3464551315}]},"public_addr":"172.21.15.32:6811/3464551315","cluster_addr":"172.21.15.32:6813/3464551315","heartbeat_back_addr":"172.21.15.32:6817/3464551315","heartbeat_front_addr":"172.21.15.32:6815/3464551315","state":["exists","up"]},{"osd":2,"uuid":"e41022aa-de8c-45d9-aa0e-a1918b23fb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6819","nonce":317848821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6821","nonce":317848821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6825","nonce":317848821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6823","nonce":317848821}]},"public_addr":"172.21.15.32:6819/317848821","cluster_addr":"172.21.15.32:6821/317848821","heartbeat_back_addr":"172.21.15.32:6825/317848821","heartbeat_front_addr":"172.21.15.32:6823/317848821","state":["exists","up"]},{"osd":3,"uuid":"11e127c4-f415-4261-9584-b53b7bfa8b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6801","nonce":2326216039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6803","nonce":2326216039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6807","nonce":2326216039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6805","nonce":2326216039}]},"public_addr":"172.21.15.154:6801/2326216039","cluster_addr":"172.21.15.154:6803/2326216039","heartbeat_back_addr":"172.21.15.154:6807/2326216039","heartbeat_front_addr":"172.21.15.154:6805/2326216039","state":["exists","up"]},{"osd":4,"uuid":"190cd663-20cb-49b3-84b0-345f665e068e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6809","nonce":662519611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6811","nonce":662519611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6815","nonce":662519611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6813","nonce":662519611}]},"public_addr":"172.21.15.154:6809/662519611","cluster_addr":"172.21.15.154:6811/662519611","heartbeat_back_addr":"172.21.15.154:6815/662519611","heartbeat_front_addr":"172.21.15.154:6813/662519611","state":["exists","up"]},{"osd":5,"uuid":"7655488e-f7b9-4902-b6d3-28f762d44a2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6817","nonce":1788446264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6819","nonce":1788446264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6823","nonce":1788446264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6821","nonce":1788446264}]},"public_addr":"172.21.15.154:6817/1788446264","cluster_addr":"172.21.15.154:6819/1788446264","heartbeat_back_addr":"172.21.15.154:6823/1788446264","heartbeat_front_addr":"172.21.15.154:6821/1788446264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:14.221856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:43.419480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:12.732797+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:36.574751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:02.167660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:28.497477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:0/2913247857":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/1723093349":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/3998200556":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6801/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/1223764907":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/2720610700":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/2077354807":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1230396006":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6801/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1406133666":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6800/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6800/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6801/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/2104181876":"2024-05-07T21:17:45.720027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T21:22:50.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcf7006c680 msgr2=0x7fcf7006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:50.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcf7006c680 0x7fcf7006eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400b5c0 tx=0x7fcf74005460 comp rx=0 tx=0).stop 2024-05-06T21:22:50.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 msgr2=0x7fcf84196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:50.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 0x7fcf84196d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00b4b0 tx=0x7fcf6c00b870 comp rx=0 tx=0).stop 2024-05-06T21:22:50.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 shutdown_connections 2024-05-06T21:22:50.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcf7006c680 0x7fcf7006eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:50.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf840ff350 0x7fcf84196d40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:50.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 --2- 172.21.15.32:0/4206220921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf841038b0 0x7fcf84197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:50.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 >> 172.21.15.32:0/4206220921 conn(0x7fcf840748b0 msgr2=0x7fcf840fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:50.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 shutdown_connections 2024-05-06T21:22:50.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:50.769+0000 7fcf8ae0e700 1 -- 172.21.15.32:0/4206220921 wait complete. 2024-05-06T21:22:50.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:50 smithi032 ceph-mon[27179]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:51.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:50 smithi154 ceph-mon[32880]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:51.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-06T21:22:51.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-06T21:22:51.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-06T21:22:51.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-06T21:22:51.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-06T21:22:51.454 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-06T21:22:51.681 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:51 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/4206220921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:22:51.773 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:51.786 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:52.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:51 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/4206220921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:22:52.815 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:52 smithi032 ceph-mon[27179]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:53.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:52 smithi154 ceph-mon[32880]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:53.151 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:53.151 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:53.152 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:53.153 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:22:54.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:54 smithi032 ceph-mon[27179]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:55.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:54 smithi154 ceph-mon[32880]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:55.908 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:55 smithi032 ceph-mon[27179]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:56.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:55 smithi154 ceph-mon[32880]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:56.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 -- 172.21.15.32:0/1456256177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 msgr2=0x7f5304104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:56.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 --2- 172.21.15.32:0/1456256177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 0x7f5304104e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009910 tx=0x7f52f0009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:56.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 -- 172.21.15.32:0/1456256177 shutdown_connections 2024-05-06T21:22:56.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 --2- 172.21.15.32:0/1456256177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 0x7f5304104e50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 --2- 172.21.15.32:0/1456256177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53041004e0 0x7f53041008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 -- 172.21.15.32:0/1456256177 >> 172.21.15.32:0/1456256177 conn(0x7f53040fbda0 msgr2=0x7f53040fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 -- 172.21.15.32:0/1456256177 shutdown_connections 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 -- 172.21.15.32:0/1456256177 wait complete. 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 Processor -- start 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.242+0000 7f530ad16700 1 -- start start 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f530ad16700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53041004e0 0x7f5304195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f530ad16700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 0x7f5304196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f530ad16700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5304196b50 con 0x7f5304100e80 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f530ad16700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530419a8e0 con 0x7f53041004e0 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5303fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 0x7f5304196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5303fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 0x7f5304196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42546/0 (socket says 172.21.15.32:42546) 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5303fff700 1 -- 172.21.15.32:0/519944080 learned_addr learned my addr 172.21.15.32:0/519944080 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5308ab2700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53041004e0 0x7f5304195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:56.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5303fff700 1 -- 172.21.15.32:0/519944080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53041004e0 msgr2=0x7f5304195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:56.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5303fff700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53041004e0 0x7f5304195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:56.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5303fff700 1 -- 172.21.15.32:0/519944080 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f00095f0 con 0x7f5304100e80 2024-05-06T21:22:56.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5308ab2700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53041004e0 0x7f5304195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:22:56.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5303fff700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 0x7f5304196470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f52f00092e0 tx=0x7f52f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:56.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5301ffb700 1 -- 172.21.15.32:0/519944080 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52f001d070 con 0x7f5304100e80 2024-05-06T21:22:56.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530419ab60 con 0x7f5304100e80 2024-05-06T21:22:56.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5301ffb700 1 -- 172.21.15.32:0/519944080 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52f000f460 con 0x7f5304100e80 2024-05-06T21:22:56.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.243+0000 7f5301ffb700 1 -- 172.21.15.32:0/519944080 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52f0017630 con 0x7f5304100e80 2024-05-06T21:22:56.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.244+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530419b050 con 0x7f5304100e80 2024-05-06T21:22:56.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.244+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f530410d650 con 0x7f5304100e80 2024-05-06T21:22:56.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.246+0000 7f5301ffb700 1 -- 172.21.15.32:0/519944080 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f52f000f5d0 con 0x7f5304100e80 2024-05-06T21:22:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.246+0000 7f5301ffb700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f52f406c680 0x7f52f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.246+0000 7f5301ffb700 1 -- 172.21.15.32:0/519944080 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f52f008cdf0 con 0x7f5304100e80 2024-05-06T21:22:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.246+0000 7f5308ab2700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f52f406c680 0x7f52f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.246+0000 7f5301ffb700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] conn(0x7f52f4072350 0x7f52f4074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.246+0000 7f5301ffb700 1 -- 172.21.15.32:0/519944080 --> [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52f4074e10 con 0x7f52f4072350 2024-05-06T21:22:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.246+0000 7f5301ffb700 1 -- 172.21.15.32:0/519944080 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52f008d250 con 0x7f5304100e80 2024-05-06T21:22:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.246+0000 7f53092b3700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] conn(0x7f52f4072350 0x7f52f4074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.247+0000 7f5308ab2700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f52f406c680 0x7f52f406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52f8005fd0 tx=0x7f52f8005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.247+0000 7f53092b3700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] conn(0x7f52f4072350 0x7f52f4074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:56.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.247+0000 7f5301ffb700 1 -- 172.21.15.32:0/519944080 <== osd.2 v2:172.21.15.32:6818/317848821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f52f4074e10 con 0x7f52f4072350 2024-05-06T21:22:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.263+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 --> [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f530404f2a0 con 0x7f52f4072350 2024-05-06T21:22:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.263+0000 7f5301ffb700 1 -- 172.21.15.32:0/519944080 <== osd.2 v2:172.21.15.32:6818/317848821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f530404f2a0 con 0x7f52f4072350 2024-05-06T21:22:56.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] conn(0x7f52f4072350 msgr2=0x7f52f4074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] conn(0x7f52f4072350 0x7f52f4074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f52f406c680 msgr2=0x7f52f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f52f406c680 0x7f52f406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52f8005fd0 tx=0x7f52f8005ee0 comp rx=0 tx=0).stop 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 msgr2=0x7f5304196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 0x7f5304196470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f52f00092e0 tx=0x7f52f000be20 comp rx=0 tx=0).stop 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 shutdown_connections 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6818/317848821,v1:172.21.15.32:6819/317848821] conn(0x7f52f4072350 0x7f52f4074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f52f406c680 0x7f52f406eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53041004e0 0x7f5304195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 --2- 172.21.15.32:0/519944080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5304100e80 0x7f5304196470 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 >> 172.21.15.32:0/519944080 conn(0x7f53040fbda0 msgr2=0x7f53040fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 shutdown_connections 2024-05-06T21:22:56.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:56.264+0000 7f530ad16700 1 -- 172.21.15.32:0/519944080 wait complete. 2024-05-06T21:22:57.938 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:22:57.939 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:57 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:22:58.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.041+0000 7f89a8340700 1 -- 172.21.15.32:0/627799945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 msgr2=0x7f89a010a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:58.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.041+0000 7f89a8340700 1 --2- 172.21.15.32:0/627799945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 0x7f89a010a220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8990009910 tx=0x7f8990009c20 comp rx=0 tx=0).stop 2024-05-06T21:22:58.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.041+0000 7f89a8340700 1 -- 172.21.15.32:0/627799945 shutdown_connections 2024-05-06T21:22:58.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.041+0000 7f89a8340700 1 --2- 172.21.15.32:0/627799945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 0x7f89a010a220 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:58.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.041+0000 7f89a8340700 1 --2- 172.21.15.32:0/627799945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a0101410 0x7f89a01017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:58.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.041+0000 7f89a8340700 1 -- 172.21.15.32:0/627799945 >> 172.21.15.32:0/627799945 conn(0x7f89a00fac90 msgr2=0x7f89a00fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:58.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.042+0000 7f89a8340700 1 -- 172.21.15.32:0/627799945 shutdown_connections 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.042+0000 7f89a8340700 1 -- 172.21.15.32:0/627799945 wait complete. 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.042+0000 7f89a8340700 1 Processor -- start 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.042+0000 7f89a8340700 1 -- start start 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.042+0000 7f89a8340700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a0101410 0x7f89a00ff070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.042+0000 7f89a8340700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 0x7f89a00ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.042+0000 7f89a8340700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00ffaf0 con 0x7f89a0101d20 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.042+0000 7f89a8340700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00ffc30 con 0x7f89a0101410 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a58db700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 0x7f89a00ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a58db700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 0x7f89a00ff5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42562/0 (socket says 172.21.15.32:42562) 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a58db700 1 -- 172.21.15.32:0/964076660 learned_addr learned my addr 172.21.15.32:0/964076660 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a60dc700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a0101410 0x7f89a00ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a58db700 1 -- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a0101410 msgr2=0x7f89a00ff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a58db700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a0101410 0x7f89a00ff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:58.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a58db700 1 -- 172.21.15.32:0/964076660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900095f0 con 0x7f89a0101d20 2024-05-06T21:22:58.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a58db700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 0x7f89a00ff5b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8990006010 tx=0x7f899000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:58.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89977fe700 1 -- 172.21.15.32:0/964076660 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f899001d070 con 0x7f89a0101d20 2024-05-06T21:22:58.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89977fe700 1 -- 172.21.15.32:0/964076660 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f899000f460 con 0x7f89a0101d20 2024-05-06T21:22:58.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a00ffeb0 con 0x7f89a0101d20 2024-05-06T21:22:58.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89977fe700 1 -- 172.21.15.32:0/964076660 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8990017630 con 0x7f89a0101d20 2024-05-06T21:22:58.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.043+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a01a2340 con 0x7f89a0101d20 2024-05-06T21:22:58.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.044+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89a010d620 con 0x7f89a0101d20 2024-05-06T21:22:58.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.045+0000 7f89977fe700 1 -- 172.21.15.32:0/964076660 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f899000f5d0 con 0x7f89a0101d20 2024-05-06T21:22:58.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.045+0000 7f89977fe700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f898c06c680 0x7f898c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:58.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.045+0000 7f89977fe700 1 -- 172.21.15.32:0/964076660 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f899008c950 con 0x7f89a0101d20 2024-05-06T21:22:58.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.045+0000 7f89a60dc700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f898c06c680 0x7f898c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:58.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.046+0000 7f89977fe700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] conn(0x7f898c072350 0x7f898c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:22:58.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.046+0000 7f89977fe700 1 -- 172.21.15.32:0/964076660 --> [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f898c074e10 con 0x7f898c072350 2024-05-06T21:22:58.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.046+0000 7f89977fe700 1 -- 172.21.15.32:0/964076660 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89900912a0 con 0x7f89a0101d20 2024-05-06T21:22:58.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.046+0000 7f89a68dd700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] conn(0x7f898c072350 0x7f898c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:22:58.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.046+0000 7f89a60dc700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f898c06c680 0x7f898c06eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f899c005950 tx=0x7f899c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:58.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.046+0000 7f89a68dd700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] conn(0x7f898c072350 0x7f898c074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:22:58.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.047+0000 7f89977fe700 1 -- 172.21.15.32:0/964076660 <== osd.5 v2:172.21.15.154:6816/1788446264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f898c074e10 con 0x7f898c072350 2024-05-06T21:22:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.063+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 --> [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f89a004f2a0 con 0x7f898c072350 2024-05-06T21:22:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89977fe700 1 -- 172.21.15.32:0/964076660 <== osd.5 v2:172.21.15.154:6816/1788446264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f89a004f2a0 con 0x7f898c072350 2024-05-06T21:22:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] conn(0x7f898c072350 msgr2=0x7f898c074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] conn(0x7f898c072350 0x7f898c074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f898c06c680 msgr2=0x7f898c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f898c06c680 0x7f898c06eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f899c005950 tx=0x7f899c00b410 comp rx=0 tx=0).stop 2024-05-06T21:22:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 msgr2=0x7f89a00ff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:22:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 0x7f89a00ff5b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8990006010 tx=0x7f899000bd70 comp rx=0 tx=0).stop 2024-05-06T21:22:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 shutdown_connections 2024-05-06T21:22:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:6816/1788446264,v1:172.21.15.154:6817/1788446264] conn(0x7f898c072350 0x7f898c074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f898c06c680 0x7f898c06eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a0101410 0x7f89a00ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 --2- 172.21.15.32:0/964076660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89a0101d20 0x7f89a00ff5b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:22:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 >> 172.21.15.32:0/964076660 conn(0x7f89a00fac90 msgr2=0x7f89a01049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:22:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 shutdown_connections 2024-05-06T21:22:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:22:58.064+0000 7f89a8340700 1 -- 172.21.15.32:0/964076660 wait complete. 2024-05-06T21:22:58.901 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:22:58 smithi032 ceph-mon[27179]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:59.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:22:58 smithi154 ceph-mon[32880]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:22:59.592 INFO:teuthology.orchestra.run.smithi032.stdout:171798691848 2024-05-06T21:22:59.592 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-06T21:22:59.996 INFO:teuthology.orchestra.run.smithi032.stdout:81604378648 2024-05-06T21:22:59.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-06T21:23:00.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.357+0000 7f35f22b7700 1 -- 172.21.15.32:0/2389157722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ff3c0 msgr2=0x7f35ec0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:00.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.357+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2389157722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ff3c0 0x7f35ec0ff790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009910 tx=0x7f35dc009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:00.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.357+0000 7f35f22b7700 1 -- 172.21.15.32:0/2389157722 shutdown_connections 2024-05-06T21:23:00.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.357+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2389157722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35ec0ffd60 0x7f35ec103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:00.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.357+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2389157722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ff3c0 0x7f35ec0ff790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:00.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.357+0000 7f35f22b7700 1 -- 172.21.15.32:0/2389157722 >> 172.21.15.32:0/2389157722 conn(0x7f35ec0fac80 msgr2=0x7f35ec0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:00.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.357+0000 7f35f22b7700 1 -- 172.21.15.32:0/2389157722 shutdown_connections 2024-05-06T21:23:00.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.357+0000 7f35f22b7700 1 -- 172.21.15.32:0/2389157722 wait complete. 2024-05-06T21:23:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.358+0000 7f35f22b7700 1 Processor -- start 2024-05-06T21:23:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.358+0000 7f35f22b7700 1 -- start start 2024-05-06T21:23:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35f22b7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35ec0ff3c0 0x7f35ec100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35f22b7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ffd60 0x7f35ec101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35f22b7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec101850 con 0x7f35ec0ffd60 2024-05-06T21:23:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35f22b7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec101990 con 0x7f35ec0ff3c0 2024-05-06T21:23:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35eb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ffd60 0x7f35ec101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35eb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ffd60 0x7f35ec101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42570/0 (socket says 172.21.15.32:42570) 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35eb7fe700 1 -- 172.21.15.32:0/2184687449 learned_addr learned my addr 172.21.15.32:0/2184687449 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35ebfff700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35ec0ff3c0 0x7f35ec100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35eb7fe700 1 -- 172.21.15.32:0/2184687449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35ec0ff3c0 msgr2=0x7f35ec100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35eb7fe700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35ec0ff3c0 0x7f35ec100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35eb7fe700 1 -- 172.21.15.32:0/2184687449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc0095f0 con 0x7f35ec0ffd60 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35ebfff700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35ec0ff3c0 0x7f35ec100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.359+0000 7f35eb7fe700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ffd60 0x7f35ec101310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35e000d8d0 tx=0x7f35e000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.360+0000 7f35e97fa700 1 -- 172.21.15.32:0/2184687449 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e0004a00 con 0x7f35ec0ffd60 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.360+0000 7f35e97fa700 1 -- 172.21.15.32:0/2184687449 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35e00054d0 con 0x7f35ec0ffd60 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.360+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec1a20f0 con 0x7f35ec0ffd60 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.360+0000 7f35e97fa700 1 -- 172.21.15.32:0/2184687449 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e0009d40 con 0x7f35ec0ffd60 2024-05-06T21:23:00.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.360+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec1a2500 con 0x7f35ec0ffd60 2024-05-06T21:23:00.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.361+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35ec10c540 con 0x7f35ec0ffd60 2024-05-06T21:23:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.361+0000 7f35e97fa700 1 -- 172.21.15.32:0/2184687449 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f35e0005020 con 0x7f35ec0ffd60 2024-05-06T21:23:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.362+0000 7f35e97fa700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f35d406c680 0x7f35d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.362+0000 7f35e97fa700 1 -- 172.21.15.32:0/2184687449 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f35e008ae90 con 0x7f35ec0ffd60 2024-05-06T21:23:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.362+0000 7f35ebfff700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f35d406c680 0x7f35d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.362+0000 7f35e97fa700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] conn(0x7f35d40723a0 0x7f35d40747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.362+0000 7f35e97fa700 1 -- 172.21.15.32:0/2184687449 --> [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35d4074e60 con 0x7f35d40723a0 2024-05-06T21:23:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.362+0000 7f35e97fa700 1 -- 172.21.15.32:0/2184687449 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35e0090570 con 0x7f35ec0ffd60 2024-05-06T21:23:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.362+0000 7f35f0854700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] conn(0x7f35d40723a0 0x7f35d40747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.363+0000 7f35ebfff700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f35d406c680 0x7f35d406eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35dc006010 tx=0x7f35dc00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.363+0000 7f35f0854700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] conn(0x7f35d40723a0 0x7f35d40747b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.363+0000 7f35e97fa700 1 -- 172.21.15.32:0/2184687449 <== osd.0 v2:172.21.15.32:6802/1973178361 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f35d4074e60 con 0x7f35d40723a0 2024-05-06T21:23:00.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.379+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 --> [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35ec04f2a0 con 0x7f35d40723a0 2024-05-06T21:23:00.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35e97fa700 1 -- 172.21.15.32:0/2184687449 <== osd.0 v2:172.21.15.32:6802/1973178361 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35ec04f2a0 con 0x7f35d40723a0 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] conn(0x7f35d40723a0 msgr2=0x7f35d40747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] conn(0x7f35d40723a0 0x7f35d40747b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f35d406c680 msgr2=0x7f35d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f35d406c680 0x7f35d406eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35dc006010 tx=0x7f35dc00b540 comp rx=0 tx=0).stop 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ffd60 msgr2=0x7f35ec101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ffd60 0x7f35ec101310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35e000d8d0 tx=0x7f35e000dc90 comp rx=0 tx=0).stop 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 shutdown_connections 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6802/1973178361,v1:172.21.15.32:6803/1973178361] conn(0x7f35d40723a0 0x7f35d40747b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f35d406c680 0x7f35d406eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35ec0ff3c0 0x7f35ec100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 --2- 172.21.15.32:0/2184687449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec0ffd60 0x7f35ec101310 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 >> 172.21.15.32:0/2184687449 conn(0x7f35ec0fac80 msgr2=0x7f35ec103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 shutdown_connections 2024-05-06T21:23:00.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:00.380+0000 7f35f22b7700 1 -- 172.21.15.32:0/2184687449 wait complete. 2024-05-06T21:23:00.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:00 smithi032 ceph-mon[27179]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:01.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:00 smithi154 ceph-mon[32880]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:02.698 INFO:teuthology.orchestra.run.smithi032.stdout:38654705698 2024-05-06T21:23:02.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-06T21:23:02.728 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:02 smithi032 ceph-mon[27179]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.014+0000 7f19a4044700 1 -- 172.21.15.32:0/541412359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c100e80 msgr2=0x7f199c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.014+0000 7f19a4044700 1 --2- 172.21.15.32:0/541412359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c100e80 0x7f199c104e50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1990009910 tx=0x7f1990009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.014+0000 7f19a4044700 1 -- 172.21.15.32:0/541412359 shutdown_connections 2024-05-06T21:23:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.014+0000 7f19a4044700 1 --2- 172.21.15.32:0/541412359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c100e80 0x7f199c104e50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.014+0000 7f19a4044700 1 --2- 172.21.15.32:0/541412359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f199c1004e0 0x7f199c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.014+0000 7f19a4044700 1 -- 172.21.15.32:0/541412359 >> 172.21.15.32:0/541412359 conn(0x7f199c0fbda0 msgr2=0x7f199c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.014+0000 7f19a4044700 1 -- 172.21.15.32:0/541412359 shutdown_connections 2024-05-06T21:23:03.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.014+0000 7f19a4044700 1 -- 172.21.15.32:0/541412359 wait complete. 2024-05-06T21:23:03.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a4044700 1 Processor -- start 2024-05-06T21:23:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a4044700 1 -- start start 2024-05-06T21:23:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a4044700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c1004e0 0x7f199c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a4044700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f199c100e80 0x7f199c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a4044700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c073ad0 con 0x7f199c1004e0 2024-05-06T21:23:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a4044700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c073c10 con 0x7f199c100e80 2024-05-06T21:23:03.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a1de0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c1004e0 0x7f199c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a1de0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c1004e0 0x7f199c073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55580/0 (socket says 172.21.15.32:55580) 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a1de0700 1 -- 172.21.15.32:0/444448963 learned_addr learned my addr 172.21.15.32:0/444448963 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.015+0000 7f19a15df700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f199c100e80 0x7f199c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.016+0000 7f19a1de0700 1 -- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f199c100e80 msgr2=0x7f199c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.016+0000 7f19a1de0700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f199c100e80 0x7f199c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.016+0000 7f19a1de0700 1 -- 172.21.15.32:0/444448963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900095f0 con 0x7f199c1004e0 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.016+0000 7f19a1de0700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c1004e0 0x7f199c073050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f198c00ada0 tx=0x7f198c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.016+0000 7f199affd700 1 -- 172.21.15.32:0/444448963 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198c00f070 con 0x7f199c1004e0 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.016+0000 7f199affd700 1 -- 172.21.15.32:0/444448963 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f198c007bf0 con 0x7f199c1004e0 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.016+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c1a2100 con 0x7f199c1004e0 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.016+0000 7f199affd700 1 -- 172.21.15.32:0/444448963 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198c005670 con 0x7f199c1004e0 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.016+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c1a2510 con 0x7f199c1004e0 2024-05-06T21:23:03.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.017+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f199c10d650 con 0x7f199c1004e0 2024-05-06T21:23:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.018+0000 7f199affd700 1 -- 172.21.15.32:0/444448963 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f198c0058b0 con 0x7f199c1004e0 2024-05-06T21:23:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.018+0000 7f199affd700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f198406c680 0x7f198406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.018+0000 7f199affd700 1 -- 172.21.15.32:0/444448963 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f198c08ae80 con 0x7f199c1004e0 2024-05-06T21:23:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.018+0000 7f19a15df700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f198406c680 0x7f198406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.018+0000 7f199affd700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] conn(0x7f1984072350 0x7f1984074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.018+0000 7f199affd700 1 -- 172.21.15.32:0/444448963 --> [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1984074e10 con 0x7f1984072350 2024-05-06T21:23:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.018+0000 7f199affd700 1 -- 172.21.15.32:0/444448963 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f198c090560 con 0x7f199c1004e0 2024-05-06T21:23:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.019+0000 7f19a15df700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f198406c680 0x7f198406eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f199c074840 tx=0x7f199001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.019+0000 7f19a25e1700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] conn(0x7f1984072350 0x7f1984074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.019+0000 7f19a25e1700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] conn(0x7f1984072350 0x7f1984074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.020+0000 7f199affd700 1 -- 172.21.15.32:0/444448963 <== osd.3 v2:172.21.15.154:6800/2326216039 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1984074e10 con 0x7f1984072350 2024-05-06T21:23:03.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.036+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 --> [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f199c04f2a0 con 0x7f1984072350 2024-05-06T21:23:03.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.036+0000 7f199affd700 1 -- 172.21.15.32:0/444448963 <== osd.3 v2:172.21.15.154:6800/2326216039 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f199c04f2a0 con 0x7f1984072350 2024-05-06T21:23:03.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] conn(0x7f1984072350 msgr2=0x7f1984074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] conn(0x7f1984072350 0x7f1984074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f198406c680 msgr2=0x7f198406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f198406c680 0x7f198406eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f199c074840 tx=0x7f199001a040 comp rx=0 tx=0).stop 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c1004e0 msgr2=0x7f199c073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c1004e0 0x7f199c073050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f198c00ada0 tx=0x7f198c00c330 comp rx=0 tx=0).stop 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 shutdown_connections 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:6800/2326216039,v1:172.21.15.154:6801/2326216039] conn(0x7f1984072350 0x7f1984074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f198406c680 0x7f198406eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f199c1004e0 0x7f199c073050 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 --2- 172.21.15.32:0/444448963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f199c100e80 0x7f199c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 >> 172.21.15.32:0/444448963 conn(0x7f199c0fbda0 msgr2=0x7f199c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 shutdown_connections 2024-05-06T21:23:03.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.037+0000 7f19a4044700 1 -- 172.21.15.32:0/444448963 wait complete. 2024-05-06T21:23:03.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:02 smithi154 ceph-mon[32880]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 -- 172.21.15.32:0/3489920579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 msgr2=0x7f1b30100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 --2- 172.21.15.32:0/3489920579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 0x7f1b30100890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009910 tx=0x7f1b24009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 -- 172.21.15.32:0/3489920579 shutdown_connections 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 --2- 172.21.15.32:0/3489920579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b30100e60 0x7f1b30104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 --2- 172.21.15.32:0/3489920579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 0x7f1b30100890 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 -- 172.21.15.32:0/3489920579 >> 172.21.15.32:0/3489920579 conn(0x7f1b300fbd80 msgr2=0x7f1b300fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 -- 172.21.15.32:0/3489920579 shutdown_connections 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 -- 172.21.15.32:0/3489920579 wait complete. 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 Processor -- start 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.743+0000 7f1b36a95700 1 -- start start 2024-05-06T21:23:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b36a95700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 0x7f1b30195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b36a95700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b30100e60 0x7f1b30196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b36a95700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30196b30 con 0x7f1b301004c0 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b36a95700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3019a8c0 con 0x7f1b30100e60 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b34831700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 0x7f1b30195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b34831700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 0x7f1b30195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55590/0 (socket says 172.21.15.32:55590) 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b34831700 1 -- 172.21.15.32:0/576601979 learned_addr learned my addr 172.21.15.32:0/576601979 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b2ffff700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b30100e60 0x7f1b30196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b34831700 1 -- 172.21.15.32:0/576601979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b30100e60 msgr2=0x7f1b30196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b34831700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b30100e60 0x7f1b30196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b34831700 1 -- 172.21.15.32:0/576601979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b240095f0 con 0x7f1b301004c0 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b34831700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 0x7f1b30195f10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1b24006010 tx=0x7f1b2400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b2dffb700 1 -- 172.21.15.32:0/576601979 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b2401d070 con 0x7f1b301004c0 2024-05-06T21:23:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.744+0000 7f1b2dffb700 1 -- 172.21.15.32:0/576601979 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1b2400f460 con 0x7f1b301004c0 2024-05-06T21:23:03.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.745+0000 7f1b2dffb700 1 -- 172.21.15.32:0/576601979 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b24021640 con 0x7f1b301004c0 2024-05-06T21:23:03.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.745+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3019ab40 con 0x7f1b301004c0 2024-05-06T21:23:03.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.745+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3019b030 con 0x7f1b301004c0 2024-05-06T21:23:03.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.746+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b3010d6d0 con 0x7f1b301004c0 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.746+0000 7f1b2dffb700 1 -- 172.21.15.32:0/576601979 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1b2400faf0 con 0x7f1b301004c0 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.747+0000 7f1b2dffb700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f1b2006c680 0x7f1b2006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.747+0000 7f1b2dffb700 1 -- 172.21.15.32:0/576601979 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1b2408c8f0 con 0x7f1b301004c0 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.747+0000 7f1b2ffff700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f1b2006c680 0x7f1b2006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.747+0000 7f1b2dffb700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] conn(0x7f1b20072350 0x7f1b20074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.747+0000 7f1b2dffb700 1 -- 172.21.15.32:0/576601979 --> [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b20074e10 con 0x7f1b20072350 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.747+0000 7f1b2dffb700 1 -- 172.21.15.32:0/576601979 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b240912a0 con 0x7f1b301004c0 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.747+0000 7f1b35032700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] conn(0x7f1b20072350 0x7f1b20074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.747+0000 7f1b2ffff700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f1b2006c680 0x7f1b2006eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c006fd0 tx=0x7f1b1c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:03.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.748+0000 7f1b35032700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] conn(0x7f1b20072350 0x7f1b20074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:03.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.748+0000 7f1b2dffb700 1 -- 172.21.15.32:0/576601979 <== osd.1 v2:172.21.15.32:6810/3464551315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1b20074e10 con 0x7f1b20072350 2024-05-06T21:23:03.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.765+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 --> [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b3004f2a0 con 0x7f1b20072350 2024-05-06T21:23:03.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.765+0000 7f1b2dffb700 1 -- 172.21.15.32:0/576601979 <== osd.1 v2:172.21.15.32:6810/3464551315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b3004f2a0 con 0x7f1b20072350 2024-05-06T21:23:03.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.765+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] conn(0x7f1b20072350 msgr2=0x7f1b20074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.765+0000 7f1b36a95700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] conn(0x7f1b20072350 0x7f1b20074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.765+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f1b2006c680 msgr2=0x7f1b2006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.765+0000 7f1b36a95700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f1b2006c680 0x7f1b2006eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c006fd0 tx=0x7f1b1c008040 comp rx=0 tx=0).stop 2024-05-06T21:23:03.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 msgr2=0x7f1b30195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:03.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 0x7f1b30195f10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1b24006010 tx=0x7f1b2400be20 comp rx=0 tx=0).stop 2024-05-06T21:23:03.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 shutdown_connections 2024-05-06T21:23:03.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6810/3464551315,v1:172.21.15.32:6811/3464551315] conn(0x7f1b20072350 0x7f1b20074760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f1b2006c680 0x7f1b2006eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b301004c0 0x7f1b30195f10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 --2- 172.21.15.32:0/576601979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b30100e60 0x7f1b30196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:03.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 >> 172.21.15.32:0/576601979 conn(0x7f1b300fbd80 msgr2=0x7f1b300fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:03.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 shutdown_connections 2024-05-06T21:23:03.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:03.766+0000 7f1b36a95700 1 -- 172.21.15.32:0/576601979 wait complete. 2024-05-06T21:23:03.788 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:03.999 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:04.535 INFO:teuthology.orchestra.run.smithi032.stdout:60129542174 2024-05-06T21:23:04.536 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-06T21:23:04.837 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:04 smithi032 ceph-mon[27179]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:05.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:04 smithi154 ceph-mon[32880]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.260+0000 7fda50a3c700 1 -- 172.21.15.32:0/3869726956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 msgr2=0x7fda4c104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.260+0000 7fda50a3c700 1 --2- 172.21.15.32:0/3869726956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 0x7fda4c104500 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009910 tx=0x7fda3c009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.260+0000 7fda50a3c700 1 -- 172.21.15.32:0/3869726956 shutdown_connections 2024-05-06T21:23:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.260+0000 7fda50a3c700 1 --2- 172.21.15.32:0/3869726956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4c0ffbd0 0x7fda4c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.260+0000 7fda50a3c700 1 --2- 172.21.15.32:0/3869726956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 0x7fda4c104500 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.260+0000 7fda50a3c700 1 -- 172.21.15.32:0/3869726956 >> 172.21.15.32:0/3869726956 conn(0x7fda4c075130 msgr2=0x7fda4c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.260+0000 7fda50a3c700 1 -- 172.21.15.32:0/3869726956 shutdown_connections 2024-05-06T21:23:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.260+0000 7fda50a3c700 1 -- 172.21.15.32:0/3869726956 wait complete. 2024-05-06T21:23:05.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.261+0000 7fda50a3c700 1 Processor -- start 2024-05-06T21:23:05.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.261+0000 7fda50a3c700 1 -- start start 2024-05-06T21:23:05.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.261+0000 7fda50a3c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4c0ffbd0 0x7fda4c195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:05.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.261+0000 7fda50a3c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 0x7fda4c196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:05.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.261+0000 7fda50a3c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c196a70 con 0x7fda4c104130 2024-05-06T21:23:05.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.261+0000 7fda50a3c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c19a800 con 0x7fda4c0ffbd0 2024-05-06T21:23:05.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda49d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 0x7fda4c196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda49d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 0x7fda4c196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55604/0 (socket says 172.21.15.32:55604) 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda49d9b700 1 -- 172.21.15.32:0/2205644601 learned_addr learned my addr 172.21.15.32:0/2205644601 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda4a59c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4c0ffbd0 0x7fda4c195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda49d9b700 1 -- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4c0ffbd0 msgr2=0x7fda4c195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda49d9b700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4c0ffbd0 0x7fda4c195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda49d9b700 1 -- 172.21.15.32:0/2205644601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c0095f0 con 0x7fda4c104130 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda49d9b700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 0x7fda4c196390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda4000d8d0 tx=0x7fda4000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda3b7fe700 1 -- 172.21.15.32:0/2205644601 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda400098a0 con 0x7fda4c104130 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda3b7fe700 1 -- 172.21.15.32:0/2205644601 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda40010460 con 0x7fda4c104130 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4c19aae0 con 0x7fda4c104130 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda3b7fe700 1 -- 172.21.15.32:0/2205644601 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda4000f5f0 con 0x7fda4c104130 2024-05-06T21:23:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.262+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4c19b030 con 0x7fda4c104130 2024-05-06T21:23:05.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.263+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda4c10c5c0 con 0x7fda4c104130 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.264+0000 7fda3b7fe700 1 -- 172.21.15.32:0/2205644601 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fda40009a00 con 0x7fda4c104130 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.264+0000 7fda3b7fe700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fda3406c680 0x7fda3406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.265+0000 7fda3b7fe700 1 -- 172.21.15.32:0/2205644601 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fda4008b440 con 0x7fda4c104130 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.265+0000 7fda4a59c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fda3406c680 0x7fda3406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.265+0000 7fda3b7fe700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] conn(0x7fda34072350 0x7fda34074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.265+0000 7fda3b7fe700 1 -- 172.21.15.32:0/2205644601 --> [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda34074e10 con 0x7fda34072350 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.265+0000 7fda3b7fe700 1 -- 172.21.15.32:0/2205644601 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda4008db10 con 0x7fda4c104130 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.265+0000 7fda4a59c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fda3406c680 0x7fda3406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda3c000c00 tx=0x7fda3c01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.265+0000 7fda4ad9d700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] conn(0x7fda34072350 0x7fda34074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.265+0000 7fda4ad9d700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] conn(0x7fda34072350 0x7fda34074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.266+0000 7fda3b7fe700 1 -- 172.21.15.32:0/2205644601 <== osd.4 v2:172.21.15.154:6808/662519611 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fda34074e10 con 0x7fda34072350 2024-05-06T21:23:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.283+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 --> [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda4c04f2a0 con 0x7fda34072350 2024-05-06T21:23:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.284+0000 7fda3b7fe700 1 -- 172.21.15.32:0/2205644601 <== osd.4 v2:172.21.15.154:6808/662519611 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fda4c04f2a0 con 0x7fda34072350 2024-05-06T21:23:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.284+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] conn(0x7fda34072350 msgr2=0x7fda34074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.284+0000 7fda50a3c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] conn(0x7fda34072350 0x7fda34074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.284+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fda3406c680 msgr2=0x7fda3406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.284+0000 7fda50a3c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fda3406c680 0x7fda3406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda3c000c00 tx=0x7fda3c01a040 comp rx=0 tx=0).stop 2024-05-06T21:23:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.284+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 msgr2=0x7fda4c196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.285+0000 7fda50a3c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 0x7fda4c196390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda4000d8d0 tx=0x7fda4000dbe0 comp rx=0 tx=0).stop 2024-05-06T21:23:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.285+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 shutdown_connections 2024-05-06T21:23:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.285+0000 7fda50a3c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:6808/662519611,v1:172.21.15.154:6809/662519611] conn(0x7fda34072350 0x7fda34074760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.285+0000 7fda50a3c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fda3406c680 0x7fda3406eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:05.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.285+0000 7fda50a3c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4c0ffbd0 0x7fda4c195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:05.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.285+0000 7fda50a3c700 1 --2- 172.21.15.32:0/2205644601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4c104130 0x7fda4c196390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:05.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.285+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 >> 172.21.15.32:0/2205644601 conn(0x7fda4c075130 msgr2=0x7fda4c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:05.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.285+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 shutdown_connections 2024-05-06T21:23:05.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:05.285+0000 7fda50a3c700 1 -- 172.21.15.32:0/2205644601 wait complete. 2024-05-06T21:23:05.816 INFO:teuthology.orchestra.run.smithi032.stdout:115964117011 2024-05-06T21:23:05.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-06T21:23:06.004 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:05 smithi032 ceph-mon[27179]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:06.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:05 smithi154 ceph-mon[32880]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:06.450 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:06.846 INFO:teuthology.orchestra.run.smithi032.stdout:150323855375 2024-05-06T21:23:06.846 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-06T21:23:08.897 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:08 smithi032 ceph-mon[27179]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:09.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:08 smithi154 ceph-mon[32880]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:09.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.545+0000 7f762ebf6700 1 -- 172.21.15.32:0/495620632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 msgr2=0x7f7628104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:09.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.545+0000 7f762ebf6700 1 --2- 172.21.15.32:0/495620632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 0x7f7628104500 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7610009910 tx=0x7f7610009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:09.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.545+0000 7f762ebf6700 1 -- 172.21.15.32:0/495620632 shutdown_connections 2024-05-06T21:23:09.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.545+0000 7f762ebf6700 1 --2- 172.21.15.32:0/495620632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76280ffbd0 0x7f7628100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:09.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.545+0000 7f762ebf6700 1 --2- 172.21.15.32:0/495620632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 0x7f7628104500 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:09.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.545+0000 7f762ebf6700 1 -- 172.21.15.32:0/495620632 >> 172.21.15.32:0/495620632 conn(0x7f7628075130 msgr2=0x7f7628075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:09.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.545+0000 7f762ebf6700 1 -- 172.21.15.32:0/495620632 shutdown_connections 2024-05-06T21:23:09.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.545+0000 7f762ebf6700 1 -- 172.21.15.32:0/495620632 wait complete. 2024-05-06T21:23:09.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.546+0000 7f762ebf6700 1 Processor -- start 2024-05-06T21:23:09.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.546+0000 7f762ebf6700 1 -- start start 2024-05-06T21:23:09.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.546+0000 7f762ebf6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76280ffbd0 0x7f7628195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:09.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.546+0000 7f762ebf6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 0x7f7628196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:09.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.546+0000 7f762ebf6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76281969e0 con 0x7f7628104130 2024-05-06T21:23:09.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.546+0000 7f762ebf6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7628196b20 con 0x7f76280ffbd0 2024-05-06T21:23:09.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.546+0000 7f7627fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 0x7f7628196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.546+0000 7f7627fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 0x7f7628196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55626/0 (socket says 172.21.15.32:55626) 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.546+0000 7f7627fff700 1 -- 172.21.15.32:0/1231067936 learned_addr learned my addr 172.21.15.32:0/1231067936 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f762c992700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76280ffbd0 0x7f7628195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f7627fff700 1 -- 172.21.15.32:0/1231067936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76280ffbd0 msgr2=0x7f7628195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f7627fff700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76280ffbd0 0x7f7628195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f7627fff700 1 -- 172.21.15.32:0/1231067936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76100095f0 con 0x7f7628104130 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f7627fff700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 0x7f7628196390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f761800cfd0 tx=0x7f761800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f7625ffb700 1 -- 172.21.15.32:0/1231067936 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761800ad70 con 0x7f7628104130 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f7625ffb700 1 -- 172.21.15.32:0/1231067936 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76180128d0 con 0x7f7628104130 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762819a970 con 0x7f7628104130 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f7625ffb700 1 -- 172.21.15.32:0/1231067936 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7618011880 con 0x7f7628104130 2024-05-06T21:23:09.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.547+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762819aec0 con 0x7f7628104130 2024-05-06T21:23:09.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.548+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76281086a0 con 0x7f7628104130 2024-05-06T21:23:09.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.549+0000 7f7625ffb700 1 -- 172.21.15.32:0/1231067936 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7618012420 con 0x7f7628104130 2024-05-06T21:23:09.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.549+0000 7f7625ffb700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f761406c680 0x7f761406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:09.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.549+0000 7f7625ffb700 1 -- 172.21.15.32:0/1231067936 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f761808b680 con 0x7f7628104130 2024-05-06T21:23:09.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.549+0000 7f762c992700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f761406c680 0x7f761406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:09.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.550+0000 7f762c992700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f761406c680 0x7f761406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f761000b5c0 tx=0x7f7610005460 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:09.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.554+0000 7f7625ffb700 1 -- 172.21.15.32:0/1231067936 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f76180560a0 con 0x7f7628104130 2024-05-06T21:23:09.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.758+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f762802cc30 con 0x7f7628104130 2024-05-06T21:23:09.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.758+0000 7f7625ffb700 1 -- 172.21.15.32:0/1231067936 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76180596c0 con 0x7f7628104130 2024-05-06T21:23:09.762 INFO:teuthology.orchestra.run.smithi032.stdout:171798691850 2024-05-06T21:23:09.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.760+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f761406c680 msgr2=0x7f761406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:09.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.760+0000 7f762ebf6700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f761406c680 0x7f761406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f761000b5c0 tx=0x7f7610005460 comp rx=0 tx=0).stop 2024-05-06T21:23:09.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.761+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 msgr2=0x7f7628196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:09.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.761+0000 7f762ebf6700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 0x7f7628196390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f761800cfd0 tx=0x7f761800a340 comp rx=0 tx=0).stop 2024-05-06T21:23:09.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.761+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 shutdown_connections 2024-05-06T21:23:09.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.761+0000 7f762ebf6700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f761406c680 0x7f761406eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:09.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.761+0000 7f762ebf6700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76280ffbd0 0x7f7628195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:09.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.761+0000 7f762ebf6700 1 --2- 172.21.15.32:0/1231067936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7628104130 0x7f7628196390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:09.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.761+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 >> 172.21.15.32:0/1231067936 conn(0x7f7628075130 msgr2=0x7f76280fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:09.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.761+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 shutdown_connections 2024-05-06T21:23:09.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.761+0000 7f762ebf6700 1 -- 172.21.15.32:0/1231067936 wait complete. 2024-05-06T21:23:10.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.755+0000 7f3e294f8700 1 -- 172.21.15.32:0/3053853886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e241038b0 msgr2=0x7f3e24103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:10.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.755+0000 7f3e294f8700 1 --2- 172.21.15.32:0/3053853886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e241038b0 0x7f3e24103c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009910 tx=0x7f3e14009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:10.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.755+0000 7f3e294f8700 1 -- 172.21.15.32:0/3053853886 shutdown_connections 2024-05-06T21:23:10.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.755+0000 7f3e294f8700 1 --2- 172.21.15.32:0/3053853886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e240ff350 0x7f3e240ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:10.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.755+0000 7f3e294f8700 1 --2- 172.21.15.32:0/3053853886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e241038b0 0x7f3e24103c80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:10.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.755+0000 7f3e294f8700 1 -- 172.21.15.32:0/3053853886 >> 172.21.15.32:0/3053853886 conn(0x7f3e240748b0 msgr2=0x7f3e24074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:10.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.755+0000 7f3e294f8700 1 -- 172.21.15.32:0/3053853886 shutdown_connections 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.755+0000 7f3e294f8700 1 -- 172.21.15.32:0/3053853886 wait complete. 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.755+0000 7f3e294f8700 1 Processor -- start 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e294f8700 1 -- start start 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e294f8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e240ff350 0x7f3e241005b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e294f8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e241038b0 0x7f3e24100af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e294f8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24101030 con 0x7f3e240ff350 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e294f8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24101170 con 0x7f3e241038b0 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e22ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e240ff350 0x7f3e241005b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e22ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e240ff350 0x7f3e241005b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55642/0 (socket says 172.21.15.32:55642) 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e22ffd700 1 -- 172.21.15.32:0/3007165171 learned_addr learned my addr 172.21.15.32:0/3007165171 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e227fc700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e241038b0 0x7f3e24100af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e22ffd700 1 -- 172.21.15.32:0/3007165171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e241038b0 msgr2=0x7f3e24100af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:10.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e22ffd700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e241038b0 0x7f3e24100af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e22ffd700 1 -- 172.21.15.32:0/3007165171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e140095f0 con 0x7f3e240ff350 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.756+0000 7f3e22ffd700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e240ff350 0x7f3e241005b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e14000c00 tx=0x7f3e1400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.757+0000 7f3e0bfff700 1 -- 172.21.15.32:0/3007165171 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e1401d070 con 0x7f3e240ff350 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.757+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e241013f0 con 0x7f3e240ff350 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.757+0000 7f3e0bfff700 1 -- 172.21.15.32:0/3007165171 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e14004fa0 con 0x7f3e240ff350 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.757+0000 7f3e0bfff700 1 -- 172.21.15.32:0/3007165171 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e1400f460 con 0x7f3e240ff350 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.757+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e241a2350 con 0x7f3e240ff350 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.758+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2404f2a0 con 0x7f3e240ff350 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.758+0000 7f3e0bfff700 1 -- 172.21.15.32:0/3007165171 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3e14022870 con 0x7f3e240ff350 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.759+0000 7f3e0bfff700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3e0c06c680 0x7f3e0c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:10.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.759+0000 7f3e0bfff700 1 -- 172.21.15.32:0/3007165171 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3e1408ca70 con 0x7f3e240ff350 2024-05-06T21:23:10.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.759+0000 7f3e227fc700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3e0c06c680 0x7f3e0c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:10.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.760+0000 7f3e227fc700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3e0c06c680 0x7f3e0c06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e18005950 tx=0x7f3e180058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:10.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.764+0000 7f3e0bfff700 1 -- 172.21.15.32:0/3007165171 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3e14057540 con 0x7f3e240ff350 2024-05-06T21:23:10.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.972+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e241a2610 con 0x7f3e240ff350 2024-05-06T21:23:10.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.972+0000 7f3e0bfff700 1 -- 172.21.15.32:0/3007165171 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e1408ce60 con 0x7f3e240ff350 2024-05-06T21:23:10.837 INFO:teuthology.orchestra.run.smithi032.stdout:81604378650 2024-05-06T21:23:10.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.974+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3e0c06c680 msgr2=0x7f3e0c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:10.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.974+0000 7f3e294f8700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3e0c06c680 0x7f3e0c06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e18005950 tx=0x7f3e180058e0 comp rx=0 tx=0).stop 2024-05-06T21:23:10.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.974+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e240ff350 msgr2=0x7f3e241005b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:10.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.974+0000 7f3e294f8700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e240ff350 0x7f3e241005b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e14000c00 tx=0x7f3e1400be20 comp rx=0 tx=0).stop 2024-05-06T21:23:10.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.974+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 shutdown_connections 2024-05-06T21:23:10.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.974+0000 7f3e294f8700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3e0c06c680 0x7f3e0c06eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:10.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.974+0000 7f3e294f8700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e240ff350 0x7f3e241005b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:10.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.974+0000 7f3e294f8700 1 --2- 172.21.15.32:0/3007165171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e241038b0 0x7f3e24100af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:10.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.974+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 >> 172.21.15.32:0/3007165171 conn(0x7f3e240748b0 msgr2=0x7f3e240fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:10.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.975+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 shutdown_connections 2024-05-06T21:23:10.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:09.975+0000 7f3e294f8700 1 -- 172.21.15.32:0/3007165171 wait complete. 2024-05-06T21:23:10.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:10 smithi032 ceph-mon[27179]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:10.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:10 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1231067936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-06T21:23:10.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:10 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3007165171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-06T21:23:11.084 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:11.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:10 smithi154 ceph-mon[32880]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:11.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:10 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1231067936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-06T21:23:11.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:10 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3007165171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-06T21:23:11.474 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-05-06T21:23:11.475 DEBUG:teuthology.parallel:result is None 2024-05-06T21:23:11.714 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:11.714 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:12.125 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691848 got 171798691850 for osd.5 2024-05-06T21:23:12.126 DEBUG:teuthology.parallel:result is None 2024-05-06T21:23:12.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.790+0000 7f75f3231700 1 -- 172.21.15.32:0/930191319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0ffbd0 msgr2=0x7f75ec100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:12.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.790+0000 7f75f3231700 1 --2- 172.21.15.32:0/930191319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0ffbd0 0x7f75ec100040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009910 tx=0x7f75e0009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.790+0000 7f75f3231700 1 -- 172.21.15.32:0/930191319 shutdown_connections 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.790+0000 7f75f3231700 1 --2- 172.21.15.32:0/930191319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0ffbd0 0x7f75ec100040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.790+0000 7f75f3231700 1 --2- 172.21.15.32:0/930191319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75ec104130 0x7f75ec104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.790+0000 7f75f3231700 1 -- 172.21.15.32:0/930191319 >> 172.21.15.32:0/930191319 conn(0x7f75ec075130 msgr2=0x7f75ec075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.790+0000 7f75f3231700 1 -- 172.21.15.32:0/930191319 shutdown_connections 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.790+0000 7f75f3231700 1 -- 172.21.15.32:0/930191319 wait complete. 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75f3231700 1 Processor -- start 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75f3231700 1 -- start start 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75f3231700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75ec0ffbd0 0x7f75ec196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75f3231700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec104130 0x7f75ec1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75f3231700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec197800 con 0x7f75ec104130 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75f3231700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec197940 con 0x7f75ec0ffbd0 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75ebfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec104130 0x7f75ec1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:12.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75ebfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec104130 0x7f75ec1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35588/0 (socket says 172.21.15.32:35588) 2024-05-06T21:23:12.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75ebfff700 1 -- 172.21.15.32:0/3784695121 learned_addr learned my addr 172.21.15.32:0/3784695121 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75ebfff700 1 -- 172.21.15.32:0/3784695121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75ec0ffbd0 msgr2=0x7f75ec196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75f0fcd700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75ec0ffbd0 0x7f75ec196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75ebfff700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75ec0ffbd0 0x7f75ec196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75ebfff700 1 -- 172.21.15.32:0/3784695121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e00095f0 con 0x7f75ec104130 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.791+0000 7f75f0fcd700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75ec0ffbd0 0x7f75ec196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.792+0000 7f75ebfff700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec104130 0x7f75ec1971e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f75e000bd70 tx=0x7f75e000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.792+0000 7f75e9ffb700 1 -- 172.21.15.32:0/3784695121 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e001d070 con 0x7f75ec104130 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.792+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec19fd10 con 0x7f75ec104130 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.792+0000 7f75e9ffb700 1 -- 172.21.15.32:0/3784695121 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75e0022470 con 0x7f75ec104130 2024-05-06T21:23:12.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.792+0000 7f75e9ffb700 1 -- 172.21.15.32:0/3784695121 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e000f690 con 0x7f75ec104130 2024-05-06T21:23:12.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.792+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec1a0120 con 0x7f75ec104130 2024-05-06T21:23:12.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.793+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ec04f2a0 con 0x7f75ec104130 2024-05-06T21:23:12.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.794+0000 7f75e9ffb700 1 -- 172.21.15.32:0/3784695121 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f75e00225e0 con 0x7f75ec104130 2024-05-06T21:23:12.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.794+0000 7f75e9ffb700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f75d406c680 0x7f75d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:12.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.794+0000 7f75e9ffb700 1 -- 172.21.15.32:0/3784695121 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f75e008cb40 con 0x7f75ec104130 2024-05-06T21:23:12.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.794+0000 7f75f0fcd700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f75d406c680 0x7f75d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:12.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.795+0000 7f75f0fcd700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f75d406c680 0x7f75d406eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75dc005fd0 tx=0x7f75dc005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:12.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:12.799+0000 7f75e9ffb700 1 -- 172.21.15.32:0/3784695121 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f75e0057610 con 0x7f75ec104130 2024-05-06T21:23:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:12 smithi032 ceph-mon[27179]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.005+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75ec1a03e0 con 0x7f75ec104130 2024-05-06T21:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.005+0000 7f75e9ffb700 1 -- 172.21.15.32:0/3784695121 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75e005ac30 con 0x7f75ec104130 2024-05-06T21:23:13.009 INFO:teuthology.orchestra.run.smithi032.stdout:38654705701 2024-05-06T21:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f75d406c680 msgr2=0x7f75d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f75d406c680 0x7f75d406eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75dc005fd0 tx=0x7f75dc005dc0 comp rx=0 tx=0).stop 2024-05-06T21:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec104130 msgr2=0x7f75ec1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec104130 0x7f75ec1971e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f75e000bd70 tx=0x7f75e000be50 comp rx=0 tx=0).stop 2024-05-06T21:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 shutdown_connections 2024-05-06T21:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f75d406c680 0x7f75d406eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:13.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75ec0ffbd0 0x7f75ec196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:13.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 --2- 172.21.15.32:0/3784695121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec104130 0x7f75ec1971e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:13.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 >> 172.21.15.32:0/3784695121 conn(0x7f75ec075130 msgr2=0x7f75ec0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:13.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 shutdown_connections 2024-05-06T21:23:13.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:13.007+0000 7f75f3231700 1 -- 172.21.15.32:0/3784695121 wait complete. 2024-05-06T21:23:13.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:12 smithi154 ceph-mon[32880]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:13.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:12 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:23:13.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:13 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3784695121' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-06T21:23:14.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:13 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3784695121' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-06T21:23:14.534 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705701 for osd.0 2024-05-06T21:23:14.534 DEBUG:teuthology.parallel:result is None 2024-05-06T21:23:14.765 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:14 smithi032 ceph-mon[27179]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:15.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:14 smithi154 ceph-mon[32880]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:16.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:15 smithi154 ceph-mon[32880]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:16.157 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:15 smithi032 ceph-mon[27179]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:17.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.133+0000 7f7075676700 1 -- 172.21.15.32:0/894561952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 msgr2=0x7f7070104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:17.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.133+0000 7f7075676700 1 --2- 172.21.15.32:0/894561952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 0x7f7070104500 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f706000b0a0 tx=0x7f706000b3b0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.133+0000 7f7075676700 1 -- 172.21.15.32:0/894561952 shutdown_connections 2024-05-06T21:23:17.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.133+0000 7f7075676700 1 --2- 172.21.15.32:0/894561952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70700ffbd0 0x7f7070100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.133+0000 7f7075676700 1 --2- 172.21.15.32:0/894561952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 0x7f7070104500 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.133+0000 7f7075676700 1 -- 172.21.15.32:0/894561952 >> 172.21.15.32:0/894561952 conn(0x7f7070075130 msgr2=0x7f7070075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:17.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.133+0000 7f7075676700 1 -- 172.21.15.32:0/894561952 shutdown_connections 2024-05-06T21:23:17.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.133+0000 7f7075676700 1 -- 172.21.15.32:0/894561952 wait complete. 2024-05-06T21:23:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f7075676700 1 Processor -- start 2024-05-06T21:23:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f7075676700 1 -- start start 2024-05-06T21:23:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f7075676700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70700ffbd0 0x7f7070100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f7075676700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 0x7f7070101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f7075676700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70701018b0 con 0x7f7070104130 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f7075676700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70701019f0 con 0x7f70700ffbd0 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f706e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 0x7f7070101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f706e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 0x7f7070101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35600/0 (socket says 172.21.15.32:35600) 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f706e7fc700 1 -- 172.21.15.32:0/925019822 learned_addr learned my addr 172.21.15.32:0/925019822 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.134+0000 7f706effd700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70700ffbd0 0x7f7070100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.135+0000 7f706e7fc700 1 -- 172.21.15.32:0/925019822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70700ffbd0 msgr2=0x7f7070100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.135+0000 7f706e7fc700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70700ffbd0 0x7f7070100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.135+0000 7f706e7fc700 1 -- 172.21.15.32:0/925019822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060009d00 con 0x7f7070104130 2024-05-06T21:23:17.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.135+0000 7f706e7fc700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 0x7f7070101370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f705800b4b0 tx=0x7f705800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:17.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.135+0000 7f7067fff700 1 -- 172.21.15.32:0/925019822 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7058011800 con 0x7f7070104130 2024-05-06T21:23:17.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.135+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70701a2160 con 0x7f7070104130 2024-05-06T21:23:17.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.135+0000 7f7067fff700 1 -- 172.21.15.32:0/925019822 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7058011e10 con 0x7f7070104130 2024-05-06T21:23:17.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.135+0000 7f7067fff700 1 -- 172.21.15.32:0/925019822 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705800f2e0 con 0x7f7070104130 2024-05-06T21:23:17.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.135+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70701a2570 con 0x7f7070104130 2024-05-06T21:23:17.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.136+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70701086a0 con 0x7f7070104130 2024-05-06T21:23:17.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.136+0000 7f7067fff700 1 -- 172.21.15.32:0/925019822 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7058010380 con 0x7f7070104130 2024-05-06T21:23:17.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.137+0000 7f7067fff700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f705c06c680 0x7f705c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:17.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.137+0000 7f7067fff700 1 -- 172.21.15.32:0/925019822 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f705808b1b0 con 0x7f7070104130 2024-05-06T21:23:17.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.137+0000 7f706effd700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f705c06c680 0x7f705c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:17.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.137+0000 7f706effd700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f705c06c680 0x7f705c06eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7060009480 tx=0x7f706000b7b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:17.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.142+0000 7f7067fff700 1 -- 172.21.15.32:0/925019822 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7058055bd0 con 0x7f7070104130 2024-05-06T21:23:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.341+0000 7f7a12d18700 1 -- 172.21.15.32:0/1295683081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 msgr2=0x7f7a0c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.341+0000 7f7a12d18700 1 --2- 172.21.15.32:0/1295683081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 0x7f7a0c103d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009910 tx=0x7f79f8009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.341+0000 7f7a12d18700 1 -- 172.21.15.32:0/1295683081 shutdown_connections 2024-05-06T21:23:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.341+0000 7f7a12d18700 1 --2- 172.21.15.32:0/1295683081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 0x7f7a0c103d30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.341+0000 7f7a12d18700 1 --2- 172.21.15.32:0/1295683081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a0c0ff3c0 0x7f7a0c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.341+0000 7f7a12d18700 1 -- 172.21.15.32:0/1295683081 >> 172.21.15.32:0/1295683081 conn(0x7f7a0c0fac60 msgr2=0x7f7a0c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.341+0000 7f7a12d18700 1 -- 172.21.15.32:0/1295683081 shutdown_connections 2024-05-06T21:23:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.341+0000 7f7a12d18700 1 -- 172.21.15.32:0/1295683081 wait complete. 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a12d18700 1 Processor -- start 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a12d18700 1 -- start start 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a12d18700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a0c0ff3c0 0x7f7a0c196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a12d18700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 0x7f7a0c197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a12d18700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c1977a0 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a12d18700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c1978e0 con 0x7f7a0c0ff3c0 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a0bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 0x7f7a0c197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a0bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 0x7f7a0c197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35616/0 (socket says 172.21.15.32:35616) 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a0bfff700 1 -- 172.21.15.32:0/1175915883 learned_addr learned my addr 172.21.15.32:0/1175915883 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.342+0000 7f7a10ab4700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a0c0ff3c0 0x7f7a0c196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.343+0000 7f7a0bfff700 1 -- 172.21.15.32:0/1175915883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a0c0ff3c0 msgr2=0x7f7a0c196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.343+0000 7f7a0bfff700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a0c0ff3c0 0x7f7a0c196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.343+0000 7f7a0bfff700 1 -- 172.21.15.32:0/1175915883 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f80095f0 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.343+0000 7f7a0bfff700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 0x7f7a0c197260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79f800bda0 tx=0x7f79f800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.343+0000 7f7a09ffb700 1 -- 172.21.15.32:0/1175915883 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f801d070 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.343+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0c197b30 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.343+0000 7f7a09ffb700 1 -- 172.21.15.32:0/1175915883 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79f8022470 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.343+0000 7f7a09ffb700 1 -- 172.21.15.32:0/1175915883 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f800f690 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.343+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0c1a00a0 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.344+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0c107730 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.345+0000 7f7a09ffb700 1 -- 172.21.15.32:0/1175915883 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f79f8004c50 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.345+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f707002cc30 con 0x7f7070104130 2024-05-06T21:23:17.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.345+0000 7f7a09ffb700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f79fc06c680 0x7f79fc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:17.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.345+0000 7f7a09ffb700 1 -- 172.21.15.32:0/1175915883 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f79f808c9a0 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.345+0000 7f7a10ab4700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f79fc06c680 0x7f79fc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:17.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.346+0000 7f7a10ab4700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f79fc06c680 0x7f79fc06eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a00005ea0 tx=0x7f7a00005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:17.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.350+0000 7f7067fff700 1 -- 172.21.15.32:0/925019822 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70580591f0 con 0x7f7070104130 2024-05-06T21:23:17.353 INFO:teuthology.orchestra.run.smithi032.stdout:60129542176 2024-05-06T21:23:17.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.350+0000 7f7a09ffb700 1 -- 172.21.15.32:0/1175915883 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f79f80574f0 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.352+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f705c06c680 msgr2=0x7f705c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.352+0000 7f7075676700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f705c06c680 0x7f705c06eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7060009480 tx=0x7f706000b7b0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.352+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 msgr2=0x7f7070101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.352+0000 7f7075676700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 0x7f7070101370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f705800b4b0 tx=0x7f705800b870 comp rx=0 tx=0).stop 2024-05-06T21:23:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.352+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 shutdown_connections 2024-05-06T21:23:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.352+0000 7f7075676700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f705c06c680 0x7f705c06eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.352+0000 7f7075676700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70700ffbd0 0x7f7070100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.352+0000 7f7075676700 1 --2- 172.21.15.32:0/925019822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070104130 0x7f7070101370 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.352+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 >> 172.21.15.32:0/925019822 conn(0x7f7070075130 msgr2=0x7f70700fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:17.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.353+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 shutdown_connections 2024-05-06T21:23:17.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.353+0000 7f7075676700 1 -- 172.21.15.32:0/925019822 wait complete. 2024-05-06T21:23:17.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.561+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7a0c04f2a0 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.562+0000 7f7a09ffb700 1 -- 172.21.15.32:0/1175915883 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79f8027090 con 0x7f7a0c0ffd60 2024-05-06T21:23:17.565 INFO:teuthology.orchestra.run.smithi032.stdout:150323855377 2024-05-06T21:23:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.563+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f79fc06c680 msgr2=0x7f79fc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.563+0000 7f7a12d18700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f79fc06c680 0x7f79fc06eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a00005ea0 tx=0x7f7a00005e30 comp rx=0 tx=0).stop 2024-05-06T21:23:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.563+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 msgr2=0x7f7a0c197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.564+0000 7f7a12d18700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 0x7f7a0c197260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79f800bda0 tx=0x7f79f800be80 comp rx=0 tx=0).stop 2024-05-06T21:23:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.564+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 shutdown_connections 2024-05-06T21:23:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.564+0000 7f7a12d18700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f79fc06c680 0x7f79fc06eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.564+0000 7f7a12d18700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a0c0ff3c0 0x7f7a0c196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.564+0000 7f7a12d18700 1 --2- 172.21.15.32:0/1175915883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a0c0ffd60 0x7f7a0c197260 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.564+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 >> 172.21.15.32:0/1175915883 conn(0x7f7a0c0fac60 msgr2=0x7f7a0c0fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.564+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 shutdown_connections 2024-05-06T21:23:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:17.564+0000 7f7a12d18700 1 -- 172.21.15.32:0/1175915883 wait complete. 2024-05-06T21:23:17.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:17 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/925019822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-06T21:23:17.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:17 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/925019822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-06T21:23:18.489 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:18 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1175915883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-06T21:23:18.489 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:18 smithi032 ceph-mon[27179]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:18.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.592+0000 7fc9e2271700 1 -- 172.21.15.32:0/1796834140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 msgr2=0x7fc9dc10a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:18.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.592+0000 7fc9e2271700 1 --2- 172.21.15.32:0/1796834140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 0x7fc9dc10a220 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009910 tx=0x7fc9c4009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:18.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.592+0000 7fc9e2271700 1 -- 172.21.15.32:0/1796834140 shutdown_connections 2024-05-06T21:23:18.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.592+0000 7fc9e2271700 1 --2- 172.21.15.32:0/1796834140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 0x7fc9dc10a220 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:18.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.592+0000 7fc9e2271700 1 --2- 172.21.15.32:0/1796834140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9dc101410 0x7fc9dc1017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:18.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.592+0000 7fc9e2271700 1 -- 172.21.15.32:0/1796834140 >> 172.21.15.32:0/1796834140 conn(0x7fc9dc0fac90 msgr2=0x7fc9dc0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.592+0000 7fc9e2271700 1 -- 172.21.15.32:0/1796834140 shutdown_connections 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.592+0000 7fc9e2271700 1 -- 172.21.15.32:0/1796834140 wait complete. 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9e2271700 1 Processor -- start 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9e2271700 1 -- start start 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9e2271700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9dc101410 0x7fc9dc195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9e2271700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 0x7fc9dc196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9e2271700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc196a60 con 0x7fc9dc101d20 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9e2271700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc19a7f0 con 0x7fc9dc101410 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9d3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 0x7fc9dc196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9d3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 0x7fc9dc196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35628/0 (socket says 172.21.15.32:35628) 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9d3fff700 1 -- 172.21.15.32:0/3666314940 learned_addr learned my addr 172.21.15.32:0/3666314940 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9dbfff700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9dc101410 0x7fc9dc195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:18.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9d3fff700 1 -- 172.21.15.32:0/3666314940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9dc101410 msgr2=0x7fc9dc195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:18.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9d3fff700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9dc101410 0x7fc9dc195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:18.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9d3fff700 1 -- 172.21.15.32:0/3666314940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40095f0 con 0x7fc9dc101d20 2024-05-06T21:23:18.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9dbfff700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9dc101410 0x7fc9dc195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:23:18.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.593+0000 7fc9d3fff700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 0x7fc9dc196380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40092e0 tx=0x7fc9c400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:18.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.594+0000 7fc9d9ffb700 1 -- 172.21.15.32:0/3666314940 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c401d070 con 0x7fc9dc101d20 2024-05-06T21:23:18.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.594+0000 7fc9d9ffb700 1 -- 172.21.15.32:0/3666314940 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc9c4004fa0 con 0x7fc9dc101d20 2024-05-06T21:23:18.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.594+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc19aa70 con 0x7fc9dc101d20 2024-05-06T21:23:18.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.594+0000 7fc9d9ffb700 1 -- 172.21.15.32:0/3666314940 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c400f460 con 0x7fc9dc101d20 2024-05-06T21:23:18.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.594+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc19af60 con 0x7fc9dc101d20 2024-05-06T21:23:18.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.595+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc107890 con 0x7fc9dc101d20 2024-05-06T21:23:18.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.595+0000 7fc9d9ffb700 1 -- 172.21.15.32:0/3666314940 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc9c4022810 con 0x7fc9dc101d20 2024-05-06T21:23:18.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.596+0000 7fc9d9ffb700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc9c806c680 0x7fc9c806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:18.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.596+0000 7fc9d9ffb700 1 -- 172.21.15.32:0/3666314940 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc9c408c9e0 con 0x7fc9dc101d20 2024-05-06T21:23:18.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.596+0000 7fc9dbfff700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc9c806c680 0x7fc9c806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:18.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.596+0000 7fc9dbfff700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc9c806c680 0x7fc9c806eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc005fd0 tx=0x7fc9cc005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:18.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.600+0000 7fc9d9ffb700 1 -- 172.21.15.32:0/3666314940 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc9c4057490 con 0x7fc9dc101d20 2024-05-06T21:23:18.620 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:18 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1175915883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-06T21:23:18.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:18 smithi154 ceph-mon[32880]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:18.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.801+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc9dc04f2a0 con 0x7fc9dc101d20 2024-05-06T21:23:18.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.801+0000 7fc9d9ffb700 1 -- 172.21.15.32:0/3666314940 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9c4027020 con 0x7fc9dc101d20 2024-05-06T21:23:18.805 INFO:teuthology.orchestra.run.smithi032.stdout:115964117014 2024-05-06T21:23:18.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc9c806c680 msgr2=0x7fc9c806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:18.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc9c806c680 0x7fc9c806eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc005fd0 tx=0x7fc9cc005ee0 comp rx=0 tx=0).stop 2024-05-06T21:23:18.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 msgr2=0x7fc9dc196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:18.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 0x7fc9dc196380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40092e0 tx=0x7fc9c400be20 comp rx=0 tx=0).stop 2024-05-06T21:23:18.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 shutdown_connections 2024-05-06T21:23:18.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc9c806c680 0x7fc9c806eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:18.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9dc101410 0x7fc9dc195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:18.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 --2- 172.21.15.32:0/3666314940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9dc101d20 0x7fc9dc196380 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:18.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 >> 172.21.15.32:0/3666314940 conn(0x7fc9dc0fac90 msgr2=0x7fc9dc1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:18.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 shutdown_connections 2024-05-06T21:23:18.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:18.804+0000 7fc9e2271700 1 -- 172.21.15.32:0/3666314940 wait complete. 2024-05-06T21:23:19.350 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855375 got 150323855377 for osd.4 2024-05-06T21:23:19.351 DEBUG:teuthology.parallel:result is None 2024-05-06T21:23:19.672 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:19 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3666314940' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-06T21:23:19.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:19 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3666314940' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-06T21:23:20.100 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117014 for osd.3 2024-05-06T21:23:20.100 DEBUG:teuthology.parallel:result is None 2024-05-06T21:23:20.612 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-05-06T21:23:20.612 DEBUG:teuthology.parallel:result is None 2024-05-06T21:23:20.612 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-06T21:23:20.612 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-06T21:23:20.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:20 smithi032 ceph-mon[27179]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:20.834 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:20.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:20 smithi154 ceph-mon[32880]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.474+0000 7f27d67ea700 1 -- 172.21.15.32:0/3274107132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ffd60 msgr2=0x7f27d0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.474+0000 7f27d67ea700 1 --2- 172.21.15.32:0/3274107132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ffd60 0x7f27d0103d30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009910 tx=0x7f27b8009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.474+0000 7f27d67ea700 1 -- 172.21.15.32:0/3274107132 shutdown_connections 2024-05-06T21:23:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.474+0000 7f27d67ea700 1 --2- 172.21.15.32:0/3274107132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ffd60 0x7f27d0103d30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.474+0000 7f27d67ea700 1 --2- 172.21.15.32:0/3274107132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d00ff3c0 0x7f27d00ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.474+0000 7f27d67ea700 1 -- 172.21.15.32:0/3274107132 >> 172.21.15.32:0/3274107132 conn(0x7f27d00fac80 msgr2=0x7f27d00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.474+0000 7f27d67ea700 1 -- 172.21.15.32:0/3274107132 shutdown_connections 2024-05-06T21:23:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.474+0000 7f27d67ea700 1 -- 172.21.15.32:0/3274107132 wait complete. 2024-05-06T21:23:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.475+0000 7f27d67ea700 1 Processor -- start 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.475+0000 7f27d67ea700 1 -- start start 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.475+0000 7f27d67ea700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ff3c0 0x7f27d0194da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.475+0000 7f27d67ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d00ffd60 0x7f27d01952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.475+0000 7f27d67ea700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d01959c0 con 0x7f27d00ff3c0 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.475+0000 7f27d67ea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0199750 con 0x7f27d00ffd60 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.475+0000 7f27cffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ff3c0 0x7f27d0194da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.475+0000 7f27cffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ff3c0 0x7f27d0194da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59184/0 (socket says 172.21.15.32:59184) 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.475+0000 7f27cffff700 1 -- 172.21.15.32:0/710975170 learned_addr learned my addr 172.21.15.32:0/710975170 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27c7fff700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d00ffd60 0x7f27d01952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27cffff700 1 -- 172.21.15.32:0/710975170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d00ffd60 msgr2=0x7f27d01952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27cffff700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d00ffd60 0x7f27d01952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27cffff700 1 -- 172.21.15.32:0/710975170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b80095f0 con 0x7f27d00ff3c0 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27cffff700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ff3c0 0x7f27d0194da0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27c000d900 tx=0x7f27c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27cdffb700 1 -- 172.21.15.32:0/710975170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27c0004a00 con 0x7f27d00ff3c0 2024-05-06T21:23:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27cdffb700 1 -- 172.21.15.32:0/710975170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27c00054d0 con 0x7f27d00ff3c0 2024-05-06T21:23:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27cdffb700 1 -- 172.21.15.32:0/710975170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27c0009d60 con 0x7f27d00ff3c0 2024-05-06T21:23:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d0199a30 con 0x7f27d00ff3c0 2024-05-06T21:23:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.476+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d0199f30 con 0x7f27d00ff3c0 2024-05-06T21:23:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.477+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d0107640 con 0x7f27d00ff3c0 2024-05-06T21:23:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.478+0000 7f27cdffb700 1 -- 172.21.15.32:0/710975170 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f27c0005020 con 0x7f27d00ff3c0 2024-05-06T21:23:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.478+0000 7f27cdffb700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f27bc06c680 0x7f27bc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.478+0000 7f27cdffb700 1 -- 172.21.15.32:0/710975170 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f27c008b710 con 0x7f27d00ff3c0 2024-05-06T21:23:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.478+0000 7f27c7fff700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f27bc06c680 0x7f27bc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.479+0000 7f27c7fff700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f27bc06c680 0x7f27bc06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f27d01963c0 tx=0x7f27b801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:22.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.483+0000 7f27cdffb700 1 -- 172.21.15.32:0/710975170 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f27c0056130 con 0x7f27d00ff3c0 2024-05-06T21:23:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.679+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27d019a210 con 0x7f27bc06c680 2024-05-06T21:23:22.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.681+0000 7f27cdffb700 1 -- 172.21.15.32:0/710975170 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28222 (secure 0 0 0) 0x7f27d019a210 con 0x7f27bc06c680 2024-05-06T21:23:22.683 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:23:22.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f27bc06c680 msgr2=0x7f27bc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:22.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f27bc06c680 0x7f27bc06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f27d01963c0 tx=0x7f27b801a040 comp rx=0 tx=0).stop 2024-05-06T21:23:22.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ff3c0 msgr2=0x7f27d0194da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:22.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ff3c0 0x7f27d0194da0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27c000d900 tx=0x7f27c000dcc0 comp rx=0 tx=0).stop 2024-05-06T21:23:22.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 shutdown_connections 2024-05-06T21:23:22.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f27bc06c680 0x7f27bc06eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:22.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27d00ff3c0 0x7f27d0194da0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:22.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 --2- 172.21.15.32:0/710975170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d00ffd60 0x7f27d01952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:22.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 >> 172.21.15.32:0/710975170 conn(0x7f27d00fac80 msgr2=0x7f27d01035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:22.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 shutdown_connections 2024-05-06T21:23:22.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:22.683+0000 7f27d67ea700 1 -- 172.21.15.32:0/710975170 wait complete. 2024-05-06T21:23:22.686 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-06T21:23:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:22 smithi032 ceph-mon[27179]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:23.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:22 smithi154 ceph-mon[32880]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:23.372 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-05-06T21:23:21.628600+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165636,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305276,"statfs":{"total":575970213888,"available":575800602624,"internally_reserved":0,"allocated":4018176,"data_stored":2627442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002369"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":187,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-06T21:22:30.283608+0000","last_change":"2024-05-06T21:22:03.679305+0000","last_active":"2024-05-06T21:22:30.283608+0000","last_peered":"2024-05-06T21:22:30.283608+0000","last_clean":"2024-05-06T21:22:30.283608+0000","last_became_active":"2024-05-06T21:22:03.678913+0000","last_became_peered":"2024-05-06T21:22:03.678913+0000","last_unstale":"2024-05-06T21:22:30.283608+0000","last_undegraded":"2024-05-06T21:22:30.283608+0000","last_fullsized":"2024-05-06T21:22:30.283608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T21:21:16.377344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T21:21:16.377344+0000","last_clean_scrub_stamp":"2024-05-06T21:21:16.377344+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T06:55:27.450001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":15.750999999999999,"5min":15.750999999999999,"15min":15.750999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":15.712,"5min":15.712,"15min":15.712},"last":0.71899999999999997}]},{"osd":1,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59399999999999997}]},{"osd":2,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.65000000000000002}]},{"osd":3,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 21:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon May 6 21:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon May 6 21:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 21:23:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.379,"15min":0.38},"min":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.50800000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.36499999999999999}]},{"osd":1,"last update":"Mon May 6 21:23:19 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.314,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38800000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54600000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon May 6 21:22:40 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.497},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.436}]},{"osd":4,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 6 21:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34200000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.308}]},{"osd":2,"last update":"Mon May 6 21:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.59199999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32300000000000001}]},{"osd":3,"last update":"Mon May 6 21:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":16.597000000000001,"5min":16.597000000000001,"15min":16.597000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.497},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":16.635000000000002,"5min":16.635000000000002,"15min":16.635000000000002},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 21:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.499,"15min":0.499},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.26300000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47599999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon May 6 21:22:19 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon May 6 21:22:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.85199999999999998}]},{"osd":4,"last update":"Mon May 6 21:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T21:23:23.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-06T21:23:23.591 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:23.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:23 smithi032 ceph-mon[27179]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T21:23:24.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:23 smithi154 ceph-mon[32880]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T21:23:24.946 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:24 smithi032 ceph-mon[27179]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:25.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:24 smithi154 ceph-mon[32880]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:25.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.278+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/2794827733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 msgr2=0x7fd2b8104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:25.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.278+0000 7fd2bdc4b700 1 --2- 172.21.15.32:0/2794827733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 0x7fd2b8104500 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009910 tx=0x7fd2a8009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.279+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/2794827733 shutdown_connections 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.279+0000 7fd2bdc4b700 1 --2- 172.21.15.32:0/2794827733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2b80ffbd0 0x7fd2b8100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.279+0000 7fd2bdc4b700 1 --2- 172.21.15.32:0/2794827733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 0x7fd2b8104500 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.279+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/2794827733 >> 172.21.15.32:0/2794827733 conn(0x7fd2b8075130 msgr2=0x7fd2b8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.279+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/2794827733 shutdown_connections 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.279+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/2794827733 wait complete. 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.279+0000 7fd2bdc4b700 1 Processor -- start 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.279+0000 7fd2bdc4b700 1 -- start start 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2bdc4b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2b80ffbd0 0x7fd2b8195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2bdc4b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 0x7fd2b8196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2bdc4b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8196a70 con 0x7fd2b8104130 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2bdc4b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b819a800 con 0x7fd2b80ffbd0 2024-05-06T21:23:25.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2aeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 0x7fd2b8196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2aeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 0x7fd2b8196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59192/0 (socket says 172.21.15.32:59192) 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2aeffd700 1 -- 172.21.15.32:0/872443870 learned_addr learned my addr 172.21.15.32:0/872443870 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2b77fe700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2b80ffbd0 0x7fd2b8195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2aeffd700 1 -- 172.21.15.32:0/872443870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2b80ffbd0 msgr2=0x7fd2b8195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2aeffd700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2b80ffbd0 0x7fd2b8195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.280+0000 7fd2aeffd700 1 -- 172.21.15.32:0/872443870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80095f0 con 0x7fd2b8104130 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.281+0000 7fd2aeffd700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 0x7fd2b8196390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000d8d0 tx=0x7fd2a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.281+0000 7fd2b57fa700 1 -- 172.21.15.32:0/872443870 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a0009940 con 0x7fd2b8104130 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.281+0000 7fd2b57fa700 1 -- 172.21.15.32:0/872443870 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2a0010460 con 0x7fd2b8104130 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.281+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b819aae0 con 0x7fd2b8104130 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.281+0000 7fd2b57fa700 1 -- 172.21.15.32:0/872443870 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a000f5f0 con 0x7fd2b8104130 2024-05-06T21:23:25.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.281+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b819b030 con 0x7fd2b8104130 2024-05-06T21:23:25.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.282+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b81086a0 con 0x7fd2b8104130 2024-05-06T21:23:25.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.282+0000 7fd2b57fa700 1 -- 172.21.15.32:0/872443870 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd2a00105d0 con 0x7fd2b8104130 2024-05-06T21:23:25.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.283+0000 7fd2b57fa700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd2a406c680 0x7fd2a406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:25.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.283+0000 7fd2b57fa700 1 -- 172.21.15.32:0/872443870 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd2a008b470 con 0x7fd2b8104130 2024-05-06T21:23:25.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.283+0000 7fd2b77fe700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd2a406c680 0x7fd2a406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:25.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.283+0000 7fd2b77fe700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd2a406c680 0x7fd2a406eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800b5c0 tx=0x7fd2a801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:25.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.287+0000 7fd2b57fa700 1 -- 172.21.15.32:0/872443870 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd2a0055f10 con 0x7fd2b8104130 2024-05-06T21:23:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.484+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2b819b310 con 0x7fd2a406c680 2024-05-06T21:23:25.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.486+0000 7fd2b57fa700 1 -- 172.21.15.32:0/872443870 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28222 (secure 0 0 0) 0x7fd2b819b310 con 0x7fd2a406c680 2024-05-06T21:23:25.489 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:23:25.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd2a406c680 msgr2=0x7fd2a406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd2a406c680 0x7fd2a406eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800b5c0 tx=0x7fd2a801a040 comp rx=0 tx=0).stop 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 msgr2=0x7fd2b8196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 0x7fd2b8196390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000d8d0 tx=0x7fd2a000dc90 comp rx=0 tx=0).stop 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 shutdown_connections 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd2a406c680 0x7fd2a406eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2b80ffbd0 0x7fd2b8195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 --2- 172.21.15.32:0/872443870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8104130 0x7fd2b8196390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 >> 172.21.15.32:0/872443870 conn(0x7fd2b8075130 msgr2=0x7fd2b80fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 shutdown_connections 2024-05-06T21:23:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:25.488+0000 7fd2bdc4b700 1 -- 172.21.15.32:0/872443870 wait complete. 2024-05-06T21:23:25.492 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-06T21:23:26.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:25 smithi154 ceph-mon[32880]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T21:23:26.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:25 smithi154 ceph-mon[32880]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:26.144 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:25 smithi032 ceph-mon[27179]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T21:23:26.144 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:25 smithi032 ceph-mon[27179]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:26.171 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-05-06T21:23:23.628909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165636,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305276,"statfs":{"total":575970213888,"available":575800602624,"internally_reserved":0,"allocated":4018176,"data_stored":2627442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002326"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":187,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-06T21:22:30.283608+0000","last_change":"2024-05-06T21:22:03.679305+0000","last_active":"2024-05-06T21:22:30.283608+0000","last_peered":"2024-05-06T21:22:30.283608+0000","last_clean":"2024-05-06T21:22:30.283608+0000","last_became_active":"2024-05-06T21:22:03.678913+0000","last_became_peered":"2024-05-06T21:22:03.678913+0000","last_unstale":"2024-05-06T21:22:30.283608+0000","last_undegraded":"2024-05-06T21:22:30.283608+0000","last_fullsized":"2024-05-06T21:22:30.283608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T21:21:16.377344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T21:21:16.377344+0000","last_clean_scrub_stamp":"2024-05-06T21:21:16.377344+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T06:55:27.450001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":15.750999999999999,"5min":15.750999999999999,"15min":15.750999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":15.712,"5min":15.712,"15min":15.712},"last":0.71899999999999997}]},{"osd":1,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59399999999999997}]},{"osd":2,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.65000000000000002}]},{"osd":3,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 21:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon May 6 21:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon May 6 21:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717836,"statfs":{"total":95995035648,"available":95967064064,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 21:23:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.379,"15min":0.38},"min":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.50800000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.36499999999999999}]},{"osd":1,"last update":"Mon May 6 21:23:19 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.314,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38800000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54600000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon May 6 21:22:40 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.497},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.436}]},{"osd":4,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 6 21:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34200000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.308}]},{"osd":2,"last update":"Mon May 6 21:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.59199999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32300000000000001}]},{"osd":3,"last update":"Mon May 6 21:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":16.597000000000001,"5min":16.597000000000001,"15min":16.597000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon May 6 21:23:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.497},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":16.635000000000002,"5min":16.635000000000002,"15min":16.635000000000002},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 21:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.499,"15min":0.499},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.26300000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47599999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon May 6 21:22:19 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon May 6 21:22:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.85199999999999998}]},{"osd":4,"last update":"Mon May 6 21:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T21:23:26.171 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-06T21:23:26.172 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-06T21:23:26.172 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-06T21:23:26.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-06T21:23:26.392 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:27.919 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:27 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:23:28.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:27 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:23:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.176+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/3581732788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 msgr2=0x7f9d581017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.176+0000 7f9d5ff3f700 1 --2- 172.21.15.32:0/3581732788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 0x7f9d581017e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009910 tx=0x7f9d54009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.176+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/3581732788 shutdown_connections 2024-05-06T21:23:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.176+0000 7f9d5ff3f700 1 --2- 172.21.15.32:0/3581732788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58101d20 0x7f9d5810a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.176+0000 7f9d5ff3f700 1 --2- 172.21.15.32:0/3581732788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 0x7f9d581017e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.176+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/3581732788 >> 172.21.15.32:0/3581732788 conn(0x7f9d580fac90 msgr2=0x7f9d580fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.176+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/3581732788 shutdown_connections 2024-05-06T21:23:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.177+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/3581732788 wait complete. 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.177+0000 7f9d5ff3f700 1 Processor -- start 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.177+0000 7f9d5ff3f700 1 -- start start 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.177+0000 7f9d5ff3f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 0x7f9d58195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.177+0000 7f9d5ff3f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58101d20 0x7f9d581963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.177+0000 7f9d5ff3f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58196aa0 con 0x7f9d58101410 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.177+0000 7f9d5ff3f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5819a830 con 0x7f9d58101d20 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5dcdb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 0x7f9d58195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5dcdb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 0x7f9d58195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59218/0 (socket says 172.21.15.32:59218) 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5dcdb700 1 -- 172.21.15.32:0/8627274 learned_addr learned my addr 172.21.15.32:0/8627274 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5d4da700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58101d20 0x7f9d581963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5dcdb700 1 -- 172.21.15.32:0/8627274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58101d20 msgr2=0x7f9d581963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5dcdb700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58101d20 0x7f9d581963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5dcdb700 1 -- 172.21.15.32:0/8627274 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540095f0 con 0x7f9d58101410 2024-05-06T21:23:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5dcdb700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 0x7f9d58195e80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9d540092e0 tx=0x7f9d5400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d4effd700 1 -- 172.21.15.32:0/8627274 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d5401d070 con 0x7f9d58101410 2024-05-06T21:23:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d4effd700 1 -- 172.21.15.32:0/8627274 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d54005e00 con 0x7f9d58101410 2024-05-06T21:23:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5819aab0 con 0x7f9d58101410 2024-05-06T21:23:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d4effd700 1 -- 172.21.15.32:0/8627274 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d54017400 con 0x7f9d58101410 2024-05-06T21:23:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.178+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5819afa0 con 0x7f9d58101410 2024-05-06T21:23:28.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.180+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d581078f0 con 0x7f9d58101410 2024-05-06T21:23:28.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.180+0000 7f9d4effd700 1 -- 172.21.15.32:0/8627274 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9d5400f460 con 0x7f9d58101410 2024-05-06T21:23:28.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.180+0000 7f9d4effd700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d4406c680 0x7f9d4406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:28.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.181+0000 7f9d4effd700 1 -- 172.21.15.32:0/8627274 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9d5408c990 con 0x7f9d58101410 2024-05-06T21:23:28.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.181+0000 7f9d5d4da700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d4406c680 0x7f9d4406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:28.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.181+0000 7f9d5d4da700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d4406c680 0x7f9d4406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d581974a0 tx=0x7f9d4800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:28.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.185+0000 7f9d4effd700 1 -- 172.21.15.32:0/8627274 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9d54057430 con 0x7f9d58101410 2024-05-06T21:23:28.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.428+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9d581972e0 con 0x7f9d58101410 2024-05-06T21:23:28.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.428+0000 7f9d4effd700 1 -- 172.21.15.32:0/8627274 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9d5405aa50 con 0x7f9d58101410 2024-05-06T21:23:28.467 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:23:28.467 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-06T21:23:28.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d4406c680 msgr2=0x7f9d4406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:28.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d4406c680 0x7f9d4406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d581974a0 tx=0x7f9d4800b410 comp rx=0 tx=0).stop 2024-05-06T21:23:28.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 msgr2=0x7f9d58195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 0x7f9d58195e80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9d540092e0 tx=0x7f9d5400bd70 comp rx=0 tx=0).stop 2024-05-06T21:23:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 shutdown_connections 2024-05-06T21:23:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d4406c680 0x7f9d4406eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d58101410 0x7f9d58195e80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 --2- 172.21.15.32:0/8627274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58101d20 0x7f9d581963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 >> 172.21.15.32:0/8627274 conn(0x7f9d580fac90 msgr2=0x7f9d58104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 shutdown_connections 2024-05-06T21:23:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:28.431+0000 7f9d5ff3f700 1 -- 172.21.15.32:0/8627274 wait complete. 2024-05-06T21:23:28.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:28 smithi032 ceph-mon[27179]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:28.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:28 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/8627274' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-06T21:23:29.099 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-06T21:23:29.099 INFO:tasks.cephadm:Setup complete, yielding 2024-05-06T21:23:29.100 INFO:teuthology.run_tasks:Running task print... 2024-05-06T21:23:29.109 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-05-06T21:23:29.109 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T21:23:29.134 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:23:29.134 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-05-06T21:23:29.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:28 smithi154 ceph-mon[32880]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:29.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:28 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/8627274' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-06T21:23:29.353 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:30.951 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:30 smithi032 ceph-mon[27179]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:30.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.983+0000 7f6259bd2700 1 -- 172.21.15.32:0/3797230172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 msgr2=0x7f6254105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:30.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.983+0000 7f6259bd2700 1 --2- 172.21.15.32:0/3797230172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 0x7f6254105790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6248009910 tx=0x7f6248009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:30.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.983+0000 7f6259bd2700 1 -- 172.21.15.32:0/3797230172 shutdown_connections 2024-05-06T21:23:30.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.983+0000 7f6259bd2700 1 --2- 172.21.15.32:0/3797230172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 0x7f6254105790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:30.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.983+0000 7f6259bd2700 1 --2- 172.21.15.32:0/3797230172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6254069230 0x7f6254102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:30.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.983+0000 7f6259bd2700 1 -- 172.21.15.32:0/3797230172 >> 172.21.15.32:0/3797230172 conn(0x7f62540fa780 msgr2=0x7f62540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:30.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.983+0000 7f6259bd2700 1 -- 172.21.15.32:0/3797230172 shutdown_connections 2024-05-06T21:23:30.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.983+0000 7f6259bd2700 1 -- 172.21.15.32:0/3797230172 wait complete. 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f6259bd2700 1 Processor -- start 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f6259bd2700 1 -- start start 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f6259bd2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6254069230 0x7f6254100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f6259bd2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 0x7f62540fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f6259bd2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62540ff2f0 con 0x7f6254103350 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f6259bd2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62540ff430 con 0x7f6254069230 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f6252ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 0x7f62540fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f6252ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 0x7f62540fedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59240/0 (socket says 172.21.15.32:59240) 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f6252ffd700 1 -- 172.21.15.32:0/346537979 learned_addr learned my addr 172.21.15.32:0/346537979 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.984+0000 7f62537fe700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6254069230 0x7f6254100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.985+0000 7f6252ffd700 1 -- 172.21.15.32:0/346537979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6254069230 msgr2=0x7f6254100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.985+0000 7f6252ffd700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6254069230 0x7f6254100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:30.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.985+0000 7f6252ffd700 1 -- 172.21.15.32:0/346537979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62480095f0 con 0x7f6254103350 2024-05-06T21:23:30.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.985+0000 7f6252ffd700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 0x7f62540fedb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6248006010 tx=0x7f624800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:30.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.985+0000 7f6250ff9700 1 -- 172.21.15.32:0/346537979 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f624801d070 con 0x7f6254103350 2024-05-06T21:23:30.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.985+0000 7f6250ff9700 1 -- 172.21.15.32:0/346537979 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f624800f460 con 0x7f6254103350 2024-05-06T21:23:30.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.985+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62540ff6b0 con 0x7f6254103350 2024-05-06T21:23:30.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.985+0000 7f6250ff9700 1 -- 172.21.15.32:0/346537979 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6248021640 con 0x7f6254103350 2024-05-06T21:23:30.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.985+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62540ffba0 con 0x7f6254103350 2024-05-06T21:23:30.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.986+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625418fbf0 con 0x7f6254103350 2024-05-06T21:23:30.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.987+0000 7f6250ff9700 1 -- 172.21.15.32:0/346537979 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6248003a60 con 0x7f6254103350 2024-05-06T21:23:30.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.987+0000 7f6250ff9700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f623c06c680 0x7f623c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:30.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.987+0000 7f6250ff9700 1 -- 172.21.15.32:0/346537979 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f624808c7d0 con 0x7f6254103350 2024-05-06T21:23:30.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.987+0000 7f62537fe700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f623c06c680 0x7f623c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:30.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.988+0000 7f62537fe700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f623c06c680 0x7f623c06eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6244009550 tx=0x7f62440091b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:30.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:30.992+0000 7f6250ff9700 1 -- 172.21.15.32:0/346537979 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f624805ac80 con 0x7f6254103350 2024-05-06T21:23:31.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:30 smithi154 ceph-mon[32880]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:31.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.191+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f625402cc30 con 0x7f6254103350 2024-05-06T21:23:31.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.196+0000 7f6250ff9700 1 -- 172.21.15.32:0/346537979 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f624805a810 con 0x7f6254103350 2024-05-06T21:23:31.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.198+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f623c06c680 msgr2=0x7f623c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:31.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.198+0000 7f6259bd2700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f623c06c680 0x7f623c06eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6244009550 tx=0x7f62440091b0 comp rx=0 tx=0).stop 2024-05-06T21:23:31.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.198+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 msgr2=0x7f62540fedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:31.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.198+0000 7f6259bd2700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 0x7f62540fedb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6248006010 tx=0x7f624800bd70 comp rx=0 tx=0).stop 2024-05-06T21:23:31.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.198+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 shutdown_connections 2024-05-06T21:23:31.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.198+0000 7f6259bd2700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f623c06c680 0x7f623c06eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:31.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.198+0000 7f6259bd2700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6254069230 0x7f6254100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:31.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.198+0000 7f6259bd2700 1 --2- 172.21.15.32:0/346537979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6254103350 0x7f62540fedb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:31.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.198+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 >> 172.21.15.32:0/346537979 conn(0x7f62540fa780 msgr2=0x7f62540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:31.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.199+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 shutdown_connections 2024-05-06T21:23:31.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:31.199+0000 7f6259bd2700 1 -- 172.21.15.32:0/346537979 wait complete. 2024-05-06T21:23:32.146 INFO:teuthology.run_tasks:Running task print... 2024-05-06T21:23:32.154 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-05-06T21:23:32.154 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T21:23:32.192 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:23:32.192 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-06T21:23:32.408 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:32.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:32 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/346537979' entity='client.admin' 2024-05-06T21:23:32.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:23:32.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:32 smithi032 ceph-mon[27179]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:32.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:32.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:23:32.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:32 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/346537979' entity='client.admin' 2024-05-06T21:23:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:23:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:32 smithi154 ceph-mon[32880]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:23:32.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:34.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.075+0000 7f989c9e0700 1 -- 172.21.15.32:0/2497039907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98980ff130 msgr2=0x7f98980ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.075+0000 7f989c9e0700 1 --2- 172.21.15.32:0/2497039907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98980ff130 0x7f98980ff540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9888009910 tx=0x7f9888009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.075+0000 7f989c9e0700 1 -- 172.21.15.32:0/2497039907 shutdown_connections 2024-05-06T21:23:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.075+0000 7f989c9e0700 1 --2- 172.21.15.32:0/2497039907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98981003d0 0x7f9898100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.075+0000 7f989c9e0700 1 --2- 172.21.15.32:0/2497039907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98980ff130 0x7f98980ff540 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.075+0000 7f989c9e0700 1 -- 172.21.15.32:0/2497039907 >> 172.21.15.32:0/2497039907 conn(0x7f98980fa780 msgr2=0x7f98980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.075+0000 7f989c9e0700 1 -- 172.21.15.32:0/2497039907 shutdown_connections 2024-05-06T21:23:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.075+0000 7f989c9e0700 1 -- 172.21.15.32:0/2497039907 wait complete. 2024-05-06T21:23:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.076+0000 7f989c9e0700 1 Processor -- start 2024-05-06T21:23:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.076+0000 7f989c9e0700 1 -- start start 2024-05-06T21:23:34.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.076+0000 7f989c9e0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98980ff130 0x7f98981949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:34.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.076+0000 7f989c9e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98981003d0 0x7f9898194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:34.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.076+0000 7f989c9e0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898195510 con 0x7f98981003d0 2024-05-06T21:23:34.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.076+0000 7f989c9e0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898195650 con 0x7f98980ff130 2024-05-06T21:23:34.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98981003d0 0x7f9898194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:34.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98981003d0 0x7f9898194ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39550/0 (socket says 172.21.15.32:39550) 2024-05-06T21:23:34.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988dd9b700 1 -- 172.21.15.32:0/2519757564 learned_addr learned my addr 172.21.15.32:0/2519757564 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f989659c700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98980ff130 0x7f98981949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988dd9b700 1 -- 172.21.15.32:0/2519757564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98980ff130 msgr2=0x7f98981949b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988dd9b700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98980ff130 0x7f98981949b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988dd9b700 1 -- 172.21.15.32:0/2519757564 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98880095f0 con 0x7f98981003d0 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988dd9b700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98981003d0 0x7f9898194ef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f988000c8a0 tx=0x7f988000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988ffff700 1 -- 172.21.15.32:0/2519757564 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98800078e0 con 0x7f98981003d0 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989819a100 con 0x7f98981003d0 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988ffff700 1 -- 172.21.15.32:0/2519757564 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f988000f450 con 0x7f98981003d0 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f988ffff700 1 -- 172.21.15.32:0/2519757564 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988000e5e0 con 0x7f98981003d0 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.077+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9898068540 con 0x7f98981003d0 2024-05-06T21:23:34.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.078+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9898107c10 con 0x7f98981003d0 2024-05-06T21:23:34.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.079+0000 7f988ffff700 1 -- 172.21.15.32:0/2519757564 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f988000f5c0 con 0x7f98981003d0 2024-05-06T21:23:34.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.080+0000 7f988ffff700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f988406e890 0x7f9884070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:34.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.080+0000 7f988ffff700 1 -- 172.21.15.32:0/2519757564 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f988008b4b0 con 0x7f98981003d0 2024-05-06T21:23:34.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.080+0000 7f989659c700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f988406e890 0x7f9884070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:34.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.080+0000 7f989659c700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f988406e890 0x7f9884070d40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9888006010 tx=0x7f988800b560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:34.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.083+0000 7f988ffff700 1 -- 172.21.15.32:0/2519757564 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9880059a80 con 0x7f98981003d0 2024-05-06T21:23:34.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.298+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9898069150 con 0x7f988406e890 2024-05-06T21:23:34.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.299+0000 7f988ffff700 1 -- 172.21.15.32:0/2519757564 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9898069150 con 0x7f988406e890 2024-05-06T21:23:34.302 INFO:teuthology.orchestra.run.smithi032.stdout:Backend: cephadm 2024-05-06T21:23:34.302 INFO:teuthology.orchestra.run.smithi032.stdout:Available: Yes 2024-05-06T21:23:34.303 INFO:teuthology.orchestra.run.smithi032.stdout:Paused: No 2024-05-06T21:23:34.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f988406e890 msgr2=0x7f9884070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f988406e890 0x7f9884070d40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9888006010 tx=0x7f988800b560 comp rx=0 tx=0).stop 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98981003d0 msgr2=0x7f9898194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98981003d0 0x7f9898194ef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f988000c8a0 tx=0x7f988000cbb0 comp rx=0 tx=0).stop 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 shutdown_connections 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f988406e890 0x7f9884070d40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98980ff130 0x7f98981949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 --2- 172.21.15.32:0/2519757564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98981003d0 0x7f9898194ef0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 >> 172.21.15.32:0/2519757564 conn(0x7f98980fa780 msgr2=0x7f9898103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 shutdown_connections 2024-05-06T21:23:34.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:34.301+0000 7f989c9e0700 1 -- 172.21.15.32:0/2519757564 wait complete. 2024-05-06T21:23:34.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:34 smithi032 ceph-mon[27179]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:35.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-06T21:23:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:34 smithi154 ceph-mon[32880]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:35.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:35 smithi032 ceph-mon[27179]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:36.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:35 smithi154 ceph-mon[32880]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:36.800 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:36 smithi032 ceph-mon[27179]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:37.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.058+0000 7f0918e3e700 1 -- 172.21.15.32:0/679846301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914100250 msgr2=0x7f0914100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:37.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.058+0000 7f0918e3e700 1 --2- 172.21.15.32:0/679846301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914100250 0x7f0914100660 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009910 tx=0x7f08fc009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:37.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.058+0000 7f0918e3e700 1 -- 172.21.15.32:0/679846301 shutdown_connections 2024-05-06T21:23:37.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.058+0000 7f0918e3e700 1 --2- 172.21.15.32:0/679846301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0914101450 0x7f09141018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:37.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.058+0000 7f0918e3e700 1 --2- 172.21.15.32:0/679846301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914100250 0x7f0914100660 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:37.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.058+0000 7f0918e3e700 1 -- 172.21.15.32:0/679846301 >> 172.21.15.32:0/679846301 conn(0x7f09140fb7e0 msgr2=0x7f09140fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:37.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.058+0000 7f0918e3e700 1 -- 172.21.15.32:0/679846301 shutdown_connections 2024-05-06T21:23:37.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.058+0000 7f0918e3e700 1 -- 172.21.15.32:0/679846301 wait complete. 2024-05-06T21:23:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.059+0000 7f0918e3e700 1 Processor -- start 2024-05-06T21:23:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.059+0000 7f0918e3e700 1 -- start start 2024-05-06T21:23:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.059+0000 7f0918e3e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0914100250 0x7f0914074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0918e3e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914101450 0x7f0914073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0918e3e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914073680 con 0x7f0914101450 2024-05-06T21:23:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0918e3e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140737c0 con 0x7f0914100250 2024-05-06T21:23:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0911d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914101450 0x7f0914073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0911d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914101450 0x7f0914073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39572/0 (socket says 172.21.15.32:39572) 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0911d9b700 1 -- 172.21.15.32:0/108126551 learned_addr learned my addr 172.21.15.32:0/108126551 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f091259c700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0914100250 0x7f0914074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0911d9b700 1 -- 172.21.15.32:0/108126551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0914100250 msgr2=0x7f0914074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0911d9b700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0914100250 0x7f0914074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0911d9b700 1 -- 172.21.15.32:0/108126551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0095f0 con 0x7f0914101450 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0911d9b700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914101450 0x7f0914073140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f090400d8d0 tx=0x7f090400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f090b7fe700 1 -- 172.21.15.32:0/108126551 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0904009940 con 0x7f0914101450 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0914073aa0 con 0x7f0914101450 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091419db40 con 0x7f0914101450 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.060+0000 7f090b7fe700 1 -- 172.21.15.32:0/108126551 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0904010460 con 0x7f0914101450 2024-05-06T21:23:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.061+0000 7f090b7fe700 1 -- 172.21.15.32:0/108126551 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f090400f5f0 con 0x7f0914101450 2024-05-06T21:23:37.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.061+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f4005320 con 0x7f0914101450 2024-05-06T21:23:37.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.062+0000 7f090b7fe700 1 -- 172.21.15.32:0/108126551 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0904009aa0 con 0x7f0914101450 2024-05-06T21:23:37.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.063+0000 7f090b7fe700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f090006c680 0x7f090006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.063+0000 7f090b7fe700 1 -- 172.21.15.32:0/108126551 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f090408b3c0 con 0x7f0914101450 2024-05-06T21:23:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.063+0000 7f091259c700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f090006c680 0x7f090006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.063+0000 7f091259c700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f090006c680 0x7f090006eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f08fc006010 tx=0x7f08fc005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:37.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.067+0000 7f090b7fe700 1 -- 172.21.15.32:0/108126551 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0904059660 con 0x7f0914101450 2024-05-06T21:23:37.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:36 smithi154 ceph-mon[32880]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:37.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.278+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08f4000bf0 con 0x7f090006c680 2024-05-06T21:23:37.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.287+0000 7f090b7fe700 1 -- 172.21.15.32:0/108126551 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2860 (secure 0 0 0) 0x7f08f4000bf0 con 0x7f090006c680 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (3m) 2m ago 5m 25.6M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (5m) 2m ago 5m 7017k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (4m) 68s ago 4m 6953k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (5m) 2m ago 5m 6665k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (4m) 68s ago 4m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (3m) 2m ago 5m 79.4M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:9283,8765,8443 running (6m) 2m ago 6m 477M - 18.2.0 dc2bc1663786 7711cd2179ff 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (4m) 68s ago 4m 439M - 18.2.0 dc2bc1663786 f1d5be241e61 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (6m) 2m ago 6m 43.6M 2048M 18.2.0 dc2bc1663786 b06a214f4520 2024-05-06T21:23:37.291 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (4m) 68s ago 4m 40.8M 2048M 18.2.0 dc2bc1663786 8a37ef7f53f9 2024-05-06T21:23:37.292 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (5m) 2m ago 5m 16.1M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:23:37.292 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (4m) 68s ago 4m 17.3M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:23:37.292 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (3m) 2m ago 3m 41.3M 3948M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:23:37.292 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (2m) 2m ago 2m 40.0M 3948M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:23:37.292 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (2m) 2m ago 2m 41.1M 3948M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:23:37.292 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (2m) 68s ago 2m 41.1M 4970M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:23:37.292 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (100s) 68s ago 100s 38.5M 4970M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:23:37.292 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (74s) 68s ago 73s 11.4M 4970M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:23:37.292 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (3m) 2m ago 4m 40.1M - 2.43.0 a07b618ecd1d eb2dd06c5402 2024-05-06T21:23:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f090006c680 msgr2=0x7f090006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f090006c680 0x7f090006eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f08fc006010 tx=0x7f08fc005a90 comp rx=0 tx=0).stop 2024-05-06T21:23:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914101450 msgr2=0x7f0914073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914101450 0x7f0914073140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f090400d8d0 tx=0x7f090400dc90 comp rx=0 tx=0).stop 2024-05-06T21:23:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 shutdown_connections 2024-05-06T21:23:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f090006c680 0x7f090006eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0914100250 0x7f0914074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 --2- 172.21.15.32:0/108126551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0914101450 0x7f0914073140 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 >> 172.21.15.32:0/108126551 conn(0x7f09140fb7e0 msgr2=0x7f0914104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 shutdown_connections 2024-05-06T21:23:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:37.290+0000 7f0918e3e700 1 -- 172.21.15.32:0/108126551 wait complete. 2024-05-06T21:23:37.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-06T21:23:38.191 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:38.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:38 smithi154 ceph-mon[32880]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:38.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:38 smithi154 ceph-mon[32880]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:38.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:38 smithi032 ceph-mon[27179]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:38.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:38 smithi032 ceph-mon[27179]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.935+0000 7f65c68b8700 1 -- 172.21.15.32:0/648373566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c0069270 msgr2=0x7f65c0102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.935+0000 7f65c68b8700 1 --2- 172.21.15.32:0/648373566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c0069270 0x7f65c0102dd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009910 tx=0x7f65b0009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.935+0000 7f65c68b8700 1 -- 172.21.15.32:0/648373566 shutdown_connections 2024-05-06T21:23:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.935+0000 7f65c68b8700 1 --2- 172.21.15.32:0/648373566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c0103310 0x7f65c0105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.935+0000 7f65c68b8700 1 --2- 172.21.15.32:0/648373566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c0069270 0x7f65c0102dd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.935+0000 7f65c68b8700 1 -- 172.21.15.32:0/648373566 >> 172.21.15.32:0/648373566 conn(0x7f65c00fa780 msgr2=0x7f65c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.935+0000 7f65c68b8700 1 -- 172.21.15.32:0/648373566 shutdown_connections 2024-05-06T21:23:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.935+0000 7f65c68b8700 1 -- 172.21.15.32:0/648373566 wait complete. 2024-05-06T21:23:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.936+0000 7f65c68b8700 1 Processor -- start 2024-05-06T21:23:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.936+0000 7f65c68b8700 1 -- start start 2024-05-06T21:23:39.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.936+0000 7f65c68b8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c0103310 0x7f65c0195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:39.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.936+0000 7f65c68b8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01960c0 0x7f65c019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.936+0000 7f65c68b8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c01965c0 con 0x7f65c01960c0 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.936+0000 7f65c68b8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0196730 con 0x7f65c0103310 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.936+0000 7f65b7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01960c0 0x7f65c019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.936+0000 7f65b7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01960c0 0x7f65c019b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39592/0 (socket says 172.21.15.32:39592) 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.936+0000 7f65b7fff700 1 -- 172.21.15.32:0/944301693 learned_addr learned my addr 172.21.15.32:0/944301693 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65bffff700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c0103310 0x7f65c0195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65b7fff700 1 -- 172.21.15.32:0/944301693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c0103310 msgr2=0x7f65c0195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65b7fff700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c0103310 0x7f65c0195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65b7fff700 1 -- 172.21.15.32:0/944301693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00095f0 con 0x7f65c01960c0 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65b7fff700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01960c0 0x7f65c019b130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f65a800b4b0 tx=0x7f65a800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65bdffb700 1 -- 172.21.15.32:0/944301693 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a8011800 con 0x7f65c01960c0 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c019b6d0 con 0x7f65c01960c0 2024-05-06T21:23:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65bdffb700 1 -- 172.21.15.32:0/944301693 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f65a8011e10 con 0x7f65c01960c0 2024-05-06T21:23:39.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c019bbf0 con 0x7f65c01960c0 2024-05-06T21:23:39.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.937+0000 7f65bdffb700 1 -- 172.21.15.32:0/944301693 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a800f2e0 con 0x7f65c01960c0 2024-05-06T21:23:39.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.938+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c018fc50 con 0x7f65c01960c0 2024-05-06T21:23:39.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.939+0000 7f65bdffb700 1 -- 172.21.15.32:0/944301693 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f65a8010380 con 0x7f65c01960c0 2024-05-06T21:23:39.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.939+0000 7f65bdffb700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f65ac06c680 0x7f65ac06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:39.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.939+0000 7f65bdffb700 1 -- 172.21.15.32:0/944301693 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f65a808b130 con 0x7f65c01960c0 2024-05-06T21:23:39.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.939+0000 7f65bffff700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f65ac06c680 0x7f65ac06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:39.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.940+0000 7f65bffff700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f65ac06c680 0x7f65ac06eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65b0006010 tx=0x7f65b0005920 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:39.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:39.944+0000 7f65bdffb700 1 -- 172.21.15.32:0/944301693 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f65a80595c0 con 0x7f65c01960c0 2024-05-06T21:23:40.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.154+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f65c002cf20 con 0x7f65ac06c680 2024-05-06T21:23:40.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.159+0000 7f65bdffb700 1 -- 172.21.15.32:0/944301693 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f65c002cf20 con 0x7f65ac06c680 2024-05-06T21:23:40.162 INFO:teuthology.orchestra.run.smithi032.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-06T21:23:40.163 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-05-06T21:23:40.163 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter 2/2 2m ago 6m * 2024-05-06T21:23:40.163 INFO:teuthology.orchestra.run.smithi032.stdout:crash 2/2 2m ago 6m * 2024-05-06T21:23:40.163 INFO:teuthology.orchestra.run.smithi032.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-05-06T21:23:40.163 INFO:teuthology.orchestra.run.smithi032.stdout:mgr 2/2 2m ago 6m count:2 2024-05-06T21:23:40.163 INFO:teuthology.orchestra.run.smithi032.stdout:mon 2/2 2m ago 5m smithi032:172.21.15.32=smithi032;smithi154:172.21.15.154=smithi154;count:2 2024-05-06T21:23:40.163 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-05-06T21:23:40.163 INFO:teuthology.orchestra.run.smithi032.stdout:osd 6 2m ago - 2024-05-06T21:23:40.163 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f65ac06c680 msgr2=0x7f65ac06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f65ac06c680 0x7f65ac06eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65b0006010 tx=0x7f65b0005920 comp rx=0 tx=0).stop 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01960c0 msgr2=0x7f65c019b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01960c0 0x7f65c019b130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f65a800b4b0 tx=0x7f65a800b870 comp rx=0 tx=0).stop 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 shutdown_connections 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f65ac06c680 0x7f65ac06eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c0103310 0x7f65c0195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 --2- 172.21.15.32:0/944301693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01960c0 0x7f65c019b130 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 >> 172.21.15.32:0/944301693 conn(0x7f65c00fa780 msgr2=0x7f65c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 shutdown_connections 2024-05-06T21:23:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:40.161+0000 7f65c68b8700 1 -- 172.21.15.32:0/944301693 wait complete. 2024-05-06T21:23:40.795 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:40 smithi032 ceph-mon[27179]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:40.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-06T21:23:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:40 smithi154 ceph-mon[32880]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:41.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:41 smithi032 ceph-mon[27179]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:42.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:41 smithi154 ceph-mon[32880]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.699+0000 7fd5262fe700 1 -- 172.21.15.32:0/3977035500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 msgr2=0x7fd520100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.699+0000 7fd5262fe700 1 --2- 172.21.15.32:0/3977035500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 0x7fd520100840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd514009910 tx=0x7fd514009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.699+0000 7fd5262fe700 1 -- 172.21.15.32:0/3977035500 shutdown_connections 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.699+0000 7fd5262fe700 1 --2- 172.21.15.32:0/3977035500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 0x7fd520100840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.699+0000 7fd5262fe700 1 --2- 172.21.15.32:0/3977035500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5200ff130 0x7fd5200ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.699+0000 7fd5262fe700 1 -- 172.21.15.32:0/3977035500 >> 172.21.15.32:0/3977035500 conn(0x7fd5200fa780 msgr2=0x7fd5200fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.699+0000 7fd5262fe700 1 -- 172.21.15.32:0/3977035500 shutdown_connections 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.699+0000 7fd5262fe700 1 -- 172.21.15.32:0/3977035500 wait complete. 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.699+0000 7fd5262fe700 1 Processor -- start 2024-05-06T21:23:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd5262fe700 1 -- start start 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd5262fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5200ff130 0x7fd520195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd5262fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 0x7fd520195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd5262fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5201965c0 con 0x7fd5201003d0 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd5262fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520196700 con 0x7fd5200ff130 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 0x7fd520195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 0x7fd520195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48664/0 (socket says 172.21.15.32:48664) 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd51f7fe700 1 -- 172.21.15.32:0/2200108254 learned_addr learned my addr 172.21.15.32:0/2200108254 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd51ffff700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5200ff130 0x7fd520195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd51f7fe700 1 -- 172.21.15.32:0/2200108254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5200ff130 msgr2=0x7fd520195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd51f7fe700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5200ff130 0x7fd520195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd51f7fe700 1 -- 172.21.15.32:0/2200108254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5140095f0 con 0x7fd5201003d0 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.700+0000 7fd51f7fe700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 0x7fd520195fa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd514000c00 tx=0x7fd51400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.701+0000 7fd51d7fa700 1 -- 172.21.15.32:0/2200108254 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd51401d070 con 0x7fd5201003d0 2024-05-06T21:23:42.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.701+0000 7fd51d7fa700 1 -- 172.21.15.32:0/2200108254 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd514005dc0 con 0x7fd5201003d0 2024-05-06T21:23:42.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.701+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52019b150 con 0x7fd5201003d0 2024-05-06T21:23:42.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.701+0000 7fd51d7fa700 1 -- 172.21.15.32:0/2200108254 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5140226a0 con 0x7fd5201003d0 2024-05-06T21:23:42.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.701+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52019b640 con 0x7fd5201003d0 2024-05-06T21:23:42.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.702+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd520107c10 con 0x7fd5201003d0 2024-05-06T21:23:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.702+0000 7fd51d7fa700 1 -- 172.21.15.32:0/2200108254 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd514022800 con 0x7fd5201003d0 2024-05-06T21:23:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.703+0000 7fd51d7fa700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd50806c680 0x7fd50806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.703+0000 7fd51d7fa700 1 -- 172.21.15.32:0/2200108254 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd51408c940 con 0x7fd5201003d0 2024-05-06T21:23:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.703+0000 7fd51ffff700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd50806c680 0x7fd50806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.703+0000 7fd51ffff700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd50806c680 0x7fd50806eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd510009c60 tx=0x7fd510009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.707+0000 7fd51d7fa700 1 -- 172.21.15.32:0/2200108254 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd51405ae70 con 0x7fd5201003d0 2024-05-06T21:23:42.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.912+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd520068c50 con 0x7fd50806c680 2024-05-06T21:23:42.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.913+0000 7fd51d7fa700 1 -- 172.21.15.32:0/2200108254 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fd520068c50 con 0x7fd50806c680 2024-05-06T21:23:42.917 INFO:teuthology.orchestra.run.smithi032.stdout:HOST ADDR LABELS STATUS 2024-05-06T21:23:42.917 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032 172.21.15.32 2024-05-06T21:23:42.917 INFO:teuthology.orchestra.run.smithi032.stdout:smithi154 172.21.15.154 2024-05-06T21:23:42.917 INFO:teuthology.orchestra.run.smithi032.stdout:2 hosts in cluster 2024-05-06T21:23:42.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd50806c680 msgr2=0x7fd50806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:42.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd50806c680 0x7fd50806eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd510009c60 tx=0x7fd510009260 comp rx=0 tx=0).stop 2024-05-06T21:23:42.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 msgr2=0x7fd520195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:42.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 0x7fd520195fa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd514000c00 tx=0x7fd51400f690 comp rx=0 tx=0).stop 2024-05-06T21:23:42.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 shutdown_connections 2024-05-06T21:23:42.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd50806c680 0x7fd50806eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:42.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5200ff130 0x7fd520195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:42.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 --2- 172.21.15.32:0/2200108254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5201003d0 0x7fd520195fa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:42.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 >> 172.21.15.32:0/2200108254 conn(0x7fd5200fa780 msgr2=0x7fd520068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:42.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.915+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 shutdown_connections 2024-05-06T21:23:42.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:42.916+0000 7fd5262fe700 1 -- 172.21.15.32:0/2200108254 wait complete. 2024-05-06T21:23:42.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:42 smithi032 ceph-mon[27179]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:42.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:23:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:42 smithi154 ceph-mon[32880]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:23:43.626 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-06T21:23:43.847 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:44.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:44 smithi032 ceph-mon[27179]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:44.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:44 smithi032 ceph-mon[27179]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:44 smithi154 ceph-mon[32880]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:44 smithi154 ceph-mon[32880]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:45.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.514+0000 7f7deaf87700 1 -- 172.21.15.32:0/1922676336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 msgr2=0x7f7de4100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:45.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.514+0000 7f7deaf87700 1 --2- 172.21.15.32:0/1922676336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 0x7f7de4100860 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009910 tx=0x7f7dd0009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:45.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 -- 172.21.15.32:0/1922676336 shutdown_connections 2024-05-06T21:23:45.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 --2- 172.21.15.32:0/1922676336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 0x7f7de4100860 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:45.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 --2- 172.21.15.32:0/1922676336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de40ff150 0x7f7de40ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:45.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 -- 172.21.15.32:0/1922676336 >> 172.21.15.32:0/1922676336 conn(0x7f7de40fa7a0 msgr2=0x7f7de40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 -- 172.21.15.32:0/1922676336 shutdown_connections 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 -- 172.21.15.32:0/1922676336 wait complete. 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 Processor -- start 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 -- start start 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de40ff150 0x7f7de4195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 0x7f7de4196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de41969a0 con 0x7f7de41003f0 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.515+0000 7f7deaf87700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4196ae0 con 0x7f7de40ff150 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 0x7f7de4196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 0x7f7de4196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48670/0 (socket says 172.21.15.32:48670) 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de3fff700 1 -- 172.21.15.32:0/1731760947 learned_addr learned my addr 172.21.15.32:0/1731760947 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:45.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de8d23700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de40ff150 0x7f7de4195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:45.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de3fff700 1 -- 172.21.15.32:0/1731760947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de40ff150 msgr2=0x7f7de4195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:45.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de3fff700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de40ff150 0x7f7de4195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:45.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de3fff700 1 -- 172.21.15.32:0/1731760947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd00095f0 con 0x7f7de41003f0 2024-05-06T21:23:45.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de3fff700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 0x7f7de4196380 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000bd70 tx=0x7f7dd000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:45.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de1ffb700 1 -- 172.21.15.32:0/1731760947 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd001d070 con 0x7f7de41003f0 2024-05-06T21:23:45.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de1ffb700 1 -- 172.21.15.32:0/1731760947 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7dd0005940 con 0x7f7de41003f0 2024-05-06T21:23:45.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7de1ffb700 1 -- 172.21.15.32:0/1731760947 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd0021430 con 0x7f7de41003f0 2024-05-06T21:23:45.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.516+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de419b530 con 0x7f7de41003f0 2024-05-06T21:23:45.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.517+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de419b9d0 con 0x7f7de41003f0 2024-05-06T21:23:45.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.518+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de4068ab0 con 0x7f7de41003f0 2024-05-06T21:23:45.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.518+0000 7f7de1ffb700 1 -- 172.21.15.32:0/1731760947 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7dd000f860 con 0x7f7de41003f0 2024-05-06T21:23:45.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.518+0000 7f7de1ffb700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7dd406c680 0x7f7dd406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:45.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.519+0000 7f7de1ffb700 1 -- 172.21.15.32:0/1731760947 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7dd008c950 con 0x7f7de41003f0 2024-05-06T21:23:45.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.519+0000 7f7de8d23700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7dd406c680 0x7f7dd406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:45.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.519+0000 7f7de8d23700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7dd406c680 0x7f7dd406eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009a10 tx=0x7f7dd8009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.523+0000 7f7de1ffb700 1 -- 172.21.15.32:0/1731760947 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7dd005ae00 con 0x7f7de41003f0 2024-05-06T21:23:45.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.731+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7de40694e0 con 0x7f7dd406c680 2024-05-06T21:23:45.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.732+0000 7f7de1ffb700 1 -- 172.21.15.32:0/1731760947 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f7de40694e0 con 0x7f7dd406c680 2024-05-06T21:23:45.736 INFO:teuthology.orchestra.run.smithi032.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-06T21:23:45.736 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747402DN480DGN 447G No 2m ago LVM detected, locked 2024-05-06T21:23:45.736 INFO:teuthology.orchestra.run.smithi032.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 73s ago LVM detected, locked 2024-05-06T21:23:45.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7dd406c680 msgr2=0x7f7dd406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:45.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7dd406c680 0x7f7dd406eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009a10 tx=0x7f7dd8009190 comp rx=0 tx=0).stop 2024-05-06T21:23:45.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 msgr2=0x7f7de4196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:45.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 0x7f7de4196380 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000bd70 tx=0x7f7dd000bda0 comp rx=0 tx=0).stop 2024-05-06T21:23:45.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 shutdown_connections 2024-05-06T21:23:45.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7dd406c680 0x7f7dd406eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:45.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7de40ff150 0x7f7de4195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:45.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 --2- 172.21.15.32:0/1731760947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7de41003f0 0x7f7de4196380 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:45.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 >> 172.21.15.32:0/1731760947 conn(0x7f7de40fa7a0 msgr2=0x7f7de4068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:45.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 shutdown_connections 2024-05-06T21:23:45.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:45.734+0000 7f7deaf87700 1 -- 172.21.15.32:0/1731760947 wait complete. 2024-05-06T21:23:46.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:45 smithi032 ceph-mon[27179]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:46.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:45 smithi154 ceph-mon[32880]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:46.450 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T21:23:46.459 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:23:46.460 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-05-06T21:23:46.679 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:47.052 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:46 smithi032 ceph-mon[27179]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:47.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:46 smithi154 ceph-mon[32880]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:48.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:47 smithi154 ceph-mon[32880]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:48.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:47 smithi032 ceph-mon[27179]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:48.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.447+0000 7fe184c40700 1 -- 172.21.15.32:0/2358606895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1801003f0 msgr2=0x7fe180100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.447+0000 7fe184c40700 1 --2- 172.21.15.32:0/2358606895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1801003f0 0x7fe180100860 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe174009910 tx=0x7fe174009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.448+0000 7fe184c40700 1 -- 172.21.15.32:0/2358606895 shutdown_connections 2024-05-06T21:23:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.448+0000 7fe184c40700 1 --2- 172.21.15.32:0/2358606895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1801003f0 0x7fe180100860 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.448+0000 7fe184c40700 1 --2- 172.21.15.32:0/2358606895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1800ff150 0x7fe1800ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.448+0000 7fe184c40700 1 -- 172.21.15.32:0/2358606895 >> 172.21.15.32:0/2358606895 conn(0x7fe1800fa7a0 msgr2=0x7fe1800fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.448+0000 7fe184c40700 1 -- 172.21.15.32:0/2358606895 shutdown_connections 2024-05-06T21:23:48.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.448+0000 7fe184c40700 1 -- 172.21.15.32:0/2358606895 wait complete. 2024-05-06T21:23:48.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.448+0000 7fe184c40700 1 Processor -- start 2024-05-06T21:23:48.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.448+0000 7fe184c40700 1 -- start start 2024-05-06T21:23:48.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe184c40700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1800ff150 0x7fe180103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:48.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe184c40700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1801003f0 0x7fe1801017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:48.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe184c40700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe180101d10 con 0x7fe1800ff150 2024-05-06T21:23:48.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe184c40700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe180101e50 con 0x7fe1801003f0 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe17e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1800ff150 0x7fe180103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe17e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1800ff150 0x7fe180103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48690/0 (socket says 172.21.15.32:48690) 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe17e59c700 1 -- 172.21.15.32:0/680089316 learned_addr learned my addr 172.21.15.32:0/680089316 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe17dd9b700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1801003f0 0x7fe1801017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe17e59c700 1 -- 172.21.15.32:0/680089316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1801003f0 msgr2=0x7fe1801017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe17e59c700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1801003f0 0x7fe1801017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe17e59c700 1 -- 172.21.15.32:0/680089316 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1740095f0 con 0x7fe1800ff150 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe17dd9b700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1801003f0 0x7fe1801017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe17e59c700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1800ff150 0x7fe180103180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe17000b4b0 tx=0x7fe17000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.449+0000 7fe16f7fe700 1 -- 172.21.15.32:0/680089316 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe170011800 con 0x7fe1800ff150 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.450+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe180102130 con 0x7fe1800ff150 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.450+0000 7fe16f7fe700 1 -- 172.21.15.32:0/680089316 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe170011e10 con 0x7fe1800ff150 2024-05-06T21:23:48.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.450+0000 7fe16f7fe700 1 -- 172.21.15.32:0/680089316 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17000f2e0 con 0x7fe1800ff150 2024-05-06T21:23:48.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.450+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18019dea0 con 0x7fe1800ff150 2024-05-06T21:23:48.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.451+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe180068ab0 con 0x7fe1800ff150 2024-05-06T21:23:48.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.451+0000 7fe16f7fe700 1 -- 172.21.15.32:0/680089316 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe170010380 con 0x7fe1800ff150 2024-05-06T21:23:48.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.452+0000 7fe16f7fe700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe16806c680 0x7fe16806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:48.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.452+0000 7fe16f7fe700 1 -- 172.21.15.32:0/680089316 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe17008b120 con 0x7fe1800ff150 2024-05-06T21:23:48.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.452+0000 7fe17dd9b700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe16806c680 0x7fe16806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:48.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.452+0000 7fe17dd9b700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe16806c680 0x7fe16806eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe174006010 tx=0x7fe17400b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:48.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.456+0000 7fe16f7fe700 1 -- 172.21.15.32:0/680089316 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe170059660 con 0x7fe1800ff150 2024-05-06T21:23:48.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:48.687+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1800694e0 con 0x7fe16806c680 2024-05-06T21:23:49.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:49 smithi032 ceph-mon[27179]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:49.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:49 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-06T21:23:49.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:49 smithi154 ceph-mon[32880]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:23:49.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:49 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-06T21:23:50.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.222+0000 7fe16f7fe700 1 -- 172.21.15.32:0/680089316 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe1800694e0 con 0x7fe16806c680 2024-05-06T21:23:50.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.224+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe16806c680 msgr2=0x7fe16806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:50.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.224+0000 7fe184c40700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe16806c680 0x7fe16806eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe174006010 tx=0x7fe17400b540 comp rx=0 tx=0).stop 2024-05-06T21:23:50.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.225+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1800ff150 msgr2=0x7fe180103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:50.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.225+0000 7fe184c40700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1800ff150 0x7fe180103180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe17000b4b0 tx=0x7fe17000b870 comp rx=0 tx=0).stop 2024-05-06T21:23:50.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.225+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 shutdown_connections 2024-05-06T21:23:50.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.225+0000 7fe184c40700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe16806c680 0x7fe16806eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:50.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.225+0000 7fe184c40700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1800ff150 0x7fe180103180 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:50.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.225+0000 7fe184c40700 1 --2- 172.21.15.32:0/680089316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1801003f0 0x7fe1801017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:50.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.225+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 >> 172.21.15.32:0/680089316 conn(0x7fe1800fa7a0 msgr2=0x7fe180068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:50.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.225+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 shutdown_connections 2024-05-06T21:23:50.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:50.225+0000 7fe184c40700 1 -- 172.21.15.32:0/680089316 wait complete. 2024-05-06T21:23:50.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:50 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-06T21:23:50.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:50 smithi032 ceph-mon[27179]: osdmap e42: 6 total, 6 up, 6 in 2024-05-06T21:23:50.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:50 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-06T21:23:50.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:50 smithi032 ceph-mon[27179]: pgmap v176: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:50.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:50 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032[27175]: 2024-05-06T21:23:50.197+0000 7ff571bc9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T21:23:50.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:50 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-06T21:23:50.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:50 smithi154 ceph-mon[32880]: osdmap e42: 6 total, 6 up, 6 in 2024-05-06T21:23:50.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:50 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-06T21:23:50.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:50 smithi154 ceph-mon[32880]: pgmap v176: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:50.895 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-06T21:23:51.426 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: osdmap e43: 6 total, 6 up, 6 in 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: osdmap e44: 6 total, 6 up, 6 in 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: fsmap cephfs:0 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: Saving service mds.cephfs spec with placement count:4 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:23:51.427 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:51.428 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.fpdhzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:23:51.428 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.fpdhzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T21:23:51.428 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:51.428 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:51 smithi032 ceph-mon[27179]: Deploying daemon mds.cephfs.smithi032.fpdhzg on smithi032 2024-05-06T21:23:51.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-06T21:23:51.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: osdmap e43: 6 total, 6 up, 6 in 2024-05-06T21:23:51.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-06T21:23:51.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T21:23:51.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T21:23:51.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: osdmap e44: 6 total, 6 up, 6 in 2024-05-06T21:23:51.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: fsmap cephfs:0 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: Saving service mds.cephfs spec with placement count:4 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.fpdhzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.fpdhzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:51.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:51 smithi154 ceph-mon[32880]: Deploying daemon mds.cephfs.smithi032.fpdhzg on smithi032 2024-05-06T21:23:52.306 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:52.430 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:52 smithi032 ceph-mon[27179]: osdmap e45: 6 total, 6 up, 6 in 2024-05-06T21:23:52.430 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:52 smithi032 ceph-mon[27179]: pgmap v180: 65 pgs: 7 creating+activating, 10 creating+peering, 23 active+clean, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:52.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:52 smithi154 ceph-mon[32880]: osdmap e45: 6 total, 6 up, 6 in 2024-05-06T21:23:52.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:52 smithi154 ceph-mon[32880]: pgmap v180: 65 pgs: 7 creating+activating, 10 creating+peering, 23 active+clean, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:53.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:53 smithi032 ceph-mon[27179]: osdmap e46: 6 total, 6 up, 6 in 2024-05-06T21:23:53.602 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:53 smithi154 ceph-mon[32880]: osdmap e46: 6 total, 6 up, 6 in 2024-05-06T21:23:54.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.087+0000 7f5c72b48700 1 -- 172.21.15.32:0/3500714399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c102230 msgr2=0x7f5c6c0fe360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:54.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.087+0000 7f5c72b48700 1 --2- 172.21.15.32:0/3500714399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c102230 0x7f5c6c0fe360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009910 tx=0x7f5c58009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:54.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.087+0000 7f5c72b48700 1 -- 172.21.15.32:0/3500714399 shutdown_connections 2024-05-06T21:23:54.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.087+0000 7f5c72b48700 1 --2- 172.21.15.32:0/3500714399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c102230 0x7f5c6c0fe360 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:54.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.087+0000 7f5c72b48700 1 --2- 172.21.15.32:0/3500714399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c1018e0 0x7f5c6c101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:54.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.087+0000 7f5c72b48700 1 -- 172.21.15.32:0/3500714399 >> 172.21.15.32:0/3500714399 conn(0x7f5c6c0f9f10 msgr2=0x7f5c6c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:54.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.087+0000 7f5c72b48700 1 -- 172.21.15.32:0/3500714399 shutdown_connections 2024-05-06T21:23:54.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.087+0000 7f5c72b48700 1 -- 172.21.15.32:0/3500714399 wait complete. 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c72b48700 1 Processor -- start 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c72b48700 1 -- start start 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c72b48700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c1018e0 0x7f5c6c100fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c72b48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c102230 0x7f5c6c0ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c72b48700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0ffb70 con 0x7f5c6c1018e0 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c72b48700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0ffcb0 con 0x7f5c6c102230 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c708e4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c1018e0 0x7f5c6c100fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c708e4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c1018e0 0x7f5c6c100fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48526/0 (socket says 172.21.15.32:48526) 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c708e4700 1 -- 172.21.15.32:0/3845526023 learned_addr learned my addr 172.21.15.32:0/3845526023 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.088+0000 7f5c6bfff700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c102230 0x7f5c6c0ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:54.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.089+0000 7f5c708e4700 1 -- 172.21.15.32:0/3845526023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c102230 msgr2=0x7f5c6c0ff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:54.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.089+0000 7f5c708e4700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c102230 0x7f5c6c0ff630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:54.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.089+0000 7f5c708e4700 1 -- 172.21.15.32:0/3845526023 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c580095f0 con 0x7f5c6c1018e0 2024-05-06T21:23:54.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.089+0000 7f5c708e4700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c1018e0 0x7f5c6c100fe0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000d8d0 tx=0x7f5c6000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:54.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.089+0000 7f5c69ffb700 1 -- 172.21.15.32:0/3845526023 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c60009940 con 0x7f5c6c1018e0 2024-05-06T21:23:54.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.089+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c0fff90 con 0x7f5c6c1018e0 2024-05-06T21:23:54.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.089+0000 7f5c69ffb700 1 -- 172.21.15.32:0/3845526023 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c60010460 con 0x7f5c6c1018e0 2024-05-06T21:23:54.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.089+0000 7f5c69ffb700 1 -- 172.21.15.32:0/3845526023 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c6000f5f0 con 0x7f5c6c1018e0 2024-05-06T21:23:54.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.089+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c19db50 con 0x7f5c6c1018e0 2024-05-06T21:23:54.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.091+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c108d20 con 0x7f5c6c1018e0 2024-05-06T21:23:54.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.091+0000 7f5c69ffb700 1 -- 172.21.15.32:0/3845526023 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5c600105d0 con 0x7f5c6c1018e0 2024-05-06T21:23:54.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.091+0000 7f5c69ffb700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5c5c06c680 0x7f5c5c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:54.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.092+0000 7f5c69ffb700 1 -- 172.21.15.32:0/3845526023 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f5c6008b880 con 0x7f5c6c1018e0 2024-05-06T21:23:54.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.092+0000 7f5c6bfff700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5c5c06c680 0x7f5c5c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:54.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.092+0000 7f5c6bfff700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5c5c06c680 0x7f5c5c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5c58005090 tx=0x7f5c5800b580 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:54.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.097+0000 7f5c69ffb700 1 -- 172.21.15.32:0/3845526023 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5c600599f0 con 0x7f5c6c1018e0 2024-05-06T21:23:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.346+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5c6c19e310 con 0x7f5c6c1018e0 2024-05-06T21:23:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.347+0000 7f5c69ffb700 1 -- 172.21.15.32:0/3845526023 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7f5c60016460 con 0x7f5c6c1018e0 2024-05-06T21:23:54.350 INFO:teuthology.orchestra.run.smithi032.stdout:e2 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 2 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:23:50.199036+0000 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:23:54.351 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 0 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 1 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:in 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:up {} 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:23:54.352 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:23:54.353 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:23:54.353 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 0 2024-05-06T21:23:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:23:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:23:54.353 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:54 smithi032 ceph-mon[27179]: pgmap v182: 65 pgs: 7 creating+activating, 10 creating+peering, 23 active+clean, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5c5c06c680 msgr2=0x7f5c5c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5c5c06c680 0x7f5c5c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5c58005090 tx=0x7f5c5800b580 comp rx=0 tx=0).stop 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c1018e0 msgr2=0x7f5c6c100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c1018e0 0x7f5c6c100fe0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000d8d0 tx=0x7f5c6000dc90 comp rx=0 tx=0).stop 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 shutdown_connections 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f5c5c06c680 0x7f5c5c06eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c6c1018e0 0x7f5c6c100fe0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 --2- 172.21.15.32:0/3845526023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c102230 0x7f5c6c0ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 >> 172.21.15.32:0/3845526023 conn(0x7f5c6c0f9f10 msgr2=0x7f5c6c1048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 shutdown_connections 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:54.349+0000 7f5c72b48700 1 -- 172.21.15.32:0/3845526023 wait complete. 2024-05-06T21:23:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 2 2024-05-06T21:23:54.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:54 smithi154 ceph-mon[32880]: pgmap v182: 65 pgs: 7 creating+activating, 10 creating+peering, 23 active+clean, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:23:55.277 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T21:23:55.291 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:23:55.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-05-06T21:23:55.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3845526023' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:23:55.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: daemon mds.cephfs.smithi032.fpdhzg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: Cluster is now healthy 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.32:6826/403692088,v1:172.21.15.32:6827/403692088] up:boot 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:creating} 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: daemon mds.cephfs.smithi032.fpdhzg is now active in filesystem cephfs as rank 0 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.rizdbu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.rizdbu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T21:23:55.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:55 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:55.493 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3845526023' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:23:55.493 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:55.493 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: daemon mds.cephfs.smithi032.fpdhzg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: Cluster is now healthy 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.32:6826/403692088,v1:172.21.15.32:6827/403692088] up:boot 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:creating} 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: daemon mds.cephfs.smithi032.fpdhzg is now active in filesystem cephfs as rank 0 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.rizdbu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.rizdbu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T21:23:55.494 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:55 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:55.511 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:23:56.449 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:56 smithi154 ceph-mon[32880]: Deploying daemon mds.cephfs.smithi154.rizdbu on smithi154 2024-05-06T21:23:56.449 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:56 smithi154 ceph-mon[32880]: pgmap v183: 65 pgs: 7 creating+activating, 5 creating+peering, 53 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2024-05-06T21:23:56.449 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:56 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.32:6826/403692088,v1:172.21.15.32:6827/403692088] up:active 2024-05-06T21:23:56.449 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:56 smithi154 ceph-mon[32880]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 2024-05-06T21:23:56.581 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:56 smithi032 ceph-mon[27179]: Deploying daemon mds.cephfs.smithi154.rizdbu on smithi154 2024-05-06T21:23:56.581 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:56 smithi032 ceph-mon[27179]: pgmap v183: 65 pgs: 7 creating+activating, 5 creating+peering, 53 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2024-05-06T21:23:56.581 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:56 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.32:6826/403692088,v1:172.21.15.32:6827/403692088] up:active 2024-05-06T21:23:56.581 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:56 smithi032 ceph-mon[27179]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.129+0000 7fa75fb68700 1 -- 172.21.15.32:0/1313466190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 msgr2=0x7fa758101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.129+0000 7fa75fb68700 1 --2- 172.21.15.32:0/1313466190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 0x7fa758101890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009910 tx=0x7fa74c009c20 comp rx=0 tx=0).stop 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.129+0000 7fa75fb68700 1 -- 172.21.15.32:0/1313466190 shutdown_connections 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.129+0000 7fa75fb68700 1 --2- 172.21.15.32:0/1313466190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 0x7fa758101890 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.129+0000 7fa75fb68700 1 --2- 172.21.15.32:0/1313466190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa758100240 0x7fa758100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.129+0000 7fa75fb68700 1 -- 172.21.15.32:0/1313466190 >> 172.21.15.32:0/1313466190 conn(0x7fa7580fb7f0 msgr2=0x7fa7580fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.129+0000 7fa75fb68700 1 -- 172.21.15.32:0/1313466190 shutdown_connections 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.129+0000 7fa75fb68700 1 -- 172.21.15.32:0/1313466190 wait complete. 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75fb68700 1 Processor -- start 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75fb68700 1 -- start start 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75fb68700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa758100240 0x7fa758074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75fb68700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 0x7fa758073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75fb68700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758073680 con 0x7fa758101440 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75fb68700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7580737c0 con 0x7fa758100240 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75d103700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 0x7fa758073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75d904700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa758100240 0x7fa758074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75d103700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 0x7fa758073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48552/0 (socket says 172.21.15.32:48552) 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.130+0000 7fa75d103700 1 -- 172.21.15.32:0/2905873726 learned_addr learned my addr 172.21.15.32:0/2905873726 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa75d103700 1 -- 172.21.15.32:0/2905873726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa758100240 msgr2=0x7fa758074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa75d103700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa758100240 0x7fa758074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa75d103700 1 -- 172.21.15.32:0/2905873726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0095f0 con 0x7fa758101440 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa75d904700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa758100240 0x7fa758074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa75d103700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 0x7fa758073140 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000c00 tx=0x7fa74c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa756ffd700 1 -- 172.21.15.32:0/2905873726 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa74c01d070 con 0x7fa758101440 2024-05-06T21:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa756ffd700 1 -- 172.21.15.32:0/2905873726 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa74c005dc0 con 0x7fa758101440 2024-05-06T21:23:57.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa758073a40 con 0x7fa758101440 2024-05-06T21:23:57.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa756ffd700 1 -- 172.21.15.32:0/2905873726 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa74c0226a0 con 0x7fa758101440 2024-05-06T21:23:57.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.131+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa758073f30 con 0x7fa758101440 2024-05-06T21:23:57.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.132+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa758108d90 con 0x7fa758101440 2024-05-06T21:23:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.133+0000 7fa756ffd700 1 -- 172.21.15.32:0/2905873726 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa74c0038f0 con 0x7fa758101440 2024-05-06T21:23:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.133+0000 7fa756ffd700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa74006c680 0x7fa74006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:23:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.133+0000 7fa756ffd700 1 -- 172.21.15.32:0/2905873726 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa74c08cc50 con 0x7fa758101440 2024-05-06T21:23:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.133+0000 7fa75d904700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa74006c680 0x7fa74006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:23:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.134+0000 7fa75d904700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa74006c680 0x7fa74006eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7581012a0 tx=0x7fa748009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:23:57.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.138+0000 7fa756ffd700 1 -- 172.21.15.32:0/2905873726 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa74c05ae40 con 0x7fa758101440 2024-05-06T21:23:57.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:57.392+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fa75819dff0 con 0x7fa758101440 2024-05-06T21:23:58.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.383+0000 7fa756ffd700 1 -- 172.21.15.32:0/2905873726 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7fa74c003680 con 0x7fa758101440 2024-05-06T21:23:58.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.385+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa74006c680 msgr2=0x7fa74006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:58.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.385+0000 7fa75fb68700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa74006c680 0x7fa74006eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7581012a0 tx=0x7fa748009260 comp rx=0 tx=0).stop 2024-05-06T21:23:58.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.386+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 msgr2=0x7fa758073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:23:58.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.386+0000 7fa75fb68700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 0x7fa758073140 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000c00 tx=0x7fa74c00f690 comp rx=0 tx=0).stop 2024-05-06T21:23:58.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.386+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 shutdown_connections 2024-05-06T21:23:58.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.386+0000 7fa75fb68700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa74006c680 0x7fa74006eb30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:58.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.386+0000 7fa75fb68700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa758100240 0x7fa758074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:58.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.386+0000 7fa75fb68700 1 --2- 172.21.15.32:0/2905873726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa758101440 0x7fa758073140 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:23:58.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.386+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 >> 172.21.15.32:0/2905873726 conn(0x7fa7580fb7f0 msgr2=0x7fa758104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:23:58.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.386+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 shutdown_connections 2024-05-06T21:23:58.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:23:58.386+0000 7fa75fb68700 1 -- 172.21.15.32:0/2905873726 wait complete. 2024-05-06T21:23:58.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] up:boot 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 1 up:standby 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 1 up:standby 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2905873726' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.jbgmwi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.jbgmwi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: Deploying daemon mds.cephfs.smithi032.jbgmwi on smithi032 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: pgmap v184: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 3 op/s 2024-05-06T21:23:58.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:58 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:23:58.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] up:boot 2024-05-06T21:23:58.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 1 up:standby 2024-05-06T21:23:58.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:23:58.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 1 up:standby 2024-05-06T21:23:58.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:58.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:58.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2905873726' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-05-06T21:23:58.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:23:58.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.jbgmwi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:23:58.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.jbgmwi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T21:23:58.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:23:58.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: Deploying daemon mds.cephfs.smithi032.jbgmwi on smithi032 2024-05-06T21:23:58.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: pgmap v184: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 3 op/s 2024-05-06T21:23:58.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:58 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:23:59.061 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T21:23:59.073 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:23:59.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-05-06T21:23:59.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:59 smithi032 ceph-mon[27179]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T21:23:59.485 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:59 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2905873726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-05-06T21:23:59.485 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:59 smithi032 ceph-mon[27179]: daemon mds.cephfs.smithi154.rizdbu assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-06T21:23:59.485 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:59 smithi032 ceph-mon[27179]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-05-06T21:23:59.485 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:59 smithi032 ceph-mon[27179]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T21:23:59.485 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:59 smithi032 ceph-mon[27179]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 1 up:standby 2024-05-06T21:23:59.485 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:59 smithi032 ceph-mon[27179]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:creating} 2024-05-06T21:23:59.485 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:23:59 smithi032 ceph-mon[27179]: daemon mds.cephfs.smithi154.rizdbu is now active in filesystem cephfs as rank 1 2024-05-06T21:23:59.596 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:59 smithi154 ceph-mon[32880]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T21:23:59.596 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:59 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2905873726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-05-06T21:23:59.596 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:59 smithi154 ceph-mon[32880]: daemon mds.cephfs.smithi154.rizdbu assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-06T21:23:59.596 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:59 smithi154 ceph-mon[32880]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-05-06T21:23:59.596 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:59 smithi154 ceph-mon[32880]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T21:23:59.596 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:59 smithi154 ceph-mon[32880]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 1 up:standby 2024-05-06T21:23:59.596 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:59 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:creating} 2024-05-06T21:23:59.596 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:23:59 smithi154 ceph-mon[32880]: daemon mds.cephfs.smithi154.rizdbu is now active in filesystem cephfs as rank 1 2024-05-06T21:23:59.743 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:00.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:00 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] up:active 2024-05-06T21:24:00.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:00 smithi032 ceph-mon[27179]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 2024-05-06T21:24:00.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:00 smithi032 ceph-mon[27179]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s wr, 7 op/s 2024-05-06T21:24:00.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:00 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] up:active 2024-05-06T21:24:00.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:00 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 2024-05-06T21:24:00.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:00 smithi154 ceph-mon[32880]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s wr, 7 op/s 2024-05-06T21:24:01.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.497+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/818374578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c0ff140 msgr2=0x7fd89c0ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:01.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.497+0000 7fd8a3cb7700 1 --2- 172.21.15.32:0/818374578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c0ff140 0x7fd89c0ff550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd898009910 tx=0x7fd898009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:01.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.497+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/818374578 shutdown_connections 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.497+0000 7fd8a3cb7700 1 --2- 172.21.15.32:0/818374578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd89c100340 0x7fd89c100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.497+0000 7fd8a3cb7700 1 --2- 172.21.15.32:0/818374578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c0ff140 0x7fd89c0ff550 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.497+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/818374578 >> 172.21.15.32:0/818374578 conn(0x7fd89c0fa6d0 msgr2=0x7fd89c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.497+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/818374578 shutdown_connections 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.497+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/818374578 wait complete. 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a3cb7700 1 Processor -- start 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a3cb7700 1 -- start start 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a3cb7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd89c0ff140 0x7fd89c195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a3cb7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c100340 0x7fd89c1960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a3cb7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c1966c0 con 0x7fd89c100340 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a3cb7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c196800 con 0x7fd89c0ff140 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a1252700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c100340 0x7fd89c1960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a1252700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c100340 0x7fd89c1960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48564/0 (socket says 172.21.15.32:48564) 2024-05-06T21:24:01.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a1252700 1 -- 172.21.15.32:0/1997823441 learned_addr learned my addr 172.21.15.32:0/1997823441 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a1a53700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd89c0ff140 0x7fd89c195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a1252700 1 -- 172.21.15.32:0/1997823441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd89c0ff140 msgr2=0x7fd89c195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a1252700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd89c0ff140 0x7fd89c195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a1252700 1 -- 172.21.15.32:0/1997823441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8980095f0 con 0x7fd89c100340 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.498+0000 7fd8a1252700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c100340 0x7fd89c1960a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00b4b0 tx=0x7fd88c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.499+0000 7fd892ffd700 1 -- 172.21.15.32:0/1997823441 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88c011800 con 0x7fd89c100340 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.499+0000 7fd892ffd700 1 -- 172.21.15.32:0/1997823441 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd88c011e10 con 0x7fd89c100340 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.499+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c19b2b0 con 0x7fd89c100340 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.499+0000 7fd892ffd700 1 -- 172.21.15.32:0/1997823441 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88c00f2e0 con 0x7fd89c100340 2024-05-06T21:24:01.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.499+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c19b800 con 0x7fd89c100340 2024-05-06T21:24:01.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.500+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c107d10 con 0x7fd89c100340 2024-05-06T21:24:01.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.500+0000 7fd892ffd700 1 -- 172.21.15.32:0/1997823441 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd88c010380 con 0x7fd89c100340 2024-05-06T21:24:01.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.501+0000 7fd892ffd700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd88806c680 0x7fd88806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:01.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.501+0000 7fd8a1a53700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd88806c680 0x7fd88806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:01.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.501+0000 7fd892ffd700 1 -- 172.21.15.32:0/1997823441 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd88c08b450 con 0x7fd89c100340 2024-05-06T21:24:01.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.501+0000 7fd8a1a53700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd88806c680 0x7fd88806eb30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd898006010 tx=0x7fd89800b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:01.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.506+0000 7fd892ffd700 1 -- 172.21.15.32:0/1997823441 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd88c0595c0 con 0x7fd89c100340 2024-05-06T21:24:01.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:01.758+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd89c107ed0 con 0x7fd89c100340 2024-05-06T21:24:02.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.694+0000 7fd892ffd700 1 -- 172.21.15.32:0/1997823441 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd88c059150 con 0x7fd89c100340 2024-05-06T21:24:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd88806c680 msgr2=0x7fd88806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd88806c680 0x7fd88806eb30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd898006010 tx=0x7fd89800b540 comp rx=0 tx=0).stop 2024-05-06T21:24:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c100340 msgr2=0x7fd89c1960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c100340 0x7fd89c1960a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00b4b0 tx=0x7fd88c00b7c0 comp rx=0 tx=0).stop 2024-05-06T21:24:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 shutdown_connections 2024-05-06T21:24:02.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd88806c680 0x7fd88806eb30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd89c0ff140 0x7fd89c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 --2- 172.21.15.32:0/1997823441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c100340 0x7fd89c1960a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 >> 172.21.15.32:0/1997823441 conn(0x7fd89c0fa6d0 msgr2=0x7fd89c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 shutdown_connections 2024-05-06T21:24:02.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:02.697+0000 7fd8a3cb7700 1 -- 172.21.15.32:0/1997823441 wait complete. 2024-05-06T21:24:02.942 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:02 smithi154 ceph-mon[32880]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-05-06T21:24:02.942 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:02 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1997823441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-06T21:24:02.942 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:02.942 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:02.942 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:02.942 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.xfmqxf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:24:02.942 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.xfmqxf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T21:24:02.942 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:02.942 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:02 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:02 smithi032 ceph-mon[27179]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-05-06T21:24:02.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:02 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1997823441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-06T21:24:02.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:02.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:02.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:02.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.xfmqxf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:24:02.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.xfmqxf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-06T21:24:02.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:02.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:02 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:03.336 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T21:24:03.349 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:24:03.349 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-05-06T21:24:03.578 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:03.944 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:03 smithi032 ceph-mon[27179]: Deploying daemon mds.cephfs.smithi154.xfmqxf on smithi154 2024-05-06T21:24:03.945 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:03 smithi032 ceph-mon[27179]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-05-06T21:24:03.945 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:03 smithi032 ceph-mon[27179]: Cluster is now healthy 2024-05-06T21:24:03.945 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:03 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1997823441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-06T21:24:03.945 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:03 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:boot 2024-05-06T21:24:03.945 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:03 smithi032 ceph-mon[27179]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 1 up:standby 2024-05-06T21:24:03.946 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:03 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:24:04.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:03 smithi154 ceph-mon[32880]: Deploying daemon mds.cephfs.smithi154.xfmqxf on smithi154 2024-05-06T21:24:04.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:03 smithi154 ceph-mon[32880]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-05-06T21:24:04.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:03 smithi154 ceph-mon[32880]: Cluster is now healthy 2024-05-06T21:24:04.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:03 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1997823441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-06T21:24:04.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:03 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:boot 2024-05-06T21:24:04.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:03 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 1 up:standby 2024-05-06T21:24:04.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:03 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:24:04.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:04 smithi154 ceph-mon[32880]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-05-06T21:24:04.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:04 smithi032 ceph-mon[27179]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-05-06T21:24:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.293+0000 7f7d78d25700 1 -- 172.21.15.32:0/358749133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d74103680 msgr2=0x7f7d74105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.293+0000 7f7d78d25700 1 --2- 172.21.15.32:0/358749133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d74103680 0x7f7d74105a60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009910 tx=0x7f7d68009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.293+0000 7f7d78d25700 1 -- 172.21.15.32:0/358749133 shutdown_connections 2024-05-06T21:24:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.293+0000 7f7d78d25700 1 --2- 172.21.15.32:0/358749133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d74103680 0x7f7d74105a60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.293+0000 7f7d78d25700 1 --2- 172.21.15.32:0/358749133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d74100d60 0x7f7d74103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:05.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.293+0000 7f7d78d25700 1 -- 172.21.15.32:0/358749133 >> 172.21.15.32:0/358749133 conn(0x7f7d740fa780 msgr2=0x7f7d740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:05.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.293+0000 7f7d78d25700 1 -- 172.21.15.32:0/358749133 shutdown_connections 2024-05-06T21:24:05.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.293+0000 7f7d78d25700 1 -- 172.21.15.32:0/358749133 wait complete. 2024-05-06T21:24:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.294+0000 7f7d78d25700 1 Processor -- start 2024-05-06T21:24:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.294+0000 7f7d78d25700 1 -- start start 2024-05-06T21:24:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d78d25700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d74100d60 0x7f7d74195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d78d25700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d74103680 0x7f7d74196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d78d25700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74196640 con 0x7f7d74103680 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d78d25700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74196780 con 0x7f7d74100d60 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d71d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d74103680 0x7f7d74196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d7259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d74100d60 0x7f7d74195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d71d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d74103680 0x7f7d74196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55908/0 (socket says 172.21.15.32:55908) 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d71d9b700 1 -- 172.21.15.32:0/1490400678 learned_addr learned my addr 172.21.15.32:0/1490400678 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d7259c700 1 -- 172.21.15.32:0/1490400678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d74103680 msgr2=0x7f7d74196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d7259c700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d74103680 0x7f7d74196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d7259c700 1 -- 172.21.15.32:0/1490400678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d680095f0 con 0x7f7d74100d60 2024-05-06T21:24:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.295+0000 7f7d7259c700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d74100d60 0x7f7d74195ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400e940 tx=0x7f7d6400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.296+0000 7f7d637fe700 1 -- 172.21.15.32:0/1490400678 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d6400c990 con 0x7f7d74100d60 2024-05-06T21:24:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.296+0000 7f7d637fe700 1 -- 172.21.15.32:0/1490400678 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7d64010430 con 0x7f7d74100d60 2024-05-06T21:24:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.296+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7419b230 con 0x7f7d74100d60 2024-05-06T21:24:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.296+0000 7f7d637fe700 1 -- 172.21.15.32:0/1490400678 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d64018630 con 0x7f7d74100d60 2024-05-06T21:24:05.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.296+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7419b780 con 0x7f7d74100d60 2024-05-06T21:24:05.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.297+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7418fbe0 con 0x7f7d74100d60 2024-05-06T21:24:05.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.297+0000 7f7d637fe700 1 -- 172.21.15.32:0/1490400678 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7d640188f0 con 0x7f7d74100d60 2024-05-06T21:24:05.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.298+0000 7f7d637fe700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d5c06c680 0x7f7d5c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:05.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.298+0000 7f7d637fe700 1 -- 172.21.15.32:0/1490400678 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7d64014070 con 0x7f7d74100d60 2024-05-06T21:24:05.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.298+0000 7f7d71d9b700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d5c06c680 0x7f7d5c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:05.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.298+0000 7f7d71d9b700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d5c06c680 0x7f7d5c06eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009fd0 tx=0x7f7d68005940 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.303+0000 7f7d637fe700 1 -- 172.21.15.32:0/1490400678 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7d64051720 con 0x7f7d74100d60 2024-05-06T21:24:05.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.565+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f7d7402cc30 con 0x7f7d74100d60 2024-05-06T21:24:05.851 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:boot 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1490400678' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-05-06T21:24:05.852 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:05 smithi032 ceph-mon[27179]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-05-06T21:24:05.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.863+0000 7f7d637fe700 1 -- 172.21.15.32:0/1490400678 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7d64059e10 con 0x7f7d74100d60 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d5c06c680 msgr2=0x7f7d5c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d5c06c680 0x7f7d5c06eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009fd0 tx=0x7f7d68005940 comp rx=0 tx=0).stop 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d74100d60 msgr2=0x7f7d74195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d74100d60 0x7f7d74195ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400e940 tx=0x7f7d6400ec50 comp rx=0 tx=0).stop 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 shutdown_connections 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d5c06c680 0x7f7d5c06eb30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d74100d60 0x7f7d74195ae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 --2- 172.21.15.32:0/1490400678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d74103680 0x7f7d74196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 >> 172.21.15.32:0/1490400678 conn(0x7f7d740fa780 msgr2=0x7f7d740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 shutdown_connections 2024-05-06T21:24:05.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:05.867+0000 7f7d78d25700 1 -- 172.21.15.32:0/1490400678 wait complete. 2024-05-06T21:24:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:boot 2024-05-06T21:24:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:24:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:24:05.873 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1490400678' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-05-06T21:24:05.873 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:05 smithi154 ceph-mon[32880]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-05-06T21:24:05.873 INFO:teuthology.orchestra.run.smithi032.stderr:inline data disabled 2024-05-06T21:24:06.878 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:06 smithi032 ceph-mon[27179]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-05-06T21:24:06.879 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:06 smithi032 ceph-mon[27179]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-05-06T21:24:06.879 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:06 smithi032 ceph-mon[27179]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:06.939 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T21:24:06.951 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:24:06.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-06T21:24:07.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:06 smithi154 ceph-mon[32880]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-05-06T21:24:07.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:06 smithi154 ceph-mon[32880]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-05-06T21:24:07.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:06 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:08.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:standby 2024-05-06T21:24:08.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] up:active 2024-05-06T21:24:08.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: Dropping low affinity active daemon mds.cephfs.smithi032.fpdhzg in favor of higher affinity standby. 2024-05-06T21:24:08.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: Replacing daemon mds.cephfs.smithi032.fpdhzg as rank 0 with standby daemon mds.cephfs.smithi032.jbgmwi 2024-05-06T21:24:08.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-06T21:24:08.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:08.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: osdmap e47: 6 total, 6 up, 6 in 2024-05-06T21:24:08.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: fsmap cephfs:2/2 {0=cephfs.smithi032.jbgmwi=up:replay,1=cephfs.smithi154.rizdbu=up:active} 1 up:standby 2024-05-06T21:24:08.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:08.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:08.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-06T21:24:08.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:07 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:08.160 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:standby 2024-05-06T21:24:08.160 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] up:active 2024-05-06T21:24:08.160 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: Dropping low affinity active daemon mds.cephfs.smithi032.fpdhzg in favor of higher affinity standby. 2024-05-06T21:24:08.160 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: Replacing daemon mds.cephfs.smithi032.fpdhzg as rank 0 with standby daemon mds.cephfs.smithi032.jbgmwi 2024-05-06T21:24:08.160 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-06T21:24:08.160 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:08.160 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: osdmap e47: 6 total, 6 up, 6 in 2024-05-06T21:24:08.160 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: fsmap cephfs:2/2 {0=cephfs.smithi032.jbgmwi=up:replay,1=cephfs.smithi154.rizdbu=up:active} 1 up:standby 2024-05-06T21:24:08.160 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:08.161 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:08.161 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-06T21:24:08.161 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:07 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:09.091 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:08 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:resolve 2024-05-06T21:24:09.092 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:08 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] up:boot 2024-05-06T21:24:09.092 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:08 smithi154 ceph-mon[32880]: fsmap cephfs:2/2 {0=cephfs.smithi032.jbgmwi=up:resolve,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:09.092 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:08 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:24:09.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:08 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:resolve 2024-05-06T21:24:09.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:08 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] up:boot 2024-05-06T21:24:09.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:08 smithi032 ceph-mon[27179]: fsmap cephfs:2/2 {0=cephfs.smithi032.jbgmwi=up:resolve,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:09.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:08 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:24:10.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:09 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:reconnect 2024-05-06T21:24:10.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:09 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:standby 2024-05-06T21:24:10.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:09 smithi154 ceph-mon[32880]: fsmap cephfs:2/2 {0=cephfs.smithi032.jbgmwi=up:reconnect,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:10.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:09 smithi154 ceph-mon[32880]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 614 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-05-06T21:24:10.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:09 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:rejoin 2024-05-06T21:24:10.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:09 smithi154 ceph-mon[32880]: fsmap cephfs:2/2 {0=cephfs.smithi032.jbgmwi=up:rejoin,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:10.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:09 smithi154 ceph-mon[32880]: daemon mds.cephfs.smithi032.jbgmwi is now active in filesystem cephfs as rank 0 2024-05-06T21:24:10.140 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:09 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:reconnect 2024-05-06T21:24:10.140 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:09 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:standby 2024-05-06T21:24:10.140 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:09 smithi032 ceph-mon[27179]: fsmap cephfs:2/2 {0=cephfs.smithi032.jbgmwi=up:reconnect,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:10.141 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:09 smithi032 ceph-mon[27179]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 614 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-05-06T21:24:10.141 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:09 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:rejoin 2024-05-06T21:24:10.141 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:09 smithi032 ceph-mon[27179]: fsmap cephfs:2/2 {0=cephfs.smithi032.jbgmwi=up:rejoin,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:10.141 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:09 smithi032 ceph-mon[27179]: daemon mds.cephfs.smithi032.jbgmwi is now active in filesystem cephfs as rank 0 2024-05-06T21:24:10.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.551+0000 7f09dbd9b700 1 -- 172.21.15.32:0/2935512502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fe500 msgr2=0x7f09d40fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:10.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.551+0000 7f09dbd9b700 1 --2- 172.21.15.32:0/2935512502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fe500 0x7f09d40fe910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f09c400b0a0 tx=0x7f09c400b3b0 comp rx=0 tx=0).stop 2024-05-06T21:24:10.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.551+0000 7f09dbd9b700 1 -- 172.21.15.32:0/2935512502 shutdown_connections 2024-05-06T21:24:10.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.551+0000 7f09dbd9b700 1 --2- 172.21.15.32:0/2935512502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40fee50 0x7f09d4101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:10.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.551+0000 7f09dbd9b700 1 --2- 172.21.15.32:0/2935512502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fe500 0x7f09d40fe910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:10.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.551+0000 7f09dbd9b700 1 -- 172.21.15.32:0/2935512502 >> 172.21.15.32:0/2935512502 conn(0x7f09d40f9f10 msgr2=0x7f09d40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:10.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.551+0000 7f09dbd9b700 1 -- 172.21.15.32:0/2935512502 shutdown_connections 2024-05-06T21:24:10.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.551+0000 7f09dbd9b700 1 -- 172.21.15.32:0/2935512502 wait complete. 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09dbd9b700 1 Processor -- start 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09dbd9b700 1 -- start start 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09dbd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40fe500 0x7f09d4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09dbd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fee50 0x7f09d40ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09dbd9b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40ffa70 con 0x7f09d40fee50 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09dbd9b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40ffbb0 con 0x7f09d40fe500 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09d9336700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fee50 0x7f09d40ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09d9336700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fee50 0x7f09d40ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55946/0 (socket says 172.21.15.32:55946) 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09d9336700 1 -- 172.21.15.32:0/1473641998 learned_addr learned my addr 172.21.15.32:0/1473641998 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09d9b37700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40fe500 0x7f09d4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09d9336700 1 -- 172.21.15.32:0/1473641998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40fe500 msgr2=0x7f09d4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:10.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09d9336700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40fe500 0x7f09d4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:10.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09d9336700 1 -- 172.21.15.32:0/1473641998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4009d00 con 0x7f09d40fee50 2024-05-06T21:24:10.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.552+0000 7f09d9b37700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40fe500 0x7f09d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:24:10.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.553+0000 7f09d9336700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fee50 0x7f09d40ff530 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f09c800c840 tx=0x7f09c800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:10.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.553+0000 7f09d2ffd700 1 -- 172.21.15.32:0/1473641998 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c80041f0 con 0x7f09d40fee50 2024-05-06T21:24:10.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.553+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d40ffe90 con 0x7f09d40fee50 2024-05-06T21:24:10.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.553+0000 7f09d2ffd700 1 -- 172.21.15.32:0/1473641998 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09c8004ce0 con 0x7f09d40fee50 2024-05-06T21:24:10.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.553+0000 7f09d2ffd700 1 -- 172.21.15.32:0/1473641998 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c8007740 con 0x7f09d40fee50 2024-05-06T21:24:10.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.553+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d419db90 con 0x7f09d40fee50 2024-05-06T21:24:10.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.554+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d4108d50 con 0x7f09d40fee50 2024-05-06T21:24:10.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.554+0000 7f09d2ffd700 1 -- 172.21.15.32:0/1473641998 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f09c8004350 con 0x7f09d40fee50 2024-05-06T21:24:10.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.555+0000 7f09d2ffd700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f09bc06c680 0x7f09bc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:10.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.555+0000 7f09d2ffd700 1 -- 172.21.15.32:0/1473641998 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f09c808b540 con 0x7f09d40fee50 2024-05-06T21:24:10.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.555+0000 7f09d9b37700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f09bc06c680 0x7f09bc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:10.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.555+0000 7f09d9b37700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f09bc06c680 0x7f09bc06eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f09c400b830 tx=0x7f09c4006000 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:10.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.559+0000 7f09d2ffd700 1 -- 172.21.15.32:0/1473641998 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f09c8059650 con 0x7f09d40fee50 2024-05-06T21:24:10.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.807+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f09d419e400 con 0x7f09d40fee50 2024-05-06T21:24:10.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.807+0000 7f09d2ffd700 1 -- 172.21.15.32:0/1473641998 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f09c80591e0 con 0x7f09d40fee50 2024-05-06T21:24:10.810 INFO:teuthology.orchestra.run.smithi032.stdout:e17 2024-05-06T21:24:10.810 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 17 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:24:09.873014+0000 2024-05-06T21:24:10.811 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:24:10.812 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:rejoin seq 5 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:24:10.813 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:10.814 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:24:10.814 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:24:10.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.809+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f09bc06c680 msgr2=0x7f09bc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:10.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.809+0000 7f09dbd9b700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f09bc06c680 0x7f09bc06eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f09c400b830 tx=0x7f09c4006000 comp rx=0 tx=0).stop 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.809+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fee50 msgr2=0x7f09d40ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.809+0000 7f09dbd9b700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fee50 0x7f09d40ff530 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f09c800c840 tx=0x7f09c800cc00 comp rx=0 tx=0).stop 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.810+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 shutdown_connections 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.810+0000 7f09dbd9b700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f09bc06c680 0x7f09bc06eb30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.810+0000 7f09dbd9b700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40fe500 0x7f09d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.810+0000 7f09dbd9b700 1 --2- 172.21.15.32:0/1473641998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d40fee50 0x7f09d40ff530 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.810+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 >> 172.21.15.32:0/1473641998 conn(0x7f09d40f9f10 msgr2=0x7f09d41047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.810+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 shutdown_connections 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:10.810+0000 7f09dbd9b700 1 -- 172.21.15.32:0/1473641998 wait complete. 2024-05-06T21:24:10.815 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 17 2024-05-06T21:24:11.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:10 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1473641998' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:24:11.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:10 smithi032 ceph-mon[27179]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-06T21:24:11.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:10 smithi032 ceph-mon[27179]: Cluster is now healthy 2024-05-06T21:24:11.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:10 smithi032 ceph-mon[27179]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:active 2024-05-06T21:24:11.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:10 smithi032 ceph-mon[27179]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:11.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:10 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1473641998' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:24:11.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:10 smithi154 ceph-mon[32880]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-06T21:24:11.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:10 smithi154 ceph-mon[32880]: Cluster is now healthy 2024-05-06T21:24:11.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:10 smithi154 ceph-mon[32880]: mds.? [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] up:active 2024-05-06T21:24:11.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:10 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:24:11.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-05-06T21:24:12.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:11 smithi032 ceph-mon[27179]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-06T21:24:12.283 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:12.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:11 smithi154 ceph-mon[32880]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-06T21:24:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:24:13.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:12 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:24:13.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.978+0000 7f7cde451700 1 -- 172.21.15.32:0/4096572526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd80ff3d0 msgr2=0x7f7cd80ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:13.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.978+0000 7f7cde451700 1 --2- 172.21.15.32:0/4096572526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd80ff3d0 0x7f7cd80ff840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009910 tx=0x7f7ccc009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.978+0000 7f7cde451700 1 -- 172.21.15.32:0/4096572526 shutdown_connections 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.978+0000 7f7cde451700 1 --2- 172.21.15.32:0/4096572526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd80ff3d0 0x7f7cd80ff840 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.978+0000 7f7cde451700 1 --2- 172.21.15.32:0/4096572526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd8100770 0x7f7cd8100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.978+0000 7f7cde451700 1 -- 172.21.15.32:0/4096572526 >> 172.21.15.32:0/4096572526 conn(0x7f7cd80f9e70 msgr2=0x7f7cd80fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.978+0000 7f7cde451700 1 -- 172.21.15.32:0/4096572526 shutdown_connections 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.978+0000 7f7cde451700 1 -- 172.21.15.32:0/4096572526 wait complete. 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cde451700 1 Processor -- start 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cde451700 1 -- start start 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cde451700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd80ff3d0 0x7f7cd8195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cde451700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd8100770 0x7f7cd8196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cde451700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8196670 con 0x7f7cd8100770 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cde451700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd81967b0 con 0x7f7cd80ff3d0 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cd77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd8100770 0x7f7cd8196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cd77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd8100770 0x7f7cd8196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40850/0 (socket says 172.21.15.32:40850) 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cd77fe700 1 -- 172.21.15.32:0/2821505714 learned_addr learned my addr 172.21.15.32:0/2821505714 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cd7fff700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd80ff3d0 0x7f7cd8195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cd77fe700 1 -- 172.21.15.32:0/2821505714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd80ff3d0 msgr2=0x7f7cd8195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cd77fe700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd80ff3d0 0x7f7cd8195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.979+0000 7f7cd77fe700 1 -- 172.21.15.32:0/2821505714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc0095f0 con 0x7f7cd8100770 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.980+0000 7f7cd77fe700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd8100770 0x7f7cd8196050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc006010 tx=0x7f7ccc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.980+0000 7f7cd57fa700 1 -- 172.21.15.32:0/2821505714 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ccc01d070 con 0x7f7cd8100770 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.980+0000 7f7cd57fa700 1 -- 172.21.15.32:0/2821505714 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ccc00f460 con 0x7f7cd8100770 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.980+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd819b200 con 0x7f7cd8100770 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.980+0000 7f7cd57fa700 1 -- 172.21.15.32:0/2821505714 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ccc017630 con 0x7f7cd8100770 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.980+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd819b6f0 con 0x7f7cd8100770 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.981+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd8107cc0 con 0x7f7cd8100770 2024-05-06T21:24:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.981+0000 7f7cd57fa700 1 -- 172.21.15.32:0/2821505714 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7ccc00f5d0 con 0x7f7cd8100770 2024-05-06T21:24:13.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.982+0000 7f7cd57fa700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:13.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.982+0000 7f7cd57fa700 1 -- 172.21.15.32:0/2821505714 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7ccc08cc60 con 0x7f7cd8100770 2024-05-06T21:24:13.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.982+0000 7f7cd7fff700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:13.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.982+0000 7f7cd7fff700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8068c10 tx=0x7f7cc800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:13.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:13.986+0000 7f7cd57fa700 1 -- 172.21.15.32:0/2821505714 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7ccc05adf0 con 0x7f7cd8100770 2024-05-06T21:24:14.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:13 smithi154 ceph-mon[32880]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-06T21:24:14.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:13 smithi032 ceph-mon[27179]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-05-06T21:24:14.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.242+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cd8107e80 con 0x7f7cd8100770 2024-05-06T21:24:14.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.242+0000 7f7cd57fa700 1 -- 172.21.15.32:0/2821505714 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f7ccc05a980 con 0x7f7cd8100770 2024-05-06T21:24:14.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.244+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 msgr2=0x7f7cc006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:14.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.244+0000 7f7cde451700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8068c10 tx=0x7f7cc800b410 comp rx=0 tx=0).stop 2024-05-06T21:24:14.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.244+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd8100770 msgr2=0x7f7cd8196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:14.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.244+0000 7f7cde451700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd8100770 0x7f7cd8196050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc006010 tx=0x7f7ccc00bd70 comp rx=0 tx=0).stop 2024-05-06T21:24:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.245+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 shutdown_connections 2024-05-06T21:24:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.245+0000 7f7cde451700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.245+0000 7f7cde451700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd80ff3d0 0x7f7cd8195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.245+0000 7f7cde451700 1 --2- 172.21.15.32:0/2821505714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd8100770 0x7f7cd8196050 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.245+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 >> 172.21.15.32:0/2821505714 conn(0x7f7cd80f9e70 msgr2=0x7f7cd80fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.245+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 shutdown_connections 2024-05-06T21:24:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:14.245+0000 7f7cde451700 1 -- 172.21.15.32:0/2821505714 wait complete. 2024-05-06T21:24:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-05-06T21:24:14.259 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:24:14.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-05-06T21:24:15.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:15 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:15.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:15 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:15.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:15 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:15.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:15 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:24:15.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:15 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:15.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:15 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:24:15.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:15 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2821505714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T21:24:15.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:15 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:15.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:15 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:15.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:15 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:15.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:15 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:24:15.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:15 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:15.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:15 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:24:15.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:15 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2821505714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T21:24:15.419 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:16.184 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:16 smithi032 ceph-mon[27179]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-06T21:24:16.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:16 smithi154 ceph-mon[32880]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-06T21:24:17.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.336+0000 7f3dfb37a700 1 -- 172.21.15.32:0/3997651689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4101440 msgr2=0x7f3df4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:17.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.336+0000 7f3dfb37a700 1 --2- 172.21.15.32:0/3997651689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4101440 0x7f3df4101890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009910 tx=0x7f3df0009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:17.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.336+0000 7f3dfb37a700 1 -- 172.21.15.32:0/3997651689 shutdown_connections 2024-05-06T21:24:17.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.336+0000 7f3dfb37a700 1 --2- 172.21.15.32:0/3997651689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4101440 0x7f3df4101890 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:17.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.336+0000 7f3dfb37a700 1 --2- 172.21.15.32:0/3997651689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3df4100240 0x7f3df4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:17.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.336+0000 7f3dfb37a700 1 -- 172.21.15.32:0/3997651689 >> 172.21.15.32:0/3997651689 conn(0x7f3df40fb7f0 msgr2=0x7f3df40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:17.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.336+0000 7f3dfb37a700 1 -- 172.21.15.32:0/3997651689 shutdown_connections 2024-05-06T21:24:17.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3dfb37a700 1 -- 172.21.15.32:0/3997651689 wait complete. 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3dfb37a700 1 Processor -- start 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3dfb37a700 1 -- start start 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3dfb37a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4100240 0x7f3df4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3dfb37a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3df4101440 0x7f3df4073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3dfb37a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4073680 con 0x7f3df4100240 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3dfb37a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40737c0 con 0x7f3df4101440 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3df9116700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4100240 0x7f3df4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3df9116700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4100240 0x7f3df4074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40860/0 (socket says 172.21.15.32:40860) 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.337+0000 7f3df9116700 1 -- 172.21.15.32:0/908600122 learned_addr learned my addr 172.21.15.32:0/908600122 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3df8915700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3df4101440 0x7f3df4073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3df9116700 1 -- 172.21.15.32:0/908600122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3df4101440 msgr2=0x7f3df4073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3df9116700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3df4101440 0x7f3df4073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3df9116700 1 -- 172.21.15.32:0/908600122 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00095f0 con 0x7f3df4100240 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3df9116700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4100240 0x7f3df4074af0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3de800d900 tx=0x7f3de800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3de67fc700 1 -- 172.21.15.32:0/908600122 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de8009900 con 0x7f3df4100240 2024-05-06T21:24:17.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3de67fc700 1 -- 172.21.15.32:0/908600122 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3de8010460 con 0x7f3df4100240 2024-05-06T21:24:17.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df4073aa0 con 0x7f3df4100240 2024-05-06T21:24:17.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3de67fc700 1 -- 172.21.15.32:0/908600122 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de800f5b0 con 0x7f3df4100240 2024-05-06T21:24:17.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.338+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df419db30 con 0x7f3df4100240 2024-05-06T21:24:17.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.339+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df4108db0 con 0x7f3df4100240 2024-05-06T21:24:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.340+0000 7f3de67fc700 1 -- 172.21.15.32:0/908600122 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3de80105d0 con 0x7f3df4100240 2024-05-06T21:24:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.340+0000 7f3de67fc700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3de006c680 0x7f3de006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.340+0000 7f3de67fc700 1 -- 172.21.15.32:0/908600122 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3de808b760 con 0x7f3df4100240 2024-05-06T21:24:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.340+0000 7f3df8915700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3de006c680 0x7f3de006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:17.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.341+0000 7f3df8915700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3de006c680 0x7f3de006eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3df0005b40 tx=0x7f3df0005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.345+0000 7f3de67fc700 1 -- 172.21.15.32:0/908600122 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3de8059870 con 0x7f3df4100240 2024-05-06T21:24:17.406 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:17 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:17.406 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:17 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:17.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:17 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:17.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:17 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:17.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.642+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f3df419e2f0 con 0x7f3df4100240 2024-05-06T21:24:17.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.643+0000 7f3de67fc700 1 -- 172.21.15.32:0/908600122 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+83 (secure 0 0 0) 0x7f3de8059400 con 0x7f3df4100240 2024-05-06T21:24:17.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.645+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3de006c680 msgr2=0x7f3de006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:17.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.645+0000 7f3dfb37a700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3de006c680 0x7f3de006eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3df0005b40 tx=0x7f3df0005a90 comp rx=0 tx=0).stop 2024-05-06T21:24:17.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.645+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4100240 msgr2=0x7f3df4074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.645+0000 7f3dfb37a700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4100240 0x7f3df4074af0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3de800d900 tx=0x7f3de800dcc0 comp rx=0 tx=0).stop 2024-05-06T21:24:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.645+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 shutdown_connections 2024-05-06T21:24:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.645+0000 7f3dfb37a700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f3de006c680 0x7f3de006eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.645+0000 7f3dfb37a700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df4100240 0x7f3df4074af0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.645+0000 7f3dfb37a700 1 --2- 172.21.15.32:0/908600122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3df4101440 0x7f3df4073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.645+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 >> 172.21.15.32:0/908600122 conn(0x7f3df40fb7f0 msgr2=0x7f3df4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.646+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 shutdown_connections 2024-05-06T21:24:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:17.646+0000 7f3dfb37a700 1 -- 172.21.15.32:0/908600122 wait complete. 2024-05-06T21:24:17.660 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:24:18.356 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:18 smithi032 ceph-mon[27179]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-06T21:24:18.357 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:18 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/908600122' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-06T21:24:18.381 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-05-06T21:24:18.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-06T21:24:18.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 -- 172.21.15.32:0/3090443849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300fe550 msgr2=0x7f06300fe960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:18.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 --2- 172.21.15.32:0/3090443849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300fe550 0x7f06300fe960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0620009880 tx=0x7f062002bce0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 -- 172.21.15.32:0/3090443849 shutdown_connections 2024-05-06T21:24:18.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 --2- 172.21.15.32:0/3090443849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06300ff740 0x7f06300ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 --2- 172.21.15.32:0/3090443849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300fe550 0x7f06300fe960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 -- 172.21.15.32:0/3090443849 >> 172.21.15.32:0/3090443849 conn(0x7f06300f9a90 msgr2=0x7f06300fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:18.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 -- 172.21.15.32:0/3090443849 shutdown_connections 2024-05-06T21:24:18.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 -- 172.21.15.32:0/3090443849 wait complete. 2024-05-06T21:24:18.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 Processor -- start 2024-05-06T21:24:18.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.527+0000 7f06361d0640 1 -- start start 2024-05-06T21:24:18.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f06361d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06300fe550 0x7f0630194eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:18.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f06361d0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300ff740 0x7f06301953f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:18.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f06361d0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06301959c0 con 0x7f06300ff740 2024-05-06T21:24:18.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f06361d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630195b30 con 0x7f06300fe550 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f0626ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300ff740 0x7f06301953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f0626ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300ff740 0x7f06301953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40886/0 (socket says 172.21.15.32:40886) 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f0626ffd640 1 -- 172.21.15.32:0/3462941129 learned_addr learned my addr 172.21.15.32:0/3462941129 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f062f7fe640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06300fe550 0x7f0630194eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f0626ffd640 1 -- 172.21.15.32:0/3462941129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06300fe550 msgr2=0x7f0630194eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f0626ffd640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06300fe550 0x7f0630194eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f0626ffd640 1 -- 172.21.15.32:0/3462941129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620009560 con 0x7f06300ff740 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.528+0000 7f0626ffd640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300ff740 0x7f06301953f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f061800d8d0 tx=0x7f061800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.529+0000 7f062d7fa640 1 -- 172.21.15.32:0/3462941129 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0618009c00 con 0x7f06300ff740 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.529+0000 7f062d7fa640 1 -- 172.21.15.32:0/3462941129 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06180044d0 con 0x7f06300ff740 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.529+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063019a5c0 con 0x7f06300ff740 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.529+0000 7f062d7fa640 1 -- 172.21.15.32:0/3462941129 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06180049d0 con 0x7f06300ff740 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.529+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063019ab20 con 0x7f06300ff740 2024-05-06T21:24:18.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.530+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0630107260 con 0x7f06300ff740 2024-05-06T21:24:18.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.530+0000 7f062d7fa640 1 -- 172.21.15.32:0/3462941129 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0618004020 con 0x7f06300ff740 2024-05-06T21:24:18.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.531+0000 7f062d7fa640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f061c06c6b0 0x7f061c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:18.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.531+0000 7f062d7fa640 1 -- 172.21.15.32:0/3462941129 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f061808b630 con 0x7f06300ff740 2024-05-06T21:24:18.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.531+0000 7f062f7fe640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f061c06c6b0 0x7f061c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:18.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.531+0000 7f062f7fe640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f061c06c6b0 0x7f061c06eb60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0620000c00 tx=0x7f0620005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:18.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.535+0000 7f062d7fa640 1 -- 172.21.15.32:0/3462941129 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0618055c10 con 0x7f06300ff740 2024-05-06T21:24:18.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:18 smithi154 ceph-mon[32880]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-06T21:24:18.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:18 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/908600122' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-06T21:24:18.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.712+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f063019ada0 con 0x7f06300ff740 2024-05-06T21:24:18.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.714+0000 7f062d7fa640 1 -- 172.21.15.32:0/3462941129 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15118 (secure 0 0 0) 0x7f0618059230 con 0x7f06300ff740 2024-05-06T21:24:18.717 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:18.718 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":47,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","created":"2024-05-06T21:16:43.886575+0000","modified":"2024-05-06T21:24:06.865397+0000","last_up_change":"2024-05-06T21:22:30.280541+0000","last_in_change":"2024-05-06T21:22:10.894148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T21:21:16.105413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-05-06T21:23:49.127155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-05-06T21:23:49.617433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0095c3fd-9b90-4d23-b192-98fd9a06c20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6803","nonce":1973178361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6805","nonce":1973178361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6809","nonce":1973178361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1973178361},{"type":"v1","addr":"172.21.15.32:6807","nonce":1973178361}]},"public_addr":"172.21.15.32:6803/1973178361","cluster_addr":"172.21.15.32:6805/1973178361","heartbeat_back_addr":"172.21.15.32:6809/1973178361","heartbeat_front_addr":"172.21.15.32:6807/1973178361","state":["exists","up"]},{"osd":1,"uuid":"0d37de85-e43f-4094-ba6a-00a09047798a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6811","nonce":3464551315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6813","nonce":3464551315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6817","nonce":3464551315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3464551315},{"type":"v1","addr":"172.21.15.32:6815","nonce":3464551315}]},"public_addr":"172.21.15.32:6811/3464551315","cluster_addr":"172.21.15.32:6813/3464551315","heartbeat_back_addr":"172.21.15.32:6817/3464551315","heartbeat_front_addr":"172.21.15.32:6815/3464551315","state":["exists","up"]},{"osd":2,"uuid":"e41022aa-de8c-45d9-aa0e-a1918b23fb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6819","nonce":317848821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6821","nonce":317848821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6825","nonce":317848821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":317848821},{"type":"v1","addr":"172.21.15.32:6823","nonce":317848821}]},"public_addr":"172.21.15.32:6819/317848821","cluster_addr":"172.21.15.32:6821/317848821","heartbeat_back_addr":"172.21.15.32:6825/317848821","heartbeat_front_addr":"172.21.15.32:6823/317848821","state":["exists","up"]},{"osd":3,"uuid":"11e127c4-f415-4261-9584-b53b7bfa8b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6801","nonce":2326216039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6803","nonce":2326216039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6807","nonce":2326216039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2326216039},{"type":"v1","addr":"172.21.15.154:6805","nonce":2326216039}]},"public_addr":"172.21.15.154:6801/2326216039","cluster_addr":"172.21.15.154:6803/2326216039","heartbeat_back_addr":"172.21.15.154:6807/2326216039","heartbeat_front_addr":"172.21.15.154:6805/2326216039","state":["exists","up"]},{"osd":4,"uuid":"190cd663-20cb-49b3-84b0-345f665e068e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6809","nonce":662519611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6811","nonce":662519611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6815","nonce":662519611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":662519611},{"type":"v1","addr":"172.21.15.154:6813","nonce":662519611}]},"public_addr":"172.21.15.154:6809/662519611","cluster_addr":"172.21.15.154:6811/662519611","heartbeat_back_addr":"172.21.15.154:6815/662519611","heartbeat_front_addr":"172.21.15.154:6813/662519611","state":["exists","up"]},{"osd":5,"uuid":"7655488e-f7b9-4902-b6d3-28f762d44a2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6817","nonce":1788446264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6819","nonce":1788446264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6823","nonce":1788446264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1788446264},{"type":"v1","addr":"172.21.15.154:6821","nonce":1788446264}]},"public_addr":"172.21.15.154:6817/1788446264","cluster_addr":"172.21.15.154:6819/1788446264","heartbeat_back_addr":"172.21.15.154:6823/1788446264","heartbeat_front_addr":"172.21.15.154:6821/1788446264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:14.221856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:43.419480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:12.732797+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:36.574751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:02.167660+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:28.497477+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:6827/403692088":"2024-05-07T21:24:06.865368+0000","172.21.15.32:0/2104181876":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6801/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6800/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/1406133666":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6801/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1230396006":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/2077354807":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/2720610700":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1223764907":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6826/403692088":"2024-05-07T21:24:06.865368+0000","172.21.15.32:6800/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6801/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/3998200556":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/1723093349":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/2913247857":"2024-05-07T21:18:57.579578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T21:24:18.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.716+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f061c06c6b0 msgr2=0x7f061c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:18.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.716+0000 7f06361d0640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f061c06c6b0 0x7f061c06eb60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0620000c00 tx=0x7f0620005fd0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.716+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300ff740 msgr2=0x7f06301953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:18.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.716+0000 7f06361d0640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300ff740 0x7f06301953f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f061800d8d0 tx=0x7f061800dd90 comp rx=0 tx=0).stop 2024-05-06T21:24:18.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.716+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 shutdown_connections 2024-05-06T21:24:18.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.716+0000 7f06361d0640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f061c06c6b0 0x7f061c06eb60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.716+0000 7f06361d0640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06300ff740 0x7f06301953f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.716+0000 7f06361d0640 1 --2- 172.21.15.32:0/3462941129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06300fe550 0x7f0630194eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.717+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 >> 172.21.15.32:0/3462941129 conn(0x7f06300f9a90 msgr2=0x7f0630067310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:18.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.717+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 shutdown_connections 2024-05-06T21:24:18.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.717+0000 7f06361d0640 1 -- 172.21.15.32:0/3462941129 wait complete. 2024-05-06T21:24:18.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-06T21:21:16.105413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-05-06T21:23:49.127155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-05-06T21:23:49.617433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-06T21:24:18.735 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-06T21:24:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.849+0000 7f68cacaf640 1 -- 172.21.15.32:0/1903443590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 msgr2=0x7f68c40fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.849+0000 7f68cacaf640 1 --2- 172.21.15.32:0/1903443590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 0x7f68c40fe100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009880 tx=0x7f68b802bce0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 -- 172.21.15.32:0/1903443590 shutdown_connections 2024-05-06T21:24:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 --2- 172.21.15.32:0/1903443590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40fef80 0x7f68c40ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 --2- 172.21.15.32:0/1903443590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 0x7f68c40fe100 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 -- 172.21.15.32:0/1903443590 >> 172.21.15.32:0/1903443590 conn(0x7f68c40f9310 msgr2=0x7f68c40fb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 -- 172.21.15.32:0/1903443590 shutdown_connections 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 -- 172.21.15.32:0/1903443590 wait complete. 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 Processor -- start 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 -- start start 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 0x7f68c4194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40fef80 0x7f68c41954b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4195a80 con 0x7f68c40fdcf0 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68cacaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4195bf0 con 0x7f68c40fef80 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68c8a4b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 0x7f68c4194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.850+0000 7f68c8a4b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 0x7f68c4194f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40908/0 (socket says 172.21.15.32:40908) 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68c8a4b640 1 -- 172.21.15.32:0/3368089292 learned_addr learned my addr 172.21.15.32:0/3368089292 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68c3fff640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40fef80 0x7f68c41954b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68c8a4b640 1 -- 172.21.15.32:0/3368089292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40fef80 msgr2=0x7f68c41954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68c8a4b640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40fef80 0x7f68c41954b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:18.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68c8a4b640 1 -- 172.21.15.32:0/3368089292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8009560 con 0x7f68c40fdcf0 2024-05-06T21:24:18.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68c8a4b640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 0x7f68c4194f70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009230 tx=0x7f68b802cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:18.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68c1ffb640 1 -- 172.21.15.32:0/3368089292 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68b8004420 con 0x7f68c40fdcf0 2024-05-06T21:24:18.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c419a620 con 0x7f68c40fdcf0 2024-05-06T21:24:18.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68c1ffb640 1 -- 172.21.15.32:0/3368089292 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f68b80054b0 con 0x7f68c40fdcf0 2024-05-06T21:24:18.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68c1ffb640 1 -- 172.21.15.32:0/3368089292 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68b8034440 con 0x7f68c40fdcf0 2024-05-06T21:24:18.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.851+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c419ab20 con 0x7f68c40fdcf0 2024-05-06T21:24:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.853+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c4106150 con 0x7f68c40fdcf0 2024-05-06T21:24:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.853+0000 7f68c1ffb640 1 -- 172.21.15.32:0/3368089292 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f68b80037d0 con 0x7f68c40fdcf0 2024-05-06T21:24:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.853+0000 7f68c1ffb640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f68b406c5f0 0x7f68b406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.853+0000 7f68c3fff640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f68b406c5f0 0x7f68b406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.853+0000 7f68c1ffb640 1 -- 172.21.15.32:0/3368089292 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f68b80add30 con 0x7f68c40fdcf0 2024-05-06T21:24:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.854+0000 7f68c3fff640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f68b406c5f0 0x7f68b406eaa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68c4196480 tx=0x7f68b0010040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:18.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:18.858+0000 7f68c1ffb640 1 -- 172.21.15.32:0/3368089292 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f68b8078460 con 0x7f68c40fdcf0 2024-05-06T21:24:19.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.035+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68c419ae00 con 0x7f68c40fdcf0 2024-05-06T21:24:19.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.035+0000 7f68c1ffb640 1 -- 172.21.15.32:0/3368089292 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68b804b020 con 0x7f68c40fdcf0 2024-05-06T21:24:19.039 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-05-06T21:24:19.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.037+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f68b406c5f0 msgr2=0x7f68b406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.037+0000 7f68cacaf640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f68b406c5f0 0x7f68b406eaa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68c4196480 tx=0x7f68b0010040 comp rx=0 tx=0).stop 2024-05-06T21:24:19.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.037+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 msgr2=0x7f68c4194f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.037+0000 7f68cacaf640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 0x7f68c4194f70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009230 tx=0x7f68b802cec0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.038+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 shutdown_connections 2024-05-06T21:24:19.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.038+0000 7f68cacaf640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40fef80 0x7f68c41954b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.038+0000 7f68cacaf640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f68b406c5f0 0x7f68b406eaa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.038+0000 7f68cacaf640 1 --2- 172.21.15.32:0/3368089292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c40fdcf0 0x7f68c4194f70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.038+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 >> 172.21.15.32:0/3368089292 conn(0x7f68c40f9310 msgr2=0x7f68c41021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:19.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.038+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 shutdown_connections 2024-05-06T21:24:19.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.038+0000 7f68cacaf640 1 -- 172.21.15.32:0/3368089292 wait complete. 2024-05-06T21:24:19.052 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-05-06T21:24:19.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 -- 172.21.15.32:0/1037503816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0ff730 msgr2=0x7f0b1c0ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 --2- 172.21.15.32:0/1037503816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0ff730 0x7f0b1c0ffba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009880 tx=0x7f0b1002bce0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 -- 172.21.15.32:0/1037503816 shutdown_connections 2024-05-06T21:24:19.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 --2- 172.21.15.32:0/1037503816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0ff730 0x7f0b1c0ffba0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 --2- 172.21.15.32:0/1037503816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b1c0fe540 0x7f0b1c0fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 -- 172.21.15.32:0/1037503816 >> 172.21.15.32:0/1037503816 conn(0x7f0b1c0f9a80 msgr2=0x7f0b1c0fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:19.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 -- 172.21.15.32:0/1037503816 shutdown_connections 2024-05-06T21:24:19.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 -- 172.21.15.32:0/1037503816 wait complete. 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 Processor -- start 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.157+0000 7f0b20d63640 1 -- start start 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b20d63640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0fe540 0x7f0b1c194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b20d63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b1c0ff730 0x7f0b1c1954d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b20d63640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c195aa0 con 0x7f0b1c0fe540 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b20d63640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c195c10 con 0x7f0b1c0ff730 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b1a59c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0fe540 0x7f0b1c194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b1a59c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0fe540 0x7f0b1c194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40924/0 (socket says 172.21.15.32:40924) 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b1a59c640 1 -- 172.21.15.32:0/1695157147 learned_addr learned my addr 172.21.15.32:0/1695157147 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b19d9b640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b1c0ff730 0x7f0b1c1954d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:19.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b1a59c640 1 -- 172.21.15.32:0/1695157147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b1c0ff730 msgr2=0x7f0b1c1954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b1a59c640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b1c0ff730 0x7f0b1c1954d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b1a59c640 1 -- 172.21.15.32:0/1695157147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10009560 con 0x7f0b1c0fe540 2024-05-06T21:24:19.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b1a59c640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0fe540 0x7f0b1c194f90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c8f0 tx=0x7f0b0c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:19.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.158+0000 7f0b0b7fe640 1 -- 172.21.15.32:0/1695157147 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c007b80 con 0x7f0b1c0fe540 2024-05-06T21:24:19.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.159+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c19a6a0 con 0x7f0b1c0fe540 2024-05-06T21:24:19.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.159+0000 7f0b0b7fe640 1 -- 172.21.15.32:0/1695157147 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0b0c007ce0 con 0x7f0b1c0fe540 2024-05-06T21:24:19.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.159+0000 7f0b0b7fe640 1 -- 172.21.15.32:0/1695157147 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c0187d0 con 0x7f0b1c0fe540 2024-05-06T21:24:19.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.159+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c19ac00 con 0x7f0b1c0fe540 2024-05-06T21:24:19.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.160+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c107260 con 0x7f0b1c0fe540 2024-05-06T21:24:19.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.160+0000 7f0b0b7fe640 1 -- 172.21.15.32:0/1695157147 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0b0c018a40 con 0x7f0b1c0fe540 2024-05-06T21:24:19.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.161+0000 7f0b0b7fe640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0b0406c5f0 0x7f0b0406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:19.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.161+0000 7f0b0b7fe640 1 -- 172.21.15.32:0/1695157147 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0b0c08ba10 con 0x7f0b1c0fe540 2024-05-06T21:24:19.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.161+0000 7f0b19d9b640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0b0406c5f0 0x7f0b0406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:19.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.161+0000 7f0b19d9b640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0b0406c5f0 0x7f0b0406eaa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c1964a0 tx=0x7f0b10000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:19.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.165+0000 7f0b0b7fe640 1 -- 172.21.15.32:0/1695157147 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0b0c056090 con 0x7f0b1c0fe540 2024-05-06T21:24:19.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.341+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f0b1c19b0e0 con 0x7f0b1c0fe540 2024-05-06T21:24:19.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.341+0000 7f0b0b7fe640 1 -- 172.21.15.32:0/1695157147 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0b0c0596b0 con 0x7f0b1c0fe540 2024-05-06T21:24:19.345 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0b0406c5f0 msgr2=0x7f0b0406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0b0406c5f0 0x7f0b0406eaa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c1964a0 tx=0x7f0b10000bc0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0fe540 msgr2=0x7f0b1c194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0fe540 0x7f0b1c194f90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c8f0 tx=0x7f0b0c00cdb0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 shutdown_connections 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b1c0ff730 0x7f0b1c1954d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0b0406c5f0 0x7f0b0406eaa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 --2- 172.21.15.32:0/1695157147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b1c0fe540 0x7f0b1c194f90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 >> 172.21.15.32:0/1695157147 conn(0x7f0b1c0f9a80 msgr2=0x7f0b1c067310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 shutdown_connections 2024-05-06T21:24:19.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.343+0000 7f0b20d63640 1 -- 172.21.15.32:0/1695157147 wait complete. 2024-05-06T21:24:19.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-05-06T21:24:19.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.461+0000 7f021b436640 1 -- 172.21.15.32:0/3614470661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 msgr2=0x7f0214104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.461+0000 7f021b436640 1 --2- 172.21.15.32:0/3614470661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 0x7f0214104e80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0204009880 tx=0x7f020402bce0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.461+0000 7f021b436640 1 -- 172.21.15.32:0/3614470661 shutdown_connections 2024-05-06T21:24:19.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.461+0000 7f021b436640 1 --2- 172.21.15.32:0/3614470661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 0x7f0214104e80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.461+0000 7f021b436640 1 --2- 172.21.15.32:0/3614470661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0214100180 0x7f0214102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.461+0000 7f021b436640 1 -- 172.21.15.32:0/3614470661 >> 172.21.15.32:0/3614470661 conn(0x7f02140f9ac0 msgr2=0x7f02140fbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:19.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.461+0000 7f021b436640 1 -- 172.21.15.32:0/3614470661 shutdown_connections 2024-05-06T21:24:19.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.461+0000 7f021b436640 1 -- 172.21.15.32:0/3614470661 wait complete. 2024-05-06T21:24:19.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.462+0000 7f021b436640 1 Processor -- start 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.462+0000 7f021b436640 1 -- start start 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.462+0000 7f021b436640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0214100180 0x7f0214194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.462+0000 7f021b436640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 0x7f02141954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.462+0000 7f021b436640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0214195ab0 con 0x7f0214102aa0 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.462+0000 7f021b436640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0214195c20 con 0x7f0214100180 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.462+0000 7f02189d1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 0x7f02141954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.462+0000 7f02189d1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 0x7f02141954e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40938/0 (socket says 172.21.15.32:40938) 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.462+0000 7f02189d1640 1 -- 172.21.15.32:0/2223332528 learned_addr learned my addr 172.21.15.32:0/2223332528 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f02191d2640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0214100180 0x7f0214194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f02189d1640 1 -- 172.21.15.32:0/2223332528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0214100180 msgr2=0x7f0214194fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f02189d1640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0214100180 0x7f0214194fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f02189d1640 1 -- 172.21.15.32:0/2223332528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204009560 con 0x7f0214102aa0 2024-05-06T21:24:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f02189d1640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 0x7f02141954e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0204009230 tx=0x7f0204004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:19.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f020a7fc640 1 -- 172.21.15.32:0/2223332528 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0204005000 con 0x7f0214102aa0 2024-05-06T21:24:19.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f020a7fc640 1 -- 172.21.15.32:0/2223332528 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0204005610 con 0x7f0214102aa0 2024-05-06T21:24:19.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021419a650 con 0x7f0214102aa0 2024-05-06T21:24:19.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f020a7fc640 1 -- 172.21.15.32:0/2223332528 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0204034440 con 0x7f0214102aa0 2024-05-06T21:24:19.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.463+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021419ab50 con 0x7f0214102aa0 2024-05-06T21:24:19.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.464+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021418f080 con 0x7f0214102aa0 2024-05-06T21:24:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.465+0000 7f020a7fc640 1 -- 172.21.15.32:0/2223332528 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0204003880 con 0x7f0214102aa0 2024-05-06T21:24:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.465+0000 7f020a7fc640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f020006c5f0 0x7f020006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.465+0000 7f020a7fc640 1 -- 172.21.15.32:0/2223332528 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f02040ade40 con 0x7f0214102aa0 2024-05-06T21:24:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.465+0000 7f02191d2640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f020006c5f0 0x7f020006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.466+0000 7f02191d2640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f020006c5f0 0x7f020006eaa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0210005fd0 tx=0x7f021000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:19.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.470+0000 7f020a7fc640 1 -- 172.21.15.32:0/2223332528 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f02040784d0 con 0x7f0214102aa0 2024-05-06T21:24:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:19 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3462941129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:24:19.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:19 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3368089292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:24:19.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.659+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f0214108310 con 0x7f0214102aa0 2024-05-06T21:24:19.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.659+0000 7f020a7fc640 1 -- 172.21.15.32:0/2223332528 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f020404b020 con 0x7f0214102aa0 2024-05-06T21:24:19.663 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f020006c5f0 msgr2=0x7f020006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f020006c5f0 0x7f020006eaa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0210005fd0 tx=0x7f021000b390 comp rx=0 tx=0).stop 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 msgr2=0x7f02141954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 0x7f02141954e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0204009230 tx=0x7f0204004e30 comp rx=0 tx=0).stop 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 shutdown_connections 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f020006c5f0 0x7f020006eaa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0214102aa0 0x7f02141954e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 --2- 172.21.15.32:0/2223332528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0214100180 0x7f0214194fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 >> 172.21.15.32:0/2223332528 conn(0x7f02140f9ac0 msgr2=0x7f02140fbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:19.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 shutdown_connections 2024-05-06T21:24:19.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.661+0000 7f021b436640 1 -- 172.21.15.32:0/2223332528 wait complete. 2024-05-06T21:24:19.674 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:19 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3462941129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:24:19.674 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:19 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3368089292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:24:19.676 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-06T21:24:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 -- 172.21.15.32:0/2390561346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308100130 msgr2=0x7fb308102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 --2- 172.21.15.32:0/2390561346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308100130 0x7fb308102510 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009c20 tx=0x7fb2f802c1b0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 -- 172.21.15.32:0/2390561346 shutdown_connections 2024-05-06T21:24:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 --2- 172.21.15.32:0/2390561346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb308102a50 0x7fb308104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 --2- 172.21.15.32:0/2390561346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308100130 0x7fb308102510 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 -- 172.21.15.32:0/2390561346 >> 172.21.15.32:0/2390561346 conn(0x7fb3080f9a90 msgr2=0x7fb3080fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 -- 172.21.15.32:0/2390561346 shutdown_connections 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 -- 172.21.15.32:0/2390561346 wait complete. 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 Processor -- start 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.780+0000 7fb310236640 1 -- start start 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb310236640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb308100130 0x7fb3080ffaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb310236640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308102a50 0x7fb3080fe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb310236640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080fe620 con 0x7fb308102a50 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb310236640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080fe790 con 0x7fb308100130 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb30d7d1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308102a50 0x7fb3080fe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb30d7d1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308102a50 0x7fb3080fe0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40958/0 (socket says 172.21.15.32:40958) 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb30d7d1640 1 -- 172.21.15.32:0/3205866240 learned_addr learned my addr 172.21.15.32:0/3205866240 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb30dfd2640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb308100130 0x7fb3080ffaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb30d7d1640 1 -- 172.21.15.32:0/3205866240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb308100130 msgr2=0x7fb3080ffaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb30d7d1640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb308100130 0x7fb3080ffaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb30d7d1640 1 -- 172.21.15.32:0/3205866240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009900 con 0x7fb308102a50 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb30dfd2640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb308100130 0x7fb3080ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb30d7d1640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308102a50 0x7fb3080fe0e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00d6c0 tx=0x7fb2fc00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb306ffd640 1 -- 172.21.15.32:0/3205866240 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2fc0051f0 con 0x7fb308102a50 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.781+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3080fea70 con 0x7fb308102a50 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.782+0000 7fb306ffd640 1 -- 172.21.15.32:0/3205866240 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb2fc009cd0 con 0x7fb308102a50 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.782+0000 7fb306ffd640 1 -- 172.21.15.32:0/3205866240 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2fc004e40 con 0x7fb308102a50 2024-05-06T21:24:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.782+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30819cec0 con 0x7fb308102a50 2024-05-06T21:24:19.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.783+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30818f040 con 0x7fb308102a50 2024-05-06T21:24:19.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.783+0000 7fb306ffd640 1 -- 172.21.15.32:0/3205866240 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb2fc010460 con 0x7fb308102a50 2024-05-06T21:24:19.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.784+0000 7fb306ffd640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb2f006c650 0x7fb2f006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:19.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.784+0000 7fb306ffd640 1 -- 172.21.15.32:0/3205866240 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb2fc08b410 con 0x7fb308102a50 2024-05-06T21:24:19.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.784+0000 7fb30dfd2640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb2f006c650 0x7fb2f006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:19.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.784+0000 7fb30dfd2640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb2f006c650 0x7fb2f006eb00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8006010 tx=0x7fb2f8009890 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:19.792+0000 7fb306ffd640 1 -- 172.21.15.32:0/3205866240 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb2fc055b70 con 0x7fb308102a50 2024-05-06T21:24:20.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.011+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb30802c450 con 0x7fb308102a50 2024-05-06T21:24:20.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.012+0000 7fb306ffd640 1 -- 172.21.15.32:0/3205866240 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4757 (secure 0 0 0) 0x7fb2fc059190 con 0x7fb308102a50 2024-05-06T21:24:20.015 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:20.016 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:24:10.874189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14486,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi154.rizdbu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6825/345804530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":345804530},{"type":"v1","addr":"172.21.15.154:6825","nonce":345804530}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-06T21:24:20.016 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-05-06T21:24:20.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb2f006c650 msgr2=0x7fb2f006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb2f006c650 0x7fb2f006eb00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8006010 tx=0x7fb2f8009890 comp rx=0 tx=0).stop 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308102a50 msgr2=0x7fb3080fe0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308102a50 0x7fb3080fe0e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00d6c0 tx=0x7fb2fc00db80 comp rx=0 tx=0).stop 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 shutdown_connections 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fb2f006c650 0x7fb2f006eb00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb308102a50 0x7fb3080fe0e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 --2- 172.21.15.32:0/3205866240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb308100130 0x7fb3080ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 >> 172.21.15.32:0/3205866240 conn(0x7fb3080f9a90 msgr2=0x7fb3080fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 shutdown_connections 2024-05-06T21:24:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:20.014+0000 7fb310236640 1 -- 172.21.15.32:0/3205866240 wait complete. 2024-05-06T21:24:20.028 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-05-06T21:24:20.029 INFO:teuthology.run_tasks:Running task kclient... 2024-05-06T21:24:20.054 INFO:tasks.kclient:Mounting kernel clients... 2024-05-06T21:24:20.054 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-05-06T21:24:20.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:20.054 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-05-06T21:24:20.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:20.070 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-05-06T21:24:20.138 INFO:teuthology.orchestra.run.smithi032.stderr:Cannot find device "ceph-brx" 2024-05-06T21:24:20.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:24:20.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:20.140 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-05-06T21:24:20.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:20.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-05-06T21:24:20.235 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2024-05-06T21:24:20.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:24:20.236 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-06T21:24:20.237 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-06T21:24:20.237 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-06T21:24:20.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-06T21:24:20.570 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:20 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1695157147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-06T21:24:20.570 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:20 smithi032 ceph-mon[27179]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-06T21:24:20.570 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:20 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2223332528' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-06T21:24:20.570 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:20 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3205866240' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T21:24:20.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:20 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1695157147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-06T21:24:20.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:20 smithi154 ceph-mon[32880]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-06T21:24:20.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:20 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2223332528' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-06T21:24:20.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:20 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3205866240' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T21:24:21.129 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.808+0000 7fd60fcb1700 1 -- 172.21.15.32:0/3656985799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 msgr2=0x7fd6080689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.808+0000 7fd60fcb1700 1 --2- 172.21.15.32:0/3656985799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 0x7fd6080689b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009910 tx=0x7fd5f8009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.808+0000 7fd60fcb1700 1 -- 172.21.15.32:0/3656985799 shutdown_connections 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.808+0000 7fd60fcb1700 1 --2- 172.21.15.32:0/3656985799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 0x7fd6080689b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.808+0000 7fd60fcb1700 1 --2- 172.21.15.32:0/3656985799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd608106320 0x7fd6081066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.808+0000 7fd60fcb1700 1 -- 172.21.15.32:0/3656985799 >> 172.21.15.32:0/3656985799 conn(0x7fd608075130 msgr2=0x7fd608075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.808+0000 7fd60fcb1700 1 -- 172.21.15.32:0/3656985799 shutdown_connections 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.808+0000 7fd60fcb1700 1 -- 172.21.15.32:0/3656985799 wait complete. 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.809+0000 7fd60fcb1700 1 Processor -- start 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.809+0000 7fd60fcb1700 1 -- start start 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.809+0000 7fd60fcb1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 0x7fd6080ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.809+0000 7fd60fcb1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd608106320 0x7fd6081001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.809+0000 7fd60fcb1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608100720 con 0x7fd608068540 2024-05-06T21:24:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.809+0000 7fd60fcb1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608100890 con 0x7fd608106320 2024-05-06T21:24:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.809+0000 7fd60da4d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 0x7fd6080ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd60da4d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 0x7fd6080ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38218/0 (socket says 172.21.15.32:38218) 2024-05-06T21:24:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd60da4d700 1 -- 172.21.15.32:0/2419411881 learned_addr learned my addr 172.21.15.32:0/2419411881 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd60d24c700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd608106320 0x7fd6081001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd60da4d700 1 -- 172.21.15.32:0/2419411881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd608106320 msgr2=0x7fd6081001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd60da4d700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd608106320 0x7fd6081001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd60da4d700 1 -- 172.21.15.32:0/2419411881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f80095f0 con 0x7fd608068540 2024-05-06T21:24:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd60da4d700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 0x7fd6080ffca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd60400cfd0 tx=0x7fd60400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd5feffd700 1 -- 172.21.15.32:0/2419411881 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd60400ad70 con 0x7fd608068540 2024-05-06T21:24:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd608100b10 con 0x7fd608068540 2024-05-06T21:24:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd5feffd700 1 -- 172.21.15.32:0/2419411881 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd604007e70 con 0x7fd608068540 2024-05-06T21:24:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd5feffd700 1 -- 172.21.15.32:0/2419411881 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd604011810 con 0x7fd608068540 2024-05-06T21:24:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.810+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6081a2380 con 0x7fd608068540 2024-05-06T21:24:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.811+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd608108770 con 0x7fd608068540 2024-05-06T21:24:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.812+0000 7fd5feffd700 1 -- 172.21.15.32:0/2419411881 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd6040119b0 con 0x7fd608068540 2024-05-06T21:24:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.812+0000 7fd5feffd700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd5f406c680 0x7fd5f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.812+0000 7fd60d24c700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd5f406c680 0x7fd5f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.812+0000 7fd5feffd700 1 -- 172.21.15.32:0/2419411881 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd60408b7f0 con 0x7fd608068540 2024-05-06T21:24:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.813+0000 7fd60d24c700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd5f406c680 0x7fd5f406eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd608101490 tx=0x7fd5f801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:22.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:22.817+0000 7fd5feffd700 1 -- 172.21.15.32:0/2419411881 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd604055dd0 con 0x7fd608068540 2024-05-06T21:24:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:22 smithi032 ceph-mon[27179]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-06T21:24:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:22.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:22.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:22.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:24:22.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:22 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:23.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.063+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd608100a50 con 0x7fd608068540 2024-05-06T21:24:23.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.063+0000 7fd5feffd700 1 -- 172.21.15.32:0/2419411881 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd6040593f0 con 0x7fd608068540 2024-05-06T21:24:23.067 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-06T21:24:23.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.065+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd5f406c680 msgr2=0x7fd5f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:23.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.065+0000 7fd60fcb1700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd5f406c680 0x7fd5f406eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd608101490 tx=0x7fd5f801a040 comp rx=0 tx=0).stop 2024-05-06T21:24:23.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.065+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 msgr2=0x7fd6080ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:23.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.065+0000 7fd60fcb1700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 0x7fd6080ffca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd60400cfd0 tx=0x7fd60400a340 comp rx=0 tx=0).stop 2024-05-06T21:24:23.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.065+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 shutdown_connections 2024-05-06T21:24:23.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.065+0000 7fd60fcb1700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fd5f406c680 0x7fd5f406eb30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:23.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.065+0000 7fd60fcb1700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd608068540 0x7fd6080ffca0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:23.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.065+0000 7fd60fcb1700 1 --2- 172.21.15.32:0/2419411881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd608106320 0x7fd6081001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:23.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.065+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 >> 172.21.15.32:0/2419411881 conn(0x7fd608075130 msgr2=0x7fd6080feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:23.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.066+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 shutdown_connections 2024-05-06T21:24:23.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23.066+0000 7fd60fcb1700 1 -- 172.21.15.32:0/2419411881 wait complete. 2024-05-06T21:24:23.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:22 smithi154 ceph-mon[32880]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-06T21:24:23.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:23.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:23.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:23.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:24:23.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:22 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:23.728 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-06T21:24:23.728 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-06T21:24:23.728 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-05-06T21:24:23.728 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-06T21:24:23.728 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-06T21:24:23.728 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-06T21:24:23.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-06T21:24:23.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-06T21:24:23.729 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-06T21:24:23.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:23.729 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-05-06T21:24:23.747 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42234sec preferred_lft 42234sec 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link noprefixroute 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-05-06T21:24:23.748 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-05-06T21:24:23.749 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-06T21:24:23.749 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:23.749 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-05-06T21:24:23.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2024-05-06T21:24:23.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2024-05-06T21:24:23.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2024-05-06T21:24:23.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-06T21:24:23.749 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-05-06T21:24:23.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:23.958 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:23 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2419411881' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-06T21:24:23.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:23.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:23.969 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-06T21:24:23.996 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-05-06T21:24:23.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:23.997 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-05-06T21:24:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-05-06T21:24:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-06T21:24:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-06T21:24:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-06T21:24:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-06T21:24:24.067 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:24.067 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-05-06T21:24:24.067 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-06T21:24:24.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-06T21:24:24.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-06T21:24:24.068 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-05-06T21:24:24.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:23 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2419411881' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-06T21:24:24.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:24.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:24.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:24.386 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-05-06T21:24:24.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:24.403 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2024-05-06T21:24:24.460 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:24.460 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-05-06T21:24:24.460 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-06T21:24:24.460 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-06T21:24:24.460 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-05-06T21:24:24.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:24.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:24.581 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-06T21:24:24.581 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:24.582 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-05-06T21:24:24.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-06T21:24:24.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-06T21:24:24.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-06T21:24:24.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-06T21:24:24.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-06T21:24:24.582 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-05-06T21:24:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:24.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:24.721 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:24.721 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-05-06T21:24:24.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-05-06T21:24:24.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2024-05-06T21:24:24.722 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-05-06T21:24:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:24.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:24.801 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-06T21:24:24.801 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-06T21:24:24.831 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-06T21:24:24.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-06T21:24:24.831 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-06T21:24:24.887 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-06T21:24:24.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:24.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-06T21:24:24.950 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:24 smithi032 ceph-mon[27179]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-06T21:24:24.996 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-06T21:24:25.019 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-06T21:24:25.019 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-05-06T21:24:25.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:24 smithi154 ceph-mon[32880]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-06T21:24:25.139 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-06T21:24:25.139 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-06T21:24:25.139 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-05-06T21:24:25.139 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.154:3300" 2024-05-06T21:24:25.139 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-06T21:24:25.150 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-06T21:24:25.150 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-06T21:24:25.150 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-05-06T21:24:25.150 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.154:3300" 2024-05-06T21:24:25.150 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-06T21:24:25.150 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.154:6789" 2024-05-06T21:24:25.150 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.154:6789:/ 2024-05-06T21:24:25.151 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=d155ff30-0bed-11ef-bc97-c7b262605968" will pass to kernel 2024-05-06T21:24:25.155 INFO:teuthology.orchestra.run.smithi032.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-06T21:24:25.155 INFO:teuthology.orchestra.run.smithi032.stdout: You just mounted a file system that supports labels which does not 2024-05-06T21:24:25.155 INFO:teuthology.orchestra.run.smithi032.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-06T21:24:25.155 INFO:teuthology.orchestra.run.smithi032.stdout: applications will generate AVC messages and not be allowed access to 2024-05-06T21:24:25.155 INFO:teuthology.orchestra.run.smithi032.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-06T21:24:25.155 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-06T21:24:25.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:25.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-06T21:24:25.227 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T21:24:25.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T21:24:25.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:25.334 INFO:teuthology.orchestra.run.smithi032.stdout:client14532 2024-05-06T21:24:25.335 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:24:25.335 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T21:24:25.352 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T21:24:25.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T21:24:25.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:25.457 INFO:teuthology.orchestra.run.smithi032.stdout:client14532 2024-05-06T21:24:25.457 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T21:24:25.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T21:24:25.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:25.522 INFO:teuthology.orchestra.run.smithi032.stdout:client14532 2024-05-06T21:24:25.522 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d155ff30-0bed-11ef-bc97-c7b262605968.client14532/status') 2024-05-06T21:24:25.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:25.589 INFO:teuthology.orchestra.run.smithi032.stdout:instance: client.14532 (3)192.168.0.1:0/718525170 2024-05-06T21:24:25.589 INFO:teuthology.orchestra.run.smithi032.stdout:blocklisted: false 2024-05-06T21:24:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records in 2024-05-06T21:24:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records out 2024-05-06T21:24:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:69 bytes copied, 2.377e-05 s, 2.9 MB/s 2024-05-06T21:24:25.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:25.597 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-06T21:24:25.597 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-06T21:24:25.597 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-06T21:24:25.597 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-06T21:24:25.820 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:26.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:25 smithi154 ceph-mon[32880]: pgmap v199: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-06T21:24:26.122 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:25 smithi032 ceph-mon[27179]: pgmap v199: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-06T21:24:27.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.530+0000 7f42f0370700 1 -- 172.21.15.32:0/766048561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 msgr2=0x7f42e8100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:27.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.530+0000 7f42f0370700 1 --2- 172.21.15.32:0/766048561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 0x7f42e8100040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f42d8009910 tx=0x7f42d8009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:27.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.530+0000 7f42f0370700 1 -- 172.21.15.32:0/766048561 shutdown_connections 2024-05-06T21:24:27.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.530+0000 7f42f0370700 1 --2- 172.21.15.32:0/766048561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 0x7f42e8100040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:27.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.530+0000 7f42f0370700 1 --2- 172.21.15.32:0/766048561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8104130 0x7f42e8104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:27.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.530+0000 7f42f0370700 1 -- 172.21.15.32:0/766048561 >> 172.21.15.32:0/766048561 conn(0x7f42e8075130 msgr2=0x7f42e8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:27.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.530+0000 7f42f0370700 1 -- 172.21.15.32:0/766048561 shutdown_connections 2024-05-06T21:24:27.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.530+0000 7f42f0370700 1 -- 172.21.15.32:0/766048561 wait complete. 2024-05-06T21:24:27.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.531+0000 7f42f0370700 1 Processor -- start 2024-05-06T21:24:27.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.531+0000 7f42f0370700 1 -- start start 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.531+0000 7f42f0370700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 0x7f42e8196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.531+0000 7f42f0370700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8104130 0x7f42e8197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.531+0000 7f42f0370700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8197860 con 0x7f42e80ffbd0 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.531+0000 7f42f0370700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e81979a0 con 0x7f42e8104130 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.531+0000 7f42ee10c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 0x7f42e8196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.531+0000 7f42ee10c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 0x7f42e8196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38236/0 (socket says 172.21.15.32:38236) 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.531+0000 7f42ee10c700 1 -- 172.21.15.32:0/2042254084 learned_addr learned my addr 172.21.15.32:0/2042254084 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42ed90b700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8104130 0x7f42e8197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42ee10c700 1 -- 172.21.15.32:0/2042254084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8104130 msgr2=0x7f42e8197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42ee10c700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8104130 0x7f42e8197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42ee10c700 1 -- 172.21.15.32:0/2042254084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80095f0 con 0x7f42e80ffbd0 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42ed90b700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8104130 0x7f42e8197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42ee10c700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 0x7f42e8196c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f42e400d8d0 tx=0x7f42e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42df7fe700 1 -- 172.21.15.32:0/2042254084 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42e4009940 con 0x7f42e80ffbd0 2024-05-06T21:24:27.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42df7fe700 1 -- 172.21.15.32:0/2042254084 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f42e4010460 con 0x7f42e80ffbd0 2024-05-06T21:24:27.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e819fcb0 con 0x7f42e80ffbd0 2024-05-06T21:24:27.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.532+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e81a01d0 con 0x7f42e80ffbd0 2024-05-06T21:24:27.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.533+0000 7f42df7fe700 1 -- 172.21.15.32:0/2042254084 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42e400f5f0 con 0x7f42e80ffbd0 2024-05-06T21:24:27.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.533+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e804f2a0 con 0x7f42e80ffbd0 2024-05-06T21:24:27.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.534+0000 7f42df7fe700 1 -- 172.21.15.32:0/2042254084 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f42e40105d0 con 0x7f42e80ffbd0 2024-05-06T21:24:27.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.534+0000 7f42df7fe700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f42d406c680 0x7f42d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:27.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.535+0000 7f42df7fe700 1 -- 172.21.15.32:0/2042254084 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f42e408b8e0 con 0x7f42e80ffbd0 2024-05-06T21:24:27.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.535+0000 7f42ed90b700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f42d406c680 0x7f42d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:27.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.535+0000 7f42ed90b700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f42d406c680 0x7f42d406eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f42d800b5c0 tx=0x7f42d801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:27.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.540+0000 7f42df7fe700 1 -- 172.21.15.32:0/2042254084 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f42e4055f60 con 0x7f42e80ffbd0 2024-05-06T21:24:27.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.784+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f42e81a0410 con 0x7f42e80ffbd0 2024-05-06T21:24:27.788 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:27 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:24:27.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.785+0000 7f42df7fe700 1 -- 172.21.15.32:0/2042254084 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f42e4059580 con 0x7f42e80ffbd0 2024-05-06T21:24:27.789 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f42d406c680 msgr2=0x7f42d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f42d406c680 0x7f42d406eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f42d800b5c0 tx=0x7f42d801a040 comp rx=0 tx=0).stop 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 msgr2=0x7f42e8196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 0x7f42e8196c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f42e400d8d0 tx=0x7f42e400dc90 comp rx=0 tx=0).stop 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 shutdown_connections 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f42d406c680 0x7f42d406eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42e80ffbd0 0x7f42e8196c40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 --2- 172.21.15.32:0/2042254084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8104130 0x7f42e8197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 >> 172.21.15.32:0/2042254084 conn(0x7f42e8075130 msgr2=0x7f42e80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:27.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 shutdown_connections 2024-05-06T21:24:27.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:27.787+0000 7f42f0370700 1 -- 172.21.15.32:0/2042254084 wait complete. 2024-05-06T21:24:28.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:27 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:24:28.421 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-06T21:24:28.421 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-06T21:24:28.421 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-05-06T21:24:28.421 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-06T21:24:28.421 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-06T21:24:28.421 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-06T21:24:28.421 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-06T21:24:28.421 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-06T21:24:28.421 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-06T21:24:28.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:28.422 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-05-06T21:24:28.438 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-06T21:24:28.438 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-06T21:24:28.438 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-05-06T21:24:28.438 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42278sec preferred_lft 42278sec 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2024-05-06T21:24:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-06T21:24:28.440 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-06T21:24:28.440 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:28.440 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-06T21:24:28.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add name ceph-brx type bridge 2024-05-06T21:24:28.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr flush dev ceph-brx 2024-05-06T21:24:28.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set ceph-brx up 2024-05-06T21:24:28.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-06T21:24:28.440 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-06T21:24:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:28.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:28.641 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-06T21:24:28.666 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-05-06T21:24:28.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:28.668 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-05-06T21:24:28.734 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-05-06T21:24:28.734 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-06T21:24:28.734 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-06T21:24:28.734 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-06T21:24:28.734 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-06T21:24:28.735 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:28.735 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-06T21:24:28.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-06T21:24:28.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-06T21:24:28.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-06T21:24:28.735 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-06T21:24:28.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:28.831 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:28 smithi154 ceph-mon[32880]: pgmap v200: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 170 B/s wr, 0 op/s 2024-05-06T21:24:28.831 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:28 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2042254084' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-06T21:24:28.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:28 smithi032 ceph-mon[27179]: pgmap v200: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 170 B/s wr, 0 op/s 2024-05-06T21:24:28.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:28 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2042254084' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-06T21:24:29.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:29.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:29.012 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-05-06T21:24:29.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:29.028 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2024-05-06T21:24:29.083 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:29.084 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-06T21:24:29.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-06T21:24:29.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-06T21:24:29.084 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-06T21:24:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:29.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:29.203 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-06T21:24:29.203 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:29.203 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-06T21:24:29.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-06T21:24:29.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-06T21:24:29.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-06T21:24:29.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-06T21:24:29.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-06T21:24:29.204 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-06T21:24:29.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:29.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:29.331 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-06T21:24:29.331 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-06T21:24:29.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-05-06T21:24:29.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.0 master ceph-brx 2024-05-06T21:24:29.331 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-06T21:24:29.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:29.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:29.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-06T21:24:29.408 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-06T21:24:29.423 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-06T21:24:29.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-06T21:24:29.423 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-06T21:24:29.478 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-06T21:24:29.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:29.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-06T21:24:29.580 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-06T21:24:29.580 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-06T21:24:29.580 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2024-05-06T21:24:29.687 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-06T21:24:29.687 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-06T21:24:29.687 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2024-05-06T21:24:29.688 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.154:3300" 2024-05-06T21:24:29.688 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-06T21:24:29.697 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-06T21:24:29.697 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-06T21:24:29.697 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2024-05-06T21:24:29.697 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.154:3300" 2024-05-06T21:24:29.697 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-06T21:24:29.698 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.154:6789" 2024-05-06T21:24:29.698 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.154:6789:/ 2024-05-06T21:24:29.698 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=d155ff30-0bed-11ef-bc97-c7b262605968" will pass to kernel 2024-05-06T21:24:29.698 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-06T21:24:29.699 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-05-06T21:24:29.699 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-06T21:24:29.699 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-05-06T21:24:29.699 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-06T21:24:29.700 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-06T21:24:29.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:24:29.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-06T21:24:29.725 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T21:24:29.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T21:24:29.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:29.822 INFO:teuthology.orchestra.run.smithi154.stdout:client24325 2024-05-06T21:24:29.822 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:24:29.822 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T21:24:29.839 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T21:24:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T21:24:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:29.936 INFO:teuthology.orchestra.run.smithi154.stdout:client24325 2024-05-06T21:24:29.936 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-06T21:24:29.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-06T21:24:29.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:client24325 2024-05-06T21:24:29.992 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d155ff30-0bed-11ef-bc97-c7b262605968.client24325/status') 2024-05-06T21:24:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-06T21:24:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:instance: client.24325 (3)192.168.0.1:0/3805930735 2024-05-06T21:24:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:blocklisted: false 2024-05-06T21:24:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records in 2024-05-06T21:24:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records out 2024-05-06T21:24:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:70 bytes copied, 2.3737e-05 s, 2.9 MB/s 2024-05-06T21:24:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-06T21:24:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-06T21:24:30.058 INFO:teuthology.run_tasks:Running task print... 2024-05-06T21:24:30.069 INFO:teuthology.task.print:**** done client 2024-05-06T21:24:30.070 INFO:teuthology.run_tasks:Running task parallel... 2024-05-06T21:24:30.107 INFO:teuthology.task.parallel:starting parallel... 2024-05-06T21:24:30.108 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-06T21:24:30.108 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-06T21:24:30.109 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:24:30.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-05-06T21:24:30.109 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-06T21:24:30.109 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-05-06T21:24:30.113 INFO:tasks.workunit:Pulling workunits from ref f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:24:30.113 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-06T21:24:30.113 INFO:tasks.workunit:timeout=3h 2024-05-06T21:24:30.113 INFO:tasks.workunit:cleanup=True 2024-05-06T21:24:30.113 DEBUG:teuthology.orchestra.run.smithi032:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-06T21:24:30.135 INFO:teuthology.orchestra.run.smithi032.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-06T21:24:30.135 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-06T21:24:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5bh/91d Inode: 1 Links: 2 2024-05-06T21:24:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:24:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-06T21:24:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-06T21:24:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-05-06 21:23:54.856424642 +0000 2024-05-06T21:24:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-05-06 21:24:25.217825564 +0000 2024-05-06T21:24:30.136 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-05-06 21:23:54.856424642 +0000 2024-05-06T21:24:30.136 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-06T21:24:30.136 DEBUG:teuthology.orchestra.run.smithi032:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-06T21:24:30.210 DEBUG:teuthology.orchestra.run.smithi154:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-06T21:24:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-06T21:24:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-05-06T21:24:30.227 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 7ah/122d Inode: 1 Links: 3 2024-05-06T21:24:30.227 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T21:24:30.227 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-06T21:24:30.227 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-06T21:24:30.228 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-06 21:24:30.200723939 +0000 2024-05-06T21:24:30.228 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-06 21:24:30.200723939 +0000 2024-05-06T21:24:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-05-06 21:23:54.856424642 +0000 2024-05-06T21:24:30.228 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-06T21:24:30.228 DEBUG:teuthology.orchestra.run.smithi154:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-06T21:24:30.299 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:24:30.299 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:24:30.317 INFO:tasks.workunit.client.0.smithi032.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-06T21:24:30.351 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:30.356 INFO:tasks.workunit.client.1.smithi154.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-06T21:24:30.726 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:30 smithi032 ceph-mon[27179]: pgmap v201: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T21:24:31.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:30 smithi154 ceph-mon[32880]: pgmap v201: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T21:24:32.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 -- 172.21.15.32:0/780787710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 msgr2=0x7f245c1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 --2- 172.21.15.32:0/780787710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 0x7f245c1030b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2450009910 tx=0x7f2450009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 -- 172.21.15.32:0/780787710 shutdown_connections 2024-05-06T21:24:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 --2- 172.21.15.32:0/780787710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c1035f0 0x7f245c1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 --2- 172.21.15.32:0/780787710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 0x7f245c1030b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 -- 172.21.15.32:0/780787710 >> 172.21.15.32:0/780787710 conn(0x7f245c0fa6d0 msgr2=0x7f245c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 -- 172.21.15.32:0/780787710 shutdown_connections 2024-05-06T21:24:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 -- 172.21.15.32:0/780787710 wait complete. 2024-05-06T21:24:32.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 Processor -- start 2024-05-06T21:24:32.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.144+0000 7f2462d61700 1 -- start start 2024-05-06T21:24:32.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2462d61700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 0x7f245c100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:32.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2462d61700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c1035f0 0x7f245c0fec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:32.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2462d61700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0ff1c0 con 0x7f245c100cd0 2024-05-06T21:24:32.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2462d61700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0ff300 con 0x7f245c1035f0 2024-05-06T21:24:32.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2460afd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 0x7f245c100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:32.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2460afd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 0x7f245c100630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60598/0 (socket says 172.21.15.32:60598) 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2460afd700 1 -- 172.21.15.32:0/3488413123 learned_addr learned my addr 172.21.15.32:0/3488413123 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2460afd700 1 -- 172.21.15.32:0/3488413123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c1035f0 msgr2=0x7f245c0fec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2460afd700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c1035f0 0x7f245c0fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2460afd700 1 -- 172.21.15.32:0/3488413123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500095f0 con 0x7f245c100cd0 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2460afd700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 0x7f245c100630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2450006010 tx=0x7f245000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2459ffb700 1 -- 172.21.15.32:0/3488413123 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f245001d070 con 0x7f245c100cd0 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2459ffb700 1 -- 172.21.15.32:0/3488413123 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f245000f460 con 0x7f245c100cd0 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c0ff580 con 0x7f245c100cd0 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.145+0000 7f2459ffb700 1 -- 172.21.15.32:0/3488413123 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2450021640 con 0x7f245c100cd0 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.146+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c0ffa70 con 0x7f245c100cd0 2024-05-06T21:24:32.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.147+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c18fc60 con 0x7f245c100cd0 2024-05-06T21:24:32.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.147+0000 7f2459ffb700 1 -- 172.21.15.32:0/3488413123 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f245000fab0 con 0x7f245c100cd0 2024-05-06T21:24:32.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.148+0000 7f2459ffb700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f244c06c680 0x7f244c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:32.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.148+0000 7f2459ffb700 1 -- 172.21.15.32:0/3488413123 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f245008cdc0 con 0x7f245c100cd0 2024-05-06T21:24:32.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.148+0000 7f245bfff700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f244c06c680 0x7f244c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:32.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.148+0000 7f245bfff700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f244c06c680 0x7f244c06eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f244800a990 tx=0x7f2448005c80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:32.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.152+0000 7f2459ffb700 1 -- 172.21.15.32:0/3488413123 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2450090030 con 0x7f245c100cd0 2024-05-06T21:24:32.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.348+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f245c02cc30 con 0x7f245c100cd0 2024-05-06T21:24:32.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.353+0000 7f2459ffb700 1 -- 172.21.15.32:0/3488413123 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v22)=0 v22) v1 ==== 126+0+0 (secure 0 0 0) 0x7f24500260c0 con 0x7f245c100cd0 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.355+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f244c06c680 msgr2=0x7f244c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.355+0000 7f2462d61700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f244c06c680 0x7f244c06eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f244800a990 tx=0x7f2448005c80 comp rx=0 tx=0).stop 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.355+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 msgr2=0x7f245c100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.355+0000 7f2462d61700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 0x7f245c100630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2450006010 tx=0x7f245000be20 comp rx=0 tx=0).stop 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.356+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 shutdown_connections 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.356+0000 7f2462d61700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f244c06c680 0x7f244c06eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.356+0000 7f2462d61700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c100cd0 0x7f245c100630 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.356+0000 7f2462d61700 1 --2- 172.21.15.32:0/3488413123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c1035f0 0x7f245c0fec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.356+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 >> 172.21.15.32:0/3488413123 conn(0x7f245c0fa6d0 msgr2=0x7f245c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.356+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 shutdown_connections 2024-05-06T21:24:32.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:32.356+0000 7f2462d61700 1 -- 172.21.15.32:0/3488413123 wait complete. 2024-05-06T21:24:32.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:32 smithi032 ceph-mon[27179]: pgmap v202: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:24:32.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:32 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3488413123' entity='client.admin' 2024-05-06T21:24:32.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:32 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:24:33.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:32 smithi154 ceph-mon[32880]: pgmap v202: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:24:33.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:32 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3488413123' entity='client.admin' 2024-05-06T21:24:33.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:32 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:24:33.263 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-06T21:24:33.264 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:24:33.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-05-06T21:24:33.557 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:33.943 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:33 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:33.943 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:33 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:24:33.943 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:33 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:33.988 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:33 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:33.988 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:33 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:24:33.988 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:33 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:34.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:34 smithi032 ceph-mon[27179]: pgmap v203: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:24:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:34 smithi154 ceph-mon[32880]: pgmap v203: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:24:35.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.328+0000 7efd40e2a700 1 -- 172.21.15.32:0/1183895453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c1035f0 msgr2=0x7efd3c1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.328+0000 7efd40e2a700 1 --2- 172.21.15.32:0/1183895453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c1035f0 0x7efd3c1059d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efd30009910 tx=0x7efd30009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.328+0000 7efd40e2a700 1 -- 172.21.15.32:0/1183895453 shutdown_connections 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.328+0000 7efd40e2a700 1 --2- 172.21.15.32:0/1183895453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c1035f0 0x7efd3c1059d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.328+0000 7efd40e2a700 1 --2- 172.21.15.32:0/1183895453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c100cd0 0x7efd3c1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.328+0000 7efd40e2a700 1 -- 172.21.15.32:0/1183895453 >> 172.21.15.32:0/1183895453 conn(0x7efd3c0fa6d0 msgr2=0x7efd3c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.328+0000 7efd40e2a700 1 -- 172.21.15.32:0/1183895453 shutdown_connections 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.328+0000 7efd40e2a700 1 -- 172.21.15.32:0/1183895453 wait complete. 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.329+0000 7efd40e2a700 1 Processor -- start 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.329+0000 7efd40e2a700 1 -- start start 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.329+0000 7efd40e2a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c100cd0 0x7efd3c195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.329+0000 7efd40e2a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c1035f0 0x7efd3c195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.329+0000 7efd40e2a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c196540 con 0x7efd3c100cd0 2024-05-06T21:24:35.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.329+0000 7efd40e2a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c196680 con 0x7efd3c1035f0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.329+0000 7efd3a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c100cd0 0x7efd3c195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.329+0000 7efd3a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c100cd0 0x7efd3c195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60624/0 (socket says 172.21.15.32:60624) 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.329+0000 7efd3a59c700 1 -- 172.21.15.32:0/1499135084 learned_addr learned my addr 172.21.15.32:0/1499135084 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd39d9b700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c1035f0 0x7efd3c195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd3a59c700 1 -- 172.21.15.32:0/1499135084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c1035f0 msgr2=0x7efd3c195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd3a59c700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c1035f0 0x7efd3c195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd3a59c700 1 -- 172.21.15.32:0/1499135084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300095f0 con 0x7efd3c100cd0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd3a59c700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c100cd0 0x7efd3c195a70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00c930 tx=0x7efd2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd2b7fe700 1 -- 172.21.15.32:0/1499135084 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2c007ad0 con 0x7efd3c100cd0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3c19b140 con 0x7efd3c100cd0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd2b7fe700 1 -- 172.21.15.32:0/1499135084 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efd2c00ce80 con 0x7efd3c100cd0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd2b7fe700 1 -- 172.21.15.32:0/1499135084 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2c018630 con 0x7efd3c100cd0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.330+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3c19b660 con 0x7efd3c100cd0 2024-05-06T21:24:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.331+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3c18fc60 con 0x7efd3c100cd0 2024-05-06T21:24:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.332+0000 7efd2b7fe700 1 -- 172.21.15.32:0/1499135084 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efd2c007c30 con 0x7efd3c100cd0 2024-05-06T21:24:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.332+0000 7efd2b7fe700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7efd2406c680 0x7efd2406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.332+0000 7efd2b7fe700 1 -- 172.21.15.32:0/1499135084 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7efd2c08b8e0 con 0x7efd3c100cd0 2024-05-06T21:24:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.332+0000 7efd39d9b700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7efd2406c680 0x7efd2406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.333+0000 7efd39d9b700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7efd2406c680 0x7efd2406eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd30006010 tx=0x7efd3000b560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:35.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.337+0000 7efd2b7fe700 1 -- 172.21.15.32:0/1499135084 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efd2c0599f0 con 0x7efd3c100cd0 2024-05-06T21:24:35.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.535+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7efd3c02cc30 con 0x7efd3c100cd0 2024-05-06T21:24:35.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.536+0000 7efd2b7fe700 1 -- 172.21.15.32:0/1499135084 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v22)=0 v22) v1 ==== 155+0+0 (secure 0 0 0) 0x7efd2c059580 con 0x7efd3c100cd0 2024-05-06T21:24:35.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7efd2406c680 msgr2=0x7efd2406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:35.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7efd2406c680 0x7efd2406eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd30006010 tx=0x7efd3000b560 comp rx=0 tx=0).stop 2024-05-06T21:24:35.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c100cd0 msgr2=0x7efd3c195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:35.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c100cd0 0x7efd3c195a70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00c930 tx=0x7efd2c00cc40 comp rx=0 tx=0).stop 2024-05-06T21:24:35.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 shutdown_connections 2024-05-06T21:24:35.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7efd2406c680 0x7efd2406eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:35.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd3c100cd0 0x7efd3c195a70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:35.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 --2- 172.21.15.32:0/1499135084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c1035f0 0x7efd3c195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:35.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 >> 172.21.15.32:0/1499135084 conn(0x7efd3c0fa6d0 msgr2=0x7efd3c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:35.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 shutdown_connections 2024-05-06T21:24:35.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:35.538+0000 7efd40e2a700 1 -- 172.21.15.32:0/1499135084 wait complete. 2024-05-06T21:24:36.163 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:35 smithi032 ceph-mon[27179]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-05-06T21:24:36.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-05-06T21:24:36.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:35 smithi154 ceph-mon[32880]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-05-06T21:24:36.412 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:38.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.166+0000 7f8074ea2700 1 -- 172.21.15.32:0/972849319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 msgr2=0x7f80701057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:38.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.166+0000 7f8074ea2700 1 --2- 172.21.15.32:0/972849319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 0x7f80701057b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8064009910 tx=0x7f8064009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.166+0000 7f8074ea2700 1 -- 172.21.15.32:0/972849319 shutdown_connections 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.166+0000 7f8074ea2700 1 --2- 172.21.15.32:0/972849319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 0x7f80701057b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.166+0000 7f8074ea2700 1 --2- 172.21.15.32:0/972849319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8070069aa0 0x7f8070102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.166+0000 7f8074ea2700 1 -- 172.21.15.32:0/972849319 >> 172.21.15.32:0/972849319 conn(0x7f80700fa7a0 msgr2=0x7f80700fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.166+0000 7f8074ea2700 1 -- 172.21.15.32:0/972849319 shutdown_connections 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.166+0000 7f8074ea2700 1 -- 172.21.15.32:0/972849319 wait complete. 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f8074ea2700 1 Processor -- start 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f8074ea2700 1 -- start start 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f8074ea2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8070069aa0 0x7f8070195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f8074ea2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 0x7f80701962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f8074ea2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070196900 con 0x7f8070103390 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f8074ea2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070196a40 con 0x7f8070069aa0 2024-05-06T21:24:38.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f806dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 0x7f80701962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f806dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 0x7f80701962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60634/0 (socket says 172.21.15.32:60634) 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f806dd9b700 1 -- 172.21.15.32:0/1233000159 learned_addr learned my addr 172.21.15.32:0/1233000159 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f806e59c700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8070069aa0 0x7f8070195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f806dd9b700 1 -- 172.21.15.32:0/1233000159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8070069aa0 msgr2=0x7f8070195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f806dd9b700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8070069aa0 0x7f8070195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.167+0000 7f806dd9b700 1 -- 172.21.15.32:0/1233000159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80640095f0 con 0x7f8070103390 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.168+0000 7f806dd9b700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 0x7f80701962e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8064000c00 tx=0x7f806400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.168+0000 7f805f7fe700 1 -- 172.21.15.32:0/1233000159 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f806401d070 con 0x7f8070103390 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.168+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807019b490 con 0x7f8070103390 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.168+0000 7f805f7fe700 1 -- 172.21.15.32:0/1233000159 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8064005dc0 con 0x7f8070103390 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.168+0000 7f805f7fe700 1 -- 172.21.15.32:0/1233000159 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80640226a0 con 0x7f8070103390 2024-05-06T21:24:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.168+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807019b980 con 0x7f8070103390 2024-05-06T21:24:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.169+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807018fbf0 con 0x7f8070103390 2024-05-06T21:24:38.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.169+0000 7f805f7fe700 1 -- 172.21.15.32:0/1233000159 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f80640038f0 con 0x7f8070103390 2024-05-06T21:24:38.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.170+0000 7f805f7fe700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f805806c680 0x7f805806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:38.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.170+0000 7f805f7fe700 1 -- 172.21.15.32:0/1233000159 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f806408cd70 con 0x7f8070103390 2024-05-06T21:24:38.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.170+0000 7f806e59c700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f805806c680 0x7f805806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:38.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.170+0000 7f806e59c700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f805806c680 0x7f805806eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80700697d0 tx=0x7f8060009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.174+0000 7f805f7fe700 1 -- 172.21.15.32:0/1233000159 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f806405ae80 con 0x7f8070103390 2024-05-06T21:24:38.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.376+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f8070068ab0 con 0x7f8070103390 2024-05-06T21:24:38.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.377+0000 7f805f7fe700 1 -- 172.21.15.32:0/1233000159 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v22)=0 v22) v1 ==== 163+0+0 (secure 0 0 0) 0x7f8064003680 con 0x7f8070103390 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f805806c680 msgr2=0x7f805806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f805806c680 0x7f805806eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80700697d0 tx=0x7f8060009260 comp rx=0 tx=0).stop 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 msgr2=0x7f80701962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 0x7f80701962e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8064000c00 tx=0x7f806400f690 comp rx=0 tx=0).stop 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 shutdown_connections 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f805806c680 0x7f805806eb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8070069aa0 0x7f8070195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 --2- 172.21.15.32:0/1233000159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8070103390 0x7f80701962e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 >> 172.21.15.32:0/1233000159 conn(0x7f80700fa7a0 msgr2=0x7f80700fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 shutdown_connections 2024-05-06T21:24:38.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:38.379+0000 7f8074ea2700 1 -- 172.21.15.32:0/1233000159 wait complete. 2024-05-06T21:24:38.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:38 smithi032 ceph-mon[27179]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-05-06T21:24:39.036 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:38 smithi154 ceph-mon[32880]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-05-06T21:24:39.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph config set global log_to_journald false --force' 2024-05-06T21:24:39.323 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:40.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:40 smithi032 ceph-mon[27179]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-05-06T21:24:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.100+0000 7f93313a2700 1 -- 172.21.15.32:0/2412813048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c101440 msgr2=0x7f932c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.100+0000 7f93313a2700 1 --2- 172.21.15.32:0/2412813048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c101440 0x7f932c101890 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9314009910 tx=0x7f9314009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.100+0000 7f93313a2700 1 -- 172.21.15.32:0/2412813048 shutdown_connections 2024-05-06T21:24:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.100+0000 7f93313a2700 1 --2- 172.21.15.32:0/2412813048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c101440 0x7f932c101890 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.100+0000 7f93313a2700 1 --2- 172.21.15.32:0/2412813048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c100240 0x7f932c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.100+0000 7f93313a2700 1 -- 172.21.15.32:0/2412813048 >> 172.21.15.32:0/2412813048 conn(0x7f932c0fb7f0 msgr2=0x7f932c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.100+0000 7f93313a2700 1 -- 172.21.15.32:0/2412813048 shutdown_connections 2024-05-06T21:24:41.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.100+0000 7f93313a2700 1 -- 172.21.15.32:0/2412813048 wait complete. 2024-05-06T21:24:41.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.101+0000 7f93313a2700 1 Processor -- start 2024-05-06T21:24:41.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.101+0000 7f93313a2700 1 -- start start 2024-05-06T21:24:41.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.101+0000 7f93313a2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c100240 0x7f932c195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:41.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.101+0000 7f93313a2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c101440 0x7f932c195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.101+0000 7f93313a2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c1965f0 con 0x7f932c100240 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.101+0000 7f93313a2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c196730 con 0x7f932c101440 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.101+0000 7f932affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c100240 0x7f932c195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f932affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c100240 0x7f932c195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60654/0 (socket says 172.21.15.32:60654) 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f932affd700 1 -- 172.21.15.32:0/2140586452 learned_addr learned my addr 172.21.15.32:0/2140586452 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f932a7fc700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c101440 0x7f932c195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f932affd700 1 -- 172.21.15.32:0/2140586452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c101440 msgr2=0x7f932c195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f932affd700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c101440 0x7f932c195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f932affd700 1 -- 172.21.15.32:0/2140586452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93140095f0 con 0x7f932c100240 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f932affd700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c100240 0x7f932c195a90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f931c007e90 tx=0x7f931c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f9323fff700 1 -- 172.21.15.32:0/2140586452 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f931c017070 con 0x7f932c100240 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c19b1e0 con 0x7f932c100240 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f9323fff700 1 -- 172.21.15.32:0/2140586452 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f931c00f040 con 0x7f932c100240 2024-05-06T21:24:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f9323fff700 1 -- 172.21.15.32:0/2140586452 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f931c004820 con 0x7f932c100240 2024-05-06T21:24:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.102+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c19b730 con 0x7f932c100240 2024-05-06T21:24:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.103+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c108d90 con 0x7f932c100240 2024-05-06T21:24:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.104+0000 7f9323fff700 1 -- 172.21.15.32:0/2140586452 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f931c003a00 con 0x7f932c100240 2024-05-06T21:24:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.104+0000 7f9323fff700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f931806c680 0x7f931806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.105+0000 7f9323fff700 1 -- 172.21.15.32:0/2140586452 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f931c08b360 con 0x7f932c100240 2024-05-06T21:24:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.105+0000 7f932a7fc700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f931806c680 0x7f931806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.105+0000 7f932a7fc700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f931806c680 0x7f931806eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9314006010 tx=0x7f931400b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:41.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.109+0000 7f9323fff700 1 -- 172.21.15.32:0/2140586452 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f931c0593d0 con 0x7f932c100240 2024-05-06T21:24:41.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:40 smithi154 ceph-mon[32880]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-05-06T21:24:41.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.306+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f932c19be30 con 0x7f932c100240 2024-05-06T21:24:41.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.307+0000 7f9323fff700 1 -- 172.21.15.32:0/2140586452 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v22)=0 v22) v1 ==== 135+0+0 (secure 0 0 0) 0x7f931c058f60 con 0x7f932c100240 2024-05-06T21:24:41.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f931806c680 msgr2=0x7f931806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:41.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f931806c680 0x7f931806eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9314006010 tx=0x7f931400b540 comp rx=0 tx=0).stop 2024-05-06T21:24:41.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c100240 msgr2=0x7f932c195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:41.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c100240 0x7f932c195a90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f931c007e90 tx=0x7f931c00d3b0 comp rx=0 tx=0).stop 2024-05-06T21:24:41.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 shutdown_connections 2024-05-06T21:24:41.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f931806c680 0x7f931806eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:41.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f932c100240 0x7f932c195a90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:41.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 --2- 172.21.15.32:0/2140586452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c101440 0x7f932c195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:41.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 >> 172.21.15.32:0/2140586452 conn(0x7f932c0fb7f0 msgr2=0x7f932c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:41.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 shutdown_connections 2024-05-06T21:24:41.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:41.310+0000 7f93313a2700 1 -- 172.21.15.32:0/2140586452 wait complete. 2024-05-06T21:24:41.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-05-06T21:24:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:42.963 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:42 smithi032 ceph-mon[27179]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-05-06T21:24:42.964 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:24:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:42 smithi154 ceph-mon[32880]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-05-06T21:24:43.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:24:43.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.890+0000 7fa295d6a700 1 -- 172.21.15.32:0/2145149062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 msgr2=0x7fa290100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:43.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.890+0000 7fa295d6a700 1 --2- 172.21.15.32:0/2145149062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 0x7fa290100650 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa280009910 tx=0x7fa280009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:43.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.890+0000 7fa295d6a700 1 -- 172.21.15.32:0/2145149062 shutdown_connections 2024-05-06T21:24:43.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.890+0000 7fa295d6a700 1 --2- 172.21.15.32:0/2145149062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290101440 0x7fa290101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:43.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.890+0000 7fa295d6a700 1 --2- 172.21.15.32:0/2145149062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 0x7fa290100650 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:43.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.890+0000 7fa295d6a700 1 -- 172.21.15.32:0/2145149062 >> 172.21.15.32:0/2145149062 conn(0x7fa2900fb7f0 msgr2=0x7fa2900fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:43.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.890+0000 7fa295d6a700 1 -- 172.21.15.32:0/2145149062 shutdown_connections 2024-05-06T21:24:43.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.890+0000 7fa295d6a700 1 -- 172.21.15.32:0/2145149062 wait complete. 2024-05-06T21:24:43.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.891+0000 7fa295d6a700 1 Processor -- start 2024-05-06T21:24:43.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.891+0000 7fa295d6a700 1 -- start start 2024-05-06T21:24:43.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa295d6a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 0x7fa290195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:43.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa295d6a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290101440 0x7fa290196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:43.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa295d6a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2901965a0 con 0x7fa290100240 2024-05-06T21:24:43.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa295d6a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2901966e0 con 0x7fa290101440 2024-05-06T21:24:43.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa28f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 0x7fa290195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:43.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa28f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 0x7fa290195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45684/0 (socket says 172.21.15.32:45684) 2024-05-06T21:24:43.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa28f7fe700 1 -- 172.21.15.32:0/1846075852 learned_addr learned my addr 172.21.15.32:0/1846075852 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:43.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa28effd700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290101440 0x7fa290196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:43.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa28f7fe700 1 -- 172.21.15.32:0/1846075852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290101440 msgr2=0x7fa290196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:43.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa28f7fe700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290101440 0x7fa290196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:43.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa28f7fe700 1 -- 172.21.15.32:0/1846075852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800095f0 con 0x7fa290100240 2024-05-06T21:24:43.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa28effd700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290101440 0x7fa290196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:24:43.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.892+0000 7fa28f7fe700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 0x7fa290195ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa28000bda0 tx=0x7fa28000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:43.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.893+0000 7fa28cff9700 1 -- 172.21.15.32:0/1846075852 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa28001d070 con 0x7fa290100240 2024-05-06T21:24:43.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.893+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29019b140 con 0x7fa290100240 2024-05-06T21:24:43.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.893+0000 7fa28cff9700 1 -- 172.21.15.32:0/1846075852 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa280004c50 con 0x7fa290100240 2024-05-06T21:24:43.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.893+0000 7fa28cff9700 1 -- 172.21.15.32:0/1846075852 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa28000f690 con 0x7fa290100240 2024-05-06T21:24:43.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.893+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29019b600 con 0x7fa290100240 2024-05-06T21:24:43.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.894+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa290108d90 con 0x7fa290100240 2024-05-06T21:24:43.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.894+0000 7fa28cff9700 1 -- 172.21.15.32:0/1846075852 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa280022a20 con 0x7fa290100240 2024-05-06T21:24:43.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.895+0000 7fa28cff9700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa27806c680 0x7fa27806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:43.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.895+0000 7fa28cff9700 1 -- 172.21.15.32:0/1846075852 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa28008d180 con 0x7fa290100240 2024-05-06T21:24:43.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.895+0000 7fa28effd700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa27806c680 0x7fa27806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:43.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.895+0000 7fa28effd700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa27806c680 0x7fa27806eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa284005fd0 tx=0x7fa284005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:43.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:43.899+0000 7fa28cff9700 1 -- 172.21.15.32:0/1846075852 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa28005b3c0 con 0x7fa290100240 2024-05-06T21:24:44.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.116+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c", "target": ["mon-mgr", ""]}) v1 -- 0x7fa290105e30 con 0x7fa27806c680 2024-05-06T21:24:44.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.121+0000 7fa28cff9700 1 -- 172.21.15.32:0/1846075852 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fa290105e30 con 0x7fa27806c680 2024-05-06T21:24:44.125 INFO:teuthology.orchestra.run.smithi032.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:24:44.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa27806c680 msgr2=0x7fa27806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:44.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa27806c680 0x7fa27806eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa284005fd0 tx=0x7fa284005e30 comp rx=0 tx=0).stop 2024-05-06T21:24:44.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 msgr2=0x7fa290195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:44.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 0x7fa290195ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa28000bda0 tx=0x7fa28000be80 comp rx=0 tx=0).stop 2024-05-06T21:24:44.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 shutdown_connections 2024-05-06T21:24:44.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa27806c680 0x7fa27806eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:44.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa290100240 0x7fa290195ad0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:44.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 --2- 172.21.15.32:0/1846075852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290101440 0x7fa290196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:44.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 >> 172.21.15.32:0/1846075852 conn(0x7fa2900fb7f0 msgr2=0x7fa290104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:44.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 shutdown_connections 2024-05-06T21:24:44.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:44.123+0000 7fa295d6a700 1 -- 172.21.15.32:0/1846075852 wait complete. 2024-05-06T21:24:44.848 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:44 smithi032 ceph-mon[27179]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-05-06T21:24:44.848 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:44 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:44.848 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:44 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:24:44.848 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:44 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:44.848 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:44 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:24:44.848 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:44 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:44.870 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-06T21:24:44.871 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:24:44.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-05-06T21:24:45.097 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:24:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:44 smithi154 ceph-mon[32880]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-05-06T21:24:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:44 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:44 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:24:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:44 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:24:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:44 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:24:45.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:44 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:24:45.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:45 smithi032 ceph-mon[27179]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:45.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:45 smithi032 ceph-mon[27179]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:24:45.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:45 smithi032 ceph-mon[27179]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:24:46.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:45 smithi154 ceph-mon[32880]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:46.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:45 smithi154 ceph-mon[32880]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:24:46.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:45 smithi154 ceph-mon[32880]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c 2024-05-06T21:24:46.894 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:46 smithi032 ceph-mon[27179]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-05-06T21:24:47.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.010+0000 7fa986f76700 1 -- 172.21.15.32:0/2083908308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9801003d0 msgr2=0x7fa980100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.010+0000 7fa986f76700 1 --2- 172.21.15.32:0/2083908308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9801003d0 0x7fa980100840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009910 tx=0x7fa96c009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:47.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.010+0000 7fa986f76700 1 -- 172.21.15.32:0/2083908308 shutdown_connections 2024-05-06T21:24:47.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.010+0000 7fa986f76700 1 --2- 172.21.15.32:0/2083908308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9801003d0 0x7fa980100840 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.010+0000 7fa986f76700 1 --2- 172.21.15.32:0/2083908308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9800ff130 0x7fa9800ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.010+0000 7fa986f76700 1 -- 172.21.15.32:0/2083908308 >> 172.21.15.32:0/2083908308 conn(0x7fa9800fa780 msgr2=0x7fa9800fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:47.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.010+0000 7fa986f76700 1 -- 172.21.15.32:0/2083908308 shutdown_connections 2024-05-06T21:24:47.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.010+0000 7fa986f76700 1 -- 172.21.15.32:0/2083908308 wait complete. 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.011+0000 7fa986f76700 1 Processor -- start 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.011+0000 7fa986f76700 1 -- start start 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.011+0000 7fa986f76700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9800ff130 0x7fa9800690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.011+0000 7fa986f76700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9801003d0 0x7fa98019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.011+0000 7fa986f76700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98019ad00 con 0x7fa9800ff130 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.011+0000 7fa986f76700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98019ae40 con 0x7fa9801003d0 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.011+0000 7fa984d12700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9800ff130 0x7fa9800690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa984d12700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9800ff130 0x7fa9800690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45702/0 (socket says 172.21.15.32:45702) 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa984d12700 1 -- 172.21.15.32:0/2581295282 learned_addr learned my addr 172.21.15.32:0/2581295282 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa97ffff700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9801003d0 0x7fa98019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa984d12700 1 -- 172.21.15.32:0/2581295282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9801003d0 msgr2=0x7fa98019a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa984d12700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9801003d0 0x7fa98019a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa984d12700 1 -- 172.21.15.32:0/2581295282 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c0095f0 con 0x7fa9800ff130 2024-05-06T21:24:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa984d12700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9800ff130 0x7fa9800690a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa97400c930 tx=0x7fa97400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa97dffb700 1 -- 172.21.15.32:0/2581295282 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa974007ad0 con 0x7fa9800ff130 2024-05-06T21:24:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa97dffb700 1 -- 172.21.15.32:0/2581295282 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa974007c30 con 0x7fa9800ff130 2024-05-06T21:24:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa97dffb700 1 -- 172.21.15.32:0/2581295282 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa974018630 con 0x7fa9800ff130 2024-05-06T21:24:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.012+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98019b120 con 0x7fa9800ff130 2024-05-06T21:24:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.013+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98019b670 con 0x7fa9800ff130 2024-05-06T21:24:47.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.014+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa980107c10 con 0x7fa9800ff130 2024-05-06T21:24:47.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.014+0000 7fa97dffb700 1 -- 172.21.15.32:0/2581295282 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa97400f450 con 0x7fa9800ff130 2024-05-06T21:24:47.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.015+0000 7fa97dffb700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa97006c680 0x7fa97006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:47.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.015+0000 7fa97dffb700 1 -- 172.21.15.32:0/2581295282 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa97408ba50 con 0x7fa9800ff130 2024-05-06T21:24:47.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.015+0000 7fa97ffff700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa97006c680 0x7fa97006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:47.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.015+0000 7fa97ffff700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa97006c680 0x7fa97006eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa980069620 tx=0x7fa96c00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:47.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.020+0000 7fa97dffb700 1 -- 172.21.15.32:0/2581295282 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa974059b60 con 0x7fa9800ff130 2024-05-06T21:24:47.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:46 smithi154 ceph-mon[32880]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-05-06T21:24:47.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.263+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa980104d20 con 0x7fa97006c680 2024-05-06T21:24:47.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.264+0000 7fa97dffb700 1 -- 172.21.15.32:0/2581295282 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fa980104d20 con 0x7fa97006c680 2024-05-06T21:24:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa97006c680 msgr2=0x7fa97006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa97006c680 0x7fa97006eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa980069620 tx=0x7fa96c00b540 comp rx=0 tx=0).stop 2024-05-06T21:24:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9800ff130 msgr2=0x7fa9800690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9800ff130 0x7fa9800690a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa97400c930 tx=0x7fa97400ccf0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 shutdown_connections 2024-05-06T21:24:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa97006c680 0x7fa97006eb30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9800ff130 0x7fa9800690a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 --2- 172.21.15.32:0/2581295282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9801003d0 0x7fa98019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 >> 172.21.15.32:0/2581295282 conn(0x7fa9800fa780 msgr2=0x7fa980103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 shutdown_connections 2024-05-06T21:24:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.266+0000 7fa986f76700 1 -- 172.21.15.32:0/2581295282 wait complete. 2024-05-06T21:24:47.281 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:24:47.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.385+0000 7f9380019700 1 -- 172.21.15.32:0/4138237196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 msgr2=0x7f93781059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.385+0000 7f9380019700 1 --2- 172.21.15.32:0/4138237196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 0x7f93781059e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9368009910 tx=0x7f9368009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:47.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.385+0000 7f9380019700 1 -- 172.21.15.32:0/4138237196 shutdown_connections 2024-05-06T21:24:47.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.385+0000 7f9380019700 1 --2- 172.21.15.32:0/4138237196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 0x7f93781059e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.385+0000 7f9380019700 1 --2- 172.21.15.32:0/4138237196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9378100ce0 0x7f93781030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.385+0000 7f9380019700 1 -- 172.21.15.32:0/4138237196 >> 172.21.15.32:0/4138237196 conn(0x7f93780fa700 msgr2=0x7f93780fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:47.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.386+0000 7f9380019700 1 -- 172.21.15.32:0/4138237196 shutdown_connections 2024-05-06T21:24:47.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.386+0000 7f9380019700 1 -- 172.21.15.32:0/4138237196 wait complete. 2024-05-06T21:24:47.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.386+0000 7f9380019700 1 Processor -- start 2024-05-06T21:24:47.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.386+0000 7f9380019700 1 -- start start 2024-05-06T21:24:47.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.386+0000 7f9380019700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9378100ce0 0x7f93781005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:47.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.386+0000 7f9380019700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 0x7f93780fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:47.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.386+0000 7f9380019700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780ff1d0 con 0x7f9378103600 2024-05-06T21:24:47.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.386+0000 7f9380019700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780ff310 con 0x7f9378100ce0 2024-05-06T21:24:47.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f937d5b4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 0x7f93780fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:47.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f937d5b4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 0x7f93780fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45712/0 (socket says 172.21.15.32:45712) 2024-05-06T21:24:47.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f937d5b4700 1 -- 172.21.15.32:0/3202740635 learned_addr learned my addr 172.21.15.32:0/3202740635 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:47.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f937ddb5700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9378100ce0 0x7f93781005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:47.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f937d5b4700 1 -- 172.21.15.32:0/3202740635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9378100ce0 msgr2=0x7f93781005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f937d5b4700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9378100ce0 0x7f93781005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f937d5b4700 1 -- 172.21.15.32:0/3202740635 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680095f0 con 0x7f9378103600 2024-05-06T21:24:47.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f937d5b4700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 0x7f93780fec90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9368005b40 tx=0x7f936800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:47.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f936effd700 1 -- 172.21.15.32:0/3202740635 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f936801d070 con 0x7f9378103600 2024-05-06T21:24:47.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93780ff590 con 0x7f9378103600 2024-05-06T21:24:47.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f936effd700 1 -- 172.21.15.32:0/3202740635 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f936800f460 con 0x7f9378103600 2024-05-06T21:24:47.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.387+0000 7f936effd700 1 -- 172.21.15.32:0/3202740635 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9368021640 con 0x7f9378103600 2024-05-06T21:24:47.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.388+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93780ffa80 con 0x7f9378103600 2024-05-06T21:24:47.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.389+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937818fc70 con 0x7f9378103600 2024-05-06T21:24:47.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.389+0000 7f936effd700 1 -- 172.21.15.32:0/3202740635 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f936800fa90 con 0x7f9378103600 2024-05-06T21:24:47.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.390+0000 7f936effd700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f936406c680 0x7f936406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:47.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.390+0000 7f936effd700 1 -- 172.21.15.32:0/3202740635 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f936808cc40 con 0x7f9378103600 2024-05-06T21:24:47.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.390+0000 7f937ddb5700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f936406c680 0x7f936406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:47.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.390+0000 7f937ddb5700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f936406c680 0x7f936406eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9374005950 tx=0x7f93740058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:47.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.395+0000 7f936effd700 1 -- 172.21.15.32:0/3202740635 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f936805ad50 con 0x7f9378103600 2024-05-06T21:24:47.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.625+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9378061190 con 0x7f936406c680 2024-05-06T21:24:47.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.626+0000 7f936effd700 1 -- 172.21.15.32:0/3202740635 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f9378061190 con 0x7f936406c680 2024-05-06T21:24:47.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f936406c680 msgr2=0x7f936406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f936406c680 0x7f936406eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9374005950 tx=0x7f93740058e0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 msgr2=0x7f93780fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 0x7f93780fec90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9368005b40 tx=0x7f936800be20 comp rx=0 tx=0).stop 2024-05-06T21:24:47.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 shutdown_connections 2024-05-06T21:24:47.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f936406c680 0x7f936406eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9378100ce0 0x7f93781005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 --2- 172.21.15.32:0/3202740635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9378103600 0x7f93780fec90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 >> 172.21.15.32:0/3202740635 conn(0x7f93780fa700 msgr2=0x7f93780fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:47.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 shutdown_connections 2024-05-06T21:24:47.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.628+0000 7f9380019700 1 -- 172.21.15.32:0/3202740635 wait complete. 2024-05-06T21:24:47.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.756+0000 7f951fc71700 1 -- 172.21.15.32:0/4020261005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95181036a0 msgr2=0x7f9518105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.756+0000 7f951fc71700 1 --2- 172.21.15.32:0/4020261005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95181036a0 0x7f9518105a80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9508009910 tx=0x7f9508009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:47.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.756+0000 7f951fc71700 1 -- 172.21.15.32:0/4020261005 shutdown_connections 2024-05-06T21:24:47.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.756+0000 7f951fc71700 1 --2- 172.21.15.32:0/4020261005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95181036a0 0x7f9518105a80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.756+0000 7f951fc71700 1 --2- 172.21.15.32:0/4020261005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9518100d80 0x7f9518103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.756+0000 7f951fc71700 1 -- 172.21.15.32:0/4020261005 >> 172.21.15.32:0/4020261005 conn(0x7f95180fa7a0 msgr2=0x7f95180fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:47.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.756+0000 7f951fc71700 1 -- 172.21.15.32:0/4020261005 shutdown_connections 2024-05-06T21:24:47.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.756+0000 7f951fc71700 1 -- 172.21.15.32:0/4020261005 wait complete. 2024-05-06T21:24:47.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.756+0000 7f951fc71700 1 Processor -- start 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951fc71700 1 -- start start 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951fc71700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9518100d80 0x7f9518195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951fc71700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181036a0 0x7f9518196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951fc71700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9518196920 con 0x7f9518100d80 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951fc71700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9518196a60 con 0x7f95181036a0 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951da0d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9518100d80 0x7f9518195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951da0d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9518100d80 0x7f9518195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45726/0 (socket says 172.21.15.32:45726) 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951da0d700 1 -- 172.21.15.32:0/4083371297 learned_addr learned my addr 172.21.15.32:0/4083371297 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951d20c700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181036a0 0x7f9518196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:47.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951da0d700 1 -- 172.21.15.32:0/4083371297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181036a0 msgr2=0x7f9518196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:47.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951da0d700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181036a0 0x7f9518196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:47.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951da0d700 1 -- 172.21.15.32:0/4083371297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95080095f0 con 0x7f9518100d80 2024-05-06T21:24:47.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.757+0000 7f951da0d700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9518100d80 0x7f9518195dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f951400d900 tx=0x7f951400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:47.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.758+0000 7f950effd700 1 -- 172.21.15.32:0/4083371297 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9514009900 con 0x7f9518100d80 2024-05-06T21:24:47.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.758+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951819b510 con 0x7f9518100d80 2024-05-06T21:24:47.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.758+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951819ba60 con 0x7f9518100d80 2024-05-06T21:24:47.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.758+0000 7f950effd700 1 -- 172.21.15.32:0/4083371297 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9514010460 con 0x7f9518100d80 2024-05-06T21:24:47.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.758+0000 7f950effd700 1 -- 172.21.15.32:0/4083371297 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951400f5f0 con 0x7f9518100d80 2024-05-06T21:24:47.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.759+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc005320 con 0x7f9518100d80 2024-05-06T21:24:47.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.760+0000 7f950effd700 1 -- 172.21.15.32:0/4083371297 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9514010a90 con 0x7f9518100d80 2024-05-06T21:24:47.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.760+0000 7f950effd700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f950406c680 0x7f950406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:47.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.760+0000 7f950effd700 1 -- 172.21.15.32:0/4083371297 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f951408b440 con 0x7f9518100d80 2024-05-06T21:24:47.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.761+0000 7f951d20c700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f950406c680 0x7f950406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:47.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.761+0000 7f951d20c700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f950406c680 0x7f950406eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9508005b40 tx=0x7f9508005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:47.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.765+0000 7f950effd700 1 -- 172.21.15.32:0/4083371297 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f95140595d0 con 0x7f9518100d80 2024-05-06T21:24:47.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:47.991+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f94fc000bf0 con 0x7f950406c680 2024-05-06T21:24:48.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.002+0000 7f950effd700 1 -- 172.21.15.32:0/4083371297 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f94fc000bf0 con 0x7f950406c680 2024-05-06T21:24:48.006 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:24:48.006 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (5m) 26s ago 6m 24.7M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:24:48.006 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (6m) 26s ago 6m 7428k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:24:48.006 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (5m) 31s ago 5m 7360k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (6m) 26s ago 6m 6665k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (5m) 31s ago 5m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (4m) 26s ago 6m 85.3M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (53s) 26s ago 53s 11.4M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (46s) 26s ago 45s 17.3M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (51s) 31s ago 50s 18.5M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (43s) 31s ago 43s 13.0M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:9283,8765,8443 running (7m) 26s ago 7m 487M - 18.2.0 dc2bc1663786 7711cd2179ff 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (5m) 31s ago 5m 439M - 18.2.0 dc2bc1663786 f1d5be241e61 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (7m) 26s ago 8m 44.9M 2048M 18.2.0 dc2bc1663786 b06a214f4520 2024-05-06T21:24:48.007 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (5m) 31s ago 5m 35.9M 2048M 18.2.0 dc2bc1663786 8a37ef7f53f9 2024-05-06T21:24:48.008 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (6m) 26s ago 6m 16.1M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:24:48.008 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (5m) 31s ago 5m 16.6M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:24:48.008 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (4m) 26s ago 4m 48.3M 3948M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:24:48.008 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (4m) 26s ago 4m 47.2M 3948M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:24:48.008 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (3m) 26s ago 3m 48.4M 3948M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:24:48.008 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (3m) 31s ago 3m 46.0M 4970M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:24:48.008 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (2m) 31s ago 2m 43.8M 4970M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:24:48.008 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (2m) 31s ago 2m 44.9M 4970M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:24:48.008 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (4m) 26s ago 5m 63.3M - 2.43.0 a07b618ecd1d eb2dd06c5402 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f950406c680 msgr2=0x7f950406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f950406c680 0x7f950406eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9508005b40 tx=0x7f9508005a90 comp rx=0 tx=0).stop 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9518100d80 msgr2=0x7f9518195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9518100d80 0x7f9518195dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f951400d900 tx=0x7f951400dcc0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 shutdown_connections 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f950406c680 0x7f950406eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9518100d80 0x7f9518195dc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 --2- 172.21.15.32:0/4083371297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181036a0 0x7f9518196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 >> 172.21.15.32:0/4083371297 conn(0x7f95180fa7a0 msgr2=0x7f95180fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:48.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 shutdown_connections 2024-05-06T21:24:48.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.005+0000 7f951fc71700 1 -- 172.21.15.32:0/4083371297 wait complete. 2024-05-06T21:24:48.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 -- 172.21.15.32:0/1216534212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8069270 msgr2=0x7fcca8102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 --2- 172.21.15.32:0/1216534212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8069270 0x7fcca8102dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009910 tx=0x7fcca4009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:48.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 -- 172.21.15.32:0/1216534212 shutdown_connections 2024-05-06T21:24:48.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 --2- 172.21.15.32:0/1216534212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca8103310 0x7fcca8105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 --2- 172.21.15.32:0/1216534212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8069270 0x7fcca8102dd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 -- 172.21.15.32:0/1216534212 >> 172.21.15.32:0/1216534212 conn(0x7fcca80fa780 msgr2=0x7fcca80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:48.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 -- 172.21.15.32:0/1216534212 shutdown_connections 2024-05-06T21:24:48.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 -- 172.21.15.32:0/1216534212 wait complete. 2024-05-06T21:24:48.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 Processor -- start 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.124+0000 7fccafed8700 1 -- start start 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccafed8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8103310 0x7fcca81938b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccafed8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca8193df0 0x7fcca8198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccafed8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca81942f0 con 0x7fcca8103310 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccafed8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca8194460 con 0x7fcca8193df0 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccadc74700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8103310 0x7fcca81938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccadc74700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8103310 0x7fcca81938b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45756/0 (socket says 172.21.15.32:45756) 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccadc74700 1 -- 172.21.15.32:0/4048996728 learned_addr learned my addr 172.21.15.32:0/4048996728 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccad473700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca8193df0 0x7fcca8198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccadc74700 1 -- 172.21.15.32:0/4048996728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca8193df0 msgr2=0x7fcca8198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccadc74700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca8193df0 0x7fcca8198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccadc74700 1 -- 172.21.15.32:0/4048996728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca40095f0 con 0x7fcca8103310 2024-05-06T21:24:48.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.125+0000 7fccadc74700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8103310 0x7fcca81938b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcca400bda0 tx=0x7fcca400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:48.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.126+0000 7fcc9effd700 1 -- 172.21.15.32:0/4048996728 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca401d070 con 0x7fcca8103310 2024-05-06T21:24:48.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.126+0000 7fcc9effd700 1 -- 172.21.15.32:0/4048996728 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcca4004c50 con 0x7fcca8103310 2024-05-06T21:24:48.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.126+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca81993a0 con 0x7fcca8103310 2024-05-06T21:24:48.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.126+0000 7fcc9effd700 1 -- 172.21.15.32:0/4048996728 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca400f690 con 0x7fcca8103310 2024-05-06T21:24:48.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.126+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca8199860 con 0x7fcca8103310 2024-05-06T21:24:48.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.127+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca8069270 con 0x7fcca8103310 2024-05-06T21:24:48.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.128+0000 7fcc9effd700 1 -- 172.21.15.32:0/4048996728 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcca4022a20 con 0x7fcca8103310 2024-05-06T21:24:48.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.128+0000 7fcc9effd700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcc9406c680 0x7fcc9406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:48.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.128+0000 7fcc9effd700 1 -- 172.21.15.32:0/4048996728 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fcca408ce90 con 0x7fcca8103310 2024-05-06T21:24:48.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.128+0000 7fccad473700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcc9406c680 0x7fcc9406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:48.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.129+0000 7fccad473700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcc9406c680 0x7fcc9406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005fd0 tx=0x7fcc9800a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:48.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.133+0000 7fcc9effd700 1 -- 172.21.15.32:0/4048996728 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcca405b0d0 con 0x7fcca8103310 2024-05-06T21:24:48.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.440+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcca8069430 con 0x7fcca8103310 2024-05-06T21:24:48.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.441+0000 7fcc9effd700 1 -- 172.21.15.32:0/4048996728 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fcca4027240 con 0x7fcca8103310 2024-05-06T21:24:48.445 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:24:48.445 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:24:48.446 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:24:48.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:24:48.446 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:24:48.446 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:24:48.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:24:48.447 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:24:48.447 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-05-06T21:24:48.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:24:48.447 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:24:48.447 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:24:48.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:24:48.448 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:24:48.448 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-05-06T21:24:48.448 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:24:48.448 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:24:48.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcc9406c680 msgr2=0x7fcc9406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcc9406c680 0x7fcc9406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005fd0 tx=0x7fcc9800a560 comp rx=0 tx=0).stop 2024-05-06T21:24:48.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8103310 msgr2=0x7fcca81938b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8103310 0x7fcca81938b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcca400bda0 tx=0x7fcca400be80 comp rx=0 tx=0).stop 2024-05-06T21:24:48.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 shutdown_connections 2024-05-06T21:24:48.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fcc9406c680 0x7fcc9406eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcca8103310 0x7fcca81938b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 --2- 172.21.15.32:0/4048996728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca8193df0 0x7fcca8198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 >> 172.21.15.32:0/4048996728 conn(0x7fcca80fa780 msgr2=0x7fcca8100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:48.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 shutdown_connections 2024-05-06T21:24:48.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.444+0000 7fccafed8700 1 -- 172.21.15.32:0/4048996728 wait complete. 2024-05-06T21:24:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.567+0000 7ff7a773d700 1 -- 172.21.15.32:0/2873804542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 msgr2=0x7ff7a0105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.567+0000 7ff7a773d700 1 --2- 172.21.15.32:0/2873804542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 0x7ff7a0105a60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff790009910 tx=0x7ff790009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.567+0000 7ff7a773d700 1 -- 172.21.15.32:0/2873804542 shutdown_connections 2024-05-06T21:24:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.567+0000 7ff7a773d700 1 --2- 172.21.15.32:0/2873804542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 0x7ff7a0105a60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.567+0000 7ff7a773d700 1 --2- 172.21.15.32:0/2873804542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a0100d60 0x7ff7a0103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.567+0000 7ff7a773d700 1 -- 172.21.15.32:0/2873804542 >> 172.21.15.32:0/2873804542 conn(0x7ff7a00fa780 msgr2=0x7ff7a00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.567+0000 7ff7a773d700 1 -- 172.21.15.32:0/2873804542 shutdown_connections 2024-05-06T21:24:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.567+0000 7ff7a773d700 1 -- 172.21.15.32:0/2873804542 wait complete. 2024-05-06T21:24:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.568+0000 7ff7a773d700 1 Processor -- start 2024-05-06T21:24:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.568+0000 7ff7a773d700 1 -- start start 2024-05-06T21:24:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.568+0000 7ff7a773d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a0100d60 0x7ff7a0195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.568+0000 7ff7a773d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 0x7ff7a0196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.568+0000 7ff7a773d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0196640 con 0x7ff7a0103680 2024-05-06T21:24:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.568+0000 7ff7a773d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0196780 con 0x7ff7a0100d60 2024-05-06T21:24:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.568+0000 7ff7a4cd8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 0x7ff7a0196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.568+0000 7ff7a4cd8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 0x7ff7a0196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45786/0 (socket says 172.21.15.32:45786) 2024-05-06T21:24:48.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.568+0000 7ff7a4cd8700 1 -- 172.21.15.32:0/2814658254 learned_addr learned my addr 172.21.15.32:0/2814658254 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7a54d9700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a0100d60 0x7ff7a0195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7a4cd8700 1 -- 172.21.15.32:0/2814658254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a0100d60 msgr2=0x7ff7a0195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7a4cd8700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a0100d60 0x7ff7a0195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7a4cd8700 1 -- 172.21.15.32:0/2814658254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7900095f0 con 0x7ff7a0103680 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7a4cd8700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 0x7ff7a0196020 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff790006010 tx=0x7ff79000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7967fc700 1 -- 172.21.15.32:0/2814658254 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff79001d070 con 0x7ff7a0103680 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7967fc700 1 -- 172.21.15.32:0/2814658254 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff79000f460 con 0x7ff7a0103680 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a019b1d0 con 0x7ff7a0103680 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7967fc700 1 -- 172.21.15.32:0/2814658254 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff790021640 con 0x7ff7a0103680 2024-05-06T21:24:48.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.569+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a019b6c0 con 0x7ff7a0103680 2024-05-06T21:24:48.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.570+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a018fbe0 con 0x7ff7a0103680 2024-05-06T21:24:48.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.571+0000 7ff7967fc700 1 -- 172.21.15.32:0/2814658254 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff79000fab0 con 0x7ff7a0103680 2024-05-06T21:24:48.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.571+0000 7ff7967fc700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff78c06c680 0x7ff78c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:48.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.571+0000 7ff7967fc700 1 -- 172.21.15.32:0/2814658254 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff79008cb80 con 0x7ff7a0103680 2024-05-06T21:24:48.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.571+0000 7ff7a54d9700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff78c06c680 0x7ff78c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:48.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.572+0000 7ff7a54d9700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff78c06c680 0x7ff78c06eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff79c005950 tx=0x7ff79c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:48.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.576+0000 7ff7967fc700 1 -- 172.21.15.32:0/2814658254 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff79005ac90 con 0x7ff7a0103680 2024-05-06T21:24:48.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.848+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff7a002cc30 con 0x7ff7a0103680 2024-05-06T21:24:48.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.849+0000 7ff7967fc700 1 -- 172.21.15.32:0/2814658254 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1835 (secure 0 0 0) 0x7ff79005a820 con 0x7ff7a0103680 2024-05-06T21:24:48.852 INFO:teuthology.orchestra.run.smithi032.stdout:e18 2024-05-06T21:24:48.852 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:24:48.852 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 18 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:24:10.874189+0000 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:24:48.853 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:24:48.854 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:24:48.855 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:24:48.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff78c06c680 msgr2=0x7ff78c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff78c06c680 0x7ff78c06eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff79c005950 tx=0x7ff79c00b410 comp rx=0 tx=0).stop 2024-05-06T21:24:48.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 msgr2=0x7ff7a0196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 0x7ff7a0196020 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff790006010 tx=0x7ff79000bd70 comp rx=0 tx=0).stop 2024-05-06T21:24:48.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 shutdown_connections 2024-05-06T21:24:48.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff78c06c680 0x7ff78c06eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a0100d60 0x7ff7a0195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 --2- 172.21.15.32:0/2814658254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7a0103680 0x7ff7a0196020 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 >> 172.21.15.32:0/2814658254 conn(0x7ff7a00fa780 msgr2=0x7ff7a00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:48.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 shutdown_connections 2024-05-06T21:24:48.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.852+0000 7ff7a773d700 1 -- 172.21.15.32:0/2814658254 wait complete. 2024-05-06T21:24:48.857 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-05-06T21:24:48.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.968+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1606665152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 msgr2=0x7fdf54103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.968+0000 7fdf59fe2700 1 --2- 172.21.15.32:0/1606665152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 0x7fdf54103140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009910 tx=0x7fdf44009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:48.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.968+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1606665152 shutdown_connections 2024-05-06T21:24:48.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.968+0000 7fdf59fe2700 1 --2- 172.21.15.32:0/1606665152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54103680 0x7fdf54105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.968+0000 7fdf59fe2700 1 --2- 172.21.15.32:0/1606665152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 0x7fdf54103140 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.968+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1606665152 >> 172.21.15.32:0/1606665152 conn(0x7fdf540fa780 msgr2=0x7fdf540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:48.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:48 smithi032 ceph-mon[27179]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:48.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:48 smithi032 ceph-mon[27179]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:48.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:48 smithi032 ceph-mon[27179]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:24:48.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:48 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/4048996728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.969+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1606665152 shutdown_connections 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.969+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1606665152 wait complete. 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.969+0000 7fdf59fe2700 1 Processor -- start 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf59fe2700 1 -- start start 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf59fe2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 0x7fdf54195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf59fe2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54103680 0x7fdf54195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf59fe2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf54196610 con 0x7fdf54100d60 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf59fe2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf54196750 con 0x7fdf54103680 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf537fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 0x7fdf54195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf537fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 0x7fdf54195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45818/0 (socket says 172.21.15.32:45818) 2024-05-06T21:24:48.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf537fe700 1 -- 172.21.15.32:0/1043536162 learned_addr learned my addr 172.21.15.32:0/1043536162 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:48.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf537fe700 1 -- 172.21.15.32:0/1043536162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54103680 msgr2=0x7fdf54195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:48.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf537fe700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54103680 0x7fdf54195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:48.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.970+0000 7fdf537fe700 1 -- 172.21.15.32:0/1043536162 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440095f0 con 0x7fdf54100d60 2024-05-06T21:24:48.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.971+0000 7fdf537fe700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 0x7fdf54195ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400bda0 tx=0x7fdf4400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:48.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.971+0000 7fdf50ff9700 1 -- 172.21.15.32:0/1043536162 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf4401d070 con 0x7fdf54100d60 2024-05-06T21:24:48.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.971+0000 7fdf50ff9700 1 -- 172.21.15.32:0/1043536162 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdf4400f460 con 0x7fdf54100d60 2024-05-06T21:24:48.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.971+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5419b1a0 con 0x7fdf54100d60 2024-05-06T21:24:48.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.971+0000 7fdf50ff9700 1 -- 172.21.15.32:0/1043536162 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf44021640 con 0x7fdf54100d60 2024-05-06T21:24:48.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.971+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf540feb50 con 0x7fdf54100d60 2024-05-06T21:24:48.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.972+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5418fbc0 con 0x7fdf54100d60 2024-05-06T21:24:48.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.973+0000 7fdf50ff9700 1 -- 172.21.15.32:0/1043536162 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdf44003a60 con 0x7fdf54100d60 2024-05-06T21:24:48.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.974+0000 7fdf50ff9700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fdf3c070a90 0x7fdf3c072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:48.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.974+0000 7fdf50ff9700 1 -- 172.21.15.32:0/1043536162 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdf4408cc30 con 0x7fdf54100d60 2024-05-06T21:24:48.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.974+0000 7fdf52ffd700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fdf3c070a90 0x7fdf3c072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:48.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.974+0000 7fdf52ffd700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fdf3c070a90 0x7fdf3c072f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005fd0 tx=0x7fdf48005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:48.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:48.979+0000 7fdf50ff9700 1 -- 172.21.15.32:0/1043536162 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdf4405ad40 con 0x7fdf54100d60 2024-05-06T21:24:49.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:48 smithi154 ceph-mon[32880]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:49.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:48 smithi154 ceph-mon[32880]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:49.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:48 smithi154 ceph-mon[32880]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:24:49.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:48 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/4048996728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:24:49.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.232+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf54061190 con 0x7fdf3c070a90 2024-05-06T21:24:49.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.233+0000 7fdf50ff9700 1 -- 172.21.15.32:0/1043536162 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fdf54061190 con 0x7fdf3c070a90 2024-05-06T21:24:49.236 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:24:49.237 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c", 2024-05-06T21:24:49.237 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:24:49.237 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:24:49.237 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [], 2024-05-06T21:24:49.237 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "", 2024-05-06T21:24:49.237 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:f273489c6dcd4bc88409993babd09dd99491162c image", 2024-05-06T21:24:49.237 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:24:49.237 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fdf3c070a90 msgr2=0x7fdf3c072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fdf3c070a90 0x7fdf3c072f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005fd0 tx=0x7fdf48005f60 comp rx=0 tx=0).stop 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 msgr2=0x7fdf54195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 0x7fdf54195ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400bda0 tx=0x7fdf4400be80 comp rx=0 tx=0).stop 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 shutdown_connections 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fdf3c070a90 0x7fdf3c072f40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf54100d60 0x7fdf54195ab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 --2- 172.21.15.32:0/1043536162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54103680 0x7fdf54195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 >> 172.21.15.32:0/1043536162 conn(0x7fdf540fa780 msgr2=0x7fdf540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 shutdown_connections 2024-05-06T21:24:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.235+0000 7fdf59fe2700 1 -- 172.21.15.32:0/1043536162 wait complete. 2024-05-06T21:24:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.356+0000 7f53b4d84700 1 -- 172.21.15.32:0/1170358443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 msgr2=0x7f53b00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.356+0000 7f53b4d84700 1 --2- 172.21.15.32:0/1170358443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 0x7f53b00ff540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009910 tx=0x7f53a0009c20 comp rx=0 tx=0).stop 2024-05-06T21:24:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.356+0000 7f53b4d84700 1 -- 172.21.15.32:0/1170358443 shutdown_connections 2024-05-06T21:24:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.356+0000 7f53b4d84700 1 --2- 172.21.15.32:0/1170358443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01003d0 0x7f53b0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.356+0000 7f53b4d84700 1 --2- 172.21.15.32:0/1170358443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 0x7f53b00ff540 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.356+0000 7f53b4d84700 1 -- 172.21.15.32:0/1170358443 >> 172.21.15.32:0/1170358443 conn(0x7f53b00fa780 msgr2=0x7f53b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.356+0000 7f53b4d84700 1 -- 172.21.15.32:0/1170358443 shutdown_connections 2024-05-06T21:24:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.356+0000 7f53b4d84700 1 -- 172.21.15.32:0/1170358443 wait complete. 2024-05-06T21:24:49.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.357+0000 7f53b4d84700 1 Processor -- start 2024-05-06T21:24:49.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.357+0000 7f53b4d84700 1 -- start start 2024-05-06T21:24:49.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.357+0000 7f53b4d84700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 0x7f53b00690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:49.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.357+0000 7f53b4d84700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01003d0 0x7f53b019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.357+0000 7f53b4d84700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b019ade0 con 0x7f53b00ff130 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.357+0000 7f53b4d84700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b019af20 con 0x7f53b01003d0 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 0x7f53b00690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 0x7f53b00690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45836/0 (socket says 172.21.15.32:45836) 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53ae59c700 1 -- 172.21.15.32:0/1301900225 learned_addr learned my addr 172.21.15.32:0/1301900225 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53ae59c700 1 -- 172.21.15.32:0/1301900225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01003d0 msgr2=0x7f53b019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53add9b700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01003d0 0x7f53b019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53ae59c700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01003d0 0x7f53b019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53ae59c700 1 -- 172.21.15.32:0/1301900225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a00095f0 con 0x7f53b00ff130 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53add9b700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01003d0 0x7f53b019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53ae59c700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 0x7f53b00690a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f53a0006010 tx=0x7f53a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f539f7fe700 1 -- 172.21.15.32:0/1301900225 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a001d070 con 0x7f53b00ff130 2024-05-06T21:24:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f539f7fe700 1 -- 172.21.15.32:0/1301900225 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f53a000f460 con 0x7f53b00ff130 2024-05-06T21:24:49.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b019b1a0 con 0x7f53b00ff130 2024-05-06T21:24:49.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.358+0000 7f539f7fe700 1 -- 172.21.15.32:0/1301900225 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a0017630 con 0x7f53b00ff130 2024-05-06T21:24:49.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.359+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b019b690 con 0x7f53b00ff130 2024-05-06T21:24:49.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.359+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b0107c10 con 0x7f53b00ff130 2024-05-06T21:24:49.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.360+0000 7f539f7fe700 1 -- 172.21.15.32:0/1301900225 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f53a0003a60 con 0x7f53b00ff130 2024-05-06T21:24:49.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.361+0000 7f539f7fe700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f539806c680 0x7f539806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:24:49.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.361+0000 7f539f7fe700 1 -- 172.21.15.32:0/1301900225 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f53a008ce10 con 0x7f53b00ff130 2024-05-06T21:24:49.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.361+0000 7f53add9b700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f539806c680 0x7f539806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:24:49.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.361+0000 7f53add9b700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f539806c680 0x7f539806eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005fd0 tx=0x7f53a4005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:24:49.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.366+0000 7f539f7fe700 1 -- 172.21.15.32:0/1301900225 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f53a005af20 con 0x7f53b00ff130 2024-05-06T21:24:49.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.661+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f53b0107e30 con 0x7f53b00ff130 2024-05-06T21:24:49.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.661+0000 7f539f7fe700 1 -- 172.21.15.32:0/1301900225 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f53a005aab0 con 0x7f53b00ff130 2024-05-06T21:24:49.665 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:24:49.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.663+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f539806c680 msgr2=0x7f539806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:49.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.663+0000 7f53b4d84700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f539806c680 0x7f539806eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005fd0 tx=0x7f53a4005ee0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.663+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 msgr2=0x7f53b00690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:24:49.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.663+0000 7f53b4d84700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 0x7f53b00690a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f53a0006010 tx=0x7f53a000be20 comp rx=0 tx=0).stop 2024-05-06T21:24:49.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.663+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 shutdown_connections 2024-05-06T21:24:49.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.663+0000 7f53b4d84700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f539806c680 0x7f539806eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.663+0000 7f53b4d84700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00ff130 0x7f53b00690a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.663+0000 7f53b4d84700 1 --2- 172.21.15.32:0/1301900225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01003d0 0x7f53b019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:24:49.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.663+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 >> 172.21.15.32:0/1301900225 conn(0x7f53b00fa780 msgr2=0x7f53b0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:24:49.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.664+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 shutdown_connections 2024-05-06T21:24:49.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:24:49.664+0000 7f53b4d84700 1 -- 172.21.15.32:0/1301900225 wait complete. 2024-05-06T21:24:49.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:49 smithi032 ceph-mon[27179]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:49.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:49 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2814658254' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:24:49.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:49 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1301900225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:24:50.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:49 smithi154 ceph-mon[32880]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:50.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:49 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2814658254' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:24:50.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:49 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1301900225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:24:50.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:50 smithi032 ceph-mon[27179]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:50.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:50 smithi032 ceph-mon[27179]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:24:51.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:50 smithi154 ceph-mon[32880]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:24:51.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:50 smithi154 ceph-mon[32880]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:24:52.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:52 smithi032 ceph-mon[27179]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:24:53.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:52 smithi154 ceph-mon[32880]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:24:54.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:54 smithi032 ceph-mon[27179]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:24:55.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:54 smithi154 ceph-mon[32880]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:24:56.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:55 smithi032 ceph-mon[27179]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:24:56.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:55 smithi154 ceph-mon[32880]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:24:57.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:24:58.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:57 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:24:58.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:24:58 smithi032 ceph-mon[27179]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:24:59.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:24:58 smithi154 ceph-mon[32880]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:00.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:00 smithi032 ceph-mon[27179]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:01.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:00 smithi154 ceph-mon[32880]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:02.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:02 smithi032 ceph-mon[27179]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:03.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:02 smithi154 ceph-mon[32880]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:04.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:04 smithi032 ceph-mon[27179]: pgmap v218: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:05.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:04 smithi154 ceph-mon[32880]: pgmap v218: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:06.226 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:05 smithi032 ceph-mon[27179]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T21:25:06.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:05 smithi154 ceph-mon[32880]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T21:25:08.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:08 smithi032 ceph-mon[27179]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T21:25:09.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:08 smithi154 ceph-mon[32880]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T21:25:10.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:10 smithi032 ceph-mon[27179]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T21:25:11.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:10 smithi154 ceph-mon[32880]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-06T21:25:12.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:12 smithi032 ceph-mon[27179]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:25:12.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:12 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:25:13.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:12 smithi154 ceph-mon[32880]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:25:13.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:12 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:25:14.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:14 smithi032 ceph-mon[27179]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:25:15.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:14 smithi154 ceph-mon[32880]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:25:16.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:15 smithi032 ceph-mon[27179]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:25:16.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:15 smithi154 ceph-mon[32880]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-06T21:25:18.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:18 smithi032 ceph-mon[27179]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:25:18.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:18 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:18.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:18 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:25:18.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:18 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:19.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:18 smithi154 ceph-mon[32880]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:25:19.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:18 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:19.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:18 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:25:19.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:18 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:19.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.785+0000 7f9d4bf59700 1 -- 172.21.15.32:0/2476583782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 msgr2=0x7f9d440ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:19.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.785+0000 7f9d4bf59700 1 --2- 172.21.15.32:0/2476583782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 0x7f9d440ff550 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009910 tx=0x7f9d40009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.785+0000 7f9d4bf59700 1 -- 172.21.15.32:0/2476583782 shutdown_connections 2024-05-06T21:25:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.785+0000 7f9d4bf59700 1 --2- 172.21.15.32:0/2476583782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d44100340 0x7f9d44100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.785+0000 7f9d4bf59700 1 --2- 172.21.15.32:0/2476583782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 0x7f9d440ff550 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.785+0000 7f9d4bf59700 1 -- 172.21.15.32:0/2476583782 >> 172.21.15.32:0/2476583782 conn(0x7f9d440fa6d0 msgr2=0x7f9d440fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.785+0000 7f9d4bf59700 1 -- 172.21.15.32:0/2476583782 shutdown_connections 2024-05-06T21:25:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.785+0000 7f9d4bf59700 1 -- 172.21.15.32:0/2476583782 wait complete. 2024-05-06T21:25:19.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.786+0000 7f9d4bf59700 1 Processor -- start 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.786+0000 7f9d4bf59700 1 -- start start 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.786+0000 7f9d4bf59700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 0x7f9d44195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.786+0000 7f9d4bf59700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d44100340 0x7f9d44195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.786+0000 7f9d4bf59700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44196610 con 0x7f9d440ff140 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.786+0000 7f9d4bf59700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44196750 con 0x7f9d44100340 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d49cf5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 0x7f9d44195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d49cf5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 0x7f9d44195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37986/0 (socket says 172.21.15.32:37986) 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d49cf5700 1 -- 172.21.15.32:0/16046004 learned_addr learned my addr 172.21.15.32:0/16046004 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d494f4700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d44100340 0x7f9d44195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d49cf5700 1 -- 172.21.15.32:0/16046004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d44100340 msgr2=0x7f9d44195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d49cf5700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d44100340 0x7f9d44195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d49cf5700 1 -- 172.21.15.32:0/16046004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d400095f0 con 0x7f9d440ff140 2024-05-06T21:25:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d49cf5700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 0x7f9d44195ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000f690 tx=0x7f9d4000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:19.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d3affd700 1 -- 172.21.15.32:0/16046004 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d4001d070 con 0x7f9d440ff140 2024-05-06T21:25:19.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d3affd700 1 -- 172.21.15.32:0/16046004 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d400052a0 con 0x7f9d440ff140 2024-05-06T21:25:19.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4419b1a0 con 0x7f9d440ff140 2024-05-06T21:25:19.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.787+0000 7f9d3affd700 1 -- 172.21.15.32:0/16046004 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d40022470 con 0x7f9d440ff140 2024-05-06T21:25:19.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.788+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4419b690 con 0x7f9d440ff140 2024-05-06T21:25:19.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.789+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d44107c90 con 0x7f9d440ff140 2024-05-06T21:25:19.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.789+0000 7f9d3affd700 1 -- 172.21.15.32:0/16046004 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9d4000fa20 con 0x7f9d440ff140 2024-05-06T21:25:19.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.790+0000 7f9d3affd700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d3006c680 0x7f9d3006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:19.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.790+0000 7f9d3affd700 1 -- 172.21.15.32:0/16046004 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9d4008ccf0 con 0x7f9d440ff140 2024-05-06T21:25:19.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.790+0000 7f9d494f4700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d3006c680 0x7f9d3006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:19.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.791+0000 7f9d494f4700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d3006c680 0x7f9d3006eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009c60 tx=0x7f9d34009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:19.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:19.795+0000 7f9d3affd700 1 -- 172.21.15.32:0/16046004 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9d4005ae80 con 0x7f9d440ff140 2024-05-06T21:25:19.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:19 smithi032 ceph-mon[27179]: Upgrade: Target is version 19.0.0-2497-gf273489c (unknown) 2024-05-06T21:25:19.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:19 smithi032 ceph-mon[27179]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, digests ['quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4'] 2024-05-06T21:25:19.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:19 smithi032 ceph-mon[27179]: Upgrade: Need to upgrade myself (mgr.smithi032.ecoohh) 2024-05-06T21:25:19.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:19 smithi032 ceph-mon[27179]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 on smithi154 2024-05-06T21:25:20.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.042+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d4419bd20 con 0x7f9d3006c680 2024-05-06T21:25:20.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.044+0000 7f9d3affd700 1 -- 172.21.15.32:0/16046004 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f9d4419bd20 con 0x7f9d3006c680 2024-05-06T21:25:20.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d3006c680 msgr2=0x7f9d3006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d3006c680 0x7f9d3006eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009c60 tx=0x7f9d34009260 comp rx=0 tx=0).stop 2024-05-06T21:25:20.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 msgr2=0x7f9d44195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 0x7f9d44195ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000f690 tx=0x7f9d4000f6c0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 shutdown_connections 2024-05-06T21:25:20.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f9d3006c680 0x7f9d3006eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d440ff140 0x7f9d44195ab0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 --2- 172.21.15.32:0/16046004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d44100340 0x7f9d44195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 >> 172.21.15.32:0/16046004 conn(0x7f9d440fa6d0 msgr2=0x7f9d44068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:20.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 shutdown_connections 2024-05-06T21:25:20.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.046+0000 7f9d4bf59700 1 -- 172.21.15.32:0/16046004 wait complete. 2024-05-06T21:25:20.060 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:25:20.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:19 smithi154 ceph-mon[32880]: Upgrade: Target is version 19.0.0-2497-gf273489c (unknown) 2024-05-06T21:25:20.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:19 smithi154 ceph-mon[32880]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, digests ['quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4'] 2024-05-06T21:25:20.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:19 smithi154 ceph-mon[32880]: Upgrade: Need to upgrade myself (mgr.smithi032.ecoohh) 2024-05-06T21:25:20.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:19 smithi154 ceph-mon[32880]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 on smithi154 2024-05-06T21:25:20.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.161+0000 7fc0d3267700 1 -- 172.21.15.32:0/2221381437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 msgr2=0x7fc0cc1028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.161+0000 7fc0d3267700 1 --2- 172.21.15.32:0/2221381437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 0x7fc0cc1028a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009910 tx=0x7fc0c8009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:20.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.161+0000 7fc0d3267700 1 -- 172.21.15.32:0/2221381437 shutdown_connections 2024-05-06T21:25:20.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.161+0000 7fc0d3267700 1 --2- 172.21.15.32:0/2221381437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0cc103640 0x7fc0cc103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.161+0000 7fc0d3267700 1 --2- 172.21.15.32:0/2221381437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 0x7fc0cc1028a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.161+0000 7fc0d3267700 1 -- 172.21.15.32:0/2221381437 >> 172.21.15.32:0/2221381437 conn(0x7fc0cc0fda60 msgr2=0x7fc0cc0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:20.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.162+0000 7fc0d3267700 1 -- 172.21.15.32:0/2221381437 shutdown_connections 2024-05-06T21:25:20.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.162+0000 7fc0d3267700 1 -- 172.21.15.32:0/2221381437 wait complete. 2024-05-06T21:25:20.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.162+0000 7fc0d3267700 1 Processor -- start 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.162+0000 7fc0d3267700 1 -- start start 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d3267700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 0x7fc0cc197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d3267700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0cc103640 0x7fc0cc198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d3267700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc198860 con 0x7fc0cc102490 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d3267700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc19d270 con 0x7fc0cc103640 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d1003700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 0x7fc0cc197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d1003700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 0x7fc0cc197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38004/0 (socket says 172.21.15.32:38004) 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d1003700 1 -- 172.21.15.32:0/1502796097 learned_addr learned my addr 172.21.15.32:0/1502796097 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d0802700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0cc103640 0x7fc0cc198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d1003700 1 -- 172.21.15.32:0/1502796097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0cc103640 msgr2=0x7fc0cc198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d1003700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0cc103640 0x7fc0cc198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d1003700 1 -- 172.21.15.32:0/1502796097 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c80095f0 con 0x7fc0cc102490 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0d1003700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 0x7fc0cc197d00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8000c00 tx=0x7fc0c800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0c27fc700 1 -- 172.21.15.32:0/1502796097 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0c801d070 con 0x7fc0cc102490 2024-05-06T21:25:20.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.163+0000 7fc0c27fc700 1 -- 172.21.15.32:0/1502796097 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0c8005dc0 con 0x7fc0cc102490 2024-05-06T21:25:20.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.164+0000 7fc0c27fc700 1 -- 172.21.15.32:0/1502796097 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0c8022470 con 0x7fc0cc102490 2024-05-06T21:25:20.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.164+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc19d410 con 0x7fc0cc102490 2024-05-06T21:25:20.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.164+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc19d8d0 con 0x7fc0cc102490 2024-05-06T21:25:20.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.165+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0cc10af90 con 0x7fc0cc102490 2024-05-06T21:25:20.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.166+0000 7fc0c27fc700 1 -- 172.21.15.32:0/1502796097 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc0c8003810 con 0x7fc0cc102490 2024-05-06T21:25:20.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.166+0000 7fc0c27fc700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc0b806c680 0x7fc0b806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:20.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.166+0000 7fc0c27fc700 1 -- 172.21.15.32:0/1502796097 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc0c808cd20 con 0x7fc0cc102490 2024-05-06T21:25:20.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.166+0000 7fc0d0802700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc0b806c680 0x7fc0b806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:20.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.167+0000 7fc0d0802700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc0b806c680 0x7fc0b806eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009c60 tx=0x7fc0bc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:20.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.171+0000 7fc0c27fc700 1 -- 172.21.15.32:0/1502796097 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc0c8057420 con 0x7fc0cc102490 2024-05-06T21:25:20.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.414+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0cc19df30 con 0x7fc0b806c680 2024-05-06T21:25:20.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.416+0000 7fc0c27fc700 1 -- 172.21.15.32:0/1502796097 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fc0cc19df30 con 0x7fc0b806c680 2024-05-06T21:25:20.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc0b806c680 msgr2=0x7fc0b806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc0b806c680 0x7fc0b806eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009c60 tx=0x7fc0bc009260 comp rx=0 tx=0).stop 2024-05-06T21:25:20.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 msgr2=0x7fc0cc197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 0x7fc0cc197d00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8000c00 tx=0x7fc0c800f690 comp rx=0 tx=0).stop 2024-05-06T21:25:20.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 shutdown_connections 2024-05-06T21:25:20.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc0b806c680 0x7fc0b806eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0cc102490 0x7fc0cc197d00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 --2- 172.21.15.32:0/1502796097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0cc103640 0x7fc0cc198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 >> 172.21.15.32:0/1502796097 conn(0x7fc0cc0fda60 msgr2=0x7fc0cc106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:20.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 shutdown_connections 2024-05-06T21:25:20.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.418+0000 7fc0d3267700 1 -- 172.21.15.32:0/1502796097 wait complete. 2024-05-06T21:25:20.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.530+0000 7f44231ef700 1 -- 172.21.15.32:0/398499374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c069270 msgr2=0x7f441c102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.530+0000 7f44231ef700 1 --2- 172.21.15.32:0/398499374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c069270 0x7f441c102dd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4410009910 tx=0x7f4410009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:20.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.530+0000 7f44231ef700 1 -- 172.21.15.32:0/398499374 shutdown_connections 2024-05-06T21:25:20.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.530+0000 7f44231ef700 1 --2- 172.21.15.32:0/398499374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f441c103310 0x7f441c105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.530+0000 7f44231ef700 1 --2- 172.21.15.32:0/398499374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c069270 0x7f441c102dd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.530+0000 7f44231ef700 1 -- 172.21.15.32:0/398499374 >> 172.21.15.32:0/398499374 conn(0x7f441c0fa780 msgr2=0x7f441c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:20.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.530+0000 7f44231ef700 1 -- 172.21.15.32:0/398499374 shutdown_connections 2024-05-06T21:25:20.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.530+0000 7f44231ef700 1 -- 172.21.15.32:0/398499374 wait complete. 2024-05-06T21:25:20.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f44231ef700 1 Processor -- start 2024-05-06T21:25:20.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f44231ef700 1 -- start start 2024-05-06T21:25:20.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f44231ef700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c103310 0x7f441c197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:20.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f44231ef700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f441c198220 0x7f441c19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:20.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f44231ef700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c198690 con 0x7f441c103310 2024-05-06T21:25:20.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f44231ef700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c198800 con 0x7f441c198220 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f4420f8b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c103310 0x7f441c197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f4420f8b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c103310 0x7f441c197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38020/0 (socket says 172.21.15.32:38020) 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f4420f8b700 1 -- 172.21.15.32:0/183268728 learned_addr learned my addr 172.21.15.32:0/183268728 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.531+0000 7f441bfff700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f441c198220 0x7f441c19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.532+0000 7f4420f8b700 1 -- 172.21.15.32:0/183268728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f441c198220 msgr2=0x7f441c19d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.532+0000 7f4420f8b700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f441c198220 0x7f441c19d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.532+0000 7f4420f8b700 1 -- 172.21.15.32:0/183268728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100095f0 con 0x7f441c103310 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.532+0000 7f4420f8b700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c103310 0x7f441c197ce0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4410000c00 tx=0x7f441000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.532+0000 7f4419ffb700 1 -- 172.21.15.32:0/183268728 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f441001d070 con 0x7f441c103310 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.532+0000 7f4419ffb700 1 -- 172.21.15.32:0/183268728 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4410005dc0 con 0x7f441c103310 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.532+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c19d790 con 0x7f441c103310 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.532+0000 7f4419ffb700 1 -- 172.21.15.32:0/183268728 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4410022470 con 0x7f441c103310 2024-05-06T21:25:20.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.532+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c19dc50 con 0x7f441c103310 2024-05-06T21:25:20.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.533+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c0fc340 con 0x7f441c103310 2024-05-06T21:25:20.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.534+0000 7f4419ffb700 1 -- 172.21.15.32:0/183268728 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4410003810 con 0x7f441c103310 2024-05-06T21:25:20.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.534+0000 7f4419ffb700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f440c06c680 0x7f440c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:20.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.535+0000 7f4419ffb700 1 -- 172.21.15.32:0/183268728 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f441008cd20 con 0x7f441c103310 2024-05-06T21:25:20.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.535+0000 7f441bfff700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f440c06c680 0x7f440c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:20.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.535+0000 7f441bfff700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f440c06c680 0x7f440c06eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4408009c60 tx=0x7f4408009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:20.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.539+0000 7f4419ffb700 1 -- 172.21.15.32:0/183268728 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4410057420 con 0x7f441c103310 2024-05-06T21:25:20.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.764+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f441c02cdb0 con 0x7f440c06c680 2024-05-06T21:25:20.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.784+0000 7f4419ffb700 1 -- 172.21.15.32:0/183268728 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f441c02cdb0 con 0x7f440c06c680 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (5m) 58s ago 6m 24.7M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (7m) 58s ago 7m 7428k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (6m) 64s ago 6m 7360k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (7m) 58s ago 7m 6665k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (6m) 64s ago 6m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (5m) 58s ago 6m 85.3M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (86s) 58s ago 86s 11.4M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (79s) 58s ago 78s 17.3M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (83s) 64s ago 83s 18.5M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (76s) 64s ago 76s 13.0M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:25:20.787 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:9283,8765,8443 running (8m) 58s ago 8m 487M - 18.2.0 dc2bc1663786 7711cd2179ff 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (6m) 64s ago 6m 439M - 18.2.0 dc2bc1663786 f1d5be241e61 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (8m) 58s ago 8m 44.9M 2048M 18.2.0 dc2bc1663786 b06a214f4520 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (5m) 64s ago 5m 35.9M 2048M 18.2.0 dc2bc1663786 8a37ef7f53f9 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (7m) 58s ago 7m 16.1M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (6m) 64s ago 6m 16.6M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (5m) 58s ago 5m 48.3M 3948M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (4m) 58s ago 4m 47.2M 3948M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (4m) 58s ago 4m 48.4M 3948M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (3m) 64s ago 3m 46.0M 4970M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (3m) 64s ago 3m 43.8M 4970M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (2m) 64s ago 2m 44.9M 4970M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:25:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (5m) 58s ago 6m 63.3M - 2.43.0 a07b618ecd1d eb2dd06c5402 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f440c06c680 msgr2=0x7f440c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f440c06c680 0x7f440c06eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4408009c60 tx=0x7f4408009260 comp rx=0 tx=0).stop 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c103310 msgr2=0x7f441c197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c103310 0x7f441c197ce0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4410000c00 tx=0x7f441000f690 comp rx=0 tx=0).stop 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 shutdown_connections 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f440c06c680 0x7f440c06eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f441c103310 0x7f441c197ce0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 --2- 172.21.15.32:0/183268728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f441c198220 0x7f441c19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 >> 172.21.15.32:0/183268728 conn(0x7f441c0fa780 msgr2=0x7f441c100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 shutdown_connections 2024-05-06T21:25:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.787+0000 7f44231ef700 1 -- 172.21.15.32:0/183268728 wait complete. 2024-05-06T21:25:20.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.896+0000 7f7d7e25c700 1 -- 172.21.15.32:0/2743579860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78100240 msgr2=0x7f7d78100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.896+0000 7f7d7e25c700 1 --2- 172.21.15.32:0/2743579860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78100240 0x7f7d78100650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009910 tx=0x7f7d68009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:20.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.896+0000 7f7d7e25c700 1 -- 172.21.15.32:0/2743579860 shutdown_connections 2024-05-06T21:25:20.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.896+0000 7f7d7e25c700 1 --2- 172.21.15.32:0/2743579860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d78101440 0x7f7d78101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.896+0000 7f7d7e25c700 1 --2- 172.21.15.32:0/2743579860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78100240 0x7f7d78100650 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.896+0000 7f7d7e25c700 1 -- 172.21.15.32:0/2743579860 >> 172.21.15.32:0/2743579860 conn(0x7f7d780fb7f0 msgr2=0x7f7d780fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:20.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.896+0000 7f7d7e25c700 1 -- 172.21.15.32:0/2743579860 shutdown_connections 2024-05-06T21:25:20.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.896+0000 7f7d7e25c700 1 -- 172.21.15.32:0/2743579860 wait complete. 2024-05-06T21:25:20.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.897+0000 7f7d7e25c700 1 Processor -- start 2024-05-06T21:25:20.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d7e25c700 1 -- start start 2024-05-06T21:25:20.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d7e25c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d78100240 0x7f7d78195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d7e25c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78101440 0x7f7d78195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d7e25c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78196610 con 0x7f7d78101440 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d7e25c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78196750 con 0x7f7d78100240 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d76ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78101440 0x7f7d78195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d777fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d78100240 0x7f7d78195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d76ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78101440 0x7f7d78195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38034/0 (socket says 172.21.15.32:38034) 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d76ffd700 1 -- 172.21.15.32:0/1752965541 learned_addr learned my addr 172.21.15.32:0/1752965541 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d76ffd700 1 -- 172.21.15.32:0/1752965541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d78100240 msgr2=0x7f7d78195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d76ffd700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d78100240 0x7f7d78195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d76ffd700 1 -- 172.21.15.32:0/1752965541 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d680095f0 con 0x7f7d78101440 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d777fe700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d78100240 0x7f7d78195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:25:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.898+0000 7f7d76ffd700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78101440 0x7f7d78195ff0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00e920 tx=0x7f7d6c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:20.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.899+0000 7f7d74ff9700 1 -- 172.21.15.32:0/1752965541 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d6c00c9d0 con 0x7f7d78101440 2024-05-06T21:25:20.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.899+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7819b200 con 0x7f7d78101440 2024-05-06T21:25:20.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.899+0000 7f7d74ff9700 1 -- 172.21.15.32:0/1752965541 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7d6c010430 con 0x7f7d78101440 2024-05-06T21:25:20.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.899+0000 7f7d74ff9700 1 -- 172.21.15.32:0/1752965541 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d6c018650 con 0x7f7d78101440 2024-05-06T21:25:20.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.899+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7819b750 con 0x7f7d78101440 2024-05-06T21:25:20.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.900+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d78108d90 con 0x7f7d78101440 2024-05-06T21:25:20.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.901+0000 7f7d74ff9700 1 -- 172.21.15.32:0/1752965541 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7d6c0105a0 con 0x7f7d78101440 2024-05-06T21:25:20.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.902+0000 7f7d74ff9700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d6006c680 0x7f7d6006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:20.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.902+0000 7f7d74ff9700 1 -- 172.21.15.32:0/1752965541 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7d6c014070 con 0x7f7d78101440 2024-05-06T21:25:20.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.902+0000 7f7d777fe700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d6006c680 0x7f7d6006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:20.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.902+0000 7f7d777fe700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d6006c680 0x7f7d6006eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800b6f0 tx=0x7f7d68005940 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:20.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:20.906+0000 7f7d74ff9700 1 -- 172.21.15.32:0/1752965541 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7d6c051720 con 0x7f7d78101440 2024-05-06T21:25:20.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:20 smithi032 ceph-mon[27179]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:25:21.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:20 smithi154 ceph-mon[32880]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:25:21.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.201+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7d78108f50 con 0x7f7d78101440 2024-05-06T21:25:21.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.202+0000 7f7d74ff9700 1 -- 172.21.15.32:0/1752965541 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f7d6c059dc0 con 0x7f7d78101440 2024-05-06T21:25:21.206 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:25:21.206 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:25:21.206 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:25:21.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:25:21.206 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:25:21.206 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:25:21.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:25:21.207 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d6006c680 msgr2=0x7f7d6006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d6006c680 0x7f7d6006eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800b6f0 tx=0x7f7d68005940 comp rx=0 tx=0).stop 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78101440 msgr2=0x7f7d78195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78101440 0x7f7d78195ff0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00e920 tx=0x7f7d6c00ec30 comp rx=0 tx=0).stop 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 shutdown_connections 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7d6006c680 0x7f7d6006eb30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d78100240 0x7f7d78195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 --2- 172.21.15.32:0/1752965541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d78101440 0x7f7d78195ff0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 >> 172.21.15.32:0/1752965541 conn(0x7f7d780fb7f0 msgr2=0x7f7d78104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 shutdown_connections 2024-05-06T21:25:21.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.204+0000 7f7d7e25c700 1 -- 172.21.15.32:0/1752965541 wait complete. 2024-05-06T21:25:21.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.333+0000 7f7cdbb22700 1 -- 172.21.15.32:0/3257480020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 msgr2=0x7f7cd41028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.333+0000 7f7cdbb22700 1 --2- 172.21.15.32:0/3257480020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 0x7f7cd41028a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009910 tx=0x7f7cd0009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:21.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.333+0000 7f7cdbb22700 1 -- 172.21.15.32:0/3257480020 shutdown_connections 2024-05-06T21:25:21.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.333+0000 7f7cdbb22700 1 --2- 172.21.15.32:0/3257480020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4103640 0x7f7cd4103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.333+0000 7f7cdbb22700 1 --2- 172.21.15.32:0/3257480020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 0x7f7cd41028a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.333+0000 7f7cdbb22700 1 -- 172.21.15.32:0/3257480020 >> 172.21.15.32:0/3257480020 conn(0x7f7cd40fda60 msgr2=0x7f7cd40ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:21.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.334+0000 7f7cdbb22700 1 -- 172.21.15.32:0/3257480020 shutdown_connections 2024-05-06T21:25:21.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.334+0000 7f7cdbb22700 1 -- 172.21.15.32:0/3257480020 wait complete. 2024-05-06T21:25:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.334+0000 7f7cdbb22700 1 Processor -- start 2024-05-06T21:25:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.334+0000 7f7cdbb22700 1 -- start start 2024-05-06T21:25:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cdbb22700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 0x7f7cd4197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cdbb22700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4103640 0x7f7cd4198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cdbb22700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd4198860 con 0x7f7cd4102490 2024-05-06T21:25:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cdbb22700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd419d270 con 0x7f7cd4103640 2024-05-06T21:25:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cd98be700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 0x7f7cd4197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cd98be700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 0x7f7cd4197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38056/0 (socket says 172.21.15.32:38056) 2024-05-06T21:25:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cd98be700 1 -- 172.21.15.32:0/2553850231 learned_addr learned my addr 172.21.15.32:0/2553850231 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cd90bd700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4103640 0x7f7cd4198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cd98be700 1 -- 172.21.15.32:0/2553850231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4103640 msgr2=0x7f7cd4198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cd98be700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4103640 0x7f7cd4198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cd98be700 1 -- 172.21.15.32:0/2553850231 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd00095f0 con 0x7f7cd4102490 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.335+0000 7f7cd98be700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 0x7f7cd4197d00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000bda0 tx=0x7f7cd000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.336+0000 7f7ccaffd700 1 -- 172.21.15.32:0/2553850231 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd001d070 con 0x7f7cd4102490 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.336+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd419d410 con 0x7f7cd4102490 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.336+0000 7f7ccaffd700 1 -- 172.21.15.32:0/2553850231 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7cd000f460 con 0x7f7cd4102490 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.336+0000 7f7ccaffd700 1 -- 172.21.15.32:0/2553850231 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd0021640 con 0x7f7cd4102490 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.336+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd419d8d0 con 0x7f7cd4102490 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.337+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd410af90 con 0x7f7cd4102490 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.338+0000 7f7ccaffd700 1 -- 172.21.15.32:0/2553850231 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7cd000f5d0 con 0x7f7cd4102490 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.339+0000 7f7ccaffd700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.339+0000 7f7ccaffd700 1 -- 172.21.15.32:0/2553850231 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7cd008cb40 con 0x7f7cd4102490 2024-05-06T21:25:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.339+0000 7f7cd90bd700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.339+0000 7f7cd90bd700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4007be0 tx=0x7f7cc40073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.344+0000 7f7ccaffd700 1 -- 172.21.15.32:0/2553850231 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7cd0057240 con 0x7f7cd4102490 2024-05-06T21:25:21.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.597+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7cd419dff0 con 0x7f7cd4102490 2024-05-06T21:25:21.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.598+0000 7f7ccaffd700 1 -- 172.21.15.32:0/2553850231 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f7cd005a860 con 0x7f7cd4102490 2024-05-06T21:25:21.601 INFO:teuthology.orchestra.run.smithi032.stdout:e18 2024-05-06T21:25:21.601 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:25:21.601 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:25:21.601 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:25:21.601 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:25:21.601 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:25:21.601 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:25:21.601 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 18 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:24:10.874189+0000 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:25:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:25:21.603 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:25:21.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:25:21.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:25:21.604 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:25:21.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:25:21.604 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:25:21.604 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 msgr2=0x7f7cc006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4007be0 tx=0x7f7cc40073d0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 msgr2=0x7f7cd4197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 0x7f7cd4197d00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000bda0 tx=0x7f7cd000bdd0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 shutdown_connections 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f7cc006c680 0x7f7cc006eb30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cd4102490 0x7f7cd4197d00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 --2- 172.21.15.32:0/2553850231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4103640 0x7f7cd4198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 >> 172.21.15.32:0/2553850231 conn(0x7f7cd40fda60 msgr2=0x7f7cd4106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 shutdown_connections 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.601+0000 7f7cdbb22700 1 -- 172.21.15.32:0/2553850231 wait complete. 2024-05-06T21:25:21.605 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-05-06T21:25:21.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.716+0000 7ff38bd1f700 1 -- 172.21.15.32:0/2818778497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840fffb0 msgr2=0x7ff384100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.716+0000 7ff38bd1f700 1 --2- 172.21.15.32:0/2818778497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840fffb0 0x7ff384100440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff374009910 tx=0x7ff374009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:21.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.717+0000 7ff38bd1f700 1 -- 172.21.15.32:0/2818778497 shutdown_connections 2024-05-06T21:25:21.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.717+0000 7ff38bd1f700 1 --2- 172.21.15.32:0/2818778497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840fffb0 0x7ff384100440 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.717+0000 7ff38bd1f700 1 --2- 172.21.15.32:0/2818778497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3840ff660 0x7ff3840ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.717+0000 7ff38bd1f700 1 -- 172.21.15.32:0/2818778497 >> 172.21.15.32:0/2818778497 conn(0x7ff3840f9f10 msgr2=0x7ff3840fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:21.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.717+0000 7ff38bd1f700 1 -- 172.21.15.32:0/2818778497 shutdown_connections 2024-05-06T21:25:21.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.717+0000 7ff38bd1f700 1 -- 172.21.15.32:0/2818778497 wait complete. 2024-05-06T21:25:21.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.717+0000 7ff38bd1f700 1 Processor -- start 2024-05-06T21:25:21.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.717+0000 7ff38bd1f700 1 -- start start 2024-05-06T21:25:21.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff38bd1f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840ff660 0x7ff3840fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:21.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff38bd1f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3840fffb0 0x7ff38419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:21.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff38bd1f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38419ae10 con 0x7ff3840ff660 2024-05-06T21:25:21.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff38bd1f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38419af50 con 0x7ff3840fffb0 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff389abb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840ff660 0x7ff3840fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff389abb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840ff660 0x7ff3840fedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44440/0 (socket says 172.21.15.32:44440) 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff389abb700 1 -- 172.21.15.32:0/285356017 learned_addr learned my addr 172.21.15.32:0/285356017 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff3892ba700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3840fffb0 0x7ff38419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff389abb700 1 -- 172.21.15.32:0/285356017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3840fffb0 msgr2=0x7ff38419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff389abb700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3840fffb0 0x7ff38419a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.718+0000 7ff389abb700 1 -- 172.21.15.32:0/285356017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740095f0 con 0x7ff3840ff660 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.719+0000 7ff389abb700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840ff660 0x7ff3840fedc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff38000d900 tx=0x7ff38000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.719+0000 7ff37affd700 1 -- 172.21.15.32:0/285356017 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3800041f0 con 0x7ff3840ff660 2024-05-06T21:25:21.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.719+0000 7ff37affd700 1 -- 172.21.15.32:0/285356017 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff380004350 con 0x7ff3840ff660 2024-05-06T21:25:21.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.719+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38419b230 con 0x7ff3840ff660 2024-05-06T21:25:21.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.719+0000 7ff37affd700 1 -- 172.21.15.32:0/285356017 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff380003d20 con 0x7ff3840ff660 2024-05-06T21:25:21.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.719+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38419b750 con 0x7ff3840ff660 2024-05-06T21:25:21.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.720+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff384107c00 con 0x7ff3840ff660 2024-05-06T21:25:21.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.721+0000 7ff37affd700 1 -- 172.21.15.32:0/285356017 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff380009730 con 0x7ff3840ff660 2024-05-06T21:25:21.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.721+0000 7ff37affd700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff37006c680 0x7ff37006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:21.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.721+0000 7ff3892ba700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff37006c680 0x7ff37006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:21.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.721+0000 7ff37affd700 1 -- 172.21.15.32:0/285356017 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff38008b710 con 0x7ff3840ff660 2024-05-06T21:25:21.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.722+0000 7ff3892ba700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff37006c680 0x7ff37006eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff374006010 tx=0x7ff374005ec0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:21.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.726+0000 7ff37affd700 1 -- 172.21.15.32:0/285356017 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff3800598a0 con 0x7ff3840ff660 2024-05-06T21:25:21.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.957+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff384104d70 con 0x7ff37006c680 2024-05-06T21:25:21.960 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:21 smithi032 ceph-mon[27179]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:21.960 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:21 smithi032 ceph-mon[27179]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:21.960 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:21 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1752965541' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:25:21.960 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:21 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2553850231' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:25:21.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.958+0000 7ff37affd700 1 -- 172.21.15.32:0/285356017 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7ff384104d70 con 0x7ff37006c680 2024-05-06T21:25:21.961 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:25:21.961 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:25:21.961 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:25:21.961 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:25:21.961 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [], 2024-05-06T21:25:21.962 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "0/23 daemons upgraded", 2024-05-06T21:25:21.962 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 image on host smithi154", 2024-05-06T21:25:21.962 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:25:21.962 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff37006c680 msgr2=0x7ff37006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff37006c680 0x7ff37006eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff374006010 tx=0x7ff374005ec0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840ff660 msgr2=0x7ff3840fedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840ff660 0x7ff3840fedc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff38000d900 tx=0x7ff38000dc10 comp rx=0 tx=0).stop 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 shutdown_connections 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7ff37006c680 0x7ff37006eb30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840ff660 0x7ff3840fedc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 --2- 172.21.15.32:0/285356017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3840fffb0 0x7ff38419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 >> 172.21.15.32:0/285356017 conn(0x7ff3840f9f10 msgr2=0x7ff384103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 shutdown_connections 2024-05-06T21:25:21.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:21.961+0000 7ff38bd1f700 1 -- 172.21.15.32:0/285356017 wait complete. 2024-05-06T21:25:22.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.074+0000 7fc453bee700 1 -- 172.21.15.32:0/4293568134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c100250 msgr2=0x7fc44c100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:22.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.074+0000 7fc453bee700 1 --2- 172.21.15.32:0/4293568134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c100250 0x7fc44c100660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc448009910 tx=0x7fc448009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:22.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.074+0000 7fc453bee700 1 -- 172.21.15.32:0/4293568134 shutdown_connections 2024-05-06T21:25:22.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.074+0000 7fc453bee700 1 --2- 172.21.15.32:0/4293568134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc44c101450 0x7fc44c1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:22.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.074+0000 7fc453bee700 1 --2- 172.21.15.32:0/4293568134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c100250 0x7fc44c100660 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:22.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.074+0000 7fc453bee700 1 -- 172.21.15.32:0/4293568134 >> 172.21.15.32:0/4293568134 conn(0x7fc44c0fb7e0 msgr2=0x7fc44c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.074+0000 7fc453bee700 1 -- 172.21.15.32:0/4293568134 shutdown_connections 2024-05-06T21:25:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.074+0000 7fc453bee700 1 -- 172.21.15.32:0/4293568134 wait complete. 2024-05-06T21:25:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.075+0000 7fc453bee700 1 Processor -- start 2024-05-06T21:25:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.075+0000 7fc453bee700 1 -- start start 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.075+0000 7fc453bee700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc44c100250 0x7fc44c195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.075+0000 7fc453bee700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c101450 0x7fc44c196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.075+0000 7fc453bee700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c196640 con 0x7fc44c101450 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.075+0000 7fc453bee700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c196780 con 0x7fc44c100250 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc451189700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c101450 0x7fc44c196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc451189700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c101450 0x7fc44c196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44464/0 (socket says 172.21.15.32:44464) 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc451189700 1 -- 172.21.15.32:0/360159737 learned_addr learned my addr 172.21.15.32:0/360159737 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc451189700 1 -- 172.21.15.32:0/360159737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc44c100250 msgr2=0x7fc44c195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc451189700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc44c100250 0x7fc44c195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc451189700 1 -- 172.21.15.32:0/360159737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480095f0 con 0x7fc44c101450 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc451189700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c101450 0x7fc44c196020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00e920 tx=0x7fc43c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc442ffd700 1 -- 172.21.15.32:0/360159737 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43c009790 con 0x7fc44c101450 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc442ffd700 1 -- 172.21.15.32:0/360159737 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc43c00cba0 con 0x7fc44c101450 2024-05-06T21:25:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c19b230 con 0x7fc44c101450 2024-05-06T21:25:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.076+0000 7fc442ffd700 1 -- 172.21.15.32:0/360159737 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43c018630 con 0x7fc44c101450 2024-05-06T21:25:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.077+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c19b780 con 0x7fc44c101450 2024-05-06T21:25:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.078+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c108da0 con 0x7fc44c101450 2024-05-06T21:25:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.078+0000 7fc442ffd700 1 -- 172.21.15.32:0/360159737 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc43c00cd10 con 0x7fc44c101450 2024-05-06T21:25:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.079+0000 7fc442ffd700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc43806c680 0x7fc43806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.079+0000 7fc442ffd700 1 -- 172.21.15.32:0/360159737 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc43c014070 con 0x7fc44c101450 2024-05-06T21:25:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.079+0000 7fc45198a700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc43806c680 0x7fc43806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.080+0000 7fc45198a700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc43806c680 0x7fc43806eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc448009fd0 tx=0x7fc448000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.084+0000 7fc442ffd700 1 -- 172.21.15.32:0/360159737 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc43c051720 con 0x7fc44c101450 2024-05-06T21:25:22.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:21 smithi154 ceph-mon[32880]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:22.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:21 smithi154 ceph-mon[32880]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:22.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:21 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1752965541' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:25:22.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:21 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2553850231' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:25:22.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.439+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc44c19bdb0 con 0x7fc44c101450 2024-05-06T21:25:22.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.440+0000 7fc442ffd700 1 -- 172.21.15.32:0/360159737 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc43c059be0 con 0x7fc44c101450 2024-05-06T21:25:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:25:22.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc43806c680 msgr2=0x7fc43806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:22.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc43806c680 0x7fc43806eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc448009fd0 tx=0x7fc448000bc0 comp rx=0 tx=0).stop 2024-05-06T21:25:22.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c101450 msgr2=0x7fc44c196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:22.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c101450 0x7fc44c196020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00e920 tx=0x7fc43c00ece0 comp rx=0 tx=0).stop 2024-05-06T21:25:22.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 shutdown_connections 2024-05-06T21:25:22.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fc43806c680 0x7fc43806eb30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:22.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc44c100250 0x7fc44c195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:22.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 --2- 172.21.15.32:0/360159737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc44c101450 0x7fc44c196020 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:22.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 >> 172.21.15.32:0/360159737 conn(0x7fc44c0fb7e0 msgr2=0x7fc44c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:22.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 shutdown_connections 2024-05-06T21:25:22.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:22.442+0000 7fc453bee700 1 -- 172.21.15.32:0/360159737 wait complete. 2024-05-06T21:25:22.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:22 smithi032 ceph-mon[27179]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:22.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:22 smithi032 ceph-mon[27179]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:25:22.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:22 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/360159737' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:25:23.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:22 smithi154 ceph-mon[32880]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:23.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:22 smithi154 ceph-mon[32880]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:25:23.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:22 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/360159737' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:25:23.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:23 smithi032 ceph-mon[27179]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:24.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:23 smithi154 ceph-mon[32880]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:24.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:24 smithi032 ceph-mon[27179]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T21:25:24.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:24 smithi154 ceph-mon[32880]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T21:25:26.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:25 smithi032 ceph-mon[27179]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T21:25:26.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:25 smithi154 ceph-mon[32880]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T21:25:27.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:27 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:25:28.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:27 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:25:28.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:28 smithi032 ceph-mon[27179]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T21:25:29.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:28 smithi154 ceph-mon[32880]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T21:25:30.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:30 smithi032 ceph-mon[27179]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:31.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:30 smithi154 ceph-mon[32880]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:32.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:32 smithi032 ceph-mon[27179]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:33.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:32 smithi154 ceph-mon[32880]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:34.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:34 smithi154 ceph-mon[32880]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:34.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:34 smithi032 ceph-mon[27179]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:36.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:35 smithi032 ceph-mon[27179]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:36.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:35 smithi154 ceph-mon[32880]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:38.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:38 smithi032 ceph-mon[27179]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:39.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:38 smithi154 ceph-mon[32880]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:40.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:40 smithi032 ceph-mon[27179]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:41.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:40 smithi154 ceph-mon[32880]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:42.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:42 smithi032 ceph-mon[27179]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:42.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:42 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:25:43.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:42 smithi154 ceph-mon[32880]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:43.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:42 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:25:44.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:44 smithi032 ceph-mon[27179]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:45.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:44 smithi154 ceph-mon[32880]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:46.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:45 smithi032 ceph-mon[27179]: pgmap v239: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:46.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:45 smithi154 ceph-mon[32880]: pgmap v239: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:48.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:48 smithi032 ceph-mon[27179]: pgmap v240: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:48.998 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:48 smithi154 ceph-mon[32880]: pgmap v240: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:50.745 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:50 smithi154 ceph-mon[32880]: pgmap v241: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:50.745 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:50 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:50.745 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:50 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:25:50.745 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:50 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:25:50.745 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:50 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:25:50.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:50 smithi032 ceph-mon[27179]: pgmap v241: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:50.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:50 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:50.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:50 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:25:50.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:50 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:25:50.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:50 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:25:51.779 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:51 smithi154 ceph-mon[32880]: Upgrade: Updating mgr.smithi154.kilvol 2024-05-06T21:25:51.779 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:51 smithi154 ceph-mon[32880]: Deploying daemon mgr.smithi154.kilvol on smithi154 2024-05-06T21:25:51.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:51 smithi032 ceph-mon[27179]: Upgrade: Updating mgr.smithi154.kilvol 2024-05-06T21:25:51.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:51 smithi032 ceph-mon[27179]: Deploying daemon mgr.smithi154.kilvol on smithi154 2024-05-06T21:25:52.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.615+0000 7f0dd66bb700 1 -- 172.21.15.32:0/1406881627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd01003d0 msgr2=0x7f0dd0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:52.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.615+0000 7f0dd66bb700 1 --2- 172.21.15.32:0/1406881627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd01003d0 0x7f0dd0100840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009910 tx=0x7f0dc4009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:52.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.615+0000 7f0dd66bb700 1 -- 172.21.15.32:0/1406881627 shutdown_connections 2024-05-06T21:25:52.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.615+0000 7f0dd66bb700 1 --2- 172.21.15.32:0/1406881627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd01003d0 0x7f0dd0100840 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:52.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.615+0000 7f0dd66bb700 1 --2- 172.21.15.32:0/1406881627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00ff130 0x7f0dd00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:52.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.615+0000 7f0dd66bb700 1 -- 172.21.15.32:0/1406881627 >> 172.21.15.32:0/1406881627 conn(0x7f0dd00fa780 msgr2=0x7f0dd00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:52.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.615+0000 7f0dd66bb700 1 -- 172.21.15.32:0/1406881627 shutdown_connections 2024-05-06T21:25:52.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.616+0000 7f0dd66bb700 1 -- 172.21.15.32:0/1406881627 wait complete. 2024-05-06T21:25:52.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.616+0000 7f0dd66bb700 1 Processor -- start 2024-05-06T21:25:52.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.616+0000 7f0dd66bb700 1 -- start start 2024-05-06T21:25:52.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.617+0000 7f0dd66bb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd00ff130 0x7f0dd0194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:52.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.617+0000 7f0dd66bb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd01003d0 0x7f0dd0194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:52.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.617+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd00ff130 0x7f0dd0194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:52.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.617+0000 7f0dd66bb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd01954c0 con 0x7f0dd00ff130 2024-05-06T21:25:52.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.617+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd00ff130 0x7f0dd0194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50918/0 (socket says 172.21.15.32:50918) 2024-05-06T21:25:52.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.617+0000 7f0dcffff700 1 -- 172.21.15.32:0/3687644815 learned_addr learned my addr 172.21.15.32:0/3687644815 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:52.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.617+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd0195600 con 0x7f0dd01003d0 2024-05-06T21:25:52.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.617+0000 7f0dcf7fe700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd01003d0 0x7f0dd0194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:52.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.618+0000 7f0dcffff700 1 -- 172.21.15.32:0/3687644815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd01003d0 msgr2=0x7f0dd0194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:52.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.618+0000 7f0dcffff700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd01003d0 0x7f0dd0194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:52.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.618+0000 7f0dcffff700 1 -- 172.21.15.32:0/3687644815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc40095f0 con 0x7f0dd00ff130 2024-05-06T21:25:52.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.618+0000 7f0dcf7fe700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd01003d0 0x7f0dd0194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:25:52.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.618+0000 7f0dcffff700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd00ff130 0x7f0dd0194960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e920 tx=0x7f0dc000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:52.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.619+0000 7f0dcd7fa700 1 -- 172.21.15.32:0/3687644815 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc000c9d0 con 0x7f0dd00ff130 2024-05-06T21:25:52.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.619+0000 7f0dcd7fa700 1 -- 172.21.15.32:0/3687644815 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0dc00115d0 con 0x7f0dd00ff130 2024-05-06T21:25:52.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.619+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd00685a0 con 0x7f0dd00ff130 2024-05-06T21:25:52.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.619+0000 7f0dcd7fa700 1 -- 172.21.15.32:0/3687644815 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc0019740 con 0x7f0dd00ff130 2024-05-06T21:25:52.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.620+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd0068af0 con 0x7f0dd00ff130 2024-05-06T21:25:52.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.621+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd0107c10 con 0x7f0dd00ff130 2024-05-06T21:25:52.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.622+0000 7f0dcd7fa700 1 -- 172.21.15.32:0/3687644815 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0dc00199c0 con 0x7f0dd00ff130 2024-05-06T21:25:52.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.623+0000 7f0dcd7fa700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0db806c6d0 0x7f0db806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:52.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.623+0000 7f0dcd7fa700 1 -- 172.21.15.32:0/3687644815 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0dc008d940 con 0x7f0dd00ff130 2024-05-06T21:25:52.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.623+0000 7f0dcf7fe700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0db806c6d0 0x7f0db806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:52.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.624+0000 7f0dcf7fe700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0db806c6d0 0x7f0db806eb80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400b6f0 tx=0x7f0dc4005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:52.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:52.631+0000 7f0dcd7fa700 1 -- 172.21.15.32:0/3687644815 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0dc0053720 con 0x7f0dd00ff130 2024-05-06T21:25:52.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:52 smithi154 ceph-mon[32880]: pgmap v242: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:52.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:52 smithi032 ceph-mon[27179]: pgmap v242: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:53.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.069+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dd0104d20 con 0x7f0db806c6d0 2024-05-06T21:25:53.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.070+0000 7f0dcd7fa700 1 -- 172.21.15.32:0/3687644815 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f0dd0104d20 con 0x7f0db806c6d0 2024-05-06T21:25:53.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.073+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0db806c6d0 msgr2=0x7f0db806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.073+0000 7f0dd66bb700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0db806c6d0 0x7f0db806eb80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400b6f0 tx=0x7f0dc4005a90 comp rx=0 tx=0).stop 2024-05-06T21:25:53.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.073+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd00ff130 msgr2=0x7f0dd0194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.073+0000 7f0dd66bb700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd00ff130 0x7f0dd0194960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e920 tx=0x7f0dc000ec30 comp rx=0 tx=0).stop 2024-05-06T21:25:53.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.074+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 shutdown_connections 2024-05-06T21:25:53.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.074+0000 7f0dd66bb700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f0db806c6d0 0x7f0db806eb80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.074+0000 7f0dd66bb700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dd00ff130 0x7f0dd0194960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.074+0000 7f0dd66bb700 1 --2- 172.21.15.32:0/3687644815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd01003d0 0x7f0dd0194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.074+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 >> 172.21.15.32:0/3687644815 conn(0x7f0dd00fa780 msgr2=0x7f0dd0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:53.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.074+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 shutdown_connections 2024-05-06T21:25:53.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.074+0000 7f0dd66bb700 1 -- 172.21.15.32:0/3687644815 wait complete. 2024-05-06T21:25:53.090 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:25:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.215+0000 7fb014830700 1 -- 172.21.15.32:0/221008593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 msgr2=0x7fb0100ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.215+0000 7fb014830700 1 --2- 172.21.15.32:0/221008593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 0x7fb0100ff540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb000009910 tx=0x7fb000009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.215+0000 7fb014830700 1 -- 172.21.15.32:0/221008593 shutdown_connections 2024-05-06T21:25:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.215+0000 7fb014830700 1 --2- 172.21.15.32:0/221008593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0101003d0 0x7fb010100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.215+0000 7fb014830700 1 --2- 172.21.15.32:0/221008593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 0x7fb0100ff540 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.215+0000 7fb014830700 1 -- 172.21.15.32:0/221008593 >> 172.21.15.32:0/221008593 conn(0x7fb0100fa780 msgr2=0x7fb0100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.216+0000 7fb014830700 1 -- 172.21.15.32:0/221008593 shutdown_connections 2024-05-06T21:25:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.216+0000 7fb014830700 1 -- 172.21.15.32:0/221008593 wait complete. 2024-05-06T21:25:53.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.216+0000 7fb014830700 1 Processor -- start 2024-05-06T21:25:53.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.216+0000 7fb014830700 1 -- start start 2024-05-06T21:25:53.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb014830700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 0x7fb010103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:53.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb014830700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0101003d0 0x7fb0101017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb014830700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb010101cf0 con 0x7fb0100ff130 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb014830700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb010101e30 con 0x7fb0101003d0 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb00e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 0x7fb010103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb00e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 0x7fb010103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50930/0 (socket says 172.21.15.32:50930) 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb00e59c700 1 -- 172.21.15.32:0/2885379120 learned_addr learned my addr 172.21.15.32:0/2885379120 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb00dd9b700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0101003d0 0x7fb0101017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb00e59c700 1 -- 172.21.15.32:0/2885379120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0101003d0 msgr2=0x7fb0101017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb00e59c700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0101003d0 0x7fb0101017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb00e59c700 1 -- 172.21.15.32:0/2885379120 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000095f0 con 0x7fb0100ff130 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.217+0000 7fb00e59c700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 0x7fb010103160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb00000b5c0 tx=0x7fb00000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.218+0000 7fafff7fe700 1 -- 172.21.15.32:0/2885379120 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00001d070 con 0x7fb0100ff130 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.218+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0101020b0 con 0x7fb0100ff130 2024-05-06T21:25:53.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.218+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0101025a0 con 0x7fb0100ff130 2024-05-06T21:25:53.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.218+0000 7fafff7fe700 1 -- 172.21.15.32:0/2885379120 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb000022470 con 0x7fb0100ff130 2024-05-06T21:25:53.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.218+0000 7fafff7fe700 1 -- 172.21.15.32:0/2885379120 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00000f690 con 0x7fb0100ff130 2024-05-06T21:25:53.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.219+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb010107c90 con 0x7fb0100ff130 2024-05-06T21:25:53.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.219+0000 7fafff7fe700 1 -- 172.21.15.32:0/2885379120 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb00000f900 con 0x7fb0100ff130 2024-05-06T21:25:53.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.220+0000 7fafff7fe700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7faff806c680 0x7faff806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:53.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.220+0000 7fafff7fe700 1 -- 172.21.15.32:0/2885379120 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb00008d160 con 0x7fb0100ff130 2024-05-06T21:25:53.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.220+0000 7fb00dd9b700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7faff806c680 0x7faff806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:53.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.220+0000 7fb00dd9b700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7faff806c680 0x7faff806eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb004009a10 tx=0x7fb004009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:53.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.224+0000 7fafff7fe700 1 -- 172.21.15.32:0/2885379120 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb00005b1d0 con 0x7fb0100ff130 2024-05-06T21:25:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.450+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb010068c50 con 0x7faff806c680 2024-05-06T21:25:53.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.451+0000 7fafff7fe700 1 -- 172.21.15.32:0/2885379120 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fb010068c50 con 0x7faff806c680 2024-05-06T21:25:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.453+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7faff806c680 msgr2=0x7faff806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.453+0000 7fb014830700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7faff806c680 0x7faff806eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb004009a10 tx=0x7fb004009190 comp rx=0 tx=0).stop 2024-05-06T21:25:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.453+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 msgr2=0x7fb010103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.453+0000 7fb014830700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 0x7fb010103160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb00000b5c0 tx=0x7fb00000bd70 comp rx=0 tx=0).stop 2024-05-06T21:25:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.454+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 shutdown_connections 2024-05-06T21:25:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.454+0000 7fb014830700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7faff806c680 0x7faff806eb30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.454+0000 7fb014830700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0100ff130 0x7fb010103160 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.454+0000 7fb014830700 1 --2- 172.21.15.32:0/2885379120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0101003d0 0x7fb0101017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.454+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 >> 172.21.15.32:0/2885379120 conn(0x7fb0100fa780 msgr2=0x7fb010068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:53.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.454+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 shutdown_connections 2024-05-06T21:25:53.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.454+0000 7fb014830700 1 -- 172.21.15.32:0/2885379120 wait complete. 2024-05-06T21:25:53.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.581+0000 7f46cd83f700 1 -- 172.21.15.32:0/1397262297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 msgr2=0x7f46c8101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.581+0000 7f46cd83f700 1 --2- 172.21.15.32:0/1397262297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 0x7f46c8101cd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009910 tx=0x7f46b8009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:53.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.581+0000 7f46cd83f700 1 -- 172.21.15.32:0/1397262297 shutdown_connections 2024-05-06T21:25:53.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.581+0000 7f46cd83f700 1 --2- 172.21.15.32:0/1397262297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c8102210 0x7f46c80fe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.581+0000 7f46cd83f700 1 --2- 172.21.15.32:0/1397262297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 0x7f46c8101cd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.581+0000 7f46cd83f700 1 -- 172.21.15.32:0/1397262297 >> 172.21.15.32:0/1397262297 conn(0x7f46c80f9f10 msgr2=0x7f46c80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:53.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.581+0000 7f46cd83f700 1 -- 172.21.15.32:0/1397262297 shutdown_connections 2024-05-06T21:25:53.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.581+0000 7f46cd83f700 1 -- 172.21.15.32:0/1397262297 wait complete. 2024-05-06T21:25:53.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.582+0000 7f46cd83f700 1 Processor -- start 2024-05-06T21:25:53.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.582+0000 7f46cd83f700 1 -- start start 2024-05-06T21:25:53.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.582+0000 7f46cd83f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 0x7f46c8195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:53.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.582+0000 7f46cd83f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c8102210 0x7f46c8196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.582+0000 7f46cd83f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8196670 con 0x7f46c81018c0 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.582+0000 7f46cd83f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c81967b0 con 0x7f46c8102210 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.582+0000 7f46c6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 0x7f46c8195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.582+0000 7f46c6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 0x7f46c8195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50958/0 (socket says 172.21.15.32:50958) 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.582+0000 7f46c6ffd700 1 -- 172.21.15.32:0/1822872690 learned_addr learned my addr 172.21.15.32:0/1822872690 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.583+0000 7f46c6ffd700 1 -- 172.21.15.32:0/1822872690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c8102210 msgr2=0x7f46c8196050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.583+0000 7f46c6ffd700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c8102210 0x7f46c8196050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.583+0000 7f46c6ffd700 1 -- 172.21.15.32:0/1822872690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b80095f0 con 0x7f46c81018c0 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.583+0000 7f46c6ffd700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 0x7f46c8195b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f46b8000c00 tx=0x7f46b800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.583+0000 7f46cc83d700 1 -- 172.21.15.32:0/1822872690 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b801d070 con 0x7f46c81018c0 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.583+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c819b200 con 0x7f46c81018c0 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.583+0000 7f46cc83d700 1 -- 172.21.15.32:0/1822872690 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f46b8005dc0 con 0x7f46c81018c0 2024-05-06T21:25:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.583+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c819b6f0 con 0x7f46c81018c0 2024-05-06T21:25:53.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.584+0000 7f46cc83d700 1 -- 172.21.15.32:0/1822872690 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b8022640 con 0x7f46c81018c0 2024-05-06T21:25:53.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.584+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c8108d50 con 0x7f46c81018c0 2024-05-06T21:25:53.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.585+0000 7f46cc83d700 1 -- 172.21.15.32:0/1822872690 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f46b8003680 con 0x7f46c81018c0 2024-05-06T21:25:53.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.586+0000 7f46cc83d700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f46b006c680 0x7f46b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:53.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.586+0000 7f46cc83d700 1 -- 172.21.15.32:0/1822872690 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f46b808d200 con 0x7f46c81018c0 2024-05-06T21:25:53.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.586+0000 7f46c67fc700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f46b006c680 0x7f46b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:53.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.586+0000 7f46c67fc700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f46b006c680 0x7f46b006eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46c8102640 tx=0x7f46bc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.590+0000 7f46cc83d700 1 -- 172.21.15.32:0/1822872690 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f46b805b2f0 con 0x7f46c81018c0 2024-05-06T21:25:53.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.802+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f46c8105fb0 con 0x7f46b006c680 2024-05-06T21:25:53.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.813+0000 7f46cc83d700 1 -- 172.21.15.32:0/1822872690 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f46c8105fb0 con 0x7f46b006c680 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (6m) 91s ago 7m 24.7M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (7m) 91s ago 7m 7428k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (6m) 97s ago 6m 7360k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (7m) 91s ago 7m 6665k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (6m) 97s ago 6m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (5m) 91s ago 7m 85.3M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (119s) 91s ago 119s 11.4M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (112s) 91s ago 111s 17.3M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (116s) 97s ago 116s 18.5M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (109s) 97s ago 109s 13.0M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:9283,8765,8443 running (9m) 91s ago 9m 487M - 18.2.0 dc2bc1663786 7711cd2179ff 2024-05-06T21:25:53.815 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (6m) 97s ago 6m 439M - 18.2.0 dc2bc1663786 f1d5be241e61 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (9m) 91s ago 9m 44.9M 2048M 18.2.0 dc2bc1663786 b06a214f4520 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (6m) 97s ago 6m 35.9M 2048M 18.2.0 dc2bc1663786 8a37ef7f53f9 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (7m) 91s ago 7m 16.1M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (6m) 97s ago 6m 16.6M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (5m) 91s ago 5m 48.3M 3948M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (5m) 91s ago 5m 47.2M 3948M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (4m) 91s ago 4m 48.4M 3948M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (4m) 97s ago 4m 46.0M 4970M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (3m) 97s ago 3m 43.8M 4970M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (3m) 97s ago 3m 44.9M 4970M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:25:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (5m) 91s ago 7m 63.3M - 2.43.0 a07b618ecd1d eb2dd06c5402 2024-05-06T21:25:53.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f46b006c680 msgr2=0x7f46b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f46b006c680 0x7f46b006eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46c8102640 tx=0x7f46bc009260 comp rx=0 tx=0).stop 2024-05-06T21:25:53.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 msgr2=0x7f46c8195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 0x7f46c8195b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f46b8000c00 tx=0x7f46b800f740 comp rx=0 tx=0).stop 2024-05-06T21:25:53.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 shutdown_connections 2024-05-06T21:25:53.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f46b006c680 0x7f46b006eb30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c81018c0 0x7f46c8195b10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 --2- 172.21.15.32:0/1822872690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c8102210 0x7f46c8196050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 >> 172.21.15.32:0/1822872690 conn(0x7f46c80f9f10 msgr2=0x7f46c8104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:53.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 shutdown_connections 2024-05-06T21:25:53.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.815+0000 7f46cd83f700 1 -- 172.21.15.32:0/1822872690 wait complete. 2024-05-06T21:25:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.931+0000 7fe22734e700 1 -- 172.21.15.32:0/1485400799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe220100350 msgr2=0x7fe2201007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.931+0000 7fe22734e700 1 --2- 172.21.15.32:0/1485400799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe220100350 0x7fe2201007a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe210009910 tx=0x7fe210009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.931+0000 7fe22734e700 1 -- 172.21.15.32:0/1485400799 shutdown_connections 2024-05-06T21:25:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.931+0000 7fe22734e700 1 --2- 172.21.15.32:0/1485400799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe220100350 0x7fe2201007a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.931+0000 7fe22734e700 1 --2- 172.21.15.32:0/1485400799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200ff150 0x7fe2200ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.931+0000 7fe22734e700 1 -- 172.21.15.32:0/1485400799 >> 172.21.15.32:0/1485400799 conn(0x7fe2200fa700 msgr2=0x7fe2200fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.931+0000 7fe22734e700 1 -- 172.21.15.32:0/1485400799 shutdown_connections 2024-05-06T21:25:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.931+0000 7fe22734e700 1 -- 172.21.15.32:0/1485400799 wait complete. 2024-05-06T21:25:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.932+0000 7fe22734e700 1 Processor -- start 2024-05-06T21:25:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.932+0000 7fe22734e700 1 -- start start 2024-05-06T21:25:53.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.932+0000 7fe22734e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200ff150 0x7fe2201030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:53.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.932+0000 7fe22734e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220100350 0x7fe220101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:53.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.932+0000 7fe22734e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220101c70 con 0x7fe2200ff150 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.932+0000 7fe22734e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220101db0 con 0x7fe220100350 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.932+0000 7fe2250ea700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200ff150 0x7fe2201030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.932+0000 7fe2250ea700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200ff150 0x7fe2201030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50976/0 (socket says 172.21.15.32:50976) 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.932+0000 7fe2250ea700 1 -- 172.21.15.32:0/1586303830 learned_addr learned my addr 172.21.15.32:0/1586303830 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe2248e9700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220100350 0x7fe220101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe2250ea700 1 -- 172.21.15.32:0/1586303830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220100350 msgr2=0x7fe220101730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe2250ea700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220100350 0x7fe220101730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe2250ea700 1 -- 172.21.15.32:0/1586303830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2100095f0 con 0x7fe2200ff150 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe2248e9700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220100350 0x7fe220101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe2250ea700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200ff150 0x7fe2201030e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00d900 tx=0x7fe21c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe2167fc700 1 -- 172.21.15.32:0/1586303830 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21c0041f0 con 0x7fe2200ff150 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe2167fc700 1 -- 172.21.15.32:0/1586303830 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe21c004350 con 0x7fe2200ff150 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe220102090 con 0x7fe2200ff150 2024-05-06T21:25:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe2167fc700 1 -- 172.21.15.32:0/1586303830 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21c003da0 con 0x7fe2200ff150 2024-05-06T21:25:53.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.933+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22019db00 con 0x7fe2200ff150 2024-05-06T21:25:53.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.934+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe220107ca0 con 0x7fe2200ff150 2024-05-06T21:25:53.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.935+0000 7fe2167fc700 1 -- 172.21.15.32:0/1586303830 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe21c009940 con 0x7fe2200ff150 2024-05-06T21:25:53.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.936+0000 7fe2167fc700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c680 0x7fe20c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:53.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.936+0000 7fe2167fc700 1 -- 172.21.15.32:0/1586303830 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe21c08be50 con 0x7fe2200ff150 2024-05-06T21:25:53.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.936+0000 7fe2248e9700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c680 0x7fe20c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:53.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.936+0000 7fe2248e9700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c680 0x7fe20c06eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe210005b40 tx=0x7fe210005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:53.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:53.940+0000 7fe2167fc700 1 -- 172.21.15.32:0/1586303830 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe21c059fc0 con 0x7fe2200ff150 2024-05-06T21:25:54.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.242+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe220107e90 con 0x7fe2200ff150 2024-05-06T21:25:54.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.243+0000 7fe2167fc700 1 -- 172.21.15.32:0/1586303830 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fe21c059b50 con 0x7fe2200ff150 2024-05-06T21:25:54.244 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:25:54.244 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:25:54.244 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:25:54.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:25:54.244 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:25:54.244 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:25:54.245 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:25:54.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c680 msgr2=0x7fe20c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c680 0x7fe20c06eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe210005b40 tx=0x7fe210005a90 comp rx=0 tx=0).stop 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200ff150 msgr2=0x7fe2201030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200ff150 0x7fe2201030e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00d900 tx=0x7fe21c00dcc0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 shutdown_connections 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fe20c06c680 0x7fe20c06eb30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2200ff150 0x7fe2201030e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 --2- 172.21.15.32:0/1586303830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220100350 0x7fe220101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 >> 172.21.15.32:0/1586303830 conn(0x7fe2200fa700 msgr2=0x7fe220068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 shutdown_connections 2024-05-06T21:25:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.246+0000 7fe22734e700 1 -- 172.21.15.32:0/1586303830 wait complete. 2024-05-06T21:25:54.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.364+0000 7f6f91d08700 1 -- 172.21.15.32:0/146014193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c101440 msgr2=0x7f6f8c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:54.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.364+0000 7f6f91d08700 1 --2- 172.21.15.32:0/146014193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c101440 0x7f6f8c101890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009910 tx=0x7f6f80009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:54.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.364+0000 7f6f91d08700 1 -- 172.21.15.32:0/146014193 shutdown_connections 2024-05-06T21:25:54.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.364+0000 7f6f91d08700 1 --2- 172.21.15.32:0/146014193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c101440 0x7f6f8c101890 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.364+0000 7f6f91d08700 1 --2- 172.21.15.32:0/146014193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c100240 0x7f6f8c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.364+0000 7f6f91d08700 1 -- 172.21.15.32:0/146014193 >> 172.21.15.32:0/146014193 conn(0x7f6f8c0fb7f0 msgr2=0x7f6f8c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:54.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.364+0000 7f6f91d08700 1 -- 172.21.15.32:0/146014193 shutdown_connections 2024-05-06T21:25:54.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.364+0000 7f6f91d08700 1 -- 172.21.15.32:0/146014193 wait complete. 2024-05-06T21:25:54.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.365+0000 7f6f91d08700 1 Processor -- start 2024-05-06T21:25:54.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.365+0000 7f6f91d08700 1 -- start start 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.365+0000 7f6f91d08700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c100240 0x7f6f8c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.365+0000 7f6f91d08700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c101440 0x7f6f8c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.365+0000 7f6f91d08700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c196610 con 0x7f6f8c100240 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.365+0000 7f6f91d08700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c196750 con 0x7f6f8c101440 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f8b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c100240 0x7f6f8c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f8b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c100240 0x7f6f8c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50986/0 (socket says 172.21.15.32:50986) 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f8b7fe700 1 -- 172.21.15.32:0/1269608319 learned_addr learned my addr 172.21.15.32:0/1269608319 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f8affd700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c101440 0x7f6f8c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f8b7fe700 1 -- 172.21.15.32:0/1269608319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c101440 msgr2=0x7f6f8c195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:54.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f8b7fe700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c101440 0x7f6f8c195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f8b7fe700 1 -- 172.21.15.32:0/1269608319 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800095f0 con 0x7f6f8c100240 2024-05-06T21:25:54.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f8b7fe700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c100240 0x7f6f8c195ab0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00d900 tx=0x7f6f7c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:54.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f88ff9700 1 -- 172.21.15.32:0/1269608319 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c0041f0 con 0x7f6f8c100240 2024-05-06T21:25:54.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f88ff9700 1 -- 172.21.15.32:0/1269608319 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f7c004350 con 0x7f6f8c100240 2024-05-06T21:25:54.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.366+0000 7f6f88ff9700 1 -- 172.21.15.32:0/1269608319 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c003d20 con 0x7f6f8c100240 2024-05-06T21:25:54.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.367+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c19b200 con 0x7f6f8c100240 2024-05-06T21:25:54.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.367+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c19b750 con 0x7f6f8c100240 2024-05-06T21:25:54.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.368+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c108d90 con 0x7f6f8c100240 2024-05-06T21:25:54.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.369+0000 7f6f88ff9700 1 -- 172.21.15.32:0/1269608319 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6f7c009730 con 0x7f6f8c100240 2024-05-06T21:25:54.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.370+0000 7f6f88ff9700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f6f7406c680 0x7f6f7406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:54.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.370+0000 7f6f88ff9700 1 -- 172.21.15.32:0/1269608319 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6f7c08b700 con 0x7f6f8c100240 2024-05-06T21:25:54.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.370+0000 7f6f8affd700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f6f7406c680 0x7f6f7406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:54.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.370+0000 7f6f8affd700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f6f7406c680 0x7f6f7406eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6f80006010 tx=0x7f6f8000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:54.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.377+0000 7f6f88ff9700 1 -- 172.21.15.32:0/1269608319 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6f7c059890 con 0x7f6f8c100240 2024-05-06T21:25:54.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.646+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f8c19bea0 con 0x7f6f8c100240 2024-05-06T21:25:54.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.647+0000 7f6f88ff9700 1 -- 172.21.15.32:0/1269608319 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f6f7c003e80 con 0x7f6f8c100240 2024-05-06T21:25:54.648 INFO:teuthology.orchestra.run.smithi032.stdout:e18 2024-05-06T21:25:54.648 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:25:54.648 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:25:54.648 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 18 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:24:10.874189+0000 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:25:54.649 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:25:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:25:54.651 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:25:54.651 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:25:54.651 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:25:54.651 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:25:54.651 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:25:54.651 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:25:54.651 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f6f7406c680 msgr2=0x7f6f7406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f6f7406c680 0x7f6f7406eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6f80006010 tx=0x7f6f8000b540 comp rx=0 tx=0).stop 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c100240 msgr2=0x7f6f8c195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c100240 0x7f6f8c195ab0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00d900 tx=0x7f6f7c00dc10 comp rx=0 tx=0).stop 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 shutdown_connections 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f6f7406c680 0x7f6f7406eb30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8c100240 0x7f6f8c195ab0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 --2- 172.21.15.32:0/1269608319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c101440 0x7f6f8c195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 >> 172.21.15.32:0/1269608319 conn(0x7f6f8c0fb7f0 msgr2=0x7f6f8c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:54.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 shutdown_connections 2024-05-06T21:25:54.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.649+0000 7f6f91d08700 1 -- 172.21.15.32:0/1269608319 wait complete. 2024-05-06T21:25:54.653 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-05-06T21:25:54.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.764+0000 7fa639208700 1 -- 172.21.15.32:0/588466348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 msgr2=0x7fa634101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:54.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.764+0000 7fa639208700 1 --2- 172.21.15.32:0/588466348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 0x7fa634101890 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009910 tx=0x7fa61c009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:54.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.764+0000 7fa639208700 1 -- 172.21.15.32:0/588466348 shutdown_connections 2024-05-06T21:25:54.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.764+0000 7fa639208700 1 --2- 172.21.15.32:0/588466348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 0x7fa634101890 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.764+0000 7fa639208700 1 --2- 172.21.15.32:0/588466348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634100240 0x7fa634100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.764+0000 7fa639208700 1 -- 172.21.15.32:0/588466348 >> 172.21.15.32:0/588466348 conn(0x7fa6340fb7f0 msgr2=0x7fa6340fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:54.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.764+0000 7fa639208700 1 -- 172.21.15.32:0/588466348 shutdown_connections 2024-05-06T21:25:54.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.764+0000 7fa639208700 1 -- 172.21.15.32:0/588466348 wait complete. 2024-05-06T21:25:54.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.765+0000 7fa639208700 1 Processor -- start 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.765+0000 7fa639208700 1 -- start start 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.765+0000 7fa639208700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634100240 0x7fa634195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.765+0000 7fa639208700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 0x7fa634195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.765+0000 7fa639208700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6341965f0 con 0x7fa634101440 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.765+0000 7fa639208700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634196730 con 0x7fa634100240 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.765+0000 7fa63259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 0x7fa634195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.765+0000 7fa63259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 0x7fa634195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51000/0 (socket says 172.21.15.32:51000) 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.765+0000 7fa63259c700 1 -- 172.21.15.32:0/2150105633 learned_addr learned my addr 172.21.15.32:0/2150105633 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.766+0000 7fa63259c700 1 -- 172.21.15.32:0/2150105633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634100240 msgr2=0x7fa634195a90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.766+0000 7fa63259c700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634100240 0x7fa634195a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.766+0000 7fa63259c700 1 -- 172.21.15.32:0/2150105633 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0095f0 con 0x7fa634101440 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.766+0000 7fa63259c700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 0x7fa634195fd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00bd70 tx=0x7fa61c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.766+0000 7fa62bfff700 1 -- 172.21.15.32:0/2150105633 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c01d070 con 0x7fa634101440 2024-05-06T21:25:54.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.766+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63419b180 con 0x7fa634101440 2024-05-06T21:25:54.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.766+0000 7fa62bfff700 1 -- 172.21.15.32:0/2150105633 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa61c022470 con 0x7fa634101440 2024-05-06T21:25:54.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.766+0000 7fa62bfff700 1 -- 172.21.15.32:0/2150105633 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c00f670 con 0x7fa634101440 2024-05-06T21:25:54.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.766+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63419b670 con 0x7fa634101440 2024-05-06T21:25:54.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.767+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa634108d90 con 0x7fa634101440 2024-05-06T21:25:54.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.768+0000 7fa62bfff700 1 -- 172.21.15.32:0/2150105633 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa61c022a50 con 0x7fa634101440 2024-05-06T21:25:54.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.768+0000 7fa62bfff700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa62006c680 0x7fa62006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:54.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.769+0000 7fa62bfff700 1 -- 172.21.15.32:0/2150105633 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa61c08ce40 con 0x7fa634101440 2024-05-06T21:25:54.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.769+0000 7fa632d9d700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa62006c680 0x7fa62006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:54.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.769+0000 7fa632d9d700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa62006c680 0x7fa62006eb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa624005950 tx=0x7fa6240058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:54.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.775+0000 7fa62bfff700 1 -- 172.21.15.32:0/2150105633 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa61c05b000 con 0x7fa634101440 2024-05-06T21:25:54.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:54 smithi032 ceph-mon[27179]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:54.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:54 smithi032 ceph-mon[27179]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:54.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:54 smithi032 ceph-mon[27179]: pgmap v243: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:54.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:54 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:54.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:54 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:54.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:54 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:25:54.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:54 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1586303830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:25:54.976 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:54 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1269608319' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:25:55.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.998+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 --> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa634105d90 con 0x7fa62006c680 2024-05-06T21:25:55.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:54.999+0000 7fa62bfff700 1 -- 172.21.15.32:0/2150105633 <== mgr.14217 v2:172.21.15.32:6800/2162274499 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fa634105d90 con 0x7fa62006c680 2024-05-06T21:25:55.002 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:25:55.002 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:25:55.002 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:25:55.002 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:25:55.002 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [], 2024-05-06T21:25:55.002 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "", 2024-05-06T21:25:55.002 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading mgr daemons", 2024-05-06T21:25:55.002 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:25:55.002 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:25:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.001+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa62006c680 msgr2=0x7fa62006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.001+0000 7fa639208700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa62006c680 0x7fa62006eb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa624005950 tx=0x7fa6240058e0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.001+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 msgr2=0x7fa634195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.001+0000 7fa639208700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 0x7fa634195fd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00bd70 tx=0x7fa61c00be50 comp rx=0 tx=0).stop 2024-05-06T21:25:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.002+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 shutdown_connections 2024-05-06T21:25:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.002+0000 7fa639208700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7fa62006c680 0x7fa62006eb30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.002+0000 7fa639208700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa634100240 0x7fa634195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.002+0000 7fa639208700 1 --2- 172.21.15.32:0/2150105633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa634101440 0x7fa634195fd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.002+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 >> 172.21.15.32:0/2150105633 conn(0x7fa6340fb7f0 msgr2=0x7fa634104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:55.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.002+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 shutdown_connections 2024-05-06T21:25:55.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.002+0000 7fa639208700 1 -- 172.21.15.32:0/2150105633 wait complete. 2024-05-06T21:25:55.026 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:54 smithi154 ceph-mon[32880]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:55.026 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:54 smithi154 ceph-mon[32880]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:55.026 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:54 smithi154 ceph-mon[32880]: pgmap v243: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:55.026 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:54 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:55.026 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:54 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:25:55.026 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:54 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:25:55.026 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:54 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1586303830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:25:55.026 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:54 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1269608319' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:25:55.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.111+0000 7f995f88b700 1 -- 172.21.15.32:0/3735258440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99580ff150 msgr2=0x7f99580ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:55.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.111+0000 7f995f88b700 1 --2- 172.21.15.32:0/3735258440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99580ff150 0x7f99580ff560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9954009910 tx=0x7f9954009c20 comp rx=0 tx=0).stop 2024-05-06T21:25:55.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.111+0000 7f995f88b700 1 -- 172.21.15.32:0/3735258440 shutdown_connections 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.111+0000 7f995f88b700 1 --2- 172.21.15.32:0/3735258440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9958100350 0x7f99581007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.111+0000 7f995f88b700 1 --2- 172.21.15.32:0/3735258440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99580ff150 0x7f99580ff560 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.111+0000 7f995f88b700 1 -- 172.21.15.32:0/3735258440 >> 172.21.15.32:0/3735258440 conn(0x7f99580fa700 msgr2=0x7f99580fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.111+0000 7f995f88b700 1 -- 172.21.15.32:0/3735258440 shutdown_connections 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.111+0000 7f995f88b700 1 -- 172.21.15.32:0/3735258440 wait complete. 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995f88b700 1 Processor -- start 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995f88b700 1 -- start start 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995f88b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99580ff150 0x7f99581030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995f88b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9958100350 0x7f9958101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995f88b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9958101c70 con 0x7f9958100350 2024-05-06T21:25:55.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995f88b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9958101db0 con 0x7f99580ff150 2024-05-06T21:25:55.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995ce26700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9958100350 0x7f9958101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:55.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995ce26700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9958100350 0x7f9958101730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51008/0 (socket says 172.21.15.32:51008) 2024-05-06T21:25:55.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995ce26700 1 -- 172.21.15.32:0/3803410925 learned_addr learned my addr 172.21.15.32:0/3803410925 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:25:55.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.112+0000 7f995d627700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99580ff150 0x7f99581030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:55.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.113+0000 7f995ce26700 1 -- 172.21.15.32:0/3803410925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99580ff150 msgr2=0x7f99581030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:55.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.113+0000 7f995ce26700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99580ff150 0x7f99581030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.113+0000 7f995ce26700 1 -- 172.21.15.32:0/3803410925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540095f0 con 0x7f9958100350 2024-05-06T21:25:55.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.113+0000 7f995ce26700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9958100350 0x7f9958101730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f994800d8d0 tx=0x7f994800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:55.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.113+0000 7f994e7fc700 1 -- 172.21.15.32:0/3803410925 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99480098a0 con 0x7f9958100350 2024-05-06T21:25:55.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.113+0000 7f994e7fc700 1 -- 172.21.15.32:0/3803410925 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9948010460 con 0x7f9958100350 2024-05-06T21:25:55.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.113+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9958102090 con 0x7f9958100350 2024-05-06T21:25:55.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.114+0000 7f994e7fc700 1 -- 172.21.15.32:0/3803410925 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f994800f5f0 con 0x7f9958100350 2024-05-06T21:25:55.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.114+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995819db20 con 0x7f9958100350 2024-05-06T21:25:55.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.114+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9958107ca0 con 0x7f9958100350 2024-05-06T21:25:55.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.115+0000 7f994e7fc700 1 -- 172.21.15.32:0/3803410925 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9948009a00 con 0x7f9958100350 2024-05-06T21:25:55.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.115+0000 7f994e7fc700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f994406c680 0x7f994406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:25:55.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.115+0000 7f994e7fc700 1 -- 172.21.15.32:0/3803410925 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f994808b6e0 con 0x7f9958100350 2024-05-06T21:25:55.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.115+0000 7f995d627700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f994406c680 0x7f994406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:25:55.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.116+0000 7f995d627700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f994406c680 0x7f994406eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9954006010 tx=0x7f995400b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:25:55.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.120+0000 7f994e7fc700 1 -- 172.21.15.32:0/3803410925 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9948059870 con 0x7f9958100350 2024-05-06T21:25:55.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.404+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9958107e60 con 0x7f9958100350 2024-05-06T21:25:55.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.404+0000 7f994e7fc700 1 -- 172.21.15.32:0/3803410925 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9948059400 con 0x7f9958100350 2024-05-06T21:25:55.407 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:25:55.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.407+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f994406c680 msgr2=0x7f994406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:55.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.407+0000 7f995f88b700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f994406c680 0x7f994406eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9954006010 tx=0x7f995400b540 comp rx=0 tx=0).stop 2024-05-06T21:25:55.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.408+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9958100350 msgr2=0x7f9958101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:25:55.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.408+0000 7f995f88b700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9958100350 0x7f9958101730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f994800d8d0 tx=0x7f994800dbe0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.408+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 shutdown_connections 2024-05-06T21:25:55.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.408+0000 7f995f88b700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:6800/2162274499,v1:172.21.15.32:6801/2162274499] conn(0x7f994406c680 0x7f994406eb30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.408+0000 7f995f88b700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99580ff150 0x7f99581030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.408+0000 7f995f88b700 1 --2- 172.21.15.32:0/3803410925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9958100350 0x7f9958101730 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:25:55.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.408+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 >> 172.21.15.32:0/3803410925 conn(0x7f99580fa700 msgr2=0x7f9958068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:25:55.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.408+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 shutdown_connections 2024-05-06T21:25:55.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:25:55.408+0000 7f995f88b700 1 -- 172.21.15.32:0/3803410925 wait complete. 2024-05-06T21:25:55.768 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:55 smithi154 ceph-mon[32880]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:55.768 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:55 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3803410925' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:25:56.152 INFO:tasks.workunit.client.0.smithi032.stderr:Updating files: 93% (11451/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-06T21:25:56.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:55 smithi032 ceph-mon[27179]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:56.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:55 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3803410925' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:25:56.498 INFO:tasks.workunit.client.0.smithi032.stderr:Note: switching to 'f273489c6dcd4bc88409993babd09dd99491162c'. 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr:state without impacting any branches by switching back to a branch. 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr: git switch -c 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr:Or undo this operation with: 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-06T21:25:56.499 INFO:tasks.workunit.client.0.smithi032.stderr: git switch - 2024-05-06T21:25:56.500 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-06T21:25:56.500 INFO:tasks.workunit.client.0.smithi032.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-06T21:25:56.500 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-06T21:25:56.500 INFO:tasks.workunit.client.0.smithi032.stderr:HEAD is now at f273489c6dc Merge branch 'wip-65185-squid' of https://github.com/rzarzynski/ceph into wip-yuri11-testing-2024-05-02-1242-squid 2024-05-06T21:25:56.505 DEBUG:teuthology.orchestra.run.smithi032:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-06T21:25:56.572 INFO:tasks.workunit.client.0.smithi032.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-06T21:25:56.574 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-06T21:25:56.574 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-06T21:25:57.011 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:56 smithi154 ceph-mon[32880]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:57.011 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:56 smithi154 ceph-mon[32880]: pgmap v244: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:57.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:56 smithi032 ceph-mon[27179]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:25:57.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:56 smithi032 ceph-mon[27179]: pgmap v244: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:57.237 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-06T21:25:57.292 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-06T21:25:57.334 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-06T21:25:57.336 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-06T21:25:57.336 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-06T21:25:57.376 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-06T21:25:57.379 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:25:57.379 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-06T21:25:57.437 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-05-06T21:25:57.439 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-06T21:25:57.439 DEBUG:teuthology.orchestra.run.smithi032:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f273489c6dcd4bc88409993babd09dd99491162c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-05-06T21:25:57.500 INFO:tasks.workunit.client.0.smithi032.stderr:+ mkdir -p fsstress 2024-05-06T21:25:57.501 INFO:tasks.workunit.client.0.smithi032.stderr:+ pushd fsstress 2024-05-06T21:25:57.502 INFO:tasks.workunit.client.0.smithi032.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-06T21:25:57.502 INFO:tasks.workunit.client.0.smithi032.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-06T21:25:57.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:57 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:25:58.066 INFO:tasks.workunit.client.0.smithi032.stderr:+ tar xzf ltp-full.tgz 2024-05-06T21:25:58.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:57 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:25:58.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:25:58 smithi032 ceph-mon[27179]: pgmap v245: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:25:59.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:25:58 smithi154 ceph-mon[32880]: pgmap v245: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:26:01.054 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:00 smithi154 ceph-mon[32880]: pgmap v246: 65 pgs: 65 active+clean; 2.9 MiB data, 162 MiB used, 536 GiB / 536 GiB avail; 197 KiB/s wr, 0 op/s 2024-05-06T21:26:01.054 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:00 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:01.054 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:00 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:01.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:00 smithi032 ceph-mon[27179]: pgmap v246: 65 pgs: 65 active+clean; 2.9 MiB data, 162 MiB used, 536 GiB / 536 GiB avail; 197 KiB/s wr, 0 op/s 2024-05-06T21:26:01.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:00 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:01.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:00 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:02.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:01 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:02.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:01 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:02.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:01 smithi154 ceph-mon[32880]: pgmap v247: 65 pgs: 65 active+clean; 6.9 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 538 KiB/s wr, 0 op/s 2024-05-06T21:26:02.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:01 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:02.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:01 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:02.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:01 smithi032 ceph-mon[27179]: pgmap v247: 65 pgs: 65 active+clean; 6.9 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 538 KiB/s wr, 0 op/s 2024-05-06T21:26:03.009 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:02 smithi154 ceph-mon[32880]: Standby manager daemon smithi154.kilvol restarted 2024-05-06T21:26:03.009 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:02 smithi154 ceph-mon[32880]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:26:03.010 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:02 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:26:03.010 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:02 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:26:03.010 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:02 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:26:03.010 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:02 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:26:03.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:02 smithi032 ceph-mon[27179]: Standby manager daemon smithi154.kilvol restarted 2024-05-06T21:26:03.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:02 smithi032 ceph-mon[27179]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:26:03.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:02 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:26:03.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:02 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:26:03.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:02 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:26:03.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:02 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:26:03.830 INFO:tasks.workunit.client.1.smithi154.stderr:Updating files: 79% (9779/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-06T21:26:04.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:03 smithi154 ceph-mon[32880]: mgrmap e20: smithi032.ecoohh(active, since 7m), standbys: smithi154.kilvol 2024-05-06T21:26:04.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:03 smithi154 ceph-mon[32880]: pgmap v248: 65 pgs: 65 active+clean; 6.9 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 538 KiB/s wr, 0 op/s 2024-05-06T21:26:04.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:03 smithi032 ceph-mon[27179]: mgrmap e20: smithi032.ecoohh(active, since 7m), standbys: smithi154.kilvol 2024-05-06T21:26:04.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:03 smithi032 ceph-mon[27179]: pgmap v248: 65 pgs: 65 active+clean; 6.9 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 538 KiB/s wr, 0 op/s 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr:Note: switching to 'f273489c6dcd4bc88409993babd09dd99491162c'. 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr:state without impacting any branches by switching back to a branch. 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-05-06T21:26:04.560 INFO:tasks.workunit.client.1.smithi154.stderr: git switch -c 2024-05-06T21:26:04.561 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-05-06T21:26:04.561 INFO:tasks.workunit.client.1.smithi154.stderr:Or undo this operation with: 2024-05-06T21:26:04.561 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-05-06T21:26:04.561 INFO:tasks.workunit.client.1.smithi154.stderr: git switch - 2024-05-06T21:26:04.561 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-05-06T21:26:04.561 INFO:tasks.workunit.client.1.smithi154.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-06T21:26:04.561 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-05-06T21:26:04.561 INFO:tasks.workunit.client.1.smithi154.stderr:HEAD is now at f273489c6dc Merge branch 'wip-65185-squid' of https://github.com/rzarzynski/ceph into wip-yuri11-testing-2024-05-02-1242-squid 2024-05-06T21:26:04.566 DEBUG:teuthology.orchestra.run.smithi154:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-06T21:26:04.631 INFO:tasks.workunit.client.1.smithi154.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-06T21:26:04.634 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-06T21:26:04.634 INFO:tasks.workunit.client.1.smithi154.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-06T21:26:05.373 INFO:tasks.workunit.client.1.smithi154.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-06T21:26:05.428 INFO:tasks.workunit.client.1.smithi154.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-06T21:26:05.469 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-06T21:26:05.470 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-06T21:26:05.471 INFO:tasks.workunit.client.1.smithi154.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-06T21:26:05.516 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-06T21:26:05.519 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:26:05.520 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-06T21:26:05.576 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-05-06T21:26:05.577 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-06T21:26:05.577 DEBUG:teuthology.orchestra.run.smithi154:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f273489c6dcd4bc88409993babd09dd99491162c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-05-06T21:26:05.641 INFO:tasks.workunit.client.1.smithi154.stderr:+ mkdir -p fsstress 2024-05-06T21:26:05.644 INFO:tasks.workunit.client.1.smithi154.stderr:+ pushd fsstress 2024-05-06T21:26:05.645 INFO:tasks.workunit.client.1.smithi154.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-06T21:26:05.645 INFO:tasks.workunit.client.1.smithi154.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-06T21:26:05.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:05.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:05.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:26:05.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:26:05.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:05.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:26:05.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr fail", "who": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:26:05.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: osdmap e48: 6 total, 6 up, 6 in 2024-05-06T21:26:05.870 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "mgr fail", "who": "smithi032.ecoohh"}]': finished 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: mgrmap e21: smithi154.kilvol(active, starting, since 0.00789568s) 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr metadata", "who": "smithi154.kilvol", "id": "smithi154.kilvol"}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:26:05.871 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: Manager daemon smithi154.kilvol is now available 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi154.kilvol/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi154.kilvol/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi154.kilvol/trash_purge_schedule"}]: dispatch 2024-05-06T21:26:05.872 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:05 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi154.kilvol/trash_purge_schedule"}]: dispatch 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr fail", "who": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: osdmap e48: 6 total, 6 up, 6 in 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.14217 172.21.15.32:0/88510889' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "mgr fail", "who": "smithi032.ecoohh"}]': finished 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: mgrmap e21: smithi154.kilvol(active, starting, since 0.00789568s) 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:26:05.883 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr metadata", "who": "smithi154.kilvol", "id": "smithi154.kilvol"}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: Manager daemon smithi154.kilvol is now available 2024-05-06T21:26:05.884 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:26:05.885 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:26:05.885 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi154.kilvol/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:26:05.885 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi154.kilvol/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:26:05.885 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi154.kilvol/trash_purge_schedule"}]: dispatch 2024-05-06T21:26:05.885 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:05 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi154.kilvol/trash_purge_schedule"}]: dispatch 2024-05-06T21:26:06.763 INFO:tasks.workunit.client.1.smithi154.stderr:+ tar xzf ltp-full.tgz 2024-05-06T21:26:07.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:06 smithi154 ceph-mon[32880]: Deploying cephadm binary to smithi154 2024-05-06T21:26:07.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:06 smithi154 ceph-mon[32880]: Deploying cephadm binary to smithi032 2024-05-06T21:26:07.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:06 smithi154 ceph-mon[32880]: mgrmap e22: smithi154.kilvol(active, since 1.00855s) 2024-05-06T21:26:07.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:06 smithi154 ceph-mon[32880]: pgmap v3: 65 pgs: 65 active+clean; 43 MiB data, 310 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:26:07.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:06 smithi032 ceph-mon[27179]: Deploying cephadm binary to smithi154 2024-05-06T21:26:07.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:06 smithi032 ceph-mon[27179]: Deploying cephadm binary to smithi032 2024-05-06T21:26:07.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:06 smithi032 ceph-mon[27179]: mgrmap e22: smithi154.kilvol(active, since 1.00855s) 2024-05-06T21:26:07.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:06 smithi032 ceph-mon[27179]: pgmap v3: 65 pgs: 65 active+clean; 43 MiB data, 310 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:26:08.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:07 smithi154 ceph-mon[32880]: [06/May/2024:21:26:05] ENGINE Bus STARTING 2024-05-06T21:26:08.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:07 smithi154 ceph-mon[32880]: [06/May/2024:21:26:06] ENGINE Serving on http://172.21.15.154:8765 2024-05-06T21:26:08.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:07 smithi154 ceph-mon[32880]: [06/May/2024:21:26:06] ENGINE Serving on https://172.21.15.154:7150 2024-05-06T21:26:08.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:07 smithi154 ceph-mon[32880]: [06/May/2024:21:26:06] ENGINE Bus STARTED 2024-05-06T21:26:08.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:07 smithi154 ceph-mon[32880]: mgrmap e23: smithi154.kilvol(active, since 2s) 2024-05-06T21:26:08.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:07 smithi154 ceph-mon[32880]: pgmap v4: 65 pgs: 65 active+clean; 43 MiB data, 310 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:26:08.193 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:07 smithi032 ceph-mon[27179]: [06/May/2024:21:26:05] ENGINE Bus STARTING 2024-05-06T21:26:08.194 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:07 smithi032 ceph-mon[27179]: [06/May/2024:21:26:06] ENGINE Serving on http://172.21.15.154:8765 2024-05-06T21:26:08.194 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:07 smithi032 ceph-mon[27179]: [06/May/2024:21:26:06] ENGINE Serving on https://172.21.15.154:7150 2024-05-06T21:26:08.194 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:07 smithi032 ceph-mon[27179]: [06/May/2024:21:26:06] ENGINE Bus STARTED 2024-05-06T21:26:08.194 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:07 smithi032 ceph-mon[27179]: mgrmap e23: smithi154.kilvol(active, since 2s) 2024-05-06T21:26:08.194 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:07 smithi032 ceph-mon[27179]: pgmap v4: 65 pgs: 65 active+clean; 43 MiB data, 310 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:26:10.037 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:09 smithi032 ceph-mon[27179]: pgmap v5: 65 pgs: 65 active+clean; 43 MiB data, 310 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:26:10.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:09 smithi032 ceph-mon[27179]: mgrmap e24: smithi154.kilvol(active, since 4s) 2024-05-06T21:26:10.109 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:09 smithi154 ceph-mon[32880]: pgmap v5: 65 pgs: 65 active+clean; 43 MiB data, 310 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:26:10.110 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:09 smithi154 ceph-mon[32880]: mgrmap e24: smithi154.kilvol(active, since 4s) 2024-05-06T21:26:11.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:10 smithi032 ceph-mon[27179]: pgmap v6: 65 pgs: 65 active+clean; 43 MiB data, 310 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:26:11.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:10 smithi154 ceph-mon[32880]: pgmap v6: 65 pgs: 65 active+clean; 43 MiB data, 310 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:26:13.212 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:12 smithi032 ceph-mon[27179]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:26:13.212 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:13 smithi032 ceph-mon[27179]: pgmap v7: 65 pgs: 65 active+clean; 56 MiB data, 336 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 32 op/s 2024-05-06T21:26:13.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:12 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:26:13.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:12 smithi154 ceph-mon[32880]: pgmap v7: 65 pgs: 65 active+clean; 56 MiB data, 336 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 32 op/s 2024-05-06T21:26:14.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:13 smithi032 ceph-mon[27179]: Standby manager daemon smithi032.ecoohh started 2024-05-06T21:26:14.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:13 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.32:0/3416909473' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi032.ecoohh/crt"}]: dispatch 2024-05-06T21:26:14.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:13 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.32:0/3416909473' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:26:14.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:13 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.32:0/3416909473' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi032.ecoohh/key"}]: dispatch 2024-05-06T21:26:14.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:13 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.32:0/3416909473' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:26:14.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:13 smithi154 ceph-mon[32880]: Standby manager daemon smithi032.ecoohh started 2024-05-06T21:26:14.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:13 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.32:0/3416909473' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi032.ecoohh/crt"}]: dispatch 2024-05-06T21:26:14.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:13 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.32:0/3416909473' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:26:14.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:13 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.32:0/3416909473' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi032.ecoohh/key"}]: dispatch 2024-05-06T21:26:14.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:13 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.32:0/3416909473' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:26:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:14 smithi154 ceph-mon[32880]: mgrmap e25: smithi154.kilvol(active, since 9s), standbys: smithi032.ecoohh 2024-05-06T21:26:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:14 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:26:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:14 smithi154 ceph-mon[32880]: pgmap v8: 65 pgs: 65 active+clean; 56 MiB data, 336 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-05-06T21:26:15.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:14 smithi032 ceph-mon[27179]: mgrmap e25: smithi154.kilvol(active, since 9s), standbys: smithi032.ecoohh 2024-05-06T21:26:15.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:14 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:26:15.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:14 smithi032 ceph-mon[27179]: pgmap v8: 65 pgs: 65 active+clean; 56 MiB data, 336 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-05-06T21:26:18.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:17 smithi154 ceph-mon[32880]: pgmap v9: 65 pgs: 65 active+clean; 79 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 3.4 MiB/s wr, 150 op/s 2024-05-06T21:26:18.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:17 smithi032 ceph-mon[27179]: pgmap v9: 65 pgs: 65 active+clean; 79 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 3.4 MiB/s wr, 150 op/s 2024-05-06T21:26:20.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:19 smithi154 ceph-mon[32880]: pgmap v10: 65 pgs: 65 active+clean; 79 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 137 op/s 2024-05-06T21:26:20.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:19 smithi032 ceph-mon[27179]: pgmap v10: 65 pgs: 65 active+clean; 79 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 137 op/s 2024-05-06T21:26:21.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:20 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:26:21.213 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:20 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:26:21.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:21 smithi032 ceph-mon[27179]: pgmap v11: 65 pgs: 65 active+clean; 79 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 137 op/s 2024-05-06T21:26:22.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:21 smithi154 ceph-mon[32880]: pgmap v11: 65 pgs: 65 active+clean; 79 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 137 op/s 2024-05-06T21:26:23.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:23 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:23.621 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:23 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:23.622 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:23 smithi154 ceph-mon[32880]: pgmap v12: 65 pgs: 65 active+clean; 117 MiB data, 598 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 549 op/s 2024-05-06T21:26:23.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:23 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:23.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:23 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:23.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:23 smithi032 ceph-mon[27179]: pgmap v12: 65 pgs: 65 active+clean; 117 MiB data, 598 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 549 op/s 2024-05-06T21:26:25.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:25.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:25.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: Adjusting osd_memory_target on smithi032 to 1217M 2024-05-06T21:26:25.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:24 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:25.208 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:25.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:25.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:25.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: Adjusting osd_memory_target on smithi032 to 1217M 2024-05-06T21:26:25.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:24 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.527+0000 7f0a9ab47700 1 -- 172.21.15.32:0/3471162740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94100240 msgr2=0x7f0a94100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.527+0000 7f0a9ab47700 1 --2- 172.21.15.32:0/3471162740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94100240 0x7f0a94100650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009910 tx=0x7f0a88009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.527+0000 7f0a9ab47700 1 -- 172.21.15.32:0/3471162740 shutdown_connections 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.527+0000 7f0a9ab47700 1 --2- 172.21.15.32:0/3471162740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a94101440 0x7f0a94101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.527+0000 7f0a9ab47700 1 --2- 172.21.15.32:0/3471162740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94100240 0x7f0a94100650 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.527+0000 7f0a9ab47700 1 -- 172.21.15.32:0/3471162740 >> 172.21.15.32:0/3471162740 conn(0x7f0a940fb7f0 msgr2=0x7f0a940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.527+0000 7f0a9ab47700 1 -- 172.21.15.32:0/3471162740 shutdown_connections 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.527+0000 7f0a9ab47700 1 -- 172.21.15.32:0/3471162740 wait complete. 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a9ab47700 1 Processor -- start 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a9ab47700 1 -- start start 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a9ab47700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a94100240 0x7f0a94074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:25.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a9ab47700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94101440 0x7f0a94073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a9ab47700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94073680 con 0x7f0a94101440 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a9ab47700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940737c0 con 0x7f0a94100240 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a93fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94101440 0x7f0a94073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a93fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94101440 0x7f0a94073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52856/0 (socket says 172.21.15.32:52856) 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a93fff700 1 -- 172.21.15.32:0/606188228 learned_addr learned my addr 172.21.15.32:0/606188228 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a988e3700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a94100240 0x7f0a94074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a93fff700 1 -- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a94100240 msgr2=0x7f0a94074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a93fff700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a94100240 0x7f0a94074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.528+0000 7f0a93fff700 1 -- 172.21.15.32:0/606188228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a880095f0 con 0x7f0a94101440 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.529+0000 7f0a93fff700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94101440 0x7f0a94073140 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000d8d0 tx=0x7f0a8000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.529+0000 7f0a91ffb700 1 -- 172.21.15.32:0/606188228 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a800098a0 con 0x7f0a94101440 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.529+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a94073aa0 con 0x7f0a94101440 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.529+0000 7f0a91ffb700 1 -- 172.21.15.32:0/606188228 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a80010460 con 0x7f0a94101440 2024-05-06T21:26:25.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.529+0000 7f0a91ffb700 1 -- 172.21.15.32:0/606188228 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a8000f5f0 con 0x7f0a94101440 2024-05-06T21:26:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.529+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9419db10 con 0x7f0a94101440 2024-05-06T21:26:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.530+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a94108d90 con 0x7f0a94101440 2024-05-06T21:26:25.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.530+0000 7f0a91ffb700 1 -- 172.21.15.32:0/606188228 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f0a80009a00 con 0x7f0a94101440 2024-05-06T21:26:25.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.531+0000 7f0a91ffb700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f0a8406d3c0 0x7f0a8406f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:25.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.531+0000 7f0a91ffb700 1 -- 172.21.15.32:0/606188228 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0a8008cba0 con 0x7f0a94101440 2024-05-06T21:26:25.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.531+0000 7f0a988e3700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f0a8406d3c0 0x7f0a8406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:25.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.532+0000 7f0a988e3700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f0a8406d3c0 0x7f0a8406f870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0a88006010 tx=0x7f0a88005ec0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:25.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.536+0000 7f0a91ffb700 1 -- 172.21.15.32:0/606188228 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f0a80059e10 con 0x7f0a94101440 2024-05-06T21:26:25.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.805+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 --> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a94105d90 con 0x7f0a8406d3c0 2024-05-06T21:26:25.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.806+0000 7f0a91ffb700 1 -- 172.21.15.32:0/606188228 <== mgr.24395 v2:172.21.15.154:6828/2671631515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0a94105d90 con 0x7f0a8406d3c0 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f0a8406d3c0 msgr2=0x7f0a8406f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f0a8406d3c0 0x7f0a8406f870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0a88006010 tx=0x7f0a88005ec0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94101440 msgr2=0x7f0a94073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94101440 0x7f0a94073140 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000d8d0 tx=0x7f0a8000dbe0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 shutdown_connections 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f0a8406d3c0 0x7f0a8406f870 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a94100240 0x7f0a94074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 --2- 172.21.15.32:0/606188228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a94101440 0x7f0a94073140 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 >> 172.21.15.32:0/606188228 conn(0x7f0a940fb7f0 msgr2=0x7f0a94104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 shutdown_connections 2024-05-06T21:26:25.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.809+0000 7f0a9ab47700 1 -- 172.21.15.32:0/606188228 wait complete. 2024-05-06T21:26:25.822 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:26:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.928+0000 7f072edb9700 1 -- 172.21.15.32:0/957539074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 msgr2=0x7f0728100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.928+0000 7f072edb9700 1 --2- 172.21.15.32:0/957539074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 0x7f0728100b00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f071c009910 tx=0x7f071c009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.928+0000 7f072edb9700 1 -- 172.21.15.32:0/957539074 shutdown_connections 2024-05-06T21:26:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.928+0000 7f072edb9700 1 --2- 172.21.15.32:0/957539074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0728101040 0x7f07280ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.928+0000 7f072edb9700 1 --2- 172.21.15.32:0/957539074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 0x7f0728100b00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.928+0000 7f072edb9700 1 -- 172.21.15.32:0/957539074 >> 172.21.15.32:0/957539074 conn(0x7f07280f9f10 msgr2=0x7f07280fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.928+0000 7f072edb9700 1 -- 172.21.15.32:0/957539074 shutdown_connections 2024-05-06T21:26:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.928+0000 7f072edb9700 1 -- 172.21.15.32:0/957539074 wait complete. 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072edb9700 1 Processor -- start 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072edb9700 1 -- start start 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072edb9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 0x7f0728197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072edb9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0728101040 0x7f0728198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072edb9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728198870 con 0x7f07281006f0 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072edb9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072819d280 con 0x7f0728101040 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072cb55700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 0x7f0728197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072cb55700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 0x7f0728197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52866/0 (socket says 172.21.15.32:52866) 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f0727fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0728101040 0x7f0728198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072cb55700 1 -- 172.21.15.32:0/2603706285 learned_addr learned my addr 172.21.15.32:0/2603706285 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072cb55700 1 -- 172.21.15.32:0/2603706285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0728101040 msgr2=0x7f0728198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072cb55700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0728101040 0x7f0728198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.929+0000 7f072cb55700 1 -- 172.21.15.32:0/2603706285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c0095f0 con 0x7f07281006f0 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.930+0000 7f072cb55700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 0x7f0728197d10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f071c005b40 tx=0x7f071c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.930+0000 7f0725ffb700 1 -- 172.21.15.32:0/2603706285 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071c01d070 con 0x7f07281006f0 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.930+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072819d420 con 0x7f07281006f0 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.930+0000 7f0725ffb700 1 -- 172.21.15.32:0/2603706285 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f071c005dc0 con 0x7f07281006f0 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.930+0000 7f0725ffb700 1 -- 172.21.15.32:0/2603706285 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071c022470 con 0x7f07281006f0 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.930+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072819d8e0 con 0x7f07281006f0 2024-05-06T21:26:25.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.931+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0728107bf0 con 0x7f07281006f0 2024-05-06T21:26:25.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.933+0000 7f0725ffb700 1 -- 172.21.15.32:0/2603706285 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f071c003680 con 0x7f07281006f0 2024-05-06T21:26:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.933+0000 7f0725ffb700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f071806d3b0 0x7f071806f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.933+0000 7f0725ffb700 1 -- 172.21.15.32:0/2603706285 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f071c08e2e0 con 0x7f07281006f0 2024-05-06T21:26:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.933+0000 7f0727fff700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f071806d3b0 0x7f071806f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.934+0000 7f0727fff700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f071806d3b0 0x7f071806f860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0714009c60 tx=0x7f0714009260 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:25.937+0000 7f0725ffb700 1 -- 172.21.15.32:0/2603706285 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f071c057b40 con 0x7f07281006f0 2024-05-06T21:26:26.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:25 smithi154 ceph-mon[32880]: pgmap v13: 65 pgs: 65 active+clean; 117 MiB data, 598 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s wr, 531 op/s 2024-05-06T21:26:26.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.185+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 --> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07280fe9f0 con 0x7f071806d3b0 2024-05-06T21:26:26.187 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:25 smithi032 ceph-mon[27179]: pgmap v13: 65 pgs: 65 active+clean; 117 MiB data, 598 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s wr, 531 op/s 2024-05-06T21:26:26.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.186+0000 7f0725ffb700 1 -- 172.21.15.32:0/2603706285 <== mgr.24395 v2:172.21.15.154:6828/2671631515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f07280fe9f0 con 0x7f071806d3b0 2024-05-06T21:26:26.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.188+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f071806d3b0 msgr2=0x7f071806f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:26.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.188+0000 7f072edb9700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f071806d3b0 0x7f071806f860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0714009c60 tx=0x7f0714009260 comp rx=0 tx=0).stop 2024-05-06T21:26:26.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.188+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 msgr2=0x7f0728197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:26.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.188+0000 7f072edb9700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 0x7f0728197d10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f071c005b40 tx=0x7f071c00fa00 comp rx=0 tx=0).stop 2024-05-06T21:26:26.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.188+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 shutdown_connections 2024-05-06T21:26:26.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.188+0000 7f072edb9700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f071806d3b0 0x7f071806f860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.188+0000 7f072edb9700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07281006f0 0x7f0728197d10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.188+0000 7f072edb9700 1 --2- 172.21.15.32:0/2603706285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0728101040 0x7f0728198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.188+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 >> 172.21.15.32:0/2603706285 conn(0x7f07280f9f10 msgr2=0x7f07280fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:26.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.189+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 shutdown_connections 2024-05-06T21:26:26.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.189+0000 7f072edb9700 1 -- 172.21.15.32:0/2603706285 wait complete. 2024-05-06T21:26:26.259 INFO:tasks.workunit.client.0.smithi032.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-06T21:26:26.274 INFO:tasks.workunit.client.0.smithi032.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-06T21:26:26.274 INFO:tasks.workunit.client.0.smithi032.stderr:+ make 2024-05-06T21:26:26.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.312+0000 7fb14cb8f700 1 -- 172.21.15.32:0/4118396054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148100240 msgr2=0x7fb148100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:26.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.312+0000 7fb14cb8f700 1 --2- 172.21.15.32:0/4118396054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148100240 0x7fb148100650 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb138009910 tx=0x7fb138009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:26.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.312+0000 7fb14cb8f700 1 -- 172.21.15.32:0/4118396054 shutdown_connections 2024-05-06T21:26:26.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.312+0000 7fb14cb8f700 1 --2- 172.21.15.32:0/4118396054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb148101440 0x7fb148101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.312+0000 7fb14cb8f700 1 --2- 172.21.15.32:0/4118396054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148100240 0x7fb148100650 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.312+0000 7fb14cb8f700 1 -- 172.21.15.32:0/4118396054 >> 172.21.15.32:0/4118396054 conn(0x7fb1480fb7f0 msgr2=0x7fb1480fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:26.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.312+0000 7fb14cb8f700 1 -- 172.21.15.32:0/4118396054 shutdown_connections 2024-05-06T21:26:26.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.312+0000 7fb14cb8f700 1 -- 172.21.15.32:0/4118396054 wait complete. 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.313+0000 7fb14cb8f700 1 Processor -- start 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb14cb8f700 1 -- start start 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb14cb8f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb148100240 0x7fb148195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb14cb8f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148101440 0x7fb148195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb14cb8f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148196610 con 0x7fb148101440 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb14cb8f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148196750 con 0x7fb148100240 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb145d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148101440 0x7fb148195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb145d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148101440 0x7fb148195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52892/0 (socket says 172.21.15.32:52892) 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb145d9b700 1 -- 172.21.15.32:0/2238982560 learned_addr learned my addr 172.21.15.32:0/2238982560 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:26.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb14659c700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb148100240 0x7fb148195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:26.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb145d9b700 1 -- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb148100240 msgr2=0x7fb148195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:26.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb145d9b700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb148100240 0x7fb148195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.314+0000 7fb145d9b700 1 -- 172.21.15.32:0/2238982560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1380095f0 con 0x7fb148101440 2024-05-06T21:26:26.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.315+0000 7fb145d9b700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148101440 0x7fb148195ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e920 tx=0x7fb13c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:26.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.315+0000 7fb1377fe700 1 -- 172.21.15.32:0/2238982560 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb13c00c9d0 con 0x7fb148101440 2024-05-06T21:26:26.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.315+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14819b200 con 0x7fb148101440 2024-05-06T21:26:26.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.315+0000 7fb1377fe700 1 -- 172.21.15.32:0/2238982560 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb13c010430 con 0x7fb148101440 2024-05-06T21:26:26.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.315+0000 7fb1377fe700 1 -- 172.21.15.32:0/2238982560 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb13c018650 con 0x7fb148101440 2024-05-06T21:26:26.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.315+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14819b750 con 0x7fb148101440 2024-05-06T21:26:26.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.317+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb148108d90 con 0x7fb148101440 2024-05-06T21:26:26.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.318+0000 7fb1377fe700 1 -- 172.21.15.32:0/2238982560 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7fb13c0105a0 con 0x7fb148101440 2024-05-06T21:26:26.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.318+0000 7fb1377fe700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fb13006d3c0 0x7fb13006f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:26.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.319+0000 7fb1377fe700 1 -- 172.21.15.32:0/2238982560 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb13c014070 con 0x7fb148101440 2024-05-06T21:26:26.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.319+0000 7fb14659c700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fb13006d3c0 0x7fb13006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:26.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.319+0000 7fb14659c700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fb13006d3c0 0x7fb13006f870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb13800b6f0 tx=0x7fb138005940 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:26.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.325+0000 7fb1377fe700 1 -- 172.21.15.32:0/2238982560 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7fb13c053470 con 0x7fb148101440 2024-05-06T21:26:26.587 INFO:tasks.workunit.client.0.smithi032.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-06T21:26:26.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.592+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 --> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb148105d90 con 0x7fb13006d3c0 2024-05-06T21:26:26.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.606+0000 7fb1377fe700 1 -- 172.21.15.32:0/2238982560 <== mgr.24395 v2:172.21.15.154:6828/2671631515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb148105d90 con 0x7fb13006d3c0 2024-05-06T21:26:26.608 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:26:26.608 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (6m) 4s ago 8m 24.6M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:26:26.608 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (8m) 4s ago 8m 7578k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:26:26.608 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (7m) 26s ago 7m 7486k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:26:26.608 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (8m) 4s ago 8m 6665k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:26:26.608 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (7m) 26s ago 7m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (6m) 4s ago 7m 88.7M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (2m) 4s ago 2m 13.0M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (2m) 4s ago 2m 119M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (2m) 26s ago 2m 21.9M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (2m) 26s ago 2m 13.9M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:9283,8765,8443 running (9m) 4s ago 9m 322M - 18.2.0 dc2bc1663786 7711cd2179ff 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (33s) 26s ago 7m 58.8M - 19.0.0-2497-gf273489c 3b8ac54a9a71 49af90f5d83c 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (9m) 4s ago 9m 48.4M 2048M 18.2.0 dc2bc1663786 b06a214f4520 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (7m) 26s ago 7m 36.3M 2048M 18.2.0 dc2bc1663786 8a37ef7f53f9 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (8m) 4s ago 8m 15.8M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (7m) 26s ago 7m 16.9M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (6m) 4s ago 6m 84.9M 1217M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (5m) 4s ago 5m 74.7M 1217M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:26:26.609 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (5m) 4s ago 5m 71.7M 1217M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:26:26.610 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (4m) 26s ago 4m 46.0M 4970M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:26:26.610 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (4m) 26s ago 4m 44.7M 4970M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:26:26.610 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (4m) 26s ago 4m 45.3M 4970M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:26:26.610 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (6m) 4s ago 7m 67.6M - 2.43.0 a07b618ecd1d eb2dd06c5402 2024-05-06T21:26:26.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fb13006d3c0 msgr2=0x7fb13006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:26.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fb13006d3c0 0x7fb13006f870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb13800b6f0 tx=0x7fb138005940 comp rx=0 tx=0).stop 2024-05-06T21:26:26.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148101440 msgr2=0x7fb148195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:26.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148101440 0x7fb148195ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e920 tx=0x7fb13c00ec30 comp rx=0 tx=0).stop 2024-05-06T21:26:26.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 shutdown_connections 2024-05-06T21:26:26.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fb13006d3c0 0x7fb13006f870 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb148100240 0x7fb148195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 --2- 172.21.15.32:0/2238982560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb148101440 0x7fb148195ff0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 >> 172.21.15.32:0/2238982560 conn(0x7fb1480fb7f0 msgr2=0x7fb148104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:26.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 shutdown_connections 2024-05-06T21:26:26.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.609+0000 7fb14cb8f700 1 -- 172.21.15.32:0/2238982560 wait complete. 2024-05-06T21:26:26.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.731+0000 7f177dcb3700 1 -- 172.21.15.32:0/797097801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 msgr2=0x7f17780ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:26.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.731+0000 7f177dcb3700 1 --2- 172.21.15.32:0/797097801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 0x7f17780ff560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1768009910 tx=0x7f1768009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:26.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.731+0000 7f177dcb3700 1 -- 172.21.15.32:0/797097801 shutdown_connections 2024-05-06T21:26:26.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.731+0000 7f177dcb3700 1 --2- 172.21.15.32:0/797097801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17781003f0 0x7f1778100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.731+0000 7f177dcb3700 1 --2- 172.21.15.32:0/797097801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 0x7f17780ff560 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.731+0000 7f177dcb3700 1 -- 172.21.15.32:0/797097801 >> 172.21.15.32:0/797097801 conn(0x7f17780fa7a0 msgr2=0x7f17780fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:26.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.731+0000 7f177dcb3700 1 -- 172.21.15.32:0/797097801 shutdown_connections 2024-05-06T21:26:26.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.732+0000 7f177dcb3700 1 -- 172.21.15.32:0/797097801 wait complete. 2024-05-06T21:26:26.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.732+0000 7f177dcb3700 1 Processor -- start 2024-05-06T21:26:26.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.733+0000 7f177dcb3700 1 -- start start 2024-05-06T21:26:26.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.733+0000 7f177dcb3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 0x7f1778069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:26.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.733+0000 7f177dcb3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17781003f0 0x7f177819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:26.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.733+0000 7f177dcb3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177819b120 con 0x7f17780ff150 2024-05-06T21:26:26.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.733+0000 7f17777fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 0x7f1778069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:26.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.733+0000 7f17777fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 0x7f1778069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52912/0 (socket says 172.21.15.32:52912) 2024-05-06T21:26:26.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.733+0000 7f17777fe700 1 -- 172.21.15.32:0/503256000 learned_addr learned my addr 172.21.15.32:0/503256000 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:26.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.733+0000 7f1776ffd700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17781003f0 0x7f177819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:26.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.733+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177819b260 con 0x7f17781003f0 2024-05-06T21:26:26.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.734+0000 7f17777fe700 1 -- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17781003f0 msgr2=0x7f177819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:26.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.734+0000 7f17777fe700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17781003f0 0x7f177819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:26.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.734+0000 7f17777fe700 1 -- 172.21.15.32:0/503256000 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680095f0 con 0x7f17780ff150 2024-05-06T21:26:26.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.734+0000 7f1776ffd700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17781003f0 0x7f177819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:26:26.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.734+0000 7f17777fe700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 0x7f1778069930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f176800bd70 tx=0x7f176800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:26.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.734+0000 7f1774ff9700 1 -- 172.21.15.32:0/503256000 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f176801d070 con 0x7f17780ff150 2024-05-06T21:26:26.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.734+0000 7f1774ff9700 1 -- 172.21.15.32:0/503256000 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1768005dc0 con 0x7f17780ff150 2024-05-06T21:26:26.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.735+0000 7f1774ff9700 1 -- 172.21.15.32:0/503256000 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1768021410 con 0x7f17780ff150 2024-05-06T21:26:26.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.735+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177819b4e0 con 0x7f17780ff150 2024-05-06T21:26:26.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.735+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177819b9d0 con 0x7f17780ff150 2024-05-06T21:26:26.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.737+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1778068ab0 con 0x7f17780ff150 2024-05-06T21:26:26.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.737+0000 7f1774ff9700 1 -- 172.21.15.32:0/503256000 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f176800f7d0 con 0x7f17780ff150 2024-05-06T21:26:26.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.738+0000 7f1774ff9700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f176006d3c0 0x7f176006f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:26.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.738+0000 7f1774ff9700 1 -- 172.21.15.32:0/503256000 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f176808dec0 con 0x7f17780ff150 2024-05-06T21:26:26.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.738+0000 7f1776ffd700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f176006d3c0 0x7f176006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:26.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.739+0000 7f1776ffd700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f176006d3c0 0x7f176006f870 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1778069eb0 tx=0x7f176c00b410 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:26.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:26.746+0000 7f1774ff9700 1 -- 172.21.15.32:0/503256000 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f176805b130 con 0x7f17780ff150 2024-05-06T21:26:26.856 INFO:tasks.workunit.client.0.smithi032.stderr:++ readlink -f fsstress 2024-05-06T21:26:26.857 INFO:tasks.workunit.client.0.smithi032.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-06T21:26:26.857 INFO:tasks.workunit.client.0.smithi032.stderr:+ popd 2024-05-06T21:26:26.858 INFO:tasks.workunit.client.0.smithi032.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-06T21:26:26.858 INFO:tasks.workunit.client.0.smithi032.stderr:+ popd 2024-05-06T21:26:26.858 INFO:tasks.workunit.client.0.smithi032.stdout:~/cephtest/mnt.0/client.0/tmp 2024-05-06T21:26:26.859 INFO:tasks.workunit.client.0.smithi032.stderr:++ mktemp -d -p . 2024-05-06T21:26:26.860 INFO:tasks.workunit.client.0.smithi032.stderr:+ T=./tmp.nrfkA4qOS7 2024-05-06T21:26:26.860 INFO:tasks.workunit.client.0.smithi032.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.nrfkA4qOS7 -l 1 -n 1000 -p 10 -v 2024-05-06T21:26:26.861 INFO:tasks.workunit.client.0.smithi032.stdout:seed = 1714710712 2024-05-06T21:26:26.863 INFO:tasks.workunit.client.0.smithi032.stdout:0/0: dread - no filename 2024-05-06T21:26:26.863 INFO:tasks.workunit.client.0.smithi032.stdout:0/1: write - no filename 2024-05-06T21:26:26.863 INFO:tasks.workunit.client.0.smithi032.stdout:1/0: dwrite - no filename 2024-05-06T21:26:26.863 INFO:tasks.workunit.client.0.smithi032.stdout:1/1: fdatasync - no filename 2024-05-06T21:26:26.864 INFO:tasks.workunit.client.0.smithi032.stdout:0/2: creat f0 x:0 0 0 2024-05-06T21:26:26.865 INFO:tasks.workunit.client.0.smithi032.stdout:1/2: creat f0 x:0 0 0 2024-05-06T21:26:26.865 INFO:tasks.workunit.client.0.smithi032.stdout:1/3: truncate f0 341385 0 2024-05-06T21:26:26.866 INFO:tasks.workunit.client.0.smithi032.stdout:1/4: write f0 [764332,95041] 0 2024-05-06T21:26:26.867 INFO:tasks.workunit.client.0.smithi032.stdout:2/0: creat f0 x:0 0 0 2024-05-06T21:26:26.869 INFO:tasks.workunit.client.0.smithi032.stdout:3/0: creat f0 x:0 0 0 2024-05-06T21:26:26.869 INFO:tasks.workunit.client.0.smithi032.stdout:4/0: truncate - no filename 2024-05-06T21:26:26.869 INFO:tasks.workunit.client.0.smithi032.stdout:4/1: readlink - no filename 2024-05-06T21:26:26.869 INFO:tasks.workunit.client.0.smithi032.stdout:4/2: chown . 1634593 1 2024-05-06T21:26:26.869 INFO:tasks.workunit.client.0.smithi032.stdout:4/3: link - no file 2024-05-06T21:26:26.869 INFO:tasks.workunit.client.0.smithi032.stdout:3/1: readlink - no filename 2024-05-06T21:26:26.870 INFO:tasks.workunit.client.0.smithi032.stdout:5/0: write - no filename 2024-05-06T21:26:26.871 INFO:tasks.workunit.client.0.smithi032.stdout:4/4: creat f0 x:0 0 0 2024-05-06T21:26:26.872 INFO:tasks.workunit.client.0.smithi032.stdout:3/2: mkdir d1 0 2024-05-06T21:26:26.872 INFO:tasks.workunit.client.0.smithi032.stdout:3/3: truncate f0 469542 0 2024-05-06T21:26:26.873 INFO:tasks.workunit.client.0.smithi032.stdout:6/0: dread - no filename 2024-05-06T21:26:26.873 INFO:tasks.workunit.client.0.smithi032.stdout:6/1: chown . 1925666426 1 2024-05-06T21:26:26.873 INFO:tasks.workunit.client.0.smithi032.stdout:6/2: truncate - no filename 2024-05-06T21:26:26.873 INFO:tasks.workunit.client.0.smithi032.stdout:6/3: rename - no filename 2024-05-06T21:26:26.873 INFO:tasks.workunit.client.0.smithi032.stdout:6/4: getdents . 0 2024-05-06T21:26:26.874 INFO:tasks.workunit.client.0.smithi032.stdout:5/1: mkdir d0 0 2024-05-06T21:26:26.874 INFO:tasks.workunit.client.0.smithi032.stdout:3/4: symlink d1/l2 0 2024-05-06T21:26:26.874 INFO:tasks.workunit.client.0.smithi032.stdout:3/5: chown f0 6 1 2024-05-06T21:26:26.875 INFO:tasks.workunit.client.0.smithi032.stdout:6/5: mkdir d0 0 2024-05-06T21:26:26.875 INFO:tasks.workunit.client.0.smithi032.stdout:6/6: read - no filename 2024-05-06T21:26:26.875 INFO:tasks.workunit.client.0.smithi032.stdout:6/7: chown d0 45599 1 2024-05-06T21:26:26.876 INFO:tasks.workunit.client.0.smithi032.stdout:7/0: getdents . 0 2024-05-06T21:26:26.876 INFO:tasks.workunit.client.0.smithi032.stdout:7/1: write - no filename 2024-05-06T21:26:26.876 INFO:tasks.workunit.client.0.smithi032.stdout:7/2: dwrite - no filename 2024-05-06T21:26:26.876 INFO:tasks.workunit.client.0.smithi032.stdout:7/3: chown . 0 1 2024-05-06T21:26:26.876 INFO:tasks.workunit.client.0.smithi032.stdout:7/4: link - no file 2024-05-06T21:26:26.876 INFO:tasks.workunit.client.0.smithi032.stdout:7/5: write - no filename 2024-05-06T21:26:26.877 INFO:tasks.workunit.client.0.smithi032.stdout:5/2: creat d0/f1 x:0 0 0 2024-05-06T21:26:26.878 INFO:tasks.workunit.client.0.smithi032.stdout:6/8: rmdir d0 0 2024-05-06T21:26:26.878 INFO:tasks.workunit.client.0.smithi032.stdout:6/9: chown . 2 1 2024-05-06T21:26:26.878 INFO:tasks.workunit.client.0.smithi032.stdout:6/10: readlink - no filename 2024-05-06T21:26:26.878 INFO:tasks.workunit.client.0.smithi032.stdout:6/11: write - no filename 2024-05-06T21:26:26.878 INFO:tasks.workunit.client.0.smithi032.stdout:6/12: unlink - no file 2024-05-06T21:26:26.879 INFO:tasks.workunit.client.0.smithi032.stdout:8/0: truncate - no filename 2024-05-06T21:26:26.879 INFO:tasks.workunit.client.0.smithi032.stdout:8/1: dwrite - no filename 2024-05-06T21:26:26.879 INFO:tasks.workunit.client.0.smithi032.stdout:8/2: write - no filename 2024-05-06T21:26:26.879 INFO:tasks.workunit.client.0.smithi032.stdout:8/3: rename - no filename 2024-05-06T21:26:26.879 INFO:tasks.workunit.client.0.smithi032.stdout:8/4: dwrite - no filename 2024-05-06T21:26:26.879 INFO:tasks.workunit.client.0.smithi032.stdout:8/5: dwrite - no filename 2024-05-06T21:26:26.880 INFO:tasks.workunit.client.0.smithi032.stdout:8/6: link - no file 2024-05-06T21:26:26.880 INFO:tasks.workunit.client.0.smithi032.stdout:8/7: rmdir - no directory 2024-05-06T21:26:26.880 INFO:tasks.workunit.client.0.smithi032.stdout:7/6: mknod c0 0 2024-05-06T21:26:26.880 INFO:tasks.workunit.client.0.smithi032.stdout:7/7: write - no filename 2024-05-06T21:26:26.880 INFO:tasks.workunit.client.0.smithi032.stdout:7/8: truncate - no filename 2024-05-06T21:26:26.880 INFO:tasks.workunit.client.0.smithi032.stdout:7/9: fdatasync - no filename 2024-05-06T21:26:26.880 INFO:tasks.workunit.client.0.smithi032.stdout:7/10: fdatasync - no filename 2024-05-06T21:26:26.882 INFO:tasks.workunit.client.0.smithi032.stdout:5/3: symlink d0/l2 0 2024-05-06T21:26:26.882 INFO:tasks.workunit.client.0.smithi032.stdout:6/13: creat f1 x:0 0 0 2024-05-06T21:26:26.886 INFO:tasks.workunit.client.0.smithi032.stdout:8/8: mkdir d0 0 2024-05-06T21:26:26.886 INFO:tasks.workunit.client.0.smithi032.stdout:8/9: dwrite - no filename 2024-05-06T21:26:26.886 INFO:tasks.workunit.client.0.smithi032.stdout:8/10: fsync - no filename 2024-05-06T21:26:26.887 INFO:tasks.workunit.client.0.smithi032.stdout:7/11: mknod c1 0 2024-05-06T21:26:26.887 INFO:tasks.workunit.client.0.smithi032.stdout:7/12: read - no filename 2024-05-06T21:26:26.887 INFO:tasks.workunit.client.0.smithi032.stdout:7/13: fdatasync - no filename 2024-05-06T21:26:26.887 INFO:tasks.workunit.client.0.smithi032.stdout:7/14: truncate - no filename 2024-05-06T21:26:26.887 INFO:tasks.workunit.client.0.smithi032.stdout:7/15: write - no filename 2024-05-06T21:26:26.887 INFO:tasks.workunit.client.0.smithi032.stdout:7/16: dwrite - no filename 2024-05-06T21:26:26.888 INFO:tasks.workunit.client.0.smithi032.stdout:5/4: unlink d0/f1 0 2024-05-06T21:26:26.889 INFO:tasks.workunit.client.0.smithi032.stdout:6/14: unlink f1 0 2024-05-06T21:26:26.889 INFO:tasks.workunit.client.0.smithi032.stdout:6/15: fdatasync - no filename 2024-05-06T21:26:26.889 INFO:tasks.workunit.client.0.smithi032.stdout:6/16: truncate - no filename 2024-05-06T21:26:26.889 INFO:tasks.workunit.client.0.smithi032.stdout:6/17: read - no filename 2024-05-06T21:26:26.889 INFO:tasks.workunit.client.0.smithi032.stdout:6/18: dread - no filename 2024-05-06T21:26:26.889 INFO:tasks.workunit.client.0.smithi032.stdout:6/19: dwrite - no filename 2024-05-06T21:26:26.890 INFO:tasks.workunit.client.0.smithi032.stdout:7/17: rename c0 to c2 0 2024-05-06T21:26:26.890 INFO:tasks.workunit.client.0.smithi032.stdout:7/18: truncate - no filename 2024-05-06T21:26:26.900 INFO:tasks.workunit.client.0.smithi032.stdout:1/5: fdatasync f0 0 2024-05-06T21:26:26.900 INFO:tasks.workunit.client.0.smithi032.stdout:1/6: creat f1 x:0 0 0 2024-05-06T21:26:26.900 INFO:tasks.workunit.client.0.smithi032.stdout:1/7: write f1 [558280,110066] 0 2024-05-06T21:26:26.907 INFO:tasks.workunit.client.0.smithi032.stdout:7/19: creat f3 x:0 0 0 2024-05-06T21:26:26.909 INFO:tasks.workunit.client.0.smithi032.stdout:1/8: symlink l2 0 2024-05-06T21:26:26.909 INFO:tasks.workunit.client.0.smithi032.stdout:1/9: write f0 [1090900,47533] 0 2024-05-06T21:26:26.914 INFO:tasks.workunit.client.0.smithi032.stdout:7/20: symlink l4 0 2024-05-06T21:26:26.914 INFO:tasks.workunit.client.0.smithi032.stdout:7/21: creat f5 x:0 0 0 2024-05-06T21:26:26.915 INFO:tasks.workunit.client.0.smithi032.stdout:7/22: chown l4 36821 1 2024-05-06T21:26:26.915 INFO:tasks.workunit.client.0.smithi032.stdout:7/23: truncate f3 289439 0 2024-05-06T21:26:26.915 INFO:tasks.workunit.client.0.smithi032.stdout:1/10: symlink l3 0 2024-05-06T21:26:26.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:26 smithi032 ceph-mon[27179]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:26:26.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:26 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:26.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:26 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:26.983 INFO:tasks.workunit.client.0.smithi032.stdout:6/20: getdents . 0 2024-05-06T21:26:26.983 INFO:tasks.workunit.client.0.smithi032.stdout:6/21: fdatasync - no filename 2024-05-06T21:26:26.983 INFO:tasks.workunit.client.0.smithi032.stdout:6/22: link - no file 2024-05-06T21:26:26.989 INFO:tasks.workunit.client.0.smithi032.stdout:6/23: creat f2 x:0 0 0 2024-05-06T21:26:26.989 INFO:tasks.workunit.client.0.smithi032.stdout:6/24: dread - f2 zero size 2024-05-06T21:26:27.073 INFO:tasks.workunit.client.0.smithi032.stdout:0/3: dwrite f0 [0,4194304] 0 2024-05-06T21:26:27.077 INFO:tasks.workunit.client.0.smithi032.stdout:0/4: mknod c1 0 2024-05-06T21:26:27.078 INFO:tasks.workunit.client.0.smithi032.stdout:0/5: chown c1 159540 1 2024-05-06T21:26:27.082 INFO:tasks.workunit.client.0.smithi032.stdout:0/6: symlink l2 0 2024-05-06T21:26:27.085 INFO:tasks.workunit.client.0.smithi032.stdout:0/7: mknod c3 0 2024-05-06T21:26:27.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:26 smithi154 ceph-mon[32880]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:26:27.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:26 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:27.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:26 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:27.154 INFO:tasks.workunit.client.0.smithi032.stdout:4/5: dwrite f0 [0,4194304] 0 2024-05-06T21:26:27.154 INFO:tasks.workunit.client.0.smithi032.stdout:4/6: chown f0 0 1 2024-05-06T21:26:27.175 INFO:tasks.workunit.client.0.smithi032.stdout:4/7: rename f0 to f1 0 2024-05-06T21:26:27.193 INFO:tasks.workunit.client.0.smithi032.stdout:4/8: mkdir d2 0 2024-05-06T21:26:27.221 INFO:tasks.workunit.client.0.smithi032.stdout:4/9: symlink d2/l3 0 2024-05-06T21:26:27.291 INFO:tasks.workunit.client.0.smithi032.stdout:3/6: dwrite f0 [0,4194304] 0 2024-05-06T21:26:27.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.332+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f177819bc40 con 0x7f17780ff150 2024-05-06T21:26:27.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.333+0000 7f1774ff9700 1 -- 172.21.15.32:0/503256000 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f176800f460 con 0x7f17780ff150 2024-05-06T21:26:27.335 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:26:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:26:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 1 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-05-06T21:26:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 1 2024-05-06T21:26:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:26:27.337 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:26:27.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.340+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f176006d3c0 msgr2=0x7f176006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.340+0000 7f177dcb3700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f176006d3c0 0x7f176006f870 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1778069eb0 tx=0x7f176c00b410 comp rx=0 tx=0).stop 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.340+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 msgr2=0x7f1778069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.340+0000 7f177dcb3700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 0x7f1778069930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f176800bd70 tx=0x7f176800bda0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.340+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 shutdown_connections 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.340+0000 7f177dcb3700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f176006d3c0 0x7f176006f870 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.340+0000 7f177dcb3700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17780ff150 0x7f1778069930 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f176800bd70 tx=0x7f176800bda0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.340+0000 7f177dcb3700 1 --2- 172.21.15.32:0/503256000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17781003f0 0x7f177819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.340+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 >> 172.21.15.32:0/503256000 conn(0x7f17780fa7a0 msgr2=0x7f17781036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.341+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 shutdown_connections 2024-05-06T21:26:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.341+0000 7f177dcb3700 1 -- 172.21.15.32:0/503256000 wait complete. 2024-05-06T21:26:27.344 INFO:tasks.workunit.client.0.smithi032.stdout:4/10: dread f1 [0,4194304] 0 2024-05-06T21:26:27.344 INFO:tasks.workunit.client.0.smithi032.stdout:4/11: chown d2 73110058 1 2024-05-06T21:26:27.348 INFO:tasks.workunit.client.0.smithi032.stdout:1/11: write f0 [849793,125382] 0 2024-05-06T21:26:27.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.455+0000 7f969749a700 1 -- 172.21.15.32:0/143605226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 msgr2=0x7f9690100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:27.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.455+0000 7f969749a700 1 --2- 172.21.15.32:0/143605226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 0x7f9690100660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f968c009910 tx=0x7f968c009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:27.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.455+0000 7f969749a700 1 -- 172.21.15.32:0/143605226 shutdown_connections 2024-05-06T21:26:27.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.455+0000 7f969749a700 1 --2- 172.21.15.32:0/143605226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690101450 0x7f96901018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.455+0000 7f969749a700 1 --2- 172.21.15.32:0/143605226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 0x7f9690100660 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.455+0000 7f969749a700 1 -- 172.21.15.32:0/143605226 >> 172.21.15.32:0/143605226 conn(0x7f96900fb7e0 msgr2=0x7f96900fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.456+0000 7f969749a700 1 -- 172.21.15.32:0/143605226 shutdown_connections 2024-05-06T21:26:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.456+0000 7f969749a700 1 -- 172.21.15.32:0/143605226 wait complete. 2024-05-06T21:26:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.456+0000 7f969749a700 1 Processor -- start 2024-05-06T21:26:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.456+0000 7f969749a700 1 -- start start 2024-05-06T21:26:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f969749a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 0x7f9690074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f969749a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690101450 0x7f9690073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f969749a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690073680 con 0x7f9690100250 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f969749a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900737c0 con 0x7f9690101450 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f9695236700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 0x7f9690074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f9695236700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 0x7f9690074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52932/0 (socket says 172.21.15.32:52932) 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f9695236700 1 -- 172.21.15.32:0/1005958095 learned_addr learned my addr 172.21.15.32:0/1005958095 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f9694a35700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690101450 0x7f9690073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f9695236700 1 -- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690101450 msgr2=0x7f9690073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f9695236700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690101450 0x7f9690073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f9695236700 1 -- 172.21.15.32:0/1005958095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0095f0 con 0x7f9690100250 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.457+0000 7f9695236700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 0x7f9690074af0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f968c000c00 tx=0x7f968c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.458+0000 7f96867fc700 1 -- 172.21.15.32:0/1005958095 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f968c01d070 con 0x7f9690100250 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.458+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9690073a40 con 0x7f9690100250 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.458+0000 7f96867fc700 1 -- 172.21.15.32:0/1005958095 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f968c005dc0 con 0x7f9690100250 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.458+0000 7f96867fc700 1 -- 172.21.15.32:0/1005958095 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f968c022470 con 0x7f9690100250 2024-05-06T21:26:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.458+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9690073f30 con 0x7f9690100250 2024-05-06T21:26:27.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.459+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9690108da0 con 0x7f9690100250 2024-05-06T21:26:27.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.460+0000 7f96867fc700 1 -- 172.21.15.32:0/1005958095 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f968c003810 con 0x7f9690100250 2024-05-06T21:26:27.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.460+0000 7f96867fc700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f967c06d3c0 0x7f967c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:27.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.461+0000 7f96867fc700 1 -- 172.21.15.32:0/1005958095 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f968c08e170 con 0x7f9690100250 2024-05-06T21:26:27.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.461+0000 7f9694a35700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f967c06d3c0 0x7f967c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:27.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.462+0000 7f9694a35700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f967c06d3c0 0x7f967c06f870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9680009c60 tx=0x7f9680009260 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:27.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.465+0000 7f96867fc700 1 -- 172.21.15.32:0/1005958095 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f968c05b3e0 con 0x7f9690100250 2024-05-06T21:26:27.558 INFO:tasks.workunit.client.0.smithi032.stdout:7/24: dread f3 [0,4194304] 0 2024-05-06T21:26:27.558 INFO:tasks.workunit.client.0.smithi032.stdout:7/25: fsync f5 0 2024-05-06T21:26:27.558 INFO:tasks.workunit.client.0.smithi032.stdout:7/26: dread - f5 zero size 2024-05-06T21:26:27.570 INFO:tasks.workunit.client.0.smithi032.stdout:6/25: dwrite f2 [0,4194304] 0 2024-05-06T21:26:27.570 INFO:tasks.workunit.client.0.smithi032.stdout:6/26: creat f3 x:0 0 0 2024-05-06T21:26:27.570 INFO:tasks.workunit.client.0.smithi032.stdout:6/27: chown f3 113216659 1 2024-05-06T21:26:27.576 INFO:tasks.workunit.client.0.smithi032.stdout:4/12: mknod d2/c4 0 2024-05-06T21:26:27.576 INFO:tasks.workunit.client.0.smithi032.stdout:4/13: fsync f1 0 2024-05-06T21:26:27.580 INFO:tasks.workunit.client.0.smithi032.stdout:1/12: rename f0 to f4 0 2024-05-06T21:26:27.580 INFO:tasks.workunit.client.0.smithi032.stdout:1/13: rmdir - no directory 2024-05-06T21:26:27.580 INFO:tasks.workunit.client.0.smithi032.stdout:1/14: write f1 [1177951,15809] 0 2024-05-06T21:26:27.580 INFO:tasks.workunit.client.0.smithi032.stdout:1/15: creat f5 x:0 0 0 2024-05-06T21:26:27.580 INFO:tasks.workunit.client.0.smithi032.stdout:1/16: dread - f5 zero size 2024-05-06T21:26:27.580 INFO:tasks.workunit.client.0.smithi032.stdout:1/17: creat f6 x:0 0 0 2024-05-06T21:26:27.580 INFO:tasks.workunit.client.0.smithi032.stdout:1/18: truncate f6 333041 0 2024-05-06T21:26:27.581 INFO:tasks.workunit.client.0.smithi032.stdout:8/11: rename d0 to d0/d1 22 2024-05-06T21:26:27.581 INFO:tasks.workunit.client.0.smithi032.stdout:8/12: dwrite - no filename 2024-05-06T21:26:27.581 INFO:tasks.workunit.client.0.smithi032.stdout:8/13: dwrite - no filename 2024-05-06T21:26:27.581 INFO:tasks.workunit.client.0.smithi032.stdout:8/14: readlink - no filename 2024-05-06T21:26:27.602 INFO:tasks.workunit.client.0.smithi032.stdout:4/14: dwrite f1 [4194304,4194304] 0 2024-05-06T21:26:27.638 INFO:tasks.workunit.client.0.smithi032.stdout:7/27: unlink f5 0 2024-05-06T21:26:27.657 INFO:tasks.workunit.client.0.smithi032.stdout:0/8: read f0 [2910604,113974] 0 2024-05-06T21:26:27.657 INFO:tasks.workunit.client.0.smithi032.stdout:0/9: chown c1 142709 1 2024-05-06T21:26:27.664 INFO:tasks.workunit.client.0.smithi032.stdout:0/10: dread f0 [0,4194304] 0 2024-05-06T21:26:27.664 INFO:tasks.workunit.client.0.smithi032.stdout:0/11: rmdir - no directory 2024-05-06T21:26:27.685 INFO:tasks.workunit.client.0.smithi032.stdout:8/15: creat d0/f2 x:0 0 0 2024-05-06T21:26:27.689 INFO:tasks.workunit.client.0.smithi032.stdout:0/12: dwrite f0 [0,4194304] 0 2024-05-06T21:26:27.690 INFO:tasks.workunit.client.0.smithi032.stdout:0/13: truncate f0 5111888 0 2024-05-06T21:26:27.690 INFO:tasks.workunit.client.0.smithi032.stdout:0/14: rmdir - no directory 2024-05-06T21:26:27.696 INFO:tasks.workunit.client.0.smithi032.stdout:0/15: dread f0 [0,4194304] 0 2024-05-06T21:26:27.697 INFO:tasks.workunit.client.0.smithi032.stdout:4/15: link d2/l3 d2/l5 0 2024-05-06T21:26:27.698 INFO:tasks.workunit.client.0.smithi032.stdout:4/16: rename d2 to d2/d6 22 2024-05-06T21:26:27.705 INFO:tasks.workunit.client.0.smithi032.stdout:7/28: mknod c6 0 2024-05-06T21:26:27.705 INFO:tasks.workunit.client.0.smithi032.stdout:7/29: write f3 [942906,89003] 0 2024-05-06T21:26:27.710 INFO:tasks.workunit.client.0.smithi032.stdout:7/30: dread f3 [0,4194304] 0 2024-05-06T21:26:27.713 INFO:tasks.workunit.client.0.smithi032.stdout:6/28: unlink f3 0 2024-05-06T21:26:27.714 INFO:tasks.workunit.client.0.smithi032.stdout:6/29: readlink - no filename 2024-05-06T21:26:27.718 INFO:tasks.workunit.client.0.smithi032.stdout:0/16: dwrite f0 [0,4194304] 0 2024-05-06T21:26:27.719 INFO:tasks.workunit.client.0.smithi032.stdout:0/17: dread f0 [4194304,4194304] 0 2024-05-06T21:26:27.720 INFO:tasks.workunit.client.0.smithi032.stdout:0/18: dread f0 [4194304,4194304] 0 2024-05-06T21:26:27.720 INFO:tasks.workunit.client.0.smithi032.stdout:4/17: creat d2/f7 x:0 0 0 2024-05-06T21:26:27.721 INFO:tasks.workunit.client.0.smithi032.stdout:7/31: mknod c7 0 2024-05-06T21:26:27.721 INFO:tasks.workunit.client.0.smithi032.stdout:7/32: creat f8 x:0 0 0 2024-05-06T21:26:27.721 INFO:tasks.workunit.client.0.smithi032.stdout:7/33: chown c2 51002 1 2024-05-06T21:26:27.722 INFO:tasks.workunit.client.0.smithi032.stdout:6/30: link f2 f4 0 2024-05-06T21:26:27.722 INFO:tasks.workunit.client.0.smithi032.stdout:6/31: chown f2 7442 1 2024-05-06T21:26:27.722 INFO:tasks.workunit.client.0.smithi032.stdout:6/32: fdatasync f2 0 2024-05-06T21:26:27.724 INFO:tasks.workunit.client.0.smithi032.stdout:0/19: unlink l2 0 2024-05-06T21:26:27.724 INFO:tasks.workunit.client.0.smithi032.stdout:0/20: chown c3 43 1 2024-05-06T21:26:27.725 INFO:tasks.workunit.client.0.smithi032.stdout:4/18: write f1 [3435814,119066] 0 2024-05-06T21:26:27.725 INFO:tasks.workunit.client.0.smithi032.stdout:4/19: creat d2/f8 x:0 0 0 2024-05-06T21:26:27.725 INFO:tasks.workunit.client.0.smithi032.stdout:4/20: creat d2/f9 x:0 0 0 2024-05-06T21:26:27.725 INFO:tasks.workunit.client.0.smithi032.stdout:4/21: creat d2/fa x:0 0 0 2024-05-06T21:26:27.725 INFO:tasks.workunit.client.0.smithi032.stdout:4/22: readlink d2/l5 0 2024-05-06T21:26:27.725 INFO:tasks.workunit.client.0.smithi032.stdout:4/23: dread - d2/fa zero size 2024-05-06T21:26:27.725 INFO:tasks.workunit.client.0.smithi032.stdout:4/24: fdatasync d2/f7 0 2024-05-06T21:26:27.725 INFO:tasks.workunit.client.0.smithi032.stdout:4/25: dread - d2/f9 zero size 2024-05-06T21:26:27.725 INFO:tasks.workunit.client.0.smithi032.stdout:4/26: creat d2/fb x:0 0 0 2024-05-06T21:26:27.726 INFO:tasks.workunit.client.0.smithi032.stdout:7/34: rename c6 to c9 0 2024-05-06T21:26:27.726 INFO:tasks.workunit.client.0.smithi032.stdout:7/35: write f3 [1379183,111041] 0 2024-05-06T21:26:27.726 INFO:tasks.workunit.client.0.smithi032.stdout:7/36: dread - f8 zero size 2024-05-06T21:26:27.726 INFO:tasks.workunit.client.0.smithi032.stdout:7/37: dread - f8 zero size 2024-05-06T21:26:27.726 INFO:tasks.workunit.client.0.smithi032.stdout:7/38: dread - f8 zero size 2024-05-06T21:26:27.726 INFO:tasks.workunit.client.0.smithi032.stdout:7/39: readlink l4 0 2024-05-06T21:26:27.730 INFO:tasks.workunit.client.0.smithi032.stdout:7/40: rename c1 to ca 0 2024-05-06T21:26:27.735 INFO:tasks.workunit.client.0.smithi032.stdout:7/41: fdatasync f3 0 2024-05-06T21:26:27.735 INFO:tasks.workunit.client.0.smithi032.stdout:0/21: write f0 [811249,54557] 0 2024-05-06T21:26:27.735 INFO:tasks.workunit.client.0.smithi032.stdout:0/22: chown f0 2848498 1 2024-05-06T21:26:27.735 INFO:tasks.workunit.client.0.smithi032.stdout:7/42: dread - f8 zero size 2024-05-06T21:26:27.737 INFO:tasks.workunit.client.0.smithi032.stdout:4/27: dread f1 [0,4194304] 0 2024-05-06T21:26:27.737 INFO:tasks.workunit.client.0.smithi032.stdout:4/28: dread - d2/fb zero size 2024-05-06T21:26:27.737 INFO:tasks.workunit.client.0.smithi032.stdout:4/29: creat d2/fc x:0 0 0 2024-05-06T21:26:27.737 INFO:tasks.workunit.client.0.smithi032.stdout:4/30: readlink d2/l3 0 2024-05-06T21:26:27.737 INFO:tasks.workunit.client.0.smithi032.stdout:4/31: dread - d2/f7 zero size 2024-05-06T21:26:27.738 INFO:tasks.workunit.client.0.smithi032.stdout:4/32: dread - d2/fc zero size 2024-05-06T21:26:27.738 INFO:tasks.workunit.client.0.smithi032.stdout:4/33: fdatasync d2/f7 0 2024-05-06T21:26:27.740 INFO:tasks.workunit.client.0.smithi032.stdout:6/33: dwrite f4 [0,4194304] 0 2024-05-06T21:26:27.741 INFO:tasks.workunit.client.0.smithi032.stdout:0/23: fdatasync f0 0 2024-05-06T21:26:27.741 INFO:tasks.workunit.client.0.smithi032.stdout:0/24: readlink - no filename 2024-05-06T21:26:27.744 INFO:tasks.workunit.client.0.smithi032.stdout:6/34: unlink f2 0 2024-05-06T21:26:27.744 INFO:tasks.workunit.client.0.smithi032.stdout:6/35: creat f5 x:0 0 0 2024-05-06T21:26:27.744 INFO:tasks.workunit.client.0.smithi032.stdout:6/36: dread - f5 zero size 2024-05-06T21:26:27.744 INFO:tasks.workunit.client.0.smithi032.stdout:6/37: chown f4 3253 1 2024-05-06T21:26:27.746 INFO:tasks.workunit.client.0.smithi032.stdout:0/25: mkdir d4 0 2024-05-06T21:26:27.748 INFO:tasks.workunit.client.0.smithi032.stdout:6/38: mknod c6 0 2024-05-06T21:26:27.749 INFO:tasks.workunit.client.0.smithi032.stdout:0/26: symlink d4/l5 0 2024-05-06T21:26:27.750 INFO:tasks.workunit.client.0.smithi032.stdout:6/39: mknod c7 0 2024-05-06T21:26:27.751 INFO:tasks.workunit.client.0.smithi032.stdout:0/27: creat d4/f6 x:0 0 0 2024-05-06T21:26:27.751 INFO:tasks.workunit.client.0.smithi032.stdout:0/28: write d4/f6 [353700,78236] 0 2024-05-06T21:26:27.753 INFO:tasks.workunit.client.0.smithi032.stdout:0/29: unlink f0 0 2024-05-06T21:26:27.760 INFO:tasks.workunit.client.0.smithi032.stdout:1/19: getdents . 0 2024-05-06T21:26:27.760 INFO:tasks.workunit.client.0.smithi032.stdout:4/34: dwrite f1 [0,4194304] 0 2024-05-06T21:26:27.760 INFO:tasks.workunit.client.0.smithi032.stdout:4/35: dread - d2/f9 zero size 2024-05-06T21:26:27.760 INFO:tasks.workunit.client.0.smithi032.stdout:7/43: dwrite f8 [0,4194304] 0 2024-05-06T21:26:27.760 INFO:tasks.workunit.client.0.smithi032.stdout:1/20: write f5 [1018305,10055] 0 2024-05-06T21:26:27.764 INFO:tasks.workunit.client.0.smithi032.stdout:8/16: getdents d0 0 2024-05-06T21:26:27.764 INFO:tasks.workunit.client.0.smithi032.stdout:8/17: truncate d0/f2 431777 0 2024-05-06T21:26:27.764 INFO:tasks.workunit.client.0.smithi032.stdout:8/18: stat d0/f2 0 2024-05-06T21:26:27.764 INFO:tasks.workunit.client.0.smithi032.stdout:8/19: write d0/f2 [1393544,9755] 0 2024-05-06T21:26:27.765 INFO:tasks.workunit.client.0.smithi032.stdout:8/20: creat d0/f3 x:0 0 0 2024-05-06T21:26:27.767 INFO:tasks.workunit.client.0.smithi032.stdout:0/30: dread d4/f6 [0,4194304] 0 2024-05-06T21:26:27.767 INFO:tasks.workunit.client.0.smithi032.stdout:0/31: stat c3 0 2024-05-06T21:26:27.767 INFO:tasks.workunit.client.0.smithi032.stdout:1/21: fdatasync f5 0 2024-05-06T21:26:27.767 INFO:tasks.workunit.client.0.smithi032.stdout:0/32: creat d4/f7 x:0 0 0 2024-05-06T21:26:27.768 INFO:tasks.workunit.client.0.smithi032.stdout:1/22: write f1 [2154030,94143] 0 2024-05-06T21:26:27.768 INFO:tasks.workunit.client.0.smithi032.stdout:8/21: write d0/f2 [779508,79344] 0 2024-05-06T21:26:27.768 INFO:tasks.workunit.client.0.smithi032.stdout:1/23: chown l2 193892 1 2024-05-06T21:26:27.768 INFO:tasks.workunit.client.0.smithi032.stdout:8/22: chown d0 50 1 2024-05-06T21:26:27.772 INFO:tasks.workunit.client.0.smithi032.stdout:6/40: dwrite f5 [0,4194304] 0 2024-05-06T21:26:27.772 INFO:tasks.workunit.client.0.smithi032.stdout:1/24: symlink l7 0 2024-05-06T21:26:27.778 INFO:tasks.workunit.client.0.smithi032.stdout:8/23: dread d0/f2 [0,4194304] 0 2024-05-06T21:26:27.778 INFO:tasks.workunit.client.0.smithi032.stdout:8/24: chown d0/f2 510 1 2024-05-06T21:26:27.778 INFO:tasks.workunit.client.0.smithi032.stdout:1/25: read f4 [52604,45096] 0 2024-05-06T21:26:27.780 INFO:tasks.workunit.client.0.smithi032.stdout:1/26: creat f8 x:0 0 0 2024-05-06T21:26:27.780 INFO:tasks.workunit.client.0.smithi032.stdout:1/27: creat f9 x:0 0 0 2024-05-06T21:26:27.780 INFO:tasks.workunit.client.0.smithi032.stdout:1/28: rmdir - no directory 2024-05-06T21:26:27.780 INFO:tasks.workunit.client.0.smithi032.stdout:1/29: stat f4 0 2024-05-06T21:26:27.783 INFO:tasks.workunit.client.0.smithi032.stdout:7/44: dwrite f3 [0,4194304] 0 2024-05-06T21:26:27.784 INFO:tasks.workunit.client.0.smithi032.stdout:1/30: link l2 la 0 2024-05-06T21:26:27.787 INFO:tasks.workunit.client.0.smithi032.stdout:7/45: mkdir db 0 2024-05-06T21:26:27.788 INFO:tasks.workunit.client.0.smithi032.stdout:7/46: symlink db/lc 0 2024-05-06T21:26:27.790 INFO:tasks.workunit.client.0.smithi032.stdout:7/47: symlink db/ld 0 2024-05-06T21:26:27.790 INFO:tasks.workunit.client.0.smithi032.stdout:7/48: chown db/lc 16317102 1 2024-05-06T21:26:27.792 INFO:tasks.workunit.client.0.smithi032.stdout:7/49: creat db/fe x:0 0 0 2024-05-06T21:26:27.795 INFO:tasks.workunit.client.0.smithi032.stdout:7/50: mknod db/cf 0 2024-05-06T21:26:27.796 INFO:tasks.workunit.client.0.smithi032.stdout:7/51: creat db/f10 x:0 0 0 2024-05-06T21:26:27.796 INFO:tasks.workunit.client.0.smithi032.stdout:7/52: chown db/cf 257953981 1 2024-05-06T21:26:27.796 INFO:tasks.workunit.client.0.smithi032.stdout:7/53: chown db/ld 21 1 2024-05-06T21:26:27.800 INFO:tasks.workunit.client.0.smithi032.stdout:4/36: dwrite d2/fb [0,4194304] 0 2024-05-06T21:26:27.805 INFO:tasks.workunit.client.0.smithi032.stdout:4/37: link d2/l3 d2/ld 0 2024-05-06T21:26:27.805 INFO:tasks.workunit.client.0.smithi032.stdout:4/38: creat d2/fe x:0 0 0 2024-05-06T21:26:27.807 INFO:tasks.workunit.client.0.smithi032.stdout:4/39: symlink d2/lf 0 2024-05-06T21:26:27.809 INFO:tasks.workunit.client.0.smithi032.stdout:4/40: rename d2/f8 to d2/f10 0 2024-05-06T21:26:27.809 INFO:tasks.workunit.client.0.smithi032.stdout:4/41: chown d2/f9 98 1 2024-05-06T21:26:27.809 INFO:tasks.workunit.client.0.smithi032.stdout:4/42: truncate d2/fc 600684 0 2024-05-06T21:26:27.809 INFO:tasks.workunit.client.0.smithi032.stdout:4/43: creat d2/f11 x:0 0 0 2024-05-06T21:26:27.810 INFO:tasks.workunit.client.0.smithi032.stdout:4/44: creat d2/f12 x:0 0 0 2024-05-06T21:26:27.810 INFO:tasks.workunit.client.0.smithi032.stdout:4/45: dread - d2/fa zero size 2024-05-06T21:26:27.810 INFO:tasks.workunit.client.0.smithi032.stdout:4/46: chown d2/f7 1 1 2024-05-06T21:26:27.811 INFO:tasks.workunit.client.0.smithi032.stdout:7/54: read f8 [3829008,43898] 0 2024-05-06T21:26:27.811 INFO:tasks.workunit.client.0.smithi032.stdout:7/55: write db/fe [893408,31208] 0 2024-05-06T21:26:27.811 INFO:tasks.workunit.client.0.smithi032.stdout:7/56: chown db/f10 150 1 2024-05-06T21:26:27.812 INFO:tasks.workunit.client.0.smithi032.stdout:6/41: dwrite f4 [0,4194304] 0 2024-05-06T21:26:27.812 INFO:tasks.workunit.client.0.smithi032.stdout:8/25: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:27.814 INFO:tasks.workunit.client.0.smithi032.stdout:1/31: dwrite f8 [0,4194304] 0 2024-05-06T21:26:27.814 INFO:tasks.workunit.client.0.smithi032.stdout:1/32: stat f4 0 2024-05-06T21:26:27.815 INFO:tasks.workunit.client.0.smithi032.stdout:4/47: mkdir d2/d13 0 2024-05-06T21:26:27.817 INFO:tasks.workunit.client.0.smithi032.stdout:7/57: mknod db/c11 0 2024-05-06T21:26:27.818 INFO:tasks.workunit.client.0.smithi032.stdout:1/33: dread f4 [0,4194304] 0 2024-05-06T21:26:27.824 INFO:tasks.workunit.client.0.smithi032.stdout:0/33: fsync d4/f7 0 2024-05-06T21:26:27.826 INFO:tasks.workunit.client.0.smithi032.stdout:4/48: mknod d2/d13/c14 0 2024-05-06T21:26:27.826 INFO:tasks.workunit.client.0.smithi032.stdout:4/49: write d2/f10 [813195,16606] 0 2024-05-06T21:26:27.827 INFO:tasks.workunit.client.0.smithi032.stdout:1/34: unlink f6 0 2024-05-06T21:26:27.830 INFO:tasks.workunit.client.0.smithi032.stdout:8/26: rmdir d0 39 2024-05-06T21:26:27.831 INFO:tasks.workunit.client.0.smithi032.stdout:1/35: fsync f9 0 2024-05-06T21:26:27.831 INFO:tasks.workunit.client.0.smithi032.stdout:1/36: fsync f4 0 2024-05-06T21:26:27.833 INFO:tasks.workunit.client.0.smithi032.stdout:4/50: symlink d2/d13/l15 0 2024-05-06T21:26:27.835 INFO:tasks.workunit.client.0.smithi032.stdout:8/27: rename d0/f2 to d0/f4 0 2024-05-06T21:26:27.837 INFO:tasks.workunit.client.0.smithi032.stdout:1/37: mkdir db 0 2024-05-06T21:26:27.837 INFO:tasks.workunit.client.0.smithi032.stdout:1/38: fdatasync f5 0 2024-05-06T21:26:27.837 INFO:tasks.workunit.client.0.smithi032.stdout:0/34: rmdir d4 39 2024-05-06T21:26:27.837 INFO:tasks.workunit.client.0.smithi032.stdout:0/35: readlink d4/l5 0 2024-05-06T21:26:27.839 INFO:tasks.workunit.client.0.smithi032.stdout:4/51: mkdir d2/d16 0 2024-05-06T21:26:27.839 INFO:tasks.workunit.client.0.smithi032.stdout:8/28: dread d0/f4 [0,4194304] 0 2024-05-06T21:26:27.840 INFO:tasks.workunit.client.0.smithi032.stdout:8/29: readlink - no filename 2024-05-06T21:26:27.840 INFO:tasks.workunit.client.0.smithi032.stdout:8/30: chown d0 20 1 2024-05-06T21:26:27.840 INFO:tasks.workunit.client.0.smithi032.stdout:7/58: dwrite db/f10 [0,4194304] 0 2024-05-06T21:26:27.840 INFO:tasks.workunit.client.0.smithi032.stdout:1/39: rename la to db/lc 0 2024-05-06T21:26:27.842 INFO:tasks.workunit.client.0.smithi032.stdout:0/36: link c1 d4/c8 0 2024-05-06T21:26:27.843 INFO:tasks.workunit.client.0.smithi032.stdout:4/52: rmdir d2/d13 39 2024-05-06T21:26:27.843 INFO:tasks.workunit.client.0.smithi032.stdout:4/53: stat d2/f12 0 2024-05-06T21:26:27.843 INFO:tasks.workunit.client.0.smithi032.stdout:4/54: dread - d2/f12 zero size 2024-05-06T21:26:27.845 INFO:tasks.workunit.client.0.smithi032.stdout:7/59: mkdir db/d12 0 2024-05-06T21:26:27.847 INFO:tasks.workunit.client.0.smithi032.stdout:1/40: unlink l2 0 2024-05-06T21:26:27.848 INFO:tasks.workunit.client.0.smithi032.stdout:0/37: creat d4/f9 x:0 0 0 2024-05-06T21:26:27.852 INFO:tasks.workunit.client.0.smithi032.stdout:7/60: mkdir db/d13 0 2024-05-06T21:26:27.854 INFO:tasks.workunit.client.0.smithi032.stdout:1/41: creat db/fd x:0 0 0 2024-05-06T21:26:27.855 INFO:tasks.workunit.client.0.smithi032.stdout:4/55: unlink d2/f12 0 2024-05-06T21:26:27.855 INFO:tasks.workunit.client.0.smithi032.stdout:4/56: truncate d2/fa 931366 0 2024-05-06T21:26:27.855 INFO:tasks.workunit.client.0.smithi032.stdout:4/57: write d2/fc [777987,100193] 0 2024-05-06T21:26:27.855 INFO:tasks.workunit.client.0.smithi032.stdout:4/58: dread - d2/f7 zero size 2024-05-06T21:26:27.856 INFO:tasks.workunit.client.0.smithi032.stdout:1/42: dread f4 [0,4194304] 0 2024-05-06T21:26:27.857 INFO:tasks.workunit.client.0.smithi032.stdout:1/43: fdatasync f8 0 2024-05-06T21:26:27.857 INFO:tasks.workunit.client.0.smithi032.stdout:7/61: unlink c7 0 2024-05-06T21:26:27.863 INFO:tasks.workunit.client.0.smithi032.stdout:0/38: dwrite d4/f7 [0,4194304] 0 2024-05-06T21:26:27.863 INFO:tasks.workunit.client.0.smithi032.stdout:0/39: fdatasync d4/f6 0 2024-05-06T21:26:27.865 INFO:tasks.workunit.client.0.smithi032.stdout:4/59: getdents d2/d13 0 2024-05-06T21:26:27.868 INFO:tasks.workunit.client.0.smithi032.stdout:6/42: dread f4 [0,4194304] 0 2024-05-06T21:26:27.872 INFO:tasks.workunit.client.0.smithi032.stdout:7/62: dread f3 [0,4194304] 0 2024-05-06T21:26:27.873 INFO:tasks.workunit.client.0.smithi032.stdout:4/60: unlink d2/l3 0 2024-05-06T21:26:27.877 INFO:tasks.workunit.client.0.smithi032.stdout:1/44: dwrite f4 [0,4194304] 0 2024-05-06T21:26:27.880 INFO:tasks.workunit.client.0.smithi032.stdout:7/63: creat db/d13/f14 x:0 0 0 2024-05-06T21:26:27.891 INFO:tasks.workunit.client.0.smithi032.stdout:1/45: dread f4 [0,4194304] 0 2024-05-06T21:26:27.891 INFO:tasks.workunit.client.0.smithi032.stdout:1/46: dread - f9 zero size 2024-05-06T21:26:27.891 INFO:tasks.workunit.client.0.smithi032.stdout:1/47: fdatasync f9 0 2024-05-06T21:26:27.892 INFO:tasks.workunit.client.0.smithi032.stdout:0/40: truncate d4/f7 272595 0 2024-05-06T21:26:27.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.895+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f969019df60 con 0x7f9690100250 2024-05-06T21:26:27.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.896+0000 7f96867fc700 1 -- 172.21.15.32:0/1005958095 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f968c05af70 con 0x7f9690100250 2024-05-06T21:26:27.897 INFO:teuthology.orchestra.run.smithi032.stdout:e19 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 19 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:26:11.972572+0000 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:26:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:26:27.899 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:26:27.900 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f967c06d3c0 msgr2=0x7f967c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f967c06d3c0 0x7f967c06f870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9680009c60 tx=0x7f9680009260 comp rx=0 tx=0).stop 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 msgr2=0x7f9690074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 0x7f9690074af0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f968c000c00 tx=0x7f968c00f690 comp rx=0 tx=0).stop 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 shutdown_connections 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f967c06d3c0 0x7f967c06f870 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9690100250 0x7f9690074af0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 --2- 172.21.15.32:0/1005958095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690101450 0x7f9690073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 >> 172.21.15.32:0/1005958095 conn(0x7f96900fb7e0 msgr2=0x7f9690104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 shutdown_connections 2024-05-06T21:26:27.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:27.900+0000 7f969749a700 1 -- 172.21.15.32:0/1005958095 wait complete. 2024-05-06T21:26:27.903 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 19 2024-05-06T21:26:27.903 INFO:tasks.workunit.client.0.smithi032.stdout:4/61: dwrite d2/fa [0,4194304] 0 2024-05-06T21:26:27.913 INFO:tasks.workunit.client.0.smithi032.stdout:1/48: symlink db/le 0 2024-05-06T21:26:27.913 INFO:tasks.workunit.client.0.smithi032.stdout:1/49: fsync f8 0 2024-05-06T21:26:27.920 INFO:tasks.workunit.client.0.smithi032.stdout:7/64: dwrite db/f10 [0,4194304] 0 2024-05-06T21:26:27.920 INFO:tasks.workunit.client.0.smithi032.stdout:7/65: stat db/d13/f14 0 2024-05-06T21:26:27.925 INFO:tasks.workunit.client.0.smithi032.stdout:4/62: dwrite d2/f10 [0,4194304] 0 2024-05-06T21:26:27.926 INFO:tasks.workunit.client.0.smithi032.stdout:6/43: dwrite f5 [0,4194304] 0 2024-05-06T21:26:27.929 INFO:tasks.workunit.client.0.smithi032.stdout:7/66: mknod db/d13/c15 0 2024-05-06T21:26:27.929 INFO:tasks.workunit.client.0.smithi032.stdout:0/41: write d4/f7 [772585,111265] 0 2024-05-06T21:26:27.933 INFO:tasks.workunit.client.0.smithi032.stdout:4/63: readlink d2/l5 0 2024-05-06T21:26:27.933 INFO:tasks.workunit.client.0.smithi032.stdout:4/64: fdatasync f1 0 2024-05-06T21:26:27.934 INFO:tasks.workunit.client.0.smithi032.stdout:7/67: stat ca 0 2024-05-06T21:26:27.935 INFO:tasks.workunit.client.0.smithi032.stdout:0/42: mkdir d4/da 0 2024-05-06T21:26:27.937 INFO:tasks.workunit.client.0.smithi032.stdout:6/44: mkdir d8 0 2024-05-06T21:26:27.938 INFO:tasks.workunit.client.0.smithi032.stdout:6/45: fdatasync f5 0 2024-05-06T21:26:27.938 INFO:tasks.workunit.client.0.smithi032.stdout:7/68: mkdir db/d12/d16 0 2024-05-06T21:26:27.938 INFO:tasks.workunit.client.0.smithi032.stdout:7/69: readlink db/ld 0 2024-05-06T21:26:27.938 INFO:tasks.workunit.client.0.smithi032.stdout:7/70: fdatasync db/fe 0 2024-05-06T21:26:27.939 INFO:tasks.workunit.client.0.smithi032.stdout:0/43: creat d4/da/fb x:0 0 0 2024-05-06T21:26:27.939 INFO:tasks.workunit.client.0.smithi032.stdout:0/44: dread - d4/f9 zero size 2024-05-06T21:26:27.939 INFO:tasks.workunit.client.0.smithi032.stdout:0/45: creat d4/fc x:0 0 0 2024-05-06T21:26:27.940 INFO:tasks.workunit.client.0.smithi032.stdout:1/50: mknod db/cf 0 2024-05-06T21:26:27.940 INFO:tasks.workunit.client.0.smithi032.stdout:1/51: fsync f9 0 2024-05-06T21:26:27.942 INFO:tasks.workunit.client.0.smithi032.stdout:0/46: rename c3 to d4/da/cd 0 2024-05-06T21:26:27.943 INFO:tasks.workunit.client.0.smithi032.stdout:0/47: read - d4/f9 zero size 2024-05-06T21:26:27.944 INFO:tasks.workunit.client.0.smithi032.stdout:1/52: creat db/f10 x:0 0 0 2024-05-06T21:26:27.944 INFO:tasks.workunit.client.0.smithi032.stdout:1/53: readlink l7 0 2024-05-06T21:26:27.951 INFO:tasks.workunit.client.0.smithi032.stdout:1/54: dread f4 [0,4194304] 0 2024-05-06T21:26:27.954 INFO:tasks.workunit.client.0.smithi032.stdout:0/48: fdatasync d4/f7 0 2024-05-06T21:26:27.954 INFO:tasks.workunit.client.0.smithi032.stdout:0/49: truncate d4/f9 1027700 0 2024-05-06T21:26:27.954 INFO:tasks.workunit.client.0.smithi032.stdout:0/50: rename d4/da to d4/da/de 22 2024-05-06T21:26:27.955 INFO:tasks.workunit.client.0.smithi032.stdout:0/51: dread d4/f9 [0,4194304] 0 2024-05-06T21:26:27.955 INFO:tasks.workunit.client.0.smithi032.stdout:0/52: dread - d4/fc zero size 2024-05-06T21:26:27.955 INFO:tasks.workunit.client.0.smithi032.stdout:7/71: dwrite f8 [4194304,4194304] 0 2024-05-06T21:26:27.956 INFO:tasks.workunit.client.0.smithi032.stdout:0/53: mknod d4/da/cf 0 2024-05-06T21:26:27.958 INFO:tasks.workunit.client.0.smithi032.stdout:6/46: dwrite f4 [0,4194304] 0 2024-05-06T21:26:27.959 INFO:tasks.workunit.client.0.smithi032.stdout:0/54: symlink d4/l10 0 2024-05-06T21:26:27.959 INFO:tasks.workunit.client.0.smithi032.stdout:0/55: creat d4/da/f11 x:0 0 0 2024-05-06T21:26:27.960 INFO:tasks.workunit.client.0.smithi032.stdout:4/65: read d2/fa [1854186,94713] 0 2024-05-06T21:26:27.961 INFO:tasks.workunit.client.0.smithi032.stdout:0/56: mknod d4/c12 0 2024-05-06T21:26:27.961 INFO:tasks.workunit.client.0.smithi032.stdout:0/57: dread - d4/da/fb zero size 2024-05-06T21:26:27.961 INFO:tasks.workunit.client.0.smithi032.stdout:0/58: write d4/f6 [517656,98761] 0 2024-05-06T21:26:27.963 INFO:tasks.workunit.client.0.smithi032.stdout:0/59: symlink d4/da/l13 0 2024-05-06T21:26:27.963 INFO:tasks.workunit.client.0.smithi032.stdout:0/60: dread - d4/da/fb zero size 2024-05-06T21:26:27.965 INFO:tasks.workunit.client.0.smithi032.stdout:0/61: mkdir d4/da/d14 0 2024-05-06T21:26:27.965 INFO:tasks.workunit.client.0.smithi032.stdout:6/47: read f4 [2739704,110604] 0 2024-05-06T21:26:27.965 INFO:tasks.workunit.client.0.smithi032.stdout:6/48: readlink - no filename 2024-05-06T21:26:27.967 INFO:tasks.workunit.client.0.smithi032.stdout:0/62: symlink d4/l15 0 2024-05-06T21:26:27.967 INFO:tasks.workunit.client.0.smithi032.stdout:0/63: truncate d4/da/fb 899016 0 2024-05-06T21:26:27.967 INFO:tasks.workunit.client.0.smithi032.stdout:6/49: chown c7 1 1 2024-05-06T21:26:27.970 INFO:tasks.workunit.client.0.smithi032.stdout:0/64: mkdir d4/da/d16 0 2024-05-06T21:26:27.970 INFO:tasks.workunit.client.0.smithi032.stdout:0/65: creat d4/da/f17 x:0 0 0 2024-05-06T21:26:27.970 INFO:tasks.workunit.client.0.smithi032.stdout:0/66: stat d4 0 2024-05-06T21:26:27.970 INFO:tasks.workunit.client.0.smithi032.stdout:0/67: truncate d4/f9 1469354 0 2024-05-06T21:26:27.971 INFO:tasks.workunit.client.0.smithi032.stdout:6/50: mknod d8/c9 0 2024-05-06T21:26:27.973 INFO:tasks.workunit.client.0.smithi032.stdout:0/68: creat d4/da/d16/f18 x:0 0 0 2024-05-06T21:26:27.976 INFO:tasks.workunit.client.0.smithi032.stdout:0/69: symlink d4/l19 0 2024-05-06T21:26:27.990 INFO:tasks.workunit.client.0.smithi032.stdout:6/51: write f5 [3074301,114589] 0 2024-05-06T21:26:27.992 INFO:tasks.workunit.client.0.smithi032.stdout:1/55: dwrite f1 [0,4194304] 0 2024-05-06T21:26:27.994 INFO:tasks.workunit.client.0.smithi032.stdout:1/56: getdents db 0 2024-05-06T21:26:27.995 INFO:tasks.workunit.client.0.smithi032.stdout:4/66: dwrite d2/f10 [0,4194304] 0 2024-05-06T21:26:27.996 INFO:tasks.workunit.client.0.smithi032.stdout:7/72: dwrite db/d13/f14 [0,4194304] 0 2024-05-06T21:26:27.997 INFO:tasks.workunit.client.0.smithi032.stdout:7/73: truncate db/f10 5003637 0 2024-05-06T21:26:27.997 INFO:tasks.workunit.client.0.smithi032.stdout:1/57: unlink db/fd 0 2024-05-06T21:26:28.000 INFO:tasks.workunit.client.0.smithi032.stdout:0/70: dread d4/f6 [0,4194304] 0 2024-05-06T21:26:28.001 INFO:tasks.workunit.client.0.smithi032.stdout:7/74: link db/fe db/d12/f17 0 2024-05-06T21:26:28.001 INFO:tasks.workunit.client.0.smithi032.stdout:7/75: write f3 [4505853,77449] 0 2024-05-06T21:26:28.003 INFO:tasks.workunit.client.0.smithi032.stdout:0/71: mkdir d4/da/d14/d1a 0 2024-05-06T21:26:28.005 INFO:tasks.workunit.client.0.smithi032.stdout:1/58: mknod db/c11 0 2024-05-06T21:26:28.005 INFO:tasks.workunit.client.0.smithi032.stdout:1/59: fdatasync f8 0 2024-05-06T21:26:28.006 INFO:tasks.workunit.client.0.smithi032.stdout:6/52: getdents d8 0 2024-05-06T21:26:28.006 INFO:tasks.workunit.client.0.smithi032.stdout:6/53: write f5 [4962391,73859] 0 2024-05-06T21:26:28.008 INFO:tasks.workunit.client.0.smithi032.stdout:0/72: rename d4/da/fb to d4/da/d14/d1a/f1b 0 2024-05-06T21:26:28.009 INFO:tasks.workunit.client.0.smithi032.stdout:7/76: write db/f10 [220834,43423] 0 2024-05-06T21:26:28.009 INFO:tasks.workunit.client.0.smithi032.stdout:6/54: mkdir d8/da 0 2024-05-06T21:26:28.009 INFO:tasks.workunit.client.0.smithi032.stdout:6/55: read f5 [160344,49843] 0 2024-05-06T21:26:28.010 INFO:tasks.workunit.client.0.smithi032.stdout:0/73: creat d4/da/d14/d1a/f1c x:0 0 0 2024-05-06T21:26:28.015 INFO:tasks.workunit.client.0.smithi032.stdout:4/67: dwrite d2/f7 [0,4194304] 0 2024-05-06T21:26:28.015 INFO:tasks.workunit.client.0.smithi032.stdout:7/77: rename db/d13/f14 to db/d12/f18 0 2024-05-06T21:26:28.015 INFO:tasks.workunit.client.0.smithi032.stdout:0/74: rename d4 to d4/d1d 22 2024-05-06T21:26:28.015 INFO:tasks.workunit.client.0.smithi032.stdout:0/75: fsync d4/da/d16/f18 0 2024-05-06T21:26:28.016 INFO:tasks.workunit.client.0.smithi032.stdout:0/76: chown d4/da/d14 226920 1 2024-05-06T21:26:28.016 INFO:tasks.workunit.client.0.smithi032.stdout:0/77: creat d4/da/d14/d1a/f1e x:0 0 0 2024-05-06T21:26:28.016 INFO:tasks.workunit.client.0.smithi032.stdout:0/78: chown d4/da 6 1 2024-05-06T21:26:28.016 INFO:tasks.workunit.client.0.smithi032.stdout:6/56: creat d8/fb x:0 0 0 2024-05-06T21:26:28.017 INFO:tasks.workunit.client.0.smithi032.stdout:7/78: read db/d12/f17 [742974,71873] 0 2024-05-06T21:26:28.017 INFO:tasks.workunit.client.0.smithi032.stdout:7/79: chown f3 103295367 1 2024-05-06T21:26:28.019 INFO:tasks.workunit.client.0.smithi032.stdout:0/79: rmdir d4/da/d14 39 2024-05-06T21:26:28.020 INFO:tasks.workunit.client.0.smithi032.stdout:7/80: dread db/fe [0,4194304] 0 2024-05-06T21:26:28.020 INFO:tasks.workunit.client.0.smithi032.stdout:4/68: symlink d2/l17 0 2024-05-06T21:26:28.022 INFO:tasks.workunit.client.0.smithi032.stdout:0/80: link d4/da/d14/d1a/f1e d4/f1f 0 2024-05-06T21:26:28.023 INFO:tasks.workunit.client.0.smithi032.stdout:4/69: stat d2/fc 0 2024-05-06T21:26:28.025 INFO:tasks.workunit.client.0.smithi032.stdout:0/81: symlink d4/l20 0 2024-05-06T21:26:28.026 INFO:tasks.workunit.client.0.smithi032.stdout:0/82: write d4/f9 [894924,6562] 0 2024-05-06T21:26:28.026 INFO:tasks.workunit.client.0.smithi032.stdout:0/83: chown d4/da/d14/d1a/f1c 0 1 2024-05-06T21:26:28.026 INFO:tasks.workunit.client.0.smithi032.stdout:4/70: write d2/fe [949188,90507] 0 2024-05-06T21:26:28.027 INFO:tasks.workunit.client.0.smithi032.stdout:0/84: mkdir d4/da/d14/d21 0 2024-05-06T21:26:28.027 INFO:tasks.workunit.client.0.smithi032.stdout:0/85: truncate d4/da/d16/f18 622557 0 2024-05-06T21:26:28.027 INFO:tasks.workunit.client.0.smithi032.stdout:0/86: truncate d4/da/f17 908282 0 2024-05-06T21:26:28.027 INFO:tasks.workunit.client.0.smithi032.stdout:0/87: chown d4/c8 62432 1 2024-05-06T21:26:28.031 INFO:tasks.workunit.client.0.smithi032.stdout:1/60: dwrite f4 [4194304,4194304] 0 2024-05-06T21:26:28.032 INFO:tasks.workunit.client.0.smithi032.stdout:4/71: creat d2/f18 x:0 0 0 2024-05-06T21:26:28.033 INFO:tasks.workunit.client.0.smithi032.stdout:6/57: dwrite f4 [0,4194304] 0 2024-05-06T21:26:28.039 INFO:tasks.workunit.client.0.smithi032.stdout:7/81: getdents db/d13 0 2024-05-06T21:26:28.042 INFO:tasks.workunit.client.0.smithi032.stdout:6/58: dread f5 [0,4194304] 0 2024-05-06T21:26:28.042 INFO:tasks.workunit.client.0.smithi032.stdout:6/59: write f5 [2113343,84643] 0 2024-05-06T21:26:28.049 INFO:tasks.workunit.client.0.smithi032.stdout:4/72: write d2/fb [4032998,987] 0 2024-05-06T21:26:28.053 INFO:tasks.workunit.client.0.smithi032.stdout:4/73: link d2/d13/l15 d2/l19 0 2024-05-06T21:26:28.053 INFO:tasks.workunit.client.0.smithi032.stdout:4/74: fsync d2/f18 0 2024-05-06T21:26:28.053 INFO:tasks.workunit.client.0.smithi032.stdout:4/75: fsync d2/f18 0 2024-05-06T21:26:28.054 INFO:tasks.workunit.client.0.smithi032.stdout:1/61: dwrite f1 [4194304,4194304] 0 2024-05-06T21:26:28.057 INFO:tasks.workunit.client.0.smithi032.stdout:1/62: creat db/f12 x:0 0 0 2024-05-06T21:26:28.058 INFO:tasks.workunit.client.0.smithi032.stdout:7/82: dwrite db/d12/f17 [0,4194304] 0 2024-05-06T21:26:28.058 INFO:tasks.workunit.client.0.smithi032.stdout:7/83: readlink l4 0 2024-05-06T21:26:28.062 INFO:tasks.workunit.client.0.smithi032.stdout:7/84: creat db/d12/f19 x:0 0 0 2024-05-06T21:26:28.070 INFO:tasks.workunit.client.0.smithi032.stdout:1/63: truncate f4 7260583 0 2024-05-06T21:26:28.070 INFO:tasks.workunit.client.0.smithi032.stdout:1/64: truncate f9 536725 0 2024-05-06T21:26:28.070 INFO:tasks.workunit.client.0.smithi032.stdout:1/65: write db/f10 [387449,4525] 0 2024-05-06T21:26:28.070 INFO:tasks.workunit.client.0.smithi032.stdout:4/76: dwrite f1 [8388608,4194304] 0 2024-05-06T21:26:28.071 INFO:tasks.workunit.client.0.smithi032.stdout:7/85: dread db/fe [0,4194304] 0 2024-05-06T21:26:28.071 INFO:tasks.workunit.client.0.smithi032.stdout:7/86: fdatasync db/d12/f18 0 2024-05-06T21:26:28.071 INFO:tasks.workunit.client.0.smithi032.stdout:6/60: dwrite f5 [0,4194304] 0 2024-05-06T21:26:28.072 INFO:tasks.workunit.client.0.smithi032.stdout:6/61: getdents d8/da 0 2024-05-06T21:26:28.073 INFO:tasks.workunit.client.0.smithi032.stdout:7/87: creat db/d13/f1a x:0 0 0 2024-05-06T21:26:28.073 INFO:tasks.workunit.client.0.smithi032.stdout:7/88: write db/f10 [2694368,119379] 0 2024-05-06T21:26:28.073 INFO:tasks.workunit.client.0.smithi032.stdout:7/89: write db/f10 [4078755,99001] 0 2024-05-06T21:26:28.073 INFO:tasks.workunit.client.0.smithi032.stdout:7/90: creat db/f1b x:0 0 0 2024-05-06T21:26:28.073 INFO:tasks.workunit.client.0.smithi032.stdout:4/77: symlink d2/l1a 0 2024-05-06T21:26:28.074 INFO:tasks.workunit.client.0.smithi032.stdout:6/62: rename f5 to d8/da/fc 0 2024-05-06T21:26:28.074 INFO:tasks.workunit.client.0.smithi032.stdout:6/63: write d8/da/fc [5851758,68148] 0 2024-05-06T21:26:28.077 INFO:tasks.workunit.client.0.smithi032.stdout:7/91: write db/fe [2702610,85629] 0 2024-05-06T21:26:28.077 INFO:tasks.workunit.client.0.smithi032.stdout:7/92: chown db/d13/f1a 7 1 2024-05-06T21:26:28.077 INFO:tasks.workunit.client.0.smithi032.stdout:7/93: write db/d13/f1a [703455,5183] 0 2024-05-06T21:26:28.077 INFO:tasks.workunit.client.0.smithi032.stdout:4/78: creat d2/d13/f1b x:0 0 0 2024-05-06T21:26:28.078 INFO:tasks.workunit.client.0.smithi032.stdout:6/64: mkdir d8/dd 0 2024-05-06T21:26:28.083 INFO:tasks.workunit.client.0.smithi032.stdout:7/94: unlink db/d13/f1a 0 2024-05-06T21:26:28.083 INFO:tasks.workunit.client.0.smithi032.stdout:7/95: creat db/d12/f1c x:0 0 0 2024-05-06T21:26:28.083 INFO:tasks.workunit.client.0.smithi032.stdout:7/96: creat db/d13/f1d x:0 0 0 2024-05-06T21:26:28.083 INFO:tasks.workunit.client.0.smithi032.stdout:6/65: rename d8/c9 to d8/dd/ce 0 2024-05-06T21:26:28.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.087+0000 7ffb036ca700 1 -- 172.21.15.32:0/2962566847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 msgr2=0x7ffafc0769b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:28.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.087+0000 7ffb036ca700 1 --2- 172.21.15.32:0/2962566847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 0x7ffafc0769b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009910 tx=0x7ffaec009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:28.089 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:27 smithi032 ceph-mon[27179]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:26:28.089 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:27 smithi032 ceph-mon[27179]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:26:28.090 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:27 smithi032 ceph-mon[27179]: pgmap v14: 65 pgs: 65 active+clean; 159 MiB data, 752 MiB used, 536 GiB / 536 GiB avail; 9.1 MiB/s wr, 789 op/s 2024-05-06T21:26:28.090 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:27 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/503256000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:26:28.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.088+0000 7ffb036ca700 1 -- 172.21.15.32:0/2962566847 shutdown_connections 2024-05-06T21:26:28.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.088+0000 7ffb036ca700 1 --2- 172.21.15.32:0/2962566847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 0x7ffafc0769b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.088+0000 7ffb036ca700 1 --2- 172.21.15.32:0/2962566847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffafc075660 0x7ffafc075a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.088+0000 7ffb036ca700 1 -- 172.21.15.32:0/2962566847 >> 172.21.15.32:0/2962566847 conn(0x7ffafc0fdac0 msgr2=0x7ffafc0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:28.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.088+0000 7ffb036ca700 1 -- 172.21.15.32:0/2962566847 shutdown_connections 2024-05-06T21:26:28.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.088+0000 7ffb036ca700 1 -- 172.21.15.32:0/2962566847 wait complete. 2024-05-06T21:26:28.091 INFO:tasks.workunit.client.0.smithi032.stdout:7/97: unlink db/cf 0 2024-05-06T21:26:28.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.089+0000 7ffb036ca700 1 Processor -- start 2024-05-06T21:26:28.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.089+0000 7ffb036ca700 1 -- start start 2024-05-06T21:26:28.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.089+0000 7ffb036ca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffafc075660 0x7ffafc19c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:28.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.089+0000 7ffb036ca700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 0x7ffafc19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:28.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.089+0000 7ffb036ca700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc19cc20 con 0x7ffafc075fb0 2024-05-06T21:26:28.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.089+0000 7ffb036ca700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc19cd60 con 0x7ffafc075660 2024-05-06T21:26:28.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.089+0000 7ffb00c65700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 0x7ffafc19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:28.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.089+0000 7ffb00c65700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 0x7ffafc19c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52942/0 (socket says 172.21.15.32:52942) 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.089+0000 7ffb00c65700 1 -- 172.21.15.32:0/1075070927 learned_addr learned my addr 172.21.15.32:0/1075070927 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.090+0000 7ffb01466700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffafc075660 0x7ffafc19c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.090+0000 7ffb00c65700 1 -- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffafc075660 msgr2=0x7ffafc19c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.090+0000 7ffb00c65700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffafc075660 0x7ffafc19c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.090+0000 7ffb00c65700 1 -- 172.21.15.32:0/1075070927 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec0095f0 con 0x7ffafc075fb0 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.090+0000 7ffb00c65700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 0x7ffafc19c600 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffaec006010 tx=0x7ffaec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.091+0000 7ffaf27fc700 1 -- 172.21.15.32:0/1075070927 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaec01d070 con 0x7ffafc075fb0 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.091+0000 7ffaf27fc700 1 -- 172.21.15.32:0/1075070927 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffaec00f460 con 0x7ffafc075fb0 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.091+0000 7ffaf27fc700 1 -- 172.21.15.32:0/1075070927 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaec021640 con 0x7ffafc075fb0 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.091+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffafc1a17b0 con 0x7ffafc075fb0 2024-05-06T21:26:28.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.091+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffafc1a1c50 con 0x7ffafc075fb0 2024-05-06T21:26:28.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.093+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc10f300 con 0x7ffafc075fb0 2024-05-06T21:26:28.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.093+0000 7ffaf27fc700 1 -- 172.21.15.32:0/1075070927 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7ffaec00fab0 con 0x7ffafc075fb0 2024-05-06T21:26:28.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.094+0000 7ffaf27fc700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ffae806d3f0 0x7ffae806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:28.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.094+0000 7ffaf27fc700 1 -- 172.21.15.32:0/1075070927 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ffaec08dfa0 con 0x7ffafc075fb0 2024-05-06T21:26:28.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.094+0000 7ffb01466700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ffae806d3f0 0x7ffae806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:28.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.095+0000 7ffb01466700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ffae806d3f0 0x7ffae806f8a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8005fd0 tx=0x7ffaf8005dd0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:28.101 INFO:tasks.workunit.client.0.smithi032.stdout:1/66: dwrite f4 [4194304,4194304] 0 2024-05-06T21:26:28.102 INFO:tasks.workunit.client.0.smithi032.stdout:4/79: dwrite d2/f10 [4194304,4194304] 0 2024-05-06T21:26:28.103 INFO:tasks.workunit.client.0.smithi032.stdout:4/80: rename d2 to d2/d13/d1c 22 2024-05-06T21:26:28.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.101+0000 7ffaf27fc700 1 -- 172.21.15.32:0/1075070927 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7ffaec05b330 con 0x7ffafc075fb0 2024-05-06T21:26:28.107 INFO:tasks.workunit.client.0.smithi032.stdout:4/81: truncate d2/f11 1033352 0 2024-05-06T21:26:28.108 INFO:tasks.workunit.client.0.smithi032.stdout:7/98: getdents db/d13 0 2024-05-06T21:26:28.108 INFO:tasks.workunit.client.0.smithi032.stdout:7/99: creat db/f1e x:0 0 0 2024-05-06T21:26:28.114 INFO:tasks.workunit.client.0.smithi032.stdout:4/82: link d2/d13/l15 d2/l1d 0 2024-05-06T21:26:28.116 INFO:tasks.workunit.client.0.smithi032.stdout:1/67: truncate f9 417097 0 2024-05-06T21:26:28.117 INFO:tasks.workunit.client.0.smithi032.stdout:4/83: getdents d2/d13 0 2024-05-06T21:26:28.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:27 smithi154 ceph-mon[32880]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:26:28.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:27 smithi154 ceph-mon[32880]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:26:28.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:27 smithi154 ceph-mon[32880]: pgmap v14: 65 pgs: 65 active+clean; 159 MiB data, 752 MiB used, 536 GiB / 536 GiB avail; 9.1 MiB/s wr, 789 op/s 2024-05-06T21:26:28.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:27 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/503256000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:26:28.120 INFO:tasks.workunit.client.0.smithi032.stdout:4/84: write d2/f9 [954474,44064] 0 2024-05-06T21:26:28.120 INFO:tasks.workunit.client.0.smithi032.stdout:4/85: chown d2/fb 2401 1 2024-05-06T21:26:28.120 INFO:tasks.workunit.client.0.smithi032.stdout:4/86: write d2/d13/f1b [637597,33662] 0 2024-05-06T21:26:28.121 INFO:tasks.workunit.client.0.smithi032.stdout:1/68: rename f1 to db/f13 0 2024-05-06T21:26:28.123 INFO:tasks.workunit.client.0.smithi032.stdout:7/100: dwrite db/fe [0,4194304] 0 2024-05-06T21:26:28.123 INFO:tasks.workunit.client.0.smithi032.stdout:1/69: creat db/f14 x:0 0 0 2024-05-06T21:26:28.126 INFO:tasks.workunit.client.0.smithi032.stdout:1/70: read f5 [427930,104223] 0 2024-05-06T21:26:28.128 INFO:tasks.workunit.client.0.smithi032.stdout:4/87: dread d2/f9 [0,4194304] 0 2024-05-06T21:26:28.128 INFO:tasks.workunit.client.0.smithi032.stdout:4/88: chown d2/f10 29 1 2024-05-06T21:26:28.128 INFO:tasks.workunit.client.0.smithi032.stdout:4/89: write d2/fe [1216857,52946] 0 2024-05-06T21:26:28.130 INFO:tasks.workunit.client.0.smithi032.stdout:4/90: mkdir d2/d1e 0 2024-05-06T21:26:28.142 INFO:tasks.workunit.client.0.smithi032.stdout:4/91: dread d2/fa [0,4194304] 0 2024-05-06T21:26:28.144 INFO:tasks.workunit.client.0.smithi032.stdout:1/71: dwrite db/f13 [0,4194304] 0 2024-05-06T21:26:28.144 INFO:tasks.workunit.client.0.smithi032.stdout:4/92: unlink d2/fe 0 2024-05-06T21:26:28.145 INFO:tasks.workunit.client.0.smithi032.stdout:4/93: chown d2/f9 87185 1 2024-05-06T21:26:28.161 INFO:tasks.workunit.client.0.smithi032.stdout:1/72: dwrite f8 [0,4194304] 0 2024-05-06T21:26:28.165 INFO:tasks.workunit.client.0.smithi032.stdout:1/73: rename f4 to db/f15 0 2024-05-06T21:26:28.165 INFO:tasks.workunit.client.0.smithi032.stdout:1/74: stat db/f12 0 2024-05-06T21:26:28.184 INFO:tasks.workunit.client.0.smithi032.stdout:1/75: dwrite db/f15 [8388608,4194304] 0 2024-05-06T21:26:28.191 INFO:tasks.workunit.client.0.smithi032.stdout:1/76: rmdir db 39 2024-05-06T21:26:28.191 INFO:tasks.workunit.client.0.smithi032.stdout:1/77: fdatasync f9 0 2024-05-06T21:26:28.191 INFO:tasks.workunit.client.0.smithi032.stdout:1/78: write db/f14 [136608,109286] 0 2024-05-06T21:26:28.192 INFO:tasks.workunit.client.0.smithi032.stdout:1/79: mkdir db/d16 0 2024-05-06T21:26:28.193 INFO:tasks.workunit.client.0.smithi032.stdout:1/80: mknod db/d16/c17 0 2024-05-06T21:26:28.194 INFO:tasks.workunit.client.0.smithi032.stdout:1/81: creat db/d16/f18 x:0 0 0 2024-05-06T21:26:28.194 INFO:tasks.workunit.client.0.smithi032.stdout:1/82: creat db/f19 x:0 0 0 2024-05-06T21:26:28.195 INFO:tasks.workunit.client.0.smithi032.stdout:1/83: stat db/lc 0 2024-05-06T21:26:28.196 INFO:tasks.workunit.client.0.smithi032.stdout:1/84: mkdir db/d16/d1a 0 2024-05-06T21:26:28.196 INFO:tasks.workunit.client.0.smithi032.stdout:1/85: stat l3 0 2024-05-06T21:26:28.196 INFO:tasks.workunit.client.0.smithi032.stdout:1/86: write db/f12 [918593,60511] 0 2024-05-06T21:26:28.196 INFO:tasks.workunit.client.0.smithi032.stdout:1/87: creat db/d16/f1b x:0 0 0 2024-05-06T21:26:28.196 INFO:tasks.workunit.client.0.smithi032.stdout:1/88: chown db/f13 141072125 1 2024-05-06T21:26:28.196 INFO:tasks.workunit.client.0.smithi032.stdout:1/89: truncate db/d16/f18 128168 0 2024-05-06T21:26:28.197 INFO:tasks.workunit.client.0.smithi032.stdout:1/90: symlink db/d16/l1c 0 2024-05-06T21:26:28.197 INFO:tasks.workunit.client.0.smithi032.stdout:1/91: chown f8 3782640 1 2024-05-06T21:26:28.197 INFO:tasks.workunit.client.0.smithi032.stdout:1/92: creat db/d16/d1a/f1d x:0 0 0 2024-05-06T21:26:28.198 INFO:tasks.workunit.client.0.smithi032.stdout:1/93: link db/f13 db/d16/f1e 0 2024-05-06T21:26:28.200 INFO:tasks.workunit.client.0.smithi032.stdout:1/94: rename db/f15 to db/f1f 0 2024-05-06T21:26:28.200 INFO:tasks.workunit.client.0.smithi032.stdout:1/95: creat db/f20 x:0 0 0 2024-05-06T21:26:28.207 INFO:tasks.workunit.client.0.smithi032.stdout:1/96: rmdir db/d16/d1a 39 2024-05-06T21:26:28.207 INFO:tasks.workunit.client.0.smithi032.stdout:1/97: write f5 [404669,51374] 0 2024-05-06T21:26:28.246 INFO:tasks.workunit.client.0.smithi032.stdout:1/98: dwrite db/f1f [4194304,4194304] 0 2024-05-06T21:26:28.247 INFO:tasks.workunit.client.0.smithi032.stdout:1/99: readlink db/le 0 2024-05-06T21:26:28.249 INFO:tasks.workunit.client.0.smithi032.stdout:1/100: getdents db/d16 0 2024-05-06T21:26:28.267 INFO:tasks.workunit.client.0.smithi032.stdout:1/101: dwrite db/f13 [0,4194304] 0 2024-05-06T21:26:28.267 INFO:tasks.workunit.client.0.smithi032.stdout:1/102: readlink l3 0 2024-05-06T21:26:28.268 INFO:tasks.workunit.client.0.smithi032.stdout:1/103: readlink l7 0 2024-05-06T21:26:28.270 INFO:tasks.workunit.client.0.smithi032.stdout:1/104: unlink db/f19 0 2024-05-06T21:26:28.289 INFO:tasks.workunit.client.0.smithi032.stdout:1/105: dwrite db/f10 [0,4194304] 0 2024-05-06T21:26:28.290 INFO:tasks.workunit.client.0.smithi032.stdout:1/106: symlink db/l21 0 2024-05-06T21:26:28.292 INFO:tasks.workunit.client.0.smithi032.stdout:1/107: mknod db/c22 0 2024-05-06T21:26:28.309 INFO:tasks.workunit.client.0.smithi032.stdout:1/108: dwrite db/d16/f18 [0,4194304] 0 2024-05-06T21:26:28.322 INFO:tasks.workunit.client.0.smithi032.stdout:1/109: write db/f13 [5206308,6864] 0 2024-05-06T21:26:28.322 INFO:tasks.workunit.client.0.smithi032.stdout:1/110: fdatasync db/f1f 0 2024-05-06T21:26:28.325 INFO:tasks.workunit.client.0.smithi032.stdout:1/111: rename db/d16/d1a/f1d to db/f23 0 2024-05-06T21:26:28.334 INFO:tasks.workunit.client.0.smithi032.stdout:1/112: dread f8 [0,4194304] 0 2024-05-06T21:26:28.335 INFO:tasks.workunit.client.0.smithi032.stdout:1/113: creat db/f24 x:0 0 0 2024-05-06T21:26:28.335 INFO:tasks.workunit.client.0.smithi032.stdout:1/114: mknod db/d16/c25 0 2024-05-06T21:26:28.355 INFO:tasks.workunit.client.0.smithi032.stdout:1/115: dwrite db/d16/f1e [0,4194304] 0 2024-05-06T21:26:28.374 INFO:tasks.workunit.client.0.smithi032.stdout:1/116: dwrite db/d16/f1b [0,4194304] 0 2024-05-06T21:26:28.376 INFO:tasks.workunit.client.0.smithi032.stdout:1/117: symlink db/d16/l26 0 2024-05-06T21:26:28.385 INFO:tasks.workunit.client.0.smithi032.stdout:1/118: write db/d16/f1e [3135200,104875] 0 2024-05-06T21:26:28.385 INFO:tasks.workunit.client.0.smithi032.stdout:1/119: chown f5 146 1 2024-05-06T21:26:28.385 INFO:tasks.workunit.client.0.smithi032.stdout:1/120: dread - db/f24 zero size 2024-05-06T21:26:28.403 INFO:tasks.workunit.client.0.smithi032.stdout:1/121: dwrite f5 [0,4194304] 0 2024-05-06T21:26:28.407 INFO:tasks.workunit.client.0.smithi032.stdout:1/122: rmdir db/d16/d1a 0 2024-05-06T21:26:28.409 INFO:tasks.workunit.client.0.smithi032.stdout:1/123: rename f5 to db/f27 0 2024-05-06T21:26:28.409 INFO:tasks.workunit.client.0.smithi032.stdout:1/124: fdatasync db/f24 0 2024-05-06T21:26:28.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.462+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 --> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffafc10de70 con 0x7ffae806d3f0 2024-05-06T21:26:28.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.464+0000 7ffaf27fc700 1 -- 172.21.15.32:0/1075070927 <== mgr.24395 v2:172.21.15.154:6828/2671631515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7ffafc10de70 con 0x7ffae806d3f0 2024-05-06T21:26:28.465 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:26:28.465 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:26:28.466 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:26:28.466 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:26:28.466 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [], 2024-05-06T21:26:28.466 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "1/23 daemons upgraded", 2024-05-06T21:26:28.466 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "", 2024-05-06T21:26:28.466 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:26:28.466 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ffae806d3f0 msgr2=0x7ffae806f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ffae806d3f0 0x7ffae806f8a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8005fd0 tx=0x7ffaf8005dd0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 msgr2=0x7ffafc19c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 0x7ffafc19c600 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffaec006010 tx=0x7ffaec00be20 comp rx=0 tx=0).stop 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 shutdown_connections 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ffae806d3f0 0x7ffae806f8a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffafc075660 0x7ffafc19c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 --2- 172.21.15.32:0/1075070927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffafc075fb0 0x7ffafc19c600 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 >> 172.21.15.32:0/1075070927 conn(0x7ffafc0fdac0 msgr2=0x7ffafc10c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 shutdown_connections 2024-05-06T21:26:28.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.466+0000 7ffb036ca700 1 -- 172.21.15.32:0/1075070927 wait complete. 2024-05-06T21:26:28.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.596+0000 7f4c42e68700 1 -- 172.21.15.32:0/2800245964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c1007d0 msgr2=0x7f4c3c100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:28.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.596+0000 7f4c42e68700 1 --2- 172.21.15.32:0/2800245964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c1007d0 0x7f4c3c100be0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009910 tx=0x7f4c30009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:28.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.596+0000 7f4c42e68700 1 -- 172.21.15.32:0/2800245964 shutdown_connections 2024-05-06T21:26:28.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.596+0000 7f4c42e68700 1 --2- 172.21.15.32:0/2800245964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c3c101120 0x7f4c3c107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.596+0000 7f4c42e68700 1 --2- 172.21.15.32:0/2800245964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c1007d0 0x7f4c3c100be0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.596+0000 7f4c42e68700 1 -- 172.21.15.32:0/2800245964 >> 172.21.15.32:0/2800245964 conn(0x7f4c3c0f9f10 msgr2=0x7f4c3c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.596+0000 7f4c42e68700 1 -- 172.21.15.32:0/2800245964 shutdown_connections 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.596+0000 7f4c42e68700 1 -- 172.21.15.32:0/2800245964 wait complete. 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c42e68700 1 Processor -- start 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c42e68700 1 -- start start 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c42e68700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c3c1007d0 0x7f4c3c197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c42e68700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c101120 0x7f4c3c198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c42e68700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c198850 con 0x7f4c3c101120 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c42e68700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c19d260 con 0x7f4c3c1007d0 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c40c04700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c3c1007d0 0x7f4c3c197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c3bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c101120 0x7f4c3c198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c40c04700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c3c1007d0 0x7f4c3c197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.32:55848/0 (socket says 172.21.15.32:55848) 2024-05-06T21:26:28.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.597+0000 7f4c40c04700 1 -- 172.21.15.32:0/2786377634 learned_addr learned my addr 172.21.15.32:0/2786377634 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.598+0000 7f4c40c04700 1 -- 172.21.15.32:0/2786377634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c101120 msgr2=0x7f4c3c198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.598+0000 7f4c40c04700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c101120 0x7f4c3c198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.598+0000 7f4c40c04700 1 -- 172.21.15.32:0/2786377634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300095f0 con 0x7f4c3c1007d0 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.598+0000 7f4c40c04700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c3c1007d0 0x7f4c3c197cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000fa00 tx=0x7f4c3000fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.598+0000 7f4c39ffb700 1 -- 172.21.15.32:0/2786377634 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c3001d070 con 0x7f4c3c1007d0 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.598+0000 7f4c39ffb700 1 -- 172.21.15.32:0/2786377634 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c3000fe90 con 0x7f4c3c1007d0 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.598+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c19d400 con 0x7f4c3c1007d0 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.598+0000 7f4c39ffb700 1 -- 172.21.15.32:0/2786377634 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c30003ea0 con 0x7f4c3c1007d0 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.599+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3c19d8c0 con 0x7f4c3c1007d0 2024-05-06T21:26:28.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.600+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3c191e10 con 0x7f4c3c1007d0 2024-05-06T21:26:28.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.601+0000 7f4c39ffb700 1 -- 172.21.15.32:0/2786377634 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f4c30003680 con 0x7f4c3c1007d0 2024-05-06T21:26:28.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.601+0000 7f4c39ffb700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f4c2c06d3c0 0x7f4c2c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:28.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.601+0000 7f4c39ffb700 1 -- 172.21.15.32:0/2786377634 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4c3008e0f0 con 0x7f4c3c1007d0 2024-05-06T21:26:28.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.602+0000 7f4c3bfff700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f4c2c06d3c0 0x7f4c2c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:28.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.602+0000 7f4c3bfff700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f4c2c06d3c0 0x7f4c2c06f870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c101550 tx=0x7f4c28009260 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:28.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.610+0000 7f4c39ffb700 1 -- 172.21.15.32:0/2786377634 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f4c300578b0 con 0x7f4c3c1007d0 2024-05-06T21:26:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.923+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4c3c02cc30 con 0x7f4c3c1007d0 2024-05-06T21:26:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.924+0000 7f4c39ffb700 1 -- 172.21.15.32:0/2786377634 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4c3000b5a0 con 0x7f4c3c1007d0 2024-05-06T21:26:28.926 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:26:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f4c2c06d3c0 msgr2=0x7f4c2c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f4c2c06d3c0 0x7f4c2c06f870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c101550 tx=0x7f4c28009260 comp rx=0 tx=0).stop 2024-05-06T21:26:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c3c1007d0 msgr2=0x7f4c3c197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c3c1007d0 0x7f4c3c197cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000fa00 tx=0x7f4c3000fa30 comp rx=0 tx=0).stop 2024-05-06T21:26:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 shutdown_connections 2024-05-06T21:26:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f4c2c06d3c0 0x7f4c2c06f870 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c3c1007d0 0x7f4c3c197cf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 --2- 172.21.15.32:0/2786377634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c3c101120 0x7f4c3c198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 >> 172.21.15.32:0/2786377634 conn(0x7f4c3c0f9f10 msgr2=0x7f4c3c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.927+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 shutdown_connections 2024-05-06T21:26:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:28.928+0000 7f4c42e68700 1 -- 172.21.15.32:0/2786377634 wait complete. 2024-05-06T21:26:29.018 INFO:tasks.workunit.client.0.smithi032.stdout:2/1: sync 2024-05-06T21:26:29.019 INFO:tasks.workunit.client.0.smithi032.stdout:3/7: sync 2024-05-06T21:26:29.019 INFO:tasks.workunit.client.0.smithi032.stdout:5/5: sync 2024-05-06T21:26:29.019 INFO:tasks.workunit.client.0.smithi032.stdout:5/6: dwrite - no filename 2024-05-06T21:26:29.019 INFO:tasks.workunit.client.0.smithi032.stdout:5/7: write - no filename 2024-05-06T21:26:29.019 INFO:tasks.workunit.client.0.smithi032.stdout:5/8: chown d0 0 1 2024-05-06T21:26:29.020 INFO:tasks.workunit.client.0.smithi032.stdout:5/9: unlink d0/l2 0 2024-05-06T21:26:29.020 INFO:tasks.workunit.client.0.smithi032.stdout:5/10: creat d0/f3 x:0 0 0 2024-05-06T21:26:29.020 INFO:tasks.workunit.client.0.smithi032.stdout:5/11: dread - d0/f3 zero size 2024-05-06T21:26:29.020 INFO:tasks.workunit.client.0.smithi032.stdout:5/12: truncate d0/f3 755648 0 2024-05-06T21:26:29.025 INFO:tasks.workunit.client.0.smithi032.stdout:3/8: dread f0 [0,4194304] 0 2024-05-06T21:26:29.025 INFO:tasks.workunit.client.0.smithi032.stdout:3/9: rename d1 to d1/d3 22 2024-05-06T21:26:29.028 INFO:tasks.workunit.client.0.smithi032.stdout:3/10: dread f0 [0,4194304] 0 2024-05-06T21:26:29.031 INFO:tasks.workunit.client.0.smithi032.stdout:3/11: write f0 [4891,114836] 0 2024-05-06T21:26:29.033 INFO:tasks.workunit.client.0.smithi032.stdout:3/12: mkdir d1/d4 0 2024-05-06T21:26:29.048 INFO:tasks.workunit.client.0.smithi032.stdout:5/13: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:29.053 INFO:tasks.workunit.client.0.smithi032.stdout:3/13: dwrite f0 [4194304,4194304] 0 2024-05-06T21:26:29.070 INFO:tasks.workunit.client.0.smithi032.stdout:3/14: dwrite f0 [4194304,4194304] 0 2024-05-06T21:26:29.071 INFO:tasks.workunit.client.0.smithi032.stdout:3/15: creat d1/f5 x:0 0 0 2024-05-06T21:26:29.071 INFO:tasks.workunit.client.0.smithi032.stdout:3/16: write d1/f5 [766216,20431] 0 2024-05-06T21:26:29.071 INFO:tasks.workunit.client.0.smithi032.stdout:3/17: creat d1/f6 x:0 0 0 2024-05-06T21:26:29.071 INFO:tasks.workunit.client.0.smithi032.stdout:3/18: write f0 [2159845,124299] 0 2024-05-06T21:26:29.084 INFO:tasks.workunit.client.0.smithi032.stdout:3/19: dread f0 [4194304,4194304] 0 2024-05-06T21:26:29.085 INFO:tasks.workunit.client.0.smithi032.stdout:3/20: creat d1/d4/f7 x:0 0 0 2024-05-06T21:26:29.086 INFO:tasks.workunit.client.0.smithi032.stdout:3/21: link d1/l2 d1/l8 0 2024-05-06T21:26:29.087 INFO:tasks.workunit.client.0.smithi032.stdout:3/22: creat d1/d4/f9 x:0 0 0 2024-05-06T21:26:29.102 INFO:tasks.workunit.client.0.smithi032.stdout:3/23: dwrite d1/f5 [0,4194304] 0 2024-05-06T21:26:29.102 INFO:tasks.workunit.client.0.smithi032.stdout:3/24: write f0 [971881,76516] 0 2024-05-06T21:26:29.102 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:28 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1005958095' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:26:29.103 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:28 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:29.103 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:28 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:29.104 INFO:tasks.workunit.client.0.smithi032.stdout:3/25: getdents d1/d4 0 2024-05-06T21:26:29.122 INFO:tasks.workunit.client.0.smithi032.stdout:3/26: dwrite d1/d4/f7 [0,4194304] 0 2024-05-06T21:26:29.124 INFO:tasks.workunit.client.0.smithi032.stdout:3/27: getdents d1 0 2024-05-06T21:26:29.125 INFO:tasks.workunit.client.0.smithi032.stdout:3/28: fsync d1/f6 0 2024-05-06T21:26:29.125 INFO:tasks.workunit.client.0.smithi032.stdout:3/29: write d1/f6 [592852,65129] 0 2024-05-06T21:26:29.125 INFO:tasks.workunit.client.0.smithi032.stdout:3/30: chown d1/d4/f9 2 1 2024-05-06T21:26:29.125 INFO:tasks.workunit.client.0.smithi032.stdout:3/31: readlink d1/l2 0 2024-05-06T21:26:29.125 INFO:tasks.workunit.client.0.smithi032.stdout:3/32: mkdir d1/d4/da 0 2024-05-06T21:26:29.127 INFO:tasks.workunit.client.0.smithi032.stdout:3/33: creat d1/fb x:0 0 0 2024-05-06T21:26:29.129 INFO:tasks.workunit.client.0.smithi032.stdout:3/34: link d1/d4/f7 d1/d4/da/fc 0 2024-05-06T21:26:29.212 INFO:tasks.workunit.client.0.smithi032.stdout:8/31: sync 2024-05-06T21:26:29.213 INFO:tasks.workunit.client.0.smithi032.stdout:9/0: sync 2024-05-06T21:26:29.213 INFO:tasks.workunit.client.0.smithi032.stdout:8/32: stat d0/f3 0 2024-05-06T21:26:29.214 INFO:tasks.workunit.client.0.smithi032.stdout:9/1: creat f0 x:0 0 0 2024-05-06T21:26:29.214 INFO:tasks.workunit.client.0.smithi032.stdout:9/2: dread - f0 zero size 2024-05-06T21:26:29.214 INFO:tasks.workunit.client.0.smithi032.stdout:9/3: read - f0 zero size 2024-05-06T21:26:29.215 INFO:tasks.workunit.client.0.smithi032.stdout:8/33: dread d0/f4 [0,4194304] 0 2024-05-06T21:26:29.215 INFO:tasks.workunit.client.0.smithi032.stdout:8/34: fsync d0/f4 0 2024-05-06T21:26:29.215 INFO:tasks.workunit.client.0.smithi032.stdout:9/4: mkdir d1 0 2024-05-06T21:26:29.215 INFO:tasks.workunit.client.0.smithi032.stdout:9/5: write f0 [995642,79836] 0 2024-05-06T21:26:29.218 INFO:tasks.workunit.client.0.smithi032.stdout:9/6: fdatasync f0 0 2024-05-06T21:26:29.218 INFO:tasks.workunit.client.0.smithi032.stdout:9/7: chown f0 62915 1 2024-05-06T21:26:29.220 INFO:tasks.workunit.client.0.smithi032.stdout:9/8: rename f0 to d1/f2 0 2024-05-06T21:26:29.221 INFO:tasks.workunit.client.0.smithi032.stdout:9/9: symlink d1/l3 0 2024-05-06T21:26:29.223 INFO:tasks.workunit.client.0.smithi032.stdout:9/10: read d1/f2 [432068,11584] 0 2024-05-06T21:26:29.223 INFO:tasks.workunit.client.0.smithi032.stdout:9/11: chown d1/f2 58316 1 2024-05-06T21:26:29.223 INFO:tasks.workunit.client.0.smithi032.stdout:9/12: rmdir d1 39 2024-05-06T21:26:29.224 INFO:tasks.workunit.client.0.smithi032.stdout:9/13: chown d1/f2 95 1 2024-05-06T21:26:29.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:28 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1005958095' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:26:29.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:28 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:29.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:28 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:29.238 INFO:tasks.workunit.client.0.smithi032.stdout:8/35: dwrite d0/f4 [0,4194304] 0 2024-05-06T21:26:29.238 INFO:tasks.workunit.client.0.smithi032.stdout:9/14: dwrite d1/f2 [0,4194304] 0 2024-05-06T21:26:29.238 INFO:tasks.workunit.client.0.smithi032.stdout:9/15: chown d1/l3 12 1 2024-05-06T21:26:29.241 INFO:tasks.workunit.client.0.smithi032.stdout:9/16: creat d1/f4 x:0 0 0 2024-05-06T21:26:29.241 INFO:tasks.workunit.client.0.smithi032.stdout:9/17: stat d1 0 2024-05-06T21:26:29.242 INFO:tasks.workunit.client.0.smithi032.stdout:8/36: creat d0/f5 x:0 0 0 2024-05-06T21:26:29.242 INFO:tasks.workunit.client.0.smithi032.stdout:8/37: fdatasync d0/f5 0 2024-05-06T21:26:29.243 INFO:tasks.workunit.client.0.smithi032.stdout:8/38: chown d0/f4 14 1 2024-05-06T21:26:29.247 INFO:tasks.workunit.client.0.smithi032.stdout:8/39: rmdir d0 39 2024-05-06T21:26:29.247 INFO:tasks.workunit.client.0.smithi032.stdout:8/40: write d0/f5 [884119,103143] 0 2024-05-06T21:26:29.247 INFO:tasks.workunit.client.0.smithi032.stdout:9/18: write d1/f2 [949044,95911] 0 2024-05-06T21:26:29.248 INFO:tasks.workunit.client.0.smithi032.stdout:9/19: getdents d1 0 2024-05-06T21:26:29.250 INFO:tasks.workunit.client.0.smithi032.stdout:9/20: unlink d1/l3 0 2024-05-06T21:26:29.251 INFO:tasks.workunit.client.0.smithi032.stdout:9/21: creat d1/f5 x:0 0 0 2024-05-06T21:26:29.252 INFO:tasks.workunit.client.0.smithi032.stdout:9/22: unlink d1/f5 0 2024-05-06T21:26:29.258 INFO:tasks.workunit.client.0.smithi032.stdout:9/23: fsync d1/f2 0 2024-05-06T21:26:29.261 INFO:tasks.workunit.client.0.smithi032.stdout:9/24: symlink d1/l6 0 2024-05-06T21:26:29.261 INFO:tasks.workunit.client.0.smithi032.stdout:9/25: creat d1/f7 x:0 0 0 2024-05-06T21:26:29.262 INFO:tasks.workunit.client.0.smithi032.stdout:9/26: write d1/f4 [55284,128239] 0 2024-05-06T21:26:29.262 INFO:tasks.workunit.client.0.smithi032.stdout:9/27: creat d1/f8 x:0 0 0 2024-05-06T21:26:29.263 INFO:tasks.workunit.client.0.smithi032.stdout:9/28: creat d1/f9 x:0 0 0 2024-05-06T21:26:29.263 INFO:tasks.workunit.client.0.smithi032.stdout:9/29: chown d1/f2 243404432 1 2024-05-06T21:26:29.264 INFO:tasks.workunit.client.0.smithi032.stdout:9/30: creat d1/fa x:0 0 0 2024-05-06T21:26:29.265 INFO:tasks.workunit.client.0.smithi032.stdout:9/31: write d1/f8 [928071,28301] 0 2024-05-06T21:26:29.266 INFO:tasks.workunit.client.0.smithi032.stdout:9/32: link d1/l6 d1/lb 0 2024-05-06T21:26:29.266 INFO:tasks.workunit.client.0.smithi032.stdout:9/33: chown d1 5 1 2024-05-06T21:26:29.266 INFO:tasks.workunit.client.0.smithi032.stdout:9/34: stat d1/f9 0 2024-05-06T21:26:29.266 INFO:tasks.workunit.client.0.smithi032.stdout:9/35: truncate d1/fa 447072 0 2024-05-06T21:26:29.266 INFO:tasks.workunit.client.0.smithi032.stdout:9/36: truncate d1/f9 397431 0 2024-05-06T21:26:29.267 INFO:tasks.workunit.client.0.smithi032.stdout:8/41: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:29.270 INFO:tasks.workunit.client.0.smithi032.stdout:8/42: creat d0/f6 x:0 0 0 2024-05-06T21:26:29.276 INFO:tasks.workunit.client.0.smithi032.stdout:9/37: truncate d1/f8 31280 0 2024-05-06T21:26:29.278 INFO:tasks.workunit.client.0.smithi032.stdout:8/43: getdents d0 0 2024-05-06T21:26:29.278 INFO:tasks.workunit.client.0.smithi032.stdout:8/44: fsync d0/f3 0 2024-05-06T21:26:29.278 INFO:tasks.workunit.client.0.smithi032.stdout:8/45: readlink - no filename 2024-05-06T21:26:29.280 INFO:tasks.workunit.client.0.smithi032.stdout:8/46: creat d0/f7 x:0 0 0 2024-05-06T21:26:29.293 INFO:tasks.workunit.client.0.smithi032.stdout:9/38: dwrite d1/fa [0,4194304] 0 2024-05-06T21:26:29.293 INFO:tasks.workunit.client.0.smithi032.stdout:9/39: readlink d1/lb 0 2024-05-06T21:26:29.302 INFO:tasks.workunit.client.0.smithi032.stdout:9/40: fdatasync d1/f4 0 2024-05-06T21:26:29.302 INFO:tasks.workunit.client.0.smithi032.stdout:9/41: stat d1/f2 0 2024-05-06T21:26:29.302 INFO:tasks.workunit.client.0.smithi032.stdout:8/47: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:29.302 INFO:tasks.workunit.client.0.smithi032.stdout:8/48: creat d0/f8 x:0 0 0 2024-05-06T21:26:29.303 INFO:tasks.workunit.client.0.smithi032.stdout:8/49: read - d0/f8 zero size 2024-05-06T21:26:29.303 INFO:tasks.workunit.client.0.smithi032.stdout:9/42: symlink d1/lc 0 2024-05-06T21:26:29.304 INFO:tasks.workunit.client.0.smithi032.stdout:8/50: creat d0/f9 x:0 0 0 2024-05-06T21:26:29.305 INFO:tasks.workunit.client.0.smithi032.stdout:9/43: symlink d1/ld 0 2024-05-06T21:26:29.305 INFO:tasks.workunit.client.0.smithi032.stdout:8/51: truncate d0/f4 3880338 0 2024-05-06T21:26:29.307 INFO:tasks.workunit.client.0.smithi032.stdout:9/44: dread d1/f4 [0,4194304] 0 2024-05-06T21:26:29.331 INFO:tasks.workunit.client.0.smithi032.stdout:9/45: dwrite d1/f4 [0,4194304] 0 2024-05-06T21:26:29.332 INFO:tasks.workunit.client.0.smithi032.stdout:8/52: dwrite d0/f5 [0,4194304] 0 2024-05-06T21:26:29.332 INFO:tasks.workunit.client.0.smithi032.stdout:8/53: write d0/f9 [164218,51566] 0 2024-05-06T21:26:29.332 INFO:tasks.workunit.client.0.smithi032.stdout:8/54: readlink - no filename 2024-05-06T21:26:29.332 INFO:tasks.workunit.client.0.smithi032.stdout:9/46: creat d1/fe x:0 0 0 2024-05-06T21:26:29.333 INFO:tasks.workunit.client.0.smithi032.stdout:8/55: write d0/f6 [330355,53404] 0 2024-05-06T21:26:29.335 INFO:tasks.workunit.client.0.smithi032.stdout:8/56: creat d0/fa x:0 0 0 2024-05-06T21:26:29.336 INFO:tasks.workunit.client.0.smithi032.stdout:9/47: mknod d1/cf 0 2024-05-06T21:26:29.337 INFO:tasks.workunit.client.0.smithi032.stdout:8/57: creat d0/fb x:0 0 0 2024-05-06T21:26:29.338 INFO:tasks.workunit.client.0.smithi032.stdout:8/58: readlink - no filename 2024-05-06T21:26:29.349 INFO:tasks.workunit.client.0.smithi032.stdout:8/59: dwrite d0/f5 [0,4194304] 0 2024-05-06T21:26:29.399 INFO:tasks.workunit.client.0.smithi032.stdout:0/88: sync 2024-05-06T21:26:29.413 INFO:tasks.workunit.client.0.smithi032.stdout:0/89: dwrite d4/f9 [0,4194304] 0 2024-05-06T21:26:29.414 INFO:tasks.workunit.client.0.smithi032.stdout:0/90: write d4/da/f17 [363415,29956] 0 2024-05-06T21:26:29.414 INFO:tasks.workunit.client.0.smithi032.stdout:0/91: truncate d4/f7 1200030 0 2024-05-06T21:26:29.414 INFO:tasks.workunit.client.0.smithi032.stdout:0/92: readlink d4/l10 0 2024-05-06T21:26:29.414 INFO:tasks.workunit.client.0.smithi032.stdout:0/93: dread - d4/da/d14/d1a/f1c zero size 2024-05-06T21:26:29.548 INFO:tasks.workunit.client.0.smithi032.stdout:6/66: sync 2024-05-06T21:26:29.548 INFO:tasks.workunit.client.0.smithi032.stdout:7/101: sync 2024-05-06T21:26:29.548 INFO:tasks.workunit.client.0.smithi032.stdout:7/102: creat db/f1f x:0 0 0 2024-05-06T21:26:29.566 INFO:tasks.workunit.client.0.smithi032.stdout:6/67: dwrite d8/da/fc [0,4194304] 0 2024-05-06T21:26:29.566 INFO:tasks.workunit.client.0.smithi032.stdout:6/68: chown d8/da/fc 1882047 1 2024-05-06T21:26:29.570 INFO:tasks.workunit.client.0.smithi032.stdout:6/69: symlink d8/da/lf 0 2024-05-06T21:26:29.570 INFO:tasks.workunit.client.0.smithi032.stdout:6/70: fsync d8/fb 0 2024-05-06T21:26:29.570 INFO:tasks.workunit.client.0.smithi032.stdout:6/71: truncate d8/fb 863659 0 2024-05-06T21:26:29.570 INFO:tasks.workunit.client.0.smithi032.stdout:6/72: chown d8/fb 0 1 2024-05-06T21:26:29.570 INFO:tasks.workunit.client.0.smithi032.stdout:6/73: creat d8/f10 x:0 0 0 2024-05-06T21:26:29.585 INFO:tasks.workunit.client.0.smithi032.stdout:6/74: dwrite d8/fb [0,4194304] 0 2024-05-06T21:26:29.585 INFO:tasks.workunit.client.0.smithi032.stdout:6/75: write d8/f10 [877633,67188] 0 2024-05-06T21:26:29.593 INFO:tasks.workunit.client.0.smithi032.stdout:6/76: dread d8/da/fc [0,4194304] 0 2024-05-06T21:26:29.595 INFO:tasks.workunit.client.0.smithi032.stdout:6/77: getdents d8 0 2024-05-06T21:26:29.612 INFO:tasks.workunit.client.0.smithi032.stdout:6/78: dwrite d8/fb [0,4194304] 0 2024-05-06T21:26:29.618 INFO:tasks.workunit.client.0.smithi032.stdout:6/79: dread f4 [0,4194304] 0 2024-05-06T21:26:29.618 INFO:tasks.workunit.client.0.smithi032.stdout:6/80: chown f4 13467 1 2024-05-06T21:26:29.620 INFO:tasks.workunit.client.0.smithi032.stdout:6/81: unlink c6 0 2024-05-06T21:26:29.637 INFO:tasks.workunit.client.0.smithi032.stdout:6/82: dwrite d8/da/fc [0,4194304] 0 2024-05-06T21:26:29.637 INFO:tasks.workunit.client.0.smithi032.stdout:6/83: read d8/f10 [420399,37071] 0 2024-05-06T21:26:29.650 INFO:tasks.workunit.client.0.smithi032.stdout:6/84: dwrite f4 [0,4194304] 0 2024-05-06T21:26:29.650 INFO:tasks.workunit.client.0.smithi032.stdout:6/85: chown c7 276 1 2024-05-06T21:26:29.651 INFO:tasks.workunit.client.0.smithi032.stdout:6/86: creat d8/da/f11 x:0 0 0 2024-05-06T21:26:29.651 INFO:tasks.workunit.client.0.smithi032.stdout:6/87: stat d8/da 0 2024-05-06T21:26:29.651 INFO:tasks.workunit.client.0.smithi032.stdout:6/88: read d8/f10 [719597,14866] 0 2024-05-06T21:26:29.652 INFO:tasks.workunit.client.0.smithi032.stdout:6/89: creat d8/dd/f12 x:0 0 0 2024-05-06T21:26:29.652 INFO:tasks.workunit.client.0.smithi032.stdout:6/90: chown d8/da 90 1 2024-05-06T21:26:29.668 INFO:tasks.workunit.client.0.smithi032.stdout:6/91: dwrite d8/f10 [0,4194304] 0 2024-05-06T21:26:29.678 INFO:tasks.workunit.client.0.smithi032.stdout:6/92: write d8/fb [382218,1841] 0 2024-05-06T21:26:29.694 INFO:tasks.workunit.client.0.smithi032.stdout:6/93: dwrite d8/da/fc [0,4194304] 0 2024-05-06T21:26:29.703 INFO:tasks.workunit.client.0.smithi032.stdout:6/94: dread d8/f10 [0,4194304] 0 2024-05-06T21:26:29.746 INFO:tasks.workunit.client.0.smithi032.stdout:1/125: sync 2024-05-06T21:26:29.746 INFO:tasks.workunit.client.0.smithi032.stdout:4/94: sync 2024-05-06T21:26:29.746 INFO:tasks.workunit.client.0.smithi032.stdout:1/126: fsync db/d16/f1e 0 2024-05-06T21:26:29.748 INFO:tasks.workunit.client.0.smithi032.stdout:4/95: symlink d2/d16/l1f 0 2024-05-06T21:26:29.748 INFO:tasks.workunit.client.0.smithi032.stdout:4/96: chown f1 48408 1 2024-05-06T21:26:29.749 INFO:tasks.workunit.client.0.smithi032.stdout:1/127: symlink db/l28 0 2024-05-06T21:26:29.751 INFO:tasks.workunit.client.0.smithi032.stdout:1/128: creat db/f29 x:0 0 0 2024-05-06T21:26:29.752 INFO:tasks.workunit.client.0.smithi032.stdout:4/97: unlink d2/lf 0 2024-05-06T21:26:29.752 INFO:tasks.workunit.client.0.smithi032.stdout:4/98: fdatasync d2/fc 0 2024-05-06T21:26:29.754 INFO:tasks.workunit.client.0.smithi032.stdout:1/129: mkdir db/d2a 0 2024-05-06T21:26:29.754 INFO:tasks.workunit.client.0.smithi032.stdout:1/130: fsync db/f27 0 2024-05-06T21:26:29.754 INFO:tasks.workunit.client.0.smithi032.stdout:1/131: fdatasync db/d16/f1b 0 2024-05-06T21:26:29.755 INFO:tasks.workunit.client.0.smithi032.stdout:1/132: rmdir db/d16 39 2024-05-06T21:26:29.756 INFO:tasks.workunit.client.0.smithi032.stdout:1/133: mknod db/d16/c2b 0 2024-05-06T21:26:29.756 INFO:tasks.workunit.client.0.smithi032.stdout:1/134: chown db/d16/c17 63364 1 2024-05-06T21:26:29.760 INFO:tasks.workunit.client.0.smithi032.stdout:4/99: dread f1 [0,4194304] 0 2024-05-06T21:26:29.762 INFO:tasks.workunit.client.0.smithi032.stdout:4/100: mknod d2/c20 0 2024-05-06T21:26:29.764 INFO:tasks.workunit.client.0.smithi032.stdout:4/101: link d2/fc d2/d1e/f21 0 2024-05-06T21:26:29.773 INFO:tasks.workunit.client.0.smithi032.stdout:1/135: dwrite f8 [0,4194304] 0 2024-05-06T21:26:29.775 INFO:tasks.workunit.client.0.smithi032.stdout:1/136: creat db/d16/f2c x:0 0 0 2024-05-06T21:26:29.776 INFO:tasks.workunit.client.0.smithi032.stdout:1/137: rename db/f24 to db/d2a/f2d 0 2024-05-06T21:26:29.777 INFO:tasks.workunit.client.0.smithi032.stdout:1/138: creat db/f2e x:0 0 0 2024-05-06T21:26:29.778 INFO:tasks.workunit.client.0.smithi032.stdout:4/102: dwrite d2/d1e/f21 [0,4194304] 0 2024-05-06T21:26:29.779 INFO:tasks.workunit.client.0.smithi032.stdout:4/103: dread d2/f11 [0,4194304] 0 2024-05-06T21:26:29.783 INFO:tasks.workunit.client.0.smithi032.stdout:1/139: write db/f1f [1998400,119586] 0 2024-05-06T21:26:29.784 INFO:tasks.workunit.client.0.smithi032.stdout:1/140: creat db/d2a/f2f x:0 0 0 2024-05-06T21:26:29.785 INFO:tasks.workunit.client.0.smithi032.stdout:4/104: getdents d2/d16 0 2024-05-06T21:26:29.786 INFO:tasks.workunit.client.0.smithi032.stdout:4/105: creat d2/d1e/f22 x:0 0 0 2024-05-06T21:26:29.788 INFO:tasks.workunit.client.0.smithi032.stdout:4/106: truncate d2/fb 1824837 0 2024-05-06T21:26:29.799 INFO:tasks.workunit.client.0.smithi032.stdout:1/141: dwrite db/f2e [0,4194304] 0 2024-05-06T21:26:29.799 INFO:tasks.workunit.client.0.smithi032.stdout:1/142: fsync db/f10 0 2024-05-06T21:26:29.799 INFO:tasks.workunit.client.0.smithi032.stdout:1/143: chown db/c22 11639 1 2024-05-06T21:26:29.813 INFO:tasks.workunit.client.0.smithi032.stdout:4/107: dwrite d2/f10 [0,4194304] 0 2024-05-06T21:26:29.819 INFO:tasks.workunit.client.0.smithi032.stdout:4/108: write d2/fc [817282,44500] 0 2024-05-06T21:26:29.820 INFO:tasks.workunit.client.0.smithi032.stdout:4/109: creat d2/f23 x:0 0 0 2024-05-06T21:26:29.820 INFO:tasks.workunit.client.0.smithi032.stdout:1/144: dwrite db/f23 [0,4194304] 0 2024-05-06T21:26:29.821 INFO:tasks.workunit.client.0.smithi032.stdout:4/110: creat d2/f24 x:0 0 0 2024-05-06T21:26:29.821 INFO:tasks.workunit.client.0.smithi032.stdout:4/111: fdatasync d2/f7 0 2024-05-06T21:26:29.824 INFO:tasks.workunit.client.0.smithi032.stdout:4/112: link d2/fa d2/d1e/f25 0 2024-05-06T21:26:29.824 INFO:tasks.workunit.client.0.smithi032.stdout:1/145: getdents db/d16 0 2024-05-06T21:26:29.826 INFO:tasks.workunit.client.0.smithi032.stdout:4/113: rename d2/l5 to d2/d1e/l26 0 2024-05-06T21:26:29.827 INFO:tasks.workunit.client.0.smithi032.stdout:4/114: write d2/f11 [1096361,19676] 0 2024-05-06T21:26:29.827 INFO:tasks.workunit.client.0.smithi032.stdout:4/115: fdatasync f1 0 2024-05-06T21:26:29.828 INFO:tasks.workunit.client.0.smithi032.stdout:4/116: truncate d2/d13/f1b 145483 0 2024-05-06T21:26:29.828 INFO:tasks.workunit.client.0.smithi032.stdout:4/117: fdatasync d2/f9 0 2024-05-06T21:26:29.828 INFO:tasks.workunit.client.0.smithi032.stdout:4/118: truncate d2/f11 2094064 0 2024-05-06T21:26:29.844 INFO:tasks.workunit.client.0.smithi032.stdout:4/119: dwrite f1 [8388608,4194304] 0 2024-05-06T21:26:29.844 INFO:tasks.workunit.client.0.smithi032.stdout:4/120: chown f1 0 1 2024-05-06T21:26:29.846 INFO:tasks.workunit.client.0.smithi032.stdout:4/121: link d2/f24 d2/d16/f27 0 2024-05-06T21:26:29.846 INFO:tasks.workunit.client.0.smithi032.stdout:4/122: creat d2/d1e/f28 x:0 0 0 2024-05-06T21:26:29.848 INFO:tasks.workunit.client.0.smithi032.stdout:4/123: mknod d2/c29 0 2024-05-06T21:26:29.849 INFO:tasks.workunit.client.0.smithi032.stdout:4/124: symlink d2/l2a 0 2024-05-06T21:26:29.851 INFO:tasks.workunit.client.0.smithi032.stdout:4/125: unlink d2/ld 0 2024-05-06T21:26:29.851 INFO:tasks.workunit.client.0.smithi032.stdout:4/126: getdents d2/d13 0 2024-05-06T21:26:29.851 INFO:tasks.workunit.client.0.smithi032.stdout:4/127: mknod d2/d13/c2b 0 2024-05-06T21:26:29.851 INFO:tasks.workunit.client.0.smithi032.stdout:4/128: truncate d2/fc 4657270 0 2024-05-06T21:26:29.852 INFO:tasks.workunit.client.0.smithi032.stdout:4/129: unlink d2/f23 0 2024-05-06T21:26:29.852 INFO:tasks.workunit.client.0.smithi032.stdout:4/130: dread - d2/d1e/f28 zero size 2024-05-06T21:26:29.853 INFO:tasks.workunit.client.0.smithi032.stdout:4/131: mkdir d2/d2c 0 2024-05-06T21:26:29.854 INFO:tasks.workunit.client.0.smithi032.stdout:4/132: link d2/d16/l1f d2/d2c/l2d 0 2024-05-06T21:26:29.854 INFO:tasks.workunit.client.0.smithi032.stdout:4/133: chown d2/f24 172 1 2024-05-06T21:26:29.855 INFO:tasks.workunit.client.0.smithi032.stdout:4/134: creat d2/d16/f2e x:0 0 0 2024-05-06T21:26:29.867 INFO:tasks.workunit.client.0.smithi032.stdout:4/135: dwrite d2/d16/f2e [0,4194304] 0 2024-05-06T21:26:29.884 INFO:tasks.workunit.client.0.smithi032.stdout:4/136: dwrite d2/d16/f27 [0,4194304] 0 2024-05-06T21:26:29.886 INFO:tasks.workunit.client.0.smithi032.stdout:4/137: mknod d2/d16/c2f 0 2024-05-06T21:26:29.907 INFO:tasks.workunit.client.0.smithi032.stdout:4/138: dwrite d2/d16/f27 [0,4194304] 0 2024-05-06T21:26:29.918 INFO:tasks.workunit.client.0.smithi032.stdout:4/139: dread d2/f10 [4194304,4194304] 0 2024-05-06T21:26:29.919 INFO:tasks.workunit.client.0.smithi032.stdout:2/2: sync 2024-05-06T21:26:29.920 INFO:tasks.workunit.client.0.smithi032.stdout:4/140: mkdir d2/d2c/d30 0 2024-05-06T21:26:29.920 INFO:tasks.workunit.client.0.smithi032.stdout:4/141: truncate d2/f9 441963 0 2024-05-06T21:26:29.929 INFO:tasks.workunit.client.0.smithi032.stdout:4/142: read d2/f7 [2315741,42843] 0 2024-05-06T21:26:29.931 INFO:tasks.workunit.client.0.smithi032.stdout:4/143: mkdir d2/d2c/d31 0 2024-05-06T21:26:29.931 INFO:tasks.workunit.client.0.smithi032.stdout:4/144: write d2/d1e/f25 [2499841,89112] 0 2024-05-06T21:26:29.931 INFO:tasks.workunit.client.0.smithi032.stdout:4/145: chown d2/f24 462287 1 2024-05-06T21:26:29.933 INFO:tasks.workunit.client.0.smithi032.stdout:4/146: link d2/fb d2/d2c/d30/f32 0 2024-05-06T21:26:29.934 INFO:tasks.workunit.client.0.smithi032.stdout:4/147: symlink d2/d2c/l33 0 2024-05-06T21:26:29.935 INFO:tasks.workunit.client.0.smithi032.stdout:4/148: symlink d2/d13/l34 0 2024-05-06T21:26:29.935 INFO:tasks.workunit.client.0.smithi032.stdout:4/149: write d2/f7 [3791666,118553] 0 2024-05-06T21:26:29.938 INFO:tasks.workunit.client.0.smithi032.stdout:4/150: dread d2/d2c/d30/f32 [0,4194304] 0 2024-05-06T21:26:29.955 INFO:tasks.workunit.client.0.smithi032.stdout:4/151: dwrite d2/f18 [0,4194304] 0 2024-05-06T21:26:29.958 INFO:tasks.workunit.client.0.smithi032.stdout:4/152: dread d2/d2c/d30/f32 [0,4194304] 0 2024-05-06T21:26:29.959 INFO:tasks.workunit.client.0.smithi032.stdout:4/153: dread d2/d13/f1b [0,4194304] 0 2024-05-06T21:26:29.961 INFO:tasks.workunit.client.0.smithi032.stdout:4/154: rename d2/d16/f27 to d2/f35 0 2024-05-06T21:26:29.961 INFO:tasks.workunit.client.0.smithi032.stdout:4/155: creat d2/d16/f36 x:0 0 0 2024-05-06T21:26:29.987 INFO:tasks.workunit.client.0.smithi032.stdout:4/156: symlink d2/d2c/d31/l37 0 2024-05-06T21:26:29.987 INFO:tasks.workunit.client.0.smithi032.stdout:4/157: read d2/d2c/d30/f32 [1506530,73568] 0 2024-05-06T21:26:29.988 INFO:tasks.workunit.client.0.smithi032.stdout:4/158: symlink d2/d13/l38 0 2024-05-06T21:26:29.988 INFO:tasks.workunit.client.0.smithi032.stdout:4/159: chown d2/l1d 22769034 1 2024-05-06T21:26:29.989 INFO:tasks.workunit.client.0.smithi032.stdout:4/160: symlink d2/d2c/d31/l39 0 2024-05-06T21:26:29.989 INFO:tasks.workunit.client.0.smithi032.stdout:4/161: chown d2/l1a 4977830 1 2024-05-06T21:26:29.991 INFO:tasks.workunit.client.0.smithi032.stdout:4/162: unlink d2/l17 0 2024-05-06T21:26:30.002 INFO:tasks.workunit.client.0.smithi032.stdout:4/163: dread d2/f10 [0,4194304] 0 2024-05-06T21:26:30.002 INFO:tasks.workunit.client.0.smithi032.stdout:4/164: truncate d2/d1e/f22 872139 0 2024-05-06T21:26:30.002 INFO:tasks.workunit.client.0.smithi032.stdout:4/165: stat d2/fb 0 2024-05-06T21:26:30.003 INFO:tasks.workunit.client.0.smithi032.stdout:4/166: rename d2/d16/l1f to d2/d2c/d30/l3a 0 2024-05-06T21:26:30.004 INFO:tasks.workunit.client.0.smithi032.stdout:4/167: write d2/d1e/f21 [1558991,5219] 0 2024-05-06T21:26:30.004 INFO:tasks.workunit.client.0.smithi032.stdout:4/168: chown d2/l1d 61 1 2024-05-06T21:26:30.008 INFO:tasks.workunit.client.0.smithi032.stdout:4/169: getdents d2/d13 0 2024-05-06T21:26:30.009 INFO:tasks.workunit.client.0.smithi032.stdout:4/170: mknod d2/d1e/c3b 0 2024-05-06T21:26:30.011 INFO:tasks.workunit.client.0.smithi032.stdout:4/171: link d2/d13/l38 d2/d2c/d31/l3c 0 2024-05-06T21:26:30.011 INFO:tasks.workunit.client.0.smithi032.stdout:4/172: chown d2/l1d 23255 1 2024-05-06T21:26:30.011 INFO:tasks.workunit.client.0.smithi032.stdout:0/94: sync 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:5/14: sync 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:7/103: sync 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:3/35: sync 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:5/15: fsync d0/f3 0 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:8/60: sync 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:8/61: chown d0/f8 1299 1 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:8/62: dread - d0/f8 zero size 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:7/104: write db/d13/f1d [134444,78130] 0 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:8/63: readlink - no filename 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:8/64: dread - d0/fa zero size 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:8/65: readlink - no filename 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:6/95: sync 2024-05-06T21:26:30.012 INFO:tasks.workunit.client.0.smithi032.stdout:9/48: sync 2024-05-06T21:26:30.013 INFO:tasks.workunit.client.0.smithi032.stdout:3/36: mknod d1/d4/cd 0 2024-05-06T21:26:30.015 INFO:tasks.workunit.client.0.smithi032.stdout:7/105: unlink c9 0 2024-05-06T21:26:30.016 INFO:tasks.workunit.client.0.smithi032.stdout:7/106: write db/d13/f1d [3246,59395] 0 2024-05-06T21:26:30.016 INFO:tasks.workunit.client.0.smithi032.stdout:7/107: chown c2 85411 1 2024-05-06T21:26:30.016 INFO:tasks.workunit.client.0.smithi032.stdout:8/66: creat d0/fc x:0 0 0 2024-05-06T21:26:30.020 INFO:tasks.workunit.client.0.smithi032.stdout:9/49: getdents d1 0 2024-05-06T21:26:30.021 INFO:tasks.workunit.client.0.smithi032.stdout:8/67: mknod d0/cd 0 2024-05-06T21:26:30.023 INFO:tasks.workunit.client.0.smithi032.stdout:9/50: rmdir d1 39 2024-05-06T21:26:30.024 INFO:tasks.workunit.client.0.smithi032.stdout:7/108: write f8 [5168117,12971] 0 2024-05-06T21:26:30.025 INFO:tasks.workunit.client.0.smithi032.stdout:9/51: link d1/f4 d1/f10 0 2024-05-06T21:26:30.025 INFO:tasks.workunit.client.0.smithi032.stdout:9/52: write d1/f9 [1088811,112869] 0 2024-05-06T21:26:30.025 INFO:tasks.workunit.client.0.smithi032.stdout:9/53: read d1/f2 [3190247,31220] 0 2024-05-06T21:26:30.025 INFO:tasks.workunit.client.0.smithi032.stdout:9/54: fdatasync d1/f4 0 2024-05-06T21:26:30.026 INFO:tasks.workunit.client.0.smithi032.stdout:9/55: dread d1/f8 [0,4194304] 0 2024-05-06T21:26:30.027 INFO:tasks.workunit.client.0.smithi032.stdout:9/56: mkdir d1/d11 0 2024-05-06T21:26:30.028 INFO:tasks.workunit.client.0.smithi032.stdout:6/96: dread d8/da/fc [0,4194304] 0 2024-05-06T21:26:30.028 INFO:tasks.workunit.client.0.smithi032.stdout:6/97: write d8/fb [384380,63288] 0 2024-05-06T21:26:30.030 INFO:tasks.workunit.client.0.smithi032.stdout:6/98: getdents d8/da 0 2024-05-06T21:26:30.032 INFO:tasks.workunit.client.0.smithi032.stdout:3/37: write f0 [4795348,57981] 0 2024-05-06T21:26:30.047 INFO:tasks.workunit.client.0.smithi032.stdout:5/16: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:30.050 INFO:tasks.workunit.client.0.smithi032.stdout:7/109: dwrite db/d12/f18 [0,4194304] 0 2024-05-06T21:26:30.051 INFO:tasks.workunit.client.0.smithi032.stdout:7/110: chown db/f10 11 1 2024-05-06T21:26:30.051 INFO:tasks.workunit.client.0.smithi032.stdout:7/111: chown db/f10 0 1 2024-05-06T21:26:30.062 INFO:tasks.workunit.client.0.smithi032.stdout:6/99: dwrite d8/da/fc [4194304,4194304] 0 2024-05-06T21:26:30.062 INFO:tasks.workunit.client.0.smithi032.stdout:3/38: dwrite d1/fb [0,4194304] 0 2024-05-06T21:26:30.062 INFO:tasks.workunit.client.0.smithi032.stdout:3/39: fdatasync d1/fb 0 2024-05-06T21:26:30.062 INFO:tasks.workunit.client.0.smithi032.stdout:7/112: dread f3 [0,4194304] 0 2024-05-06T21:26:30.064 INFO:tasks.workunit.client.0.smithi032.stdout:3/40: creat d1/d4/fe x:0 0 0 2024-05-06T21:26:30.064 INFO:tasks.workunit.client.0.smithi032.stdout:3/41: truncate d1/d4/f7 4371894 0 2024-05-06T21:26:30.065 INFO:tasks.workunit.client.0.smithi032.stdout:3/42: symlink d1/d4/lf 0 2024-05-06T21:26:30.065 INFO:tasks.workunit.client.0.smithi032.stdout:3/43: dread - d1/d4/fe zero size 2024-05-06T21:26:30.066 INFO:tasks.workunit.client.0.smithi032.stdout:3/44: mknod d1/d4/c10 0 2024-05-06T21:26:30.068 INFO:tasks.workunit.client.0.smithi032.stdout:3/45: rmdir d1/d4/da 39 2024-05-06T21:26:30.071 INFO:tasks.workunit.client.0.smithi032.stdout:7/113: truncate db/d13/f1d 109363 0 2024-05-06T21:26:30.071 INFO:tasks.workunit.client.0.smithi032.stdout:7/114: dread - db/d12/f19 zero size 2024-05-06T21:26:30.071 INFO:tasks.workunit.client.0.smithi032.stdout:7/115: creat db/f20 x:0 0 0 2024-05-06T21:26:30.073 INFO:tasks.workunit.client.0.smithi032.stdout:7/116: mkdir db/d12/d16/d21 0 2024-05-06T21:26:30.073 INFO:tasks.workunit.client.0.smithi032.stdout:7/117: readlink l4 0 2024-05-06T21:26:30.074 INFO:tasks.workunit.client.0.smithi032.stdout:7/118: mknod db/d12/d16/c22 0 2024-05-06T21:26:30.076 INFO:tasks.workunit.client.0.smithi032.stdout:7/119: truncate f8 5276180 0 2024-05-06T21:26:30.076 INFO:tasks.workunit.client.0.smithi032.stdout:6/100: dwrite d8/dd/f12 [0,4194304] 0 2024-05-06T21:26:30.077 INFO:tasks.workunit.client.0.smithi032.stdout:7/120: symlink db/d12/d16/d21/l23 0 2024-05-06T21:26:30.077 INFO:tasks.workunit.client.0.smithi032.stdout:3/46: dread d1/f5 [0,4194304] 0 2024-05-06T21:26:30.079 INFO:tasks.workunit.client.0.smithi032.stdout:3/47: unlink d1/f5 0 2024-05-06T21:26:30.081 INFO:tasks.workunit.client.0.smithi032.stdout:3/48: mkdir d1/d4/d11 0 2024-05-06T21:26:30.083 INFO:tasks.workunit.client.0.smithi032.stdout:3/49: symlink d1/d4/d11/l12 0 2024-05-06T21:26:30.083 INFO:tasks.workunit.client.0.smithi032.stdout:3/50: chown d1/d4/fe 55521383 1 2024-05-06T21:26:30.093 INFO:tasks.workunit.client.0.smithi032.stdout:6/101: dwrite d8/da/fc [4194304,4194304] 0 2024-05-06T21:26:30.095 INFO:tasks.workunit.client.0.smithi032.stdout:6/102: mkdir d8/da/d13 0 2024-05-06T21:26:30.103 INFO:tasks.workunit.client.0.smithi032.stdout:6/103: write f4 [2867048,92477] 0 2024-05-06T21:26:30.104 INFO:tasks.workunit.client.0.smithi032.stdout:6/104: creat d8/da/f14 x:0 0 0 2024-05-06T21:26:30.104 INFO:tasks.workunit.client.0.smithi032.stdout:6/105: dread - d8/da/f11 zero size 2024-05-06T21:26:30.105 INFO:tasks.workunit.client.0.smithi032.stdout:6/106: mknod d8/c15 0 2024-05-06T21:26:30.105 INFO:tasks.workunit.client.0.smithi032.stdout:6/107: chown d8/dd 22 1 2024-05-06T21:26:30.107 INFO:tasks.workunit.client.0.smithi032.stdout:3/51: dwrite d1/d4/da/fc [0,4194304] 0 2024-05-06T21:26:30.107 INFO:tasks.workunit.client.0.smithi032.stdout:3/52: chown d1/d4/f7 17238401 1 2024-05-06T21:26:30.107 INFO:tasks.workunit.client.0.smithi032.stdout:7/121: dwrite f8 [4194304,4194304] 0 2024-05-06T21:26:30.107 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:29 smithi154 ceph-mon[32880]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:26:30.107 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:29 smithi154 ceph-mon[32880]: pgmap v15: 65 pgs: 65 active+clean; 159 MiB data, 752 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s wr, 669 op/s 2024-05-06T21:26:30.107 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:29 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2786377634' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:26:30.108 INFO:tasks.workunit.client.0.smithi032.stdout:3/53: mknod d1/c13 0 2024-05-06T21:26:30.113 INFO:tasks.workunit.client.0.smithi032.stdout:7/122: creat db/d12/d16/f24 x:0 0 0 2024-05-06T21:26:30.113 INFO:tasks.workunit.client.0.smithi032.stdout:7/123: write db/d12/f1c [190198,123984] 0 2024-05-06T21:26:30.113 INFO:tasks.workunit.client.0.smithi032.stdout:7/124: fsync db/f10 0 2024-05-06T21:26:30.113 INFO:tasks.workunit.client.0.smithi032.stdout:6/108: read d8/da/fc [7835679,54857] 0 2024-05-06T21:26:30.114 INFO:tasks.workunit.client.0.smithi032.stdout:6/109: creat d8/da/d13/f16 x:0 0 0 2024-05-06T21:26:30.114 INFO:tasks.workunit.client.0.smithi032.stdout:6/110: fdatasync d8/fb 0 2024-05-06T21:26:30.117 INFO:tasks.workunit.client.0.smithi032.stdout:7/125: getdents db/d12/d16 0 2024-05-06T21:26:30.119 INFO:tasks.workunit.client.0.smithi032.stdout:3/54: dread d1/d4/da/fc [0,4194304] 0 2024-05-06T21:26:30.119 INFO:tasks.workunit.client.0.smithi032.stdout:7/126: rename db/c11 to db/c25 0 2024-05-06T21:26:30.120 INFO:tasks.workunit.client.0.smithi032.stdout:3/55: link d1/f6 d1/f14 0 2024-05-06T21:26:30.121 INFO:tasks.workunit.client.0.smithi032.stdout:7/127: unlink db/d13/f1d 0 2024-05-06T21:26:30.123 INFO:tasks.workunit.client.0.smithi032.stdout:3/56: link d1/d4/cd d1/d4/da/c15 0 2024-05-06T21:26:30.123 INFO:tasks.workunit.client.0.smithi032.stdout:3/57: write d1/d4/fe [598447,43695] 0 2024-05-06T21:26:30.124 INFO:tasks.workunit.client.0.smithi032.stdout:3/58: dread d1/d4/da/fc [4194304,4194304] 0 2024-05-06T21:26:30.124 INFO:tasks.workunit.client.0.smithi032.stdout:6/111: dread d8/fb [0,4194304] 0 2024-05-06T21:26:30.124 INFO:tasks.workunit.client.0.smithi032.stdout:7/128: link db/d12/d16/d21/l23 db/d13/l26 0 2024-05-06T21:26:30.125 INFO:tasks.workunit.client.0.smithi032.stdout:3/59: rename d1/l8 to d1/d4/da/l16 0 2024-05-06T21:26:30.126 INFO:tasks.workunit.client.0.smithi032.stdout:3/60: mknod d1/c17 0 2024-05-06T21:26:30.127 INFO:tasks.workunit.client.0.smithi032.stdout:3/61: link d1/d4/da/c15 d1/d4/da/c18 0 2024-05-06T21:26:30.128 INFO:tasks.workunit.client.0.smithi032.stdout:3/62: symlink d1/l19 0 2024-05-06T21:26:30.129 INFO:tasks.workunit.client.0.smithi032.stdout:3/63: symlink d1/d4/d11/l1a 0 2024-05-06T21:26:30.129 INFO:tasks.workunit.client.0.smithi032.stdout:3/64: chown d1/l19 4232 1 2024-05-06T21:26:30.130 INFO:tasks.workunit.client.0.smithi032.stdout:6/112: dread d8/dd/f12 [0,4194304] 0 2024-05-06T21:26:30.132 INFO:tasks.workunit.client.0.smithi032.stdout:3/65: rename d1/d4/d11/l12 to d1/d4/l1b 0 2024-05-06T21:26:30.133 INFO:tasks.workunit.client.0.smithi032.stdout:6/113: truncate d8/dd/f12 1880001 0 2024-05-06T21:26:30.141 INFO:tasks.workunit.client.0.smithi032.stdout:1/146: sync 2024-05-06T21:26:30.141 INFO:tasks.workunit.client.0.smithi032.stdout:1/147: read db/d16/f1e [6130169,56604] 0 2024-05-06T21:26:30.142 INFO:tasks.workunit.client.0.smithi032.stdout:7/129: dwrite db/d12/d16/f24 [0,4194304] 0 2024-05-06T21:26:30.144 INFO:tasks.workunit.client.0.smithi032.stdout:1/148: creat db/f30 x:0 0 0 2024-05-06T21:26:30.158 INFO:tasks.workunit.client.0.smithi032.stdout:7/130: dread db/d12/d16/f24 [0,4194304] 0 2024-05-06T21:26:30.158 INFO:tasks.workunit.client.0.smithi032.stdout:7/131: stat db/d12/f1c 0 2024-05-06T21:26:30.160 INFO:tasks.workunit.client.0.smithi032.stdout:7/132: rename db/f1b to db/d12/d16/d21/f27 0 2024-05-06T21:26:30.160 INFO:tasks.workunit.client.0.smithi032.stdout:7/133: symlink db/d12/d16/d21/l28 0 2024-05-06T21:26:30.160 INFO:tasks.workunit.client.0.smithi032.stdout:7/134: chown db/d12/f1c 1473785873 1 2024-05-06T21:26:30.161 INFO:tasks.workunit.client.0.smithi032.stdout:7/135: truncate db/f10 3788309 0 2024-05-06T21:26:30.162 INFO:tasks.workunit.client.0.smithi032.stdout:7/136: rename db/d12/f18 to db/f29 0 2024-05-06T21:26:30.163 INFO:tasks.workunit.client.0.smithi032.stdout:7/137: mkdir db/d12/d16/d2a 0 2024-05-06T21:26:30.164 INFO:tasks.workunit.client.0.smithi032.stdout:7/138: mknod db/d13/c2b 0 2024-05-06T21:26:30.164 INFO:tasks.workunit.client.0.smithi032.stdout:7/139: write db/d12/f1c [914971,52167] 0 2024-05-06T21:26:30.164 INFO:tasks.workunit.client.0.smithi032.stdout:7/140: chown db/f20 216333 1 2024-05-06T21:26:30.216 INFO:tasks.workunit.client.0.smithi032.stdout:3/66: dwrite d1/d4/da/fc [0,4194304] 0 2024-05-06T21:26:30.218 INFO:tasks.workunit.client.0.smithi032.stdout:1/149: dwrite db/f12 [0,4194304] 0 2024-05-06T21:26:30.221 INFO:tasks.workunit.client.0.smithi032.stdout:3/67: dread f0 [4194304,4194304] 0 2024-05-06T21:26:30.221 INFO:tasks.workunit.client.0.smithi032.stdout:3/68: truncate d1/f14 1135038 0 2024-05-06T21:26:30.223 INFO:tasks.workunit.client.0.smithi032.stdout:7/141: dwrite db/f1f [0,4194304] 0 2024-05-06T21:26:30.223 INFO:tasks.workunit.client.0.smithi032.stdout:7/142: readlink db/ld 0 2024-05-06T21:26:30.223 INFO:tasks.workunit.client.0.smithi032.stdout:7/143: dread - db/d12/f19 zero size 2024-05-06T21:26:30.223 INFO:tasks.workunit.client.0.smithi032.stdout:7/144: fdatasync f8 0 2024-05-06T21:26:30.224 INFO:tasks.workunit.client.0.smithi032.stdout:3/69: creat d1/d4/da/f1c x:0 0 0 2024-05-06T21:26:30.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:29 smithi032 ceph-mon[27179]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:26:30.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:29 smithi032 ceph-mon[27179]: pgmap v15: 65 pgs: 65 active+clean; 159 MiB data, 752 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s wr, 669 op/s 2024-05-06T21:26:30.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:29 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2786377634' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:26:30.227 INFO:tasks.workunit.client.0.smithi032.stdout:1/150: dread db/f12 [0,4194304] 0 2024-05-06T21:26:30.228 INFO:tasks.workunit.client.0.smithi032.stdout:3/70: mkdir d1/d4/da/d1d 0 2024-05-06T21:26:30.248 INFO:tasks.workunit.client.0.smithi032.stdout:2/3: sync 2024-05-06T21:26:30.273 INFO:tasks.workunit.client.0.smithi032.stdout:1/151: dwrite db/d2a/f2d [0,4194304] 0 2024-05-06T21:26:30.273 INFO:tasks.workunit.client.0.smithi032.stdout:2/4: dwrite f0 [0,4194304] 0 2024-05-06T21:26:30.273 INFO:tasks.workunit.client.0.smithi032.stdout:2/5: stat f0 0 2024-05-06T21:26:30.273 INFO:tasks.workunit.client.0.smithi032.stdout:7/145: dwrite db/d12/d16/d21/f27 [0,4194304] 0 2024-05-06T21:26:30.273 INFO:tasks.workunit.client.0.smithi032.stdout:7/146: fsync f3 0 2024-05-06T21:26:30.273 INFO:tasks.workunit.client.0.smithi032.stdout:7/147: chown db/lc 6 1 2024-05-06T21:26:30.273 INFO:tasks.workunit.client.0.smithi032.stdout:3/71: dwrite d1/f14 [0,4194304] 0 2024-05-06T21:26:30.273 INFO:tasks.workunit.client.0.smithi032.stdout:3/72: write f0 [4061051,93654] 0 2024-05-06T21:26:30.278 INFO:tasks.workunit.client.0.smithi032.stdout:7/148: write db/d12/d16/f24 [3775076,60297] 0 2024-05-06T21:26:30.279 INFO:tasks.workunit.client.0.smithi032.stdout:1/152: mknod db/c31 0 2024-05-06T21:26:30.281 INFO:tasks.workunit.client.0.smithi032.stdout:1/153: creat db/d16/f32 x:0 0 0 2024-05-06T21:26:30.281 INFO:tasks.workunit.client.0.smithi032.stdout:1/154: truncate db/d2a/f2f 732265 0 2024-05-06T21:26:30.303 INFO:tasks.workunit.client.0.smithi032.stdout:2/6: dwrite f0 [4194304,4194304] 0 2024-05-06T21:26:30.312 INFO:tasks.workunit.client.0.smithi032.stdout:7/149: dwrite db/f1f [0,4194304] 0 2024-05-06T21:26:30.314 INFO:tasks.workunit.client.0.smithi032.stdout:7/150: creat db/d13/f2c x:0 0 0 2024-05-06T21:26:30.315 INFO:tasks.workunit.client.0.smithi032.stdout:7/151: creat db/d12/d16/d2a/f2d x:0 0 0 2024-05-06T21:26:30.315 INFO:tasks.workunit.client.0.smithi032.stdout:2/7: read f0 [1320922,44833] 0 2024-05-06T21:26:30.315 INFO:tasks.workunit.client.0.smithi032.stdout:3/73: dwrite d1/f14 [4194304,4194304] 0 2024-05-06T21:26:30.315 INFO:tasks.workunit.client.0.smithi032.stdout:3/74: write d1/d4/da/f1c [153012,14697] 0 2024-05-06T21:26:30.316 INFO:tasks.workunit.client.0.smithi032.stdout:1/155: dwrite db/f23 [0,4194304] 0 2024-05-06T21:26:30.316 INFO:tasks.workunit.client.0.smithi032.stdout:1/156: readlink db/l21 0 2024-05-06T21:26:30.316 INFO:tasks.workunit.client.0.smithi032.stdout:7/152: truncate db/d12/f17 1053012 0 2024-05-06T21:26:30.316 INFO:tasks.workunit.client.0.smithi032.stdout:7/153: dread - db/d13/f2c zero size 2024-05-06T21:26:30.316 INFO:tasks.workunit.client.0.smithi032.stdout:7/154: creat db/d12/f2e x:0 0 0 2024-05-06T21:26:30.317 INFO:tasks.workunit.client.0.smithi032.stdout:7/155: fsync db/f29 0 2024-05-06T21:26:30.319 INFO:tasks.workunit.client.0.smithi032.stdout:7/156: mknod db/d13/c2f 0 2024-05-06T21:26:30.319 INFO:tasks.workunit.client.0.smithi032.stdout:7/157: write db/d12/f19 [283878,66794] 0 2024-05-06T21:26:30.321 INFO:tasks.workunit.client.0.smithi032.stdout:1/157: rmdir db/d16 39 2024-05-06T21:26:30.322 INFO:tasks.workunit.client.0.smithi032.stdout:3/75: dread d1/f6 [4194304,4194304] 0 2024-05-06T21:26:30.323 INFO:tasks.workunit.client.0.smithi032.stdout:1/158: creat db/d16/f33 x:0 0 0 2024-05-06T21:26:30.323 INFO:tasks.workunit.client.0.smithi032.stdout:1/159: chown f9 0 1 2024-05-06T21:26:30.327 INFO:tasks.workunit.client.0.smithi032.stdout:1/160: mknod db/d16/c34 0 2024-05-06T21:26:30.327 INFO:tasks.workunit.client.0.smithi032.stdout:1/161: chown l7 6666093 1 2024-05-06T21:26:30.330 INFO:tasks.workunit.client.0.smithi032.stdout:1/162: symlink db/l35 0 2024-05-06T21:26:30.331 INFO:tasks.workunit.client.0.smithi032.stdout:2/8: write f0 [5824998,85049] 0 2024-05-06T21:26:30.332 INFO:tasks.workunit.client.0.smithi032.stdout:1/163: rename db/l21 to db/d16/l36 0 2024-05-06T21:26:30.334 INFO:tasks.workunit.client.0.smithi032.stdout:1/164: mkdir db/d37 0 2024-05-06T21:26:30.334 INFO:tasks.workunit.client.0.smithi032.stdout:1/165: dread - db/f20 zero size 2024-05-06T21:26:30.335 INFO:tasks.workunit.client.0.smithi032.stdout:1/166: write db/f2e [4860193,19504] 0 2024-05-06T21:26:30.341 INFO:tasks.workunit.client.0.smithi032.stdout:3/76: dwrite d1/f6 [4194304,4194304] 0 2024-05-06T21:26:30.341 INFO:tasks.workunit.client.0.smithi032.stdout:3/77: readlink d1/d4/lf 0 2024-05-06T21:26:30.342 INFO:tasks.workunit.client.0.smithi032.stdout:7/158: dwrite db/d12/f1c [0,4194304] 0 2024-05-06T21:26:30.342 INFO:tasks.workunit.client.0.smithi032.stdout:7/159: creat db/d12/f30 x:0 0 0 2024-05-06T21:26:30.354 INFO:tasks.workunit.client.0.smithi032.stdout:7/160: rmdir db/d12/d16/d21 39 2024-05-06T21:26:30.357 INFO:tasks.workunit.client.0.smithi032.stdout:3/78: dread d1/d4/da/fc [0,4194304] 0 2024-05-06T21:26:30.357 INFO:tasks.workunit.client.0.smithi032.stdout:7/161: creat db/d12/d16/d21/f31 x:0 0 0 2024-05-06T21:26:30.357 INFO:tasks.workunit.client.0.smithi032.stdout:7/162: readlink db/d13/l26 0 2024-05-06T21:26:30.357 INFO:tasks.workunit.client.0.smithi032.stdout:1/167: dwrite db/f10 [0,4194304] 0 2024-05-06T21:26:30.358 INFO:tasks.workunit.client.0.smithi032.stdout:7/163: symlink db/l32 0 2024-05-06T21:26:30.358 INFO:tasks.workunit.client.0.smithi032.stdout:7/164: creat db/d12/d16/d2a/f33 x:0 0 0 2024-05-06T21:26:30.358 INFO:tasks.workunit.client.0.smithi032.stdout:7/165: write db/d12/d16/d2a/f33 [549521,111321] 0 2024-05-06T21:26:30.361 INFO:tasks.workunit.client.0.smithi032.stdout:7/166: mknod db/d13/c34 0 2024-05-06T21:26:30.363 INFO:tasks.workunit.client.0.smithi032.stdout:7/167: write db/d12/f19 [217189,82486] 0 2024-05-06T21:26:30.364 INFO:tasks.workunit.client.0.smithi032.stdout:7/168: creat db/d12/d16/d21/f35 x:0 0 0 2024-05-06T21:26:30.364 INFO:tasks.workunit.client.0.smithi032.stdout:7/169: chown db/d13/c15 20648 1 2024-05-06T21:26:30.364 INFO:tasks.workunit.client.0.smithi032.stdout:7/170: stat db/d12/d16/d21/f31 0 2024-05-06T21:26:30.364 INFO:tasks.workunit.client.0.smithi032.stdout:7/171: fsync db/f10 0 2024-05-06T21:26:30.366 INFO:tasks.workunit.client.0.smithi032.stdout:7/172: stat db/d13/l26 0 2024-05-06T21:26:30.368 INFO:tasks.workunit.client.0.smithi032.stdout:7/173: link db/f29 db/d13/f36 0 2024-05-06T21:26:30.368 INFO:tasks.workunit.client.0.smithi032.stdout:7/174: readlink db/l32 0 2024-05-06T21:26:30.369 INFO:tasks.workunit.client.0.smithi032.stdout:7/175: mknod db/d13/c37 0 2024-05-06T21:26:30.369 INFO:tasks.workunit.client.0.smithi032.stdout:7/176: creat db/d13/f38 x:0 0 0 2024-05-06T21:26:30.369 INFO:tasks.workunit.client.0.smithi032.stdout:7/177: truncate db/d12/d16/d21/f35 484571 0 2024-05-06T21:26:30.370 INFO:tasks.workunit.client.0.smithi032.stdout:2/9: dwrite f0 [0,4194304] 0 2024-05-06T21:26:30.370 INFO:tasks.workunit.client.0.smithi032.stdout:7/178: mkdir db/d12/d16/d2a/d39 0 2024-05-06T21:26:30.375 INFO:tasks.workunit.client.0.smithi032.stdout:1/168: dwrite db/f2e [4194304,4194304] 0 2024-05-06T21:26:30.375 INFO:tasks.workunit.client.0.smithi032.stdout:1/169: write db/f13 [1978512,67764] 0 2024-05-06T21:26:30.377 INFO:tasks.workunit.client.0.smithi032.stdout:1/170: unlink f8 0 2024-05-06T21:26:30.381 INFO:tasks.workunit.client.0.smithi032.stdout:2/10: truncate f0 1710098 0 2024-05-06T21:26:30.381 INFO:tasks.workunit.client.0.smithi032.stdout:4/173: sync 2024-05-06T21:26:30.382 INFO:tasks.workunit.client.0.smithi032.stdout:2/11: symlink l1 0 2024-05-06T21:26:30.383 INFO:tasks.workunit.client.0.smithi032.stdout:3/79: dwrite d1/f14 [4194304,4194304] 0 2024-05-06T21:26:30.383 INFO:tasks.workunit.client.0.smithi032.stdout:3/80: chown d1/l19 3288 1 2024-05-06T21:26:30.383 INFO:tasks.workunit.client.0.smithi032.stdout:4/174: mknod d2/d16/c3d 0 2024-05-06T21:26:30.383 INFO:tasks.workunit.client.0.smithi032.stdout:4/175: write d2/fb [550891,84360] 0 2024-05-06T21:26:30.388 INFO:tasks.workunit.client.0.smithi032.stdout:4/176: truncate d2/f35 3466302 0 2024-05-06T21:26:30.388 INFO:tasks.workunit.client.0.smithi032.stdout:4/177: chown d2/d1e/f25 0 1 2024-05-06T21:26:30.388 INFO:tasks.workunit.client.0.smithi032.stdout:4/178: stat d2/fc 0 2024-05-06T21:26:30.389 INFO:tasks.workunit.client.0.smithi032.stdout:3/81: rmdir d1/d4/da 39 2024-05-06T21:26:30.389 INFO:tasks.workunit.client.0.smithi032.stdout:3/82: truncate d1/fb 4926639 0 2024-05-06T21:26:30.389 INFO:tasks.workunit.client.0.smithi032.stdout:3/83: chown d1/f6 59041 1 2024-05-06T21:26:30.390 INFO:tasks.workunit.client.0.smithi032.stdout:4/179: mknod d2/d13/c3e 0 2024-05-06T21:26:30.390 INFO:tasks.workunit.client.0.smithi032.stdout:4/180: chown d2/c20 14 1 2024-05-06T21:26:30.390 INFO:tasks.workunit.client.0.smithi032.stdout:4/181: creat d2/d16/f3f x:0 0 0 2024-05-06T21:26:30.391 INFO:tasks.workunit.client.0.smithi032.stdout:3/84: mknod d1/c1e 0 2024-05-06T21:26:30.391 INFO:tasks.workunit.client.0.smithi032.stdout:3/85: chown d1/d4/da/c18 6401 1 2024-05-06T21:26:30.394 INFO:tasks.workunit.client.0.smithi032.stdout:7/179: dwrite db/f1e [0,4194304] 0 2024-05-06T21:26:30.397 INFO:tasks.workunit.client.0.smithi032.stdout:4/182: dread d2/fb [0,4194304] 0 2024-05-06T21:26:30.398 INFO:tasks.workunit.client.0.smithi032.stdout:3/86: write d1/f6 [1903204,128750] 0 2024-05-06T21:26:30.402 INFO:tasks.workunit.client.0.smithi032.stdout:2/12: rename f0 to f2 0 2024-05-06T21:26:30.402 INFO:tasks.workunit.client.0.smithi032.stdout:2/13: chown l1 13423344 1 2024-05-06T21:26:30.402 INFO:tasks.workunit.client.0.smithi032.stdout:2/14: stat f2 0 2024-05-06T21:26:30.403 INFO:tasks.workunit.client.0.smithi032.stdout:2/15: readlink l1 0 2024-05-06T21:26:30.403 INFO:tasks.workunit.client.0.smithi032.stdout:7/180: read db/d13/f36 [941383,25166] 0 2024-05-06T21:26:30.403 INFO:tasks.workunit.client.0.smithi032.stdout:4/183: truncate d2/fa 3473636 0 2024-05-06T21:26:30.405 INFO:tasks.workunit.client.0.smithi032.stdout:3/87: mknod d1/c1f 0 2024-05-06T21:26:30.405 INFO:tasks.workunit.client.0.smithi032.stdout:7/181: mknod db/d12/d16/d2a/c3a 0 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:7/182: write db/d12/f17 [1083531,91178] 0 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:7/183: write db/d13/f36 [3578488,40493] 0 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:7/184: chown db/d13/c15 18899088 1 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:7/185: fdatasync db/f1f 0 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:7/186: chown db/d12/d16/d21/f27 126733290 1 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:3/88: symlink d1/l20 0 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:3/89: readlink d1/l2 0 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:3/90: fsync d1/d4/da/fc 0 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:7/187: rmdir db/d12/d16 39 2024-05-06T21:26:30.406 INFO:tasks.workunit.client.0.smithi032.stdout:7/188: write db/d12/d16/d2a/f33 [940920,40954] 0 2024-05-06T21:26:30.407 INFO:tasks.workunit.client.0.smithi032.stdout:3/91: creat d1/d4/d11/f21 x:0 0 0 2024-05-06T21:26:30.407 INFO:tasks.workunit.client.0.smithi032.stdout:3/92: truncate d1/d4/d11/f21 774843 0 2024-05-06T21:26:30.407 INFO:tasks.workunit.client.0.smithi032.stdout:3/93: fsync f0 0 2024-05-06T21:26:30.407 INFO:tasks.workunit.client.0.smithi032.stdout:3/94: rename d1/d4/da/c18 to d1/d4/d11/c22 0 2024-05-06T21:26:30.493 INFO:tasks.workunit.client.0.smithi032.stdout:2/16: dread f2 [0,4194304] 0 2024-05-06T21:26:30.497 INFO:tasks.workunit.client.0.smithi032.stdout:2/17: read f2 [1292970,81763] 0 2024-05-06T21:26:30.497 INFO:tasks.workunit.client.0.smithi032.stdout:2/18: creat f3 x:0 0 0 2024-05-06T21:26:30.497 INFO:tasks.workunit.client.0.smithi032.stdout:3/95: dread d1/d4/da/f1c [0,4194304] 0 2024-05-06T21:26:30.499 INFO:tasks.workunit.client.0.smithi032.stdout:2/19: truncate f2 1560545 0 2024-05-06T21:26:30.501 INFO:tasks.workunit.client.0.smithi032.stdout:8/68: sync 2024-05-06T21:26:30.501 INFO:tasks.workunit.client.0.smithi032.stdout:6/114: sync 2024-05-06T21:26:30.501 INFO:tasks.workunit.client.0.smithi032.stdout:9/57: sync 2024-05-06T21:26:30.502 INFO:tasks.workunit.client.0.smithi032.stdout:0/95: sync 2024-05-06T21:26:30.502 INFO:tasks.workunit.client.0.smithi032.stdout:5/17: sync 2024-05-06T21:26:30.502 INFO:tasks.workunit.client.0.smithi032.stdout:8/69: readlink - no filename 2024-05-06T21:26:30.502 INFO:tasks.workunit.client.0.smithi032.stdout:8/70: truncate d0/f3 4462956 0 2024-05-06T21:26:30.503 INFO:tasks.workunit.client.0.smithi032.stdout:5/18: truncate d0/f3 698566 0 2024-05-06T21:26:30.504 INFO:tasks.workunit.client.0.smithi032.stdout:9/58: truncate d1/f10 2320770 0 2024-05-06T21:26:30.506 INFO:tasks.workunit.client.0.smithi032.stdout:0/96: truncate d4/f7 991075 0 2024-05-06T21:26:30.507 INFO:tasks.workunit.client.0.smithi032.stdout:0/97: truncate d4/f6 264003 0 2024-05-06T21:26:30.511 INFO:tasks.workunit.client.0.smithi032.stdout:8/71: read d0/f3 [999392,70278] 0 2024-05-06T21:26:30.511 INFO:tasks.workunit.client.0.smithi032.stdout:7/189: dwrite db/f20 [0,4194304] 0 2024-05-06T21:26:30.512 INFO:tasks.workunit.client.0.smithi032.stdout:8/72: creat d0/fe x:0 0 0 2024-05-06T21:26:30.516 INFO:tasks.workunit.client.0.smithi032.stdout:6/115: write d8/da/fc [1831775,7001] 0 2024-05-06T21:26:30.516 INFO:tasks.workunit.client.0.smithi032.stdout:5/19: truncate d0/f3 1733089 0 2024-05-06T21:26:30.518 INFO:tasks.workunit.client.0.smithi032.stdout:7/190: getdents db/d12/d16/d2a 0 2024-05-06T21:26:30.518 INFO:tasks.workunit.client.0.smithi032.stdout:7/191: chown db/d12/f2e 285058476 1 2024-05-06T21:26:30.523 INFO:tasks.workunit.client.0.smithi032.stdout:6/116: creat d8/f17 x:0 0 0 2024-05-06T21:26:30.523 INFO:tasks.workunit.client.0.smithi032.stdout:7/192: mkdir db/d12/d16/d2a/d39/d3b 0 2024-05-06T21:26:30.523 INFO:tasks.workunit.client.0.smithi032.stdout:7/193: write db/d12/f2e [897978,116345] 0 2024-05-06T21:26:30.525 INFO:tasks.workunit.client.0.smithi032.stdout:3/96: dwrite d1/fb [0,4194304] 0 2024-05-06T21:26:30.525 INFO:tasks.workunit.client.0.smithi032.stdout:2/20: dread f2 [0,4194304] 0 2024-05-06T21:26:30.528 INFO:tasks.workunit.client.0.smithi032.stdout:7/194: symlink db/d12/d16/d2a/d39/d3b/l3c 0 2024-05-06T21:26:30.530 INFO:tasks.workunit.client.0.smithi032.stdout:2/21: rename l1 to l4 0 2024-05-06T21:26:30.534 INFO:tasks.workunit.client.0.smithi032.stdout:2/22: unlink f3 0 2024-05-06T21:26:30.536 INFO:tasks.workunit.client.0.smithi032.stdout:2/23: symlink l5 0 2024-05-06T21:26:30.536 INFO:tasks.workunit.client.0.smithi032.stdout:2/24: fdatasync f2 0 2024-05-06T21:26:30.538 INFO:tasks.workunit.client.0.smithi032.stdout:9/59: dwrite d1/f2 [0,4194304] 0 2024-05-06T21:26:30.538 INFO:tasks.workunit.client.0.smithi032.stdout:9/60: fsync d1/fe 0 2024-05-06T21:26:30.539 INFO:tasks.workunit.client.0.smithi032.stdout:8/73: dwrite d0/f4 [0,4194304] 0 2024-05-06T21:26:30.539 INFO:tasks.workunit.client.0.smithi032.stdout:8/74: chown d0/f5 59184606 1 2024-05-06T21:26:30.541 INFO:tasks.workunit.client.0.smithi032.stdout:0/98: dread d4/f6 [0,4194304] 0 2024-05-06T21:26:30.544 INFO:tasks.workunit.client.0.smithi032.stdout:6/117: fsync d8/da/fc 0 2024-05-06T21:26:30.544 INFO:tasks.workunit.client.0.smithi032.stdout:8/75: mknod d0/cf 0 2024-05-06T21:26:30.550 INFO:tasks.workunit.client.0.smithi032.stdout:6/118: rename d8/da to d8/dd/d18 0 2024-05-06T21:26:30.555 INFO:tasks.workunit.client.0.smithi032.stdout:6/119: rename d8/fb to d8/dd/d18/f19 0 2024-05-06T21:26:30.559 INFO:tasks.workunit.client.0.smithi032.stdout:6/120: rename d8/dd/d18/fc to d8/dd/f1a 0 2024-05-06T21:26:30.569 INFO:tasks.workunit.client.0.smithi032.stdout:3/97: dwrite f0 [4194304,4194304] 0 2024-05-06T21:26:30.573 INFO:tasks.workunit.client.0.smithi032.stdout:8/76: getdents d0 0 2024-05-06T21:26:30.574 INFO:tasks.workunit.client.0.smithi032.stdout:8/77: fdatasync d0/fb 0 2024-05-06T21:26:30.575 INFO:tasks.workunit.client.0.smithi032.stdout:8/78: creat d0/f10 x:0 0 0 2024-05-06T21:26:30.581 INFO:tasks.workunit.client.0.smithi032.stdout:6/121: dread d8/dd/d18/f19 [0,4194304] 0 2024-05-06T21:26:30.586 INFO:tasks.workunit.client.0.smithi032.stdout:5/20: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:30.586 INFO:tasks.workunit.client.0.smithi032.stdout:5/21: readlink - no filename 2024-05-06T21:26:30.586 INFO:tasks.workunit.client.0.smithi032.stdout:9/61: dwrite d1/f4 [0,4194304] 0 2024-05-06T21:26:30.587 INFO:tasks.workunit.client.0.smithi032.stdout:2/25: dwrite f2 [0,4194304] 0 2024-05-06T21:26:30.587 INFO:tasks.workunit.client.0.smithi032.stdout:7/195: dwrite db/d12/d16/d21/f27 [0,4194304] 0 2024-05-06T21:26:30.590 INFO:tasks.workunit.client.0.smithi032.stdout:9/62: rmdir d1/d11 0 2024-05-06T21:26:30.591 INFO:tasks.workunit.client.0.smithi032.stdout:2/26: mknod c6 0 2024-05-06T21:26:30.591 INFO:tasks.workunit.client.0.smithi032.stdout:2/27: creat f7 x:0 0 0 2024-05-06T21:26:30.591 INFO:tasks.workunit.client.0.smithi032.stdout:2/28: chown l5 10 1 2024-05-06T21:26:30.594 INFO:tasks.workunit.client.0.smithi032.stdout:6/122: dread d8/f10 [0,4194304] 0 2024-05-06T21:26:30.594 INFO:tasks.workunit.client.0.smithi032.stdout:0/99: dwrite d4/da/d16/f18 [0,4194304] 0 2024-05-06T21:26:30.594 INFO:tasks.workunit.client.0.smithi032.stdout:6/123: write d8/dd/d18/f11 [676666,107265] 0 2024-05-06T21:26:30.597 INFO:tasks.workunit.client.0.smithi032.stdout:6/124: dread d8/dd/f12 [0,4194304] 0 2024-05-06T21:26:30.601 INFO:tasks.workunit.client.0.smithi032.stdout:5/22: dread d0/f3 [0,4194304] 0 2024-05-06T21:26:30.602 INFO:tasks.workunit.client.0.smithi032.stdout:3/98: dwrite d1/f6 [4194304,4194304] 0 2024-05-06T21:26:30.602 INFO:tasks.workunit.client.0.smithi032.stdout:3/99: chown d1/d4/da/f1c 22737268 1 2024-05-06T21:26:30.603 INFO:tasks.workunit.client.0.smithi032.stdout:8/79: dwrite d0/fa [0,4194304] 0 2024-05-06T21:26:30.603 INFO:tasks.workunit.client.0.smithi032.stdout:8/80: dread - d0/f10 zero size 2024-05-06T21:26:30.603 INFO:tasks.workunit.client.0.smithi032.stdout:8/81: creat d0/f11 x:0 0 0 2024-05-06T21:26:30.603 INFO:tasks.workunit.client.0.smithi032.stdout:8/82: fdatasync d0/fa 0 2024-05-06T21:26:30.610 INFO:tasks.workunit.client.0.smithi032.stdout:6/125: mkdir d8/dd/d1b 0 2024-05-06T21:26:30.610 INFO:tasks.workunit.client.0.smithi032.stdout:6/126: chown d8/f17 610817 1 2024-05-06T21:26:30.613 INFO:tasks.workunit.client.0.smithi032.stdout:2/29: write f2 [376387,106372] 0 2024-05-06T21:26:30.617 INFO:tasks.workunit.client.0.smithi032.stdout:8/83: symlink d0/l12 0 2024-05-06T21:26:30.617 INFO:tasks.workunit.client.0.smithi032.stdout:7/196: dwrite db/d12/d16/d2a/f33 [0,4194304] 0 2024-05-06T21:26:30.617 INFO:tasks.workunit.client.0.smithi032.stdout:9/63: dwrite d1/f9 [0,4194304] 0 2024-05-06T21:26:30.620 INFO:tasks.workunit.client.0.smithi032.stdout:0/100: rmdir d4/da 39 2024-05-06T21:26:30.622 INFO:tasks.workunit.client.0.smithi032.stdout:2/30: unlink l5 0 2024-05-06T21:26:30.622 INFO:tasks.workunit.client.0.smithi032.stdout:2/31: read - f7 zero size 2024-05-06T21:26:30.623 INFO:tasks.workunit.client.0.smithi032.stdout:8/84: truncate d0/f9 68077 0 2024-05-06T21:26:30.623 INFO:tasks.workunit.client.0.smithi032.stdout:8/85: fdatasync d0/f8 0 2024-05-06T21:26:30.626 INFO:tasks.workunit.client.0.smithi032.stdout:7/197: creat db/d12/d16/d2a/d39/d3b/f3d x:0 0 0 2024-05-06T21:26:30.628 INFO:tasks.workunit.client.0.smithi032.stdout:1/171: sync 2024-05-06T21:26:30.628 INFO:tasks.workunit.client.0.smithi032.stdout:4/184: sync 2024-05-06T21:26:30.628 INFO:tasks.workunit.client.0.smithi032.stdout:4/185: write d2/d1e/f21 [3803601,99889] 0 2024-05-06T21:26:30.630 INFO:tasks.workunit.client.0.smithi032.stdout:9/64: rename d1/f4 to d1/f12 0 2024-05-06T21:26:30.630 INFO:tasks.workunit.client.0.smithi032.stdout:4/186: dread d2/f9 [0,4194304] 0 2024-05-06T21:26:30.632 INFO:tasks.workunit.client.0.smithi032.stdout:2/32: symlink l8 0 2024-05-06T21:26:30.632 INFO:tasks.workunit.client.0.smithi032.stdout:2/33: dread - f7 zero size 2024-05-06T21:26:30.632 INFO:tasks.workunit.client.0.smithi032.stdout:8/86: symlink d0/l13 0 2024-05-06T21:26:30.632 INFO:tasks.workunit.client.0.smithi032.stdout:8/87: chown d0/cf 2517058 1 2024-05-06T21:26:30.634 INFO:tasks.workunit.client.0.smithi032.stdout:7/198: rename db/d13/f38 to db/d12/d16/f3e 0 2024-05-06T21:26:30.635 INFO:tasks.workunit.client.0.smithi032.stdout:4/187: symlink d2/d1e/l40 0 2024-05-06T21:26:30.636 INFO:tasks.workunit.client.0.smithi032.stdout:2/34: link l4 l9 0 2024-05-06T21:26:30.638 INFO:tasks.workunit.client.0.smithi032.stdout:8/88: link d0/l12 d0/l14 0 2024-05-06T21:26:30.640 INFO:tasks.workunit.client.0.smithi032.stdout:3/100: dwrite d1/d4/f7 [0,4194304] 0 2024-05-06T21:26:30.641 INFO:tasks.workunit.client.0.smithi032.stdout:2/35: mknod ca 0 2024-05-06T21:26:30.641 INFO:tasks.workunit.client.0.smithi032.stdout:4/188: rename d2/d16/f3f to d2/d16/f41 0 2024-05-06T21:26:30.641 INFO:tasks.workunit.client.0.smithi032.stdout:9/65: write d1/f2 [3862009,13502] 0 2024-05-06T21:26:30.642 INFO:tasks.workunit.client.0.smithi032.stdout:5/23: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:30.642 INFO:tasks.workunit.client.0.smithi032.stdout:5/24: chown d0 149828306 1 2024-05-06T21:26:30.644 INFO:tasks.workunit.client.0.smithi032.stdout:0/101: dwrite d4/f9 [0,4194304] 0 2024-05-06T21:26:30.644 INFO:tasks.workunit.client.0.smithi032.stdout:3/101: mknod d1/d4/c23 0 2024-05-06T21:26:30.644 INFO:tasks.workunit.client.0.smithi032.stdout:0/102: write d4/f1f [34801,30279] 0 2024-05-06T21:26:30.645 INFO:tasks.workunit.client.0.smithi032.stdout:0/103: chown d4/da/d14/d1a/f1b 376 1 2024-05-06T21:26:30.645 INFO:tasks.workunit.client.0.smithi032.stdout:4/189: mknod d2/d16/c42 0 2024-05-06T21:26:30.645 INFO:tasks.workunit.client.0.smithi032.stdout:9/66: mkdir d1/d13 0 2024-05-06T21:26:30.647 INFO:tasks.workunit.client.0.smithi032.stdout:6/127: dwrite d8/dd/d18/f14 [0,4194304] 0 2024-05-06T21:26:30.648 INFO:tasks.workunit.client.0.smithi032.stdout:0/104: creat d4/da/f22 x:0 0 0 2024-05-06T21:26:30.650 INFO:tasks.workunit.client.0.smithi032.stdout:9/67: rename d1/fa to d1/d13/f14 0 2024-05-06T21:26:30.655 INFO:tasks.workunit.client.0.smithi032.stdout:0/105: truncate d4/da/d14/d1a/f1b 217955 0 2024-05-06T21:26:30.656 INFO:tasks.workunit.client.0.smithi032.stdout:8/89: dwrite d0/f11 [0,4194304] 0 2024-05-06T21:26:30.659 INFO:tasks.workunit.client.0.smithi032.stdout:9/68: symlink d1/d13/l15 0 2024-05-06T21:26:30.659 INFO:tasks.workunit.client.0.smithi032.stdout:9/69: stat d1/d13 0 2024-05-06T21:26:30.659 INFO:tasks.workunit.client.0.smithi032.stdout:9/70: dread - d1/fe zero size 2024-05-06T21:26:30.659 INFO:tasks.workunit.client.0.smithi032.stdout:9/71: readlink d1/lb 0 2024-05-06T21:26:30.660 INFO:tasks.workunit.client.0.smithi032.stdout:1/172: dwrite db/f13 [0,4194304] 0 2024-05-06T21:26:30.663 INFO:tasks.workunit.client.0.smithi032.stdout:0/106: rmdir d4/da/d14/d21 0 2024-05-06T21:26:30.663 INFO:tasks.workunit.client.0.smithi032.stdout:3/102: dread d1/d4/f7 [0,4194304] 0 2024-05-06T21:26:30.665 INFO:tasks.workunit.client.0.smithi032.stdout:9/72: creat d1/d13/f16 x:0 0 0 2024-05-06T21:26:30.665 INFO:tasks.workunit.client.0.smithi032.stdout:5/25: dwrite d0/f3 [4194304,4194304] 0 2024-05-06T21:26:30.665 INFO:tasks.workunit.client.0.smithi032.stdout:9/73: truncate d1/fe 712595 0 2024-05-06T21:26:30.665 INFO:tasks.workunit.client.0.smithi032.stdout:9/74: truncate d1/f8 610232 0 2024-05-06T21:26:30.667 INFO:tasks.workunit.client.0.smithi032.stdout:0/107: creat d4/da/d14/d1a/f23 x:0 0 0 2024-05-06T21:26:30.674 INFO:tasks.workunit.client.0.smithi032.stdout:6/128: dwrite d8/dd/d18/f14 [0,4194304] 0 2024-05-06T21:26:30.677 INFO:tasks.workunit.client.0.smithi032.stdout:9/75: rename d1/lb to d1/d13/l17 0 2024-05-06T21:26:30.678 INFO:tasks.workunit.client.0.smithi032.stdout:3/103: getdents d1 0 2024-05-06T21:26:30.681 INFO:tasks.workunit.client.0.smithi032.stdout:2/36: dwrite f2 [0,4194304] 0 2024-05-06T21:26:30.681 INFO:tasks.workunit.client.0.smithi032.stdout:9/76: truncate d1/f9 1364606 0 2024-05-06T21:26:30.682 INFO:tasks.workunit.client.0.smithi032.stdout:3/104: dread d1/d4/fe [0,4194304] 0 2024-05-06T21:26:30.683 INFO:tasks.workunit.client.0.smithi032.stdout:6/129: getdents d8/dd 0 2024-05-06T21:26:30.683 INFO:tasks.workunit.client.0.smithi032.stdout:6/130: dread - d8/dd/d18/d13/f16 zero size 2024-05-06T21:26:30.683 INFO:tasks.workunit.client.0.smithi032.stdout:6/131: chown d8/dd/d18/f11 635145437 1 2024-05-06T21:26:30.685 INFO:tasks.workunit.client.0.smithi032.stdout:6/132: symlink d8/dd/l1c 0 2024-05-06T21:26:30.686 INFO:tasks.workunit.client.0.smithi032.stdout:3/105: dread d1/f14 [0,4194304] 0 2024-05-06T21:26:30.686 INFO:tasks.workunit.client.0.smithi032.stdout:6/133: write d8/dd/d18/f19 [512356,62416] 0 2024-05-06T21:26:30.686 INFO:tasks.workunit.client.0.smithi032.stdout:6/134: stat d8/dd 0 2024-05-06T21:26:30.689 INFO:tasks.workunit.client.0.smithi032.stdout:3/106: getdents d1/d4/d11 0 2024-05-06T21:26:30.690 INFO:tasks.workunit.client.0.smithi032.stdout:8/90: dwrite d0/fb [0,4194304] 0 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:1/173: dwrite db/f1f [4194304,4194304] 0 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:1/174: fsync db/f14 0 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:1/175: dread - db/f30 zero size 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:1/176: write db/d16/f32 [998471,84632] 0 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:1/177: truncate db/f23 4691930 0 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:3/107: rmdir d1/d4 39 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:0/108: dread d4/da/d14/d1a/f1b [0,4194304] 0 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:0/109: creat d4/f24 x:0 0 0 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:0/110: fdatasync d4/da/d14/d1a/f1b 0 2024-05-06T21:26:30.692 INFO:tasks.workunit.client.0.smithi032.stdout:0/111: dread - d4/da/d14/d1a/f23 zero size 2024-05-06T21:26:30.693 INFO:tasks.workunit.client.0.smithi032.stdout:6/135: truncate d8/dd/d18/f11 640409 0 2024-05-06T21:26:30.701 INFO:tasks.workunit.client.0.smithi032.stdout:2/37: read f2 [2467038,83905] 0 2024-05-06T21:26:30.702 INFO:tasks.workunit.client.0.smithi032.stdout:9/77: write d1/f12 [2443223,18697] 0 2024-05-06T21:26:30.703 INFO:tasks.workunit.client.0.smithi032.stdout:1/178: dread db/d16/f1e [4194304,4194304] 0 2024-05-06T21:26:30.704 INFO:tasks.workunit.client.0.smithi032.stdout:1/179: read f9 [235174,35914] 0 2024-05-06T21:26:30.762 INFO:tasks.workunit.client.0.smithi032.stdout:3/108: rename d1/d4/f7 to d1/d4/da/d1d/f24 0 2024-05-06T21:26:30.762 INFO:tasks.workunit.client.0.smithi032.stdout:3/109: chown d1/d4/c10 0 1 2024-05-06T21:26:30.766 INFO:tasks.workunit.client.0.smithi032.stdout:2/38: link l8 lb 0 2024-05-06T21:26:30.767 INFO:tasks.workunit.client.0.smithi032.stdout:9/78: creat d1/f18 x:0 0 0 2024-05-06T21:26:30.768 INFO:tasks.workunit.client.0.smithi032.stdout:1/180: symlink db/d2a/l38 0 2024-05-06T21:26:30.768 INFO:tasks.workunit.client.0.smithi032.stdout:1/181: truncate db/f20 881034 0 2024-05-06T21:26:30.771 INFO:tasks.workunit.client.0.smithi032.stdout:2/39: dread f2 [0,4194304] 0 2024-05-06T21:26:30.774 INFO:tasks.workunit.client.0.smithi032.stdout:5/26: truncate d0/f3 6942351 0 2024-05-06T21:26:30.775 INFO:tasks.workunit.client.0.smithi032.stdout:5/27: creat d0/f4 x:0 0 0 2024-05-06T21:26:30.775 INFO:tasks.workunit.client.0.smithi032.stdout:5/28: chown d0/f4 1108784209 1 2024-05-06T21:26:30.775 INFO:tasks.workunit.client.0.smithi032.stdout:5/29: fdatasync d0/f3 0 2024-05-06T21:26:30.777 INFO:tasks.workunit.client.0.smithi032.stdout:8/91: rmdir d0 39 2024-05-06T21:26:30.779 INFO:tasks.workunit.client.0.smithi032.stdout:3/110: symlink d1/d4/l25 0 2024-05-06T21:26:30.779 INFO:tasks.workunit.client.0.smithi032.stdout:3/111: chown d1/d4/c23 115072 1 2024-05-06T21:26:30.779 INFO:tasks.workunit.client.0.smithi032.stdout:3/112: fdatasync d1/d4/da/d1d/f24 0 2024-05-06T21:26:30.780 INFO:tasks.workunit.client.0.smithi032.stdout:9/79: symlink d1/d13/l19 0 2024-05-06T21:26:30.784 INFO:tasks.workunit.client.0.smithi032.stdout:8/92: link d0/l12 d0/l15 0 2024-05-06T21:26:30.784 INFO:tasks.workunit.client.0.smithi032.stdout:8/93: chown d0/f11 2717954 1 2024-05-06T21:26:30.785 INFO:tasks.workunit.client.0.smithi032.stdout:3/113: mkdir d1/d4/d11/d26 0 2024-05-06T21:26:30.787 INFO:tasks.workunit.client.0.smithi032.stdout:9/80: rename d1/d13/f14 to d1/f1a 0 2024-05-06T21:26:30.788 INFO:tasks.workunit.client.0.smithi032.stdout:1/182: rmdir db/d16 39 2024-05-06T21:26:30.788 INFO:tasks.workunit.client.0.smithi032.stdout:1/183: write db/f14 [227381,110445] 0 2024-05-06T21:26:30.789 INFO:tasks.workunit.client.0.smithi032.stdout:2/40: truncate f2 2242690 0 2024-05-06T21:26:30.789 INFO:tasks.workunit.client.0.smithi032.stdout:2/41: creat fc x:0 0 0 2024-05-06T21:26:30.789 INFO:tasks.workunit.client.0.smithi032.stdout:3/114: creat d1/d4/da/d1d/f27 x:0 0 0 2024-05-06T21:26:30.791 INFO:tasks.workunit.client.0.smithi032.stdout:1/184: unlink db/f13 0 2024-05-06T21:26:30.791 INFO:tasks.workunit.client.0.smithi032.stdout:1/185: truncate db/f30 232677 0 2024-05-06T21:26:30.791 INFO:tasks.workunit.client.0.smithi032.stdout:1/186: truncate db/f29 89739 0 2024-05-06T21:26:30.791 INFO:tasks.workunit.client.0.smithi032.stdout:1/187: readlink db/d2a/l38 0 2024-05-06T21:26:30.791 INFO:tasks.workunit.client.0.smithi032.stdout:1/188: creat db/d2a/f39 x:0 0 0 2024-05-06T21:26:30.792 INFO:tasks.workunit.client.0.smithi032.stdout:2/42: mknod cd 0 2024-05-06T21:26:30.793 INFO:tasks.workunit.client.0.smithi032.stdout:2/43: dread - fc zero size 2024-05-06T21:26:30.793 INFO:tasks.workunit.client.0.smithi032.stdout:2/44: fdatasync f2 0 2024-05-06T21:26:30.793 INFO:tasks.workunit.client.0.smithi032.stdout:2/45: chown f2 7 1 2024-05-06T21:26:30.793 INFO:tasks.workunit.client.0.smithi032.stdout:2/46: readlink l9 0 2024-05-06T21:26:30.793 INFO:tasks.workunit.client.0.smithi032.stdout:2/47: chown cd 690429 1 2024-05-06T21:26:30.794 INFO:tasks.workunit.client.0.smithi032.stdout:3/115: rename d1/l20 to d1/d4/d11/d26/l28 0 2024-05-06T21:26:30.794 INFO:tasks.workunit.client.0.smithi032.stdout:3/116: chown d1/d4/da/d1d/f24 6324241 1 2024-05-06T21:26:30.794 INFO:tasks.workunit.client.0.smithi032.stdout:3/117: write d1/fb [4978457,10637] 0 2024-05-06T21:26:30.796 INFO:tasks.workunit.client.0.smithi032.stdout:1/189: symlink db/d37/l3a 0 2024-05-06T21:26:30.798 INFO:tasks.workunit.client.0.smithi032.stdout:3/118: rename d1/d4/d11/f21 to d1/d4/f29 0 2024-05-06T21:26:30.799 INFO:tasks.workunit.client.0.smithi032.stdout:1/190: mknod db/d16/c3b 0 2024-05-06T21:26:30.799 INFO:tasks.workunit.client.0.smithi032.stdout:1/191: write db/f1f [415912,89798] 0 2024-05-06T21:26:30.864 INFO:tasks.workunit.client.0.smithi032.stdout:1/192: dread db/d2a/f2f [0,4194304] 0 2024-05-06T21:26:30.875 INFO:tasks.workunit.client.0.smithi032.stdout:1/193: read db/d16/f18 [3000338,121629] 0 2024-05-06T21:26:30.876 INFO:tasks.workunit.client.0.smithi032.stdout:8/94: dwrite d0/f4 [0,4194304] 0 2024-05-06T21:26:30.876 INFO:tasks.workunit.client.0.smithi032.stdout:6/136: dwrite d8/f17 [0,4194304] 0 2024-05-06T21:26:30.877 INFO:tasks.workunit.client.0.smithi032.stdout:1/194: mknod db/d16/c3c 0 2024-05-06T21:26:30.880 INFO:tasks.workunit.client.0.smithi032.stdout:8/95: creat d0/f16 x:0 0 0 2024-05-06T21:26:30.882 INFO:tasks.workunit.client.0.smithi032.stdout:0/112: getdents d4 0 2024-05-06T21:26:30.884 INFO:tasks.workunit.client.0.smithi032.stdout:6/137: chown d8/dd/f1a 66739906 1 2024-05-06T21:26:30.884 INFO:tasks.workunit.client.0.smithi032.stdout:6/138: write d8/dd/d18/f19 [4994953,129445] 0 2024-05-06T21:26:30.884 INFO:tasks.workunit.client.0.smithi032.stdout:6/139: write d8/dd/d18/d13/f16 [923751,62533] 0 2024-05-06T21:26:30.884 INFO:tasks.workunit.client.0.smithi032.stdout:1/195: symlink db/d37/l3d 0 2024-05-06T21:26:30.886 INFO:tasks.workunit.client.0.smithi032.stdout:8/96: symlink d0/l17 0 2024-05-06T21:26:30.886 INFO:tasks.workunit.client.0.smithi032.stdout:0/113: rmdir d4/da/d16 39 2024-05-06T21:26:30.889 INFO:tasks.workunit.client.0.smithi032.stdout:6/140: mkdir d8/dd/d18/d13/d1d 0 2024-05-06T21:26:30.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/97: symlink d0/l18 0 2024-05-06T21:26:30.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/98: creat d0/f19 x:0 0 0 2024-05-06T21:26:30.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/99: fsync d0/f7 0 2024-05-06T21:26:30.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/100: dread - d0/f16 zero size 2024-05-06T21:26:30.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/101: write d0/f10 [254152,26697] 0 2024-05-06T21:26:30.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/102: creat d0/f1a x:0 0 0 2024-05-06T21:26:30.896 INFO:tasks.workunit.client.0.smithi032.stdout:0/114: mknod d4/da/c25 0 2024-05-06T21:26:30.898 INFO:tasks.workunit.client.0.smithi032.stdout:5/30: link d0/f3 d0/f5 0 2024-05-06T21:26:30.899 INFO:tasks.workunit.client.0.smithi032.stdout:6/141: dread d8/f17 [0,4194304] 0 2024-05-06T21:26:30.902 INFO:tasks.workunit.client.0.smithi032.stdout:8/103: mkdir d0/d1b 0 2024-05-06T21:26:30.902 INFO:tasks.workunit.client.0.smithi032.stdout:8/104: write d0/f11 [4871621,6886] 0 2024-05-06T21:26:30.902 INFO:tasks.workunit.client.0.smithi032.stdout:8/105: chown d0/f19 6305266 1 2024-05-06T21:26:30.902 INFO:tasks.workunit.client.0.smithi032.stdout:8/106: chown d0/d1b 8056 1 2024-05-06T21:26:30.904 INFO:tasks.workunit.client.0.smithi032.stdout:0/115: creat d4/da/d14/f26 x:0 0 0 2024-05-06T21:26:30.906 INFO:tasks.workunit.client.0.smithi032.stdout:6/142: mkdir d8/dd/d18/d13/d1d/d1e 0 2024-05-06T21:26:30.906 INFO:tasks.workunit.client.0.smithi032.stdout:6/143: stat d8/f10 0 2024-05-06T21:26:30.907 INFO:tasks.workunit.client.0.smithi032.stdout:6/144: write d8/dd/d18/d13/f16 [860256,130543] 0 2024-05-06T21:26:30.907 INFO:tasks.workunit.client.0.smithi032.stdout:6/145: write d8/dd/d18/d13/f16 [1180853,71206] 0 2024-05-06T21:26:30.907 INFO:tasks.workunit.client.0.smithi032.stdout:6/146: rename d8 to d8/dd/d18/d13/d1d/d1e/d1f 22 2024-05-06T21:26:30.908 INFO:tasks.workunit.client.0.smithi032.stdout:1/196: dwrite db/d16/f32 [0,4194304] 0 2024-05-06T21:26:30.909 INFO:tasks.workunit.client.0.smithi032.stdout:8/107: mkdir d0/d1c 0 2024-05-06T21:26:30.909 INFO:tasks.workunit.client.0.smithi032.stdout:8/108: dread - d0/f19 zero size 2024-05-06T21:26:30.910 INFO:tasks.workunit.client.0.smithi032.stdout:2/48: getdents . 0 2024-05-06T21:26:30.911 INFO:tasks.workunit.client.0.smithi032.stdout:2/49: chown lb 130183961 1 2024-05-06T21:26:30.919 INFO:tasks.workunit.client.0.smithi032.stdout:6/147: rename d8/dd/d18/d13/f16 to d8/dd/d1b/f20 0 2024-05-06T21:26:30.920 INFO:tasks.workunit.client.0.smithi032.stdout:2/50: rename fc to fe 0 2024-05-06T21:26:30.922 INFO:tasks.workunit.client.0.smithi032.stdout:1/197: write db/f2e [5484073,116380] 0 2024-05-06T21:26:30.924 INFO:tasks.workunit.client.0.smithi032.stdout:6/148: mknod d8/dd/c21 0 2024-05-06T21:26:30.926 INFO:tasks.workunit.client.0.smithi032.stdout:2/51: mkdir df 0 2024-05-06T21:26:30.928 INFO:tasks.workunit.client.0.smithi032.stdout:5/31: dwrite d0/f4 [0,4194304] 0 2024-05-06T21:26:30.928 INFO:tasks.workunit.client.0.smithi032.stdout:0/116: dwrite d4/da/f22 [0,4194304] 0 2024-05-06T21:26:30.929 INFO:tasks.workunit.client.0.smithi032.stdout:8/109: dread d0/f10 [0,4194304] 0 2024-05-06T21:26:30.929 INFO:tasks.workunit.client.0.smithi032.stdout:2/52: creat df/f10 x:0 0 0 2024-05-06T21:26:30.930 INFO:tasks.workunit.client.0.smithi032.stdout:8/110: readlink d0/l15 0 2024-05-06T21:26:30.930 INFO:tasks.workunit.client.0.smithi032.stdout:8/111: chown d0/f6 13 1 2024-05-06T21:26:30.930 INFO:tasks.workunit.client.0.smithi032.stdout:6/149: write d8/dd/f12 [208083,53051] 0 2024-05-06T21:26:30.932 INFO:tasks.workunit.client.0.smithi032.stdout:1/198: truncate db/f1f 8748905 0 2024-05-06T21:26:30.938 INFO:tasks.workunit.client.0.smithi032.stdout:5/32: write d0/f5 [1035892,5012] 0 2024-05-06T21:26:30.939 INFO:tasks.workunit.client.0.smithi032.stdout:0/117: mknod d4/da/c27 0 2024-05-06T21:26:30.940 INFO:tasks.workunit.client.0.smithi032.stdout:0/118: fdatasync d4/da/d14/d1a/f1e 0 2024-05-06T21:26:30.940 INFO:tasks.workunit.client.0.smithi032.stdout:2/53: readlink lb 0 2024-05-06T21:26:30.940 INFO:tasks.workunit.client.0.smithi032.stdout:2/54: fdatasync df/f10 0 2024-05-06T21:26:30.940 INFO:tasks.workunit.client.0.smithi032.stdout:2/55: dread - fe zero size 2024-05-06T21:26:30.941 INFO:tasks.workunit.client.0.smithi032.stdout:8/112: symlink d0/l1d 0 2024-05-06T21:26:30.941 INFO:tasks.workunit.client.0.smithi032.stdout:8/113: fsync d0/f6 0 2024-05-06T21:26:30.942 INFO:tasks.workunit.client.0.smithi032.stdout:6/150: mkdir d8/dd/d18/d22 0 2024-05-06T21:26:30.942 INFO:tasks.workunit.client.0.smithi032.stdout:6/151: write d8/dd/f12 [187295,69490] 0 2024-05-06T21:26:30.943 INFO:tasks.workunit.client.0.smithi032.stdout:1/199: truncate db/d2a/f2d 3980477 0 2024-05-06T21:26:30.944 INFO:tasks.workunit.client.0.smithi032.stdout:2/56: stat l8 0 2024-05-06T21:26:30.944 INFO:tasks.workunit.client.0.smithi032.stdout:2/57: chown l8 10832705 1 2024-05-06T21:26:30.946 INFO:tasks.workunit.client.0.smithi032.stdout:6/152: creat d8/dd/d18/f23 x:0 0 0 2024-05-06T21:26:30.949 INFO:tasks.workunit.client.0.smithi032.stdout:8/114: write d0/f5 [3289159,45481] 0 2024-05-06T21:26:30.949 INFO:tasks.workunit.client.0.smithi032.stdout:5/33: getdents d0 0 2024-05-06T21:26:30.949 INFO:tasks.workunit.client.0.smithi032.stdout:1/200: write db/f12 [2867872,89725] 0 2024-05-06T21:26:30.951 INFO:tasks.workunit.client.0.smithi032.stdout:6/153: creat d8/dd/d18/d13/f24 x:0 0 0 2024-05-06T21:26:30.953 INFO:tasks.workunit.client.0.smithi032.stdout:8/115: mknod d0/d1c/c1e 0 2024-05-06T21:26:30.956 INFO:tasks.workunit.client.0.smithi032.stdout:1/201: fsync db/d16/f2c 0 2024-05-06T21:26:30.958 INFO:tasks.workunit.client.0.smithi032.stdout:0/119: dwrite d4/f1f [0,4194304] 0 2024-05-06T21:26:30.958 INFO:tasks.workunit.client.0.smithi032.stdout:0/120: chown d4/da/c25 17662360 1 2024-05-06T21:26:30.962 INFO:tasks.workunit.client.0.smithi032.stdout:6/154: dread d8/dd/d18/f19 [0,4194304] 0 2024-05-06T21:26:30.963 INFO:tasks.workunit.client.0.smithi032.stdout:1/202: chown db/d16/f1e 99641232 1 2024-05-06T21:26:30.963 INFO:tasks.workunit.client.0.smithi032.stdout:7/199: sync 2024-05-06T21:26:30.963 INFO:tasks.workunit.client.0.smithi032.stdout:4/190: sync 2024-05-06T21:26:30.965 INFO:tasks.workunit.client.0.smithi032.stdout:9/81: sync 2024-05-06T21:26:30.965 INFO:tasks.workunit.client.0.smithi032.stdout:3/119: sync 2024-05-06T21:26:30.967 INFO:tasks.workunit.client.0.smithi032.stdout:6/155: rmdir d8/dd/d18/d13/d1d/d1e 0 2024-05-06T21:26:30.968 INFO:tasks.workunit.client.0.smithi032.stdout:1/203: creat db/d37/f3e x:0 0 0 2024-05-06T21:26:30.968 INFO:tasks.workunit.client.0.smithi032.stdout:1/204: truncate db/f30 980356 0 2024-05-06T21:26:30.970 INFO:tasks.workunit.client.0.smithi032.stdout:7/200: link db/d12/f17 db/d12/d16/f3f 0 2024-05-06T21:26:30.972 INFO:tasks.workunit.client.0.smithi032.stdout:4/191: symlink d2/d1e/l43 0 2024-05-06T21:26:30.975 INFO:tasks.workunit.client.0.smithi032.stdout:4/192: mkdir d2/d16/d44 0 2024-05-06T21:26:30.977 INFO:tasks.workunit.client.0.smithi032.stdout:4/193: mkdir d2/d16/d44/d45 0 2024-05-06T21:26:30.977 INFO:tasks.workunit.client.0.smithi032.stdout:4/194: chown d2/f9 0 1 2024-05-06T21:26:30.977 INFO:tasks.workunit.client.0.smithi032.stdout:4/195: write d2/fa [458894,82061] 0 2024-05-06T21:26:30.979 INFO:tasks.workunit.client.0.smithi032.stdout:8/116: getdents d0/d1c 0 2024-05-06T21:26:30.980 INFO:tasks.workunit.client.0.smithi032.stdout:8/117: truncate d0/f16 890123 0 2024-05-06T21:26:30.980 INFO:tasks.workunit.client.0.smithi032.stdout:8/118: creat d0/f1f x:0 0 0 2024-05-06T21:26:30.983 INFO:tasks.workunit.client.0.smithi032.stdout:5/34: truncate d0/f3 5664529 0 2024-05-06T21:26:30.985 INFO:tasks.workunit.client.0.smithi032.stdout:0/121: write d4/da/d14/d1a/f1e [4363689,54061] 0 2024-05-06T21:26:30.985 INFO:tasks.workunit.client.0.smithi032.stdout:0/122: readlink d4/l10 0 2024-05-06T21:26:30.988 INFO:tasks.workunit.client.0.smithi032.stdout:8/119: creat d0/d1c/f20 x:0 0 0 2024-05-06T21:26:30.988 INFO:tasks.workunit.client.0.smithi032.stdout:8/120: chown d0/d1c/c1e 3560 1 2024-05-06T21:26:30.989 INFO:tasks.workunit.client.0.smithi032.stdout:0/123: creat d4/f28 x:0 0 0 2024-05-06T21:26:30.989 INFO:tasks.workunit.client.0.smithi032.stdout:0/124: write d4/da/d14/d1a/f1e [4617547,89172] 0 2024-05-06T21:26:30.989 INFO:tasks.workunit.client.0.smithi032.stdout:0/125: fdatasync d4/da/d14/f26 0 2024-05-06T21:26:30.990 INFO:tasks.workunit.client.0.smithi032.stdout:6/156: read d8/f10 [2773006,58081] 0 2024-05-06T21:26:30.990 INFO:tasks.workunit.client.0.smithi032.stdout:6/157: fdatasync d8/dd/f12 0 2024-05-06T21:26:30.991 INFO:tasks.workunit.client.0.smithi032.stdout:8/121: link d0/l18 d0/d1c/l21 0 2024-05-06T21:26:30.991 INFO:tasks.workunit.client.0.smithi032.stdout:8/122: chown d0/l1d 111648 1 2024-05-06T21:26:30.991 INFO:tasks.workunit.client.0.smithi032.stdout:8/123: fdatasync d0/f4 0 2024-05-06T21:26:30.991 INFO:tasks.workunit.client.0.smithi032.stdout:8/124: chown d0/l17 0 1 2024-05-06T21:26:30.991 INFO:tasks.workunit.client.0.smithi032.stdout:8/125: write d0/fe [871230,64615] 0 2024-05-06T21:26:30.992 INFO:tasks.workunit.client.0.smithi032.stdout:0/126: mknod d4/c29 0 2024-05-06T21:26:30.992 INFO:tasks.workunit.client.0.smithi032.stdout:0/127: chown d4 102213667 1 2024-05-06T21:26:30.993 INFO:tasks.workunit.client.0.smithi032.stdout:6/158: unlink d8/c15 0 2024-05-06T21:26:30.994 INFO:tasks.workunit.client.0.smithi032.stdout:0/128: symlink d4/da/d14/d1a/l2a 0 2024-05-06T21:26:30.994 INFO:tasks.workunit.client.0.smithi032.stdout:0/129: chown d4 22771961 1 2024-05-06T21:26:30.995 INFO:tasks.workunit.client.0.smithi032.stdout:0/130: symlink d4/da/d16/l2b 0 2024-05-06T21:26:31.002 INFO:tasks.workunit.client.0.smithi032.stdout:9/82: dwrite d1/d13/f16 [0,4194304] 0 2024-05-06T21:26:31.002 INFO:tasks.workunit.client.0.smithi032.stdout:7/201: dread f3 [0,4194304] 0 2024-05-06T21:26:31.002 INFO:tasks.workunit.client.0.smithi032.stdout:9/83: stat d1/d13 0 2024-05-06T21:26:31.002 INFO:tasks.workunit.client.0.smithi032.stdout:9/84: chown d1/ld 357885 1 2024-05-06T21:26:31.002 INFO:tasks.workunit.client.0.smithi032.stdout:7/202: dread - db/d12/d16/f3e zero size 2024-05-06T21:26:31.002 INFO:tasks.workunit.client.0.smithi032.stdout:9/85: write d1/f7 [216786,58941] 0 2024-05-06T21:26:31.003 INFO:tasks.workunit.client.0.smithi032.stdout:4/196: dwrite d2/f35 [0,4194304] 0 2024-05-06T21:26:31.004 INFO:tasks.workunit.client.0.smithi032.stdout:3/120: dwrite d1/d4/f29 [0,4194304] 0 2024-05-06T21:26:31.004 INFO:tasks.workunit.client.0.smithi032.stdout:4/197: readlink d2/d1e/l43 0 2024-05-06T21:26:31.004 INFO:tasks.workunit.client.0.smithi032.stdout:4/198: truncate d2/d16/f36 41537 0 2024-05-06T21:26:31.009 INFO:tasks.workunit.client.0.smithi032.stdout:8/126: dread d0/fa [0,4194304] 0 2024-05-06T21:26:31.009 INFO:tasks.workunit.client.0.smithi032.stdout:8/127: dread - d0/fc zero size 2024-05-06T21:26:31.009 INFO:tasks.workunit.client.0.smithi032.stdout:8/128: creat d0/d1c/f22 x:0 0 0 2024-05-06T21:26:31.009 INFO:tasks.workunit.client.0.smithi032.stdout:9/86: dread d1/f8 [0,4194304] 0 2024-05-06T21:26:31.010 INFO:tasks.workunit.client.0.smithi032.stdout:9/87: creat d1/d13/f1b x:0 0 0 2024-05-06T21:26:31.010 INFO:tasks.workunit.client.0.smithi032.stdout:7/203: getdents db/d12/d16 0 2024-05-06T21:26:31.013 INFO:tasks.workunit.client.0.smithi032.stdout:6/159: dwrite d8/f10 [4194304,4194304] 0 2024-05-06T21:26:31.013 INFO:tasks.workunit.client.0.smithi032.stdout:6/160: readlink d8/dd/l1c 0 2024-05-06T21:26:31.013 INFO:tasks.workunit.client.0.smithi032.stdout:6/161: write d8/dd/d18/f23 [411210,120017] 0 2024-05-06T21:26:31.013 INFO:tasks.workunit.client.0.smithi032.stdout:4/199: truncate d2/f9 123220 0 2024-05-06T21:26:31.014 INFO:tasks.workunit.client.0.smithi032.stdout:3/121: mkdir d1/d2a 0 2024-05-06T21:26:31.017 INFO:tasks.workunit.client.0.smithi032.stdout:8/129: creat d0/d1b/f23 x:0 0 0 2024-05-06T21:26:31.017 INFO:tasks.workunit.client.0.smithi032.stdout:6/162: dread f4 [0,4194304] 0 2024-05-06T21:26:31.019 INFO:tasks.workunit.client.0.smithi032.stdout:9/88: mknod d1/d13/c1c 0 2024-05-06T21:26:31.019 INFO:tasks.workunit.client.0.smithi032.stdout:9/89: readlink d1/ld 0 2024-05-06T21:26:31.023 INFO:tasks.workunit.client.0.smithi032.stdout:7/204: rename db/d12/d16/d2a/c3a to db/d12/d16/d21/c40 0 2024-05-06T21:26:31.023 INFO:tasks.workunit.client.0.smithi032.stdout:7/205: write db/d12/d16/d2a/f2d [1035268,122376] 0 2024-05-06T21:26:31.024 INFO:tasks.workunit.client.0.smithi032.stdout:0/131: dwrite d4/fc [0,4194304] 0 2024-05-06T21:26:31.026 INFO:tasks.workunit.client.0.smithi032.stdout:8/130: read d0/f11 [2589728,120867] 0 2024-05-06T21:26:31.026 INFO:tasks.workunit.client.0.smithi032.stdout:8/131: chown d0/f16 7179330 1 2024-05-06T21:26:31.031 INFO:tasks.workunit.client.0.smithi032.stdout:3/122: creat d1/d4/d11/f2b x:0 0 0 2024-05-06T21:26:31.031 INFO:tasks.workunit.client.0.smithi032.stdout:3/123: truncate d1/d4/da/d1d/f27 263598 0 2024-05-06T21:26:31.031 INFO:tasks.workunit.client.0.smithi032.stdout:4/200: dwrite d2/d16/f36 [0,4194304] 0 2024-05-06T21:26:31.032 INFO:tasks.workunit.client.0.smithi032.stdout:7/206: dread db/f29 [0,4194304] 0 2024-05-06T21:26:31.032 INFO:tasks.workunit.client.0.smithi032.stdout:6/163: mknod d8/c25 0 2024-05-06T21:26:31.033 INFO:tasks.workunit.client.0.smithi032.stdout:9/90: truncate d1/f10 1098837 0 2024-05-06T21:26:31.033 INFO:tasks.workunit.client.0.smithi032.stdout:9/91: stat d1/f9 0 2024-05-06T21:26:31.035 INFO:tasks.workunit.client.0.smithi032.stdout:0/132: creat d4/da/d16/f2c x:0 0 0 2024-05-06T21:26:31.035 INFO:tasks.workunit.client.0.smithi032.stdout:0/133: creat d4/da/d14/f2d x:0 0 0 2024-05-06T21:26:31.037 INFO:tasks.workunit.client.0.smithi032.stdout:8/132: rename d0/fb to d0/d1c/f24 0 2024-05-06T21:26:31.037 INFO:tasks.workunit.client.0.smithi032.stdout:9/92: dread d1/f9 [0,4194304] 0 2024-05-06T21:26:31.038 INFO:tasks.workunit.client.0.smithi032.stdout:9/93: dread d1/fe [0,4194304] 0 2024-05-06T21:26:31.038 INFO:tasks.workunit.client.0.smithi032.stdout:3/124: creat d1/d4/da/f2c x:0 0 0 2024-05-06T21:26:31.038 INFO:tasks.workunit.client.0.smithi032.stdout:3/125: chown d1/d4 850861 1 2024-05-06T21:26:31.039 INFO:tasks.workunit.client.0.smithi032.stdout:3/126: dread d1/d4/da/f1c [0,4194304] 0 2024-05-06T21:26:31.041 INFO:tasks.workunit.client.0.smithi032.stdout:4/201: truncate d2/f11 1622197 0 2024-05-06T21:26:31.042 INFO:tasks.workunit.client.0.smithi032.stdout:7/207: mkdir db/d12/d16/d21/d41 0 2024-05-06T21:26:31.046 INFO:tasks.workunit.client.0.smithi032.stdout:0/134: unlink d4/da/c25 0 2024-05-06T21:26:31.048 INFO:tasks.workunit.client.0.smithi032.stdout:4/202: creat d2/f46 x:0 0 0 2024-05-06T21:26:31.050 INFO:tasks.workunit.client.0.smithi032.stdout:7/208: truncate db/f20 910924 0 2024-05-06T21:26:31.050 INFO:tasks.workunit.client.0.smithi032.stdout:7/209: fsync db/d12/f19 0 2024-05-06T21:26:31.050 INFO:tasks.workunit.client.0.smithi032.stdout:7/210: fdatasync db/d12/f17 0 2024-05-06T21:26:31.051 INFO:tasks.workunit.client.0.smithi032.stdout:6/164: getdents d8/dd/d18/d13 0 2024-05-06T21:26:31.052 INFO:tasks.workunit.client.0.smithi032.stdout:0/135: mknod d4/da/d16/c2e 0 2024-05-06T21:26:31.053 INFO:tasks.workunit.client.0.smithi032.stdout:9/94: getdents d1/d13 0 2024-05-06T21:26:31.053 INFO:tasks.workunit.client.0.smithi032.stdout:9/95: readlink d1/d13/l19 0 2024-05-06T21:26:31.055 INFO:tasks.workunit.client.0.smithi032.stdout:7/211: creat db/d12/d16/d2a/f42 x:0 0 0 2024-05-06T21:26:31.055 INFO:tasks.workunit.client.0.smithi032.stdout:7/212: truncate db/fe 1909004 0 2024-05-06T21:26:31.057 INFO:tasks.workunit.client.0.smithi032.stdout:0/136: unlink d4/da/cf 0 2024-05-06T21:26:31.057 INFO:tasks.workunit.client.0.smithi032.stdout:0/137: fdatasync d4/da/f22 0 2024-05-06T21:26:31.057 INFO:tasks.workunit.client.0.smithi032.stdout:9/96: dread d1/f10 [0,4194304] 0 2024-05-06T21:26:31.057 INFO:tasks.workunit.client.0.smithi032.stdout:9/97: chown d1/f12 277 1 2024-05-06T21:26:31.059 INFO:tasks.workunit.client.0.smithi032.stdout:0/138: mkdir d4/da/d2f 0 2024-05-06T21:26:31.059 INFO:tasks.workunit.client.0.smithi032.stdout:0/139: fsync d4/da/d14/d1a/f1e 0 2024-05-06T21:26:31.061 INFO:tasks.workunit.client.0.smithi032.stdout:0/140: mknod d4/da/d14/d1a/c30 0 2024-05-06T21:26:31.061 INFO:tasks.workunit.client.0.smithi032.stdout:0/141: stat d4/da/d16 0 2024-05-06T21:26:31.061 INFO:tasks.workunit.client.0.smithi032.stdout:0/142: chown d4/da/d14/d1a/c30 6 1 2024-05-06T21:26:31.062 INFO:tasks.workunit.client.0.smithi032.stdout:8/133: rmdir d0/d1c 39 2024-05-06T21:26:31.062 INFO:tasks.workunit.client.0.smithi032.stdout:8/134: write d0/d1c/f20 [268874,43329] 0 2024-05-06T21:26:31.064 INFO:tasks.workunit.client.0.smithi032.stdout:0/143: unlink d4/c29 0 2024-05-06T21:26:31.065 INFO:tasks.workunit.client.0.smithi032.stdout:0/144: readlink d4/da/d16/l2b 0 2024-05-06T21:26:31.072 INFO:tasks.workunit.client.0.smithi032.stdout:0/145: dread d4/f9 [0,4194304] 0 2024-05-06T21:26:31.072 INFO:tasks.workunit.client.0.smithi032.stdout:0/146: chown d4/c8 13095 1 2024-05-06T21:26:31.072 INFO:tasks.workunit.client.0.smithi032.stdout:0/147: creat d4/da/f31 x:0 0 0 2024-05-06T21:26:31.072 INFO:tasks.workunit.client.0.smithi032.stdout:0/148: fsync d4/da/f17 0 2024-05-06T21:26:31.072 INFO:tasks.workunit.client.0.smithi032.stdout:0/149: write d4/da/d14/f2d [977045,95079] 0 2024-05-06T21:26:31.074 INFO:tasks.workunit.client.0.smithi032.stdout:0/150: mknod d4/da/d2f/c32 0 2024-05-06T21:26:31.074 INFO:tasks.workunit.client.0.smithi032.stdout:9/98: dwrite d1/f12 [0,4194304] 0 2024-05-06T21:26:31.074 INFO:tasks.workunit.client.0.smithi032.stdout:9/99: readlink d1/lc 0 2024-05-06T21:26:31.074 INFO:tasks.workunit.client.0.smithi032.stdout:9/100: getdents d1/d13 0 2024-05-06T21:26:31.074 INFO:tasks.workunit.client.0.smithi032.stdout:9/101: chown d1/f1a 119 1 2024-05-06T21:26:31.076 INFO:tasks.workunit.client.0.smithi032.stdout:7/213: truncate db/d12/f17 563177 0 2024-05-06T21:26:31.076 INFO:tasks.workunit.client.0.smithi032.stdout:7/214: read - db/d13/f2c zero size 2024-05-06T21:26:31.081 INFO:tasks.workunit.client.0.smithi032.stdout:0/151: rename d4/da/d2f to d4/da/d16/d33 0 2024-05-06T21:26:31.081 INFO:tasks.workunit.client.0.smithi032.stdout:7/215: rename db/d12 to db/d12/d16/d21/d41/d43 22 2024-05-06T21:26:31.081 INFO:tasks.workunit.client.0.smithi032.stdout:7/216: stat db/d13/c2b 0 2024-05-06T21:26:31.081 INFO:tasks.workunit.client.0.smithi032.stdout:7/217: creat db/d12/d16/d21/f44 x:0 0 0 2024-05-06T21:26:31.084 INFO:tasks.workunit.client.0.smithi032.stdout:0/152: getdents d4/da/d14 0 2024-05-06T21:26:31.084 INFO:tasks.workunit.client.0.smithi032.stdout:0/153: creat d4/da/d14/d1a/f34 x:0 0 0 2024-05-06T21:26:31.084 INFO:tasks.workunit.client.0.smithi032.stdout:0/154: readlink d4/da/d14/d1a/l2a 0 2024-05-06T21:26:31.085 INFO:tasks.workunit.client.0.smithi032.stdout:9/102: write d1/f12 [1877192,54024] 0 2024-05-06T21:26:31.087 INFO:tasks.workunit.client.0.smithi032.stdout:9/103: rename d1/d13/c1c to d1/c1d 0 2024-05-06T21:26:31.090 INFO:tasks.workunit.client.0.smithi032.stdout:9/104: rename d1/f8 to d1/d13/f1e 0 2024-05-06T21:26:31.091 INFO:tasks.workunit.client.0.smithi032.stdout:9/105: read d1/d13/f1e [144742,47786] 0 2024-05-06T21:26:31.092 INFO:tasks.workunit.client.0.smithi032.stdout:9/106: rename d1/d13/f1b to d1/d13/f1f 0 2024-05-06T21:26:31.092 INFO:tasks.workunit.client.0.smithi032.stdout:9/107: write d1/d13/f1e [1649265,17477] 0 2024-05-06T21:26:31.092 INFO:tasks.workunit.client.0.smithi032.stdout:9/108: write d1/f7 [610726,29018] 0 2024-05-06T21:26:31.094 INFO:tasks.workunit.client.0.smithi032.stdout:9/109: mkdir d1/d13/d20 0 2024-05-06T21:26:31.096 INFO:tasks.workunit.client.0.smithi032.stdout:9/110: symlink d1/d13/l21 0 2024-05-06T21:26:31.096 INFO:tasks.workunit.client.0.smithi032.stdout:9/111: readlink d1/d13/l17 0 2024-05-06T21:26:31.096 INFO:tasks.workunit.client.0.smithi032.stdout:9/112: chown d1/d13/f1f 11792 1 2024-05-06T21:26:31.096 INFO:tasks.workunit.client.0.smithi032.stdout:9/113: truncate d1/f9 1131024 0 2024-05-06T21:26:31.098 INFO:tasks.workunit.client.0.smithi032.stdout:9/114: mknod d1/c22 0 2024-05-06T21:26:31.098 INFO:tasks.workunit.client.0.smithi032.stdout:9/115: chown d1/f2 488930356 1 2024-05-06T21:26:31.099 INFO:tasks.workunit.client.0.smithi032.stdout:9/116: unlink d1/ld 0 2024-05-06T21:26:31.107 INFO:tasks.workunit.client.0.smithi032.stdout:7/218: dwrite db/d12/d16/d21/f44 [0,4194304] 0 2024-05-06T21:26:31.107 INFO:tasks.workunit.client.0.smithi032.stdout:0/155: dwrite d4/da/d14/d1a/f1e [4194304,4194304] 0 2024-05-06T21:26:31.107 INFO:tasks.workunit.client.0.smithi032.stdout:0/156: chown d4/l5 8707289 1 2024-05-06T21:26:31.108 INFO:tasks.workunit.client.0.smithi032.stdout:0/157: chown d4/da/d14/d1a/l2a 416 1 2024-05-06T21:26:31.108 INFO:tasks.workunit.client.0.smithi032.stdout:0/158: creat d4/da/f35 x:0 0 0 2024-05-06T21:26:31.110 INFO:tasks.workunit.client.0.smithi032.stdout:7/219: link db/ld db/d12/d16/d2a/d39/d3b/l45 0 2024-05-06T21:26:31.182 INFO:tasks.workunit.client.0.smithi032.stdout:0/159: creat d4/da/d16/d33/f36 x:0 0 0 2024-05-06T21:26:31.184 INFO:tasks.workunit.client.0.smithi032.stdout:7/220: unlink db/lc 0 2024-05-06T21:26:31.185 INFO:tasks.workunit.client.0.smithi032.stdout:0/160: symlink d4/da/d16/l37 0 2024-05-06T21:26:31.185 INFO:tasks.workunit.client.0.smithi032.stdout:0/161: chown d4/da/d14/d1a/f23 537503 1 2024-05-06T21:26:31.187 INFO:tasks.workunit.client.0.smithi032.stdout:0/162: dread d4/da/d14/d1a/f1b [0,4194304] 0 2024-05-06T21:26:31.187 INFO:tasks.workunit.client.0.smithi032.stdout:0/163: fsync d4/da/d14/d1a/f23 0 2024-05-06T21:26:31.187 INFO:tasks.workunit.client.0.smithi032.stdout:0/164: truncate d4/da/d14/d1a/f34 484397 0 2024-05-06T21:26:31.188 INFO:tasks.workunit.client.0.smithi032.stdout:0/165: creat d4/da/d16/d33/f38 x:0 0 0 2024-05-06T21:26:31.189 INFO:tasks.workunit.client.0.smithi032.stdout:0/166: unlink d4/da/d16/l37 0 2024-05-06T21:26:31.189 INFO:tasks.workunit.client.0.smithi032.stdout:0/167: creat d4/da/f39 x:0 0 0 2024-05-06T21:26:31.190 INFO:tasks.workunit.client.0.smithi032.stdout:7/221: dread db/d12/d16/f24 [0,4194304] 0 2024-05-06T21:26:31.191 INFO:tasks.workunit.client.0.smithi032.stdout:0/168: creat d4/da/d14/f3a x:0 0 0 2024-05-06T21:26:31.191 INFO:tasks.workunit.client.0.smithi032.stdout:0/169: creat d4/da/d16/f3b x:0 0 0 2024-05-06T21:26:31.220 INFO:tasks.workunit.client.0.smithi032.stdout:7/222: dwrite db/f10 [0,4194304] 0 2024-05-06T21:26:31.220 INFO:tasks.workunit.client.0.smithi032.stdout:7/223: write db/d12/d16/d2a/d39/d3b/f3d [325997,96741] 0 2024-05-06T21:26:31.220 INFO:tasks.workunit.client.0.smithi032.stdout:0/170: dwrite d4/f1f [4194304,4194304] 0 2024-05-06T21:26:31.220 INFO:tasks.workunit.client.0.smithi032.stdout:7/224: rename db/d12/d16 to db/d12/d16/d2a/d39/d3b/d46 22 2024-05-06T21:26:31.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:30 smithi032 ceph-mon[27179]: pgmap v16: 65 pgs: 65 active+clean; 159 MiB data, 752 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s wr, 669 op/s 2024-05-06T21:26:31.227 INFO:tasks.workunit.client.0.smithi032.stdout:7/225: write f8 [5650495,76137] 0 2024-05-06T21:26:31.228 INFO:tasks.workunit.client.0.smithi032.stdout:7/226: link db/d13/c2f db/d12/c47 0 2024-05-06T21:26:31.242 INFO:tasks.workunit.client.0.smithi032.stdout:0/171: dwrite d4/da/f11 [0,4194304] 0 2024-05-06T21:26:31.242 INFO:tasks.workunit.client.0.smithi032.stdout:7/227: write db/d12/f1c [868247,103067] 0 2024-05-06T21:26:31.244 INFO:tasks.workunit.client.0.smithi032.stdout:7/228: read db/d12/f17 [460991,24302] 0 2024-05-06T21:26:31.244 INFO:tasks.workunit.client.0.smithi032.stdout:7/229: creat db/f48 x:0 0 0 2024-05-06T21:26:31.244 INFO:tasks.workunit.client.0.smithi032.stdout:7/230: write db/d13/f2c [368513,97611] 0 2024-05-06T21:26:31.247 INFO:tasks.workunit.client.0.smithi032.stdout:0/172: rmdir d4/da/d16 39 2024-05-06T21:26:31.249 INFO:tasks.workunit.client.0.smithi032.stdout:0/173: rename d4/da/d14/d1a/f23 to d4/da/d16/f3c 0 2024-05-06T21:26:31.250 INFO:tasks.workunit.client.0.smithi032.stdout:0/174: symlink d4/l3d 0 2024-05-06T21:26:31.250 INFO:tasks.workunit.client.0.smithi032.stdout:7/231: dread f3 [0,4194304] 0 2024-05-06T21:26:31.251 INFO:tasks.workunit.client.0.smithi032.stdout:0/175: mkdir d4/d3e 0 2024-05-06T21:26:31.251 INFO:tasks.workunit.client.0.smithi032.stdout:0/176: creat d4/f3f x:0 0 0 2024-05-06T21:26:31.251 INFO:tasks.workunit.client.0.smithi032.stdout:0/177: truncate d4/f3f 527101 0 2024-05-06T21:26:31.252 INFO:tasks.workunit.client.0.smithi032.stdout:7/232: mkdir db/d12/d49 0 2024-05-06T21:26:31.252 INFO:tasks.workunit.client.0.smithi032.stdout:7/233: read db/d12/f1c [1726922,30016] 0 2024-05-06T21:26:31.252 INFO:tasks.workunit.client.0.smithi032.stdout:7/234: write db/d12/f1c [3638022,97331] 0 2024-05-06T21:26:31.252 INFO:tasks.workunit.client.0.smithi032.stdout:7/235: creat db/d12/d16/d21/f4a x:0 0 0 2024-05-06T21:26:31.263 INFO:tasks.workunit.client.0.smithi032.stdout:7/236: dread db/d12/f1c [0,4194304] 0 2024-05-06T21:26:31.264 INFO:tasks.workunit.client.0.smithi032.stdout:7/237: mkdir db/d12/d16/d21/d41/d4b 0 2024-05-06T21:26:31.264 INFO:tasks.workunit.client.0.smithi032.stdout:7/238: read db/d12/d16/f24 [1982621,3196] 0 2024-05-06T21:26:31.265 INFO:tasks.workunit.client.0.smithi032.stdout:7/239: truncate db/d12/f1c 4722403 0 2024-05-06T21:26:31.265 INFO:tasks.workunit.client.0.smithi032.stdout:0/178: dwrite d4/da/f31 [0,4194304] 0 2024-05-06T21:26:31.265 INFO:tasks.workunit.client.0.smithi032.stdout:7/240: symlink db/d12/d16/d2a/d39/d3b/l4c 0 2024-05-06T21:26:31.281 INFO:tasks.workunit.client.0.smithi032.stdout:0/179: write d4/da/f22 [487796,101256] 0 2024-05-06T21:26:31.281 INFO:tasks.workunit.client.0.smithi032.stdout:0/180: truncate d4/da/d14/f3a 186351 0 2024-05-06T21:26:31.281 INFO:tasks.workunit.client.0.smithi032.stdout:0/181: chown d4/f7 788 1 2024-05-06T21:26:31.283 INFO:tasks.workunit.client.0.smithi032.stdout:7/241: dwrite db/d13/f2c [0,4194304] 0 2024-05-06T21:26:31.283 INFO:tasks.workunit.client.0.smithi032.stdout:5/35: sync 2024-05-06T21:26:31.283 INFO:tasks.workunit.client.0.smithi032.stdout:2/58: sync 2024-05-06T21:26:31.283 INFO:tasks.workunit.client.0.smithi032.stdout:1/205: sync 2024-05-06T21:26:31.283 INFO:tasks.workunit.client.0.smithi032.stdout:5/36: chown d0/f5 239 1 2024-05-06T21:26:31.285 INFO:tasks.workunit.client.0.smithi032.stdout:7/242: creat db/d12/d49/f4d x:0 0 0 2024-05-06T21:26:31.285 INFO:tasks.workunit.client.0.smithi032.stdout:7/243: creat db/d12/d16/d2a/d39/d3b/f4e x:0 0 0 2024-05-06T21:26:31.285 INFO:tasks.workunit.client.0.smithi032.stdout:7/244: creat db/d13/f4f x:0 0 0 2024-05-06T21:26:31.285 INFO:tasks.workunit.client.0.smithi032.stdout:7/245: write db/fe [107694,88352] 0 2024-05-06T21:26:31.290 INFO:tasks.workunit.client.0.smithi032.stdout:7/246: dread db/d12/d16/f3f [0,4194304] 0 2024-05-06T21:26:31.290 INFO:tasks.workunit.client.0.smithi032.stdout:7/247: fdatasync db/f1f 0 2024-05-06T21:26:31.292 INFO:tasks.workunit.client.0.smithi032.stdout:7/248: mknod db/d12/d16/d2a/d39/c50 0 2024-05-06T21:26:31.292 INFO:tasks.workunit.client.0.smithi032.stdout:7/249: stat db/d12/d16/d2a/d39/d3b/l4c 0 2024-05-06T21:26:31.293 INFO:tasks.workunit.client.0.smithi032.stdout:1/206: dread db/d16/f32 [0,4194304] 0 2024-05-06T21:26:31.294 INFO:tasks.workunit.client.0.smithi032.stdout:1/207: read - db/d16/f33 zero size 2024-05-06T21:26:31.295 INFO:tasks.workunit.client.0.smithi032.stdout:1/208: dread f9 [0,4194304] 0 2024-05-06T21:26:31.295 INFO:tasks.workunit.client.0.smithi032.stdout:1/209: write db/f29 [1073137,47174] 0 2024-05-06T21:26:31.297 INFO:tasks.workunit.client.0.smithi032.stdout:1/210: mknod db/c3f 0 2024-05-06T21:26:31.300 INFO:tasks.workunit.client.0.smithi032.stdout:1/211: creat db/d16/f40 x:0 0 0 2024-05-06T21:26:31.305 INFO:tasks.workunit.client.0.smithi032.stdout:2/59: dread f2 [0,4194304] 0 2024-05-06T21:26:31.306 INFO:tasks.workunit.client.0.smithi032.stdout:2/60: dread - df/f10 zero size 2024-05-06T21:26:31.307 INFO:tasks.workunit.client.0.smithi032.stdout:0/182: dwrite d4/da/d16/f3b [0,4194304] 0 2024-05-06T21:26:31.307 INFO:tasks.workunit.client.0.smithi032.stdout:2/61: symlink df/l11 0 2024-05-06T21:26:31.307 INFO:tasks.workunit.client.0.smithi032.stdout:2/62: fsync f2 0 2024-05-06T21:26:31.307 INFO:tasks.workunit.client.0.smithi032.stdout:2/63: creat df/f12 x:0 0 0 2024-05-06T21:26:31.309 INFO:tasks.workunit.client.0.smithi032.stdout:0/183: rename d4/f28 to d4/f40 0 2024-05-06T21:26:31.309 INFO:tasks.workunit.client.0.smithi032.stdout:0/184: chown d4/da/d16/d33 25608 1 2024-05-06T21:26:31.310 INFO:tasks.workunit.client.0.smithi032.stdout:0/185: mknod d4/c41 0 2024-05-06T21:26:31.310 INFO:tasks.workunit.client.0.smithi032.stdout:0/186: write d4/da/d14/d1a/f34 [459295,5252] 0 2024-05-06T21:26:31.310 INFO:tasks.workunit.client.0.smithi032.stdout:0/187: stat d4/l20 0 2024-05-06T21:26:31.312 INFO:tasks.workunit.client.0.smithi032.stdout:0/188: mkdir d4/d3e/d42 0 2024-05-06T21:26:31.312 INFO:tasks.workunit.client.0.smithi032.stdout:0/189: write d4/f6 [227473,62027] 0 2024-05-06T21:26:31.312 INFO:tasks.workunit.client.0.smithi032.stdout:0/190: dread - d4/f24 zero size 2024-05-06T21:26:31.314 INFO:tasks.workunit.client.0.smithi032.stdout:0/191: creat d4/da/d16/f43 x:0 0 0 2024-05-06T21:26:31.315 INFO:tasks.workunit.client.0.smithi032.stdout:7/250: dwrite db/d12/d16/d21/f44 [4194304,4194304] 0 2024-05-06T21:26:31.316 INFO:tasks.workunit.client.0.smithi032.stdout:7/251: write db/f29 [5002094,30467] 0 2024-05-06T21:26:31.316 INFO:tasks.workunit.client.0.smithi032.stdout:7/252: chown db/f1e 24 1 2024-05-06T21:26:31.316 INFO:tasks.workunit.client.0.smithi032.stdout:5/37: dwrite d0/f5 [0,4194304] 0 2024-05-06T21:26:31.320 INFO:tasks.workunit.client.0.smithi032.stdout:7/253: dread db/d12/f19 [0,4194304] 0 2024-05-06T21:26:31.320 INFO:tasks.workunit.client.0.smithi032.stdout:7/254: chown db/fe 2159 1 2024-05-06T21:26:31.320 INFO:tasks.workunit.client.0.smithi032.stdout:7/255: chown db/f1f 147 1 2024-05-06T21:26:31.320 INFO:tasks.workunit.client.0.smithi032.stdout:7/256: readlink db/l32 0 2024-05-06T21:26:31.322 INFO:tasks.workunit.client.0.smithi032.stdout:7/257: rename db/d12/d16/f3e to db/d12/f51 0 2024-05-06T21:26:31.324 INFO:tasks.workunit.client.0.smithi032.stdout:7/258: unlink db/d12/d16/d21/f35 0 2024-05-06T21:26:31.328 INFO:tasks.workunit.client.0.smithi032.stdout:2/64: dwrite df/f12 [0,4194304] 0 2024-05-06T21:26:31.331 INFO:tasks.workunit.client.0.smithi032.stdout:2/65: mknod df/c13 0 2024-05-06T21:26:31.333 INFO:tasks.workunit.client.0.smithi032.stdout:2/66: mkdir df/d14 0 2024-05-06T21:26:31.333 INFO:tasks.workunit.client.0.smithi032.stdout:2/67: fsync fe 0 2024-05-06T21:26:31.333 INFO:tasks.workunit.client.0.smithi032.stdout:5/38: read d0/f4 [1196776,80234] 0 2024-05-06T21:26:31.333 INFO:tasks.workunit.client.0.smithi032.stdout:5/39: getdents d0 0 2024-05-06T21:26:31.333 INFO:tasks.workunit.client.0.smithi032.stdout:5/40: rename d0 to d0/d6 22 2024-05-06T21:26:31.333 INFO:tasks.workunit.client.0.smithi032.stdout:2/68: chown cd 2279 1 2024-05-06T21:26:31.334 INFO:tasks.workunit.client.0.smithi032.stdout:5/41: mknod d0/c7 0 2024-05-06T21:26:31.335 INFO:tasks.workunit.client.0.smithi032.stdout:2/69: creat df/d14/f15 x:0 0 0 2024-05-06T21:26:31.337 INFO:tasks.workunit.client.0.smithi032.stdout:0/192: dwrite d4/f3f [0,4194304] 0 2024-05-06T21:26:31.337 INFO:tasks.workunit.client.0.smithi032.stdout:0/193: read - d4/da/d14/d1a/f1c zero size 2024-05-06T21:26:31.337 INFO:tasks.workunit.client.0.smithi032.stdout:0/194: stat d4/f40 0 2024-05-06T21:26:31.337 INFO:tasks.workunit.client.0.smithi032.stdout:0/195: truncate d4/f40 328181 0 2024-05-06T21:26:31.341 INFO:tasks.workunit.client.0.smithi032.stdout:0/196: mkdir d4/d44 0 2024-05-06T21:26:31.342 INFO:tasks.workunit.client.0.smithi032.stdout:0/197: symlink d4/da/l45 0 2024-05-06T21:26:31.345 INFO:tasks.workunit.client.0.smithi032.stdout:0/198: mkdir d4/da/d16/d33/d46 0 2024-05-06T21:26:31.345 INFO:tasks.workunit.client.0.smithi032.stdout:0/199: read d4/da/f17 [721448,51383] 0 2024-05-06T21:26:31.347 INFO:tasks.workunit.client.0.smithi032.stdout:7/259: dwrite db/f29 [0,4194304] 0 2024-05-06T21:26:31.348 INFO:tasks.workunit.client.0.smithi032.stdout:5/42: write d0/f5 [3526515,111379] 0 2024-05-06T21:26:31.348 INFO:tasks.workunit.client.0.smithi032.stdout:5/43: fdatasync d0/f4 0 2024-05-06T21:26:31.348 INFO:tasks.workunit.client.0.smithi032.stdout:5/44: write d0/f5 [3575891,96238] 0 2024-05-06T21:26:31.349 INFO:tasks.workunit.client.0.smithi032.stdout:5/45: rename d0/f4 to d0/f8 0 2024-05-06T21:26:31.349 INFO:tasks.workunit.client.0.smithi032.stdout:5/46: chown d0/f5 6143823 1 2024-05-06T21:26:31.350 INFO:tasks.workunit.client.0.smithi032.stdout:5/47: mknod d0/c9 0 2024-05-06T21:26:31.355 INFO:tasks.workunit.client.0.smithi032.stdout:7/260: dread db/d12/d16/d21/f27 [0,4194304] 0 2024-05-06T21:26:31.356 INFO:tasks.workunit.client.0.smithi032.stdout:2/70: dwrite df/d14/f15 [0,4194304] 0 2024-05-06T21:26:31.356 INFO:tasks.workunit.client.0.smithi032.stdout:7/261: link db/l32 db/d12/d16/d21/d41/l52 0 2024-05-06T21:26:31.359 INFO:tasks.workunit.client.0.smithi032.stdout:0/200: dread d4/f6 [0,4194304] 0 2024-05-06T21:26:31.365 INFO:tasks.workunit.client.0.smithi032.stdout:5/48: dread d0/f3 [0,4194304] 0 2024-05-06T21:26:31.365 INFO:tasks.workunit.client.0.smithi032.stdout:5/49: write d0/f3 [3661085,37682] 0 2024-05-06T21:26:31.365 INFO:tasks.workunit.client.0.smithi032.stdout:5/50: write d0/f3 [3951746,52695] 0 2024-05-06T21:26:31.365 INFO:tasks.workunit.client.0.smithi032.stdout:7/262: rmdir db/d12/d16/d21/d41 39 2024-05-06T21:26:31.366 INFO:tasks.workunit.client.0.smithi032.stdout:0/201: truncate d4/da/f22 3678001 0 2024-05-06T21:26:31.366 INFO:tasks.workunit.client.0.smithi032.stdout:0/202: chown d4/da/f22 85714 1 2024-05-06T21:26:31.367 INFO:tasks.workunit.client.0.smithi032.stdout:2/71: rmdir df/d14 39 2024-05-06T21:26:31.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:30 smithi154 ceph-mon[32880]: pgmap v16: 65 pgs: 65 active+clean; 159 MiB data, 752 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s wr, 669 op/s 2024-05-06T21:26:31.370 INFO:tasks.workunit.client.0.smithi032.stdout:0/203: link d4/f7 d4/da/d14/f47 0 2024-05-06T21:26:31.371 INFO:tasks.workunit.client.0.smithi032.stdout:5/51: unlink d0/f8 0 2024-05-06T21:26:31.375 INFO:tasks.workunit.client.0.smithi032.stdout:2/72: getdents df 0 2024-05-06T21:26:31.376 INFO:tasks.workunit.client.0.smithi032.stdout:7/263: rename db/d13 to db/d12/d16/d2a/d53 0 2024-05-06T21:26:31.377 INFO:tasks.workunit.client.0.smithi032.stdout:7/264: stat db/d12/d16/f3f 0 2024-05-06T21:26:31.381 INFO:tasks.workunit.client.0.smithi032.stdout:0/204: rmdir d4/da/d14 39 2024-05-06T21:26:31.394 INFO:tasks.workunit.client.0.smithi032.stdout:5/52: dwrite d0/f5 [4194304,4194304] 0 2024-05-06T21:26:31.394 INFO:tasks.workunit.client.0.smithi032.stdout:5/53: write d0/f5 [229114,94607] 0 2024-05-06T21:26:31.404 INFO:tasks.workunit.client.0.smithi032.stdout:7/265: dwrite db/d12/d16/d2a/d53/f2c [0,4194304] 0 2024-05-06T21:26:31.404 INFO:tasks.workunit.client.0.smithi032.stdout:2/73: dwrite f7 [0,4194304] 0 2024-05-06T21:26:31.406 INFO:tasks.workunit.client.0.smithi032.stdout:0/205: dwrite d4/da/d14/d1a/f1b [0,4194304] 0 2024-05-06T21:26:31.406 INFO:tasks.workunit.client.0.smithi032.stdout:0/206: readlink d4/l3d 0 2024-05-06T21:26:31.406 INFO:tasks.workunit.client.0.smithi032.stdout:0/207: readlink d4/l10 0 2024-05-06T21:26:31.409 INFO:tasks.workunit.client.0.smithi032.stdout:7/266: getdents db 0 2024-05-06T21:26:31.409 INFO:tasks.workunit.client.0.smithi032.stdout:2/74: link c6 df/d14/c16 0 2024-05-06T21:26:31.414 INFO:tasks.workunit.client.0.smithi032.stdout:2/75: creat df/d14/f17 x:0 0 0 2024-05-06T21:26:31.414 INFO:tasks.workunit.client.0.smithi032.stdout:2/76: readlink df/l11 0 2024-05-06T21:26:31.414 INFO:tasks.workunit.client.0.smithi032.stdout:2/77: unlink cd 0 2024-05-06T21:26:31.418 INFO:tasks.workunit.client.0.smithi032.stdout:7/267: read f3 [796994,122351] 0 2024-05-06T21:26:31.420 INFO:tasks.workunit.client.0.smithi032.stdout:5/54: dwrite d0/f5 [4194304,4194304] 0 2024-05-06T21:26:31.421 INFO:tasks.workunit.client.0.smithi032.stdout:5/55: rename d0/f3 to d0/fa 0 2024-05-06T21:26:31.421 INFO:tasks.workunit.client.0.smithi032.stdout:0/208: dread d4/da/d16/f3b [0,4194304] 0 2024-05-06T21:26:31.424 INFO:tasks.workunit.client.0.smithi032.stdout:4/203: sync 2024-05-06T21:26:31.424 INFO:tasks.workunit.client.0.smithi032.stdout:8/135: sync 2024-05-06T21:26:31.424 INFO:tasks.workunit.client.0.smithi032.stdout:6/165: sync 2024-05-06T21:26:31.424 INFO:tasks.workunit.client.0.smithi032.stdout:3/127: sync 2024-05-06T21:26:31.424 INFO:tasks.workunit.client.0.smithi032.stdout:3/128: truncate d1/f6 8771297 0 2024-05-06T21:26:31.425 INFO:tasks.workunit.client.0.smithi032.stdout:6/166: creat d8/dd/f26 x:0 0 0 2024-05-06T21:26:31.425 INFO:tasks.workunit.client.0.smithi032.stdout:6/167: stat d8/dd/d18/d13 0 2024-05-06T21:26:31.425 INFO:tasks.workunit.client.0.smithi032.stdout:6/168: chown d8/dd/d18/lf 1676010 1 2024-05-06T21:26:31.425 INFO:tasks.workunit.client.0.smithi032.stdout:4/204: dread d2/f9 [0,4194304] 0 2024-05-06T21:26:31.426 INFO:tasks.workunit.client.0.smithi032.stdout:4/205: truncate d2/f10 6025072 0 2024-05-06T21:26:31.426 INFO:tasks.workunit.client.0.smithi032.stdout:4/206: truncate f1 12627883 0 2024-05-06T21:26:31.426 INFO:tasks.workunit.client.0.smithi032.stdout:7/268: dread db/d12/d16/f24 [0,4194304] 0 2024-05-06T21:26:31.427 INFO:tasks.workunit.client.0.smithi032.stdout:4/207: mkdir d2/d1e/d47 0 2024-05-06T21:26:31.428 INFO:tasks.workunit.client.0.smithi032.stdout:4/208: truncate d2/f7 843493 0 2024-05-06T21:26:31.431 INFO:tasks.workunit.client.0.smithi032.stdout:4/209: creat d2/d16/d44/d45/f48 x:0 0 0 2024-05-06T21:26:31.431 INFO:tasks.workunit.client.0.smithi032.stdout:5/56: dread d0/fa [4194304,4194304] 0 2024-05-06T21:26:31.431 INFO:tasks.workunit.client.0.smithi032.stdout:4/210: readlink d2/d13/l34 0 2024-05-06T21:26:31.431 INFO:tasks.workunit.client.0.smithi032.stdout:4/211: readlink d2/d1e/l40 0 2024-05-06T21:26:31.431 INFO:tasks.workunit.client.0.smithi032.stdout:5/57: chown d0/f5 1 1 2024-05-06T21:26:31.431 INFO:tasks.workunit.client.0.smithi032.stdout:4/212: fdatasync d2/fc 0 2024-05-06T21:26:31.432 INFO:tasks.workunit.client.0.smithi032.stdout:4/213: dread d2/d13/f1b [0,4194304] 0 2024-05-06T21:26:31.434 INFO:tasks.workunit.client.0.smithi032.stdout:5/58: creat d0/fb x:0 0 0 2024-05-06T21:26:31.434 INFO:tasks.workunit.client.0.smithi032.stdout:5/59: creat d0/fc x:0 0 0 2024-05-06T21:26:31.435 INFO:tasks.workunit.client.0.smithi032.stdout:2/78: dread df/d14/f15 [0,4194304] 0 2024-05-06T21:26:31.435 INFO:tasks.workunit.client.0.smithi032.stdout:2/79: truncate fe 258046 0 2024-05-06T21:26:31.437 INFO:tasks.workunit.client.0.smithi032.stdout:4/214: getdents d2 0 2024-05-06T21:26:31.437 INFO:tasks.workunit.client.0.smithi032.stdout:4/215: write d2/d16/d44/d45/f48 [424072,8781] 0 2024-05-06T21:26:31.439 INFO:tasks.workunit.client.0.smithi032.stdout:5/60: unlink d0/c9 0 2024-05-06T21:26:31.443 INFO:tasks.workunit.client.0.smithi032.stdout:4/216: creat d2/d2c/f49 x:0 0 0 2024-05-06T21:26:31.445 INFO:tasks.workunit.client.0.smithi032.stdout:2/80: unlink l4 0 2024-05-06T21:26:31.445 INFO:tasks.workunit.client.0.smithi032.stdout:2/81: dread - df/d14/f17 zero size 2024-05-06T21:26:31.446 INFO:tasks.workunit.client.0.smithi032.stdout:6/169: read d8/dd/d18/f11 [319788,68740] 0 2024-05-06T21:26:31.446 INFO:tasks.workunit.client.0.smithi032.stdout:6/170: write d8/dd/f1a [4193441,103576] 0 2024-05-06T21:26:31.449 INFO:tasks.workunit.client.0.smithi032.stdout:6/171: unlink d8/dd/f1a 0 2024-05-06T21:26:31.451 INFO:tasks.workunit.client.0.smithi032.stdout:6/172: mknod d8/dd/d18/d13/c27 0 2024-05-06T21:26:31.454 INFO:tasks.workunit.client.0.smithi032.stdout:6/173: creat d8/dd/d18/d13/f28 x:0 0 0 2024-05-06T21:26:31.457 INFO:tasks.workunit.client.0.smithi032.stdout:6/174: rename d8/dd/d18/f11 to d8/dd/d18/d22/f29 0 2024-05-06T21:26:31.457 INFO:tasks.workunit.client.0.smithi032.stdout:6/175: truncate d8/dd/d18/d22/f29 1398491 0 2024-05-06T21:26:31.463 INFO:tasks.workunit.client.0.smithi032.stdout:4/217: dread d2/f24 [0,4194304] 0 2024-05-06T21:26:31.463 INFO:tasks.workunit.client.0.smithi032.stdout:4/218: chown d2/d16/c3d 656146 1 2024-05-06T21:26:31.463 INFO:tasks.workunit.client.0.smithi032.stdout:4/219: mknod d2/d16/c4a 0 2024-05-06T21:26:31.468 INFO:tasks.workunit.client.0.smithi032.stdout:8/136: dwrite d0/f16 [0,4194304] 0 2024-05-06T21:26:31.469 INFO:tasks.workunit.client.0.smithi032.stdout:7/269: dwrite db/f10 [0,4194304] 0 2024-05-06T21:26:31.471 INFO:tasks.workunit.client.0.smithi032.stdout:8/137: mkdir d0/d1b/d25 0 2024-05-06T21:26:31.473 INFO:tasks.workunit.client.0.smithi032.stdout:8/138: read d0/fe [201590,4387] 0 2024-05-06T21:26:31.473 INFO:tasks.workunit.client.0.smithi032.stdout:8/139: dread - d0/d1b/f23 zero size 2024-05-06T21:26:31.473 INFO:tasks.workunit.client.0.smithi032.stdout:8/140: chown d0/l15 70 1 2024-05-06T21:26:31.476 INFO:tasks.workunit.client.0.smithi032.stdout:8/141: rename d0/f11 to d0/d1c/f26 0 2024-05-06T21:26:31.481 INFO:tasks.workunit.client.0.smithi032.stdout:6/176: rmdir d8 39 2024-05-06T21:26:31.487 INFO:tasks.workunit.client.0.smithi032.stdout:7/270: dwrite db/d12/f30 [0,4194304] 0 2024-05-06T21:26:31.502 INFO:tasks.workunit.client.0.smithi032.stdout:8/142: dwrite d0/d1b/f23 [0,4194304] 0 2024-05-06T21:26:31.502 INFO:tasks.workunit.client.0.smithi032.stdout:6/177: dwrite d8/dd/d18/d22/f29 [0,4194304] 0 2024-05-06T21:26:31.504 INFO:tasks.workunit.client.0.smithi032.stdout:8/143: truncate d0/f5 205082 0 2024-05-06T21:26:31.567 INFO:tasks.workunit.client.0.smithi032.stdout:4/220: dread d2/fb [0,4194304] 0 2024-05-06T21:26:31.571 INFO:tasks.workunit.client.0.smithi032.stdout:0/209: dwrite d4/da/d16/f43 [0,4194304] 0 2024-05-06T21:26:31.574 INFO:tasks.workunit.client.0.smithi032.stdout:0/210: mknod d4/d3e/d42/c48 0 2024-05-06T21:26:31.577 INFO:tasks.workunit.client.0.smithi032.stdout:0/211: rename d4/f40 to d4/d3e/f49 0 2024-05-06T21:26:31.577 INFO:tasks.workunit.client.0.smithi032.stdout:6/178: dwrite d8/dd/d1b/f20 [0,4194304] 0 2024-05-06T21:26:31.578 INFO:tasks.workunit.client.0.smithi032.stdout:8/144: dwrite d0/d1c/f26 [0,4194304] 0 2024-05-06T21:26:31.578 INFO:tasks.workunit.client.0.smithi032.stdout:8/145: creat d0/f27 x:0 0 0 2024-05-06T21:26:31.578 INFO:tasks.workunit.client.0.smithi032.stdout:8/146: readlink d0/l18 0 2024-05-06T21:26:31.578 INFO:tasks.workunit.client.0.smithi032.stdout:8/147: write d0/f1f [351772,1007] 0 2024-05-06T21:26:31.578 INFO:tasks.workunit.client.0.smithi032.stdout:0/212: rmdir d4/da/d14/d1a 39 2024-05-06T21:26:31.578 INFO:tasks.workunit.client.0.smithi032.stdout:0/213: dread - d4/f24 zero size 2024-05-06T21:26:31.582 INFO:tasks.workunit.client.0.smithi032.stdout:2/82: dwrite df/d14/f15 [0,4194304] 0 2024-05-06T21:26:31.584 INFO:tasks.workunit.client.0.smithi032.stdout:4/221: dwrite d2/d16/d44/d45/f48 [0,4194304] 0 2024-05-06T21:26:31.584 INFO:tasks.workunit.client.0.smithi032.stdout:4/222: readlink d2/d2c/d30/l3a 0 2024-05-06T21:26:31.589 INFO:tasks.workunit.client.0.smithi032.stdout:6/179: dread d8/f10 [0,4194304] 0 2024-05-06T21:26:31.591 INFO:tasks.workunit.client.0.smithi032.stdout:6/180: creat d8/dd/d18/d13/f2a x:0 0 0 2024-05-06T21:26:31.593 INFO:tasks.workunit.client.0.smithi032.stdout:4/223: write d2/d16/d44/d45/f48 [3952744,126514] 0 2024-05-06T21:26:31.594 INFO:tasks.workunit.client.0.smithi032.stdout:4/224: truncate d2/f24 2586056 0 2024-05-06T21:26:31.594 INFO:tasks.workunit.client.0.smithi032.stdout:4/225: readlink d2/d1e/l40 0 2024-05-06T21:26:31.596 INFO:tasks.workunit.client.0.smithi032.stdout:9/117: sync 2024-05-06T21:26:31.596 INFO:tasks.workunit.client.0.smithi032.stdout:9/118: fdatasync d1/d13/f1f 0 2024-05-06T21:26:31.596 INFO:tasks.workunit.client.0.smithi032.stdout:9/119: chown d1/d13/l15 13 1 2024-05-06T21:26:31.596 INFO:tasks.workunit.client.0.smithi032.stdout:9/120: write d1/f18 [926582,130085] 0 2024-05-06T21:26:31.598 INFO:tasks.workunit.client.0.smithi032.stdout:6/181: dread d8/f10 [4194304,4194304] 0 2024-05-06T21:26:31.598 INFO:tasks.workunit.client.0.smithi032.stdout:6/182: write d8/dd/d18/d13/f2a [1006925,4393] 0 2024-05-06T21:26:31.599 INFO:tasks.workunit.client.0.smithi032.stdout:4/226: dread d2/d1e/f22 [0,4194304] 0 2024-05-06T21:26:31.601 INFO:tasks.workunit.client.0.smithi032.stdout:4/227: rename d2/d1e/c3b to d2/d13/c4b 0 2024-05-06T21:26:31.603 INFO:tasks.workunit.client.0.smithi032.stdout:4/228: unlink d2/f7 0 2024-05-06T21:26:31.603 INFO:tasks.workunit.client.0.smithi032.stdout:4/229: rmdir d2/d2c/d30 39 2024-05-06T21:26:31.604 INFO:tasks.workunit.client.0.smithi032.stdout:4/230: creat d2/d1e/f4c x:0 0 0 2024-05-06T21:26:31.604 INFO:tasks.workunit.client.0.smithi032.stdout:4/231: readlink d2/d1e/l43 0 2024-05-06T21:26:31.604 INFO:tasks.workunit.client.0.smithi032.stdout:4/232: chown d2/d13/c3e 223612081 1 2024-05-06T21:26:31.613 INFO:tasks.workunit.client.0.smithi032.stdout:9/121: write d1/d13/f16 [1864720,81675] 0 2024-05-06T21:26:31.616 INFO:tasks.workunit.client.0.smithi032.stdout:9/122: read d1/d13/f1e [1489159,62188] 0 2024-05-06T21:26:31.617 INFO:tasks.workunit.client.0.smithi032.stdout:2/83: dwrite df/d14/f17 [0,4194304] 0 2024-05-06T21:26:31.619 INFO:tasks.workunit.client.0.smithi032.stdout:2/84: readlink l8 0 2024-05-06T21:26:31.620 INFO:tasks.workunit.client.0.smithi032.stdout:2/85: chown df/l11 3 1 2024-05-06T21:26:31.620 INFO:tasks.workunit.client.0.smithi032.stdout:0/214: dwrite d4/f3f [0,4194304] 0 2024-05-06T21:26:31.621 INFO:tasks.workunit.client.0.smithi032.stdout:2/86: unlink l8 0 2024-05-06T21:26:31.622 INFO:tasks.workunit.client.0.smithi032.stdout:2/87: chown c6 530 1 2024-05-06T21:26:31.622 INFO:tasks.workunit.client.0.smithi032.stdout:2/88: chown df/c13 25 1 2024-05-06T21:26:31.622 INFO:tasks.workunit.client.0.smithi032.stdout:2/89: chown df/l11 3528221 1 2024-05-06T21:26:31.629 INFO:tasks.workunit.client.0.smithi032.stdout:4/233: dwrite d2/d1e/f28 [0,4194304] 0 2024-05-06T21:26:31.637 INFO:tasks.workunit.client.0.smithi032.stdout:4/234: dread d2/d16/f2e [0,4194304] 0 2024-05-06T21:26:31.646 INFO:tasks.workunit.client.0.smithi032.stdout:9/123: dwrite d1/d13/f1f [0,4194304] 0 2024-05-06T21:26:31.646 INFO:tasks.workunit.client.0.smithi032.stdout:9/124: chown d1/d13/l21 66473772 1 2024-05-06T21:26:31.646 INFO:tasks.workunit.client.0.smithi032.stdout:4/235: dread d2/f35 [0,4194304] 0 2024-05-06T21:26:31.646 INFO:tasks.workunit.client.0.smithi032.stdout:4/236: write d2/fc [5101887,37689] 0 2024-05-06T21:26:31.648 INFO:tasks.workunit.client.0.smithi032.stdout:4/237: symlink d2/d16/l4d 0 2024-05-06T21:26:31.648 INFO:tasks.workunit.client.0.smithi032.stdout:4/238: write d2/d1e/f22 [1535031,75933] 0 2024-05-06T21:26:31.649 INFO:tasks.workunit.client.0.smithi032.stdout:9/125: getdents d1 0 2024-05-06T21:26:31.651 INFO:tasks.workunit.client.0.smithi032.stdout:4/239: write d2/f11 [732151,52958] 0 2024-05-06T21:26:31.651 INFO:tasks.workunit.client.0.smithi032.stdout:9/126: write d1/f9 [238591,118372] 0 2024-05-06T21:26:31.651 INFO:tasks.workunit.client.0.smithi032.stdout:2/90: dwrite df/f12 [0,4194304] 0 2024-05-06T21:26:31.652 INFO:tasks.workunit.client.0.smithi032.stdout:0/215: dwrite d4/da/d14/d1a/f1e [4194304,4194304] 0 2024-05-06T21:26:31.653 INFO:tasks.workunit.client.0.smithi032.stdout:4/240: mkdir d2/d16/d44/d45/d4e 0 2024-05-06T21:26:31.655 INFO:tasks.workunit.client.0.smithi032.stdout:2/91: creat df/d14/f18 x:0 0 0 2024-05-06T21:26:31.655 INFO:tasks.workunit.client.0.smithi032.stdout:9/127: truncate d1/f10 3881870 0 2024-05-06T21:26:31.660 INFO:tasks.workunit.client.0.smithi032.stdout:0/216: rename d4/d44 to d4/da/d14/d4a 0 2024-05-06T21:26:31.661 INFO:tasks.workunit.client.0.smithi032.stdout:4/241: unlink d2/d2c/l2d 0 2024-05-06T21:26:31.662 INFO:tasks.workunit.client.0.smithi032.stdout:2/92: mkdir df/d19 0 2024-05-06T21:26:31.664 INFO:tasks.workunit.client.0.smithi032.stdout:9/128: link d1/d13/f1e d1/f23 0 2024-05-06T21:26:31.664 INFO:tasks.workunit.client.0.smithi032.stdout:1/212: sync 2024-05-06T21:26:31.665 INFO:tasks.workunit.client.0.smithi032.stdout:0/217: mknod d4/d3e/d42/c4b 0 2024-05-06T21:26:31.671 INFO:tasks.workunit.client.0.smithi032.stdout:2/93: link df/f12 df/f1a 0 2024-05-06T21:26:31.675 INFO:tasks.workunit.client.0.smithi032.stdout:0/218: symlink d4/da/d14/d1a/l4c 0 2024-05-06T21:26:31.675 INFO:tasks.workunit.client.0.smithi032.stdout:0/219: truncate d4/f24 873800 0 2024-05-06T21:26:31.676 INFO:tasks.workunit.client.0.smithi032.stdout:9/129: fsync d1/d13/f1e 0 2024-05-06T21:26:31.677 INFO:tasks.workunit.client.0.smithi032.stdout:1/213: getdents db/d37 0 2024-05-06T21:26:31.678 INFO:tasks.workunit.client.0.smithi032.stdout:2/94: link ca df/c1b 0 2024-05-06T21:26:31.679 INFO:tasks.workunit.client.0.smithi032.stdout:9/130: mknod d1/d13/c24 0 2024-05-06T21:26:31.679 INFO:tasks.workunit.client.0.smithi032.stdout:9/131: fdatasync d1/fe 0 2024-05-06T21:26:31.679 INFO:tasks.workunit.client.0.smithi032.stdout:9/132: chown d1/cf 18201 1 2024-05-06T21:26:31.681 INFO:tasks.workunit.client.0.smithi032.stdout:4/242: dwrite d2/fb [0,4194304] 0 2024-05-06T21:26:31.681 INFO:tasks.workunit.client.0.smithi032.stdout:4/243: chown d2/c4 952194 1 2024-05-06T21:26:31.681 INFO:tasks.workunit.client.0.smithi032.stdout:2/95: creat df/f1c x:0 0 0 2024-05-06T21:26:31.681 INFO:tasks.workunit.client.0.smithi032.stdout:2/96: creat df/d14/f1d x:0 0 0 2024-05-06T21:26:31.683 INFO:tasks.workunit.client.0.smithi032.stdout:9/133: mkdir d1/d13/d25 0 2024-05-06T21:26:31.683 INFO:tasks.workunit.client.0.smithi032.stdout:0/220: write d4/da/f31 [2629681,62230] 0 2024-05-06T21:26:31.685 INFO:tasks.workunit.client.0.smithi032.stdout:1/214: link db/f29 db/d16/f41 0 2024-05-06T21:26:31.689 INFO:tasks.workunit.client.0.smithi032.stdout:4/244: mknod d2/c4f 0 2024-05-06T21:26:31.690 INFO:tasks.workunit.client.0.smithi032.stdout:9/134: truncate d1/d13/f1f 2784303 0 2024-05-06T21:26:31.690 INFO:tasks.workunit.client.0.smithi032.stdout:9/135: truncate d1/f9 1170034 0 2024-05-06T21:26:31.693 INFO:tasks.workunit.client.0.smithi032.stdout:1/215: link db/c3f db/d37/c42 0 2024-05-06T21:26:31.693 INFO:tasks.workunit.client.0.smithi032.stdout:1/216: fsync db/d16/f40 0 2024-05-06T21:26:31.695 INFO:tasks.workunit.client.0.smithi032.stdout:4/245: rename d2/d1e/l26 to d2/d16/d44/d45/l50 0 2024-05-06T21:26:31.695 INFO:tasks.workunit.client.0.smithi032.stdout:4/246: fsync d2/f11 0 2024-05-06T21:26:31.696 INFO:tasks.workunit.client.0.smithi032.stdout:1/217: creat db/f43 x:0 0 0 2024-05-06T21:26:31.698 INFO:tasks.workunit.client.0.smithi032.stdout:4/247: truncate d2/f18 3699638 0 2024-05-06T21:26:31.701 INFO:tasks.workunit.client.0.smithi032.stdout:4/248: symlink d2/d2c/d30/l51 0 2024-05-06T21:26:31.702 INFO:tasks.workunit.client.0.smithi032.stdout:1/218: rename db/d16/c17 to db/d2a/c44 0 2024-05-06T21:26:31.703 INFO:tasks.workunit.client.0.smithi032.stdout:4/249: link d2/f9 d2/d16/f52 0 2024-05-06T21:26:31.704 INFO:tasks.workunit.client.0.smithi032.stdout:2/97: dwrite df/f12 [0,4194304] 0 2024-05-06T21:26:31.704 INFO:tasks.workunit.client.0.smithi032.stdout:2/98: fsync df/d14/f17 0 2024-05-06T21:26:31.705 INFO:tasks.workunit.client.0.smithi032.stdout:4/250: creat d2/f53 x:0 0 0 2024-05-06T21:26:31.705 INFO:tasks.workunit.client.0.smithi032.stdout:2/99: readlink l9 0 2024-05-06T21:26:31.706 INFO:tasks.workunit.client.0.smithi032.stdout:4/251: mkdir d2/d16/d44/d54 0 2024-05-06T21:26:31.708 INFO:tasks.workunit.client.0.smithi032.stdout:4/252: symlink d2/d2c/d31/l55 0 2024-05-06T21:26:31.709 INFO:tasks.workunit.client.0.smithi032.stdout:1/219: write db/f2e [1489190,71449] 0 2024-05-06T21:26:31.710 INFO:tasks.workunit.client.0.smithi032.stdout:4/253: unlink d2/d16/l4d 0 2024-05-06T21:26:31.714 INFO:tasks.workunit.client.0.smithi032.stdout:4/254: creat d2/d13/f56 x:0 0 0 2024-05-06T21:26:31.714 INFO:tasks.workunit.client.0.smithi032.stdout:4/255: creat d2/d13/f57 x:0 0 0 2024-05-06T21:26:31.714 INFO:tasks.workunit.client.0.smithi032.stdout:4/256: chown d2/d13/l15 2451109 1 2024-05-06T21:26:31.714 INFO:tasks.workunit.client.0.smithi032.stdout:4/257: fdatasync d2/d1e/f21 0 2024-05-06T21:26:31.715 INFO:tasks.workunit.client.0.smithi032.stdout:4/258: symlink d2/d1e/l58 0 2024-05-06T21:26:31.716 INFO:tasks.workunit.client.0.smithi032.stdout:4/259: mknod d2/d1e/d47/c59 0 2024-05-06T21:26:31.716 INFO:tasks.workunit.client.0.smithi032.stdout:4/260: dread - d2/d2c/f49 zero size 2024-05-06T21:26:31.717 INFO:tasks.workunit.client.0.smithi032.stdout:4/261: chown d2/d16 963 1 2024-05-06T21:26:31.717 INFO:tasks.workunit.client.0.smithi032.stdout:4/262: creat d2/d2c/d31/f5a x:0 0 0 2024-05-06T21:26:31.768 INFO:tasks.workunit.client.0.smithi032.stdout:9/136: dwrite d1/f7 [0,4194304] 0 2024-05-06T21:26:31.772 INFO:tasks.workunit.client.0.smithi032.stdout:2/100: dread df/d14/f17 [0,4194304] 0 2024-05-06T21:26:31.773 INFO:tasks.workunit.client.0.smithi032.stdout:9/137: mkdir d1/d13/d20/d26 0 2024-05-06T21:26:31.773 INFO:tasks.workunit.client.0.smithi032.stdout:9/138: stat d1/c1d 0 2024-05-06T21:26:31.773 INFO:tasks.workunit.client.0.smithi032.stdout:9/139: fdatasync d1/f12 0 2024-05-06T21:26:31.773 INFO:tasks.workunit.client.0.smithi032.stdout:4/263: dread d2/d1e/f22 [0,4194304] 0 2024-05-06T21:26:31.776 INFO:tasks.workunit.client.0.smithi032.stdout:2/101: mkdir df/d19/d1e 0 2024-05-06T21:26:31.776 INFO:tasks.workunit.client.0.smithi032.stdout:9/140: creat d1/d13/d20/d26/f27 x:0 0 0 2024-05-06T21:26:31.777 INFO:tasks.workunit.client.0.smithi032.stdout:2/102: mkdir df/d19/d1e/d1f 0 2024-05-06T21:26:31.779 INFO:tasks.workunit.client.0.smithi032.stdout:9/141: symlink d1/d13/l28 0 2024-05-06T21:26:31.779 INFO:tasks.workunit.client.0.smithi032.stdout:9/142: creat d1/d13/d20/d26/f29 x:0 0 0 2024-05-06T21:26:31.779 INFO:tasks.workunit.client.0.smithi032.stdout:1/220: dwrite db/d2a/f2d [0,4194304] 0 2024-05-06T21:26:31.785 INFO:tasks.workunit.client.0.smithi032.stdout:9/143: link d1/d13/d20/d26/f29 d1/d13/f2a 0 2024-05-06T21:26:31.791 INFO:tasks.workunit.client.0.smithi032.stdout:1/221: dread db/f10 [0,4194304] 0 2024-05-06T21:26:31.791 INFO:tasks.workunit.client.0.smithi032.stdout:1/222: write db/f20 [1122990,70050] 0 2024-05-06T21:26:31.794 INFO:tasks.workunit.client.0.smithi032.stdout:1/223: rmdir db 39 2024-05-06T21:26:31.795 INFO:tasks.workunit.client.0.smithi032.stdout:1/224: write db/f20 [1276955,118317] 0 2024-05-06T21:26:31.796 INFO:tasks.workunit.client.0.smithi032.stdout:1/225: mknod db/d37/c45 0 2024-05-06T21:26:31.796 INFO:tasks.workunit.client.0.smithi032.stdout:1/226: fdatasync db/d16/f32 0 2024-05-06T21:26:31.796 INFO:tasks.workunit.client.0.smithi032.stdout:1/227: chown db/f43 1039347 1 2024-05-06T21:26:31.797 INFO:tasks.workunit.client.0.smithi032.stdout:1/228: getdents db/d16 0 2024-05-06T21:26:31.798 INFO:tasks.workunit.client.0.smithi032.stdout:1/229: mkdir db/d16/d46 0 2024-05-06T21:26:31.800 INFO:tasks.workunit.client.0.smithi032.stdout:1/230: mkdir db/d47 0 2024-05-06T21:26:31.801 INFO:tasks.workunit.client.0.smithi032.stdout:1/231: write db/d16/f1e [5721855,6641] 0 2024-05-06T21:26:31.802 INFO:tasks.workunit.client.0.smithi032.stdout:2/103: getdents df/d19/d1e 0 2024-05-06T21:26:31.802 INFO:tasks.workunit.client.0.smithi032.stdout:1/232: dread db/d2a/f2f [0,4194304] 0 2024-05-06T21:26:31.806 INFO:tasks.workunit.client.0.smithi032.stdout:9/144: rename d1/d13/d20 to d1/d13/d25/d2b 0 2024-05-06T21:26:31.808 INFO:tasks.workunit.client.0.smithi032.stdout:9/145: rename d1/d13/l15 to d1/l2c 0 2024-05-06T21:26:31.810 INFO:tasks.workunit.client.0.smithi032.stdout:9/146: link d1/d13/c24 d1/d13/c2d 0 2024-05-06T21:26:31.810 INFO:tasks.workunit.client.0.smithi032.stdout:2/104: dread df/d14/f17 [0,4194304] 0 2024-05-06T21:26:31.811 INFO:tasks.workunit.client.0.smithi032.stdout:1/233: write db/f10 [3531897,89526] 0 2024-05-06T21:26:31.813 INFO:tasks.workunit.client.0.smithi032.stdout:1/234: fsync db/f10 0 2024-05-06T21:26:31.814 INFO:tasks.workunit.client.0.smithi032.stdout:9/147: rmdir d1/d13/d25/d2b 39 2024-05-06T21:26:31.816 INFO:tasks.workunit.client.0.smithi032.stdout:1/235: symlink db/d2a/l48 0 2024-05-06T21:26:31.818 INFO:tasks.workunit.client.0.smithi032.stdout:9/148: getdents d1 0 2024-05-06T21:26:31.818 INFO:tasks.workunit.client.0.smithi032.stdout:9/149: creat d1/d13/d25/f2e x:0 0 0 2024-05-06T21:26:31.819 INFO:tasks.workunit.client.0.smithi032.stdout:9/150: mkdir d1/d2f 0 2024-05-06T21:26:31.819 INFO:tasks.workunit.client.0.smithi032.stdout:9/151: stat d1/d13/d25 0 2024-05-06T21:26:31.820 INFO:tasks.workunit.client.0.smithi032.stdout:2/105: write f7 [3093252,107262] 0 2024-05-06T21:26:31.820 INFO:tasks.workunit.client.0.smithi032.stdout:2/106: write df/f10 [257855,4518] 0 2024-05-06T21:26:31.820 INFO:tasks.workunit.client.0.smithi032.stdout:9/152: rmdir d1/d13/d25/d2b 39 2024-05-06T21:26:31.822 INFO:tasks.workunit.client.0.smithi032.stdout:2/107: truncate f2 121784 0 2024-05-06T21:26:31.825 INFO:tasks.workunit.client.0.smithi032.stdout:1/236: dread db/d2a/f2d [0,4194304] 0 2024-05-06T21:26:31.831 INFO:tasks.workunit.client.0.smithi032.stdout:1/237: rename db/d16/f41 to db/d2a/f49 0 2024-05-06T21:26:31.831 INFO:tasks.workunit.client.0.smithi032.stdout:1/238: fsync db/f43 0 2024-05-06T21:26:31.831 INFO:tasks.workunit.client.0.smithi032.stdout:1/239: chown db/f12 15714101 1 2024-05-06T21:26:31.837 INFO:tasks.workunit.client.0.smithi032.stdout:3/129: sync 2024-05-06T21:26:31.837 INFO:tasks.workunit.client.0.smithi032.stdout:3/130: readlink d1/d4/d11/l1a 0 2024-05-06T21:26:31.837 INFO:tasks.workunit.client.0.smithi032.stdout:3/131: fdatasync d1/d4/d11/f2b 0 2024-05-06T21:26:31.837 INFO:tasks.workunit.client.0.smithi032.stdout:3/132: write d1/f6 [3962127,106096] 0 2024-05-06T21:26:31.838 INFO:tasks.workunit.client.0.smithi032.stdout:3/133: symlink d1/d4/da/l2d 0 2024-05-06T21:26:31.840 INFO:tasks.workunit.client.0.smithi032.stdout:9/153: dwrite d1/d13/f16 [4194304,4194304] 0 2024-05-06T21:26:31.840 INFO:tasks.workunit.client.0.smithi032.stdout:3/134: unlink d1/d4/da/f1c 0 2024-05-06T21:26:31.842 INFO:tasks.workunit.client.0.smithi032.stdout:9/154: mknod d1/d13/d25/d2b/c30 0 2024-05-06T21:26:31.842 INFO:tasks.workunit.client.0.smithi032.stdout:9/155: read d1/d13/f16 [3368740,27372] 0 2024-05-06T21:26:31.844 INFO:tasks.workunit.client.0.smithi032.stdout:3/135: creat d1/d4/f2e x:0 0 0 2024-05-06T21:26:31.845 INFO:tasks.workunit.client.0.smithi032.stdout:1/240: dread db/f27 [0,4194304] 0 2024-05-06T21:26:31.846 INFO:tasks.workunit.client.0.smithi032.stdout:9/156: link d1/f7 d1/f31 0 2024-05-06T21:26:31.847 INFO:tasks.workunit.client.0.smithi032.stdout:9/157: dread d1/fe [0,4194304] 0 2024-05-06T21:26:31.847 INFO:tasks.workunit.client.0.smithi032.stdout:9/158: truncate d1/d13/d25/d2b/d26/f27 856121 0 2024-05-06T21:26:31.848 INFO:tasks.workunit.client.0.smithi032.stdout:3/136: rename f0 to d1/d4/da/f2f 0 2024-05-06T21:26:31.849 INFO:tasks.workunit.client.0.smithi032.stdout:3/137: write d1/d4/d11/f2b [10835,98618] 0 2024-05-06T21:26:31.849 INFO:tasks.workunit.client.0.smithi032.stdout:3/138: fsync d1/d4/da/d1d/f24 0 2024-05-06T21:26:31.850 INFO:tasks.workunit.client.0.smithi032.stdout:1/241: mkdir db/d47/d4a 0 2024-05-06T21:26:31.851 INFO:tasks.workunit.client.0.smithi032.stdout:9/159: creat d1/d13/d25/d2b/f32 x:0 0 0 2024-05-06T21:26:31.854 INFO:tasks.workunit.client.0.smithi032.stdout:3/139: unlink d1/d4/da/d1d/f27 0 2024-05-06T21:26:31.855 INFO:tasks.workunit.client.0.smithi032.stdout:1/242: creat db/d37/f4b x:0 0 0 2024-05-06T21:26:31.858 INFO:tasks.workunit.client.0.smithi032.stdout:1/243: dread db/f20 [0,4194304] 0 2024-05-06T21:26:31.864 INFO:tasks.workunit.client.0.smithi032.stdout:3/140: dread d1/d4/da/f2f [4194304,4194304] 0 2024-05-06T21:26:31.865 INFO:tasks.workunit.client.0.smithi032.stdout:3/141: truncate d1/fb 1576558 0 2024-05-06T21:26:31.867 INFO:tasks.workunit.client.0.smithi032.stdout:1/244: write db/f23 [119709,61395] 0 2024-05-06T21:26:31.868 INFO:tasks.workunit.client.0.smithi032.stdout:9/160: dwrite d1/f9 [0,4194304] 0 2024-05-06T21:26:31.869 INFO:tasks.workunit.client.0.smithi032.stdout:1/245: rename db/f14 to db/f4c 0 2024-05-06T21:26:31.869 INFO:tasks.workunit.client.0.smithi032.stdout:1/246: chown db/d2a/f2d 364982343 1 2024-05-06T21:26:31.870 INFO:tasks.workunit.client.0.smithi032.stdout:1/247: rename db/d37/f3e to db/d2a/f4d 0 2024-05-06T21:26:31.873 INFO:tasks.workunit.client.0.smithi032.stdout:3/142: write d1/f14 [6709051,121739] 0 2024-05-06T21:26:31.873 INFO:tasks.workunit.client.0.smithi032.stdout:3/143: readlink d1/d4/d11/l1a 0 2024-05-06T21:26:31.873 INFO:tasks.workunit.client.0.smithi032.stdout:3/144: truncate d1/d4/da/d1d/f24 5102029 0 2024-05-06T21:26:31.877 INFO:tasks.workunit.client.0.smithi032.stdout:9/161: dread d1/f10 [0,4194304] 0 2024-05-06T21:26:31.879 INFO:tasks.workunit.client.0.smithi032.stdout:9/162: mkdir d1/d13/d33 0 2024-05-06T21:26:31.885 INFO:tasks.workunit.client.0.smithi032.stdout:9/163: rename d1/d13/d25/d2b to d1/d13/d34 0 2024-05-06T21:26:31.888 INFO:tasks.workunit.client.0.smithi032.stdout:1/248: dwrite db/d16/f40 [0,4194304] 0 2024-05-06T21:26:31.909 INFO:tasks.workunit.client.0.smithi032.stdout:9/164: dwrite d1/d13/f1f [0,4194304] 0 2024-05-06T21:26:31.909 INFO:tasks.workunit.client.0.smithi032.stdout:1/249: dwrite db/d16/f2c [0,4194304] 0 2024-05-06T21:26:31.909 INFO:tasks.workunit.client.0.smithi032.stdout:9/165: write d1/d13/d34/d26/f27 [1454711,26120] 0 2024-05-06T21:26:31.910 INFO:tasks.workunit.client.0.smithi032.stdout:9/166: creat d1/d13/d25/f35 x:0 0 0 2024-05-06T21:26:31.913 INFO:tasks.workunit.client.0.smithi032.stdout:1/250: creat db/d16/d46/f4e x:0 0 0 2024-05-06T21:26:31.913 INFO:tasks.workunit.client.0.smithi032.stdout:1/251: readlink db/l28 0 2024-05-06T21:26:31.913 INFO:tasks.workunit.client.0.smithi032.stdout:1/252: chown db/d37 7062 1 2024-05-06T21:26:31.913 INFO:tasks.workunit.client.0.smithi032.stdout:1/253: read db/f23 [2671725,39493] 0 2024-05-06T21:26:31.914 INFO:tasks.workunit.client.0.smithi032.stdout:1/254: mkdir db/d2a/d4f 0 2024-05-06T21:26:31.914 INFO:tasks.workunit.client.0.smithi032.stdout:1/255: fsync db/d2a/f49 0 2024-05-06T21:26:31.920 INFO:tasks.workunit.client.0.smithi032.stdout:7/271: sync 2024-05-06T21:26:31.920 INFO:tasks.workunit.client.0.smithi032.stdout:5/61: sync 2024-05-06T21:26:31.920 INFO:tasks.workunit.client.0.smithi032.stdout:7/272: chown db/d12/d16/d2a/d39/d3b 0 1 2024-05-06T21:26:31.921 INFO:tasks.workunit.client.0.smithi032.stdout:5/62: getdents d0 0 2024-05-06T21:26:31.922 INFO:tasks.workunit.client.0.smithi032.stdout:1/256: getdents db/d2a 0 2024-05-06T21:26:31.923 INFO:tasks.workunit.client.0.smithi032.stdout:5/63: symlink d0/ld 0 2024-05-06T21:26:31.923 INFO:tasks.workunit.client.0.smithi032.stdout:9/167: dwrite d1/d13/d34/d26/f29 [0,4194304] 0 2024-05-06T21:26:31.925 INFO:tasks.workunit.client.0.smithi032.stdout:1/257: creat db/d2a/f50 x:0 0 0 2024-05-06T21:26:31.930 INFO:tasks.workunit.client.0.smithi032.stdout:5/64: link d0/fc d0/fe 0 2024-05-06T21:26:31.932 INFO:tasks.workunit.client.0.smithi032.stdout:1/258: getdents db/d2a 0 2024-05-06T21:26:31.933 INFO:tasks.workunit.client.0.smithi032.stdout:1/259: dread f9 [0,4194304] 0 2024-05-06T21:26:31.934 INFO:tasks.workunit.client.0.smithi032.stdout:1/260: write db/f12 [2189526,69397] 0 2024-05-06T21:26:31.934 INFO:tasks.workunit.client.0.smithi032.stdout:5/65: getdents d0 0 2024-05-06T21:26:31.935 INFO:tasks.workunit.client.0.smithi032.stdout:5/66: truncate d0/fb 260140 0 2024-05-06T21:26:31.935 INFO:tasks.workunit.client.0.smithi032.stdout:5/67: chown d0/ld 619124379 1 2024-05-06T21:26:31.935 INFO:tasks.workunit.client.0.smithi032.stdout:5/68: dread d0/fb [0,4194304] 0 2024-05-06T21:26:31.936 INFO:tasks.workunit.client.0.smithi032.stdout:5/69: mknod d0/cf 0 2024-05-06T21:26:31.940 INFO:tasks.workunit.client.0.smithi032.stdout:5/70: read d0/f5 [8135145,3253] 0 2024-05-06T21:26:31.944 INFO:tasks.workunit.client.0.smithi032.stdout:9/168: dwrite d1/d13/d34/d26/f27 [0,4194304] 0 2024-05-06T21:26:31.944 INFO:tasks.workunit.client.0.smithi032.stdout:9/169: read d1/f12 [3868913,112448] 0 2024-05-06T21:26:31.953 INFO:tasks.workunit.client.0.smithi032.stdout:9/170: dread d1/f9 [0,4194304] 0 2024-05-06T21:26:31.954 INFO:tasks.workunit.client.0.smithi032.stdout:9/171: rmdir d1 39 2024-05-06T21:26:31.954 INFO:tasks.workunit.client.0.smithi032.stdout:9/172: fdatasync d1/f18 0 2024-05-06T21:26:31.954 INFO:tasks.workunit.client.0.smithi032.stdout:9/173: truncate d1/d13/f2a 4240389 0 2024-05-06T21:26:31.954 INFO:tasks.workunit.client.0.smithi032.stdout:9/174: symlink d1/l36 0 2024-05-06T21:26:31.956 INFO:tasks.workunit.client.0.smithi032.stdout:5/71: dwrite d0/f5 [4194304,4194304] 0 2024-05-06T21:26:31.956 INFO:tasks.workunit.client.0.smithi032.stdout:5/72: dread - d0/fe zero size 2024-05-06T21:26:31.957 INFO:tasks.workunit.client.0.smithi032.stdout:5/73: creat d0/f10 x:0 0 0 2024-05-06T21:26:31.957 INFO:tasks.workunit.client.0.smithi032.stdout:5/74: stat d0/f10 0 2024-05-06T21:26:31.957 INFO:tasks.workunit.client.0.smithi032.stdout:5/75: write d0/fa [2045336,107406] 0 2024-05-06T21:26:31.962 INFO:tasks.workunit.client.0.smithi032.stdout:5/76: getdents d0 0 2024-05-06T21:26:31.963 INFO:tasks.workunit.client.0.smithi032.stdout:5/77: mkdir d0/d11 0 2024-05-06T21:26:32.036 INFO:tasks.workunit.client.0.smithi032.stdout:5/78: dwrite d0/fa [4194304,4194304] 0 2024-05-06T21:26:32.037 INFO:tasks.workunit.client.0.smithi032.stdout:5/79: link d0/fe d0/f12 0 2024-05-06T21:26:32.038 INFO:tasks.workunit.client.0.smithi032.stdout:5/80: creat d0/d11/f13 x:0 0 0 2024-05-06T21:26:32.052 INFO:tasks.workunit.client.0.smithi032.stdout:6/183: sync 2024-05-06T21:26:32.052 INFO:tasks.workunit.client.0.smithi032.stdout:8/148: sync 2024-05-06T21:26:32.054 INFO:tasks.workunit.client.0.smithi032.stdout:8/149: dread d0/f5 [0,4194304] 0 2024-05-06T21:26:32.054 INFO:tasks.workunit.client.0.smithi032.stdout:6/184: rename d8/dd/d1b/f20 to d8/f2b 0 2024-05-06T21:26:32.054 INFO:tasks.workunit.client.0.smithi032.stdout:6/185: write d8/dd/d18/f23 [586102,85478] 0 2024-05-06T21:26:32.055 INFO:tasks.workunit.client.0.smithi032.stdout:8/150: dread d0/f6 [0,4194304] 0 2024-05-06T21:26:32.056 INFO:tasks.workunit.client.0.smithi032.stdout:8/151: fdatasync d0/f5 0 2024-05-06T21:26:32.056 INFO:tasks.workunit.client.0.smithi032.stdout:8/152: fsync d0/f9 0 2024-05-06T21:26:32.063 INFO:tasks.workunit.client.0.smithi032.stdout:6/186: read d8/dd/d18/f14 [1638934,86794] 0 2024-05-06T21:26:32.064 INFO:tasks.workunit.client.0.smithi032.stdout:6/187: truncate d8/dd/d18/f14 1583382 0 2024-05-06T21:26:32.071 INFO:tasks.workunit.client.0.smithi032.stdout:5/81: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:32.076 INFO:tasks.workunit.client.0.smithi032.stdout:8/153: dwrite d0/f5 [0,4194304] 0 2024-05-06T21:26:32.076 INFO:tasks.workunit.client.0.smithi032.stdout:8/154: chown d0/d1b 3783 1 2024-05-06T21:26:32.076 INFO:tasks.workunit.client.0.smithi032.stdout:8/155: truncate d0/d1c/f22 964076 0 2024-05-06T21:26:32.076 INFO:tasks.workunit.client.0.smithi032.stdout:5/82: symlink d0/d11/l14 0 2024-05-06T21:26:32.076 INFO:tasks.workunit.client.0.smithi032.stdout:5/83: write d0/fa [9330946,88406] 0 2024-05-06T21:26:32.077 INFO:tasks.workunit.client.0.smithi032.stdout:8/156: mknod d0/d1b/c28 0 2024-05-06T21:26:32.084 INFO:tasks.workunit.client.0.smithi032.stdout:6/188: dwrite d8/f17 [4194304,4194304] 0 2024-05-06T21:26:32.098 INFO:tasks.workunit.client.0.smithi032.stdout:6/189: dread d8/dd/d18/d22/f29 [0,4194304] 0 2024-05-06T21:26:32.098 INFO:tasks.workunit.client.0.smithi032.stdout:6/190: dread - d8/dd/f26 zero size 2024-05-06T21:26:32.101 INFO:tasks.workunit.client.0.smithi032.stdout:8/157: dwrite d0/f1a [0,4194304] 0 2024-05-06T21:26:32.103 INFO:tasks.workunit.client.0.smithi032.stdout:5/84: dwrite d0/fc [0,4194304] 0 2024-05-06T21:26:32.103 INFO:tasks.workunit.client.0.smithi032.stdout:8/158: mknod d0/c29 0 2024-05-06T21:26:32.103 INFO:tasks.workunit.client.0.smithi032.stdout:8/159: chown d0/f1a 99 1 2024-05-06T21:26:32.104 INFO:tasks.workunit.client.0.smithi032.stdout:8/160: write d0/f5 [4365116,107741] 0 2024-05-06T21:26:32.105 INFO:tasks.workunit.client.0.smithi032.stdout:5/85: unlink d0/cf 0 2024-05-06T21:26:32.105 INFO:tasks.workunit.client.0.smithi032.stdout:5/86: truncate d0/fb 541044 0 2024-05-06T21:26:32.106 INFO:tasks.workunit.client.0.smithi032.stdout:8/161: link d0/l12 d0/d1b/l2a 0 2024-05-06T21:26:32.107 INFO:tasks.workunit.client.0.smithi032.stdout:8/162: symlink d0/l2b 0 2024-05-06T21:26:32.111 INFO:tasks.workunit.client.0.smithi032.stdout:8/163: dread d0/f1f [0,4194304] 0 2024-05-06T21:26:32.111 INFO:tasks.workunit.client.0.smithi032.stdout:8/164: readlink d0/l18 0 2024-05-06T21:26:32.113 INFO:tasks.workunit.client.0.smithi032.stdout:6/191: dwrite f4 [0,4194304] 0 2024-05-06T21:26:32.113 INFO:tasks.workunit.client.0.smithi032.stdout:6/192: dread - d8/dd/d18/d13/f24 zero size 2024-05-06T21:26:32.113 INFO:tasks.workunit.client.0.smithi032.stdout:6/193: creat d8/dd/d18/d13/f2c x:0 0 0 2024-05-06T21:26:32.113 INFO:tasks.workunit.client.0.smithi032.stdout:8/165: rmdir d0/d1b/d25 0 2024-05-06T21:26:32.116 INFO:tasks.workunit.client.0.smithi032.stdout:6/194: unlink d8/dd/d18/f14 0 2024-05-06T21:26:32.117 INFO:tasks.workunit.client.0.smithi032.stdout:5/87: write d0/fe [1417247,37415] 0 2024-05-06T21:26:32.117 INFO:tasks.workunit.client.0.smithi032.stdout:8/166: rename d0/l1d to d0/d1c/l2c 0 2024-05-06T21:26:32.117 INFO:tasks.workunit.client.0.smithi032.stdout:8/167: truncate d0/fc 2905 0 2024-05-06T21:26:32.118 INFO:tasks.workunit.client.0.smithi032.stdout:6/195: getdents d8/dd/d18/d22 0 2024-05-06T21:26:32.118 INFO:tasks.workunit.client.0.smithi032.stdout:6/196: stat d8/dd/d18/d13/f28 0 2024-05-06T21:26:32.120 INFO:tasks.workunit.client.0.smithi032.stdout:5/88: truncate d0/fa 4999226 0 2024-05-06T21:26:32.120 INFO:tasks.workunit.client.0.smithi032.stdout:5/89: truncate d0/d11/f13 470487 0 2024-05-06T21:26:32.121 INFO:tasks.workunit.client.0.smithi032.stdout:6/197: creat d8/dd/d1b/f2d x:0 0 0 2024-05-06T21:26:32.122 INFO:tasks.workunit.client.0.smithi032.stdout:5/90: mknod d0/d11/c15 0 2024-05-06T21:26:32.123 INFO:tasks.workunit.client.0.smithi032.stdout:6/198: creat d8/dd/f2e x:0 0 0 2024-05-06T21:26:32.124 INFO:tasks.workunit.client.0.smithi032.stdout:8/168: read d0/d1c/f26 [1762011,102876] 0 2024-05-06T21:26:32.124 INFO:tasks.workunit.client.0.smithi032.stdout:8/169: stat d0/cd 0 2024-05-06T21:26:32.126 INFO:tasks.workunit.client.0.smithi032.stdout:4/264: sync 2024-05-06T21:26:32.126 INFO:tasks.workunit.client.0.smithi032.stdout:0/221: sync 2024-05-06T21:26:32.126 INFO:tasks.workunit.client.0.smithi032.stdout:4/265: stat d2/d13/c2b 0 2024-05-06T21:26:32.126 INFO:tasks.workunit.client.0.smithi032.stdout:0/222: dread - d4/da/d16/f3c zero size 2024-05-06T21:26:32.126 INFO:tasks.workunit.client.0.smithi032.stdout:0/223: dread - d4/da/d14/d1a/f1c zero size 2024-05-06T21:26:32.126 INFO:tasks.workunit.client.0.smithi032.stdout:4/266: write d2/d2c/d31/f5a [117307,72084] 0 2024-05-06T21:26:32.128 INFO:tasks.workunit.client.0.smithi032.stdout:0/224: rename d4/da/d14/f26 to d4/da/d14/d1a/f4d 0 2024-05-06T21:26:32.128 INFO:tasks.workunit.client.0.smithi032.stdout:0/225: stat d4/da/l45 0 2024-05-06T21:26:32.131 INFO:tasks.workunit.client.0.smithi032.stdout:6/199: write d8/dd/d18/d22/f29 [1443707,20903] 0 2024-05-06T21:26:32.133 INFO:tasks.workunit.client.0.smithi032.stdout:6/200: symlink d8/dd/d18/d13/l2f 0 2024-05-06T21:26:32.137 INFO:tasks.workunit.client.0.smithi032.stdout:5/91: dread d0/fc [0,4194304] 0 2024-05-06T21:26:32.177 INFO:tasks.workunit.client.0.smithi032.stdout:6/201: dwrite f4 [4194304,4194304] 0 2024-05-06T21:26:32.178 INFO:tasks.workunit.client.0.smithi032.stdout:8/170: dwrite d0/f9 [0,4194304] 0 2024-05-06T21:26:32.178 INFO:tasks.workunit.client.0.smithi032.stdout:0/226: dwrite d4/da/d16/f3b [0,4194304] 0 2024-05-06T21:26:32.178 INFO:tasks.workunit.client.0.smithi032.stdout:4/267: dwrite d2/f9 [0,4194304] 0 2024-05-06T21:26:32.179 INFO:tasks.workunit.client.0.smithi032.stdout:5/92: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:32.183 INFO:tasks.workunit.client.0.smithi032.stdout:8/171: creat d0/d1c/f2d x:0 0 0 2024-05-06T21:26:32.183 INFO:tasks.workunit.client.0.smithi032.stdout:8/172: write d0/f19 [234635,40172] 0 2024-05-06T21:26:32.187 INFO:tasks.workunit.client.0.smithi032.stdout:0/227: rename d4/da/d14/d1a/l4c to d4/l4e 0 2024-05-06T21:26:32.187 INFO:tasks.workunit.client.0.smithi032.stdout:0/228: dread - d4/da/d14/d1a/f4d zero size 2024-05-06T21:26:32.188 INFO:tasks.workunit.client.0.smithi032.stdout:4/268: symlink d2/d16/d44/d45/l5b 0 2024-05-06T21:26:32.188 INFO:tasks.workunit.client.0.smithi032.stdout:4/269: readlink d2/d2c/d30/l3a 0 2024-05-06T21:26:32.188 INFO:tasks.workunit.client.0.smithi032.stdout:4/270: fsync d2/d1e/f22 0 2024-05-06T21:26:32.189 INFO:tasks.workunit.client.0.smithi032.stdout:8/173: mknod d0/d1c/c2e 0 2024-05-06T21:26:32.189 INFO:tasks.workunit.client.0.smithi032.stdout:8/174: stat d0/f4 0 2024-05-06T21:26:32.189 INFO:tasks.workunit.client.0.smithi032.stdout:8/175: stat d0/c29 0 2024-05-06T21:26:32.190 INFO:tasks.workunit.client.0.smithi032.stdout:8/176: chown d0/d1c/f22 16 1 2024-05-06T21:26:32.190 INFO:tasks.workunit.client.0.smithi032.stdout:8/177: write d0/d1c/f20 [947549,102535] 0 2024-05-06T21:26:32.190 INFO:tasks.workunit.client.0.smithi032.stdout:0/229: mkdir d4/da/d16/d4f 0 2024-05-06T21:26:32.191 INFO:tasks.workunit.client.0.smithi032.stdout:4/271: creat d2/d16/d44/f5c x:0 0 0 2024-05-06T21:26:32.192 INFO:tasks.workunit.client.0.smithi032.stdout:8/178: rename d0/d1c/f26 to d0/d1b/f2f 0 2024-05-06T21:26:32.193 INFO:tasks.workunit.client.0.smithi032.stdout:0/230: creat d4/da/d16/d33/d46/f50 x:0 0 0 2024-05-06T21:26:32.194 INFO:tasks.workunit.client.0.smithi032.stdout:4/272: mknod d2/d1e/c5d 0 2024-05-06T21:26:32.195 INFO:tasks.workunit.client.0.smithi032.stdout:8/179: mkdir d0/d1c/d30 0 2024-05-06T21:26:32.197 INFO:tasks.workunit.client.0.smithi032.stdout:4/273: rename d2/fb to d2/d16/f5e 0 2024-05-06T21:26:32.198 INFO:tasks.workunit.client.0.smithi032.stdout:8/180: stat d0/l18 0 2024-05-06T21:26:32.199 INFO:tasks.workunit.client.0.smithi032.stdout:5/93: dwrite d0/d11/f13 [0,4194304] 0 2024-05-06T21:26:32.199 INFO:tasks.workunit.client.0.smithi032.stdout:6/202: dwrite d8/dd/d18/f23 [0,4194304] 0 2024-05-06T21:26:32.199 INFO:tasks.workunit.client.0.smithi032.stdout:5/94: read d0/fb [19214,121746] 0 2024-05-06T21:26:32.202 INFO:tasks.workunit.client.0.smithi032.stdout:4/274: truncate d2/f11 1083325 0 2024-05-06T21:26:32.202 INFO:tasks.workunit.client.0.smithi032.stdout:4/275: truncate d2/d2c/d30/f32 4744206 0 2024-05-06T21:26:32.202 INFO:tasks.workunit.client.0.smithi032.stdout:4/276: chown d2/d1e/f28 9 1 2024-05-06T21:26:32.202 INFO:tasks.workunit.client.0.smithi032.stdout:4/277: dread - d2/d2c/f49 zero size 2024-05-06T21:26:32.202 INFO:tasks.workunit.client.0.smithi032.stdout:3/145: sync 2024-05-06T21:26:32.203 INFO:tasks.workunit.client.0.smithi032.stdout:2/108: sync 2024-05-06T21:26:32.203 INFO:tasks.workunit.client.0.smithi032.stdout:3/146: creat d1/d4/f30 x:0 0 0 2024-05-06T21:26:32.204 INFO:tasks.workunit.client.0.smithi032.stdout:5/95: mkdir d0/d16 0 2024-05-06T21:26:32.206 INFO:tasks.workunit.client.0.smithi032.stdout:3/147: mkdir d1/d4/da/d31 0 2024-05-06T21:26:32.206 INFO:tasks.workunit.client.0.smithi032.stdout:3/148: write d1/d4/f30 [1006390,117522] 0 2024-05-06T21:26:32.206 INFO:tasks.workunit.client.0.smithi032.stdout:3/149: creat d1/d4/da/f32 x:0 0 0 2024-05-06T21:26:32.208 INFO:tasks.workunit.client.0.smithi032.stdout:3/150: symlink d1/d2a/l33 0 2024-05-06T21:26:32.209 INFO:tasks.workunit.client.0.smithi032.stdout:4/278: dread d2/d16/f2e [0,4194304] 0 2024-05-06T21:26:32.212 INFO:tasks.workunit.client.0.smithi032.stdout:8/181: dread d0/f5 [0,4194304] 0 2024-05-06T21:26:32.218 INFO:tasks.workunit.client.0.smithi032.stdout:8/182: rename d0/fc to d0/d1b/f31 0 2024-05-06T21:26:32.218 INFO:tasks.workunit.client.0.smithi032.stdout:8/183: creat d0/d1c/f32 x:0 0 0 2024-05-06T21:26:32.218 INFO:tasks.workunit.client.0.smithi032.stdout:8/184: readlink d0/d1c/l2c 0 2024-05-06T21:26:32.218 INFO:tasks.workunit.client.0.smithi032.stdout:8/185: stat d0/f27 0 2024-05-06T21:26:32.219 INFO:tasks.workunit.client.0.smithi032.stdout:8/186: readlink d0/l18 0 2024-05-06T21:26:32.219 INFO:tasks.workunit.client.0.smithi032.stdout:8/187: write d0/f3 [863839,106155] 0 2024-05-06T21:26:32.221 INFO:tasks.workunit.client.0.smithi032.stdout:8/188: rmdir d0/d1c/d30 0 2024-05-06T21:26:32.223 INFO:tasks.workunit.client.0.smithi032.stdout:5/96: dread d0/f12 [0,4194304] 0 2024-05-06T21:26:32.229 INFO:tasks.workunit.client.0.smithi032.stdout:7/273: sync 2024-05-06T21:26:32.230 INFO:tasks.workunit.client.0.smithi032.stdout:7/274: write db/d12/d49/f4d [299037,70742] 0 2024-05-06T21:26:32.232 INFO:tasks.workunit.client.0.smithi032.stdout:7/275: rename db/d12/d16/d2a/f33 to db/d12/d16/d21/d41/d4b/f54 0 2024-05-06T21:26:32.234 INFO:tasks.workunit.client.0.smithi032.stdout:7/276: unlink db/d12/d16/d2a/d39/c50 0 2024-05-06T21:26:32.237 INFO:tasks.workunit.client.0.smithi032.stdout:5/97: dread d0/d11/f13 [0,4194304] 0 2024-05-06T21:26:32.237 INFO:tasks.workunit.client.0.smithi032.stdout:7/277: rename c2 to db/d12/d16/c55 0 2024-05-06T21:26:32.237 INFO:tasks.workunit.client.0.smithi032.stdout:7/278: chown db/d12/d16/d2a/d39/d3b/f4e 244433656 1 2024-05-06T21:26:32.237 INFO:tasks.workunit.client.0.smithi032.stdout:5/98: write d0/fb [50640,38511] 0 2024-05-06T21:26:32.237 INFO:tasks.workunit.client.0.smithi032.stdout:7/279: truncate db/d12/d16/d2a/d39/d3b/f4e 764565 0 2024-05-06T21:26:32.237 INFO:tasks.workunit.client.0.smithi032.stdout:7/280: dread - db/d12/d16/d2a/f42 zero size 2024-05-06T21:26:32.237 INFO:tasks.workunit.client.0.smithi032.stdout:5/99: creat d0/d11/f17 x:0 0 0 2024-05-06T21:26:32.239 INFO:tasks.workunit.client.0.smithi032.stdout:2/109: dwrite f2 [0,4194304] 0 2024-05-06T21:26:32.239 INFO:tasks.workunit.client.0.smithi032.stdout:2/110: truncate df/d14/f1d 316641 0 2024-05-06T21:26:32.239 INFO:tasks.workunit.client.0.smithi032.stdout:2/111: chown df/d14/f18 55 1 2024-05-06T21:26:32.239 INFO:tasks.workunit.client.0.smithi032.stdout:7/281: stat db/d12/d16/d2a/d53/c2f 0 2024-05-06T21:26:32.239 INFO:tasks.workunit.client.0.smithi032.stdout:6/203: dwrite d8/f17 [0,4194304] 0 2024-05-06T21:26:32.240 INFO:tasks.workunit.client.0.smithi032.stdout:6/204: symlink d8/dd/d18/l30 0 2024-05-06T21:26:32.240 INFO:tasks.workunit.client.0.smithi032.stdout:6/205: read - d8/dd/d18/d13/f28 zero size 2024-05-06T21:26:32.242 INFO:tasks.workunit.client.0.smithi032.stdout:6/206: creat d8/f31 x:0 0 0 2024-05-06T21:26:32.242 INFO:tasks.workunit.client.0.smithi032.stdout:5/100: read d0/d11/f13 [1362749,122678] 0 2024-05-06T21:26:32.247 INFO:tasks.workunit.client.0.smithi032.stdout:3/151: dwrite d1/d4/d11/f2b [0,4194304] 0 2024-05-06T21:26:32.247 INFO:tasks.workunit.client.0.smithi032.stdout:4/279: dwrite d2/d16/f52 [0,4194304] 0 2024-05-06T21:26:32.253 INFO:tasks.workunit.client.0.smithi032.stdout:3/152: dread d1/f6 [4194304,4194304] 0 2024-05-06T21:26:32.253 INFO:tasks.workunit.client.0.smithi032.stdout:3/153: dread - d1/d4/f9 zero size 2024-05-06T21:26:32.254 INFO:tasks.workunit.client.0.smithi032.stdout:8/189: dwrite d0/f27 [0,4194304] 0 2024-05-06T21:26:32.255 INFO:tasks.workunit.client.0.smithi032.stdout:8/190: creat d0/f33 x:0 0 0 2024-05-06T21:26:32.255 INFO:tasks.workunit.client.0.smithi032.stdout:8/191: dread - d0/d1c/f32 zero size 2024-05-06T21:26:32.257 INFO:tasks.workunit.client.0.smithi032.stdout:8/192: dread d0/f6 [0,4194304] 0 2024-05-06T21:26:32.257 INFO:tasks.workunit.client.0.smithi032.stdout:7/282: dwrite db/d12/d16/d21/f4a [0,4194304] 0 2024-05-06T21:26:32.263 INFO:tasks.workunit.client.0.smithi032.stdout:2/112: dwrite df/d14/f1d [0,4194304] 0 2024-05-06T21:26:32.263 INFO:tasks.workunit.client.0.smithi032.stdout:2/113: chown df/f10 176523138 1 2024-05-06T21:26:32.264 INFO:tasks.workunit.client.0.smithi032.stdout:2/114: creat df/d14/f20 x:0 0 0 2024-05-06T21:26:32.264 INFO:tasks.workunit.client.0.smithi032.stdout:2/115: write df/f10 [1083529,43584] 0 2024-05-06T21:26:32.264 INFO:tasks.workunit.client.0.smithi032.stdout:2/116: chown df/c13 13 1 2024-05-06T21:26:32.266 INFO:tasks.workunit.client.0.smithi032.stdout:7/283: rmdir db/d12/d16 39 2024-05-06T21:26:32.269 INFO:tasks.workunit.client.0.smithi032.stdout:2/117: write fe [1071009,23541] 0 2024-05-06T21:26:32.271 INFO:tasks.workunit.client.0.smithi032.stdout:7/284: rename db/d12/c47 to db/d12/c56 0 2024-05-06T21:26:32.271 INFO:tasks.workunit.client.0.smithi032.stdout:7/285: stat ca 0 2024-05-06T21:26:32.271 INFO:tasks.workunit.client.0.smithi032.stdout:7/286: write f3 [134851,12650] 0 2024-05-06T21:26:32.272 INFO:tasks.workunit.client.0.smithi032.stdout:7/287: creat db/d12/d16/f57 x:0 0 0 2024-05-06T21:26:32.274 INFO:tasks.workunit.client.0.smithi032.stdout:4/280: dwrite d2/fc [4194304,4194304] 0 2024-05-06T21:26:32.277 INFO:tasks.workunit.client.0.smithi032.stdout:3/154: dwrite d1/d4/d11/f2b [0,4194304] 0 2024-05-06T21:26:32.277 INFO:tasks.workunit.client.0.smithi032.stdout:3/155: fsync d1/d4/d11/f2b 0 2024-05-06T21:26:32.288 INFO:tasks.workunit.client.0.smithi032.stdout:7/288: read db/d12/f30 [4148047,90264] 0 2024-05-06T21:26:32.289 INFO:tasks.workunit.client.0.smithi032.stdout:2/118: dwrite df/f10 [0,4194304] 0 2024-05-06T21:26:32.292 INFO:tasks.workunit.client.0.smithi032.stdout:3/156: symlink d1/d4/l34 0 2024-05-06T21:26:32.300 INFO:tasks.workunit.client.0.smithi032.stdout:2/119: write df/d14/f1d [1783768,15671] 0 2024-05-06T21:26:32.303 INFO:tasks.workunit.client.0.smithi032.stdout:2/120: dread fe [0,4194304] 0 2024-05-06T21:26:32.304 INFO:tasks.workunit.client.0.smithi032.stdout:1/261: sync 2024-05-06T21:26:32.304 INFO:tasks.workunit.client.0.smithi032.stdout:9/175: sync 2024-05-06T21:26:32.304 INFO:tasks.workunit.client.0.smithi032.stdout:9/176: truncate d1/d13/d25/f2e 484469 0 2024-05-06T21:26:32.322 INFO:tasks.workunit.client.0.smithi032.stdout:9/177: dwrite d1/f9 [0,4194304] 0 2024-05-06T21:26:32.339 INFO:tasks.workunit.client.0.smithi032.stdout:7/289: link db/d12/d16/d21/l23 db/d12/d16/d2a/d39/l58 0 2024-05-06T21:26:32.343 INFO:tasks.workunit.client.0.smithi032.stdout:9/178: dwrite d1/d13/f1f [0,4194304] 0 2024-05-06T21:26:32.354 INFO:tasks.workunit.client.0.smithi032.stdout:4/281: rmdir d2/d1e 39 2024-05-06T21:26:32.356 INFO:tasks.workunit.client.0.smithi032.stdout:3/157: creat d1/f35 x:0 0 0 2024-05-06T21:26:32.356 INFO:tasks.workunit.client.0.smithi032.stdout:3/158: creat d1/d4/d11/f36 x:0 0 0 2024-05-06T21:26:32.356 INFO:tasks.workunit.client.0.smithi032.stdout:3/159: dread - d1/d4/f2e zero size 2024-05-06T21:26:32.356 INFO:tasks.workunit.client.0.smithi032.stdout:3/160: dread - d1/f35 zero size 2024-05-06T21:26:32.357 INFO:tasks.workunit.client.0.smithi032.stdout:9/179: dread d1/f1a [0,4194304] 0 2024-05-06T21:26:32.358 INFO:tasks.workunit.client.0.smithi032.stdout:2/121: unlink df/d14/c16 0 2024-05-06T21:26:32.363 INFO:tasks.workunit.client.0.smithi032.stdout:7/290: rename db/d12/d16/d21/f27 to db/d12/d16/d21/d41/d4b/f59 0 2024-05-06T21:26:32.363 INFO:tasks.workunit.client.0.smithi032.stdout:4/282: rename d2/d1e to d2/d1e/d5f 22 2024-05-06T21:26:32.364 INFO:tasks.workunit.client.0.smithi032.stdout:4/283: chown d2/d1e/d47/c59 22714 1 2024-05-06T21:26:32.365 INFO:tasks.workunit.client.0.smithi032.stdout:4/284: write d2/d2c/d30/f32 [4296567,20722] 0 2024-05-06T21:26:32.367 INFO:tasks.workunit.client.0.smithi032.stdout:3/161: unlink d1/d4/l34 0 2024-05-06T21:26:32.368 INFO:tasks.workunit.client.0.smithi032.stdout:2/122: symlink df/d19/d1e/l21 0 2024-05-06T21:26:32.370 INFO:tasks.workunit.client.0.smithi032.stdout:4/285: write d2/d16/f2e [119020,24966] 0 2024-05-06T21:26:32.370 INFO:tasks.workunit.client.0.smithi032.stdout:1/262: getdents db/d37 0 2024-05-06T21:26:32.372 INFO:tasks.workunit.client.0.smithi032.stdout:7/291: rename db/f29 to db/d12/d16/d2a/f5a 0 2024-05-06T21:26:32.372 INFO:tasks.workunit.client.0.smithi032.stdout:7/292: write db/d12/d16/d2a/d39/d3b/f3d [1043282,2957] 0 2024-05-06T21:26:32.373 INFO:tasks.workunit.client.0.smithi032.stdout:3/162: unlink d1/d4/da/fc 0 2024-05-06T21:26:32.373 INFO:tasks.workunit.client.0.smithi032.stdout:3/163: write d1/d4/da/f2c [509438,91670] 0 2024-05-06T21:26:32.373 INFO:tasks.workunit.client.0.smithi032.stdout:3/164: dread - d1/f35 zero size 2024-05-06T21:26:32.374 INFO:tasks.workunit.client.0.smithi032.stdout:2/123: symlink df/d19/l22 0 2024-05-06T21:26:32.375 INFO:tasks.workunit.client.0.smithi032.stdout:9/180: dwrite d1/f12 [0,4194304] 0 2024-05-06T21:26:32.376 INFO:tasks.workunit.client.0.smithi032.stdout:4/286: symlink d2/d2c/l60 0 2024-05-06T21:26:32.377 INFO:tasks.workunit.client.0.smithi032.stdout:1/263: stat db/d16/c25 0 2024-05-06T21:26:32.377 INFO:tasks.workunit.client.0.smithi032.stdout:1/264: write db/d2a/f4d [609622,21174] 0 2024-05-06T21:26:32.377 INFO:tasks.workunit.client.0.smithi032.stdout:1/265: read - db/f43 zero size 2024-05-06T21:26:32.379 INFO:tasks.workunit.client.0.smithi032.stdout:7/293: mknod db/d12/c5b 0 2024-05-06T21:26:32.379 INFO:tasks.workunit.client.0.smithi032.stdout:7/294: chown db/d12/d16/d2a/d39/l58 6244367 1 2024-05-06T21:26:32.382 INFO:tasks.workunit.client.0.smithi032.stdout:1/266: dread db/d2a/f2d [0,4194304] 0 2024-05-06T21:26:32.384 INFO:tasks.workunit.client.0.smithi032.stdout:7/295: dread db/d12/d16/d21/d41/d4b/f59 [0,4194304] 0 2024-05-06T21:26:32.386 INFO:tasks.workunit.client.0.smithi032.stdout:4/287: symlink d2/d16/d44/d54/l61 0 2024-05-06T21:26:32.387 INFO:tasks.workunit.client.0.smithi032.stdout:4/288: fsync d2/f9 0 2024-05-06T21:26:32.387 INFO:tasks.workunit.client.0.smithi032.stdout:4/289: dread - d2/f53 zero size 2024-05-06T21:26:32.387 INFO:tasks.workunit.client.0.smithi032.stdout:4/290: chown d2/d16/d44/f5c 0 1 2024-05-06T21:26:32.388 INFO:tasks.workunit.client.0.smithi032.stdout:1/267: creat db/f51 x:0 0 0 2024-05-06T21:26:32.389 INFO:tasks.workunit.client.0.smithi032.stdout:3/165: write d1/d4/d11/f2b [551774,57213] 0 2024-05-06T21:26:32.390 INFO:tasks.workunit.client.0.smithi032.stdout:4/291: rename d2/d2c/l33 to d2/d16/d44/d45/l62 0 2024-05-06T21:26:32.391 INFO:tasks.workunit.client.0.smithi032.stdout:2/124: write df/f12 [1510332,52679] 0 2024-05-06T21:26:32.392 INFO:tasks.workunit.client.0.smithi032.stdout:1/268: mkdir db/d37/d52 0 2024-05-06T21:26:32.394 INFO:tasks.workunit.client.0.smithi032.stdout:3/166: link d1/d4/f30 d1/d2a/f37 0 2024-05-06T21:26:32.397 INFO:tasks.workunit.client.0.smithi032.stdout:9/181: write d1/d13/f1f [2767540,63305] 0 2024-05-06T21:26:32.399 INFO:tasks.workunit.client.0.smithi032.stdout:2/125: mkdir df/d19/d1e/d23 0 2024-05-06T21:26:32.399 INFO:tasks.workunit.client.0.smithi032.stdout:7/296: write db/f1e [1499267,117881] 0 2024-05-06T21:26:32.399 INFO:tasks.workunit.client.0.smithi032.stdout:7/297: stat db/d12/d16/d2a/d53/c34 0 2024-05-06T21:26:32.408 INFO:tasks.workunit.client.0.smithi032.stdout:9/182: unlink d1/d13/d25/f35 0 2024-05-06T21:26:32.412 INFO:tasks.workunit.client.0.smithi032.stdout:7/298: truncate db/d12/d16/d2a/d39/d3b/f4e 314737 0 2024-05-06T21:26:32.412 INFO:tasks.workunit.client.0.smithi032.stdout:2/126: dread df/f12 [0,4194304] 0 2024-05-06T21:26:32.412 INFO:tasks.workunit.client.0.smithi032.stdout:2/127: write fe [1427610,76108] 0 2024-05-06T21:26:32.412 INFO:tasks.workunit.client.0.smithi032.stdout:2/128: creat df/d14/f24 x:0 0 0 2024-05-06T21:26:32.412 INFO:tasks.workunit.client.0.smithi032.stdout:1/269: dwrite db/d2a/f49 [0,4194304] 0 2024-05-06T21:26:32.412 INFO:tasks.workunit.client.0.smithi032.stdout:1/270: dread - db/d37/f4b zero size 2024-05-06T21:26:32.414 INFO:tasks.workunit.client.0.smithi032.stdout:9/183: creat d1/d2f/f37 x:0 0 0 2024-05-06T21:26:32.415 INFO:tasks.workunit.client.0.smithi032.stdout:7/299: symlink db/d12/d16/d2a/d39/d3b/l5c 0 2024-05-06T21:26:32.418 INFO:tasks.workunit.client.0.smithi032.stdout:2/129: mkdir df/d19/d1e/d23/d25 0 2024-05-06T21:26:32.423 INFO:tasks.workunit.client.0.smithi032.stdout:9/184: mknod d1/d2f/c38 0 2024-05-06T21:26:32.425 INFO:tasks.workunit.client.0.smithi032.stdout:2/130: symlink df/d19/d1e/d23/l26 0 2024-05-06T21:26:32.425 INFO:tasks.workunit.client.0.smithi032.stdout:7/300: write db/d12/d16/d2a/d53/f36 [1882749,29683] 0 2024-05-06T21:26:32.425 INFO:tasks.workunit.client.0.smithi032.stdout:7/301: write db/d12/d16/d2a/d53/f4f [965593,118309] 0 2024-05-06T21:26:32.425 INFO:tasks.workunit.client.0.smithi032.stdout:7/302: dread - db/d12/d16/d2a/f42 zero size 2024-05-06T21:26:32.427 INFO:tasks.workunit.client.0.smithi032.stdout:9/185: mkdir d1/d13/d34/d26/d39 0 2024-05-06T21:26:32.427 INFO:tasks.workunit.client.0.smithi032.stdout:9/186: truncate d1/f18 2052559 0 2024-05-06T21:26:32.428 INFO:tasks.workunit.client.0.smithi032.stdout:2/131: unlink df/f1a 0 2024-05-06T21:26:32.428 INFO:tasks.workunit.client.0.smithi032.stdout:2/132: chown df/d19 1267824008 1 2024-05-06T21:26:32.429 INFO:tasks.workunit.client.0.smithi032.stdout:9/187: mknod d1/d2f/c3a 0 2024-05-06T21:26:32.430 INFO:tasks.workunit.client.0.smithi032.stdout:4/292: rmdir d2/d2c 39 2024-05-06T21:26:32.430 INFO:tasks.workunit.client.0.smithi032.stdout:1/271: rmdir db 39 2024-05-06T21:26:32.431 INFO:tasks.workunit.client.0.smithi032.stdout:4/293: symlink d2/d2c/d31/l63 0 2024-05-06T21:26:32.431 INFO:tasks.workunit.client.0.smithi032.stdout:4/294: truncate d2/d2c/f49 411127 0 2024-05-06T21:26:32.435 INFO:tasks.workunit.client.0.smithi032.stdout:1/272: mknod db/d47/c53 0 2024-05-06T21:26:32.437 INFO:tasks.workunit.client.0.smithi032.stdout:1/273: creat db/d37/f54 x:0 0 0 2024-05-06T21:26:32.437 INFO:tasks.workunit.client.0.smithi032.stdout:1/274: fsync db/f43 0 2024-05-06T21:26:32.440 INFO:tasks.workunit.client.0.smithi032.stdout:7/303: dwrite db/d12/d16/f57 [0,4194304] 0 2024-05-06T21:26:32.444 INFO:tasks.workunit.client.0.smithi032.stdout:2/133: write df/d14/f15 [3861961,99974] 0 2024-05-06T21:26:32.444 INFO:tasks.workunit.client.0.smithi032.stdout:2/134: creat df/d14/f27 x:0 0 0 2024-05-06T21:26:32.444 INFO:tasks.workunit.client.0.smithi032.stdout:2/135: dread - df/d14/f20 zero size 2024-05-06T21:26:32.444 INFO:tasks.workunit.client.0.smithi032.stdout:4/295: write d2/f9 [2817048,2701] 0 2024-05-06T21:26:32.444 INFO:tasks.workunit.client.0.smithi032.stdout:4/296: dread - d2/f46 zero size 2024-05-06T21:26:32.445 INFO:tasks.workunit.client.0.smithi032.stdout:7/304: link db/d12/d16/d2a/d39/d3b/l4c db/d12/d16/d2a/d39/l5d 0 2024-05-06T21:26:32.448 INFO:tasks.workunit.client.0.smithi032.stdout:1/275: write db/f27 [3238877,1258] 0 2024-05-06T21:26:32.448 INFO:tasks.workunit.client.0.smithi032.stdout:1/276: chown db/d2a/f49 30025178 1 2024-05-06T21:26:32.448 INFO:tasks.workunit.client.0.smithi032.stdout:2/136: creat df/d19/d1e/f28 x:0 0 0 2024-05-06T21:26:32.448 INFO:tasks.workunit.client.0.smithi032.stdout:1/277: read db/d2a/f2f [107940,78110] 0 2024-05-06T21:26:32.449 INFO:tasks.workunit.client.0.smithi032.stdout:1/278: read db/f2e [1973054,72671] 0 2024-05-06T21:26:32.450 INFO:tasks.workunit.client.0.smithi032.stdout:4/297: rename d2/d16/c2f to d2/c64 0 2024-05-06T21:26:32.452 INFO:tasks.workunit.client.0.smithi032.stdout:7/305: unlink db/f1f 0 2024-05-06T21:26:32.454 INFO:tasks.workunit.client.0.smithi032.stdout:9/188: truncate d1/f12 3622241 0 2024-05-06T21:26:32.454 INFO:tasks.workunit.client.0.smithi032.stdout:9/189: chown d1/d13/d34 2 1 2024-05-06T21:26:32.459 INFO:tasks.workunit.client.0.smithi032.stdout:1/279: unlink l7 0 2024-05-06T21:26:32.462 INFO:tasks.workunit.client.0.smithi032.stdout:4/298: mknod d2/d16/c65 0 2024-05-06T21:26:32.462 INFO:tasks.workunit.client.0.smithi032.stdout:2/137: dread df/d14/f15 [0,4194304] 0 2024-05-06T21:26:32.463 INFO:tasks.workunit.client.0.smithi032.stdout:7/306: link db/d12/d16/d21/l28 db/d12/d49/l5e 0 2024-05-06T21:26:32.464 INFO:tasks.workunit.client.0.smithi032.stdout:1/280: rmdir db/d2a 39 2024-05-06T21:26:32.465 INFO:tasks.workunit.client.0.smithi032.stdout:2/138: rename f2 to df/d14/f29 0 2024-05-06T21:26:32.465 INFO:tasks.workunit.client.0.smithi032.stdout:2/139: write df/d14/f15 [4573822,48248] 0 2024-05-06T21:26:32.466 INFO:tasks.workunit.client.0.smithi032.stdout:7/307: stat db/d12/d16/d2a/d39/l5d 0 2024-05-06T21:26:32.467 INFO:tasks.workunit.client.0.smithi032.stdout:7/308: chown db/d12/d16/d21/d41/d4b 523 1 2024-05-06T21:26:32.469 INFO:tasks.workunit.client.0.smithi032.stdout:2/140: creat df/d19/d1e/d1f/f2a x:0 0 0 2024-05-06T21:26:32.471 INFO:tasks.workunit.client.0.smithi032.stdout:7/309: getdents db 0 2024-05-06T21:26:32.475 INFO:tasks.workunit.client.0.smithi032.stdout:7/310: dread db/d12/d16/d2a/d39/d3b/f3d [0,4194304] 0 2024-05-06T21:26:32.476 INFO:tasks.workunit.client.0.smithi032.stdout:9/190: dwrite d1/f31 [4194304,4194304] 0 2024-05-06T21:26:32.477 INFO:tasks.workunit.client.0.smithi032.stdout:7/311: mknod db/d12/d16/d21/d41/d4b/c5f 0 2024-05-06T21:26:32.480 INFO:tasks.workunit.client.0.smithi032.stdout:9/191: symlink d1/d13/d34/d26/d39/l3b 0 2024-05-06T21:26:32.480 INFO:tasks.workunit.client.0.smithi032.stdout:9/192: creat d1/d2f/f3c x:0 0 0 2024-05-06T21:26:32.486 INFO:tasks.workunit.client.0.smithi032.stdout:7/312: dread db/d12/d16/d2a/d53/f2c [0,4194304] 0 2024-05-06T21:26:32.486 INFO:tasks.workunit.client.0.smithi032.stdout:4/299: dwrite d2/d16/f36 [4194304,4194304] 0 2024-05-06T21:26:32.489 INFO:tasks.workunit.client.0.smithi032.stdout:4/300: unlink d2/d16/c4a 0 2024-05-06T21:26:32.489 INFO:tasks.workunit.client.0.smithi032.stdout:4/301: dread - d2/d16/d44/f5c zero size 2024-05-06T21:26:32.490 INFO:tasks.workunit.client.0.smithi032.stdout:7/313: symlink db/d12/d16/d21/d41/l60 0 2024-05-06T21:26:32.490 INFO:tasks.workunit.client.0.smithi032.stdout:7/314: write db/f20 [1667066,68835] 0 2024-05-06T21:26:32.490 INFO:tasks.workunit.client.0.smithi032.stdout:7/315: chown db/d12/c5b 1 1 2024-05-06T21:26:32.490 INFO:tasks.workunit.client.0.smithi032.stdout:7/316: chown db/d12/d49/l5e 771398 1 2024-05-06T21:26:32.491 INFO:tasks.workunit.client.0.smithi032.stdout:2/141: read df/d14/f17 [873643,22001] 0 2024-05-06T21:26:32.492 INFO:tasks.workunit.client.0.smithi032.stdout:4/302: link d2/c64 d2/d2c/d31/c66 0 2024-05-06T21:26:32.496 INFO:tasks.workunit.client.0.smithi032.stdout:4/303: dread d2/f35 [0,4194304] 0 2024-05-06T21:26:32.496 INFO:tasks.workunit.client.0.smithi032.stdout:4/304: creat d2/d16/f67 x:0 0 0 2024-05-06T21:26:32.496 INFO:tasks.workunit.client.0.smithi032.stdout:4/305: write d2/d16/f52 [5056105,56968] 0 2024-05-06T21:26:32.497 INFO:tasks.workunit.client.0.smithi032.stdout:4/306: mknod d2/d16/d44/d45/d4e/c68 0 2024-05-06T21:26:32.498 INFO:tasks.workunit.client.0.smithi032.stdout:4/307: mkdir d2/d16/d44/d54/d69 0 2024-05-06T21:26:32.502 INFO:tasks.workunit.client.0.smithi032.stdout:1/281: dwrite db/d16/f18 [0,4194304] 0 2024-05-06T21:26:32.502 INFO:tasks.workunit.client.0.smithi032.stdout:4/308: dread d2/f11 [0,4194304] 0 2024-05-06T21:26:32.502 INFO:tasks.workunit.client.0.smithi032.stdout:4/309: write d2/d16/f67 [704951,106139] 0 2024-05-06T21:26:32.502 INFO:tasks.workunit.client.0.smithi032.stdout:9/193: dwrite d1/d13/f1f [0,4194304] 0 2024-05-06T21:26:32.503 INFO:tasks.workunit.client.0.smithi032.stdout:1/282: mkdir db/d16/d46/d55 0 2024-05-06T21:26:32.504 INFO:tasks.workunit.client.0.smithi032.stdout:4/310: symlink d2/d2c/l6a 0 2024-05-06T21:26:32.505 INFO:tasks.workunit.client.0.smithi032.stdout:1/283: truncate db/f30 307332 0 2024-05-06T21:26:32.506 INFO:tasks.workunit.client.0.smithi032.stdout:4/311: creat d2/d16/d44/d45/d4e/f6b x:0 0 0 2024-05-06T21:26:32.506 INFO:tasks.workunit.client.0.smithi032.stdout:1/284: chown db/d16/f32 36 1 2024-05-06T21:26:32.506 INFO:tasks.workunit.client.0.smithi032.stdout:1/285: truncate db/d2a/f4d 1288760 0 2024-05-06T21:26:32.508 INFO:tasks.workunit.client.0.smithi032.stdout:7/317: dread db/f20 [0,4194304] 0 2024-05-06T21:26:32.510 INFO:tasks.workunit.client.0.smithi032.stdout:7/318: rmdir db 39 2024-05-06T21:26:32.512 INFO:tasks.workunit.client.0.smithi032.stdout:7/319: dread db/d12/d16/f3f [0,4194304] 0 2024-05-06T21:26:32.525 INFO:tasks.workunit.client.0.smithi032.stdout:9/194: dwrite d1/f23 [0,4194304] 0 2024-05-06T21:26:32.526 INFO:tasks.workunit.client.0.smithi032.stdout:7/320: link db/d12/d16/d21/d41/d4b/f59 db/d12/f61 0 2024-05-06T21:26:32.527 INFO:tasks.workunit.client.0.smithi032.stdout:1/286: dwrite db/d16/f2c [4194304,4194304] 0 2024-05-06T21:26:32.530 INFO:tasks.workunit.client.0.smithi032.stdout:7/321: write db/d12/f61 [632379,55699] 0 2024-05-06T21:26:32.535 INFO:tasks.workunit.client.0.smithi032.stdout:1/287: rename db/f20 to db/d37/d52/f56 0 2024-05-06T21:26:32.536 INFO:tasks.workunit.client.0.smithi032.stdout:4/312: dwrite d2/f9 [0,4194304] 0 2024-05-06T21:26:32.536 INFO:tasks.workunit.client.0.smithi032.stdout:4/313: creat d2/f6c x:0 0 0 2024-05-06T21:26:32.536 INFO:tasks.workunit.client.0.smithi032.stdout:4/314: chown d2/c4 1769 1 2024-05-06T21:26:32.537 INFO:tasks.workunit.client.0.smithi032.stdout:7/322: mknod db/d12/d49/c62 0 2024-05-06T21:26:32.537 INFO:tasks.workunit.client.0.smithi032.stdout:9/195: rmdir d1/d2f 39 2024-05-06T21:26:32.541 INFO:tasks.workunit.client.0.smithi032.stdout:9/196: symlink d1/d13/d34/d26/l3d 0 2024-05-06T21:26:32.542 INFO:tasks.workunit.client.0.smithi032.stdout:7/323: getdents db/d12/d16 0 2024-05-06T21:26:32.542 INFO:tasks.workunit.client.0.smithi032.stdout:1/288: dread db/d16/f40 [0,4194304] 0 2024-05-06T21:26:32.543 INFO:tasks.workunit.client.0.smithi032.stdout:9/197: mknod d1/d13/d25/c3e 0 2024-05-06T21:26:32.546 INFO:tasks.workunit.client.0.smithi032.stdout:7/324: dread db/d12/d16/d2a/d53/f2c [0,4194304] 0 2024-05-06T21:26:32.547 INFO:tasks.workunit.client.0.smithi032.stdout:7/325: stat db/d12/d16/d2a/d53/c2b 0 2024-05-06T21:26:32.548 INFO:tasks.workunit.client.0.smithi032.stdout:4/315: dread d2/f9 [0,4194304] 0 2024-05-06T21:26:32.549 INFO:tasks.workunit.client.0.smithi032.stdout:7/326: mknod db/d12/d16/d2a/d39/d3b/c63 0 2024-05-06T21:26:32.552 INFO:tasks.workunit.client.0.smithi032.stdout:9/198: read d1/d13/d34/d26/f29 [3370158,99723] 0 2024-05-06T21:26:32.555 INFO:tasks.workunit.client.0.smithi032.stdout:9/199: unlink d1/l2c 0 2024-05-06T21:26:32.556 INFO:tasks.workunit.client.0.smithi032.stdout:9/200: read d1/d13/d34/d26/f29 [2129771,53205] 0 2024-05-06T21:26:32.557 INFO:tasks.workunit.client.0.smithi032.stdout:9/201: mkdir d1/d13/d33/d3f 0 2024-05-06T21:26:32.557 INFO:tasks.workunit.client.0.smithi032.stdout:9/202: creat d1/d13/d25/f40 x:0 0 0 2024-05-06T21:26:32.557 INFO:tasks.workunit.client.0.smithi032.stdout:9/203: write d1/d13/d34/f32 [885291,62002] 0 2024-05-06T21:26:32.557 INFO:tasks.workunit.client.0.smithi032.stdout:9/204: fdatasync d1/d2f/f37 0 2024-05-06T21:26:32.560 INFO:tasks.workunit.client.0.smithi032.stdout:1/289: dwrite db/f30 [0,4194304] 0 2024-05-06T21:26:32.566 INFO:tasks.workunit.client.0.smithi032.stdout:1/290: dread db/d16/f32 [0,4194304] 0 2024-05-06T21:26:32.568 INFO:tasks.workunit.client.0.smithi032.stdout:1/291: mkdir db/d16/d46/d57 0 2024-05-06T21:26:32.568 INFO:tasks.workunit.client.0.smithi032.stdout:1/292: fdatasync db/d37/f54 0 2024-05-06T21:26:32.568 INFO:tasks.workunit.client.0.smithi032.stdout:1/293: truncate db/d37/f4b 8925 0 2024-05-06T21:26:32.568 INFO:tasks.workunit.client.0.smithi032.stdout:1/294: stat db/d2a/l48 0 2024-05-06T21:26:32.569 INFO:tasks.workunit.client.0.smithi032.stdout:4/316: dwrite d2/d2c/d31/f5a [0,4194304] 0 2024-05-06T21:26:32.569 INFO:tasks.workunit.client.0.smithi032.stdout:4/317: creat d2/d16/d44/d45/f6d x:0 0 0 2024-05-06T21:26:32.569 INFO:tasks.workunit.client.0.smithi032.stdout:4/318: fdatasync d2/d1e/f28 0 2024-05-06T21:26:32.569 INFO:tasks.workunit.client.0.smithi032.stdout:4/319: creat d2/d16/d44/d45/f6e x:0 0 0 2024-05-06T21:26:32.569 INFO:tasks.workunit.client.0.smithi032.stdout:4/320: fdatasync d2/f35 0 2024-05-06T21:26:32.569 INFO:tasks.workunit.client.0.smithi032.stdout:4/321: chown d2/c29 237398 1 2024-05-06T21:26:32.569 INFO:tasks.workunit.client.0.smithi032.stdout:4/322: read - d2/d16/d44/d45/f6e zero size 2024-05-06T21:26:32.569 INFO:tasks.workunit.client.0.smithi032.stdout:4/323: chown d2/f11 23 1 2024-05-06T21:26:32.569 INFO:tasks.workunit.client.0.smithi032.stdout:1/295: mkdir db/d16/d46/d57/d58 0 2024-05-06T21:26:32.575 INFO:tasks.workunit.client.0.smithi032.stdout:4/324: symlink d2/d16/d44/d45/d4e/l6f 0 2024-05-06T21:26:32.575 INFO:tasks.workunit.client.0.smithi032.stdout:4/325: rename d2 to d2/d16/d44/d70 22 2024-05-06T21:26:32.576 INFO:tasks.workunit.client.0.smithi032.stdout:1/296: symlink db/d16/d46/d55/l59 0 2024-05-06T21:26:32.577 INFO:tasks.workunit.client.0.smithi032.stdout:4/326: symlink d2/d1e/d47/l71 0 2024-05-06T21:26:32.577 INFO:tasks.workunit.client.0.smithi032.stdout:4/327: readlink d2/d13/l15 0 2024-05-06T21:26:32.577 INFO:tasks.workunit.client.0.smithi032.stdout:4/328: chown d2/d2c/d31/l37 706758968 1 2024-05-06T21:26:32.579 INFO:tasks.workunit.client.0.smithi032.stdout:4/329: unlink d2/d16/c65 0 2024-05-06T21:26:32.583 INFO:tasks.workunit.client.0.smithi032.stdout:9/205: dwrite d1/f1a [0,4194304] 0 2024-05-06T21:26:32.583 INFO:tasks.workunit.client.0.smithi032.stdout:9/206: fdatasync d1/d13/d25/f2e 0 2024-05-06T21:26:32.583 INFO:tasks.workunit.client.0.smithi032.stdout:7/327: dwrite db/d12/d16/f57 [0,4194304] 0 2024-05-06T21:26:32.589 INFO:tasks.workunit.client.0.smithi032.stdout:9/207: dread d1/f2 [0,4194304] 0 2024-05-06T21:26:32.596 INFO:tasks.workunit.client.0.smithi032.stdout:7/328: dread f8 [0,4194304] 0 2024-05-06T21:26:32.618 INFO:tasks.workunit.client.0.smithi032.stdout:1/297: dwrite db/d16/f33 [0,4194304] 0 2024-05-06T21:26:32.618 INFO:tasks.workunit.client.0.smithi032.stdout:4/330: dwrite d2/d1e/f22 [0,4194304] 0 2024-05-06T21:26:32.618 INFO:tasks.workunit.client.0.smithi032.stdout:4/331: write d2/d13/f1b [1109696,26356] 0 2024-05-06T21:26:32.618 INFO:tasks.workunit.client.0.smithi032.stdout:7/329: dwrite f3 [0,4194304] 0 2024-05-06T21:26:32.618 INFO:tasks.workunit.client.0.smithi032.stdout:7/330: chown db/d12/d16/d21/d41/l52 233710 1 2024-05-06T21:26:32.618 INFO:tasks.workunit.client.0.smithi032.stdout:9/208: dwrite d1/d13/d25/f40 [0,4194304] 0 2024-05-06T21:26:32.621 INFO:tasks.workunit.client.0.smithi032.stdout:1/298: link db/c3f db/d37/d52/c5a 0 2024-05-06T21:26:32.624 INFO:tasks.workunit.client.0.smithi032.stdout:4/332: mknod d2/d16/d44/d54/d69/c72 0 2024-05-06T21:26:32.624 INFO:tasks.workunit.client.0.smithi032.stdout:4/333: write d2/d13/f57 [123786,56244] 0 2024-05-06T21:26:32.627 INFO:tasks.workunit.client.0.smithi032.stdout:9/209: dread d1/d13/d25/f40 [0,4194304] 0 2024-05-06T21:26:32.627 INFO:tasks.workunit.client.0.smithi032.stdout:9/210: chown d1/d13/f2a 262989051 1 2024-05-06T21:26:32.627 INFO:tasks.workunit.client.0.smithi032.stdout:9/211: fsync d1/d13/d25/f40 0 2024-05-06T21:26:32.627 INFO:tasks.workunit.client.0.smithi032.stdout:7/331: symlink db/d12/d16/d21/d41/l64 0 2024-05-06T21:26:32.627 INFO:tasks.workunit.client.0.smithi032.stdout:7/332: write db/d12/d16/d2a/d39/d3b/f3d [1646246,41110] 0 2024-05-06T21:26:32.627 INFO:tasks.workunit.client.0.smithi032.stdout:7/333: chown db/d12/d16/d2a/d39/l5d 1778651 1 2024-05-06T21:26:32.628 INFO:tasks.workunit.client.0.smithi032.stdout:7/334: dread db/d12/f19 [0,4194304] 0 2024-05-06T21:26:32.630 INFO:tasks.workunit.client.0.smithi032.stdout:4/334: symlink d2/d1e/d47/l73 0 2024-05-06T21:26:32.632 INFO:tasks.workunit.client.0.smithi032.stdout:7/335: creat db/d12/d16/d21/d41/d4b/f65 x:0 0 0 2024-05-06T21:26:32.634 INFO:tasks.workunit.client.0.smithi032.stdout:4/335: mkdir d2/d16/d44/d74 0 2024-05-06T21:26:32.634 INFO:tasks.workunit.client.0.smithi032.stdout:3/167: sync 2024-05-06T21:26:32.634 INFO:tasks.workunit.client.0.smithi032.stdout:0/231: sync 2024-05-06T21:26:32.634 INFO:tasks.workunit.client.0.smithi032.stdout:2/142: sync 2024-05-06T21:26:32.634 INFO:tasks.workunit.client.0.smithi032.stdout:0/232: readlink d4/l4e 0 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:5/101: sync 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:5/102: stat d0/d11 0 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:3/168: creat d1/d4/da/f38 x:0 0 0 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:2/143: creat df/d19/d1e/d1f/f2b x:0 0 0 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:8/193: sync 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:8/194: creat d0/d1b/f34 x:0 0 0 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:3/169: write d1/d4/d11/f36 [507917,76017] 0 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:3/170: chown d1/d4/da/f38 652791471 1 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:6/207: sync 2024-05-06T21:26:32.635 INFO:tasks.workunit.client.0.smithi032.stdout:7/336: unlink db/d12/f1c 0 2024-05-06T21:26:32.639 INFO:tasks.workunit.client.0.smithi032.stdout:6/208: write d8/f10 [7183509,32830] 0 2024-05-06T21:26:32.639 INFO:tasks.workunit.client.0.smithi032.stdout:5/103: link d0/f5 d0/f18 0 2024-05-06T21:26:32.643 INFO:tasks.workunit.client.0.smithi032.stdout:8/195: rename d0/d1b/c28 to d0/c35 0 2024-05-06T21:26:32.645 INFO:tasks.workunit.client.0.smithi032.stdout:3/171: rename d1/fb to d1/f39 0 2024-05-06T21:26:32.646 INFO:tasks.workunit.client.0.smithi032.stdout:7/337: write db/f10 [56875,93115] 0 2024-05-06T21:26:32.647 INFO:tasks.workunit.client.0.smithi032.stdout:8/196: symlink d0/d1c/l36 0 2024-05-06T21:26:32.648 INFO:tasks.workunit.client.0.smithi032.stdout:7/338: mknod db/d12/c66 0 2024-05-06T21:26:32.652 INFO:tasks.workunit.client.0.smithi032.stdout:6/209: write d8/f17 [2088697,130016] 0 2024-05-06T21:26:32.671 INFO:tasks.workunit.client.0.smithi032.stdout:7/339: dwrite db/d12/d16/d2a/d39/d3b/f3d [0,4194304] 0 2024-05-06T21:26:32.673 INFO:tasks.workunit.client.0.smithi032.stdout:7/340: unlink f8 0 2024-05-06T21:26:32.673 INFO:tasks.workunit.client.0.smithi032.stdout:7/341: readlink db/d12/d16/d21/d41/l60 0 2024-05-06T21:26:32.673 INFO:tasks.workunit.client.0.smithi032.stdout:7/342: fsync db/d12/f17 0 2024-05-06T21:26:32.673 INFO:tasks.workunit.client.0.smithi032.stdout:7/343: chown db/d12/d16/d21/d41/l64 417280223 1 2024-05-06T21:26:32.713 INFO:tasks.workunit.client.0.smithi032.stdout:1/299: dwrite db/d2a/f49 [0,4194304] 0 2024-05-06T21:26:32.716 INFO:tasks.workunit.client.0.smithi032.stdout:4/336: dread d2/d1e/f25 [0,4194304] 0 2024-05-06T21:26:32.717 INFO:tasks.workunit.client.0.smithi032.stdout:1/300: rename f9 to db/d2a/f5b 0 2024-05-06T21:26:32.719 INFO:tasks.workunit.client.0.smithi032.stdout:4/337: truncate d2/d16/d44/d45/f48 50297 0 2024-05-06T21:26:32.719 INFO:tasks.workunit.client.0.smithi032.stdout:4/338: dread - d2/d13/f56 zero size 2024-05-06T21:26:32.719 INFO:tasks.workunit.client.0.smithi032.stdout:4/339: truncate d2/d16/d44/f5c 593498 0 2024-05-06T21:26:32.723 INFO:tasks.workunit.client.0.smithi032.stdout:4/340: mknod d2/d2c/c75 0 2024-05-06T21:26:32.724 INFO:tasks.workunit.client.0.smithi032.stdout:1/301: write db/d2a/f2d [41564,126334] 0 2024-05-06T21:26:32.724 INFO:tasks.workunit.client.0.smithi032.stdout:1/302: chown db/f1f 3543130 1 2024-05-06T21:26:32.724 INFO:tasks.workunit.client.0.smithi032.stdout:1/303: write db/d2a/f50 [566714,124150] 0 2024-05-06T21:26:32.724 INFO:tasks.workunit.client.0.smithi032.stdout:4/341: mkdir d2/d16/d44/d74/d76 0 2024-05-06T21:26:32.727 INFO:tasks.workunit.client.0.smithi032.stdout:4/342: symlink d2/d2c/d30/l77 0 2024-05-06T21:26:32.730 INFO:tasks.workunit.client.0.smithi032.stdout:4/343: truncate d2/d2c/d31/f5a 3863384 0 2024-05-06T21:26:32.730 INFO:tasks.workunit.client.0.smithi032.stdout:4/344: fsync d2/d16/f5e 0 2024-05-06T21:26:32.730 INFO:tasks.workunit.client.0.smithi032.stdout:4/345: truncate d2/d16/d44/d45/f6e 336205 0 2024-05-06T21:26:32.733 INFO:tasks.workunit.client.0.smithi032.stdout:4/346: link d2/d16/d44/d45/d4e/f6b d2/d1e/f78 0 2024-05-06T21:26:32.737 INFO:tasks.workunit.client.0.smithi032.stdout:4/347: mkdir d2/d16/d44/d74/d79 0 2024-05-06T21:26:32.739 INFO:tasks.workunit.client.0.smithi032.stdout:4/348: rmdir d2/d16/d44/d54/d69 39 2024-05-06T21:26:32.739 INFO:tasks.workunit.client.0.smithi032.stdout:4/349: readlink d2/d1e/l58 0 2024-05-06T21:26:32.742 INFO:tasks.workunit.client.0.smithi032.stdout:4/350: unlink d2/d2c/l60 0 2024-05-06T21:26:32.742 INFO:tasks.workunit.client.0.smithi032.stdout:4/351: fdatasync d2/f46 0 2024-05-06T21:26:32.742 INFO:tasks.workunit.client.0.smithi032.stdout:4/352: fsync d2/d1e/f4c 0 2024-05-06T21:26:32.742 INFO:tasks.workunit.client.0.smithi032.stdout:4/353: chown d2/d16/d44/d45/d4e/f6b 306 1 2024-05-06T21:26:32.743 INFO:tasks.workunit.client.0.smithi032.stdout:4/354: symlink d2/d16/d44/d74/d76/l7a 0 2024-05-06T21:26:32.750 INFO:tasks.workunit.client.0.smithi032.stdout:7/344: dwrite db/d12/f51 [0,4194304] 0 2024-05-06T21:26:32.783 INFO:tasks.workunit.client.0.smithi032.stdout:9/212: dwrite d1/f18 [0,4194304] 0 2024-05-06T21:26:32.789 INFO:tasks.workunit.client.0.smithi032.stdout:2/144: rmdir df/d19/d1e 39 2024-05-06T21:26:32.790 INFO:tasks.workunit.client.0.smithi032.stdout:5/104: rmdir d0 39 2024-05-06T21:26:32.792 INFO:tasks.workunit.client.0.smithi032.stdout:9/213: unlink d1/d13/d25/f40 0 2024-05-06T21:26:32.793 INFO:tasks.workunit.client.0.smithi032.stdout:9/214: write d1/f2 [38718,25673] 0 2024-05-06T21:26:32.793 INFO:tasks.workunit.client.0.smithi032.stdout:9/215: chown d1/fe 335 1 2024-05-06T21:26:32.794 INFO:tasks.workunit.client.0.smithi032.stdout:2/145: rename df/f10 to df/f2c 0 2024-05-06T21:26:32.798 INFO:tasks.workunit.client.0.smithi032.stdout:8/197: rmdir d0/d1b 39 2024-05-06T21:26:32.798 INFO:tasks.workunit.client.0.smithi032.stdout:9/216: rename d1/d13/d25/c3e to d1/d13/d34/d26/d39/c41 0 2024-05-06T21:26:32.800 INFO:tasks.workunit.client.0.smithi032.stdout:2/146: mkdir df/d19/d1e/d23/d25/d2d 0 2024-05-06T21:26:32.802 INFO:tasks.workunit.client.0.smithi032.stdout:2/147: mkdir df/d19/d1e/d1f/d2e 0 2024-05-06T21:26:32.804 INFO:tasks.workunit.client.0.smithi032.stdout:7/345: write db/d12/d49/f4d [182527,110308] 0 2024-05-06T21:26:32.804 INFO:tasks.workunit.client.0.smithi032.stdout:7/346: chown db/d12/d16/d2a/d53/l26 188779790 1 2024-05-06T21:26:32.804 INFO:tasks.workunit.client.0.smithi032.stdout:7/347: truncate db/d12/d16/d21/f4a 4963461 0 2024-05-06T21:26:32.804 INFO:tasks.workunit.client.0.smithi032.stdout:7/348: write db/d12/d16/d2a/f42 [56214,115383] 0 2024-05-06T21:26:32.804 INFO:tasks.workunit.client.0.smithi032.stdout:7/349: creat db/d12/d49/f67 x:0 0 0 2024-05-06T21:26:32.815 INFO:tasks.workunit.client.0.smithi032.stdout:3/172: dwrite d1/d4/da/f2f [4194304,4194304] 0 2024-05-06T21:26:32.815 INFO:tasks.workunit.client.0.smithi032.stdout:3/173: fsync d1/f14 0 2024-05-06T21:26:32.815 INFO:tasks.workunit.client.0.smithi032.stdout:3/174: readlink d1/d4/d11/d26/l28 0 2024-05-06T21:26:32.842 INFO:tasks.workunit.client.0.smithi032.stdout:7/350: dread db/d12/d16/d21/d41/d4b/f59 [0,4194304] 0 2024-05-06T21:26:32.846 INFO:tasks.workunit.client.0.smithi032.stdout:6/210: dwrite d8/dd/d18/d13/f2a [0,4194304] 0 2024-05-06T21:26:32.846 INFO:tasks.workunit.client.0.smithi032.stdout:6/211: write d8/f10 [1537515,8422] 0 2024-05-06T21:26:32.846 INFO:tasks.workunit.client.0.smithi032.stdout:6/212: chown d8/dd/d18/d13 1779715 1 2024-05-06T21:26:32.846 INFO:tasks.workunit.client.0.smithi032.stdout:6/213: write d8/dd/f12 [2588422,80310] 0 2024-05-06T21:26:32.853 INFO:tasks.workunit.client.0.smithi032.stdout:6/214: rmdir d8/dd 39 2024-05-06T21:26:32.853 INFO:tasks.workunit.client.0.smithi032.stdout:6/215: readlink d8/dd/l1c 0 2024-05-06T21:26:32.853 INFO:tasks.workunit.client.0.smithi032.stdout:6/216: read - d8/dd/d18/d13/f24 zero size 2024-05-06T21:26:32.854 INFO:tasks.workunit.client.0.smithi032.stdout:6/217: symlink d8/dd/d1b/l32 0 2024-05-06T21:26:32.884 INFO:tasks.workunit.client.0.smithi032.stdout:1/304: dwrite db/d16/d46/f4e [0,4194304] 0 2024-05-06T21:26:32.884 INFO:tasks.workunit.client.0.smithi032.stdout:1/305: fsync db/d16/f33 0 2024-05-06T21:26:32.888 INFO:tasks.workunit.client.0.smithi032.stdout:1/306: symlink db/d47/l5c 0 2024-05-06T21:26:32.888 INFO:tasks.workunit.client.0.smithi032.stdout:1/307: chown db/f2e 118152000 1 2024-05-06T21:26:32.927 INFO:tasks.workunit.client.0.smithi032.stdout:9/217: write d1/f31 [1499051,52519] 0 2024-05-06T21:26:32.935 INFO:tasks.workunit.client.0.smithi032.stdout:8/198: write d0/f16 [1802680,114404] 0 2024-05-06T21:26:32.935 INFO:tasks.workunit.client.0.smithi032.stdout:8/199: creat d0/f37 x:0 0 0 2024-05-06T21:26:32.939 INFO:tasks.workunit.client.0.smithi032.stdout:8/200: mknod d0/d1c/c38 0 2024-05-06T21:26:32.952 INFO:tasks.workunit.client.0.smithi032.stdout:2/148: dread df/f12 [0,4194304] 0 2024-05-06T21:26:32.954 INFO:tasks.workunit.client.0.smithi032.stdout:2/149: symlink df/d19/d1e/d23/d25/l2f 0 2024-05-06T21:26:32.972 INFO:tasks.workunit.client.0.smithi032.stdout:6/218: write d8/f2b [1794061,71158] 0 2024-05-06T21:26:33.024 INFO:tasks.workunit.client.0.smithi032.stdout:9/218: read d1/f1a [2433946,105334] 0 2024-05-06T21:26:33.300 INFO:tasks.workunit.client.0.smithi032.stdout:9/219: dwrite d1/d13/d34/f32 [0,4194304] 0 2024-05-06T21:26:33.304 INFO:tasks.workunit.client.0.smithi032.stdout:9/220: symlink d1/d13/d33/d3f/l42 0 2024-05-06T21:26:33.305 INFO:tasks.workunit.client.0.smithi032.stdout:9/221: write d1/d2f/f3c [257243,124926] 0 2024-05-06T21:26:33.306 INFO:tasks.workunit.client.0.smithi032.stdout:1/308: dwrite db/d16/d46/f4e [0,4194304] 0 2024-05-06T21:26:33.306 INFO:tasks.workunit.client.0.smithi032.stdout:9/222: truncate d1/d13/d34/d26/f29 301686 0 2024-05-06T21:26:33.308 INFO:tasks.workunit.client.0.smithi032.stdout:9/223: creat d1/d13/d34/f43 x:0 0 0 2024-05-06T21:26:33.349 INFO:tasks.workunit.client.0.smithi032.stdout:9/224: read d1/fe [8027,32972] 0 2024-05-06T21:26:33.353 INFO:tasks.workunit.client.0.smithi032.stdout:9/225: truncate d1/f23 1014362 0 2024-05-06T21:26:33.397 INFO:tasks.workunit.client.0.smithi032.stdout:9/226: write d1/f10 [2208576,93638] 0 2024-05-06T21:26:33.397 INFO:tasks.workunit.client.0.smithi032.stdout:9/227: chown d1/cf 39551 1 2024-05-06T21:26:33.413 INFO:tasks.workunit.client.0.smithi032.stdout:9/228: dread d1/f18 [0,4194304] 0 2024-05-06T21:26:33.413 INFO:tasks.workunit.client.0.smithi032.stdout:4/355: rmdir d2/d2c 39 2024-05-06T21:26:33.416 INFO:tasks.workunit.client.0.smithi032.stdout:9/229: mknod d1/d13/d25/c44 0 2024-05-06T21:26:33.416 INFO:tasks.workunit.client.0.smithi032.stdout:4/356: mknod d2/d16/d44/d74/d79/c7b 0 2024-05-06T21:26:33.418 INFO:tasks.workunit.client.0.smithi032.stdout:4/357: rename d2/d2c/d30 to d2/d2c/d31/d7c 0 2024-05-06T21:26:33.421 INFO:tasks.workunit.client.0.smithi032.stdout:4/358: unlink d2/d16/f36 0 2024-05-06T21:26:33.425 INFO:tasks.workunit.client.0.smithi032.stdout:2/150: fsync df/f2c 0 2024-05-06T21:26:33.432 INFO:tasks.workunit.client.0.smithi032.stdout:4/359: dread d2/d16/f52 [0,4194304] 0 2024-05-06T21:26:33.432 INFO:tasks.workunit.client.0.smithi032.stdout:4/360: truncate d2/d2c/f49 440409 0 2024-05-06T21:26:33.443 INFO:tasks.workunit.client.0.smithi032.stdout:2/151: dread f7 [0,4194304] 0 2024-05-06T21:26:33.443 INFO:tasks.workunit.client.0.smithi032.stdout:2/152: chown df/d14/f15 208355 1 2024-05-06T21:26:33.448 INFO:tasks.workunit.client.0.smithi032.stdout:2/153: mknod df/d19/d1e/d23/d25/d2d/c30 0 2024-05-06T21:26:33.448 INFO:tasks.workunit.client.0.smithi032.stdout:2/154: fsync df/d14/f20 0 2024-05-06T21:26:33.450 INFO:tasks.workunit.client.0.smithi032.stdout:2/155: link df/d14/f27 df/f31 0 2024-05-06T21:26:33.453 INFO:tasks.workunit.client.0.smithi032.stdout:2/156: symlink df/l32 0 2024-05-06T21:26:33.453 INFO:tasks.workunit.client.0.smithi032.stdout:2/157: write df/d14/f20 [60436,119279] 0 2024-05-06T21:26:33.560 INFO:tasks.workunit.client.0.smithi032.stdout:9/230: write d1/d13/d34/d26/f29 [1259518,127338] 0 2024-05-06T21:26:33.565 INFO:tasks.workunit.client.0.smithi032.stdout:9/231: rmdir d1/d13/d25 39 2024-05-06T21:26:33.577 INFO:tasks.workunit.client.0.smithi032.stdout:2/158: rename df/d14 to df/d19/d1e/d1f/d2e/d33 0 2024-05-06T21:26:33.581 INFO:tasks.workunit.client.0.smithi032.stdout:2/159: dread f7 [0,4194304] 0 2024-05-06T21:26:33.581 INFO:tasks.workunit.client.0.smithi032.stdout:2/160: write df/d19/d1e/d1f/d2e/d33/f20 [930150,55637] 0 2024-05-06T21:26:33.581 INFO:tasks.workunit.client.0.smithi032.stdout:2/161: write df/f1c [361622,35574] 0 2024-05-06T21:26:33.581 INFO:tasks.workunit.client.0.smithi032.stdout:2/162: fdatasync f7 0 2024-05-06T21:26:33.581 INFO:tasks.workunit.client.0.smithi032.stdout:2/163: dread - df/d19/d1e/d1f/f2a zero size 2024-05-06T21:26:33.581 INFO:tasks.workunit.client.0.smithi032.stdout:2/164: truncate df/d19/d1e/d1f/d2e/d33/f24 451284 0 2024-05-06T21:26:33.581 INFO:tasks.workunit.client.0.smithi032.stdout:2/165: readlink df/l32 0 2024-05-06T21:26:33.583 INFO:tasks.workunit.client.0.smithi032.stdout:2/166: mknod df/d19/d1e/d23/d25/d2d/c34 0 2024-05-06T21:26:33.585 INFO:tasks.workunit.client.0.smithi032.stdout:2/167: mkdir df/d19/d1e/d35 0 2024-05-06T21:26:33.585 INFO:tasks.workunit.client.0.smithi032.stdout:2/168: getdents df/d19/d1e/d35 0 2024-05-06T21:26:33.588 INFO:tasks.workunit.client.0.smithi032.stdout:2/169: creat df/d19/d1e/d23/f36 x:0 0 0 2024-05-06T21:26:33.588 INFO:tasks.workunit.client.0.smithi032.stdout:2/170: read df/f12 [3194922,73441] 0 2024-05-06T21:26:33.590 INFO:tasks.workunit.client.0.smithi032.stdout:2/171: creat df/d19/d1e/d23/d25/f37 x:0 0 0 2024-05-06T21:26:33.611 INFO:tasks.workunit.client.0.smithi032.stdout:9/232: dread d1/d13/d34/d26/f29 [0,4194304] 0 2024-05-06T21:26:33.612 INFO:tasks.workunit.client.0.smithi032.stdout:9/233: truncate d1/fe 146145 0 2024-05-06T21:26:33.612 INFO:tasks.workunit.client.0.smithi032.stdout:9/234: write d1/d13/d34/f43 [651730,111260] 0 2024-05-06T21:26:33.612 INFO:tasks.workunit.client.0.smithi032.stdout:9/235: chown d1/d13/d33/d3f/l42 12 1 2024-05-06T21:26:33.612 INFO:tasks.workunit.client.0.smithi032.stdout:9/236: chown d1/d13/d34 6 1 2024-05-06T21:26:33.613 INFO:tasks.workunit.client.0.smithi032.stdout:9/237: mkdir d1/d13/d34/d26/d39/d45 0 2024-05-06T21:26:33.614 INFO:tasks.workunit.client.0.smithi032.stdout:9/238: mknod d1/d13/d34/c46 0 2024-05-06T21:26:33.615 INFO:tasks.workunit.client.0.smithi032.stdout:9/239: symlink d1/d13/d33/d3f/l47 0 2024-05-06T21:26:33.616 INFO:tasks.workunit.client.0.smithi032.stdout:9/240: creat d1/d13/d34/f48 x:0 0 0 2024-05-06T21:26:33.618 INFO:tasks.workunit.client.0.smithi032.stdout:9/241: mkdir d1/d13/d34/d26/d49 0 2024-05-06T21:26:33.618 INFO:tasks.workunit.client.0.smithi032.stdout:9/242: chown d1/l36 8956 1 2024-05-06T21:26:33.619 INFO:tasks.workunit.client.0.smithi032.stdout:9/243: creat d1/d13/d34/d26/d39/d45/f4a x:0 0 0 2024-05-06T21:26:33.635 INFO:tasks.workunit.client.0.smithi032.stdout:2/172: dwrite df/d19/d1e/d1f/d2e/d33/f15 [0,4194304] 0 2024-05-06T21:26:33.635 INFO:tasks.workunit.client.0.smithi032.stdout:2/173: rename df/d19 to df/d19/d38 22 2024-05-06T21:26:33.637 INFO:tasks.workunit.client.0.smithi032.stdout:2/174: mknod df/c39 0 2024-05-06T21:26:33.696 INFO:tasks.workunit.client.0.smithi032.stdout:2/175: dwrite df/d19/d1e/d1f/d2e/d33/f29 [4194304,4194304] 0 2024-05-06T21:26:33.698 INFO:tasks.workunit.client.0.smithi032.stdout:2/176: symlink df/d19/d1e/d35/l3a 0 2024-05-06T21:26:33.698 INFO:tasks.workunit.client.0.smithi032.stdout:2/177: dread - df/d19/d1e/d1f/d2e/d33/f27 zero size 2024-05-06T21:26:33.698 INFO:tasks.workunit.client.0.smithi032.stdout:2/178: creat df/d19/d1e/d23/d25/f3b x:0 0 0 2024-05-06T21:26:33.703 INFO:tasks.workunit.client.0.smithi032.stdout:2/179: dread df/d19/d1e/d1f/d2e/d33/f17 [0,4194304] 0 2024-05-06T21:26:33.704 INFO:tasks.workunit.client.0.smithi032.stdout:2/180: chown c6 50 1 2024-05-06T21:26:33.704 INFO:tasks.workunit.client.0.smithi032.stdout:2/181: dread - df/d19/d1e/d1f/d2e/d33/f27 zero size 2024-05-06T21:26:33.704 INFO:tasks.workunit.client.0.smithi032.stdout:2/182: fdatasync df/d19/d1e/d23/d25/f37 0 2024-05-06T21:26:33.704 INFO:tasks.workunit.client.0.smithi032.stdout:2/183: chown df/d19/d1e/l21 119 1 2024-05-06T21:26:33.879 INFO:tasks.workunit.client.0.smithi032.stdout:9/244: truncate d1/f23 356931 0 2024-05-06T21:26:33.881 INFO:tasks.workunit.client.0.smithi032.stdout:3/175: dwrite d1/f39 [0,4194304] 0 2024-05-06T21:26:33.881 INFO:tasks.workunit.client.0.smithi032.stdout:3/176: dread - d1/d4/da/f32 zero size 2024-05-06T21:26:33.881 INFO:tasks.workunit.client.0.smithi032.stdout:3/177: fdatasync d1/d4/f30 0 2024-05-06T21:26:33.881 INFO:tasks.workunit.client.0.smithi032.stdout:3/178: creat d1/f3a x:0 0 0 2024-05-06T21:26:33.881 INFO:tasks.workunit.client.0.smithi032.stdout:3/179: chown d1/d4/f30 5 1 2024-05-06T21:26:33.889 INFO:tasks.workunit.client.0.smithi032.stdout:2/184: dwrite df/d19/d1e/d23/f36 [0,4194304] 0 2024-05-06T21:26:33.890 INFO:tasks.workunit.client.0.smithi032.stdout:9/245: dread d1/d13/d34/d26/f27 [0,4194304] 0 2024-05-06T21:26:33.893 INFO:tasks.workunit.client.0.smithi032.stdout:9/246: creat d1/d13/d25/f4b x:0 0 0 2024-05-06T21:26:33.916 INFO:tasks.workunit.client.0.smithi032.stdout:2/185: dwrite df/d19/d1e/f28 [0,4194304] 0 2024-05-06T21:26:33.919 INFO:tasks.workunit.client.0.smithi032.stdout:2/186: creat df/d19/d1e/d1f/d2e/f3c x:0 0 0 2024-05-06T21:26:33.919 INFO:tasks.workunit.client.0.smithi032.stdout:2/187: write fe [2279529,80375] 0 2024-05-06T21:26:33.922 INFO:tasks.workunit.client.0.smithi032.stdout:9/247: dwrite d1/d13/f16 [4194304,4194304] 0 2024-05-06T21:26:33.925 INFO:tasks.workunit.client.0.smithi032.stdout:2/188: truncate df/d19/d1e/f28 2694504 0 2024-05-06T21:26:33.927 INFO:tasks.workunit.client.0.smithi032.stdout:2/189: creat df/d19/d1e/d35/f3d x:0 0 0 2024-05-06T21:26:33.927 INFO:tasks.workunit.client.0.smithi032.stdout:2/190: dread - df/d19/d1e/d23/d25/f3b zero size 2024-05-06T21:26:33.927 INFO:tasks.workunit.client.0.smithi032.stdout:2/191: fsync df/f31 0 2024-05-06T21:26:33.928 INFO:tasks.workunit.client.0.smithi032.stdout:2/192: symlink df/d19/d1e/d23/d25/d2d/l3e 0 2024-05-06T21:26:33.929 INFO:tasks.workunit.client.0.smithi032.stdout:2/193: write df/d19/d1e/d23/d25/f3b [611516,79317] 0 2024-05-06T21:26:33.932 INFO:tasks.workunit.client.0.smithi032.stdout:7/351: dwrite db/d12/d16/d21/f44 [8388608,4194304] 0 2024-05-06T21:26:33.938 INFO:tasks.workunit.client.0.smithi032.stdout:2/194: fsync fe 0 2024-05-06T21:26:33.940 INFO:tasks.workunit.client.0.smithi032.stdout:8/201: dwrite d0/f1a [0,4194304] 0 2024-05-06T21:26:33.940 INFO:tasks.workunit.client.0.smithi032.stdout:8/202: dread - d0/f8 zero size 2024-05-06T21:26:33.943 INFO:tasks.workunit.client.0.smithi032.stdout:2/195: mkdir df/d19/d1e/d35/d3f 0 2024-05-06T21:26:33.944 INFO:tasks.workunit.client.0.smithi032.stdout:7/352: dread db/d12/d16/f24 [0,4194304] 0 2024-05-06T21:26:33.946 INFO:tasks.workunit.client.0.smithi032.stdout:8/203: truncate d0/d1b/f2f 1295659 0 2024-05-06T21:26:33.946 INFO:tasks.workunit.client.0.smithi032.stdout:2/196: symlink df/d19/d1e/d23/l40 0 2024-05-06T21:26:33.946 INFO:tasks.workunit.client.0.smithi032.stdout:2/197: creat df/d19/d1e/d35/f41 x:0 0 0 2024-05-06T21:26:33.946 INFO:tasks.workunit.client.0.smithi032.stdout:2/198: fdatasync df/d19/d1e/d1f/d2e/d33/f1d 0 2024-05-06T21:26:33.947 INFO:tasks.workunit.client.0.smithi032.stdout:9/248: dwrite d1/d13/d34/f48 [0,4194304] 0 2024-05-06T21:26:33.954 INFO:tasks.workunit.client.0.smithi032.stdout:9/249: rename d1/d13/c2d to d1/d13/d34/d26/d49/c4c 0 2024-05-06T21:26:33.954 INFO:tasks.workunit.client.0.smithi032.stdout:9/250: chown d1/d13/d33/d3f 3 1 2024-05-06T21:26:33.954 INFO:tasks.workunit.client.0.smithi032.stdout:9/251: chown d1/d2f/c3a 0 1 2024-05-06T21:26:33.959 INFO:tasks.workunit.client.0.smithi032.stdout:9/252: getdents d1/d13/d34 0 2024-05-06T21:26:33.968 INFO:tasks.workunit.client.0.smithi032.stdout:9/253: write d1/f18 [1359992,32531] 0 2024-05-06T21:26:33.971 INFO:tasks.workunit.client.0.smithi032.stdout:9/254: rename d1/d13/l17 to d1/l4d 0 2024-05-06T21:26:33.971 INFO:tasks.workunit.client.0.smithi032.stdout:9/255: stat d1/d13/d33/d3f/l42 0 2024-05-06T21:26:33.971 INFO:tasks.workunit.client.0.smithi032.stdout:9/256: fdatasync d1/f12 0 2024-05-06T21:26:33.971 INFO:tasks.workunit.client.0.smithi032.stdout:8/204: dwrite d0/d1c/f22 [0,4194304] 0 2024-05-06T21:26:33.971 INFO:tasks.workunit.client.0.smithi032.stdout:8/205: readlink d0/d1b/l2a 0 2024-05-06T21:26:33.972 INFO:tasks.workunit.client.0.smithi032.stdout:9/257: creat d1/d13/d33/d3f/f4e x:0 0 0 2024-05-06T21:26:33.972 INFO:tasks.workunit.client.0.smithi032.stdout:9/258: fdatasync d1/d13/d33/d3f/f4e 0 2024-05-06T21:26:33.974 INFO:tasks.workunit.client.0.smithi032.stdout:2/199: dwrite df/f1c [0,4194304] 0 2024-05-06T21:26:33.974 INFO:tasks.workunit.client.0.smithi032.stdout:2/200: chown c6 18 1 2024-05-06T21:26:33.979 INFO:tasks.workunit.client.0.smithi032.stdout:2/201: mkdir df/d19/d1e/d42 0 2024-05-06T21:26:33.981 INFO:tasks.workunit.client.0.smithi032.stdout:6/219: dread d8/f10 [4194304,4194304] 0 2024-05-06T21:26:33.983 INFO:tasks.workunit.client.0.smithi032.stdout:2/202: creat df/d19/d1e/d1f/f43 x:0 0 0 2024-05-06T21:26:33.983 INFO:tasks.workunit.client.0.smithi032.stdout:2/203: write df/d19/d1e/d35/f3d [757530,6275] 0 2024-05-06T21:26:33.983 INFO:tasks.workunit.client.0.smithi032.stdout:2/204: fsync df/d19/d1e/d1f/d2e/d33/f17 0 2024-05-06T21:26:33.983 INFO:tasks.workunit.client.0.smithi032.stdout:8/206: truncate d0/d1c/f22 1116411 0 2024-05-06T21:26:33.984 INFO:tasks.workunit.client.0.smithi032.stdout:6/220: mkdir d8/d33 0 2024-05-06T21:26:33.985 INFO:tasks.workunit.client.0.smithi032.stdout:2/205: creat df/d19/d1e/d35/d3f/f44 x:0 0 0 2024-05-06T21:26:33.987 INFO:tasks.workunit.client.0.smithi032.stdout:8/207: mkdir d0/d1b/d39 0 2024-05-06T21:26:33.987 INFO:tasks.workunit.client.0.smithi032.stdout:8/208: read d0/fe [660811,75748] 0 2024-05-06T21:26:33.987 INFO:tasks.workunit.client.0.smithi032.stdout:8/209: write d0/f3 [4647305,122514] 0 2024-05-06T21:26:33.988 INFO:tasks.workunit.client.0.smithi032.stdout:2/206: chown lb 501429867 1 2024-05-06T21:26:33.989 INFO:tasks.workunit.client.0.smithi032.stdout:6/221: getdents d8/dd 0 2024-05-06T21:26:33.989 INFO:tasks.workunit.client.0.smithi032.stdout:6/222: symlink d8/d33/l34 0 2024-05-06T21:26:33.991 INFO:tasks.workunit.client.0.smithi032.stdout:6/223: mkdir d8/dd/d1b/d35 0 2024-05-06T21:26:33.994 INFO:tasks.workunit.client.0.smithi032.stdout:6/224: creat d8/d33/f36 x:0 0 0 2024-05-06T21:26:33.996 INFO:tasks.workunit.client.0.smithi032.stdout:9/259: dwrite d1/f7 [4194304,4194304] 0 2024-05-06T21:26:33.996 INFO:tasks.workunit.client.0.smithi032.stdout:9/260: stat d1/d13/d34/f43 0 2024-05-06T21:26:33.998 INFO:tasks.workunit.client.0.smithi032.stdout:2/207: dread df/f2c [0,4194304] 0 2024-05-06T21:26:33.998 INFO:tasks.workunit.client.0.smithi032.stdout:6/225: creat d8/dd/d1b/d35/f37 x:0 0 0 2024-05-06T21:26:33.998 INFO:tasks.workunit.client.0.smithi032.stdout:6/226: rmdir d8/dd/d18 39 2024-05-06T21:26:34.000 INFO:tasks.workunit.client.0.smithi032.stdout:6/227: mknod d8/dd/d18/d22/c38 0 2024-05-06T21:26:34.010 INFO:tasks.workunit.client.0.smithi032.stdout:1/309: dwrite db/d37/f54 [0,4194304] 0 2024-05-06T21:26:34.019 INFO:tasks.workunit.client.0.smithi032.stdout:2/208: dwrite df/d19/d1e/d1f/f2a [0,4194304] 0 2024-05-06T21:26:34.019 INFO:tasks.workunit.client.0.smithi032.stdout:8/210: dwrite d0/f37 [0,4194304] 0 2024-05-06T21:26:34.019 INFO:tasks.workunit.client.0.smithi032.stdout:2/209: fdatasync df/d19/d1e/d23/d25/f3b 0 2024-05-06T21:26:34.023 INFO:tasks.workunit.client.0.smithi032.stdout:8/211: creat d0/d1b/d39/f3a x:0 0 0 2024-05-06T21:26:34.024 INFO:tasks.workunit.client.0.smithi032.stdout:8/212: mkdir d0/d1b/d39/d3b 0 2024-05-06T21:26:34.025 INFO:tasks.workunit.client.0.smithi032.stdout:9/261: dwrite d1/d13/d34/f32 [4194304,4194304] 0 2024-05-06T21:26:34.026 INFO:tasks.workunit.client.0.smithi032.stdout:6/228: dwrite d8/dd/d18/d13/f2c [0,4194304] 0 2024-05-06T21:26:34.026 INFO:tasks.workunit.client.0.smithi032.stdout:6/229: write d8/f17 [3968143,60554] 0 2024-05-06T21:26:34.026 INFO:tasks.workunit.client.0.smithi032.stdout:0/233: sync 2024-05-06T21:26:34.026 INFO:tasks.workunit.client.0.smithi032.stdout:8/213: symlink d0/d1b/l3c 0 2024-05-06T21:26:34.027 INFO:tasks.workunit.client.0.smithi032.stdout:8/214: read - d0/f8 zero size 2024-05-06T21:26:34.030 INFO:tasks.workunit.client.0.smithi032.stdout:9/262: mkdir d1/d2f/d4f 0 2024-05-06T21:26:34.031 INFO:tasks.workunit.client.0.smithi032.stdout:5/105: sync 2024-05-06T21:26:34.031 INFO:tasks.workunit.client.0.smithi032.stdout:2/210: dread df/d19/d1e/d23/f36 [0,4194304] 0 2024-05-06T21:26:34.031 INFO:tasks.workunit.client.0.smithi032.stdout:5/106: write d0/d11/f17 [593088,62884] 0 2024-05-06T21:26:34.031 INFO:tasks.workunit.client.0.smithi032.stdout:5/107: chown d0/f5 109146096 1 2024-05-06T21:26:34.031 INFO:tasks.workunit.client.0.smithi032.stdout:5/108: truncate d0/fe 4969711 0 2024-05-06T21:26:34.032 INFO:tasks.workunit.client.0.smithi032.stdout:8/215: symlink d0/d1b/d39/l3d 0 2024-05-06T21:26:34.033 INFO:tasks.workunit.client.0.smithi032.stdout:9/263: mknod d1/d13/c50 0 2024-05-06T21:26:34.033 INFO:tasks.workunit.client.0.smithi032.stdout:9/264: readlink d1/d13/d33/d3f/l42 0 2024-05-06T21:26:34.033 INFO:tasks.workunit.client.0.smithi032.stdout:9/265: truncate d1/d13/d34/d26/d39/d45/f4a 684664 0 2024-05-06T21:26:34.034 INFO:tasks.workunit.client.0.smithi032.stdout:0/234: getdents d4/da/d16/d33/d46 0 2024-05-06T21:26:34.035 INFO:tasks.workunit.client.0.smithi032.stdout:2/211: creat df/d19/d1e/d23/d25/d2d/f45 x:0 0 0 2024-05-06T21:26:34.037 INFO:tasks.workunit.client.0.smithi032.stdout:9/266: symlink d1/l51 0 2024-05-06T21:26:34.037 INFO:tasks.workunit.client.0.smithi032.stdout:9/267: creat d1/d13/d34/d26/d39/d45/f52 x:0 0 0 2024-05-06T21:26:34.038 INFO:tasks.workunit.client.0.smithi032.stdout:2/212: unlink df/d19/l22 0 2024-05-06T21:26:34.042 INFO:tasks.workunit.client.0.smithi032.stdout:9/268: unlink d1/d13/f1e 0 2024-05-06T21:26:34.043 INFO:tasks.workunit.client.0.smithi032.stdout:2/213: mkdir df/d19/d1e/d35/d3f/d46 0 2024-05-06T21:26:34.044 INFO:tasks.workunit.client.0.smithi032.stdout:9/269: rmdir d1/d13/d33 39 2024-05-06T21:26:34.045 INFO:tasks.workunit.client.0.smithi032.stdout:9/270: write d1/f23 [1399759,76231] 0 2024-05-06T21:26:34.050 INFO:tasks.workunit.client.0.smithi032.stdout:2/214: getdents df/d19 0 2024-05-06T21:26:34.050 INFO:tasks.workunit.client.0.smithi032.stdout:2/215: fsync df/f12 0 2024-05-06T21:26:34.050 INFO:tasks.workunit.client.0.smithi032.stdout:2/216: creat df/d19/d1e/d23/d25/d2d/f47 x:0 0 0 2024-05-06T21:26:34.051 INFO:tasks.workunit.client.0.smithi032.stdout:2/217: truncate df/d19/d1e/d1f/d2e/d33/f18 538134 0 2024-05-06T21:26:34.051 INFO:tasks.workunit.client.0.smithi032.stdout:2/218: dread - df/d19/d1e/d23/d25/f37 zero size 2024-05-06T21:26:34.052 INFO:tasks.workunit.client.0.smithi032.stdout:2/219: link df/d19/d1e/d23/d25/d2d/f45 df/d19/d1e/f48 0 2024-05-06T21:26:34.053 INFO:tasks.workunit.client.0.smithi032.stdout:2/220: truncate df/f1c 207280 0 2024-05-06T21:26:34.053 INFO:tasks.workunit.client.0.smithi032.stdout:2/221: read - df/f31 zero size 2024-05-06T21:26:34.059 INFO:tasks.workunit.client.0.smithi032.stdout:9/271: read d1/f31 [5819501,1983] 0 2024-05-06T21:26:34.061 INFO:tasks.workunit.client.0.smithi032.stdout:9/272: creat d1/d13/d33/d3f/f53 x:0 0 0 2024-05-06T21:26:34.065 INFO:tasks.workunit.client.0.smithi032.stdout:9/273: truncate d1/d13/d34/d26/f27 178547 0 2024-05-06T21:26:34.065 INFO:tasks.workunit.client.0.smithi032.stdout:9/274: write d1/d13/d25/f4b [169672,44840] 0 2024-05-06T21:26:34.068 INFO:tasks.workunit.client.0.smithi032.stdout:9/275: dread d1/d13/d34/f43 [0,4194304] 0 2024-05-06T21:26:34.074 INFO:tasks.workunit.client.0.smithi032.stdout:2/222: dwrite df/d19/d1e/d1f/d2e/d33/f18 [0,4194304] 0 2024-05-06T21:26:34.074 INFO:tasks.workunit.client.0.smithi032.stdout:2/223: chown df/d19/d1e/d23/d25/f3b 56058671 1 2024-05-06T21:26:34.078 INFO:tasks.workunit.client.0.smithi032.stdout:2/224: symlink df/d19/d1e/d1f/d2e/l49 0 2024-05-06T21:26:34.078 INFO:tasks.workunit.client.0.smithi032.stdout:2/225: write df/d19/d1e/d23/d25/d2d/f45 [872808,130289] 0 2024-05-06T21:26:34.078 INFO:tasks.workunit.client.0.smithi032.stdout:2/226: chown df/d19/d1e/d23/d25/d2d/f47 275206 1 2024-05-06T21:26:34.078 INFO:tasks.workunit.client.0.smithi032.stdout:2/227: symlink df/d19/d1e/d35/d3f/d46/l4a 0 2024-05-06T21:26:34.079 INFO:tasks.workunit.client.0.smithi032.stdout:2/228: creat df/d19/d1e/d23/d25/f4b x:0 0 0 2024-05-06T21:26:34.079 INFO:tasks.workunit.client.0.smithi032.stdout:9/276: dread d1/d13/d34/f48 [0,4194304] 0 2024-05-06T21:26:34.079 INFO:tasks.workunit.client.0.smithi032.stdout:6/230: dread f4 [4194304,4194304] 0 2024-05-06T21:26:34.079 INFO:tasks.workunit.client.0.smithi032.stdout:6/231: dread - d8/dd/d1b/d35/f37 zero size 2024-05-06T21:26:34.079 INFO:tasks.workunit.client.0.smithi032.stdout:6/232: read d8/dd/f12 [1417377,8098] 0 2024-05-06T21:26:34.079 INFO:tasks.workunit.client.0.smithi032.stdout:1/310: dwrite db/d37/f4b [0,4194304] 0 2024-05-06T21:26:34.079 INFO:tasks.workunit.client.0.smithi032.stdout:6/233: stat d8/f31 0 2024-05-06T21:26:34.080 INFO:tasks.workunit.client.0.smithi032.stdout:8/216: dwrite d0/d1b/f2f [0,4194304] 0 2024-05-06T21:26:34.080 INFO:tasks.workunit.client.0.smithi032.stdout:8/217: fsync d0/f1f 0 2024-05-06T21:26:34.080 INFO:tasks.workunit.client.0.smithi032.stdout:8/218: write d0/f10 [574890,82129] 0 2024-05-06T21:26:34.080 INFO:tasks.workunit.client.0.smithi032.stdout:8/219: fsync d0/fa 0 2024-05-06T21:26:34.080 INFO:tasks.workunit.client.0.smithi032.stdout:2/229: mknod df/d19/d1e/d23/d25/d2d/c4c 0 2024-05-06T21:26:34.081 INFO:tasks.workunit.client.0.smithi032.stdout:9/277: truncate d1/fe 498728 0 2024-05-06T21:26:34.084 INFO:tasks.workunit.client.0.smithi032.stdout:6/234: mkdir d8/dd/d18/d39 0 2024-05-06T21:26:34.084 INFO:tasks.workunit.client.0.smithi032.stdout:6/235: creat d8/dd/d1b/d35/f3a x:0 0 0 2024-05-06T21:26:34.084 INFO:tasks.workunit.client.0.smithi032.stdout:6/236: fdatasync d8/dd/d1b/d35/f37 0 2024-05-06T21:26:34.084 INFO:tasks.workunit.client.0.smithi032.stdout:6/237: dread - d8/f31 zero size 2024-05-06T21:26:34.086 INFO:tasks.workunit.client.0.smithi032.stdout:8/220: rename d0/f3 to d0/d1b/f3e 0 2024-05-06T21:26:34.086 INFO:tasks.workunit.client.0.smithi032.stdout:8/221: truncate d0/f7 557214 0 2024-05-06T21:26:34.087 INFO:tasks.workunit.client.0.smithi032.stdout:2/230: symlink df/d19/d1e/d23/d25/l4d 0 2024-05-06T21:26:34.088 INFO:tasks.workunit.client.0.smithi032.stdout:5/109: dread d0/d11/f17 [0,4194304] 0 2024-05-06T21:26:34.090 INFO:tasks.workunit.client.0.smithi032.stdout:8/222: mknod d0/d1b/c3f 0 2024-05-06T21:26:34.091 INFO:tasks.workunit.client.0.smithi032.stdout:2/231: creat df/d19/d1e/d42/f4e x:0 0 0 2024-05-06T21:26:34.091 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:33 smithi154 ceph-mon[32880]: pgmap v17: 65 pgs: 65 active+clean; 475 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 54 MiB/s wr, 945 op/s 2024-05-06T21:26:34.094 INFO:tasks.workunit.client.0.smithi032.stdout:6/238: getdents d8/d33 0 2024-05-06T21:26:34.094 INFO:tasks.workunit.client.0.smithi032.stdout:6/239: chown d8/d33/f36 20515923 1 2024-05-06T21:26:34.094 INFO:tasks.workunit.client.0.smithi032.stdout:6/240: chown d8/dd/d18/f23 2 1 2024-05-06T21:26:34.094 INFO:tasks.workunit.client.0.smithi032.stdout:6/241: write d8/f31 [679077,92862] 0 2024-05-06T21:26:34.094 INFO:tasks.workunit.client.0.smithi032.stdout:6/242: dread - d8/dd/f2e zero size 2024-05-06T21:26:34.095 INFO:tasks.workunit.client.0.smithi032.stdout:5/110: dread d0/fa [0,4194304] 0 2024-05-06T21:26:34.095 INFO:tasks.workunit.client.0.smithi032.stdout:8/223: unlink d0/cf 0 2024-05-06T21:26:34.097 INFO:tasks.workunit.client.0.smithi032.stdout:5/111: truncate d0/fa 4773357 0 2024-05-06T21:26:34.099 INFO:tasks.workunit.client.0.smithi032.stdout:8/224: rename d0/l13 to d0/d1c/l40 0 2024-05-06T21:26:34.099 INFO:tasks.workunit.client.0.smithi032.stdout:8/225: creat d0/f41 x:0 0 0 2024-05-06T21:26:34.099 INFO:tasks.workunit.client.0.smithi032.stdout:8/226: creat d0/d1c/f42 x:0 0 0 2024-05-06T21:26:34.099 INFO:tasks.workunit.client.0.smithi032.stdout:8/227: write d0/d1b/f31 [433352,36645] 0 2024-05-06T21:26:34.101 INFO:tasks.workunit.client.0.smithi032.stdout:5/112: rename d0/fc to d0/d16/f19 0 2024-05-06T21:26:34.101 INFO:tasks.workunit.client.0.smithi032.stdout:5/113: stat d0 0 2024-05-06T21:26:34.103 INFO:tasks.workunit.client.0.smithi032.stdout:8/228: symlink d0/d1b/d39/l43 0 2024-05-06T21:26:34.105 INFO:tasks.workunit.client.0.smithi032.stdout:5/114: symlink d0/d11/l1a 0 2024-05-06T21:26:34.105 INFO:tasks.workunit.client.0.smithi032.stdout:5/115: dread - d0/f10 zero size 2024-05-06T21:26:34.106 INFO:tasks.workunit.client.0.smithi032.stdout:8/229: creat d0/d1b/d39/d3b/f44 x:0 0 0 2024-05-06T21:26:34.106 INFO:tasks.workunit.client.0.smithi032.stdout:8/230: truncate d0/f1f 848411 0 2024-05-06T21:26:34.106 INFO:tasks.workunit.client.0.smithi032.stdout:8/231: write d0/f27 [4515964,67883] 0 2024-05-06T21:26:34.106 INFO:tasks.workunit.client.0.smithi032.stdout:8/232: creat d0/d1b/d39/f45 x:0 0 0 2024-05-06T21:26:34.106 INFO:tasks.workunit.client.0.smithi032.stdout:8/233: write d0/d1c/f42 [657138,47315] 0 2024-05-06T21:26:34.107 INFO:tasks.workunit.client.0.smithi032.stdout:5/116: dread d0/d11/f17 [0,4194304] 0 2024-05-06T21:26:34.110 INFO:tasks.workunit.client.0.smithi032.stdout:5/117: dread d0/d11/f17 [0,4194304] 0 2024-05-06T21:26:34.119 INFO:tasks.workunit.client.0.smithi032.stdout:5/118: fsync d0/d16/f19 0 2024-05-06T21:26:34.119 INFO:tasks.workunit.client.0.smithi032.stdout:5/119: stat d0/f10 0 2024-05-06T21:26:34.119 INFO:tasks.workunit.client.0.smithi032.stdout:5/120: fdatasync d0/f12 0 2024-05-06T21:26:34.130 INFO:tasks.workunit.client.0.smithi032.stdout:8/234: dwrite d0/f6 [0,4194304] 0 2024-05-06T21:26:34.133 INFO:tasks.workunit.client.0.smithi032.stdout:5/121: dwrite d0/d11/f13 [0,4194304] 0 2024-05-06T21:26:34.134 INFO:tasks.workunit.client.0.smithi032.stdout:5/122: symlink d0/d16/l1b 0 2024-05-06T21:26:34.136 INFO:tasks.workunit.client.0.smithi032.stdout:5/123: dread d0/d11/f17 [0,4194304] 0 2024-05-06T21:26:34.137 INFO:tasks.workunit.client.0.smithi032.stdout:8/235: dread d0/d1b/f3e [0,4194304] 0 2024-05-06T21:26:34.137 INFO:tasks.workunit.client.0.smithi032.stdout:5/124: dread d0/d11/f17 [0,4194304] 0 2024-05-06T21:26:34.137 INFO:tasks.workunit.client.0.smithi032.stdout:5/125: write d0/fa [1965955,13156] 0 2024-05-06T21:26:34.138 INFO:tasks.workunit.client.0.smithi032.stdout:8/236: rmdir d0/d1b/d39 39 2024-05-06T21:26:34.140 INFO:tasks.workunit.client.0.smithi032.stdout:8/237: creat d0/d1b/d39/d3b/f46 x:0 0 0 2024-05-06T21:26:34.140 INFO:tasks.workunit.client.0.smithi032.stdout:8/238: mkdir d0/d1b/d47 0 2024-05-06T21:26:34.146 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:33 smithi032 ceph-mon[27179]: pgmap v17: 65 pgs: 65 active+clean; 475 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 54 MiB/s wr, 945 op/s 2024-05-06T21:26:34.147 INFO:tasks.workunit.client.0.smithi032.stdout:5/126: write d0/fe [3873303,126053] 0 2024-05-06T21:26:34.155 INFO:tasks.workunit.client.0.smithi032.stdout:5/127: truncate d0/d16/f19 3643542 0 2024-05-06T21:26:34.156 INFO:tasks.workunit.client.0.smithi032.stdout:8/239: dwrite d0/f5 [0,4194304] 0 2024-05-06T21:26:34.156 INFO:tasks.workunit.client.0.smithi032.stdout:8/240: write d0/d1c/f2d [72858,124132] 0 2024-05-06T21:26:34.157 INFO:tasks.workunit.client.0.smithi032.stdout:5/128: unlink d0/d11/f17 0 2024-05-06T21:26:34.163 INFO:tasks.workunit.client.0.smithi032.stdout:8/241: write d0/d1c/f24 [703231,111391] 0 2024-05-06T21:26:34.165 INFO:tasks.workunit.client.0.smithi032.stdout:8/242: creat d0/d1b/d39/f48 x:0 0 0 2024-05-06T21:26:34.181 INFO:tasks.workunit.client.0.smithi032.stdout:8/243: dwrite d0/d1c/f42 [0,4194304] 0 2024-05-06T21:26:34.184 INFO:tasks.workunit.client.0.smithi032.stdout:5/129: dwrite d0/f18 [0,4194304] 0 2024-05-06T21:26:34.185 INFO:tasks.workunit.client.0.smithi032.stdout:8/244: getdents d0/d1b/d39 0 2024-05-06T21:26:34.186 INFO:tasks.workunit.client.0.smithi032.stdout:8/245: read d0/f19 [79080,88424] 0 2024-05-06T21:26:34.186 INFO:tasks.workunit.client.0.smithi032.stdout:8/246: chown d0/d1b/d39/d3b 37956 1 2024-05-06T21:26:34.186 INFO:tasks.workunit.client.0.smithi032.stdout:8/247: stat d0/d1c 0 2024-05-06T21:26:34.186 INFO:tasks.workunit.client.0.smithi032.stdout:8/248: fdatasync d0/f9 0 2024-05-06T21:26:34.186 INFO:tasks.workunit.client.0.smithi032.stdout:8/249: truncate d0/d1b/d39/f3a 687568 0 2024-05-06T21:26:34.186 INFO:tasks.workunit.client.0.smithi032.stdout:8/250: write d0/d1b/f34 [518207,119753] 0 2024-05-06T21:26:34.202 INFO:tasks.workunit.client.0.smithi032.stdout:5/130: dwrite d0/d11/f13 [4194304,4194304] 0 2024-05-06T21:26:34.202 INFO:tasks.workunit.client.0.smithi032.stdout:8/251: dwrite d0/d1c/f20 [0,4194304] 0 2024-05-06T21:26:34.207 INFO:tasks.workunit.client.0.smithi032.stdout:8/252: link d0/f41 d0/f49 0 2024-05-06T21:26:34.207 INFO:tasks.workunit.client.0.smithi032.stdout:8/253: creat d0/f4a x:0 0 0 2024-05-06T21:26:34.207 INFO:tasks.workunit.client.0.smithi032.stdout:8/254: chown d0/l18 0 1 2024-05-06T21:26:34.207 INFO:tasks.workunit.client.0.smithi032.stdout:8/255: stat d0/d1c 0 2024-05-06T21:26:34.207 INFO:tasks.workunit.client.0.smithi032.stdout:8/256: chown d0/d1c/c1e 0 1 2024-05-06T21:26:34.207 INFO:tasks.workunit.client.0.smithi032.stdout:8/257: fsync d0/f37 0 2024-05-06T21:26:34.211 INFO:tasks.workunit.client.0.smithi032.stdout:8/258: dread d0/d1c/f22 [0,4194304] 0 2024-05-06T21:26:34.211 INFO:tasks.workunit.client.0.smithi032.stdout:8/259: fdatasync d0/d1c/f32 0 2024-05-06T21:26:34.211 INFO:tasks.workunit.client.0.smithi032.stdout:8/260: creat d0/f4b x:0 0 0 2024-05-06T21:26:34.212 INFO:tasks.workunit.client.0.smithi032.stdout:8/261: link d0/c35 d0/c4c 0 2024-05-06T21:26:34.213 INFO:tasks.workunit.client.0.smithi032.stdout:8/262: symlink d0/d1b/d47/l4d 0 2024-05-06T21:26:34.213 INFO:tasks.workunit.client.0.smithi032.stdout:8/263: getdents d0/d1b/d39 0 2024-05-06T21:26:34.219 INFO:tasks.workunit.client.0.smithi032.stdout:5/131: dwrite d0/d11/f13 [0,4194304] 0 2024-05-06T21:26:34.225 INFO:tasks.workunit.client.0.smithi032.stdout:5/132: dread d0/d11/f13 [4194304,4194304] 0 2024-05-06T21:26:34.226 INFO:tasks.workunit.client.0.smithi032.stdout:5/133: creat d0/d16/f1c x:0 0 0 2024-05-06T21:26:34.237 INFO:tasks.workunit.client.0.smithi032.stdout:5/134: dwrite d0/d11/f13 [0,4194304] 0 2024-05-06T21:26:34.239 INFO:tasks.workunit.client.0.smithi032.stdout:5/135: mknod d0/d16/c1d 0 2024-05-06T21:26:34.239 INFO:tasks.workunit.client.0.smithi032.stdout:5/136: fsync d0/fe 0 2024-05-06T21:26:34.239 INFO:tasks.workunit.client.0.smithi032.stdout:5/137: creat d0/d16/f1e x:0 0 0 2024-05-06T21:26:34.239 INFO:tasks.workunit.client.0.smithi032.stdout:5/138: write d0/fb [256859,106914] 0 2024-05-06T21:26:34.240 INFO:tasks.workunit.client.0.smithi032.stdout:5/139: unlink d0/d16/f19 0 2024-05-06T21:26:34.240 INFO:tasks.workunit.client.0.smithi032.stdout:5/140: rename d0/d11 to d0/d11/d1f 22 2024-05-06T21:26:34.246 INFO:tasks.workunit.client.0.smithi032.stdout:5/141: write d0/d11/f13 [3407632,84970] 0 2024-05-06T21:26:34.246 INFO:tasks.workunit.client.0.smithi032.stdout:5/142: chown d0/d11/l14 40632 1 2024-05-06T21:26:34.247 INFO:tasks.workunit.client.0.smithi032.stdout:5/143: write d0/f12 [2974344,49908] 0 2024-05-06T21:26:34.248 INFO:tasks.workunit.client.0.smithi032.stdout:5/144: rename d0/d16/l1b to d0/l20 0 2024-05-06T21:26:34.494 INFO:tasks.workunit.client.0.smithi032.stdout:4/361: sync 2024-05-06T21:26:34.494 INFO:tasks.workunit.client.0.smithi032.stdout:4/362: write d2/d1e/f25 [2733281,67042] 0 2024-05-06T21:26:34.497 INFO:tasks.workunit.client.0.smithi032.stdout:4/363: mknod d2/d16/d44/d54/d69/c7d 0 2024-05-06T21:26:34.498 INFO:tasks.workunit.client.0.smithi032.stdout:4/364: mkdir d2/d16/d44/d74/d7e 0 2024-05-06T21:26:34.499 INFO:tasks.workunit.client.0.smithi032.stdout:4/365: chown d2/d16/f52 619417917 1 2024-05-06T21:26:34.499 INFO:tasks.workunit.client.0.smithi032.stdout:4/366: fdatasync d2/d1e/f78 0 2024-05-06T21:26:34.644 INFO:tasks.workunit.client.0.smithi032.stdout:8/264: sync 2024-05-06T21:26:34.644 INFO:tasks.workunit.client.0.smithi032.stdout:2/232: sync 2024-05-06T21:26:34.644 INFO:tasks.workunit.client.0.smithi032.stdout:7/353: sync 2024-05-06T21:26:34.644 INFO:tasks.workunit.client.0.smithi032.stdout:6/243: sync 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:3/180: sync 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:6/244: fdatasync d8/dd/d18/f23 0 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:1/311: sync 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:6/245: readlink d8/dd/d1b/l32 0 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:6/246: dread - d8/dd/f2e zero size 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:5/145: sync 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:7/354: creat db/d12/d16/d21/d41/d4b/f68 x:0 0 0 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:0/235: sync 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:9/278: sync 2024-05-06T21:26:34.645 INFO:tasks.workunit.client.0.smithi032.stdout:6/247: readlink d8/dd/d18/l30 0 2024-05-06T21:26:34.646 INFO:tasks.workunit.client.0.smithi032.stdout:8/265: rename d0/cd to d0/c4e 0 2024-05-06T21:26:34.646 INFO:tasks.workunit.client.0.smithi032.stdout:8/266: chown d0/d1b/d39/d3b/f44 1341882 1 2024-05-06T21:26:34.646 INFO:tasks.workunit.client.0.smithi032.stdout:8/267: write d0/fe [1411582,11462] 0 2024-05-06T21:26:34.646 INFO:tasks.workunit.client.0.smithi032.stdout:2/233: link df/d19/d1e/d1f/d2e/f3c df/d19/d1e/d35/d3f/d46/f4f 0 2024-05-06T21:26:34.646 INFO:tasks.workunit.client.0.smithi032.stdout:2/234: fsync df/d19/d1e/d23/d25/f37 0 2024-05-06T21:26:34.646 INFO:tasks.workunit.client.0.smithi032.stdout:2/235: creat df/d19/d1e/d23/d25/f50 x:0 0 0 2024-05-06T21:26:34.647 INFO:tasks.workunit.client.0.smithi032.stdout:2/236: chown df/d19/d1e/d35/d3f/d46/l4a 1038348 1 2024-05-06T21:26:34.647 INFO:tasks.workunit.client.0.smithi032.stdout:3/181: symlink d1/d4/da/l3b 0 2024-05-06T21:26:34.649 INFO:tasks.workunit.client.0.smithi032.stdout:7/355: link db/d12/d16/d2a/d53/c2b db/d12/d16/d2a/d53/c69 0 2024-05-06T21:26:34.649 INFO:tasks.workunit.client.0.smithi032.stdout:7/356: dread - db/f48 zero size 2024-05-06T21:26:34.652 INFO:tasks.workunit.client.0.smithi032.stdout:2/237: creat df/d19/d1e/f51 x:0 0 0 2024-05-06T21:26:34.654 INFO:tasks.workunit.client.0.smithi032.stdout:3/182: link d1/d4/l25 d1/d4/d11/l3c 0 2024-05-06T21:26:34.658 INFO:tasks.workunit.client.0.smithi032.stdout:1/312: read db/d37/f54 [782166,90794] 0 2024-05-06T21:26:34.658 INFO:tasks.workunit.client.0.smithi032.stdout:7/357: rename db/d12/d16/d21/d41/l64 to db/d12/d49/l6a 0 2024-05-06T21:26:34.659 INFO:tasks.workunit.client.0.smithi032.stdout:9/279: getdents d1/d13/d33/d3f 0 2024-05-06T21:26:34.662 INFO:tasks.workunit.client.0.smithi032.stdout:2/238: mkdir df/d19/d52 0 2024-05-06T21:26:34.662 INFO:tasks.workunit.client.0.smithi032.stdout:2/239: write df/d19/d1e/d35/f3d [1106433,9110] 0 2024-05-06T21:26:34.668 INFO:tasks.workunit.client.0.smithi032.stdout:7/358: unlink db/d12/d16/d21/c40 0 2024-05-06T21:26:34.669 INFO:tasks.workunit.client.0.smithi032.stdout:7/359: fdatasync db/d12/d16/d2a/f42 0 2024-05-06T21:26:34.671 INFO:tasks.workunit.client.0.smithi032.stdout:1/313: mkdir db/d16/d5d 0 2024-05-06T21:26:34.674 INFO:tasks.workunit.client.0.smithi032.stdout:7/360: link db/d12/d16/d21/l23 db/d12/d49/l6b 0 2024-05-06T21:26:34.674 INFO:tasks.workunit.client.0.smithi032.stdout:7/361: truncate db/d12/d16/d2a/f42 1171761 0 2024-05-06T21:26:34.675 INFO:tasks.workunit.client.0.smithi032.stdout:9/280: symlink d1/d2f/l54 0 2024-05-06T21:26:34.675 INFO:tasks.workunit.client.0.smithi032.stdout:1/314: getdents db/d2a/d4f 0 2024-05-06T21:26:34.676 INFO:tasks.workunit.client.0.smithi032.stdout:1/315: stat db/d2a/f39 0 2024-05-06T21:26:34.676 INFO:tasks.workunit.client.0.smithi032.stdout:1/316: chown db/d2a/c44 104590132 1 2024-05-06T21:26:34.676 INFO:tasks.workunit.client.0.smithi032.stdout:1/317: chown db/d2a/c44 991918 1 2024-05-06T21:26:34.676 INFO:tasks.workunit.client.0.smithi032.stdout:9/281: truncate d1/d13/d34/f48 2765022 0 2024-05-06T21:26:34.680 INFO:tasks.workunit.client.0.smithi032.stdout:1/318: symlink db/d37/l5e 0 2024-05-06T21:26:34.681 INFO:tasks.workunit.client.0.smithi032.stdout:9/282: truncate d1/f18 955380 0 2024-05-06T21:26:34.689 INFO:tasks.workunit.client.0.smithi032.stdout:9/283: write d1/d13/d34/f32 [402049,32090] 0 2024-05-06T21:26:34.696 INFO:tasks.workunit.client.0.smithi032.stdout:8/268: dwrite d0/f49 [0,4194304] 0 2024-05-06T21:26:34.696 INFO:tasks.workunit.client.0.smithi032.stdout:8/269: chown d0/f37 4906 1 2024-05-06T21:26:34.703 INFO:tasks.workunit.client.0.smithi032.stdout:8/270: dread d0/f5 [0,4194304] 0 2024-05-06T21:26:34.704 INFO:tasks.workunit.client.0.smithi032.stdout:8/271: rmdir d0/d1b 39 2024-05-06T21:26:34.704 INFO:tasks.workunit.client.0.smithi032.stdout:8/272: readlink d0/d1b/l3c 0 2024-05-06T21:26:34.708 INFO:tasks.workunit.client.0.smithi032.stdout:9/284: dread d1/f9 [0,4194304] 0 2024-05-06T21:26:34.709 INFO:tasks.workunit.client.0.smithi032.stdout:9/285: chown d1/d2f/f3c 12994 1 2024-05-06T21:26:34.709 INFO:tasks.workunit.client.0.smithi032.stdout:3/183: dwrite d1/d4/f2e [0,4194304] 0 2024-05-06T21:26:34.709 INFO:tasks.workunit.client.0.smithi032.stdout:6/248: dwrite d8/d33/f36 [0,4194304] 0 2024-05-06T21:26:34.709 INFO:tasks.workunit.client.0.smithi032.stdout:6/249: write d8/dd/d18/d13/f24 [320741,52293] 0 2024-05-06T21:26:34.709 INFO:tasks.workunit.client.0.smithi032.stdout:6/250: readlink d8/dd/d18/lf 0 2024-05-06T21:26:34.710 INFO:tasks.workunit.client.0.smithi032.stdout:0/236: dwrite d4/da/f39 [0,4194304] 0 2024-05-06T21:26:34.710 INFO:tasks.workunit.client.0.smithi032.stdout:5/146: dwrite d0/d16/f1c [0,4194304] 0 2024-05-06T21:26:34.711 INFO:tasks.workunit.client.0.smithi032.stdout:7/362: dwrite db/d12/d16/d2a/d53/f36 [0,4194304] 0 2024-05-06T21:26:34.712 INFO:tasks.workunit.client.0.smithi032.stdout:2/240: dwrite df/d19/d1e/f48 [0,4194304] 0 2024-05-06T21:26:34.713 INFO:tasks.workunit.client.0.smithi032.stdout:7/363: dread db/d12/f19 [0,4194304] 0 2024-05-06T21:26:34.718 INFO:tasks.workunit.client.0.smithi032.stdout:9/286: dread d1/f12 [0,4194304] 0 2024-05-06T21:26:34.718 INFO:tasks.workunit.client.0.smithi032.stdout:9/287: truncate d1/d13/d34/d26/d39/d45/f4a 1242512 0 2024-05-06T21:26:34.718 INFO:tasks.workunit.client.0.smithi032.stdout:9/288: fsync d1/d13/f1f 0 2024-05-06T21:26:34.718 INFO:tasks.workunit.client.0.smithi032.stdout:9/289: chown d1/d13/d34/d26/d39/d45 50807 1 2024-05-06T21:26:34.718 INFO:tasks.workunit.client.0.smithi032.stdout:9/290: creat d1/d13/d25/f55 x:0 0 0 2024-05-06T21:26:34.718 INFO:tasks.workunit.client.0.smithi032.stdout:3/184: dread d1/d4/d11/f36 [0,4194304] 0 2024-05-06T21:26:34.718 INFO:tasks.workunit.client.0.smithi032.stdout:3/185: chown d1/d4/d11/l3c 387 1 2024-05-06T21:26:34.718 INFO:tasks.workunit.client.0.smithi032.stdout:3/186: fsync d1/d4/d11/f2b 0 2024-05-06T21:26:34.719 INFO:tasks.workunit.client.0.smithi032.stdout:3/187: chown d1/d4/da/f32 689710113 1 2024-05-06T21:26:34.719 INFO:tasks.workunit.client.0.smithi032.stdout:2/241: write df/f2c [4037780,45237] 0 2024-05-06T21:26:34.719 INFO:tasks.workunit.client.0.smithi032.stdout:6/251: mkdir d8/dd/d18/d3b 0 2024-05-06T21:26:34.719 INFO:tasks.workunit.client.0.smithi032.stdout:6/252: write d8/dd/f12 [1182544,3428] 0 2024-05-06T21:26:34.719 INFO:tasks.workunit.client.0.smithi032.stdout:6/253: truncate d8/dd/f26 715608 0 2024-05-06T21:26:34.721 INFO:tasks.workunit.client.0.smithi032.stdout:8/273: dwrite d0/f1a [0,4194304] 0 2024-05-06T21:26:34.725 INFO:tasks.workunit.client.0.smithi032.stdout:6/254: dread d8/dd/d18/d13/f24 [0,4194304] 0 2024-05-06T21:26:34.730 INFO:tasks.workunit.client.0.smithi032.stdout:0/237: dwrite d4/da/f31 [0,4194304] 0 2024-05-06T21:26:34.730 INFO:tasks.workunit.client.0.smithi032.stdout:0/238: dread - d4/da/d16/d33/d46/f50 zero size 2024-05-06T21:26:34.730 INFO:tasks.workunit.client.0.smithi032.stdout:0/239: fsync d4/da/d14/d1a/f1e 0 2024-05-06T21:26:34.730 INFO:tasks.workunit.client.0.smithi032.stdout:0/240: fdatasync d4/da/d16/d33/d46/f50 0 2024-05-06T21:26:34.736 INFO:tasks.workunit.client.0.smithi032.stdout:7/364: truncate db/d12/f61 3396233 0 2024-05-06T21:26:34.739 INFO:tasks.workunit.client.0.smithi032.stdout:9/291: creat d1/d2f/d4f/f56 x:0 0 0 2024-05-06T21:26:34.740 INFO:tasks.workunit.client.0.smithi032.stdout:3/188: dwrite d1/d4/f9 [0,4194304] 0 2024-05-06T21:26:34.740 INFO:tasks.workunit.client.0.smithi032.stdout:7/365: write db/d12/d16/d2a/d53/f2c [321098,127756] 0 2024-05-06T21:26:34.741 INFO:tasks.workunit.client.0.smithi032.stdout:2/242: link l9 df/d19/d1e/d42/l53 0 2024-05-06T21:26:34.742 INFO:tasks.workunit.client.0.smithi032.stdout:7/366: read db/d12/d16/d2a/f2d [945409,70216] 0 2024-05-06T21:26:34.742 INFO:tasks.workunit.client.0.smithi032.stdout:7/367: dread - db/d12/d16/d21/f31 zero size 2024-05-06T21:26:34.742 INFO:tasks.workunit.client.0.smithi032.stdout:8/274: mknod d0/d1b/d47/c4f 0 2024-05-06T21:26:34.742 INFO:tasks.workunit.client.0.smithi032.stdout:8/275: truncate d0/f1a 5202357 0 2024-05-06T21:26:34.743 INFO:tasks.workunit.client.0.smithi032.stdout:0/241: rmdir d4/da/d16/d33/d46 39 2024-05-06T21:26:34.745 INFO:tasks.workunit.client.0.smithi032.stdout:5/147: creat d0/d11/f21 x:0 0 0 2024-05-06T21:26:34.746 INFO:tasks.workunit.client.0.smithi032.stdout:9/292: chown d1/f23 200 1 2024-05-06T21:26:34.746 INFO:tasks.workunit.client.0.smithi032.stdout:9/293: fsync d1/d13/f2a 0 2024-05-06T21:26:34.746 INFO:tasks.workunit.client.0.smithi032.stdout:6/255: dwrite d8/dd/f26 [0,4194304] 0 2024-05-06T21:26:34.747 INFO:tasks.workunit.client.0.smithi032.stdout:4/367: sync 2024-05-06T21:26:34.752 INFO:tasks.workunit.client.0.smithi032.stdout:7/368: rename db/d12/d16/d2a/d53/c2f to db/d12/d16/d2a/c6c 0 2024-05-06T21:26:34.752 INFO:tasks.workunit.client.0.smithi032.stdout:9/294: rename d1/d13/d34 to d1/d13/d34/d26/d49/d57 22 2024-05-06T21:26:34.752 INFO:tasks.workunit.client.0.smithi032.stdout:7/369: creat db/d12/f6d x:0 0 0 2024-05-06T21:26:34.754 INFO:tasks.workunit.client.0.smithi032.stdout:8/276: mknod d0/d1c/c50 0 2024-05-06T21:26:34.754 INFO:tasks.workunit.client.0.smithi032.stdout:8/277: dread - d0/d1b/d39/f45 zero size 2024-05-06T21:26:34.754 INFO:tasks.workunit.client.0.smithi032.stdout:8/278: truncate d0/d1b/f34 1464023 0 2024-05-06T21:26:34.755 INFO:tasks.workunit.client.0.smithi032.stdout:4/368: dread d2/fa [0,4194304] 0 2024-05-06T21:26:34.762 INFO:tasks.workunit.client.0.smithi032.stdout:6/256: symlink d8/dd/d18/d39/l3c 0 2024-05-06T21:26:34.772 INFO:tasks.workunit.client.0.smithi032.stdout:0/242: dwrite d4/f6 [0,4194304] 0 2024-05-06T21:26:34.772 INFO:tasks.workunit.client.0.smithi032.stdout:7/370: write f3 [4192278,16624] 0 2024-05-06T21:26:34.772 INFO:tasks.workunit.client.0.smithi032.stdout:7/371: write db/fe [1038570,43442] 0 2024-05-06T21:26:34.773 INFO:tasks.workunit.client.0.smithi032.stdout:3/189: rmdir d1 39 2024-05-06T21:26:34.774 INFO:tasks.workunit.client.0.smithi032.stdout:9/295: mknod d1/d13/d34/d26/d49/c58 0 2024-05-06T21:26:34.778 INFO:tasks.workunit.client.0.smithi032.stdout:7/372: symlink db/d12/d16/d21/l6e 0 2024-05-06T21:26:34.778 INFO:tasks.workunit.client.0.smithi032.stdout:7/373: chown db/d12/d16/f24 2990425 1 2024-05-06T21:26:34.778 INFO:tasks.workunit.client.0.smithi032.stdout:3/190: getdents d1 0 2024-05-06T21:26:34.779 INFO:tasks.workunit.client.0.smithi032.stdout:9/296: chown d1/l6 994050 1 2024-05-06T21:26:34.781 INFO:tasks.workunit.client.0.smithi032.stdout:7/374: truncate db/d12/d16/d2a/d53/f4f 56807 0 2024-05-06T21:26:34.781 INFO:tasks.workunit.client.0.smithi032.stdout:7/375: creat db/d12/d49/f6f x:0 0 0 2024-05-06T21:26:34.782 INFO:tasks.workunit.client.0.smithi032.stdout:3/191: symlink d1/d4/da/d31/l3d 0 2024-05-06T21:26:34.782 INFO:tasks.workunit.client.0.smithi032.stdout:9/297: readlink d1/l51 0 2024-05-06T21:26:34.786 INFO:tasks.workunit.client.0.smithi032.stdout:6/257: rename d8/dd/d18/d39 to d8/d3d 0 2024-05-06T21:26:34.787 INFO:tasks.workunit.client.0.smithi032.stdout:6/258: mkdir d8/d33/d3e 0 2024-05-06T21:26:34.789 INFO:tasks.workunit.client.0.smithi032.stdout:6/259: link d8/f2b d8/dd/d1b/d35/f3f 0 2024-05-06T21:26:34.789 INFO:tasks.workunit.client.0.smithi032.stdout:6/260: chown d8/dd/d18/d13/f2c 190 1 2024-05-06T21:26:34.789 INFO:tasks.workunit.client.0.smithi032.stdout:6/261: getdents d8/dd 0 2024-05-06T21:26:34.789 INFO:tasks.workunit.client.0.smithi032.stdout:9/298: dread d1/f2 [0,4194304] 0 2024-05-06T21:26:34.791 INFO:tasks.workunit.client.0.smithi032.stdout:9/299: mkdir d1/d13/d25/d59 0 2024-05-06T21:26:34.793 INFO:tasks.workunit.client.0.smithi032.stdout:5/148: dwrite d0/f5 [4194304,4194304] 0 2024-05-06T21:26:34.793 INFO:tasks.workunit.client.0.smithi032.stdout:5/149: truncate d0/d16/f1e 896286 0 2024-05-06T21:26:34.794 INFO:tasks.workunit.client.0.smithi032.stdout:9/300: rename d1/l4d to d1/d13/d25/d59/l5a 0 2024-05-06T21:26:34.795 INFO:tasks.workunit.client.0.smithi032.stdout:5/150: read - d0/f10 zero size 2024-05-06T21:26:34.797 INFO:tasks.workunit.client.0.smithi032.stdout:4/369: dwrite d2/fa [0,4194304] 0 2024-05-06T21:26:34.797 INFO:tasks.workunit.client.0.smithi032.stdout:3/192: dread d1/d4/da/f2f [4194304,4194304] 0 2024-05-06T21:26:34.797 INFO:tasks.workunit.client.0.smithi032.stdout:4/370: truncate d2/d13/f56 249209 0 2024-05-06T21:26:34.798 INFO:tasks.workunit.client.0.smithi032.stdout:4/371: write d2/d1e/f4c [744711,52458] 0 2024-05-06T21:26:34.798 INFO:tasks.workunit.client.0.smithi032.stdout:0/243: dwrite d4/da/d16/f43 [0,4194304] 0 2024-05-06T21:26:34.798 INFO:tasks.workunit.client.0.smithi032.stdout:8/279: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:34.798 INFO:tasks.workunit.client.0.smithi032.stdout:0/244: write d4/da/d14/d1a/f1c [49455,29194] 0 2024-05-06T21:26:34.798 INFO:tasks.workunit.client.0.smithi032.stdout:9/301: mknod d1/d13/d34/c5b 0 2024-05-06T21:26:34.798 INFO:tasks.workunit.client.0.smithi032.stdout:9/302: truncate d1/d13/d34/d26/d39/d45/f52 439991 0 2024-05-06T21:26:34.798 INFO:tasks.workunit.client.0.smithi032.stdout:5/151: fsync d0/fb 0 2024-05-06T21:26:34.798 INFO:tasks.workunit.client.0.smithi032.stdout:5/152: fsync d0/d11/f21 0 2024-05-06T21:26:34.800 INFO:tasks.workunit.client.0.smithi032.stdout:7/376: dread db/d12/d16/f3f [0,4194304] 0 2024-05-06T21:26:34.800 INFO:tasks.workunit.client.0.smithi032.stdout:7/377: chown ca 54853548 1 2024-05-06T21:26:34.800 INFO:tasks.workunit.client.0.smithi032.stdout:7/378: write db/d12/f61 [2462951,95930] 0 2024-05-06T21:26:34.800 INFO:tasks.workunit.client.0.smithi032.stdout:4/372: rename d2/d16/d44/d45/d4e/c68 to d2/d2c/c7f 0 2024-05-06T21:26:34.803 INFO:tasks.workunit.client.0.smithi032.stdout:0/245: mkdir d4/d51 0 2024-05-06T21:26:34.803 INFO:tasks.workunit.client.0.smithi032.stdout:0/246: write d4/f7 [1972998,102544] 0 2024-05-06T21:26:34.803 INFO:tasks.workunit.client.0.smithi032.stdout:0/247: chown d4/da 55518704 1 2024-05-06T21:26:34.804 INFO:tasks.workunit.client.0.smithi032.stdout:9/303: mknod d1/d2f/c5c 0 2024-05-06T21:26:34.804 INFO:tasks.workunit.client.0.smithi032.stdout:3/193: read d1/d4/f2e [128126,6914] 0 2024-05-06T21:26:34.805 INFO:tasks.workunit.client.0.smithi032.stdout:6/262: dwrite d8/f17 [8388608,4194304] 0 2024-05-06T21:26:34.805 INFO:tasks.workunit.client.0.smithi032.stdout:6/263: write d8/dd/d18/d13/f24 [729371,22526] 0 2024-05-06T21:26:34.806 INFO:tasks.workunit.client.0.smithi032.stdout:7/379: creat db/d12/d16/d21/d41/f70 x:0 0 0 2024-05-06T21:26:34.809 INFO:tasks.workunit.client.0.smithi032.stdout:8/280: rename d0/c4c to d0/d1c/c51 0 2024-05-06T21:26:34.809 INFO:tasks.workunit.client.0.smithi032.stdout:8/281: chown d0/f4a 4 1 2024-05-06T21:26:34.810 INFO:tasks.workunit.client.0.smithi032.stdout:8/282: read - d0/d1b/d39/d3b/f46 zero size 2024-05-06T21:26:34.810 INFO:tasks.workunit.client.0.smithi032.stdout:9/304: mknod d1/d13/d34/d26/d39/d45/c5d 0 2024-05-06T21:26:34.812 INFO:tasks.workunit.client.0.smithi032.stdout:3/194: creat d1/d4/f3e x:0 0 0 2024-05-06T21:26:34.816 INFO:tasks.workunit.client.0.smithi032.stdout:6/264: creat d8/dd/d18/d22/f40 x:0 0 0 2024-05-06T21:26:34.816 INFO:tasks.workunit.client.0.smithi032.stdout:6/265: write d8/dd/d18/d13/f24 [764133,81818] 0 2024-05-06T21:26:34.820 INFO:tasks.workunit.client.0.smithi032.stdout:7/380: unlink db/d12/c66 0 2024-05-06T21:26:34.823 INFO:tasks.workunit.client.0.smithi032.stdout:4/373: rename d2/f46 to d2/d1e/f80 0 2024-05-06T21:26:34.826 INFO:tasks.workunit.client.0.smithi032.stdout:9/305: mkdir d1/d13/d33/d5e 0 2024-05-06T21:26:34.826 INFO:tasks.workunit.client.0.smithi032.stdout:6/266: mknod d8/c41 0 2024-05-06T21:26:34.826 INFO:tasks.workunit.client.0.smithi032.stdout:9/306: chown d1/d13/f16 1 1 2024-05-06T21:26:34.826 INFO:tasks.workunit.client.0.smithi032.stdout:9/307: write d1/f23 [1940802,75113] 0 2024-05-06T21:26:34.827 INFO:tasks.workunit.client.0.smithi032.stdout:6/267: mknod d8/d33/d3e/c42 0 2024-05-06T21:26:34.827 INFO:tasks.workunit.client.0.smithi032.stdout:6/268: fdatasync f4 0 2024-05-06T21:26:34.827 INFO:tasks.workunit.client.0.smithi032.stdout:9/308: symlink d1/d13/d34/l5f 0 2024-05-06T21:26:34.829 INFO:tasks.workunit.client.0.smithi032.stdout:9/309: mkdir d1/d13/d33/d3f/d60 0 2024-05-06T21:26:34.850 INFO:tasks.workunit.client.0.smithi032.stdout:7/381: read db/d12/d16/d2a/d39/d3b/f3d [467069,44114] 0 2024-05-06T21:26:34.850 INFO:tasks.workunit.client.0.smithi032.stdout:7/382: chown db/d12/d16/d21/d41 14817 1 2024-05-06T21:26:34.852 INFO:tasks.workunit.client.0.smithi032.stdout:7/383: dread db/fe [0,4194304] 0 2024-05-06T21:26:34.852 INFO:tasks.workunit.client.0.smithi032.stdout:7/384: truncate db/d12/f2e 1696679 0 2024-05-06T21:26:34.853 INFO:tasks.workunit.client.0.smithi032.stdout:7/385: creat db/d12/d16/f71 x:0 0 0 2024-05-06T21:26:34.859 INFO:tasks.workunit.client.0.smithi032.stdout:0/248: dwrite d4/da/d16/d33/f36 [0,4194304] 0 2024-05-06T21:26:34.859 INFO:tasks.workunit.client.0.smithi032.stdout:3/195: dwrite d1/d4/f30 [0,4194304] 0 2024-05-06T21:26:34.864 INFO:tasks.workunit.client.0.smithi032.stdout:8/283: dwrite d0/f4b [0,4194304] 0 2024-05-06T21:26:34.865 INFO:tasks.workunit.client.0.smithi032.stdout:8/284: truncate d0/f37 5037247 0 2024-05-06T21:26:34.865 INFO:tasks.workunit.client.0.smithi032.stdout:3/196: rename d1/d4/d11/d26 to d1/d4/da/d31/d3f 0 2024-05-06T21:26:34.866 INFO:tasks.workunit.client.0.smithi032.stdout:5/153: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:34.867 INFO:tasks.workunit.client.0.smithi032.stdout:4/374: dwrite d2/f10 [4194304,4194304] 0 2024-05-06T21:26:34.867 INFO:tasks.workunit.client.0.smithi032.stdout:6/269: dwrite d8/dd/d18/d22/f40 [0,4194304] 0 2024-05-06T21:26:34.867 INFO:tasks.workunit.client.0.smithi032.stdout:6/270: dread - d8/dd/d1b/d35/f37 zero size 2024-05-06T21:26:34.868 INFO:tasks.workunit.client.0.smithi032.stdout:8/285: link d0/l2b d0/d1b/d47/l52 0 2024-05-06T21:26:34.871 INFO:tasks.workunit.client.0.smithi032.stdout:5/154: stat d0/ld 0 2024-05-06T21:26:34.871 INFO:tasks.workunit.client.0.smithi032.stdout:5/155: chown d0/d11/l1a 29686660 1 2024-05-06T21:26:34.871 INFO:tasks.workunit.client.0.smithi032.stdout:5/156: chown d0/d11/l14 20582 1 2024-05-06T21:26:34.875 INFO:tasks.workunit.client.0.smithi032.stdout:4/375: truncate d2/d1e/f21 1254857 0 2024-05-06T21:26:34.884 INFO:tasks.workunit.client.0.smithi032.stdout:6/271: rename d8/dd/f2e to d8/dd/d1b/d35/f43 0 2024-05-06T21:26:34.884 INFO:tasks.workunit.client.0.smithi032.stdout:6/272: dread - d8/dd/d1b/d35/f43 zero size 2024-05-06T21:26:34.884 INFO:tasks.workunit.client.0.smithi032.stdout:6/273: creat d8/dd/d1b/d35/f44 x:0 0 0 2024-05-06T21:26:34.894 INFO:tasks.workunit.client.0.smithi032.stdout:0/249: truncate d4/da/d16/d33/f36 205207 0 2024-05-06T21:26:34.894 INFO:tasks.workunit.client.0.smithi032.stdout:0/250: read - d4/da/d16/d33/d46/f50 zero size 2024-05-06T21:26:34.894 INFO:tasks.workunit.client.0.smithi032.stdout:0/251: dread - d4/da/d16/f3c zero size 2024-05-06T21:26:34.896 INFO:tasks.workunit.client.0.smithi032.stdout:5/157: chown d0/f12 2 1 2024-05-06T21:26:34.896 INFO:tasks.workunit.client.0.smithi032.stdout:5/158: stat d0/d16/c1d 0 2024-05-06T21:26:34.896 INFO:tasks.workunit.client.0.smithi032.stdout:5/159: chown d0/f10 11918 1 2024-05-06T21:26:34.896 INFO:tasks.workunit.client.0.smithi032.stdout:5/160: stat d0/d11/l14 0 2024-05-06T21:26:34.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/286: dwrite d0/f1f [0,4194304] 0 2024-05-06T21:26:34.897 INFO:tasks.workunit.client.0.smithi032.stdout:8/287: chown d0/f27 66295416 1 2024-05-06T21:26:34.897 INFO:tasks.workunit.client.0.smithi032.stdout:8/288: creat d0/f53 x:0 0 0 2024-05-06T21:26:34.897 INFO:tasks.workunit.client.0.smithi032.stdout:4/376: dwrite d2/f6c [0,4194304] 0 2024-05-06T21:26:34.897 INFO:tasks.workunit.client.0.smithi032.stdout:0/252: dread d4/da/d14/d1a/f1c [0,4194304] 0 2024-05-06T21:26:34.897 INFO:tasks.workunit.client.0.smithi032.stdout:0/253: dread d4/d3e/f49 [0,4194304] 0 2024-05-06T21:26:34.897 INFO:tasks.workunit.client.0.smithi032.stdout:0/254: truncate d4/da/d14/d1a/f1b 4727604 0 2024-05-06T21:26:34.905 INFO:tasks.workunit.client.0.smithi032.stdout:8/289: rename d0/d1c/f20 to d0/d1b/d47/f54 0 2024-05-06T21:26:34.905 INFO:tasks.workunit.client.0.smithi032.stdout:8/290: write d0/f4a [389223,108837] 0 2024-05-06T21:26:34.906 INFO:tasks.workunit.client.0.smithi032.stdout:4/377: mkdir d2/d16/d44/d74/d76/d81 0 2024-05-06T21:26:34.908 INFO:tasks.workunit.client.0.smithi032.stdout:0/255: creat d4/da/d16/d33/d46/f52 x:0 0 0 2024-05-06T21:26:34.908 INFO:tasks.workunit.client.0.smithi032.stdout:0/256: creat d4/da/d16/f53 x:0 0 0 2024-05-06T21:26:34.908 INFO:tasks.workunit.client.0.smithi032.stdout:0/257: write d4/da/d16/f2c [763341,125323] 0 2024-05-06T21:26:34.908 INFO:tasks.workunit.client.0.smithi032.stdout:0/258: fdatasync d4/da/f17 0 2024-05-06T21:26:34.910 INFO:tasks.workunit.client.0.smithi032.stdout:6/274: getdents d8/dd 0 2024-05-06T21:26:34.912 INFO:tasks.workunit.client.0.smithi032.stdout:8/291: rename d0/d1b/d39/d3b/f46 to d0/d1b/f55 0 2024-05-06T21:26:34.915 INFO:tasks.workunit.client.0.smithi032.stdout:0/259: creat d4/d3e/f54 x:0 0 0 2024-05-06T21:26:34.917 INFO:tasks.workunit.client.0.smithi032.stdout:0/260: dread d4/d3e/f49 [0,4194304] 0 2024-05-06T21:26:34.917 INFO:tasks.workunit.client.0.smithi032.stdout:0/261: truncate d4/da/d16/f53 39888 0 2024-05-06T21:26:34.917 INFO:tasks.workunit.client.0.smithi032.stdout:6/275: dread d8/dd/d18/d13/f2c [0,4194304] 0 2024-05-06T21:26:34.919 INFO:tasks.workunit.client.0.smithi032.stdout:6/276: symlink d8/l45 0 2024-05-06T21:26:34.921 INFO:tasks.workunit.client.0.smithi032.stdout:0/262: dread d4/da/d16/f2c [0,4194304] 0 2024-05-06T21:26:34.921 INFO:tasks.workunit.client.0.smithi032.stdout:0/263: creat d4/da/f55 x:0 0 0 2024-05-06T21:26:34.921 INFO:tasks.workunit.client.0.smithi032.stdout:5/161: truncate d0/fa 3996350 0 2024-05-06T21:26:34.925 INFO:tasks.workunit.client.0.smithi032.stdout:5/162: mknod d0/d11/c22 0 2024-05-06T21:26:34.925 INFO:tasks.workunit.client.0.smithi032.stdout:5/163: write d0/f12 [4806934,89566] 0 2024-05-06T21:26:34.925 INFO:tasks.workunit.client.0.smithi032.stdout:6/277: dread d8/f31 [0,4194304] 0 2024-05-06T21:26:34.925 INFO:tasks.workunit.client.0.smithi032.stdout:6/278: dread - d8/dd/d1b/f2d zero size 2024-05-06T21:26:34.926 INFO:tasks.workunit.client.0.smithi032.stdout:6/279: symlink d8/d3d/l46 0 2024-05-06T21:26:34.930 INFO:tasks.workunit.client.0.smithi032.stdout:6/280: dread d8/dd/d18/d13/f2c [0,4194304] 0 2024-05-06T21:26:34.932 INFO:tasks.workunit.client.0.smithi032.stdout:8/292: dwrite d0/f19 [0,4194304] 0 2024-05-06T21:26:34.932 INFO:tasks.workunit.client.0.smithi032.stdout:6/281: rmdir d8/dd/d18/d22 39 2024-05-06T21:26:34.934 INFO:tasks.workunit.client.0.smithi032.stdout:8/293: fsync d0/d1b/f55 0 2024-05-06T21:26:34.934 INFO:tasks.workunit.client.0.smithi032.stdout:8/294: write d0/d1c/f2d [1042335,107424] 0 2024-05-06T21:26:34.934 INFO:tasks.workunit.client.0.smithi032.stdout:8/295: stat d0/d1c/l36 0 2024-05-06T21:26:34.934 INFO:tasks.workunit.client.0.smithi032.stdout:8/296: chown d0/d1c/l40 1612 1 2024-05-06T21:26:34.934 INFO:tasks.workunit.client.0.smithi032.stdout:0/264: write d4/da/d16/f3b [3302291,86459] 0 2024-05-06T21:26:34.934 INFO:tasks.workunit.client.0.smithi032.stdout:0/265: chown d4/da/d14/d1a/f1b 2 1 2024-05-06T21:26:34.937 INFO:tasks.workunit.client.0.smithi032.stdout:6/282: link d8/d33/d3e/c42 d8/d33/c47 0 2024-05-06T21:26:34.937 INFO:tasks.workunit.client.0.smithi032.stdout:6/283: fsync d8/dd/d18/d13/f2a 0 2024-05-06T21:26:34.938 INFO:tasks.workunit.client.0.smithi032.stdout:8/297: symlink d0/l56 0 2024-05-06T21:26:34.938 INFO:tasks.workunit.client.0.smithi032.stdout:1/319: sync 2024-05-06T21:26:34.940 INFO:tasks.workunit.client.0.smithi032.stdout:0/266: getdents d4/da/d14/d1a 0 2024-05-06T21:26:34.940 INFO:tasks.workunit.client.0.smithi032.stdout:0/267: write d4/d3e/f49 [1133536,54665] 0 2024-05-06T21:26:34.941 INFO:tasks.workunit.client.0.smithi032.stdout:6/284: mknod d8/dd/d18/d22/c48 0 2024-05-06T21:26:34.942 INFO:tasks.workunit.client.0.smithi032.stdout:8/298: truncate d0/f9 3555330 0 2024-05-06T21:26:34.944 INFO:tasks.workunit.client.0.smithi032.stdout:0/268: creat d4/d51/f56 x:0 0 0 2024-05-06T21:26:34.945 INFO:tasks.workunit.client.0.smithi032.stdout:6/285: mkdir d8/d3d/d49 0 2024-05-06T21:26:34.945 INFO:tasks.workunit.client.0.smithi032.stdout:6/286: write d8/f10 [1829151,30024] 0 2024-05-06T21:26:34.946 INFO:tasks.workunit.client.0.smithi032.stdout:1/320: rename db/d16/l26 to db/d47/l5f 0 2024-05-06T21:26:34.949 INFO:tasks.workunit.client.0.smithi032.stdout:8/299: write d0/d1b/d47/f54 [3785322,34448] 0 2024-05-06T21:26:34.953 INFO:tasks.workunit.client.0.smithi032.stdout:1/321: rename db/d47/l5f to db/d16/d46/d57/l60 0 2024-05-06T21:26:34.954 INFO:tasks.workunit.client.0.smithi032.stdout:1/322: chown db/d37/l3d 978135303 1 2024-05-06T21:26:34.954 INFO:tasks.workunit.client.0.smithi032.stdout:8/300: dread d0/d1c/f22 [0,4194304] 0 2024-05-06T21:26:34.956 INFO:tasks.workunit.client.0.smithi032.stdout:1/323: creat db/d2a/f61 x:0 0 0 2024-05-06T21:26:34.957 INFO:tasks.workunit.client.0.smithi032.stdout:0/269: read d4/da/d14/d1a/f1e [4615154,69866] 0 2024-05-06T21:26:34.957 INFO:tasks.workunit.client.0.smithi032.stdout:8/301: mkdir d0/d1b/d39/d3b/d57 0 2024-05-06T21:26:34.958 INFO:tasks.workunit.client.0.smithi032.stdout:0/270: read d4/da/d14/f3a [4126,83628] 0 2024-05-06T21:26:34.958 INFO:tasks.workunit.client.0.smithi032.stdout:1/324: truncate db/d37/f54 1730025 0 2024-05-06T21:26:34.961 INFO:tasks.workunit.client.0.smithi032.stdout:8/302: link d0/d1c/c38 d0/d1b/c58 0 2024-05-06T21:26:34.961 INFO:tasks.workunit.client.0.smithi032.stdout:8/303: truncate d0/d1b/f55 362709 0 2024-05-06T21:26:34.961 INFO:tasks.workunit.client.0.smithi032.stdout:8/304: chown d0/d1c/c2e 767013607 1 2024-05-06T21:26:34.963 INFO:tasks.workunit.client.0.smithi032.stdout:0/271: unlink d4/da/f35 0 2024-05-06T21:26:34.963 INFO:tasks.workunit.client.0.smithi032.stdout:0/272: read d4/da/d14/d1a/f1c [54765,104444] 0 2024-05-06T21:26:34.963 INFO:tasks.workunit.client.0.smithi032.stdout:0/273: stat d4/d51 0 2024-05-06T21:26:34.963 INFO:tasks.workunit.client.0.smithi032.stdout:8/305: truncate d0/f4b 2764692 0 2024-05-06T21:26:34.970 INFO:tasks.workunit.client.0.smithi032.stdout:6/287: dwrite d8/dd/d18/d22/f40 [0,4194304] 0 2024-05-06T21:26:34.979 INFO:tasks.workunit.client.0.smithi032.stdout:8/306: dread d0/f1f [0,4194304] 0 2024-05-06T21:26:34.987 INFO:tasks.workunit.client.0.smithi032.stdout:8/307: dread d0/d1b/f2f [0,4194304] 0 2024-05-06T21:26:34.987 INFO:tasks.workunit.client.0.smithi032.stdout:8/308: fdatasync d0/d1c/f32 0 2024-05-06T21:26:34.988 INFO:tasks.workunit.client.0.smithi032.stdout:8/309: symlink d0/d1b/d39/d3b/l59 0 2024-05-06T21:26:34.988 INFO:tasks.workunit.client.0.smithi032.stdout:8/310: rmdir d0/d1b/d39 39 2024-05-06T21:26:34.989 INFO:tasks.workunit.client.0.smithi032.stdout:8/311: readlink d0/d1c/l21 0 2024-05-06T21:26:34.989 INFO:tasks.workunit.client.0.smithi032.stdout:6/288: dwrite d8/dd/d1b/f2d [0,4194304] 0 2024-05-06T21:26:34.992 INFO:tasks.workunit.client.0.smithi032.stdout:6/289: creat d8/d33/f4a x:0 0 0 2024-05-06T21:26:34.993 INFO:tasks.workunit.client.0.smithi032.stdout:6/290: symlink d8/dd/l4b 0 2024-05-06T21:26:34.994 INFO:tasks.workunit.client.0.smithi032.stdout:6/291: link f4 d8/dd/d18/d3b/f4c 0 2024-05-06T21:26:34.995 INFO:tasks.workunit.client.0.smithi032.stdout:8/312: write d0/f9 [8698,117753] 0 2024-05-06T21:26:34.995 INFO:tasks.workunit.client.0.smithi032.stdout:8/313: write d0/d1b/f34 [931163,65799] 0 2024-05-06T21:26:34.998 INFO:tasks.workunit.client.0.smithi032.stdout:6/292: getdents d8/dd 0 2024-05-06T21:26:34.999 INFO:tasks.workunit.client.0.smithi032.stdout:6/293: write d8/f10 [743108,113219] 0 2024-05-06T21:26:35.000 INFO:tasks.workunit.client.0.smithi032.stdout:6/294: creat d8/d33/d3e/f4d x:0 0 0 2024-05-06T21:26:35.009 INFO:tasks.workunit.client.0.smithi032.stdout:8/314: dread d0/f49 [0,4194304] 0 2024-05-06T21:26:35.009 INFO:tasks.workunit.client.0.smithi032.stdout:8/315: write d0/d1b/d39/d3b/f44 [641717,38067] 0 2024-05-06T21:26:35.011 INFO:tasks.workunit.client.0.smithi032.stdout:8/316: creat d0/d1b/d39/f5a x:0 0 0 2024-05-06T21:26:35.011 INFO:tasks.workunit.client.0.smithi032.stdout:8/317: creat d0/d1b/d39/d3b/f5b x:0 0 0 2024-05-06T21:26:35.011 INFO:tasks.workunit.client.0.smithi032.stdout:8/318: chown d0/d1c/c1e 928436778 1 2024-05-06T21:26:35.011 INFO:tasks.workunit.client.0.smithi032.stdout:8/319: fdatasync d0/f4a 0 2024-05-06T21:26:35.011 INFO:tasks.workunit.client.0.smithi032.stdout:8/320: fdatasync d0/f5 0 2024-05-06T21:26:35.012 INFO:tasks.workunit.client.0.smithi032.stdout:8/321: truncate d0/f49 4170834 0 2024-05-06T21:26:35.015 INFO:tasks.workunit.client.0.smithi032.stdout:6/295: dwrite d8/dd/d18/d3b/f4c [8388608,4194304] 0 2024-05-06T21:26:35.017 INFO:tasks.workunit.client.0.smithi032.stdout:6/296: rename d8/dd/d18/d22/f40 to d8/d3d/f4e 0 2024-05-06T21:26:35.020 INFO:tasks.workunit.client.0.smithi032.stdout:6/297: symlink d8/dd/d18/d3b/l4f 0 2024-05-06T21:26:35.037 INFO:tasks.workunit.client.0.smithi032.stdout:6/298: dwrite d8/f31 [0,4194304] 0 2024-05-06T21:26:35.041 INFO:tasks.workunit.client.0.smithi032.stdout:6/299: dread d8/dd/d18/d3b/f4c [4194304,4194304] 0 2024-05-06T21:26:35.043 INFO:tasks.workunit.client.0.smithi032.stdout:6/300: creat d8/dd/d18/d3b/f50 x:0 0 0 2024-05-06T21:26:35.045 INFO:tasks.workunit.client.0.smithi032.stdout:6/301: link d8/dd/d18/d22/c38 d8/dd/d1b/d35/c51 0 2024-05-06T21:26:35.045 INFO:tasks.workunit.client.0.smithi032.stdout:6/302: creat d8/d33/f52 x:0 0 0 2024-05-06T21:26:35.047 INFO:tasks.workunit.client.0.smithi032.stdout:6/303: symlink d8/d3d/d49/l53 0 2024-05-06T21:26:35.060 INFO:tasks.workunit.client.0.smithi032.stdout:2/243: sync 2024-05-06T21:26:35.061 INFO:tasks.workunit.client.0.smithi032.stdout:2/244: mkdir df/d19/d1e/d54 0 2024-05-06T21:26:35.061 INFO:tasks.workunit.client.0.smithi032.stdout:2/245: chown df/d19/d1e/d23/d25/d2d/c30 28 1 2024-05-06T21:26:35.061 INFO:tasks.workunit.client.0.smithi032.stdout:2/246: symlink df/d19/d1e/d54/l55 0 2024-05-06T21:26:35.068 INFO:tasks.workunit.client.0.smithi032.stdout:2/247: write df/d19/d1e/f48 [1642117,15252] 0 2024-05-06T21:26:35.076 INFO:tasks.workunit.client.0.smithi032.stdout:2/248: dread df/d19/d1e/d1f/f2a [0,4194304] 0 2024-05-06T21:26:35.096 INFO:tasks.workunit.client.0.smithi032.stdout:2/249: dwrite df/d19/d1e/d1f/d2e/d33/f24 [0,4194304] 0 2024-05-06T21:26:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:35 smithi154 ceph-mon[32880]: pgmap v18: 65 pgs: 65 active+clean; 475 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 51 MiB/s wr, 532 op/s 2024-05-06T21:26:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:35 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:26:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:35 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:35 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:35 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:35 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:35 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:35 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:36.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:35 smithi032 ceph-mon[27179]: pgmap v18: 65 pgs: 65 active+clean; 475 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 51 MiB/s wr, 532 op/s 2024-05-06T21:26:36.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:35 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:26:36.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:35 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:36.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:35 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:36.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:35 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:36.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:35 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:36.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:35 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:36.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:35 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:37.091 INFO:tasks.workunit.client.0.smithi032.stdout:2/250: sync 2024-05-06T21:26:37.091 INFO:tasks.workunit.client.0.smithi032.stdout:5/164: sync 2024-05-06T21:26:37.091 INFO:tasks.workunit.client.0.smithi032.stdout:4/378: sync 2024-05-06T21:26:37.092 INFO:tasks.workunit.client.0.smithi032.stdout:0/274: sync 2024-05-06T21:26:37.092 INFO:tasks.workunit.client.0.smithi032.stdout:2/251: creat df/d19/d1e/d35/f56 x:0 0 0 2024-05-06T21:26:37.092 INFO:tasks.workunit.client.0.smithi032.stdout:8/322: sync 2024-05-06T21:26:37.092 INFO:tasks.workunit.client.0.smithi032.stdout:1/325: sync 2024-05-06T21:26:37.092 INFO:tasks.workunit.client.0.smithi032.stdout:7/386: sync 2024-05-06T21:26:37.092 INFO:tasks.workunit.client.0.smithi032.stdout:3/197: sync 2024-05-06T21:26:37.092 INFO:tasks.workunit.client.0.smithi032.stdout:3/198: write d1/d4/fe [920512,37016] 0 2024-05-06T21:26:37.092 INFO:tasks.workunit.client.0.smithi032.stdout:9/310: sync 2024-05-06T21:26:37.092 INFO:tasks.workunit.client.0.smithi032.stdout:6/304: sync 2024-05-06T21:26:37.093 INFO:tasks.workunit.client.0.smithi032.stdout:6/305: readlink d8/dd/d18/l30 0 2024-05-06T21:26:37.093 INFO:tasks.workunit.client.0.smithi032.stdout:6/306: chown d8/d33/d3e 4230 1 2024-05-06T21:26:37.093 INFO:tasks.workunit.client.0.smithi032.stdout:9/311: write d1/d13/d33/d3f/f4e [910473,62333] 0 2024-05-06T21:26:37.093 INFO:tasks.workunit.client.0.smithi032.stdout:5/165: unlink d0/f5 0 2024-05-06T21:26:37.094 INFO:tasks.workunit.client.0.smithi032.stdout:4/379: link d2/d13/c4b d2/d13/c82 0 2024-05-06T21:26:37.100 INFO:tasks.workunit.client.0.smithi032.stdout:6/307: symlink d8/dd/l54 0 2024-05-06T21:26:37.100 INFO:tasks.workunit.client.0.smithi032.stdout:6/308: creat d8/d33/d3e/f55 x:0 0 0 2024-05-06T21:26:37.100 INFO:tasks.workunit.client.0.smithi032.stdout:6/309: creat d8/dd/d18/d3b/f56 x:0 0 0 2024-05-06T21:26:37.102 INFO:tasks.workunit.client.0.smithi032.stdout:9/312: symlink d1/d13/d25/l61 0 2024-05-06T21:26:37.102 INFO:tasks.workunit.client.0.smithi032.stdout:9/313: write d1/d13/f16 [1006711,77975] 0 2024-05-06T21:26:37.103 INFO:tasks.workunit.client.0.smithi032.stdout:4/380: truncate d2/d2c/d31/f5a 1847274 0 2024-05-06T21:26:37.103 INFO:tasks.workunit.client.0.smithi032.stdout:4/381: fdatasync d2/d16/d44/d45/f48 0 2024-05-06T21:26:37.105 INFO:tasks.workunit.client.0.smithi032.stdout:7/387: rmdir db/d12/d16/d21/d41 39 2024-05-06T21:26:37.105 INFO:tasks.workunit.client.0.smithi032.stdout:7/388: chown db/d12/d16/c22 1130 1 2024-05-06T21:26:37.105 INFO:tasks.workunit.client.0.smithi032.stdout:7/389: fdatasync db/d12/f6d 0 2024-05-06T21:26:37.108 INFO:tasks.workunit.client.0.smithi032.stdout:6/310: creat d8/dd/d1b/f57 x:0 0 0 2024-05-06T21:26:37.111 INFO:tasks.workunit.client.0.smithi032.stdout:5/166: rename d0/d11/f13 to d0/f23 0 2024-05-06T21:26:37.114 INFO:tasks.workunit.client.0.smithi032.stdout:4/382: dread d2/f24 [0,4194304] 0 2024-05-06T21:26:37.114 INFO:tasks.workunit.client.0.smithi032.stdout:7/390: link db/d12/d16/d21/f4a db/d12/d16/f72 0 2024-05-06T21:26:37.115 INFO:tasks.workunit.client.0.smithi032.stdout:6/311: creat d8/dd/d18/d13/f58 x:0 0 0 2024-05-06T21:26:37.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:37.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:37.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: Adjusting osd_memory_target on smithi154 to 2240M 2024-05-06T21:26:37.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:37.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:26:37.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:26:37.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: Updating smithi032:/etc/ceph/ceph.conf 2024-05-06T21:26:37.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-06T21:26:37.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:26:37.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:26:37.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:26:37.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:26:37.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:26:37.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:26:37.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:36 smithi154 ceph-mon[32880]: pgmap v19: 65 pgs: 65 active+clean; 854 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 79 MiB/s rd, 112 MiB/s wr, 986 op/s 2024-05-06T21:26:37.120 INFO:tasks.workunit.client.0.smithi032.stdout:4/383: mknod d2/d16/d44/d45/c83 0 2024-05-06T21:26:37.120 INFO:tasks.workunit.client.0.smithi032.stdout:4/384: chown d2/c4f 34 1 2024-05-06T21:26:37.121 INFO:tasks.workunit.client.0.smithi032.stdout:6/312: unlink d8/d33/f52 0 2024-05-06T21:26:37.123 INFO:tasks.workunit.client.0.smithi032.stdout:5/167: mkdir d0/d24 0 2024-05-06T21:26:37.123 INFO:tasks.workunit.client.0.smithi032.stdout:5/168: chown d0/d11/f21 957 1 2024-05-06T21:26:37.124 INFO:tasks.workunit.client.0.smithi032.stdout:6/313: mknod d8/dd/d1b/c59 0 2024-05-06T21:26:37.125 INFO:tasks.workunit.client.0.smithi032.stdout:5/169: write d0/f18 [4431087,111549] 0 2024-05-06T21:26:37.125 INFO:tasks.workunit.client.0.smithi032.stdout:5/170: chown d0/f12 5522956 1 2024-05-06T21:26:37.125 INFO:tasks.workunit.client.0.smithi032.stdout:5/171: chown d0/ld 0 1 2024-05-06T21:26:37.126 INFO:tasks.workunit.client.0.smithi032.stdout:3/199: dwrite d1/f39 [4194304,4194304] 0 2024-05-06T21:26:37.126 INFO:tasks.workunit.client.0.smithi032.stdout:6/314: rename d8/dd/d18/d22/f29 to d8/dd/d18/d13/f5a 0 2024-05-06T21:26:37.128 INFO:tasks.workunit.client.0.smithi032.stdout:3/200: symlink d1/d4/da/l40 0 2024-05-06T21:26:37.128 INFO:tasks.workunit.client.0.smithi032.stdout:3/201: dread - d1/f3a zero size 2024-05-06T21:26:37.128 INFO:tasks.workunit.client.0.smithi032.stdout:3/202: truncate d1/f3a 190631 0 2024-05-06T21:26:37.129 INFO:tasks.workunit.client.0.smithi032.stdout:6/315: truncate d8/dd/f26 423844 0 2024-05-06T21:26:37.130 INFO:tasks.workunit.client.0.smithi032.stdout:5/172: dread d0/fb [0,4194304] 0 2024-05-06T21:26:37.130 INFO:tasks.workunit.client.0.smithi032.stdout:5/173: creat d0/d11/f25 x:0 0 0 2024-05-06T21:26:37.130 INFO:tasks.workunit.client.0.smithi032.stdout:0/275: dwrite d4/da/d16/f2c [0,4194304] 0 2024-05-06T21:26:37.130 INFO:tasks.workunit.client.0.smithi032.stdout:9/314: dwrite d1/d13/d34/d26/d39/d45/f4a [0,4194304] 0 2024-05-06T21:26:37.131 INFO:tasks.workunit.client.0.smithi032.stdout:2/252: dwrite df/d19/d1e/d1f/d2e/d33/f20 [0,4194304] 0 2024-05-06T21:26:37.131 INFO:tasks.workunit.client.0.smithi032.stdout:3/203: truncate d1/d4/f9 639610 0 2024-05-06T21:26:37.131 INFO:tasks.workunit.client.0.smithi032.stdout:2/253: chown df/d19/d1e/d1f/d2e/d33/f17 12904376 1 2024-05-06T21:26:37.133 INFO:tasks.workunit.client.0.smithi032.stdout:6/316: symlink d8/d3d/d49/l5b 0 2024-05-06T21:26:37.133 INFO:tasks.workunit.client.0.smithi032.stdout:6/317: fsync d8/dd/d1b/d35/f43 0 2024-05-06T21:26:37.138 INFO:tasks.workunit.client.0.smithi032.stdout:4/385: dread d2/d2c/d31/d7c/f32 [0,4194304] 0 2024-05-06T21:26:37.139 INFO:tasks.workunit.client.0.smithi032.stdout:9/315: dread d1/d13/d34/f43 [0,4194304] 0 2024-05-06T21:26:37.149 INFO:tasks.workunit.client.0.smithi032.stdout:3/204: mkdir d1/d4/da/d31/d3f/d41 0 2024-05-06T21:26:37.151 INFO:tasks.workunit.client.0.smithi032.stdout:2/254: mknod df/d19/d1e/d1f/d2e/d33/c57 0 2024-05-06T21:26:37.151 INFO:tasks.workunit.client.0.smithi032.stdout:2/255: chown df/d19/d1e/d23/d25/l4d 0 1 2024-05-06T21:26:37.153 INFO:tasks.workunit.client.0.smithi032.stdout:6/318: mknod d8/dd/d18/c5c 0 2024-05-06T21:26:37.153 INFO:tasks.workunit.client.0.smithi032.stdout:6/319: chown d8/dd/d1b/d35/f37 426825 1 2024-05-06T21:26:37.153 INFO:tasks.workunit.client.0.smithi032.stdout:6/320: write d8/dd/d1b/d35/f37 [685925,80976] 0 2024-05-06T21:26:37.154 INFO:tasks.workunit.client.0.smithi032.stdout:4/386: truncate d2/d1e/f22 565075 0 2024-05-06T21:26:37.158 INFO:tasks.workunit.client.0.smithi032.stdout:2/256: rmdir df/d19/d1e/d35/d3f 39 2024-05-06T21:26:37.161 INFO:tasks.workunit.client.0.smithi032.stdout:9/316: dread d1/d13/f1f [0,4194304] 0 2024-05-06T21:26:37.162 INFO:tasks.workunit.client.0.smithi032.stdout:2/257: dread df/d19/d1e/d23/d25/f3b [0,4194304] 0 2024-05-06T21:26:37.164 INFO:tasks.workunit.client.0.smithi032.stdout:9/317: rename d1/d13/d34/d26/d39/d45/f4a to d1/d13/f62 0 2024-05-06T21:26:37.165 INFO:tasks.workunit.client.0.smithi032.stdout:2/258: creat df/d19/d1e/d54/f58 x:0 0 0 2024-05-06T21:26:37.165 INFO:tasks.workunit.client.0.smithi032.stdout:2/259: creat df/d19/d1e/d54/f59 x:0 0 0 2024-05-06T21:26:37.165 INFO:tasks.workunit.client.0.smithi032.stdout:9/318: mknod d1/d2f/d4f/c63 0 2024-05-06T21:26:37.166 INFO:tasks.workunit.client.0.smithi032.stdout:9/319: write d1/d13/f2a [667062,4020] 0 2024-05-06T21:26:37.166 INFO:tasks.workunit.client.0.smithi032.stdout:9/320: readlink d1/l6 0 2024-05-06T21:26:37.168 INFO:tasks.workunit.client.0.smithi032.stdout:2/260: creat df/d19/d1e/d35/d3f/d46/f5a x:0 0 0 2024-05-06T21:26:37.168 INFO:tasks.workunit.client.0.smithi032.stdout:2/261: fdatasync df/d19/d1e/d23/d25/f37 0 2024-05-06T21:26:37.168 INFO:tasks.workunit.client.0.smithi032.stdout:9/321: readlink d1/lc 0 2024-05-06T21:26:37.169 INFO:tasks.workunit.client.0.smithi032.stdout:2/262: creat df/d19/f5b x:0 0 0 2024-05-06T21:26:37.169 INFO:tasks.workunit.client.0.smithi032.stdout:2/263: write f7 [2748492,36473] 0 2024-05-06T21:26:37.170 INFO:tasks.workunit.client.0.smithi032.stdout:4/387: dread d2/f6c [0,4194304] 0 2024-05-06T21:26:37.173 INFO:tasks.workunit.client.0.smithi032.stdout:6/321: dread d8/f2b [0,4194304] 0 2024-05-06T21:26:37.181 INFO:tasks.workunit.client.0.smithi032.stdout:3/205: write d1/d4/da/d1d/f24 [2783896,34918] 0 2024-05-06T21:26:37.181 INFO:tasks.workunit.client.0.smithi032.stdout:0/276: dwrite d4/da/d16/f43 [0,4194304] 0 2024-05-06T21:26:37.181 INFO:tasks.workunit.client.0.smithi032.stdout:5/174: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:37.181 INFO:tasks.workunit.client.0.smithi032.stdout:5/175: fdatasync d0/f18 0 2024-05-06T21:26:37.182 INFO:tasks.workunit.client.0.smithi032.stdout:6/322: dread d8/dd/d18/d3b/f4c [0,4194304] 0 2024-05-06T21:26:37.183 INFO:tasks.workunit.client.0.smithi032.stdout:6/323: chown d8/dd/ce 5401948 1 2024-05-06T21:26:37.185 INFO:tasks.workunit.client.0.smithi032.stdout:3/206: creat d1/d4/da/d1d/f42 x:0 0 0 2024-05-06T21:26:37.187 INFO:tasks.workunit.client.0.smithi032.stdout:5/176: mkdir d0/d24/d26 0 2024-05-06T21:26:37.188 INFO:tasks.workunit.client.0.smithi032.stdout:2/264: write df/d19/d1e/d1f/d2e/d33/f18 [1963729,87323] 0 2024-05-06T21:26:37.188 INFO:tasks.workunit.client.0.smithi032.stdout:6/324: write d8/dd/d18/d13/f2c [64171,85972] 0 2024-05-06T21:26:37.188 INFO:tasks.workunit.client.0.smithi032.stdout:6/325: creat d8/dd/d18/d13/f5d x:0 0 0 2024-05-06T21:26:37.188 INFO:tasks.workunit.client.0.smithi032.stdout:3/207: mkdir d1/d4/da/d31/d3f/d41/d43 0 2024-05-06T21:26:37.191 INFO:tasks.workunit.client.0.smithi032.stdout:4/388: dwrite f1 [8388608,4194304] 0 2024-05-06T21:26:37.191 INFO:tasks.workunit.client.0.smithi032.stdout:4/389: chown d2/f9 5 1 2024-05-06T21:26:37.191 INFO:tasks.workunit.client.0.smithi032.stdout:4/390: write d2/d16/d44/d45/d4e/f6b [44905,124287] 0 2024-05-06T21:26:37.194 INFO:tasks.workunit.client.0.smithi032.stdout:3/208: mkdir d1/d4/da/d31/d3f/d41/d43/d44 0 2024-05-06T21:26:37.194 INFO:tasks.workunit.client.0.smithi032.stdout:3/209: write d1/d4/da/f2f [2876686,44924] 0 2024-05-06T21:26:37.196 INFO:tasks.workunit.client.0.smithi032.stdout:5/177: rename d0/d11/f21 to d0/f27 0 2024-05-06T21:26:37.199 INFO:tasks.workunit.client.0.smithi032.stdout:6/326: dread d8/dd/d18/d13/f2c [0,4194304] 0 2024-05-06T21:26:37.200 INFO:tasks.workunit.client.0.smithi032.stdout:3/210: mkdir d1/d4/da/d31/d3f/d41/d45 0 2024-05-06T21:26:37.200 INFO:tasks.workunit.client.0.smithi032.stdout:0/277: dwrite d4/da/f17 [0,4194304] 0 2024-05-06T21:26:37.203 INFO:tasks.workunit.client.0.smithi032.stdout:4/391: rmdir d2/d16 39 2024-05-06T21:26:37.203 INFO:tasks.workunit.client.0.smithi032.stdout:4/392: write d2/d1e/f80 [608330,88651] 0 2024-05-06T21:26:37.203 INFO:tasks.workunit.client.0.smithi032.stdout:6/327: mknod d8/dd/d18/d13/d1d/c5e 0 2024-05-06T21:26:37.209 INFO:tasks.workunit.client.0.smithi032.stdout:0/278: truncate d4/f9 3421719 0 2024-05-06T21:26:37.209 INFO:tasks.workunit.client.0.smithi032.stdout:0/279: getdents d4/da/d14/d1a 0 2024-05-06T21:26:37.211 INFO:tasks.workunit.client.0.smithi032.stdout:4/393: creat d2/d16/d44/d74/d76/d81/f84 x:0 0 0 2024-05-06T21:26:37.211 INFO:tasks.workunit.client.0.smithi032.stdout:4/394: chown d2/d16/d44/d54 6 1 2024-05-06T21:26:37.212 INFO:tasks.workunit.client.0.smithi032.stdout:6/328: rename d8/dd/d1b/l32 to d8/l5f 0 2024-05-06T21:26:37.212 INFO:tasks.workunit.client.0.smithi032.stdout:6/329: truncate d8/dd/d18/d3b/f50 884564 0 2024-05-06T21:26:37.214 INFO:tasks.workunit.client.0.smithi032.stdout:0/280: creat d4/da/d16/d33/f57 x:0 0 0 2024-05-06T21:26:37.215 INFO:tasks.workunit.client.0.smithi032.stdout:4/395: unlink d2/d16/d44/d54/l61 0 2024-05-06T21:26:37.217 INFO:tasks.workunit.client.0.smithi032.stdout:6/330: creat d8/d3d/d49/f60 x:0 0 0 2024-05-06T21:26:37.217 INFO:tasks.workunit.client.0.smithi032.stdout:0/281: symlink d4/d3e/l58 0 2024-05-06T21:26:37.218 INFO:tasks.workunit.client.0.smithi032.stdout:3/211: dwrite d1/d4/da/d1d/f24 [0,4194304] 0 2024-05-06T21:26:37.219 INFO:tasks.workunit.client.0.smithi032.stdout:3/212: chown d1/d4/d11/f2b 48 1 2024-05-06T21:26:37.219 INFO:tasks.workunit.client.0.smithi032.stdout:3/213: write d1/d4/d11/f36 [1458309,32795] 0 2024-05-06T21:26:37.219 INFO:tasks.workunit.client.0.smithi032.stdout:3/214: rename d1/d4 to d1/d4/da/d31/d3f/d41/d43/d46 22 2024-05-06T21:26:37.219 INFO:tasks.workunit.client.0.smithi032.stdout:3/215: chown d1/d4/da/d31 29 1 2024-05-06T21:26:37.219 INFO:tasks.workunit.client.0.smithi032.stdout:4/396: link d2/d1e/d47/l73 d2/d16/d44/d74/d76/l85 0 2024-05-06T21:26:37.219 INFO:tasks.workunit.client.0.smithi032.stdout:4/397: rename d2/d16/d44/d74 to d2/d16/d44/d74/d86 22 2024-05-06T21:26:37.221 INFO:tasks.workunit.client.0.smithi032.stdout:6/331: unlink d8/dd/d18/d13/f5d 0 2024-05-06T21:26:37.221 INFO:tasks.workunit.client.0.smithi032.stdout:6/332: dread - d8/dd/d1b/d35/f43 zero size 2024-05-06T21:26:37.222 INFO:tasks.workunit.client.0.smithi032.stdout:0/282: link d4/da/l13 d4/da/d16/l59 0 2024-05-06T21:26:37.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:37.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T21:26:37.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: Adjusting osd_memory_target on smithi154 to 2240M 2024-05-06T21:26:37.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:37.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: Updating smithi032:/etc/ceph/ceph.conf 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:26:37.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:36 smithi032 ceph-mon[27179]: pgmap v19: 65 pgs: 65 active+clean; 854 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 79 MiB/s rd, 112 MiB/s wr, 986 op/s 2024-05-06T21:26:37.225 INFO:tasks.workunit.client.0.smithi032.stdout:3/216: mkdir d1/d4/da/d31/d47 0 2024-05-06T21:26:37.226 INFO:tasks.workunit.client.0.smithi032.stdout:4/398: rmdir d2/d16 39 2024-05-06T21:26:37.228 INFO:tasks.workunit.client.0.smithi032.stdout:3/217: creat d1/d4/da/d31/f48 x:0 0 0 2024-05-06T21:26:37.229 INFO:tasks.workunit.client.0.smithi032.stdout:3/218: mknod d1/d4/d11/c49 0 2024-05-06T21:26:37.231 INFO:tasks.workunit.client.0.smithi032.stdout:3/219: mkdir d1/d4/da/d31/d47/d4a 0 2024-05-06T21:26:37.231 INFO:tasks.workunit.client.0.smithi032.stdout:3/220: read d1/f14 [3415214,112758] 0 2024-05-06T21:26:37.243 INFO:tasks.workunit.client.0.smithi032.stdout:3/221: dread d1/d4/f30 [0,4194304] 0 2024-05-06T21:26:37.248 INFO:tasks.workunit.client.0.smithi032.stdout:3/222: dread d1/d2a/f37 [0,4194304] 0 2024-05-06T21:26:37.249 INFO:tasks.workunit.client.0.smithi032.stdout:3/223: mknod d1/d4/da/d31/d47/d4a/c4b 0 2024-05-06T21:26:37.249 INFO:tasks.workunit.client.0.smithi032.stdout:3/224: stat d1/d4/da/d31/d3f 0 2024-05-06T21:26:37.250 INFO:tasks.workunit.client.0.smithi032.stdout:0/283: dwrite d4/da/d16/f2c [0,4194304] 0 2024-05-06T21:26:37.250 INFO:tasks.workunit.client.0.smithi032.stdout:4/399: dwrite d2/f9 [0,4194304] 0 2024-05-06T21:26:37.251 INFO:tasks.workunit.client.0.smithi032.stdout:3/225: creat d1/d2a/f4c x:0 0 0 2024-05-06T21:26:37.252 INFO:tasks.workunit.client.0.smithi032.stdout:4/400: rmdir d2/d16/d44 39 2024-05-06T21:26:37.252 INFO:tasks.workunit.client.0.smithi032.stdout:4/401: read d2/d16/d44/d45/f6e [47296,74646] 0 2024-05-06T21:26:37.254 INFO:tasks.workunit.client.0.smithi032.stdout:4/402: mknod d2/d2c/c87 0 2024-05-06T21:26:37.255 INFO:tasks.workunit.client.0.smithi032.stdout:4/403: getdents d2/d1e 0 2024-05-06T21:26:37.256 INFO:tasks.workunit.client.0.smithi032.stdout:3/226: dread d1/f6 [4194304,4194304] 0 2024-05-06T21:26:37.256 INFO:tasks.workunit.client.0.smithi032.stdout:3/227: dread - d1/d4/da/f38 zero size 2024-05-06T21:26:37.256 INFO:tasks.workunit.client.0.smithi032.stdout:4/404: mkdir d2/d16/d44/d74/d79/d88 0 2024-05-06T21:26:37.258 INFO:tasks.workunit.client.0.smithi032.stdout:4/405: creat d2/d2c/f89 x:0 0 0 2024-05-06T21:26:37.258 INFO:tasks.workunit.client.0.smithi032.stdout:0/284: dread d4/da/f17 [0,4194304] 0 2024-05-06T21:26:37.258 INFO:tasks.workunit.client.0.smithi032.stdout:0/285: write d4/da/d16/d33/d46/f50 [861544,25866] 0 2024-05-06T21:26:37.259 INFO:tasks.workunit.client.0.smithi032.stdout:4/406: mkdir d2/d16/d44/d54/d69/d8a 0 2024-05-06T21:26:37.260 INFO:tasks.workunit.client.0.smithi032.stdout:4/407: rmdir d2/d16/d44/d54/d69 39 2024-05-06T21:26:37.263 INFO:tasks.workunit.client.0.smithi032.stdout:4/408: dread d2/d16/d44/d45/f48 [0,4194304] 0 2024-05-06T21:26:37.263 INFO:tasks.workunit.client.0.smithi032.stdout:4/409: chown d2/d1e/d47 116513 1 2024-05-06T21:26:37.263 INFO:tasks.workunit.client.0.smithi032.stdout:4/410: write d2/d16/d44/d45/f48 [230821,57732] 0 2024-05-06T21:26:37.264 INFO:tasks.workunit.client.0.smithi032.stdout:4/411: rmdir d2/d2c/d31/d7c 39 2024-05-06T21:26:37.277 INFO:tasks.workunit.client.0.smithi032.stdout:3/228: dwrite d1/d2a/f4c [0,4194304] 0 2024-05-06T21:26:37.277 INFO:tasks.workunit.client.0.smithi032.stdout:3/229: fdatasync d1/f6 0 2024-05-06T21:26:37.281 INFO:tasks.workunit.client.0.smithi032.stdout:0/286: dwrite d4/da/f17 [4194304,4194304] 0 2024-05-06T21:26:37.281 INFO:tasks.workunit.client.0.smithi032.stdout:3/230: rename d1/d4/f29 to d1/d4/da/d31/d3f/d41/d45/f4d 0 2024-05-06T21:26:37.281 INFO:tasks.workunit.client.0.smithi032.stdout:4/412: dread d2/fa [0,4194304] 0 2024-05-06T21:26:37.355 INFO:tasks.workunit.client.0.smithi032.stdout:3/231: rename d1/d4/da/d31/d3f to d1/d4/da/d4e 0 2024-05-06T21:26:37.355 INFO:tasks.workunit.client.0.smithi032.stdout:3/232: readlink d1/d4/d11/l1a 0 2024-05-06T21:26:37.361 INFO:tasks.workunit.client.0.smithi032.stdout:4/413: rename d2/d1e/f21 to d2/d16/d44/d74/f8b 0 2024-05-06T21:26:37.363 INFO:tasks.workunit.client.0.smithi032.stdout:3/233: creat d1/d4/d11/f4f x:0 0 0 2024-05-06T21:26:37.363 INFO:tasks.workunit.client.0.smithi032.stdout:3/234: chown d1/d4/da/d31/d47 167656 1 2024-05-06T21:26:37.363 INFO:tasks.workunit.client.0.smithi032.stdout:3/235: fdatasync d1/d4/f9 0 2024-05-06T21:26:37.372 INFO:tasks.workunit.client.0.smithi032.stdout:4/414: dread d2/d1e/f28 [0,4194304] 0 2024-05-06T21:26:37.378 INFO:tasks.workunit.client.0.smithi032.stdout:4/415: write d2/f35 [2488121,43046] 0 2024-05-06T21:26:37.389 INFO:tasks.workunit.client.0.smithi032.stdout:3/236: symlink d1/l50 0 2024-05-06T21:26:37.392 INFO:tasks.workunit.client.0.smithi032.stdout:0/287: mknod d4/da/d16/c5a 0 2024-05-06T21:26:37.393 INFO:tasks.workunit.client.0.smithi032.stdout:4/416: dread d2/f9 [0,4194304] 0 2024-05-06T21:26:37.393 INFO:tasks.workunit.client.0.smithi032.stdout:4/417: stat d2/d16/c3d 0 2024-05-06T21:26:37.393 INFO:tasks.workunit.client.0.smithi032.stdout:3/237: read d1/d4/fe [720603,107764] 0 2024-05-06T21:26:37.393 INFO:tasks.workunit.client.0.smithi032.stdout:0/288: creat d4/da/d16/d33/f5b x:0 0 0 2024-05-06T21:26:37.394 INFO:tasks.workunit.client.0.smithi032.stdout:4/418: symlink d2/d16/d44/d74/d7e/l8c 0 2024-05-06T21:26:37.419 INFO:tasks.workunit.client.0.smithi032.stdout:3/238: dwrite d1/d4/d11/f36 [0,4194304] 0 2024-05-06T21:26:37.419 INFO:tasks.workunit.client.0.smithi032.stdout:0/289: dwrite d4/d3e/f49 [0,4194304] 0 2024-05-06T21:26:37.421 INFO:tasks.workunit.client.0.smithi032.stdout:3/239: symlink d1/d4/da/d1d/l51 0 2024-05-06T21:26:37.423 INFO:tasks.workunit.client.0.smithi032.stdout:3/240: creat d1/d4/f52 x:0 0 0 2024-05-06T21:26:37.427 INFO:tasks.workunit.client.0.smithi032.stdout:0/290: write d4/da/f39 [1820484,74369] 0 2024-05-06T21:26:37.442 INFO:tasks.workunit.client.0.smithi032.stdout:0/291: dwrite d4/da/d16/d33/d46/f50 [0,4194304] 0 2024-05-06T21:26:37.444 INFO:tasks.workunit.client.0.smithi032.stdout:0/292: rmdir d4 39 2024-05-06T21:26:37.444 INFO:tasks.workunit.client.0.smithi032.stdout:0/293: readlink d4/l10 0 2024-05-06T21:26:37.444 INFO:tasks.workunit.client.0.smithi032.stdout:0/294: write d4/da/d16/d33/f57 [555223,128829] 0 2024-05-06T21:26:37.444 INFO:tasks.workunit.client.0.smithi032.stdout:0/295: creat d4/d51/f5c x:0 0 0 2024-05-06T21:26:37.461 INFO:tasks.workunit.client.0.smithi032.stdout:0/296: dwrite d4/da/f22 [0,4194304] 0 2024-05-06T21:26:38.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: Reconfiguring prometheus.smithi032 (dependencies changed)... 2024-05-06T21:26:38.225 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:37 smithi032 ceph-mon[27179]: Reconfiguring daemon prometheus.smithi032 on smithi032 2024-05-06T21:26:38.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:38.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: Reconfiguring prometheus.smithi032 (dependencies changed)... 2024-05-06T21:26:38.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:37 smithi154 ceph-mon[32880]: Reconfiguring daemon prometheus.smithi032 on smithi032 2024-05-06T21:26:38.784 INFO:tasks.workunit.client.1.smithi154.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-06T21:26:38.784 INFO:tasks.workunit.client.1.smithi154.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-06T21:26:38.784 INFO:tasks.workunit.client.1.smithi154.stderr:+ make 2024-05-06T21:26:38.835 INFO:tasks.workunit.client.0.smithi032.stdout:0/297: sync 2024-05-06T21:26:38.835 INFO:tasks.workunit.client.0.smithi032.stdout:7/391: sync 2024-05-06T21:26:38.835 INFO:tasks.workunit.client.0.smithi032.stdout:4/419: sync 2024-05-06T21:26:38.835 INFO:tasks.workunit.client.0.smithi032.stdout:8/323: sync 2024-05-06T21:26:38.836 INFO:tasks.workunit.client.0.smithi032.stdout:2/265: sync 2024-05-06T21:26:38.836 INFO:tasks.workunit.client.0.smithi032.stdout:6/333: sync 2024-05-06T21:26:38.836 INFO:tasks.workunit.client.0.smithi032.stdout:4/420: readlink d2/l1a 0 2024-05-06T21:26:38.836 INFO:tasks.workunit.client.0.smithi032.stdout:8/324: chown d0/f27 295 1 2024-05-06T21:26:38.836 INFO:tasks.workunit.client.0.smithi032.stdout:3/241: sync 2024-05-06T21:26:38.836 INFO:tasks.workunit.client.0.smithi032.stdout:5/178: sync 2024-05-06T21:26:38.836 INFO:tasks.workunit.client.0.smithi032.stdout:1/326: sync 2024-05-06T21:26:38.836 INFO:tasks.workunit.client.0.smithi032.stdout:9/322: sync 2024-05-06T21:26:38.837 INFO:tasks.workunit.client.0.smithi032.stdout:0/298: rmdir d4/da/d16 39 2024-05-06T21:26:38.838 INFO:tasks.workunit.client.0.smithi032.stdout:8/325: link d0/f16 d0/d1b/d39/d3b/d57/f5c 0 2024-05-06T21:26:38.839 INFO:tasks.workunit.client.0.smithi032.stdout:7/392: rmdir db/d12/d49 39 2024-05-06T21:26:38.839 INFO:tasks.workunit.client.0.smithi032.stdout:9/323: getdents d1/d2f 0 2024-05-06T21:26:38.839 INFO:tasks.workunit.client.0.smithi032.stdout:9/324: chown d1 1 1 2024-05-06T21:26:38.840 INFO:tasks.workunit.client.0.smithi032.stdout:9/325: chown d1/f12 43181 1 2024-05-06T21:26:38.842 INFO:tasks.workunit.client.0.smithi032.stdout:1/327: symlink db/d2a/d4f/l62 0 2024-05-06T21:26:38.842 INFO:tasks.workunit.client.0.smithi032.stdout:0/299: unlink c1 0 2024-05-06T21:26:38.842 INFO:tasks.workunit.client.0.smithi032.stdout:0/300: chown d4/l5 50 1 2024-05-06T21:26:38.842 INFO:tasks.workunit.client.0.smithi032.stdout:8/326: write d0/f5 [910241,105338] 0 2024-05-06T21:26:38.843 INFO:tasks.workunit.client.0.smithi032.stdout:8/327: chown d0/f53 22 1 2024-05-06T21:26:38.843 INFO:tasks.workunit.client.0.smithi032.stdout:8/328: chown d0/f4a 37163140 1 2024-05-06T21:26:38.843 INFO:tasks.workunit.client.0.smithi032.stdout:7/393: mknod db/c73 0 2024-05-06T21:26:38.845 INFO:tasks.workunit.client.0.smithi032.stdout:4/421: write d2/d1e/f28 [2182488,96069] 0 2024-05-06T21:26:38.846 INFO:tasks.workunit.client.0.smithi032.stdout:9/326: unlink d1/d13/d34/d26/d39/c41 0 2024-05-06T21:26:38.848 INFO:tasks.workunit.client.0.smithi032.stdout:1/328: creat db/d16/d46/f63 x:0 0 0 2024-05-06T21:26:38.849 INFO:tasks.workunit.client.0.smithi032.stdout:0/301: rmdir d4/d3e/d42 39 2024-05-06T21:26:38.849 INFO:tasks.workunit.client.0.smithi032.stdout:0/302: chown d4/da/d14/d1a/c30 3826620 1 2024-05-06T21:26:38.852 INFO:tasks.workunit.client.0.smithi032.stdout:8/329: getdents d0 0 2024-05-06T21:26:38.852 INFO:tasks.workunit.client.0.smithi032.stdout:8/330: write d0/d1b/d39/d3b/d57/f5c [5188912,22627] 0 2024-05-06T21:26:38.855 INFO:tasks.workunit.client.0.smithi032.stdout:4/422: dread d2/f24 [0,4194304] 0 2024-05-06T21:26:38.863 INFO:tasks.workunit.client.0.smithi032.stdout:8/331: dread d0/f41 [0,4194304] 0 2024-05-06T21:26:38.863 INFO:tasks.workunit.client.0.smithi032.stdout:8/332: fdatasync d0/f4 0 2024-05-06T21:26:38.865 INFO:tasks.workunit.client.0.smithi032.stdout:8/333: mkdir d0/d1b/d39/d3b/d57/d5d 0 2024-05-06T21:26:38.871 INFO:tasks.workunit.client.0.smithi032.stdout:9/327: dread d1/f7 [4194304,4194304] 0 2024-05-06T21:26:38.871 INFO:tasks.workunit.client.0.smithi032.stdout:3/242: dwrite d1/d4/fe [0,4194304] 0 2024-05-06T21:26:38.871 INFO:tasks.workunit.client.0.smithi032.stdout:7/394: write db/d12/d16/d21/f44 [5981716,32538] 0 2024-05-06T21:26:38.874 INFO:tasks.workunit.client.0.smithi032.stdout:3/243: mknod d1/c53 0 2024-05-06T21:26:38.876 INFO:tasks.workunit.client.0.smithi032.stdout:6/334: dwrite d8/dd/d1b/d35/f3a [0,4194304] 0 2024-05-06T21:26:38.877 INFO:tasks.workunit.client.0.smithi032.stdout:7/395: mknod db/d12/d16/d21/c74 0 2024-05-06T21:26:38.877 INFO:tasks.workunit.client.0.smithi032.stdout:7/396: stat db/d12/d49/f4d 0 2024-05-06T21:26:38.877 INFO:tasks.workunit.client.0.smithi032.stdout:1/329: dwrite db/d16/f32 [4194304,4194304] 0 2024-05-06T21:26:38.882 INFO:tasks.workunit.client.0.smithi032.stdout:1/330: mknod db/d16/d46/d55/c64 0 2024-05-06T21:26:38.883 INFO:tasks.workunit.client.0.smithi032.stdout:1/331: stat db/f51 0 2024-05-06T21:26:38.883 INFO:tasks.workunit.client.0.smithi032.stdout:6/335: rmdir d8/dd/d18/d3b 39 2024-05-06T21:26:38.883 INFO:tasks.workunit.client.0.smithi032.stdout:6/336: stat d8/dd/d1b/f57 0 2024-05-06T21:26:38.886 INFO:tasks.workunit.client.0.smithi032.stdout:6/337: dread d8/dd/d18/d13/f24 [0,4194304] 0 2024-05-06T21:26:38.891 INFO:tasks.workunit.client.0.smithi032.stdout:3/244: write d1/d4/da/d1d/f24 [3770875,127291] 0 2024-05-06T21:26:38.895 INFO:tasks.workunit.client.0.smithi032.stdout:8/334: dwrite d0/d1b/f3e [4194304,4194304] 0 2024-05-06T21:26:38.896 INFO:tasks.workunit.client.0.smithi032.stdout:1/332: write db/d16/f1b [1083108,45942] 0 2024-05-06T21:26:38.896 INFO:tasks.workunit.client.0.smithi032.stdout:7/397: dwrite db/d12/d49/f4d [0,4194304] 0 2024-05-06T21:26:38.897 INFO:tasks.workunit.client.0.smithi032.stdout:1/333: symlink db/d16/d5d/l65 0 2024-05-06T21:26:38.899 INFO:tasks.workunit.client.0.smithi032.stdout:7/398: creat db/d12/d49/f75 x:0 0 0 2024-05-06T21:26:38.900 INFO:tasks.workunit.client.0.smithi032.stdout:7/399: symlink db/d12/d16/d2a/d53/l76 0 2024-05-06T21:26:38.902 INFO:tasks.workunit.client.0.smithi032.stdout:9/328: dwrite d1/f18 [0,4194304] 0 2024-05-06T21:26:38.902 INFO:tasks.workunit.client.0.smithi032.stdout:9/329: chown d1/d13/d34/d26/l3d 1 1 2024-05-06T21:26:38.902 INFO:tasks.workunit.client.0.smithi032.stdout:9/330: chown d1/d13/d34/f43 59055 1 2024-05-06T21:26:38.904 INFO:tasks.workunit.client.0.smithi032.stdout:3/245: dread d1/f39 [0,4194304] 0 2024-05-06T21:26:38.904 INFO:tasks.workunit.client.0.smithi032.stdout:3/246: fdatasync d1/d4/f3e 0 2024-05-06T21:26:38.904 INFO:tasks.workunit.client.0.smithi032.stdout:9/331: mkdir d1/d13/d25/d64 0 2024-05-06T21:26:38.905 INFO:tasks.workunit.client.0.smithi032.stdout:8/335: dread d0/d1b/d39/d3b/d57/f5c [0,4194304] 0 2024-05-06T21:26:38.907 INFO:tasks.workunit.client.0.smithi032.stdout:3/247: rename d1/l19 to d1/d4/da/d4e/d41/d45/l54 0 2024-05-06T21:26:38.908 INFO:tasks.workunit.client.0.smithi032.stdout:6/338: dwrite d8/dd/d18/d3b/f4c [0,4194304] 0 2024-05-06T21:26:38.910 INFO:tasks.workunit.client.0.smithi032.stdout:8/336: mkdir d0/d1c/d5e 0 2024-05-06T21:26:38.910 INFO:tasks.workunit.client.0.smithi032.stdout:1/334: dread db/f29 [0,4194304] 0 2024-05-06T21:26:38.911 INFO:tasks.workunit.client.0.smithi032.stdout:1/335: chown db 30754 1 2024-05-06T21:26:38.915 INFO:tasks.workunit.client.0.smithi032.stdout:8/337: rename d0/d1b/d39/d3b/f44 to d0/d1b/f5f 0 2024-05-06T21:26:38.915 INFO:tasks.workunit.client.0.smithi032.stdout:8/338: truncate d0/d1b/d39/f48 322947 0 2024-05-06T21:26:38.916 INFO:tasks.workunit.client.0.smithi032.stdout:7/400: read db/d12/d16/d2a/d53/f36 [922229,1097] 0 2024-05-06T21:26:38.916 INFO:tasks.workunit.client.0.smithi032.stdout:7/401: chown db/d12/d16/d2a/d39 2791600 1 2024-05-06T21:26:38.916 INFO:tasks.workunit.client.0.smithi032.stdout:7/402: fdatasync db/d12/d16/d21/d41/f70 0 2024-05-06T21:26:38.919 INFO:tasks.workunit.client.0.smithi032.stdout:9/332: dread d1/f9 [0,4194304] 0 2024-05-06T21:26:38.919 INFO:tasks.workunit.client.0.smithi032.stdout:9/333: chown d1/d13/l21 43959 1 2024-05-06T21:26:38.919 INFO:tasks.workunit.client.0.smithi032.stdout:9/334: dread - d1/d2f/f37 zero size 2024-05-06T21:26:38.919 INFO:tasks.workunit.client.0.smithi032.stdout:9/335: chown d1/d13/d34 19 1 2024-05-06T21:26:38.920 INFO:tasks.workunit.client.0.smithi032.stdout:1/336: rename db/d37/d52/f56 to db/d47/d4a/f66 0 2024-05-06T21:26:38.923 INFO:tasks.workunit.client.0.smithi032.stdout:8/339: symlink d0/d1b/d39/d3b/d57/l60 0 2024-05-06T21:26:38.923 INFO:tasks.workunit.client.0.smithi032.stdout:8/340: stat d0/d1c/f42 0 2024-05-06T21:26:38.925 INFO:tasks.workunit.client.0.smithi032.stdout:7/403: rename db/f10 to db/f77 0 2024-05-06T21:26:38.925 INFO:tasks.workunit.client.0.smithi032.stdout:7/404: fsync db/d12/d16/f71 0 2024-05-06T21:26:38.925 INFO:tasks.workunit.client.0.smithi032.stdout:7/405: chown db/d12/d16/d21 3257 1 2024-05-06T21:26:38.925 INFO:tasks.workunit.client.0.smithi032.stdout:7/406: read - db/d12/d49/f6f zero size 2024-05-06T21:26:38.925 INFO:tasks.workunit.client.0.smithi032.stdout:7/407: write db/d12/f61 [413260,60906] 0 2024-05-06T21:26:38.925 INFO:tasks.workunit.client.0.smithi032.stdout:7/408: chown db/d12/d16/d21/d41/f70 33259590 1 2024-05-06T21:26:38.925 INFO:tasks.workunit.client.0.smithi032.stdout:7/409: chown l4 53 1 2024-05-06T21:26:38.926 INFO:tasks.workunit.client.0.smithi032.stdout:7/410: chown db/d12/d49/l6a 389002497 1 2024-05-06T21:26:38.927 INFO:tasks.workunit.client.0.smithi032.stdout:9/336: write d1/f9 [3249403,60402] 0 2024-05-06T21:26:38.934 INFO:tasks.workunit.client.0.smithi032.stdout:7/411: rename db/d12/d16/d2a/d53 to db/d12/d16/d21/d41/d78 0 2024-05-06T21:26:38.938 INFO:tasks.workunit.client.0.smithi032.stdout:6/339: read d8/dd/d1b/f2d [1514137,95283] 0 2024-05-06T21:26:38.938 INFO:tasks.workunit.client.0.smithi032.stdout:3/248: dwrite d1/d2a/f4c [0,4194304] 0 2024-05-06T21:26:38.938 INFO:tasks.workunit.client.0.smithi032.stdout:6/340: write d8/dd/d1b/d35/f37 [1623364,107525] 0 2024-05-06T21:26:38.942 INFO:tasks.workunit.client.0.smithi032.stdout:3/249: rename d1/f3a to d1/d4/da/d31/f55 0 2024-05-06T21:26:38.943 INFO:tasks.workunit.client.0.smithi032.stdout:9/337: dread d1/d13/f1f [0,4194304] 0 2024-05-06T21:26:38.945 INFO:tasks.workunit.client.0.smithi032.stdout:6/341: rename d8/dd/ce to d8/dd/d1b/c61 0 2024-05-06T21:26:38.946 INFO:tasks.workunit.client.0.smithi032.stdout:3/250: creat d1/d4/da/d4e/d41/d45/f56 x:0 0 0 2024-05-06T21:26:38.946 INFO:tasks.workunit.client.0.smithi032.stdout:3/251: chown d1/d4/da/d4e/d41/d45 2785 1 2024-05-06T21:26:38.948 INFO:tasks.workunit.client.0.smithi032.stdout:9/338: creat d1/d13/d25/d59/f65 x:0 0 0 2024-05-06T21:26:38.949 INFO:tasks.workunit.client.0.smithi032.stdout:9/339: creat d1/d13/d33/d3f/d60/f66 x:0 0 0 2024-05-06T21:26:38.949 INFO:tasks.workunit.client.0.smithi032.stdout:9/340: dread - d1/d2f/f37 zero size 2024-05-06T21:26:38.950 INFO:tasks.workunit.client.0.smithi032.stdout:9/341: write d1/d13/d34/d26/f27 [437357,7259] 0 2024-05-06T21:26:38.950 INFO:tasks.workunit.client.0.smithi032.stdout:3/252: getdents d1/d4 0 2024-05-06T21:26:38.950 INFO:tasks.workunit.client.0.smithi032.stdout:3/253: truncate d1/d4/da/f38 930899 0 2024-05-06T21:26:38.951 INFO:tasks.workunit.client.0.smithi032.stdout:9/342: symlink d1/d13/l67 0 2024-05-06T21:26:38.952 INFO:tasks.workunit.client.0.smithi032.stdout:9/343: mknod d1/d13/d34/d26/d39/d45/c68 0 2024-05-06T21:26:38.952 INFO:tasks.workunit.client.0.smithi032.stdout:9/344: readlink d1/d13/d34/l5f 0 2024-05-06T21:26:38.953 INFO:tasks.workunit.client.0.smithi032.stdout:8/341: dwrite d0/d1b/f3e [0,4194304] 0 2024-05-06T21:26:38.956 INFO:tasks.workunit.client.0.smithi032.stdout:9/345: creat d1/d13/d25/d64/f69 x:0 0 0 2024-05-06T21:26:38.956 INFO:tasks.workunit.client.0.smithi032.stdout:9/346: write d1/d2f/f3c [979681,7785] 0 2024-05-06T21:26:38.957 INFO:tasks.workunit.client.0.smithi032.stdout:8/342: rename d0/d1b/f2f to d0/d1b/f61 0 2024-05-06T21:26:38.958 INFO:tasks.workunit.client.1.smithi154.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-06T21:26:38.958 INFO:tasks.workunit.client.0.smithi032.stdout:9/347: symlink d1/d2f/l6a 0 2024-05-06T21:26:38.960 INFO:tasks.workunit.client.0.smithi032.stdout:8/343: rename d0/f49 to d0/d1b/d39/d3b/f62 0 2024-05-06T21:26:38.961 INFO:tasks.workunit.client.0.smithi032.stdout:9/348: unlink d1/d2f/c3a 0 2024-05-06T21:26:38.968 INFO:tasks.workunit.client.0.smithi032.stdout:7/412: dwrite f3 [4194304,4194304] 0 2024-05-06T21:26:38.979 INFO:tasks.workunit.client.0.smithi032.stdout:3/254: dwrite d1/f14 [0,4194304] 0 2024-05-06T21:26:38.980 INFO:tasks.workunit.client.0.smithi032.stdout:3/255: symlink d1/d4/da/d1d/l57 0 2024-05-06T21:26:38.980 INFO:tasks.workunit.client.0.smithi032.stdout:3/256: dread - d1/d4/da/d4e/d41/d45/f56 zero size 2024-05-06T21:26:38.981 INFO:tasks.workunit.client.0.smithi032.stdout:3/257: creat d1/f58 x:0 0 0 2024-05-06T21:26:38.981 INFO:tasks.workunit.client.0.smithi032.stdout:3/258: fsync d1/d4/da/d4e/d41/d45/f56 0 2024-05-06T21:26:38.991 INFO:tasks.workunit.client.0.smithi032.stdout:8/344: dwrite d0/f41 [4194304,4194304] 0 2024-05-06T21:26:38.991 INFO:tasks.workunit.client.0.smithi032.stdout:6/342: dwrite d8/dd/d1b/d35/f37 [0,4194304] 0 2024-05-06T21:26:38.991 INFO:tasks.workunit.client.0.smithi032.stdout:8/345: dread - d0/f33 zero size 2024-05-06T21:26:38.991 INFO:tasks.workunit.client.0.smithi032.stdout:6/343: creat d8/dd/d1b/f62 x:0 0 0 2024-05-06T21:26:38.994 INFO:tasks.workunit.client.0.smithi032.stdout:6/344: rmdir d8/d3d/d49 39 2024-05-06T21:26:38.997 INFO:tasks.workunit.client.0.smithi032.stdout:9/349: dwrite d1/d13/d34/f43 [0,4194304] 0 2024-05-06T21:26:38.997 INFO:tasks.workunit.client.0.smithi032.stdout:9/350: fdatasync d1/f12 0 2024-05-06T21:26:38.998 INFO:tasks.workunit.client.0.smithi032.stdout:9/351: chown d1/d13/d33 4 1 2024-05-06T21:26:38.998 INFO:tasks.workunit.client.0.smithi032.stdout:9/352: truncate d1/d13/f16 6232271 0 2024-05-06T21:26:38.998 INFO:tasks.workunit.client.0.smithi032.stdout:8/346: write d0/f1a [3481833,114684] 0 2024-05-06T21:26:38.999 INFO:tasks.workunit.client.0.smithi032.stdout:8/347: readlink d0/d1c/l21 0 2024-05-06T21:26:39.000 INFO:tasks.workunit.client.0.smithi032.stdout:9/353: rename d1/f10 to d1/d13/d34/d26/d49/f6b 0 2024-05-06T21:26:39.000 INFO:tasks.workunit.client.0.smithi032.stdout:9/354: write d1/d13/f2a [1570207,25874] 0 2024-05-06T21:26:39.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/259: dwrite d1/d4/d11/f4f [0,4194304] 0 2024-05-06T21:26:39.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/260: fdatasync d1/d4/da/f2f 0 2024-05-06T21:26:39.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/261: readlink d1/d4/da/l3b 0 2024-05-06T21:26:39.002 INFO:tasks.workunit.client.0.smithi032.stdout:8/348: dread d0/d1b/d47/f54 [0,4194304] 0 2024-05-06T21:26:39.004 INFO:tasks.workunit.client.0.smithi032.stdout:9/355: dread d1/d13/d34/d26/f27 [0,4194304] 0 2024-05-06T21:26:39.006 INFO:tasks.workunit.client.0.smithi032.stdout:3/262: mknod d1/d4/da/d4e/d41/c59 0 2024-05-06T21:26:39.007 INFO:tasks.workunit.client.0.smithi032.stdout:8/349: mkdir d0/d1b/d39/d3b/d57/d5d/d63 0 2024-05-06T21:26:39.008 INFO:tasks.workunit.client.0.smithi032.stdout:9/356: rename d1/d13/l28 to d1/d13/d33/d5e/l6c 0 2024-05-06T21:26:39.011 INFO:tasks.workunit.client.0.smithi032.stdout:3/263: getdents d1/d4/da/d1d 0 2024-05-06T21:26:39.011 INFO:tasks.workunit.client.0.smithi032.stdout:3/264: stat d1/d4/da/d4e/d41/c59 0 2024-05-06T21:26:39.012 INFO:tasks.workunit.client.0.smithi032.stdout:3/265: dread - d1/d4/da/d1d/f42 zero size 2024-05-06T21:26:39.013 INFO:tasks.workunit.client.0.smithi032.stdout:6/345: dwrite d8/dd/d18/f19 [0,4194304] 0 2024-05-06T21:26:39.014 INFO:tasks.workunit.client.0.smithi032.stdout:6/346: mkdir d8/d33/d63 0 2024-05-06T21:26:39.014 INFO:tasks.workunit.client.0.smithi032.stdout:6/347: write d8/dd/d18/d13/f28 [514255,64791] 0 2024-05-06T21:26:39.017 INFO:tasks.workunit.client.0.smithi032.stdout:9/357: rename d1/d13/d34/d26/d49/f6b to d1/d13/d34/d26/d39/d45/f6d 0 2024-05-06T21:26:39.018 INFO:tasks.workunit.client.0.smithi032.stdout:6/348: truncate d8/f17 10809859 0 2024-05-06T21:26:39.020 INFO:tasks.workunit.client.0.smithi032.stdout:3/266: rename d1/d4/da/f38 to d1/d4/d11/f5a 0 2024-05-06T21:26:39.023 INFO:tasks.workunit.client.0.smithi032.stdout:3/267: mknod d1/d4/da/d4e/d41/d45/c5b 0 2024-05-06T21:26:39.023 INFO:tasks.workunit.client.0.smithi032.stdout:3/268: fsync d1/d4/da/d1d/f24 0 2024-05-06T21:26:39.026 INFO:tasks.workunit.client.0.smithi032.stdout:3/269: link d1/d4/da/d4e/l28 d1/d4/da/d31/d47/d4a/l5c 0 2024-05-06T21:26:39.026 INFO:tasks.workunit.client.0.smithi032.stdout:3/270: dread - d1/d4/da/d31/f48 zero size 2024-05-06T21:26:39.026 INFO:tasks.workunit.client.0.smithi032.stdout:3/271: creat d1/f5d x:0 0 0 2024-05-06T21:26:39.026 INFO:tasks.workunit.client.0.smithi032.stdout:3/272: truncate d1/d4/da/d1d/f24 5719882 0 2024-05-06T21:26:39.026 INFO:tasks.workunit.client.0.smithi032.stdout:3/273: write d1/d4/da/f2c [614011,97491] 0 2024-05-06T21:26:39.034 INFO:tasks.workunit.client.0.smithi032.stdout:6/349: dwrite d8/d3d/d49/f60 [0,4194304] 0 2024-05-06T21:26:39.034 INFO:tasks.workunit.client.0.smithi032.stdout:6/350: read d8/dd/f12 [63602,60234] 0 2024-05-06T21:26:39.037 INFO:tasks.workunit.client.0.smithi032.stdout:6/351: rename d8/d33/d3e/f55 to d8/d33/d3e/f64 0 2024-05-06T21:26:39.038 INFO:tasks.workunit.client.0.smithi032.stdout:3/274: rmdir d1/d4/da/d4e/d41/d45 39 2024-05-06T21:26:39.039 INFO:tasks.workunit.client.0.smithi032.stdout:3/275: getdents d1/d4/da/d4e/d41/d45 0 2024-05-06T21:26:39.039 INFO:tasks.workunit.client.0.smithi032.stdout:3/276: dread - d1/f5d zero size 2024-05-06T21:26:39.040 INFO:tasks.workunit.client.0.smithi032.stdout:3/277: mkdir d1/d4/da/d4e/d5e 0 2024-05-06T21:26:39.043 INFO:tasks.workunit.client.0.smithi032.stdout:3/278: creat d1/d4/da/d31/d47/d4a/f5f x:0 0 0 2024-05-06T21:26:39.043 INFO:tasks.workunit.client.0.smithi032.stdout:3/279: chown d1/d4/da/d4e/d41/c59 483839953 1 2024-05-06T21:26:39.043 INFO:tasks.workunit.client.0.smithi032.stdout:3/280: chown d1/d4/c10 137 1 2024-05-06T21:26:39.044 INFO:tasks.workunit.client.0.smithi032.stdout:3/281: mknod d1/d4/d11/c60 0 2024-05-06T21:26:39.044 INFO:tasks.workunit.client.0.smithi032.stdout:3/282: write d1/d4/da/d31/f55 [227211,109428] 0 2024-05-06T21:26:39.060 INFO:tasks.workunit.client.0.smithi032.stdout:6/352: dwrite d8/dd/d1b/f57 [0,4194304] 0 2024-05-06T21:26:39.061 INFO:tasks.workunit.client.0.smithi032.stdout:3/283: dwrite d1/d4/f2e [4194304,4194304] 0 2024-05-06T21:26:39.063 INFO:tasks.workunit.client.0.smithi032.stdout:6/353: rename d8/dd/d1b/f2d to d8/d33/d63/f65 0 2024-05-06T21:26:39.063 INFO:tasks.workunit.client.0.smithi032.stdout:6/354: truncate d8/dd/d1b/d35/f44 130240 0 2024-05-06T21:26:39.066 INFO:tasks.workunit.client.0.smithi032.stdout:6/355: unlink d8/d33/l34 0 2024-05-06T21:26:39.071 INFO:tasks.workunit.client.0.smithi032.stdout:6/356: dread d8/dd/f12 [0,4194304] 0 2024-05-06T21:26:39.071 INFO:tasks.workunit.client.0.smithi032.stdout:6/357: fdatasync d8/dd/d1b/d35/f3f 0 2024-05-06T21:26:39.072 INFO:tasks.workunit.client.0.smithi032.stdout:6/358: creat d8/dd/d1b/d35/f66 x:0 0 0 2024-05-06T21:26:39.073 INFO:tasks.workunit.client.0.smithi032.stdout:6/359: mkdir d8/dd/d1b/d67 0 2024-05-06T21:26:39.079 INFO:tasks.workunit.client.0.smithi032.stdout:3/284: dwrite d1/d4/da/d1d/f24 [0,4194304] 0 2024-05-06T21:26:39.081 INFO:tasks.workunit.client.0.smithi032.stdout:3/285: symlink d1/d4/da/d4e/l61 0 2024-05-06T21:26:39.082 INFO:tasks.workunit.client.0.smithi032.stdout:3/286: creat d1/d4/f62 x:0 0 0 2024-05-06T21:26:39.083 INFO:tasks.workunit.client.0.smithi032.stdout:3/287: symlink d1/d4/da/d4e/l63 0 2024-05-06T21:26:39.084 INFO:tasks.workunit.client.0.smithi032.stdout:3/288: mknod d1/d4/c64 0 2024-05-06T21:26:39.085 INFO:tasks.workunit.client.0.smithi032.stdout:3/289: mknod d1/d4/c65 0 2024-05-06T21:26:39.086 INFO:tasks.workunit.client.0.smithi032.stdout:3/290: fdatasync d1/d4/fe 0 2024-05-06T21:26:39.086 INFO:tasks.workunit.client.0.smithi032.stdout:3/291: truncate d1/d4/da/d4e/d41/d45/f56 541319 0 2024-05-06T21:26:39.086 INFO:tasks.workunit.client.0.smithi032.stdout:3/292: link d1/d2a/f37 d1/d4/da/d4e/d41/f66 0 2024-05-06T21:26:39.087 INFO:tasks.workunit.client.0.smithi032.stdout:3/293: mkdir d1/d4/da/d4e/d41/d43/d44/d67 0 2024-05-06T21:26:39.087 INFO:tasks.workunit.client.0.smithi032.stdout:3/294: write d1/d4/f30 [4224110,43534] 0 2024-05-06T21:26:39.088 INFO:tasks.workunit.client.0.smithi032.stdout:3/295: mkdir d1/d4/da/d31/d47/d4a/d68 0 2024-05-06T21:26:39.090 INFO:tasks.workunit.client.0.smithi032.stdout:3/296: link d1/c1e d1/c69 0 2024-05-06T21:26:39.090 INFO:tasks.workunit.client.0.smithi032.stdout:3/297: truncate d1/d4/da/d31/f55 925221 0 2024-05-06T21:26:39.091 INFO:tasks.workunit.client.0.smithi032.stdout:3/298: creat d1/d4/da/d4e/d41/d45/f6a x:0 0 0 2024-05-06T21:26:39.091 INFO:tasks.workunit.client.0.smithi032.stdout:6/360: dwrite d8/f2b [0,4194304] 0 2024-05-06T21:26:39.104 INFO:tasks.workunit.client.0.smithi032.stdout:3/299: read d1/d4/da/d4e/d41/f66 [742007,17909] 0 2024-05-06T21:26:39.105 INFO:tasks.workunit.client.0.smithi032.stdout:3/300: symlink d1/d4/da/d4e/l6b 0 2024-05-06T21:26:39.105 INFO:tasks.workunit.client.0.smithi032.stdout:3/301: chown d1/d4/d11/f2b 107447 1 2024-05-06T21:26:39.109 INFO:tasks.workunit.client.0.smithi032.stdout:6/361: dwrite d8/dd/d1b/d35/f44 [0,4194304] 0 2024-05-06T21:26:39.121 INFO:tasks.workunit.client.0.smithi032.stdout:3/302: dwrite d1/d4/da/d4e/d41/d45/f4d [0,4194304] 0 2024-05-06T21:26:39.121 INFO:tasks.workunit.client.0.smithi032.stdout:3/303: fdatasync d1/d4/f30 0 2024-05-06T21:26:39.137 INFO:tasks.workunit.client.0.smithi032.stdout:3/304: dread d1/d4/d11/f36 [0,4194304] 0 2024-05-06T21:26:39.138 INFO:tasks.workunit.client.0.smithi032.stdout:3/305: rename d1/f39 to d1/d4/da/d4e/d41/d43/f6c 0 2024-05-06T21:26:39.139 INFO:tasks.workunit.client.0.smithi032.stdout:3/306: dread - d1/d4/f3e zero size 2024-05-06T21:26:39.139 INFO:tasks.workunit.client.0.smithi032.stdout:3/307: truncate d1/d4/da/d1d/f42 1008659 0 2024-05-06T21:26:39.146 INFO:tasks.workunit.client.0.smithi032.stdout:3/308: dread d1/d4/d11/f2b [0,4194304] 0 2024-05-06T21:26:39.146 INFO:tasks.workunit.client.0.smithi032.stdout:3/309: read - d1/f35 zero size 2024-05-06T21:26:39.147 INFO:tasks.workunit.client.0.smithi032.stdout:3/310: creat d1/d4/da/d4e/d5e/f6d x:0 0 0 2024-05-06T21:26:39.163 INFO:tasks.workunit.client.0.smithi032.stdout:3/311: dwrite d1/d4/f52 [0,4194304] 0 2024-05-06T21:26:39.163 INFO:tasks.workunit.client.0.smithi032.stdout:3/312: fsync d1/d4/d11/f5a 0 2024-05-06T21:26:39.168 INFO:tasks.workunit.client.0.smithi032.stdout:3/313: creat d1/d4/da/d1d/f6e x:0 0 0 2024-05-06T21:26:39.169 INFO:tasks.workunit.client.0.smithi032.stdout:3/314: symlink d1/l6f 0 2024-05-06T21:26:39.188 INFO:tasks.workunit.client.0.smithi032.stdout:3/315: dwrite d1/f14 [4194304,4194304] 0 2024-05-06T21:26:39.189 INFO:tasks.workunit.client.0.smithi032.stdout:3/316: dread d1/d4/da/d4e/d41/d45/f56 [0,4194304] 0 2024-05-06T21:26:39.189 INFO:tasks.workunit.client.0.smithi032.stdout:3/317: write d1/d4/da/d1d/f6e [924372,124020] 0 2024-05-06T21:26:39.189 INFO:tasks.workunit.client.0.smithi032.stdout:3/318: chown d1/d4/d11/c49 183282886 1 2024-05-06T21:26:39.191 INFO:tasks.workunit.client.0.smithi032.stdout:3/319: creat d1/d4/da/d4e/d41/d43/f70 x:0 0 0 2024-05-06T21:26:39.192 INFO:tasks.workunit.client.0.smithi032.stdout:3/320: truncate d1/d4/da/d1d/f24 848307 0 2024-05-06T21:26:39.192 INFO:tasks.workunit.client.0.smithi032.stdout:3/321: chown d1/d4/da/d1d/l57 1107 1 2024-05-06T21:26:39.208 INFO:tasks.workunit.client.0.smithi032.stdout:3/322: dwrite d1/f58 [0,4194304] 0 2024-05-06T21:26:39.208 INFO:tasks.workunit.client.0.smithi032.stdout:3/323: chown d1/d2a/l33 6139219 1 2024-05-06T21:26:39.208 INFO:tasks.workunit.client.0.smithi032.stdout:3/324: write d1/d4/da/f32 [401565,81860] 0 2024-05-06T21:26:39.210 INFO:tasks.workunit.client.0.smithi032.stdout:3/325: mkdir d1/d2a/d71 0 2024-05-06T21:26:39.211 INFO:tasks.workunit.client.0.smithi032.stdout:3/326: mknod d1/d4/da/d31/d47/c72 0 2024-05-06T21:26:39.215 INFO:tasks.workunit.client.1.smithi154.stderr:++ readlink -f fsstress 2024-05-06T21:26:39.215 INFO:tasks.workunit.client.1.smithi154.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-06T21:26:39.215 INFO:tasks.workunit.client.1.smithi154.stderr:+ popd 2024-05-06T21:26:39.215 INFO:tasks.workunit.client.1.smithi154.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-06T21:26:39.216 INFO:tasks.workunit.client.1.smithi154.stderr:+ popd 2024-05-06T21:26:39.216 INFO:tasks.workunit.client.1.smithi154.stdout:~/cephtest/mnt.1/client.1/tmp 2024-05-06T21:26:39.216 INFO:tasks.workunit.client.1.smithi154.stderr:++ mktemp -d -p . 2024-05-06T21:26:39.217 INFO:tasks.workunit.client.1.smithi154.stderr:+ T=./tmp.OnfRIoG0QN 2024-05-06T21:26:39.217 INFO:tasks.workunit.client.1.smithi154.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.OnfRIoG0QN -l 1 -n 1000 -p 10 -v 2024-05-06T21:26:39.218 INFO:tasks.workunit.client.0.smithi032.stdout:3/327: read d1/f14 [6388178,118101] 0 2024-05-06T21:26:39.218 INFO:tasks.workunit.client.0.smithi032.stdout:3/328: write d1/d4/da/f32 [826445,98754] 0 2024-05-06T21:26:39.219 INFO:tasks.workunit.client.1.smithi154.stdout:seed = 1715082125 2024-05-06T21:26:39.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:38 smithi032 ceph-mon[27179]: pgmap v20: 65 pgs: 65 active+clean; 854 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 79 MiB/s rd, 109 MiB/s wr, 728 op/s 2024-05-06T21:26:39.221 INFO:tasks.workunit.client.1.smithi154.stdout:0/0: dread - no filename 2024-05-06T21:26:39.221 INFO:tasks.workunit.client.1.smithi154.stdout:0/1: chown . 36 1 2024-05-06T21:26:39.221 INFO:tasks.workunit.client.1.smithi154.stdout:0/2: dread - no filename 2024-05-06T21:26:39.221 INFO:tasks.workunit.client.1.smithi154.stdout:0/3: dwrite - no filename 2024-05-06T21:26:39.221 INFO:tasks.workunit.client.1.smithi154.stdout:0/4: chown . 442 1 2024-05-06T21:26:39.221 INFO:tasks.workunit.client.1.smithi154.stdout:1/0: truncate - no filename 2024-05-06T21:26:39.221 INFO:tasks.workunit.client.1.smithi154.stdout:1/1: dwrite - no filename 2024-05-06T21:26:39.222 INFO:tasks.workunit.client.1.smithi154.stdout:0/5: mknod c0 0 2024-05-06T21:26:39.222 INFO:tasks.workunit.client.1.smithi154.stdout:0/6: chown c0 17167 1 2024-05-06T21:26:39.223 INFO:tasks.workunit.client.1.smithi154.stdout:2/0: chown . 12 1 2024-05-06T21:26:39.223 INFO:tasks.workunit.client.1.smithi154.stdout:2/1: link - no file 2024-05-06T21:26:39.223 INFO:tasks.workunit.client.1.smithi154.stdout:2/2: dwrite - no filename 2024-05-06T21:26:39.223 INFO:tasks.workunit.client.1.smithi154.stdout:2/3: dread - no filename 2024-05-06T21:26:39.224 INFO:tasks.workunit.client.1.smithi154.stdout:1/2: symlink l0 0 2024-05-06T21:26:39.224 INFO:tasks.workunit.client.1.smithi154.stdout:1/3: stat l0 0 2024-05-06T21:26:39.224 INFO:tasks.workunit.client.1.smithi154.stdout:1/4: write - no filename 2024-05-06T21:26:39.225 INFO:tasks.workunit.client.1.smithi154.stdout:0/7: rename c0 to c1 0 2024-05-06T21:26:39.225 INFO:tasks.workunit.client.1.smithi154.stdout:0/8: readlink - no filename 2024-05-06T21:26:39.226 INFO:tasks.workunit.client.1.smithi154.stdout:0/9: dread - no filename 2024-05-06T21:26:39.226 INFO:tasks.workunit.client.1.smithi154.stdout:0/10: truncate - no filename 2024-05-06T21:26:39.226 INFO:tasks.workunit.client.1.smithi154.stdout:0/11: dwrite - no filename 2024-05-06T21:26:39.226 INFO:tasks.workunit.client.1.smithi154.stdout:0/12: chown c1 7066550 1 2024-05-06T21:26:39.226 INFO:tasks.workunit.client.1.smithi154.stdout:3/0: read - no filename 2024-05-06T21:26:39.226 INFO:tasks.workunit.client.1.smithi154.stdout:3/1: write - no filename 2024-05-06T21:26:39.227 INFO:tasks.workunit.client.1.smithi154.stdout:3/2: link - no file 2024-05-06T21:26:39.227 INFO:tasks.workunit.client.1.smithi154.stdout:3/3: readlink - no filename 2024-05-06T21:26:39.227 INFO:tasks.workunit.client.1.smithi154.stdout:3/4: write - no filename 2024-05-06T21:26:39.228 INFO:tasks.workunit.client.1.smithi154.stdout:2/4: creat f0 x:0 0 0 2024-05-06T21:26:39.228 INFO:tasks.workunit.client.1.smithi154.stdout:2/5: read - f0 zero size 2024-05-06T21:26:39.228 INFO:tasks.workunit.client.1.smithi154.stdout:2/6: truncate f0 9840 0 2024-05-06T21:26:39.228 INFO:tasks.workunit.client.1.smithi154.stdout:2/7: fdatasync f0 0 2024-05-06T21:26:39.228 INFO:tasks.workunit.client.1.smithi154.stdout:2/8: write f0 [83089,73582] 0 2024-05-06T21:26:39.229 INFO:tasks.workunit.client.1.smithi154.stdout:1/5: symlink l1 0 2024-05-06T21:26:39.229 INFO:tasks.workunit.client.1.smithi154.stdout:1/6: fsync - no filename 2024-05-06T21:26:39.229 INFO:tasks.workunit.client.1.smithi154.stdout:1/7: dwrite - no filename 2024-05-06T21:26:39.230 INFO:tasks.workunit.client.0.smithi032.stdout:3/329: write d1/d4/da/d4e/d41/d43/f6c [5652876,3500] 0 2024-05-06T21:26:39.230 INFO:tasks.workunit.client.1.smithi154.stdout:0/13: creat f2 x:0 0 0 2024-05-06T21:26:39.230 INFO:tasks.workunit.client.1.smithi154.stdout:4/0: truncate - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/1: readlink - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/2: dread - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/3: truncate - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/4: chown . 25 1 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/5: dread - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/6: dread - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/7: dwrite - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/8: dread - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/9: dread - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/10: chown . 511 1 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/11: read - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/12: dread - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/13: dread - no filename 2024-05-06T21:26:39.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/14: fsync - no filename 2024-05-06T21:26:39.233 INFO:tasks.workunit.client.1.smithi154.stdout:3/5: mkdir d0 0 2024-05-06T21:26:39.233 INFO:tasks.workunit.client.1.smithi154.stdout:3/6: rename d0 to d0/d1 22 2024-05-06T21:26:39.233 INFO:tasks.workunit.client.1.smithi154.stdout:5/0: link - no file 2024-05-06T21:26:39.233 INFO:tasks.workunit.client.1.smithi154.stdout:5/1: write - no filename 2024-05-06T21:26:39.233 INFO:tasks.workunit.client.1.smithi154.stdout:1/8: mknod c2 0 2024-05-06T21:26:39.233 INFO:tasks.workunit.client.1.smithi154.stdout:1/9: dread - no filename 2024-05-06T21:26:39.234 INFO:tasks.workunit.client.1.smithi154.stdout:1/10: readlink l1 0 2024-05-06T21:26:39.234 INFO:tasks.workunit.client.1.smithi154.stdout:1/11: chown l1 1379284883 1 2024-05-06T21:26:39.234 INFO:tasks.workunit.client.0.smithi032.stdout:3/330: mkdir d1/d4/da/d4e/d41/d43/d73 0 2024-05-06T21:26:39.234 INFO:tasks.workunit.client.1.smithi154.stdout:4/15: mkdir d0 0 2024-05-06T21:26:39.234 INFO:tasks.workunit.client.1.smithi154.stdout:4/16: readlink - no filename 2024-05-06T21:26:39.235 INFO:tasks.workunit.client.1.smithi154.stdout:3/7: mkdir d0/d2 0 2024-05-06T21:26:39.235 INFO:tasks.workunit.client.1.smithi154.stdout:3/8: chown d0 44 1 2024-05-06T21:26:39.235 INFO:tasks.workunit.client.1.smithi154.stdout:3/9: readlink - no filename 2024-05-06T21:26:39.235 INFO:tasks.workunit.client.1.smithi154.stdout:6/0: write - no filename 2024-05-06T21:26:39.235 INFO:tasks.workunit.client.1.smithi154.stdout:6/1: write - no filename 2024-05-06T21:26:39.235 INFO:tasks.workunit.client.1.smithi154.stdout:6/2: rename - no filename 2024-05-06T21:26:39.236 INFO:tasks.workunit.client.0.smithi032.stdout:3/331: mkdir d1/d4/da/d4e/d41/d43/d73/d74 0 2024-05-06T21:26:39.236 INFO:tasks.workunit.client.1.smithi154.stdout:5/2: creat f0 x:0 0 0 2024-05-06T21:26:39.236 INFO:tasks.workunit.client.0.smithi032.stdout:3/332: mkdir d1/d4/da/d4e/d41/d43/d73/d75 0 2024-05-06T21:26:39.236 INFO:tasks.workunit.client.0.smithi032.stdout:3/333: creat d1/d2a/f76 x:0 0 0 2024-05-06T21:26:39.237 INFO:tasks.workunit.client.1.smithi154.stdout:1/12: link l1 l3 0 2024-05-06T21:26:39.237 INFO:tasks.workunit.client.1.smithi154.stdout:1/13: chown l3 39 1 2024-05-06T21:26:39.238 INFO:tasks.workunit.client.1.smithi154.stdout:4/17: creat d0/f1 x:0 0 0 2024-05-06T21:26:39.238 INFO:tasks.workunit.client.1.smithi154.stdout:4/18: fdatasync d0/f1 0 2024-05-06T21:26:39.239 INFO:tasks.workunit.client.0.smithi032.stdout:3/334: unlink d1/d4/da/d4e/l63 0 2024-05-06T21:26:39.240 INFO:tasks.workunit.client.1.smithi154.stdout:3/10: creat d0/f3 x:0 0 0 2024-05-06T21:26:39.240 INFO:tasks.workunit.client.1.smithi154.stdout:3/11: fdatasync d0/f3 0 2024-05-06T21:26:39.240 INFO:tasks.workunit.client.1.smithi154.stdout:7/0: link - no file 2024-05-06T21:26:39.240 INFO:tasks.workunit.client.1.smithi154.stdout:7/1: dread - no filename 2024-05-06T21:26:39.241 INFO:tasks.workunit.client.1.smithi154.stdout:6/3: mknod c0 0 2024-05-06T21:26:39.241 INFO:tasks.workunit.client.1.smithi154.stdout:6/4: rmdir - no directory 2024-05-06T21:26:39.241 INFO:tasks.workunit.client.1.smithi154.stdout:6/5: dread - no filename 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/3: unlink f0 0 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/4: chown . 546 1 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/5: rename - no filename 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/6: dwrite - no filename 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/7: dwrite - no filename 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/8: link - no file 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/9: dwrite - no filename 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/10: creat f1 x:0 0 0 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/11: dread - f1 zero size 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/12: read - f1 zero size 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:5/13: read - f1 zero size 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:1/14: symlink l4 0 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:1/15: dread - no filename 2024-05-06T21:26:39.243 INFO:tasks.workunit.client.1.smithi154.stdout:1/16: chown l3 14 1 2024-05-06T21:26:39.244 INFO:tasks.workunit.client.1.smithi154.stdout:1/17: dread - no filename 2024-05-06T21:26:39.244 INFO:tasks.workunit.client.1.smithi154.stdout:1/18: truncate - no filename 2024-05-06T21:26:39.244 INFO:tasks.workunit.client.1.smithi154.stdout:4/19: mkdir d0/d2 0 2024-05-06T21:26:39.244 INFO:tasks.workunit.client.1.smithi154.stdout:4/20: fdatasync d0/f1 0 2024-05-06T21:26:39.244 INFO:tasks.workunit.client.1.smithi154.stdout:4/21: rename d0 to d0/d2/d3 22 2024-05-06T21:26:39.244 INFO:tasks.workunit.client.1.smithi154.stdout:4/22: readlink - no filename 2024-05-06T21:26:39.248 INFO:tasks.workunit.client.1.smithi154.stdout:2/9: dwrite f0 [0,4194304] 0 2024-05-06T21:26:39.255 INFO:tasks.workunit.client.1.smithi154.stdout:0/14: dwrite f2 [0,4194304] 0 2024-05-06T21:26:39.258 INFO:tasks.workunit.client.1.smithi154.stdout:2/10: dread f0 [0,4194304] 0 2024-05-06T21:26:39.271 INFO:tasks.workunit.client.1.smithi154.stdout:3/12: mkdir d0/d4 0 2024-05-06T21:26:39.272 INFO:tasks.workunit.client.1.smithi154.stdout:8/0: dwrite - no filename 2024-05-06T21:26:39.272 INFO:tasks.workunit.client.1.smithi154.stdout:8/1: fsync - no filename 2024-05-06T21:26:39.272 INFO:tasks.workunit.client.1.smithi154.stdout:8/2: fdatasync - no filename 2024-05-06T21:26:39.273 INFO:tasks.workunit.client.1.smithi154.stdout:7/2: mknod c0 0 2024-05-06T21:26:39.273 INFO:tasks.workunit.client.1.smithi154.stdout:7/3: truncate - no filename 2024-05-06T21:26:39.273 INFO:tasks.workunit.client.1.smithi154.stdout:6/6: creat f1 x:0 0 0 2024-05-06T21:26:39.273 INFO:tasks.workunit.client.1.smithi154.stdout:6/7: creat f2 x:0 0 0 2024-05-06T21:26:39.274 INFO:tasks.workunit.client.1.smithi154.stdout:6/8: chown f2 190 1 2024-05-06T21:26:39.274 INFO:tasks.workunit.client.1.smithi154.stdout:5/14: mkdir d2 0 2024-05-06T21:26:39.275 INFO:tasks.workunit.client.1.smithi154.stdout:1/19: creat f5 x:0 0 0 2024-05-06T21:26:39.275 INFO:tasks.workunit.client.1.smithi154.stdout:4/23: mknod d0/c4 0 2024-05-06T21:26:39.278 INFO:tasks.workunit.client.1.smithi154.stdout:2/11: symlink l1 0 2024-05-06T21:26:39.278 INFO:tasks.workunit.client.1.smithi154.stdout:2/12: creat f2 x:0 0 0 2024-05-06T21:26:39.279 INFO:tasks.workunit.client.1.smithi154.stdout:9/0: rmdir - no directory 2024-05-06T21:26:39.280 INFO:tasks.workunit.client.1.smithi154.stdout:9/1: dwrite - no filename 2024-05-06T21:26:39.280 INFO:tasks.workunit.client.1.smithi154.stdout:8/3: symlink l0 0 2024-05-06T21:26:39.282 INFO:tasks.workunit.client.1.smithi154.stdout:7/4: creat f1 x:0 0 0 2024-05-06T21:26:39.282 INFO:tasks.workunit.client.1.smithi154.stdout:7/5: dread - f1 zero size 2024-05-06T21:26:39.282 INFO:tasks.workunit.client.1.smithi154.stdout:7/6: write f1 [742762,33459] 0 2024-05-06T21:26:39.284 INFO:tasks.workunit.client.1.smithi154.stdout:6/9: link c0 c3 0 2024-05-06T21:26:39.284 INFO:tasks.workunit.client.1.smithi154.stdout:6/10: rmdir - no directory 2024-05-06T21:26:39.284 INFO:tasks.workunit.client.1.smithi154.stdout:6/11: write f2 [403848,65633] 0 2024-05-06T21:26:39.284 INFO:tasks.workunit.client.1.smithi154.stdout:6/12: write f1 [944448,89551] 0 2024-05-06T21:26:39.285 INFO:tasks.workunit.client.1.smithi154.stdout:5/15: mkdir d2/d3 0 2024-05-06T21:26:39.286 INFO:tasks.workunit.client.1.smithi154.stdout:1/20: mkdir d6 0 2024-05-06T21:26:39.288 INFO:tasks.workunit.client.1.smithi154.stdout:2/13: mknod c3 0 2024-05-06T21:26:39.289 INFO:tasks.workunit.client.1.smithi154.stdout:4/24: dwrite d0/f1 [0,4194304] 0 2024-05-06T21:26:39.290 INFO:tasks.workunit.client.1.smithi154.stdout:9/2: symlink l0 0 2024-05-06T21:26:39.290 INFO:tasks.workunit.client.1.smithi154.stdout:9/3: write - no filename 2024-05-06T21:26:39.290 INFO:tasks.workunit.client.1.smithi154.stdout:9/4: dwrite - no filename 2024-05-06T21:26:39.290 INFO:tasks.workunit.client.1.smithi154.stdout:9/5: fdatasync - no filename 2024-05-06T21:26:39.290 INFO:tasks.workunit.client.1.smithi154.stdout:9/6: dread - no filename 2024-05-06T21:26:39.290 INFO:tasks.workunit.client.1.smithi154.stdout:9/7: stat l0 0 2024-05-06T21:26:39.290 INFO:tasks.workunit.client.1.smithi154.stdout:8/4: mknod c1 0 2024-05-06T21:26:39.293 INFO:tasks.workunit.client.1.smithi154.stdout:7/7: unlink f1 0 2024-05-06T21:26:39.293 INFO:tasks.workunit.client.1.smithi154.stdout:7/8: readlink - no filename 2024-05-06T21:26:39.293 INFO:tasks.workunit.client.1.smithi154.stdout:7/9: fdatasync - no filename 2024-05-06T21:26:39.293 INFO:tasks.workunit.client.1.smithi154.stdout:7/10: creat f2 x:0 0 0 2024-05-06T21:26:39.293 INFO:tasks.workunit.client.1.smithi154.stdout:7/11: dread - f2 zero size 2024-05-06T21:26:39.293 INFO:tasks.workunit.client.1.smithi154.stdout:6/13: mknod c4 0 2024-05-06T21:26:39.294 INFO:tasks.workunit.client.1.smithi154.stdout:5/16: rename f1 to d2/f4 0 2024-05-06T21:26:39.295 INFO:tasks.workunit.client.1.smithi154.stdout:1/21: mknod d6/c7 0 2024-05-06T21:26:39.296 INFO:tasks.workunit.client.1.smithi154.stdout:2/14: symlink l4 0 2024-05-06T21:26:39.296 INFO:tasks.workunit.client.1.smithi154.stdout:2/15: readlink l4 0 2024-05-06T21:26:39.297 INFO:tasks.workunit.client.1.smithi154.stdout:4/25: dread d0/f1 [0,4194304] 0 2024-05-06T21:26:39.300 INFO:tasks.workunit.client.1.smithi154.stdout:9/8: symlink l1 0 2024-05-06T21:26:39.300 INFO:tasks.workunit.client.1.smithi154.stdout:9/9: readlink l1 0 2024-05-06T21:26:39.300 INFO:tasks.workunit.client.1.smithi154.stdout:9/10: write - no filename 2024-05-06T21:26:39.300 INFO:tasks.workunit.client.1.smithi154.stdout:9/11: chown l1 1323099 1 2024-05-06T21:26:39.302 INFO:tasks.workunit.client.1.smithi154.stdout:8/5: creat f2 x:0 0 0 2024-05-06T21:26:39.302 INFO:tasks.workunit.client.1.smithi154.stdout:8/6: stat l0 0 2024-05-06T21:26:39.302 INFO:tasks.workunit.client.1.smithi154.stdout:8/7: rmdir - no directory 2024-05-06T21:26:39.302 INFO:tasks.workunit.client.1.smithi154.stdout:4/26: dread d0/f1 [0,4194304] 0 2024-05-06T21:26:39.302 INFO:tasks.workunit.client.1.smithi154.stdout:2/16: dread f0 [0,4194304] 0 2024-05-06T21:26:39.305 INFO:tasks.workunit.client.1.smithi154.stdout:7/12: link c0 c3 0 2024-05-06T21:26:39.307 INFO:tasks.workunit.client.1.smithi154.stdout:6/14: symlink l5 0 2024-05-06T21:26:39.307 INFO:tasks.workunit.client.1.smithi154.stdout:6/15: write f1 [1535252,16624] 0 2024-05-06T21:26:39.307 INFO:tasks.workunit.client.1.smithi154.stdout:2/17: dread f0 [0,4194304] 0 2024-05-06T21:26:39.307 INFO:tasks.workunit.client.1.smithi154.stdout:2/18: creat f5 x:0 0 0 2024-05-06T21:26:39.308 INFO:tasks.workunit.client.1.smithi154.stdout:5/17: mkdir d2/d3/d5 0 2024-05-06T21:26:39.308 INFO:tasks.workunit.client.1.smithi154.stdout:5/18: chown d2/d3 220409 1 2024-05-06T21:26:39.308 INFO:tasks.workunit.client.1.smithi154.stdout:5/19: read - d2/f4 zero size 2024-05-06T21:26:39.309 INFO:tasks.workunit.client.1.smithi154.stdout:1/22: rmdir d6 39 2024-05-06T21:26:39.309 INFO:tasks.workunit.client.1.smithi154.stdout:1/23: dread - f5 zero size 2024-05-06T21:26:39.310 INFO:tasks.workunit.client.1.smithi154.stdout:1/24: dread - f5 zero size 2024-05-06T21:26:39.310 INFO:tasks.workunit.client.1.smithi154.stdout:1/25: chown l3 5 1 2024-05-06T21:26:39.312 INFO:tasks.workunit.client.1.smithi154.stdout:9/12: unlink l0 0 2024-05-06T21:26:39.312 INFO:tasks.workunit.client.1.smithi154.stdout:9/13: dread - no filename 2024-05-06T21:26:39.312 INFO:tasks.workunit.client.1.smithi154.stdout:9/14: stat l1 0 2024-05-06T21:26:39.312 INFO:tasks.workunit.client.1.smithi154.stdout:9/15: truncate - no filename 2024-05-06T21:26:39.312 INFO:tasks.workunit.client.1.smithi154.stdout:9/16: write - no filename 2024-05-06T21:26:39.313 INFO:tasks.workunit.client.1.smithi154.stdout:8/8: mkdir d3 0 2024-05-06T21:26:39.315 INFO:tasks.workunit.client.1.smithi154.stdout:4/27: symlink d0/l5 0 2024-05-06T21:26:39.316 INFO:tasks.workunit.client.1.smithi154.stdout:3/13: getdents d0 0 2024-05-06T21:26:39.316 INFO:tasks.workunit.client.1.smithi154.stdout:3/14: getdents d0/d2 0 2024-05-06T21:26:39.316 INFO:tasks.workunit.client.1.smithi154.stdout:3/15: rename d0 to d0/d4/d5 22 2024-05-06T21:26:39.317 INFO:tasks.workunit.client.1.smithi154.stdout:6/16: unlink c4 0 2024-05-06T21:26:39.321 INFO:tasks.workunit.client.1.smithi154.stdout:2/19: unlink l4 0 2024-05-06T21:26:39.322 INFO:tasks.workunit.client.1.smithi154.stdout:1/26: creat d6/f8 x:0 0 0 2024-05-06T21:26:39.323 INFO:tasks.workunit.client.1.smithi154.stdout:9/17: creat f2 x:0 0 0 2024-05-06T21:26:39.324 INFO:tasks.workunit.client.1.smithi154.stdout:8/9: symlink d3/l4 0 2024-05-06T21:26:39.324 INFO:tasks.workunit.client.1.smithi154.stdout:5/20: dwrite d2/f4 [0,4194304] 0 2024-05-06T21:26:39.325 INFO:tasks.workunit.client.1.smithi154.stdout:4/28: creat d0/d2/f6 x:0 0 0 2024-05-06T21:26:39.325 INFO:tasks.workunit.client.0.smithi032.stdout:2/266: sync 2024-05-06T21:26:39.327 INFO:tasks.workunit.client.1.smithi154.stdout:3/16: mknod d0/d4/c6 0 2024-05-06T21:26:39.327 INFO:tasks.workunit.client.1.smithi154.stdout:1/27: mknod d6/c9 0 2024-05-06T21:26:39.329 INFO:tasks.workunit.client.1.smithi154.stdout:9/18: symlink l3 0 2024-05-06T21:26:39.331 INFO:tasks.workunit.client.1.smithi154.stdout:8/10: creat d3/f5 x:0 0 0 2024-05-06T21:26:39.332 INFO:tasks.workunit.client.0.smithi032.stdout:2/267: link f7 df/d19/d1e/d23/f5c 0 2024-05-06T21:26:39.334 INFO:tasks.workunit.client.0.smithi032.stdout:2/268: symlink df/d19/d1e/d54/l5d 0 2024-05-06T21:26:39.334 INFO:tasks.workunit.client.0.smithi032.stdout:2/269: chown df/d19/d1e/d54 2778 1 2024-05-06T21:26:39.335 INFO:tasks.workunit.client.1.smithi154.stdout:5/21: rename d2/d3/d5 to d2/d6 0 2024-05-06T21:26:39.335 INFO:tasks.workunit.client.1.smithi154.stdout:1/28: mkdir d6/da 0 2024-05-06T21:26:39.337 INFO:tasks.workunit.client.0.smithi032.stdout:2/270: getdents df/d19/d1e/d1f/d2e 0 2024-05-06T21:26:39.338 INFO:tasks.workunit.client.1.smithi154.stdout:9/19: symlink l4 0 2024-05-06T21:26:39.339 INFO:tasks.workunit.client.0.smithi032.stdout:2/271: mknod df/d19/d1e/d54/c5e 0 2024-05-06T21:26:39.339 INFO:tasks.workunit.client.0.smithi032.stdout:2/272: fdatasync df/d19/d1e/f48 0 2024-05-06T21:26:39.340 INFO:tasks.workunit.client.1.smithi154.stdout:8/11: mkdir d3/d6 0 2024-05-06T21:26:39.340 INFO:tasks.workunit.client.1.smithi154.stdout:8/12: write d3/f5 [1031422,99411] 0 2024-05-06T21:26:39.344 INFO:tasks.workunit.client.1.smithi154.stdout:1/29: mkdir d6/db 0 2024-05-06T21:26:39.346 INFO:tasks.workunit.client.1.smithi154.stdout:9/20: mkdir d5 0 2024-05-06T21:26:39.349 INFO:tasks.workunit.client.1.smithi154.stdout:8/13: link c1 d3/c7 0 2024-05-06T21:26:39.352 INFO:tasks.workunit.client.1.smithi154.stdout:1/30: unlink f5 0 2024-05-06T21:26:39.352 INFO:tasks.workunit.client.1.smithi154.stdout:1/31: dread - d6/f8 zero size 2024-05-06T21:26:39.352 INFO:tasks.workunit.client.1.smithi154.stdout:1/32: dread - d6/f8 zero size 2024-05-06T21:26:39.352 INFO:tasks.workunit.client.1.smithi154.stdout:1/33: dread - d6/f8 zero size 2024-05-06T21:26:39.352 INFO:tasks.workunit.client.1.smithi154.stdout:1/34: creat d6/fc x:0 0 0 2024-05-06T21:26:39.352 INFO:tasks.workunit.client.1.smithi154.stdout:1/35: creat d6/fd x:0 0 0 2024-05-06T21:26:39.355 INFO:tasks.workunit.client.1.smithi154.stdout:9/21: rename f2 to d5/f6 0 2024-05-06T21:26:39.355 INFO:tasks.workunit.client.1.smithi154.stdout:9/22: write d5/f6 [648741,43108] 0 2024-05-06T21:26:39.355 INFO:tasks.workunit.client.1.smithi154.stdout:9/23: stat l4 0 2024-05-06T21:26:39.357 INFO:tasks.workunit.client.0.smithi032.stdout:2/273: dread fe [0,4194304] 0 2024-05-06T21:26:39.358 INFO:tasks.workunit.client.0.smithi032.stdout:2/274: truncate df/d19/d1e/d23/d25/f50 146980 0 2024-05-06T21:26:39.358 INFO:tasks.workunit.client.0.smithi032.stdout:2/275: chown lb 1382161 1 2024-05-06T21:26:39.358 INFO:tasks.workunit.client.1.smithi154.stdout:8/14: rmdir d3/d6 0 2024-05-06T21:26:39.358 INFO:tasks.workunit.client.1.smithi154.stdout:8/15: creat d3/f8 x:0 0 0 2024-05-06T21:26:39.358 INFO:tasks.workunit.client.1.smithi154.stdout:8/16: creat d3/f9 x:0 0 0 2024-05-06T21:26:39.368 INFO:tasks.workunit.client.1.smithi154.stdout:5/22: link d2/f4 d2/d6/f7 0 2024-05-06T21:26:39.368 INFO:tasks.workunit.client.1.smithi154.stdout:9/24: link l1 d5/l7 0 2024-05-06T21:26:39.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:38 smithi154 ceph-mon[32880]: pgmap v20: 65 pgs: 65 active+clean; 854 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 79 MiB/s rd, 109 MiB/s wr, 728 op/s 2024-05-06T21:26:39.373 INFO:tasks.workunit.client.1.smithi154.stdout:7/13: fsync f2 0 2024-05-06T21:26:39.373 INFO:tasks.workunit.client.1.smithi154.stdout:7/14: truncate f2 717992 0 2024-05-06T21:26:39.373 INFO:tasks.workunit.client.1.smithi154.stdout:8/17: symlink d3/la 0 2024-05-06T21:26:39.374 INFO:tasks.workunit.client.1.smithi154.stdout:8/18: dread - d3/f8 zero size 2024-05-06T21:26:39.374 INFO:tasks.workunit.client.1.smithi154.stdout:8/19: creat d3/fb x:0 0 0 2024-05-06T21:26:39.377 INFO:tasks.workunit.client.1.smithi154.stdout:7/15: rename f2 to f4 0 2024-05-06T21:26:39.668 INFO:tasks.workunit.client.1.smithi154.stdout:3/17: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:39.669 INFO:tasks.workunit.client.1.smithi154.stdout:4/29: dwrite d0/d2/f6 [0,4194304] 0 2024-05-06T21:26:39.686 INFO:tasks.workunit.client.1.smithi154.stdout:5/23: write d2/f4 [3766961,103752] 0 2024-05-06T21:26:39.694 INFO:tasks.workunit.client.1.smithi154.stdout:2/20: dwrite f5 [0,4194304] 0 2024-05-06T21:26:39.730 INFO:tasks.workunit.client.1.smithi154.stdout:0/15: dwrite f2 [4194304,4194304] 0 2024-05-06T21:26:39.730 INFO:tasks.workunit.client.1.smithi154.stdout:0/16: creat f3 x:0 0 0 2024-05-06T21:26:39.735 INFO:tasks.workunit.client.0.smithi032.stdout:4/423: sync 2024-05-06T21:26:39.735 INFO:tasks.workunit.client.0.smithi032.stdout:4/424: creat d2/d13/f8d x:0 0 0 2024-05-06T21:26:39.735 INFO:tasks.workunit.client.0.smithi032.stdout:7/413: sync 2024-05-06T21:26:39.735 INFO:tasks.workunit.client.0.smithi032.stdout:7/414: dread - db/d12/d16/d21/d41/f70 zero size 2024-05-06T21:26:39.735 INFO:tasks.workunit.client.0.smithi032.stdout:1/337: sync 2024-05-06T21:26:39.735 INFO:tasks.workunit.client.0.smithi032.stdout:6/362: sync 2024-05-06T21:26:39.736 INFO:tasks.workunit.client.0.smithi032.stdout:9/358: sync 2024-05-06T21:26:39.740 INFO:tasks.workunit.client.0.smithi032.stdout:8/350: sync 2024-05-06T21:26:39.740 INFO:tasks.workunit.client.0.smithi032.stdout:5/179: sync 2024-05-06T21:26:39.740 INFO:tasks.workunit.client.0.smithi032.stdout:0/303: sync 2024-05-06T21:26:39.740 INFO:tasks.workunit.client.0.smithi032.stdout:7/415: stat db/ld 0 2024-05-06T21:26:39.740 INFO:tasks.workunit.client.0.smithi032.stdout:7/416: dread - db/d12/f6d zero size 2024-05-06T21:26:39.742 INFO:tasks.workunit.client.0.smithi032.stdout:6/363: truncate f4 8720926 0 2024-05-06T21:26:39.742 INFO:tasks.workunit.client.0.smithi032.stdout:8/351: creat d0/d1b/d47/f64 x:0 0 0 2024-05-06T21:26:39.743 INFO:tasks.workunit.client.0.smithi032.stdout:8/352: chown d0/d1b/d47/f54 818744796 1 2024-05-06T21:26:39.745 INFO:tasks.workunit.client.0.smithi032.stdout:1/338: getdents db/d37 0 2024-05-06T21:26:39.748 INFO:tasks.workunit.client.0.smithi032.stdout:0/304: mknod d4/da/d14/d1a/c5d 0 2024-05-06T21:26:39.748 INFO:tasks.workunit.client.0.smithi032.stdout:0/305: creat d4/da/d16/d33/f5e x:0 0 0 2024-05-06T21:26:39.748 INFO:tasks.workunit.client.0.smithi032.stdout:1/339: symlink db/d37/l67 0 2024-05-06T21:26:39.751 INFO:tasks.workunit.client.0.smithi032.stdout:0/306: readlink d4/l10 0 2024-05-06T21:26:39.752 INFO:tasks.workunit.client.0.smithi032.stdout:1/340: chown db/d37/l3a 436005244 1 2024-05-06T21:26:39.752 INFO:tasks.workunit.client.0.smithi032.stdout:6/364: dread d8/dd/d18/d13/f28 [0,4194304] 0 2024-05-06T21:26:39.757 INFO:tasks.workunit.client.0.smithi032.stdout:0/307: fdatasync d4/d3e/f49 0 2024-05-06T21:26:39.757 INFO:tasks.workunit.client.0.smithi032.stdout:0/308: creat d4/d3e/d42/f5f x:0 0 0 2024-05-06T21:26:39.757 INFO:tasks.workunit.client.0.smithi032.stdout:0/309: stat d4/d3e/d42 0 2024-05-06T21:26:39.759 INFO:tasks.workunit.client.1.smithi154.stdout:9/25: fdatasync d5/f6 0 2024-05-06T21:26:39.766 INFO:tasks.workunit.client.1.smithi154.stdout:1/36: dwrite d6/fd [0,4194304] 0 2024-05-06T21:26:39.766 INFO:tasks.workunit.client.1.smithi154.stdout:1/37: rename d6 to d6/db/de 22 2024-05-06T21:26:39.766 INFO:tasks.workunit.client.1.smithi154.stdout:1/38: truncate d6/f8 26496 0 2024-05-06T21:26:39.766 INFO:tasks.workunit.client.1.smithi154.stdout:1/39: read - d6/fc zero size 2024-05-06T21:26:39.766 INFO:tasks.workunit.client.1.smithi154.stdout:1/40: truncate d6/fd 4408795 0 2024-05-06T21:26:39.775 INFO:tasks.workunit.client.0.smithi032.stdout:0/310: read d4/da/d14/d1a/f1e [3860490,90932] 0 2024-05-06T21:26:39.778 INFO:tasks.workunit.client.0.smithi032.stdout:0/311: rename d4/da/d14/f3a to d4/da/f60 0 2024-05-06T21:26:39.779 INFO:tasks.workunit.client.1.smithi154.stdout:0/17: dread f2 [0,4194304] 0 2024-05-06T21:26:39.779 INFO:tasks.workunit.client.1.smithi154.stdout:0/18: creat f4 x:0 0 0 2024-05-06T21:26:39.782 INFO:tasks.workunit.client.0.smithi032.stdout:7/417: dread f3 [4194304,4194304] 0 2024-05-06T21:26:39.783 INFO:tasks.workunit.client.0.smithi032.stdout:8/353: read d0/f1a [5134131,50317] 0 2024-05-06T21:26:39.784 INFO:tasks.workunit.client.0.smithi032.stdout:7/418: creat db/d12/f79 x:0 0 0 2024-05-06T21:26:39.786 INFO:tasks.workunit.client.0.smithi032.stdout:8/354: unlink d0/d1b/l3c 0 2024-05-06T21:26:39.787 INFO:tasks.workunit.client.0.smithi032.stdout:7/419: symlink db/d12/d16/d21/d41/l7a 0 2024-05-06T21:26:39.788 INFO:tasks.workunit.client.1.smithi154.stdout:9/26: creat d5/f8 x:0 0 0 2024-05-06T21:26:39.789 INFO:tasks.workunit.client.0.smithi032.stdout:9/359: dwrite d1/fe [0,4194304] 0 2024-05-06T21:26:39.791 INFO:tasks.workunit.client.0.smithi032.stdout:8/355: rename d0/d1b/d39/d3b/d57/f5c to d0/d1c/d5e/f65 0 2024-05-06T21:26:39.791 INFO:tasks.workunit.client.0.smithi032.stdout:7/420: mknod db/d12/d49/c7b 0 2024-05-06T21:26:39.791 INFO:tasks.workunit.client.0.smithi032.stdout:7/421: write db/f77 [286008,111218] 0 2024-05-06T21:26:39.793 INFO:tasks.workunit.client.1.smithi154.stdout:4/30: dwrite d0/f1 [4194304,4194304] 0 2024-05-06T21:26:39.793 INFO:tasks.workunit.client.1.smithi154.stdout:4/31: truncate d0/d2/f6 4341167 0 2024-05-06T21:26:39.793 INFO:tasks.workunit.client.1.smithi154.stdout:1/41: creat d6/db/ff x:0 0 0 2024-05-06T21:26:39.795 INFO:tasks.workunit.client.0.smithi032.stdout:5/180: dwrite d0/d11/f25 [0,4194304] 0 2024-05-06T21:26:39.796 INFO:tasks.workunit.client.0.smithi032.stdout:5/181: chown d0/d11 23209 1 2024-05-06T21:26:39.796 INFO:tasks.workunit.client.0.smithi032.stdout:5/182: chown d0/f18 45784 1 2024-05-06T21:26:39.798 INFO:tasks.workunit.client.1.smithi154.stdout:0/19: rename c1 to c5 0 2024-05-06T21:26:39.801 INFO:tasks.workunit.client.1.smithi154.stdout:9/27: symlink d5/l9 0 2024-05-06T21:26:39.801 INFO:tasks.workunit.client.1.smithi154.stdout:9/28: creat d5/fa x:0 0 0 2024-05-06T21:26:39.801 INFO:tasks.workunit.client.1.smithi154.stdout:9/29: write d5/f6 [1395785,12192] 0 2024-05-06T21:26:39.801 INFO:tasks.workunit.client.1.smithi154.stdout:9/30: write d5/fa [568298,38678] 0 2024-05-06T21:26:39.805 INFO:tasks.workunit.client.1.smithi154.stdout:4/32: symlink d0/l7 0 2024-05-06T21:26:39.807 INFO:tasks.workunit.client.0.smithi032.stdout:1/341: dwrite db/f30 [4194304,4194304] 0 2024-05-06T21:26:39.807 INFO:tasks.workunit.client.0.smithi032.stdout:1/342: read db/d2a/f2d [2285568,71265] 0 2024-05-06T21:26:39.807 INFO:tasks.workunit.client.1.smithi154.stdout:0/20: mkdir d6 0 2024-05-06T21:26:39.808 INFO:tasks.workunit.client.1.smithi154.stdout:0/21: write f3 [111890,53388] 0 2024-05-06T21:26:39.809 INFO:tasks.workunit.client.1.smithi154.stdout:9/31: symlink d5/lb 0 2024-05-06T21:26:39.810 INFO:tasks.workunit.client.1.smithi154.stdout:0/22: creat d6/f7 x:0 0 0 2024-05-06T21:26:39.811 INFO:tasks.workunit.client.0.smithi032.stdout:4/425: dwrite d2/d2c/f49 [0,4194304] 0 2024-05-06T21:26:39.811 INFO:tasks.workunit.client.0.smithi032.stdout:8/356: dread d0/d1b/f23 [0,4194304] 0 2024-05-06T21:26:39.811 INFO:tasks.workunit.client.0.smithi032.stdout:8/357: fsync d0/f27 0 2024-05-06T21:26:39.811 INFO:tasks.workunit.client.0.smithi032.stdout:8/358: fsync d0/d1b/f34 0 2024-05-06T21:26:39.814 INFO:tasks.workunit.client.0.smithi032.stdout:4/426: creat d2/d16/d44/d54/d69/f8e x:0 0 0 2024-05-06T21:26:39.820 INFO:tasks.workunit.client.0.smithi032.stdout:2/276: dwrite df/d19/f5b [0,4194304] 0 2024-05-06T21:26:39.825 INFO:tasks.workunit.client.0.smithi032.stdout:2/277: mkdir df/d19/d52/d5f 0 2024-05-06T21:26:39.828 INFO:tasks.workunit.client.0.smithi032.stdout:2/278: link df/d19/d1e/d1f/d2e/d33/f1d df/d19/d1e/d23/d25/f60 0 2024-05-06T21:26:39.830 INFO:tasks.workunit.client.0.smithi032.stdout:2/279: link ca df/d19/d52/d5f/c61 0 2024-05-06T21:26:39.833 INFO:tasks.workunit.client.0.smithi032.stdout:2/280: mknod df/d19/d1e/d23/d25/d2d/c62 0 2024-05-06T21:26:39.833 INFO:tasks.workunit.client.0.smithi032.stdout:2/281: write df/d19/d1e/d35/f56 [33055,34437] 0 2024-05-06T21:26:39.833 INFO:tasks.workunit.client.0.smithi032.stdout:2/282: creat df/d19/d1e/d42/f63 x:0 0 0 2024-05-06T21:26:39.833 INFO:tasks.workunit.client.0.smithi032.stdout:5/183: write d0/f12 [3096021,93131] 0 2024-05-06T21:26:39.834 INFO:tasks.workunit.client.1.smithi154.stdout:4/33: dread d0/d2/f6 [0,4194304] 0 2024-05-06T21:26:39.834 INFO:tasks.workunit.client.1.smithi154.stdout:4/34: creat d0/d2/f8 x:0 0 0 2024-05-06T21:26:39.834 INFO:tasks.workunit.client.1.smithi154.stdout:4/35: creat d0/d2/f9 x:0 0 0 2024-05-06T21:26:39.835 INFO:tasks.workunit.client.1.smithi154.stdout:4/36: creat d0/d2/fa x:0 0 0 2024-05-06T21:26:39.835 INFO:tasks.workunit.client.0.smithi032.stdout:5/184: dread d0/fa [4194304,4194304] 0 2024-05-06T21:26:39.837 INFO:tasks.workunit.client.0.smithi032.stdout:8/359: dread d0/d1b/f3e [4194304,4194304] 0 2024-05-06T21:26:39.838 INFO:tasks.workunit.client.0.smithi032.stdout:5/185: unlink d0/f18 0 2024-05-06T21:26:39.839 INFO:tasks.workunit.client.0.smithi032.stdout:8/360: link d0/f1a d0/d1b/d47/f66 0 2024-05-06T21:26:39.839 INFO:tasks.workunit.client.0.smithi032.stdout:2/283: dread df/d19/d1e/d35/f3d [0,4194304] 0 2024-05-06T21:26:39.841 INFO:tasks.workunit.client.0.smithi032.stdout:8/361: mkdir d0/d1c/d5e/d67 0 2024-05-06T21:26:39.841 INFO:tasks.workunit.client.0.smithi032.stdout:8/362: write d0/fa [4701928,17522] 0 2024-05-06T21:26:39.841 INFO:tasks.workunit.client.0.smithi032.stdout:8/363: stat d0/d1c/f22 0 2024-05-06T21:26:39.841 INFO:tasks.workunit.client.0.smithi032.stdout:8/364: dread - d0/d1b/d39/f45 zero size 2024-05-06T21:26:39.841 INFO:tasks.workunit.client.0.smithi032.stdout:2/284: symlink df/l64 0 2024-05-06T21:26:39.852 INFO:tasks.workunit.client.1.smithi154.stdout:1/42: dwrite d6/fc [0,4194304] 0 2024-05-06T21:26:39.852 INFO:tasks.workunit.client.0.smithi032.stdout:0/312: dwrite d4/fc [0,4194304] 0 2024-05-06T21:26:39.853 INFO:tasks.workunit.client.0.smithi032.stdout:9/360: dwrite d1/f9 [0,4194304] 0 2024-05-06T21:26:39.853 INFO:tasks.workunit.client.0.smithi032.stdout:4/427: dwrite d2/f35 [0,4194304] 0 2024-05-06T21:26:39.853 INFO:tasks.workunit.client.0.smithi032.stdout:1/343: dwrite db/d16/f33 [4194304,4194304] 0 2024-05-06T21:26:39.853 INFO:tasks.workunit.client.0.smithi032.stdout:4/428: write d2/d16/d44/d45/d4e/f6b [158746,86931] 0 2024-05-06T21:26:39.853 INFO:tasks.workunit.client.0.smithi032.stdout:4/429: dread - d2/d2c/f89 zero size 2024-05-06T21:26:39.853 INFO:tasks.workunit.client.0.smithi032.stdout:4/430: chown d2/f6c 38 1 2024-05-06T21:26:39.853 INFO:tasks.workunit.client.0.smithi032.stdout:4/431: chown d2/d16/d44/d45/l50 3396882 1 2024-05-06T21:26:39.855 INFO:tasks.workunit.client.1.smithi154.stdout:1/43: unlink l4 0 2024-05-06T21:26:39.855 INFO:tasks.workunit.client.0.smithi032.stdout:0/313: mknod d4/d3e/d42/c61 0 2024-05-06T21:26:39.856 INFO:tasks.workunit.client.1.smithi154.stdout:1/44: rename d6/da to d6/db/d10 0 2024-05-06T21:26:39.856 INFO:tasks.workunit.client.1.smithi154.stdout:1/45: chown d6/fd 772978 1 2024-05-06T21:26:39.856 INFO:tasks.workunit.client.1.smithi154.stdout:1/46: chown c2 761751828 1 2024-05-06T21:26:39.856 INFO:tasks.workunit.client.1.smithi154.stdout:1/47: chown d6 11 1 2024-05-06T21:26:39.856 INFO:tasks.workunit.client.1.smithi154.stdout:1/48: stat d6/c7 0 2024-05-06T21:26:39.857 INFO:tasks.workunit.client.1.smithi154.stdout:1/49: chown c2 139505 1 2024-05-06T21:26:39.857 INFO:tasks.workunit.client.0.smithi032.stdout:4/432: mknod d2/d16/d44/d74/c8f 0 2024-05-06T21:26:39.861 INFO:tasks.workunit.client.0.smithi032.stdout:4/433: creat d2/d16/d44/d45/d4e/f90 x:0 0 0 2024-05-06T21:26:39.863 INFO:tasks.workunit.client.0.smithi032.stdout:0/314: truncate d4/f9 3840734 0 2024-05-06T21:26:39.863 INFO:tasks.workunit.client.0.smithi032.stdout:0/315: read d4/da/f60 [33477,118451] 0 2024-05-06T21:26:39.864 INFO:tasks.workunit.client.0.smithi032.stdout:4/434: creat d2/d2c/d31/f91 x:0 0 0 2024-05-06T21:26:39.878 INFO:tasks.workunit.client.0.smithi032.stdout:0/316: dread d4/da/d14/d1a/f1e [4194304,4194304] 0 2024-05-06T21:26:39.880 INFO:tasks.workunit.client.0.smithi032.stdout:5/186: write d0/d11/f25 [4131788,89850] 0 2024-05-06T21:26:39.880 INFO:tasks.workunit.client.0.smithi032.stdout:5/187: chown d0/fe 1978340 1 2024-05-06T21:26:40.005 INFO:tasks.workunit.client.0.smithi032.stdout:2/285: dwrite df/d19/d1e/d54/f58 [0,4194304] 0 2024-05-06T21:26:40.007 INFO:tasks.workunit.client.0.smithi032.stdout:3/335: sync 2024-05-06T21:26:40.010 INFO:tasks.workunit.client.0.smithi032.stdout:9/361: write d1/fe [3169489,74194] 0 2024-05-06T21:26:40.014 INFO:tasks.workunit.client.0.smithi032.stdout:3/336: dread d1/d4/da/f32 [0,4194304] 0 2024-05-06T21:26:40.015 INFO:tasks.workunit.client.0.smithi032.stdout:8/365: dwrite d0/d1b/f55 [0,4194304] 0 2024-05-06T21:26:40.015 INFO:tasks.workunit.client.0.smithi032.stdout:8/366: fsync d0/f16 0 2024-05-06T21:26:40.015 INFO:tasks.workunit.client.0.smithi032.stdout:8/367: fsync d0/f5 0 2024-05-06T21:26:40.018 INFO:tasks.workunit.client.0.smithi032.stdout:8/368: mknod d0/d1c/d5e/d67/c68 0 2024-05-06T21:26:40.018 INFO:tasks.workunit.client.0.smithi032.stdout:8/369: fsync d0/d1b/f23 0 2024-05-06T21:26:40.018 INFO:tasks.workunit.client.0.smithi032.stdout:8/370: chown d0/d1b 7968442 1 2024-05-06T21:26:40.019 INFO:tasks.workunit.client.0.smithi032.stdout:3/337: getdents d1/d4/d11 0 2024-05-06T21:26:40.019 INFO:tasks.workunit.client.0.smithi032.stdout:3/338: fsync d1/d4/d11/f5a 0 2024-05-06T21:26:40.019 INFO:tasks.workunit.client.0.smithi032.stdout:3/339: fsync d1/d4/da/f32 0 2024-05-06T21:26:40.019 INFO:tasks.workunit.client.0.smithi032.stdout:3/340: chown d1/d4/da/d31/d47/d4a/l5c 64673832 1 2024-05-06T21:26:40.020 INFO:tasks.workunit.client.1.smithi154.stdout:1/50: dwrite d6/f8 [0,4194304] 0 2024-05-06T21:26:40.020 INFO:tasks.workunit.client.1.smithi154.stdout:1/51: truncate d6/db/ff 577066 0 2024-05-06T21:26:40.020 INFO:tasks.workunit.client.0.smithi032.stdout:1/344: dwrite db/f12 [0,4194304] 0 2024-05-06T21:26:40.020 INFO:tasks.workunit.client.0.smithi032.stdout:1/345: write db/f51 [913529,71838] 0 2024-05-06T21:26:40.021 INFO:tasks.workunit.client.0.smithi032.stdout:3/341: symlink d1/d4/da/d4e/d41/d43/d73/d75/l77 0 2024-05-06T21:26:40.021 INFO:tasks.workunit.client.1.smithi154.stdout:1/52: dread d6/db/ff [0,4194304] 0 2024-05-06T21:26:40.022 INFO:tasks.workunit.client.0.smithi032.stdout:9/362: dread d1/d13/f62 [0,4194304] 0 2024-05-06T21:26:40.022 INFO:tasks.workunit.client.0.smithi032.stdout:9/363: truncate d1/d13/d34/d26/d39/d45/f52 644110 0 2024-05-06T21:26:40.022 INFO:tasks.workunit.client.0.smithi032.stdout:8/371: rmdir d0/d1b/d39 39 2024-05-06T21:26:40.025 INFO:tasks.workunit.client.0.smithi032.stdout:1/346: mkdir db/d16/d46/d57/d58/d68 0 2024-05-06T21:26:40.027 INFO:tasks.workunit.client.0.smithi032.stdout:4/435: dwrite d2/d16/d44/d45/d4e/f90 [0,4194304] 0 2024-05-06T21:26:40.027 INFO:tasks.workunit.client.0.smithi032.stdout:3/342: creat d1/d4/da/d4e/d41/d43/d44/d67/f78 x:0 0 0 2024-05-06T21:26:40.027 INFO:tasks.workunit.client.0.smithi032.stdout:3/343: chown d1/d4/da/d31/d47/d4a 1643 1 2024-05-06T21:26:40.027 INFO:tasks.workunit.client.0.smithi032.stdout:9/364: symlink d1/d13/l6e 0 2024-05-06T21:26:40.030 INFO:tasks.workunit.client.0.smithi032.stdout:5/188: dwrite d0/f10 [0,4194304] 0 2024-05-06T21:26:40.031 INFO:tasks.workunit.client.1.smithi154.stdout:8/20: rmdir d3 39 2024-05-06T21:26:40.031 INFO:tasks.workunit.client.0.smithi032.stdout:4/436: creat d2/d16/d44/d74/f92 x:0 0 0 2024-05-06T21:26:40.034 INFO:tasks.workunit.client.0.smithi032.stdout:3/344: mknod d1/d4/da/d31/c79 0 2024-05-06T21:26:40.034 INFO:tasks.workunit.client.0.smithi032.stdout:3/345: creat d1/d4/f7a x:0 0 0 2024-05-06T21:26:40.034 INFO:tasks.workunit.client.0.smithi032.stdout:3/346: creat d1/d4/da/d4e/d41/d43/d44/d67/f7b x:0 0 0 2024-05-06T21:26:40.036 INFO:tasks.workunit.client.0.smithi032.stdout:9/365: symlink d1/d2f/d4f/l6f 0 2024-05-06T21:26:40.036 INFO:tasks.workunit.client.0.smithi032.stdout:8/372: dread d0/f19 [0,4194304] 0 2024-05-06T21:26:40.040 INFO:tasks.workunit.client.0.smithi032.stdout:2/286: dwrite df/d19/d1e/d23/d25/d2d/f45 [0,4194304] 0 2024-05-06T21:26:40.040 INFO:tasks.workunit.client.0.smithi032.stdout:4/437: link d2/d2c/d31/l39 d2/d13/l93 0 2024-05-06T21:26:40.040 INFO:tasks.workunit.client.0.smithi032.stdout:2/287: write df/f2c [32981,117363] 0 2024-05-06T21:26:40.041 INFO:tasks.workunit.client.0.smithi032.stdout:0/317: dwrite d4/f3f [0,4194304] 0 2024-05-06T21:26:40.044 INFO:tasks.workunit.client.0.smithi032.stdout:3/347: unlink d1/d4/c23 0 2024-05-06T21:26:40.046 INFO:tasks.workunit.client.0.smithi032.stdout:4/438: creat d2/d16/f94 x:0 0 0 2024-05-06T21:26:40.046 INFO:tasks.workunit.client.0.smithi032.stdout:8/373: creat d0/f69 x:0 0 0 2024-05-06T21:26:40.048 INFO:tasks.workunit.client.0.smithi032.stdout:2/288: mkdir df/d19/d1e/d23/d65 0 2024-05-06T21:26:40.048 INFO:tasks.workunit.client.0.smithi032.stdout:8/374: getdents d0/d1b/d39/d3b/d57/d5d 0 2024-05-06T21:26:40.048 INFO:tasks.workunit.client.0.smithi032.stdout:8/375: fsync d0/d1b/d47/f64 0 2024-05-06T21:26:40.049 INFO:tasks.workunit.client.0.smithi032.stdout:9/366: read d1/f9 [1495877,129371] 0 2024-05-06T21:26:40.051 INFO:tasks.workunit.client.0.smithi032.stdout:2/289: rename lb to df/d19/d1e/d1f/d2e/d33/l66 0 2024-05-06T21:26:40.052 INFO:tasks.workunit.client.0.smithi032.stdout:8/376: rmdir d0/d1b/d39/d3b 39 2024-05-06T21:26:40.056 INFO:tasks.workunit.client.0.smithi032.stdout:1/347: dwrite db/f1f [0,4194304] 0 2024-05-06T21:26:40.056 INFO:tasks.workunit.client.0.smithi032.stdout:1/348: write db/f2e [5372781,108987] 0 2024-05-06T21:26:40.057 INFO:tasks.workunit.client.0.smithi032.stdout:9/367: chown d1/c1d 505 1 2024-05-06T21:26:40.057 INFO:tasks.workunit.client.0.smithi032.stdout:2/290: creat df/d19/d1e/d23/d65/f67 x:0 0 0 2024-05-06T21:26:40.057 INFO:tasks.workunit.client.0.smithi032.stdout:2/291: fdatasync df/d19/d1e/f51 0 2024-05-06T21:26:40.058 INFO:tasks.workunit.client.1.smithi154.stdout:8/21: dwrite d3/f8 [0,4194304] 0 2024-05-06T21:26:40.059 INFO:tasks.workunit.client.0.smithi032.stdout:8/377: mknod d0/d1b/c6a 0 2024-05-06T21:26:40.059 INFO:tasks.workunit.client.0.smithi032.stdout:8/378: chown d0/f19 8474922 1 2024-05-06T21:26:40.060 INFO:tasks.workunit.client.1.smithi154.stdout:8/22: write d3/f5 [393515,51139] 0 2024-05-06T21:26:40.061 INFO:tasks.workunit.client.0.smithi032.stdout:9/368: truncate d1/f18 2069775 0 2024-05-06T21:26:40.063 INFO:tasks.workunit.client.0.smithi032.stdout:2/292: creat df/d19/d1e/d35/d3f/f68 x:0 0 0 2024-05-06T21:26:40.064 INFO:tasks.workunit.client.1.smithi154.stdout:8/23: creat d3/fc x:0 0 0 2024-05-06T21:26:40.066 INFO:tasks.workunit.client.0.smithi032.stdout:8/379: creat d0/d1b/d39/f6b x:0 0 0 2024-05-06T21:26:40.072 INFO:tasks.workunit.client.0.smithi032.stdout:2/293: rename df/d19/d1e/d1f/d2e/l49 to df/d19/d1e/d42/l69 0 2024-05-06T21:26:40.072 INFO:tasks.workunit.client.0.smithi032.stdout:2/294: fsync df/d19/d1e/d1f/d2e/d33/f1d 0 2024-05-06T21:26:40.072 INFO:tasks.workunit.client.0.smithi032.stdout:2/295: truncate df/d19/d1e/d35/d3f/d46/f5a 760967 0 2024-05-06T21:26:40.072 INFO:tasks.workunit.client.0.smithi032.stdout:2/296: creat df/d19/d1e/d54/f6a x:0 0 0 2024-05-06T21:26:40.073 INFO:tasks.workunit.client.0.smithi032.stdout:9/369: rmdir d1/d13/d25/d64 39 2024-05-06T21:26:40.080 INFO:tasks.workunit.client.0.smithi032.stdout:2/297: link ca df/d19/d1e/d35/d3f/d46/c6b 0 2024-05-06T21:26:40.081 INFO:tasks.workunit.client.0.smithi032.stdout:9/370: creat d1/d13/d25/f70 x:0 0 0 2024-05-06T21:26:40.084 INFO:tasks.workunit.client.0.smithi032.stdout:2/298: rename df/d19/d1e/d23/d25/d2d/c4c to df/d19/d1e/d1f/d2e/d33/c6c 0 2024-05-06T21:26:40.084 INFO:tasks.workunit.client.0.smithi032.stdout:2/299: fsync df/d19/d1e/d23/d25/f37 0 2024-05-06T21:26:40.086 INFO:tasks.workunit.client.0.smithi032.stdout:9/371: rename d1/f2 to d1/d13/d34/d26/f71 0 2024-05-06T21:26:40.088 INFO:tasks.workunit.client.0.smithi032.stdout:1/349: dwrite db/f12 [0,4194304] 0 2024-05-06T21:26:40.088 INFO:tasks.workunit.client.0.smithi032.stdout:0/318: dwrite d4/da/d14/d1a/f1c [0,4194304] 0 2024-05-06T21:26:40.088 INFO:tasks.workunit.client.0.smithi032.stdout:0/319: write d4/da/f31 [5106915,33841] 0 2024-05-06T21:26:40.088 INFO:tasks.workunit.client.0.smithi032.stdout:3/348: dwrite d1/d4/da/d4e/d41/f66 [0,4194304] 0 2024-05-06T21:26:40.088 INFO:tasks.workunit.client.0.smithi032.stdout:5/189: dwrite d0/d11/f25 [0,4194304] 0 2024-05-06T21:26:40.089 INFO:tasks.workunit.client.0.smithi032.stdout:9/372: mkdir d1/d13/d25/d64/d72 0 2024-05-06T21:26:40.090 INFO:tasks.workunit.client.0.smithi032.stdout:8/380: dwrite d0/d1b/d39/f48 [0,4194304] 0 2024-05-06T21:26:40.090 INFO:tasks.workunit.client.1.smithi154.stdout:8/24: dwrite f2 [0,4194304] 0 2024-05-06T21:26:40.097 INFO:tasks.workunit.client.0.smithi032.stdout:1/350: creat db/d37/f69 x:0 0 0 2024-05-06T21:26:40.097 INFO:tasks.workunit.client.1.smithi154.stdout:8/25: link d3/fb d3/fd 0 2024-05-06T21:26:40.099 INFO:tasks.workunit.client.0.smithi032.stdout:3/349: mkdir d1/d4/da/d31/d47/d4a/d68/d7c 0 2024-05-06T21:26:40.103 INFO:tasks.workunit.client.0.smithi032.stdout:9/373: mknod d1/d13/d34/c73 0 2024-05-06T21:26:40.108 INFO:tasks.workunit.client.0.smithi032.stdout:2/300: dwrite df/d19/d1e/d1f/d2e/f3c [0,4194304] 0 2024-05-06T21:26:40.108 INFO:tasks.workunit.client.0.smithi032.stdout:2/301: creat df/d19/d1e/d35/f6d x:0 0 0 2024-05-06T21:26:40.109 INFO:tasks.workunit.client.0.smithi032.stdout:1/351: creat db/d16/d46/d55/f6a x:0 0 0 2024-05-06T21:26:40.109 INFO:tasks.workunit.client.0.smithi032.stdout:1/352: write db/d2a/f39 [530496,79908] 0 2024-05-06T21:26:40.112 INFO:tasks.workunit.client.0.smithi032.stdout:8/381: rmdir d0 39 2024-05-06T21:26:40.112 INFO:tasks.workunit.client.0.smithi032.stdout:8/382: dread - d0/d1b/d47/f64 zero size 2024-05-06T21:26:40.114 INFO:tasks.workunit.client.0.smithi032.stdout:9/374: dread d1/f7 [0,4194304] 0 2024-05-06T21:26:40.114 INFO:tasks.workunit.client.0.smithi032.stdout:2/302: link ca df/d19/d1e/d1f/d2e/d33/c6e 0 2024-05-06T21:26:40.114 INFO:tasks.workunit.client.0.smithi032.stdout:2/303: readlink df/d19/d1e/d23/d25/l2f 0 2024-05-06T21:26:40.116 INFO:tasks.workunit.client.0.smithi032.stdout:1/353: getdents db/d16/d46/d57/d58 0 2024-05-06T21:26:40.116 INFO:tasks.workunit.client.0.smithi032.stdout:3/350: getdents d1/d4/da/d4e/d41/d43/d44/d67 0 2024-05-06T21:26:40.117 INFO:tasks.workunit.client.0.smithi032.stdout:3/351: fsync d1/d2a/f76 0 2024-05-06T21:26:40.118 INFO:tasks.workunit.client.0.smithi032.stdout:0/320: dwrite d4/da/d14/f2d [0,4194304] 0 2024-05-06T21:26:40.118 INFO:tasks.workunit.client.0.smithi032.stdout:8/383: symlink d0/d1c/d5e/l6c 0 2024-05-06T21:26:40.118 INFO:tasks.workunit.client.0.smithi032.stdout:8/384: fsync d0/d1b/f55 0 2024-05-06T21:26:40.119 INFO:tasks.workunit.client.1.smithi154.stdout:8/26: dwrite d3/f9 [0,4194304] 0 2024-05-06T21:26:40.119 INFO:tasks.workunit.client.1.smithi154.stdout:8/27: creat d3/fe x:0 0 0 2024-05-06T21:26:40.119 INFO:tasks.workunit.client.1.smithi154.stdout:8/28: creat d3/ff x:0 0 0 2024-05-06T21:26:40.120 INFO:tasks.workunit.client.0.smithi032.stdout:3/352: rename d1/d4/da/l2d to d1/d4/da/d4e/d41/d43/d73/l7d 0 2024-05-06T21:26:40.121 INFO:tasks.workunit.client.0.smithi032.stdout:3/353: creat d1/d4/da/d4e/d41/d45/f7e x:0 0 0 2024-05-06T21:26:40.124 INFO:tasks.workunit.client.0.smithi032.stdout:1/354: dread db/f30 [0,4194304] 0 2024-05-06T21:26:40.124 INFO:tasks.workunit.client.0.smithi032.stdout:5/190: dwrite d0/f27 [0,4194304] 0 2024-05-06T21:26:40.124 INFO:tasks.workunit.client.0.smithi032.stdout:5/191: chown d0/fb 628856 1 2024-05-06T21:26:40.124 INFO:tasks.workunit.client.0.smithi032.stdout:5/192: write d0/d16/f1e [900576,62494] 0 2024-05-06T21:26:40.125 INFO:tasks.workunit.client.0.smithi032.stdout:8/385: mknod d0/d1b/d39/d3b/d57/d5d/c6d 0 2024-05-06T21:26:40.125 INFO:tasks.workunit.client.0.smithi032.stdout:8/386: truncate d0/d1b/d39/f5a 93437 0 2024-05-06T21:26:40.126 INFO:tasks.workunit.client.1.smithi154.stdout:8/29: link d3/ff d3/f10 0 2024-05-06T21:26:40.126 INFO:tasks.workunit.client.1.smithi154.stdout:8/30: rename d3 to d3/d11 22 2024-05-06T21:26:40.127 INFO:tasks.workunit.client.0.smithi032.stdout:2/304: dwrite df/d19/d1e/d23/d25/f60 [4194304,4194304] 0 2024-05-06T21:26:40.128 INFO:tasks.workunit.client.0.smithi032.stdout:3/354: mknod d1/d4/da/d31/d47/d4a/c7f 0 2024-05-06T21:26:40.130 INFO:tasks.workunit.client.0.smithi032.stdout:0/321: truncate d4/f6 3828129 0 2024-05-06T21:26:40.135 INFO:tasks.workunit.client.1.smithi154.stdout:8/31: write d3/f8 [4068202,72077] 0 2024-05-06T21:26:40.135 INFO:tasks.workunit.client.1.smithi154.stdout:3/18: truncate d0/f3 2421483 0 2024-05-06T21:26:40.136 INFO:tasks.workunit.client.1.smithi154.stdout:3/19: getdents d0/d4 0 2024-05-06T21:26:40.137 INFO:tasks.workunit.client.1.smithi154.stdout:3/20: chown d0/d4/c6 248274668 1 2024-05-06T21:26:40.139 INFO:tasks.workunit.client.0.smithi032.stdout:2/305: mkdir df/d19/d1e/d23/d6f 0 2024-05-06T21:26:40.140 INFO:tasks.workunit.client.1.smithi154.stdout:5/24: truncate d2/d6/f7 646721 0 2024-05-06T21:26:40.140 INFO:tasks.workunit.client.1.smithi154.stdout:5/25: rename d2 to d2/d3/d8 22 2024-05-06T21:26:40.140 INFO:tasks.workunit.client.0.smithi032.stdout:8/387: dwrite d0/d1c/f42 [0,4194304] 0 2024-05-06T21:26:40.143 INFO:tasks.workunit.client.0.smithi032.stdout:0/322: truncate d4/da/d16/f3b 379962 0 2024-05-06T21:26:40.143 INFO:tasks.workunit.client.0.smithi032.stdout:1/355: creat db/d37/d52/f6b x:0 0 0 2024-05-06T21:26:40.144 INFO:tasks.workunit.client.0.smithi032.stdout:1/356: dread - db/f43 zero size 2024-05-06T21:26:40.146 INFO:tasks.workunit.client.0.smithi032.stdout:3/355: truncate d1/d4/f30 1233552 0 2024-05-06T21:26:40.148 INFO:tasks.workunit.client.0.smithi032.stdout:8/388: getdents d0/d1b/d39/d3b/d57 0 2024-05-06T21:26:40.148 INFO:tasks.workunit.client.0.smithi032.stdout:5/193: mkdir d0/d28 0 2024-05-06T21:26:40.149 INFO:tasks.workunit.client.0.smithi032.stdout:5/194: chown d0/d11/c22 36550203 1 2024-05-06T21:26:40.150 INFO:tasks.workunit.client.0.smithi032.stdout:3/356: mknod d1/d4/da/d31/d47/d4a/d68/d7c/c80 0 2024-05-06T21:26:40.150 INFO:tasks.workunit.client.0.smithi032.stdout:5/195: truncate d0/f12 4631951 0 2024-05-06T21:26:40.150 INFO:tasks.workunit.client.0.smithi032.stdout:5/196: fsync d0/f23 0 2024-05-06T21:26:40.150 INFO:tasks.workunit.client.0.smithi032.stdout:2/306: dread df/d19/d1e/d23/d25/f60 [4194304,4194304] 0 2024-05-06T21:26:40.151 INFO:tasks.workunit.client.0.smithi032.stdout:3/357: mknod d1/d4/da/d4e/d41/d43/d73/d74/c81 0 2024-05-06T21:26:40.153 INFO:tasks.workunit.client.0.smithi032.stdout:2/307: link df/d19/d1e/d1f/d2e/d33/c6e df/d19/d52/c70 0 2024-05-06T21:26:40.156 INFO:tasks.workunit.client.0.smithi032.stdout:3/358: symlink d1/d4/da/d4e/d41/d43/d44/d67/l82 0 2024-05-06T21:26:40.157 INFO:tasks.workunit.client.0.smithi032.stdout:0/323: write d4/da/f17 [6582263,28410] 0 2024-05-06T21:26:40.159 INFO:tasks.workunit.client.0.smithi032.stdout:0/324: write d4/da/d16/d33/f57 [212149,48846] 0 2024-05-06T21:26:40.160 INFO:tasks.workunit.client.0.smithi032.stdout:3/359: rename d1/d4/da/d31/d47/d4a/c4b to d1/d4/da/d4e/c83 0 2024-05-06T21:26:40.161 INFO:tasks.workunit.client.1.smithi154.stdout:0/23: fsync f3 0 2024-05-06T21:26:40.161 INFO:tasks.workunit.client.1.smithi154.stdout:0/24: truncate f4 492550 0 2024-05-06T21:26:40.161 INFO:tasks.workunit.client.1.smithi154.stdout:8/32: dwrite f2 [0,4194304] 0 2024-05-06T21:26:40.161 INFO:tasks.workunit.client.1.smithi154.stdout:8/33: truncate d3/f5 1759121 0 2024-05-06T21:26:40.163 INFO:tasks.workunit.client.0.smithi032.stdout:0/325: symlink d4/da/d16/l62 0 2024-05-06T21:26:40.163 INFO:tasks.workunit.client.0.smithi032.stdout:0/326: fsync d4/da/d16/f53 0 2024-05-06T21:26:40.163 INFO:tasks.workunit.client.0.smithi032.stdout:0/327: truncate d4/d3e/f54 805385 0 2024-05-06T21:26:40.165 INFO:tasks.workunit.client.0.smithi032.stdout:3/360: mkdir d1/d4/da/d4e/d5e/d84 0 2024-05-06T21:26:40.165 INFO:tasks.workunit.client.0.smithi032.stdout:3/361: write d1/d4/da/d1d/f6e [1244310,26298] 0 2024-05-06T21:26:40.175 INFO:tasks.workunit.client.0.smithi032.stdout:3/362: mknod d1/c85 0 2024-05-06T21:26:40.178 INFO:tasks.workunit.client.0.smithi032.stdout:3/363: getdents d1/d4/da/d1d 0 2024-05-06T21:26:40.179 INFO:tasks.workunit.client.1.smithi154.stdout:5/26: write d2/f4 [690912,86109] 0 2024-05-06T21:26:40.184 INFO:tasks.workunit.client.0.smithi032.stdout:3/364: write d1/d4/f30 [1263964,73798] 0 2024-05-06T21:26:40.186 INFO:tasks.workunit.client.0.smithi032.stdout:3/365: symlink d1/d4/da/d4e/l86 0 2024-05-06T21:26:40.187 INFO:tasks.workunit.client.0.smithi032.stdout:3/366: creat d1/d4/da/d31/f87 x:0 0 0 2024-05-06T21:26:40.189 INFO:tasks.workunit.client.0.smithi032.stdout:3/367: link d1/d4/l1b d1/d4/da/d1d/l88 0 2024-05-06T21:26:40.189 INFO:tasks.workunit.client.0.smithi032.stdout:3/368: truncate d1/f5d 89066 0 2024-05-06T21:26:40.191 INFO:tasks.workunit.client.0.smithi032.stdout:3/369: mknod d1/d4/da/d31/d47/d4a/d68/c89 0 2024-05-06T21:26:40.191 INFO:tasks.workunit.client.0.smithi032.stdout:3/370: truncate d1/d4/da/d1d/f42 1011913 0 2024-05-06T21:26:40.191 INFO:tasks.workunit.client.0.smithi032.stdout:3/371: readlink d1/d4/da/d4e/d41/d43/d73/d75/l77 0 2024-05-06T21:26:40.203 INFO:tasks.workunit.client.0.smithi032.stdout:3/372: write d1/d4/da/d4e/d41/d45/f56 [117592,72344] 0 2024-05-06T21:26:40.204 INFO:tasks.workunit.client.0.smithi032.stdout:5/197: dread d0/fe [0,4194304] 0 2024-05-06T21:26:40.204 INFO:tasks.workunit.client.0.smithi032.stdout:5/198: fdatasync d0/f12 0 2024-05-06T21:26:40.204 INFO:tasks.workunit.client.0.smithi032.stdout:3/373: creat d1/d4/da/d4e/d5e/f8a x:0 0 0 2024-05-06T21:26:40.207 INFO:tasks.workunit.client.0.smithi032.stdout:5/199: symlink d0/d24/d26/l29 0 2024-05-06T21:26:40.208 INFO:tasks.workunit.client.0.smithi032.stdout:5/200: mkdir d0/d16/d2a 0 2024-05-06T21:26:40.209 INFO:tasks.workunit.client.0.smithi032.stdout:5/201: rmdir d0 39 2024-05-06T21:26:40.209 INFO:tasks.workunit.client.0.smithi032.stdout:5/202: chown d0/d16/f1c 216304290 1 2024-05-06T21:26:40.238 INFO:tasks.workunit.client.0.smithi032.stdout:5/203: dread d0/fe [4194304,4194304] 0 2024-05-06T21:26:40.239 INFO:tasks.workunit.client.1.smithi154.stdout:2/21: dwrite f5 [4194304,4194304] 0 2024-05-06T21:26:40.239 INFO:tasks.workunit.client.1.smithi154.stdout:2/22: chown f5 217 1 2024-05-06T21:26:40.239 INFO:tasks.workunit.client.1.smithi154.stdout:2/23: chown l1 16 1 2024-05-06T21:26:40.239 INFO:tasks.workunit.client.1.smithi154.stdout:2/24: fsync f2 0 2024-05-06T21:26:40.239 INFO:tasks.workunit.client.1.smithi154.stdout:2/25: read - f2 zero size 2024-05-06T21:26:40.242 INFO:tasks.workunit.client.1.smithi154.stdout:2/26: rename l1 to l6 0 2024-05-06T21:26:40.245 INFO:tasks.workunit.client.0.smithi032.stdout:8/389: dwrite d0/d1b/d39/f48 [0,4194304] 0 2024-05-06T21:26:40.247 INFO:tasks.workunit.client.1.smithi154.stdout:0/25: dwrite f3 [0,4194304] 0 2024-05-06T21:26:40.251 INFO:tasks.workunit.client.0.smithi032.stdout:2/308: dwrite df/d19/d1e/d23/d25/f3b [0,4194304] 0 2024-05-06T21:26:40.252 INFO:tasks.workunit.client.1.smithi154.stdout:3/21: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:40.252 INFO:tasks.workunit.client.1.smithi154.stdout:3/22: truncate d0/f3 4283551 0 2024-05-06T21:26:40.252 INFO:tasks.workunit.client.1.smithi154.stdout:3/23: stat d0/d4 0 2024-05-06T21:26:40.255 INFO:tasks.workunit.client.0.smithi032.stdout:2/309: rename df/d19/d52 to df/d19/d1e/d71 0 2024-05-06T21:26:40.257 INFO:tasks.workunit.client.0.smithi032.stdout:0/328: dwrite d4/da/f22 [0,4194304] 0 2024-05-06T21:26:40.260 INFO:tasks.workunit.client.0.smithi032.stdout:8/390: dread d0/f16 [0,4194304] 0 2024-05-06T21:26:40.260 INFO:tasks.workunit.client.0.smithi032.stdout:8/391: write d0/d1c/f22 [1195728,15474] 0 2024-05-06T21:26:40.260 INFO:tasks.workunit.client.0.smithi032.stdout:8/392: fsync d0/d1b/d39/f48 0 2024-05-06T21:26:40.262 INFO:tasks.workunit.client.0.smithi032.stdout:8/393: creat d0/d1b/d39/d3b/d57/f6e x:0 0 0 2024-05-06T21:26:40.262 INFO:tasks.workunit.client.0.smithi032.stdout:8/394: fsync d0/f37 0 2024-05-06T21:26:40.263 INFO:tasks.workunit.client.1.smithi154.stdout:3/24: dread d0/f3 [0,4194304] 0 2024-05-06T21:26:40.263 INFO:tasks.workunit.client.1.smithi154.stdout:3/25: chown d0/d4 215385764 1 2024-05-06T21:26:40.263 INFO:tasks.workunit.client.0.smithi032.stdout:2/310: rename df/d19/d1e/d23 to df/d19/d1e/d54/d72 0 2024-05-06T21:26:40.264 INFO:tasks.workunit.client.0.smithi032.stdout:2/311: truncate df/d19/d1e/d54/f6a 33320 0 2024-05-06T21:26:40.264 INFO:tasks.workunit.client.1.smithi154.stdout:3/26: mknod d0/d4/c7 0 2024-05-06T21:26:40.265 INFO:tasks.workunit.client.0.smithi032.stdout:8/395: rename d0/d1b/c6a to d0/d1b/c6f 0 2024-05-06T21:26:40.265 INFO:tasks.workunit.client.0.smithi032.stdout:8/396: stat d0/f8 0 2024-05-06T21:26:40.265 INFO:tasks.workunit.client.0.smithi032.stdout:8/397: read d0/f16 [594899,34901] 0 2024-05-06T21:26:40.265 INFO:tasks.workunit.client.0.smithi032.stdout:2/312: mkdir df/d19/d1e/d71/d5f/d73 0 2024-05-06T21:26:40.266 INFO:tasks.workunit.client.0.smithi032.stdout:8/398: creat d0/d1b/f70 x:0 0 0 2024-05-06T21:26:40.266 INFO:tasks.workunit.client.0.smithi032.stdout:8/399: write d0/d1b/d39/f45 [680633,59569] 0 2024-05-06T21:26:40.267 INFO:tasks.workunit.client.1.smithi154.stdout:3/27: dread d0/f3 [0,4194304] 0 2024-05-06T21:26:40.268 INFO:tasks.workunit.client.1.smithi154.stdout:3/28: mkdir d0/d4/d8 0 2024-05-06T21:26:40.271 INFO:tasks.workunit.client.1.smithi154.stdout:3/29: write d0/f3 [678883,5601] 0 2024-05-06T21:26:40.272 INFO:tasks.workunit.client.0.smithi032.stdout:8/400: write d0/f27 [168080,77645] 0 2024-05-06T21:26:40.273 INFO:tasks.workunit.client.0.smithi032.stdout:8/401: stat d0/d1b/c6f 0 2024-05-06T21:26:40.274 INFO:tasks.workunit.client.1.smithi154.stdout:2/27: dwrite f2 [0,4194304] 0 2024-05-06T21:26:40.274 INFO:tasks.workunit.client.1.smithi154.stdout:8/34: dwrite d3/fb [0,4194304] 0 2024-05-06T21:26:40.274 INFO:tasks.workunit.client.1.smithi154.stdout:2/28: write f5 [8688165,129595] 0 2024-05-06T21:26:40.280 INFO:tasks.workunit.client.0.smithi032.stdout:2/313: write df/d19/d1e/d1f/d2e/f3c [2155534,127127] 0 2024-05-06T21:26:40.283 INFO:tasks.workunit.client.0.smithi032.stdout:1/357: dwrite db/f27 [0,4194304] 0 2024-05-06T21:26:40.283 INFO:tasks.workunit.client.0.smithi032.stdout:1/358: getdents db/d16/d46/d57/d58/d68 0 2024-05-06T21:26:40.283 INFO:tasks.workunit.client.0.smithi032.stdout:1/359: write db/d2a/f5b [599818,48120] 0 2024-05-06T21:26:40.284 INFO:tasks.workunit.client.1.smithi154.stdout:2/29: link l6 l7 0 2024-05-06T21:26:40.287 INFO:tasks.workunit.client.1.smithi154.stdout:1/53: dwrite d6/fc [4194304,4194304] 0 2024-05-06T21:26:40.287 INFO:tasks.workunit.client.0.smithi032.stdout:2/314: rmdir df/d19/d1e/d54/d72/d6f 0 2024-05-06T21:26:40.287 INFO:tasks.workunit.client.0.smithi032.stdout:1/360: truncate db/d16/d46/f4e 1721446 0 2024-05-06T21:26:40.287 INFO:tasks.workunit.client.0.smithi032.stdout:1/361: chown db/d16/d46/d57/l60 25320615 1 2024-05-06T21:26:40.288 INFO:tasks.workunit.client.0.smithi032.stdout:1/362: write db/d2a/f4d [1622065,7519] 0 2024-05-06T21:26:40.288 INFO:tasks.workunit.client.0.smithi032.stdout:3/374: dwrite d1/d4/da/d31/f55 [0,4194304] 0 2024-05-06T21:26:40.288 INFO:tasks.workunit.client.0.smithi032.stdout:8/402: dread d0/f16 [0,4194304] 0 2024-05-06T21:26:40.290 INFO:tasks.workunit.client.0.smithi032.stdout:2/315: creat df/d19/d1e/d54/d72/d65/f74 x:0 0 0 2024-05-06T21:26:40.290 INFO:tasks.workunit.client.0.smithi032.stdout:2/316: chown df/d19/d1e/d1f/d2e/d33 749975905 1 2024-05-06T21:26:40.290 INFO:tasks.workunit.client.0.smithi032.stdout:2/317: creat df/d19/d1e/d35/d3f/d46/f75 x:0 0 0 2024-05-06T21:26:40.290 INFO:tasks.workunit.client.0.smithi032.stdout:2/318: truncate df/d19/d1e/f51 998617 0 2024-05-06T21:26:40.290 INFO:tasks.workunit.client.0.smithi032.stdout:5/204: dread d0/fe [4194304,4194304] 0 2024-05-06T21:26:40.293 INFO:tasks.workunit.client.1.smithi154.stdout:1/54: unlink d6/db/ff 0 2024-05-06T21:26:40.293 INFO:tasks.workunit.client.1.smithi154.stdout:1/55: fdatasync d6/fd 0 2024-05-06T21:26:40.294 INFO:tasks.workunit.client.0.smithi032.stdout:3/375: unlink d1/l2 0 2024-05-06T21:26:40.295 INFO:tasks.workunit.client.1.smithi154.stdout:1/56: mknod d6/c11 0 2024-05-06T21:26:40.295 INFO:tasks.workunit.client.1.smithi154.stdout:1/57: chown l0 651 1 2024-05-06T21:26:40.296 INFO:tasks.workunit.client.0.smithi032.stdout:5/205: rename d0/d16/c1d to d0/d16/d2a/c2b 0 2024-05-06T21:26:40.296 INFO:tasks.workunit.client.0.smithi032.stdout:5/206: read d0/fe [1429081,54363] 0 2024-05-06T21:26:40.297 INFO:tasks.workunit.client.0.smithi032.stdout:5/207: write d0/f12 [1406592,56786] 0 2024-05-06T21:26:40.297 INFO:tasks.workunit.client.0.smithi032.stdout:3/376: mkdir d1/d4/da/d4e/d41/d43/d73/d75/d8b 0 2024-05-06T21:26:40.297 INFO:tasks.workunit.client.0.smithi032.stdout:3/377: read d1/d4/d11/f2b [1065858,100747] 0 2024-05-06T21:26:40.297 INFO:tasks.workunit.client.0.smithi032.stdout:3/378: chown d1/d2a/f4c 285963 1 2024-05-06T21:26:40.299 INFO:tasks.workunit.client.0.smithi032.stdout:1/363: dread db/f2e [0,4194304] 0 2024-05-06T21:26:40.299 INFO:tasks.workunit.client.1.smithi154.stdout:2/30: write f5 [43063,120729] 0 2024-05-06T21:26:40.299 INFO:tasks.workunit.client.1.smithi154.stdout:0/26: dwrite f4 [0,4194304] 0 2024-05-06T21:26:40.300 INFO:tasks.workunit.client.0.smithi032.stdout:3/379: getdents d1/d4/da/d4e/d5e 0 2024-05-06T21:26:40.300 INFO:tasks.workunit.client.0.smithi032.stdout:3/380: write d1/d4/da/d4e/d5e/f8a [577175,61591] 0 2024-05-06T21:26:40.301 INFO:tasks.workunit.client.0.smithi032.stdout:2/319: dread df/d19/d1e/d1f/d2e/d33/f20 [0,4194304] 0 2024-05-06T21:26:40.301 INFO:tasks.workunit.client.0.smithi032.stdout:2/320: fdatasync df/d19/d1e/d54/d72/d25/d2d/f47 0 2024-05-06T21:26:40.301 INFO:tasks.workunit.client.0.smithi032.stdout:1/364: mknod db/d37/d52/c6c 0 2024-05-06T21:26:40.302 INFO:tasks.workunit.client.1.smithi154.stdout:0/27: rename d6/f7 to d6/f8 0 2024-05-06T21:26:40.302 INFO:tasks.workunit.client.1.smithi154.stdout:0/28: chown c5 2556149 1 2024-05-06T21:26:40.303 INFO:tasks.workunit.client.0.smithi032.stdout:3/381: rename d1/d4/da/d31/c79 to d1/d4/da/d1d/c8c 0 2024-05-06T21:26:40.303 INFO:tasks.workunit.client.1.smithi154.stdout:0/29: mknod d6/c9 0 2024-05-06T21:26:40.304 INFO:tasks.workunit.client.0.smithi032.stdout:2/321: symlink df/d19/d1e/d35/d3f/d46/l76 0 2024-05-06T21:26:40.305 INFO:tasks.workunit.client.0.smithi032.stdout:1/365: readlink db/d37/l5e 0 2024-05-06T21:26:40.307 INFO:tasks.workunit.client.1.smithi154.stdout:1/58: write d6/fd [853656,105427] 0 2024-05-06T21:26:40.307 INFO:tasks.workunit.client.0.smithi032.stdout:3/382: rename d1/d4/da/d4e/d41/d43/f6c to d1/d2a/f8d 0 2024-05-06T21:26:40.307 INFO:tasks.workunit.client.0.smithi032.stdout:3/383: chown d1/d4/da/d4e/d41/d43/f70 52 1 2024-05-06T21:26:40.313 INFO:tasks.workunit.client.1.smithi154.stdout:2/31: dread f2 [0,4194304] 0 2024-05-06T21:26:40.313 INFO:tasks.workunit.client.1.smithi154.stdout:3/30: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:40.313 INFO:tasks.workunit.client.1.smithi154.stdout:8/35: dwrite d3/ff [0,4194304] 0 2024-05-06T21:26:40.313 INFO:tasks.workunit.client.1.smithi154.stdout:2/32: readlink l6 0 2024-05-06T21:26:40.313 INFO:tasks.workunit.client.1.smithi154.stdout:8/36: chown d3/f10 630153 1 2024-05-06T21:26:40.320 INFO:tasks.workunit.client.0.smithi032.stdout:0/329: dwrite d4/da/d16/f43 [4194304,4194304] 0 2024-05-06T21:26:40.323 INFO:tasks.workunit.client.0.smithi032.stdout:0/330: fsync d4/d51/f5c 0 2024-05-06T21:26:40.325 INFO:tasks.workunit.client.0.smithi032.stdout:8/403: dwrite d0/f6 [0,4194304] 0 2024-05-06T21:26:40.325 INFO:tasks.workunit.client.0.smithi032.stdout:5/208: fdatasync d0/d16/f1e 0 2024-05-06T21:26:40.326 INFO:tasks.workunit.client.1.smithi154.stdout:1/59: write d6/fc [1531729,39451] 0 2024-05-06T21:26:40.327 INFO:tasks.workunit.client.0.smithi032.stdout:2/322: dread df/d19/d1e/d1f/d2e/d33/f18 [0,4194304] 0 2024-05-06T21:26:40.327 INFO:tasks.workunit.client.0.smithi032.stdout:2/323: truncate df/d19/d1e/d1f/d2e/f3c 4938010 0 2024-05-06T21:26:40.330 INFO:tasks.workunit.client.0.smithi032.stdout:5/209: mknod d0/d16/c2c 0 2024-05-06T21:26:40.332 INFO:tasks.workunit.client.0.smithi032.stdout:2/324: mknod df/d19/d1e/d71/c77 0 2024-05-06T21:26:40.333 INFO:tasks.workunit.client.0.smithi032.stdout:0/331: rename d4/d51 to d4/d3e/d63 0 2024-05-06T21:26:40.335 INFO:tasks.workunit.client.0.smithi032.stdout:5/210: link d0/d11/l14 d0/d28/l2d 0 2024-05-06T21:26:40.335 INFO:tasks.workunit.client.0.smithi032.stdout:5/211: truncate d0/d16/f1e 1126806 0 2024-05-06T21:26:40.335 INFO:tasks.workunit.client.0.smithi032.stdout:0/332: dread d4/da/d16/d33/f36 [0,4194304] 0 2024-05-06T21:26:40.336 INFO:tasks.workunit.client.1.smithi154.stdout:0/30: truncate f2 405430 0 2024-05-06T21:26:40.337 INFO:tasks.workunit.client.1.smithi154.stdout:0/31: stat f2 0 2024-05-06T21:26:40.337 INFO:tasks.workunit.client.0.smithi032.stdout:8/404: rename d0/l14 to d0/d1c/d5e/l71 0 2024-05-06T21:26:40.337 INFO:tasks.workunit.client.0.smithi032.stdout:8/405: chown d0/d1b/d39/l43 1 1 2024-05-06T21:26:40.341 INFO:tasks.workunit.client.0.smithi032.stdout:5/212: creat d0/d28/f2e x:0 0 0 2024-05-06T21:26:40.342 INFO:tasks.workunit.client.1.smithi154.stdout:1/60: dread d6/f8 [0,4194304] 0 2024-05-06T21:26:40.342 INFO:tasks.workunit.client.1.smithi154.stdout:1/61: chown d6/fd 480503 1 2024-05-06T21:26:40.344 INFO:tasks.workunit.client.1.smithi154.stdout:1/62: unlink c2 0 2024-05-06T21:26:40.345 INFO:tasks.workunit.client.0.smithi032.stdout:0/333: symlink d4/d3e/l64 0 2024-05-06T21:26:40.347 INFO:tasks.workunit.client.0.smithi032.stdout:8/406: rename d0/d1b/d47/f66 to d0/d1b/d39/d3b/f72 0 2024-05-06T21:26:40.350 INFO:tasks.workunit.client.0.smithi032.stdout:0/334: creat d4/da/d14/d4a/f65 x:0 0 0 2024-05-06T21:26:40.351 INFO:tasks.workunit.client.0.smithi032.stdout:0/335: read d4/da/d14/d1a/f1e [1864465,95429] 0 2024-05-06T21:26:40.353 INFO:tasks.workunit.client.0.smithi032.stdout:2/325: dread df/f12 [0,4194304] 0 2024-05-06T21:26:40.354 INFO:tasks.workunit.client.0.smithi032.stdout:2/326: chown df/d19/d1e/d35/f6d 513639705 1 2024-05-06T21:26:40.354 INFO:tasks.workunit.client.0.smithi032.stdout:3/384: dwrite d1/d4/da/d4e/d41/d45/f6a [0,4194304] 0 2024-05-06T21:26:40.354 INFO:tasks.workunit.client.0.smithi032.stdout:3/385: fdatasync d1/d4/da/d4e/d41/d45/f7e 0 2024-05-06T21:26:40.361 INFO:tasks.workunit.client.1.smithi154.stdout:8/37: dwrite d3/f10 [0,4194304] 0 2024-05-06T21:26:40.363 INFO:tasks.workunit.client.1.smithi154.stdout:8/38: symlink d3/l12 0 2024-05-06T21:26:40.363 INFO:tasks.workunit.client.1.smithi154.stdout:8/39: chown d3/fb 7919931 1 2024-05-06T21:26:40.366 INFO:tasks.workunit.client.0.smithi032.stdout:2/327: dread df/d19/d1e/d54/f58 [0,4194304] 0 2024-05-06T21:26:40.366 INFO:tasks.workunit.client.0.smithi032.stdout:2/328: chown df/d19/d1e/d35/d3f/d46/l4a 74728 1 2024-05-06T21:26:40.366 INFO:tasks.workunit.client.1.smithi154.stdout:8/40: rename c1 to d3/c13 0 2024-05-06T21:26:40.367 INFO:tasks.workunit.client.1.smithi154.stdout:3/31: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:40.367 INFO:tasks.workunit.client.1.smithi154.stdout:3/32: fdatasync d0/f3 0 2024-05-06T21:26:40.367 INFO:tasks.workunit.client.1.smithi154.stdout:3/33: fsync d0/f3 0 2024-05-06T21:26:40.367 INFO:tasks.workunit.client.1.smithi154.stdout:8/41: truncate d3/fd 843758 0 2024-05-06T21:26:40.368 INFO:tasks.workunit.client.0.smithi032.stdout:2/329: mkdir df/d19/d1e/d54/d72/d65/d78 0 2024-05-06T21:26:40.369 INFO:tasks.workunit.client.1.smithi154.stdout:0/32: dwrite f4 [0,4194304] 0 2024-05-06T21:26:40.369 INFO:tasks.workunit.client.1.smithi154.stdout:3/34: getdents d0/d4 0 2024-05-06T21:26:40.371 INFO:tasks.workunit.client.0.smithi032.stdout:2/330: link df/d19/d1e/d1f/d2e/d33/f15 df/d19/d1e/d71/d5f/d73/f79 0 2024-05-06T21:26:40.371 INFO:tasks.workunit.client.0.smithi032.stdout:1/366: dwrite db/d16/d46/f4e [0,4194304] 0 2024-05-06T21:26:40.373 INFO:tasks.workunit.client.1.smithi154.stdout:8/42: mkdir d3/d14 0 2024-05-06T21:26:40.373 INFO:tasks.workunit.client.1.smithi154.stdout:8/43: fdatasync d3/fd 0 2024-05-06T21:26:40.373 INFO:tasks.workunit.client.1.smithi154.stdout:8/44: getdents d3/d14 0 2024-05-06T21:26:40.374 INFO:tasks.workunit.client.1.smithi154.stdout:0/33: symlink d6/la 0 2024-05-06T21:26:40.379 INFO:tasks.workunit.client.0.smithi032.stdout:2/331: mknod df/d19/d1e/d54/d72/d65/c7a 0 2024-05-06T21:26:40.380 INFO:tasks.workunit.client.1.smithi154.stdout:0/34: write f2 [339808,52287] 0 2024-05-06T21:26:40.380 INFO:tasks.workunit.client.1.smithi154.stdout:0/35: chown f2 1 1 2024-05-06T21:26:40.380 INFO:tasks.workunit.client.1.smithi154.stdout:0/36: creat d6/fb x:0 0 0 2024-05-06T21:26:40.380 INFO:tasks.workunit.client.1.smithi154.stdout:2/33: dwrite f5 [4194304,4194304] 0 2024-05-06T21:26:40.381 INFO:tasks.workunit.client.0.smithi032.stdout:3/386: dwrite d1/d4/d11/f36 [4194304,4194304] 0 2024-05-06T21:26:40.382 INFO:tasks.workunit.client.0.smithi032.stdout:5/213: rmdir d0/d28 39 2024-05-06T21:26:40.384 INFO:tasks.workunit.client.0.smithi032.stdout:5/214: dread d0/f12 [4194304,4194304] 0 2024-05-06T21:26:40.384 INFO:tasks.workunit.client.1.smithi154.stdout:0/37: mkdir d6/dc 0 2024-05-06T21:26:40.385 INFO:tasks.workunit.client.0.smithi032.stdout:0/336: rmdir d4/da/d14/d4a 39 2024-05-06T21:26:40.386 INFO:tasks.workunit.client.0.smithi032.stdout:8/407: truncate d0/d1c/f22 714900 0 2024-05-06T21:26:40.387 INFO:tasks.workunit.client.1.smithi154.stdout:2/34: link l7 l8 0 2024-05-06T21:26:40.389 INFO:tasks.workunit.client.1.smithi154.stdout:2/35: mknod c9 0 2024-05-06T21:26:40.389 INFO:tasks.workunit.client.1.smithi154.stdout:2/36: fdatasync f5 0 2024-05-06T21:26:40.390 INFO:tasks.workunit.client.1.smithi154.stdout:1/63: dwrite d6/fd [0,4194304] 0 2024-05-06T21:26:40.392 INFO:tasks.workunit.client.1.smithi154.stdout:1/64: mkdir d6/d12 0 2024-05-06T21:26:40.412 INFO:tasks.workunit.client.0.smithi032.stdout:1/367: truncate db/d16/d46/f4e 2850556 0 2024-05-06T21:26:40.413 INFO:tasks.workunit.client.0.smithi032.stdout:5/215: mkdir d0/d16/d2f 0 2024-05-06T21:26:40.413 INFO:tasks.workunit.client.0.smithi032.stdout:5/216: creat d0/d11/f30 x:0 0 0 2024-05-06T21:26:40.413 INFO:tasks.workunit.client.0.smithi032.stdout:5/217: fdatasync d0/f12 0 2024-05-06T21:26:40.413 INFO:tasks.workunit.client.0.smithi032.stdout:5/218: truncate d0/d28/f2e 330678 0 2024-05-06T21:26:40.414 INFO:tasks.workunit.client.0.smithi032.stdout:0/337: mkdir d4/da/d14/d1a/d66 0 2024-05-06T21:26:40.415 INFO:tasks.workunit.client.0.smithi032.stdout:3/387: mknod d1/d4/da/c8e 0 2024-05-06T21:26:40.416 INFO:tasks.workunit.client.0.smithi032.stdout:1/368: creat db/d16/f6d x:0 0 0 2024-05-06T21:26:40.416 INFO:tasks.workunit.client.0.smithi032.stdout:1/369: readlink db/d2a/l48 0 2024-05-06T21:26:40.418 INFO:tasks.workunit.client.1.smithi154.stdout:8/45: dwrite d3/fd [0,4194304] 0 2024-05-06T21:26:40.419 INFO:tasks.workunit.client.1.smithi154.stdout:2/37: dwrite f0 [4194304,4194304] 0 2024-05-06T21:26:40.419 INFO:tasks.workunit.client.1.smithi154.stdout:2/38: creat fa x:0 0 0 2024-05-06T21:26:40.419 INFO:tasks.workunit.client.0.smithi032.stdout:5/219: rename d0/d16/c2c to d0/d24/d26/c31 0 2024-05-06T21:26:40.419 INFO:tasks.workunit.client.0.smithi032.stdout:5/220: write d0/f12 [416145,119754] 0 2024-05-06T21:26:40.419 INFO:tasks.workunit.client.0.smithi032.stdout:0/338: rmdir d4/da 39 2024-05-06T21:26:40.420 INFO:tasks.workunit.client.1.smithi154.stdout:8/46: creat d3/d14/f15 x:0 0 0 2024-05-06T21:26:40.420 INFO:tasks.workunit.client.1.smithi154.stdout:8/47: chown d3/ff 7548404 1 2024-05-06T21:26:40.420 INFO:tasks.workunit.client.0.smithi032.stdout:1/370: symlink db/d16/d46/d55/l6e 0 2024-05-06T21:26:40.421 INFO:tasks.workunit.client.0.smithi032.stdout:5/221: dread d0/d28/f2e [0,4194304] 0 2024-05-06T21:26:40.421 INFO:tasks.workunit.client.0.smithi032.stdout:0/339: mknod d4/da/d16/d33/c67 0 2024-05-06T21:26:40.425 INFO:tasks.workunit.client.0.smithi032.stdout:0/340: rmdir d4/da/d14 39 2024-05-06T21:26:40.428 INFO:tasks.workunit.client.1.smithi154.stdout:2/39: dread f2 [0,4194304] 0 2024-05-06T21:26:40.429 INFO:tasks.workunit.client.1.smithi154.stdout:2/40: chown c3 2149435 1 2024-05-06T21:26:40.429 INFO:tasks.workunit.client.1.smithi154.stdout:2/41: chown l7 243 1 2024-05-06T21:26:40.429 INFO:tasks.workunit.client.1.smithi154.stdout:2/42: chown l6 52406 1 2024-05-06T21:26:40.429 INFO:tasks.workunit.client.1.smithi154.stdout:2/43: write f5 [466487,101913] 0 2024-05-06T21:26:40.430 INFO:tasks.workunit.client.1.smithi154.stdout:2/44: mkdir db 0 2024-05-06T21:26:40.431 INFO:tasks.workunit.client.0.smithi032.stdout:0/341: creat d4/da/d14/d1a/f68 x:0 0 0 2024-05-06T21:26:40.434 INFO:tasks.workunit.client.0.smithi032.stdout:0/342: chown d4/f24 179900 1 2024-05-06T21:26:40.437 INFO:tasks.workunit.client.0.smithi032.stdout:0/343: symlink d4/da/d14/d1a/d66/l69 0 2024-05-06T21:26:40.438 INFO:tasks.workunit.client.0.smithi032.stdout:0/344: write d4/da/d14/f47 [1107567,129881] 0 2024-05-06T21:26:40.438 INFO:tasks.workunit.client.0.smithi032.stdout:0/345: write d4/da/d16/d33/f36 [949446,57002] 0 2024-05-06T21:26:40.440 INFO:tasks.workunit.client.1.smithi154.stdout:8/48: dread f2 [0,4194304] 0 2024-05-06T21:26:40.441 INFO:tasks.workunit.client.0.smithi032.stdout:8/408: dwrite d0/d1b/d39/f5a [0,4194304] 0 2024-05-06T21:26:40.441 INFO:tasks.workunit.client.0.smithi032.stdout:8/409: write d0/d1b/d39/f6b [456397,123071] 0 2024-05-06T21:26:40.443 INFO:tasks.workunit.client.1.smithi154.stdout:8/49: getdents d3 0 2024-05-06T21:26:40.444 INFO:tasks.workunit.client.0.smithi032.stdout:8/410: creat d0/d1c/d5e/f73 x:0 0 0 2024-05-06T21:26:40.444 INFO:tasks.workunit.client.0.smithi032.stdout:8/411: chown d0/d1b/f5f 1954730996 1 2024-05-06T21:26:40.445 INFO:tasks.workunit.client.0.smithi032.stdout:8/412: creat d0/d1c/f74 x:0 0 0 2024-05-06T21:26:40.445 INFO:tasks.workunit.client.1.smithi154.stdout:8/50: rename l0 to d3/l16 0 2024-05-06T21:26:40.446 INFO:tasks.workunit.client.0.smithi032.stdout:8/413: rmdir d0/d1c/d5e/d67 39 2024-05-06T21:26:40.448 INFO:tasks.workunit.client.0.smithi032.stdout:8/414: write d0/f16 [4672996,7660] 0 2024-05-06T21:26:40.449 INFO:tasks.workunit.client.0.smithi032.stdout:8/415: mknod d0/d1c/d5e/c75 0 2024-05-06T21:26:40.450 INFO:tasks.workunit.client.0.smithi032.stdout:8/416: mkdir d0/d1b/d76 0 2024-05-06T21:26:40.451 INFO:tasks.workunit.client.0.smithi032.stdout:8/417: dread d0/f7 [0,4194304] 0 2024-05-06T21:26:40.451 INFO:tasks.workunit.client.0.smithi032.stdout:8/418: stat d0/d1b/d39/d3b/f72 0 2024-05-06T21:26:40.452 INFO:tasks.workunit.client.0.smithi032.stdout:3/388: dwrite d1/d4/f52 [4194304,4194304] 0 2024-05-06T21:26:40.454 INFO:tasks.workunit.client.0.smithi032.stdout:3/389: mkdir d1/d2a/d71/d8f 0 2024-05-06T21:26:40.455 INFO:tasks.workunit.client.1.smithi154.stdout:2/45: dwrite fa [0,4194304] 0 2024-05-06T21:26:40.457 INFO:tasks.workunit.client.0.smithi032.stdout:1/371: dwrite db/d16/f1e [0,4194304] 0 2024-05-06T21:26:40.458 INFO:tasks.workunit.client.0.smithi032.stdout:1/372: rmdir db/d2a/d4f 39 2024-05-06T21:26:40.458 INFO:tasks.workunit.client.1.smithi154.stdout:2/46: unlink l8 0 2024-05-06T21:26:40.459 INFO:tasks.workunit.client.0.smithi032.stdout:0/346: dread d4/da/d16/d33/f36 [0,4194304] 0 2024-05-06T21:26:40.459 INFO:tasks.workunit.client.0.smithi032.stdout:0/347: creat d4/da/d14/d1a/f6a x:0 0 0 2024-05-06T21:26:40.459 INFO:tasks.workunit.client.0.smithi032.stdout:0/348: fdatasync d4/da/f22 0 2024-05-06T21:26:40.459 INFO:tasks.workunit.client.0.smithi032.stdout:0/349: dread - d4/d3e/d42/f5f zero size 2024-05-06T21:26:40.460 INFO:tasks.workunit.client.1.smithi154.stdout:2/47: symlink db/lc 0 2024-05-06T21:26:40.460 INFO:tasks.workunit.client.0.smithi032.stdout:3/390: getdents d1/d4 0 2024-05-06T21:26:40.460 INFO:tasks.workunit.client.1.smithi154.stdout:8/51: dread d3/f9 [0,4194304] 0 2024-05-06T21:26:40.460 INFO:tasks.workunit.client.1.smithi154.stdout:2/48: mkdir db/dd 0 2024-05-06T21:26:40.462 INFO:tasks.workunit.client.1.smithi154.stdout:8/52: symlink d3/l17 0 2024-05-06T21:26:40.462 INFO:tasks.workunit.client.0.smithi032.stdout:0/350: symlink d4/da/d14/d1a/l6b 0 2024-05-06T21:26:40.464 INFO:tasks.workunit.client.0.smithi032.stdout:0/351: mkdir d4/d3e/d63/d6c 0 2024-05-06T21:26:40.475 INFO:tasks.workunit.client.1.smithi154.stdout:8/53: write d3/fd [600584,126260] 0 2024-05-06T21:26:40.475 INFO:tasks.workunit.client.1.smithi154.stdout:8/54: write d3/f9 [4821520,110364] 0 2024-05-06T21:26:40.475 INFO:tasks.workunit.client.0.smithi032.stdout:8/419: dwrite d0/f6 [0,4194304] 0 2024-05-06T21:26:40.475 INFO:tasks.workunit.client.0.smithi032.stdout:8/420: write d0/f6 [4739944,55176] 0 2024-05-06T21:26:40.476 INFO:tasks.workunit.client.1.smithi154.stdout:8/55: dread - d3/d14/f15 zero size 2024-05-06T21:26:40.477 INFO:tasks.workunit.client.1.smithi154.stdout:8/56: write d3/fe [172278,120512] 0 2024-05-06T21:26:40.478 INFO:tasks.workunit.client.1.smithi154.stdout:8/57: write d3/f8 [3027080,92058] 0 2024-05-06T21:26:40.478 INFO:tasks.workunit.client.1.smithi154.stdout:8/58: creat d3/d14/f18 x:0 0 0 2024-05-06T21:26:40.482 INFO:tasks.workunit.client.1.smithi154.stdout:8/59: unlink d3/l12 0 2024-05-06T21:26:40.483 INFO:tasks.workunit.client.1.smithi154.stdout:8/60: creat d3/d14/f19 x:0 0 0 2024-05-06T21:26:40.485 INFO:tasks.workunit.client.1.smithi154.stdout:8/61: mkdir d3/d14/d1a 0 2024-05-06T21:26:40.487 INFO:tasks.workunit.client.1.smithi154.stdout:8/62: symlink d3/d14/d1a/l1b 0 2024-05-06T21:26:40.488 INFO:tasks.workunit.client.1.smithi154.stdout:8/63: fdatasync d3/f10 0 2024-05-06T21:26:40.490 INFO:tasks.workunit.client.1.smithi154.stdout:8/64: symlink d3/l1c 0 2024-05-06T21:26:40.490 INFO:tasks.workunit.client.0.smithi032.stdout:8/421: dread d0/d1b/d39/f48 [0,4194304] 0 2024-05-06T21:26:40.490 INFO:tasks.workunit.client.0.smithi032.stdout:1/373: dwrite db/d16/f33 [4194304,4194304] 0 2024-05-06T21:26:40.491 INFO:tasks.workunit.client.0.smithi032.stdout:8/422: mknod d0/d1b/d47/c77 0 2024-05-06T21:26:40.492 INFO:tasks.workunit.client.0.smithi032.stdout:1/374: getdents db/d47/d4a 0 2024-05-06T21:26:40.492 INFO:tasks.workunit.client.0.smithi032.stdout:1/375: fdatasync db/d16/f6d 0 2024-05-06T21:26:40.493 INFO:tasks.workunit.client.0.smithi032.stdout:8/423: symlink d0/d1b/d47/l78 0 2024-05-06T21:26:40.494 INFO:tasks.workunit.client.0.smithi032.stdout:1/376: symlink db/d37/d52/l6f 0 2024-05-06T21:26:40.495 INFO:tasks.workunit.client.0.smithi032.stdout:1/377: mkdir db/d47/d70 0 2024-05-06T21:26:40.495 INFO:tasks.workunit.client.0.smithi032.stdout:1/378: fdatasync db/d37/f54 0 2024-05-06T21:26:40.497 INFO:tasks.workunit.client.0.smithi032.stdout:1/379: creat db/d16/d46/d57/f71 x:0 0 0 2024-05-06T21:26:40.497 INFO:tasks.workunit.client.0.smithi032.stdout:1/380: readlink l3 0 2024-05-06T21:26:40.497 INFO:tasks.workunit.client.0.smithi032.stdout:1/381: chown db/d16/d46/d57 0 1 2024-05-06T21:26:40.498 INFO:tasks.workunit.client.0.smithi032.stdout:1/382: fdatasync db/d16/f1b 0 2024-05-06T21:26:40.498 INFO:tasks.workunit.client.0.smithi032.stdout:1/383: chown db/d2a/d4f/l62 501494321 1 2024-05-06T21:26:40.498 INFO:tasks.workunit.client.0.smithi032.stdout:3/391: dwrite d1/d4/d11/f2b [0,4194304] 0 2024-05-06T21:26:40.499 INFO:tasks.workunit.client.0.smithi032.stdout:0/352: dwrite d4/f9 [0,4194304] 0 2024-05-06T21:26:40.499 INFO:tasks.workunit.client.0.smithi032.stdout:0/353: chown d4/f6 27189 1 2024-05-06T21:26:40.502 INFO:tasks.workunit.client.1.smithi154.stdout:8/65: getdents d3/d14 0 2024-05-06T21:26:40.508 INFO:tasks.workunit.client.1.smithi154.stdout:8/66: dread d3/f5 [0,4194304] 0 2024-05-06T21:26:40.510 INFO:tasks.workunit.client.1.smithi154.stdout:8/67: symlink d3/l1d 0 2024-05-06T21:26:40.513 INFO:tasks.workunit.client.1.smithi154.stdout:8/68: rename d3/f5 to d3/d14/f1e 0 2024-05-06T21:26:40.517 INFO:tasks.workunit.client.0.smithi032.stdout:3/392: dwrite d1/d4/da/d4e/d41/d45/f4d [4194304,4194304] 0 2024-05-06T21:26:40.518 INFO:tasks.workunit.client.1.smithi154.stdout:8/69: write f2 [4130466,8745] 0 2024-05-06T21:26:40.518 INFO:tasks.workunit.client.1.smithi154.stdout:8/70: dread - d3/d14/f18 zero size 2024-05-06T21:26:40.533 INFO:tasks.workunit.client.0.smithi032.stdout:3/393: dwrite d1/d4/da/d31/f87 [0,4194304] 0 2024-05-06T21:26:40.536 INFO:tasks.workunit.client.0.smithi032.stdout:3/394: creat d1/d4/da/d31/d47/d4a/d68/d7c/f90 x:0 0 0 2024-05-06T21:26:40.537 INFO:tasks.workunit.client.0.smithi032.stdout:3/395: creat d1/d4/da/d4e/f91 x:0 0 0 2024-05-06T21:26:40.538 INFO:tasks.workunit.client.0.smithi032.stdout:3/396: creat d1/d2a/d71/d8f/f92 x:0 0 0 2024-05-06T21:26:40.538 INFO:tasks.workunit.client.0.smithi032.stdout:3/397: chown d1/d4/cd 361494 1 2024-05-06T21:26:40.538 INFO:tasks.workunit.client.0.smithi032.stdout:3/398: dread - d1/d2a/f76 zero size 2024-05-06T21:26:40.538 INFO:tasks.workunit.client.0.smithi032.stdout:3/399: symlink d1/d4/da/d4e/d41/d45/l93 0 2024-05-06T21:26:40.540 INFO:tasks.workunit.client.0.smithi032.stdout:3/400: unlink d1/d4/f30 0 2024-05-06T21:26:40.540 INFO:tasks.workunit.client.0.smithi032.stdout:3/401: readlink d1/d4/d11/l3c 0 2024-05-06T21:26:40.541 INFO:tasks.workunit.client.0.smithi032.stdout:3/402: unlink d1/c13 0 2024-05-06T21:26:40.548 INFO:tasks.workunit.client.1.smithi154.stdout:2/49: dwrite f5 [4194304,4194304] 0 2024-05-06T21:26:40.548 INFO:tasks.workunit.client.1.smithi154.stdout:2/50: fdatasync f5 0 2024-05-06T21:26:40.548 INFO:tasks.workunit.client.1.smithi154.stdout:2/51: chown db/dd 1036296839 1 2024-05-06T21:26:40.551 INFO:tasks.workunit.client.1.smithi154.stdout:8/71: dread d3/f9 [0,4194304] 0 2024-05-06T21:26:40.553 INFO:tasks.workunit.client.1.smithi154.stdout:8/72: write d3/fc [169373,120659] 0 2024-05-06T21:26:40.572 INFO:tasks.workunit.client.1.smithi154.stdout:8/73: dread d3/ff [0,4194304] 0 2024-05-06T21:26:40.586 INFO:tasks.workunit.client.0.smithi032.stdout:8/424: dwrite d0/d1c/f24 [0,4194304] 0 2024-05-06T21:26:40.586 INFO:tasks.workunit.client.0.smithi032.stdout:8/425: fdatasync d0/f41 0 2024-05-06T21:26:40.586 INFO:tasks.workunit.client.0.smithi032.stdout:8/426: creat d0/d1b/d39/d3b/d57/f79 x:0 0 0 2024-05-06T21:26:40.586 INFO:tasks.workunit.client.0.smithi032.stdout:8/427: dread - d0/d1b/d39/d3b/d57/f79 zero size 2024-05-06T21:26:40.587 INFO:tasks.workunit.client.0.smithi032.stdout:8/428: truncate d0/d1c/d5e/f73 698940 0 2024-05-06T21:26:40.587 INFO:tasks.workunit.client.0.smithi032.stdout:8/429: read d0/d1b/f5f [360854,58084] 0 2024-05-06T21:26:40.588 INFO:tasks.workunit.client.1.smithi154.stdout:8/74: dwrite d3/f9 [4194304,4194304] 0 2024-05-06T21:26:40.588 INFO:tasks.workunit.client.1.smithi154.stdout:8/75: write d3/fe [898238,6726] 0 2024-05-06T21:26:40.589 INFO:tasks.workunit.client.0.smithi032.stdout:8/430: rename d0/d1c/f74 to d0/d1c/d5e/f7a 0 2024-05-06T21:26:40.602 INFO:tasks.workunit.client.1.smithi154.stdout:2/52: dwrite f2 [0,4194304] 0 2024-05-06T21:26:40.602 INFO:tasks.workunit.client.0.smithi032.stdout:1/384: dwrite db/f43 [0,4194304] 0 2024-05-06T21:26:40.603 INFO:tasks.workunit.client.0.smithi032.stdout:3/403: dwrite d1/f6 [0,4194304] 0 2024-05-06T21:26:40.603 INFO:tasks.workunit.client.0.smithi032.stdout:3/404: chown d1/l50 486 1 2024-05-06T21:26:40.603 INFO:tasks.workunit.client.0.smithi032.stdout:0/354: dwrite d4/f7 [0,4194304] 0 2024-05-06T21:26:40.603 INFO:tasks.workunit.client.1.smithi154.stdout:8/76: write d3/f9 [7198129,17311] 0 2024-05-06T21:26:40.603 INFO:tasks.workunit.client.1.smithi154.stdout:2/53: mkdir db/de 0 2024-05-06T21:26:40.605 INFO:tasks.workunit.client.1.smithi154.stdout:2/54: symlink db/lf 0 2024-05-06T21:26:40.607 INFO:tasks.workunit.client.0.smithi032.stdout:3/405: dread d1/d4/da/d4e/d41/d45/f56 [0,4194304] 0 2024-05-06T21:26:40.608 INFO:tasks.workunit.client.1.smithi154.stdout:2/55: mkdir db/de/d10 0 2024-05-06T21:26:40.609 INFO:tasks.workunit.client.1.smithi154.stdout:2/56: link f5 db/de/f11 0 2024-05-06T21:26:40.611 INFO:tasks.workunit.client.0.smithi032.stdout:8/431: dwrite d0/d1c/f24 [4194304,4194304] 0 2024-05-06T21:26:40.611 INFO:tasks.workunit.client.0.smithi032.stdout:8/432: chown d0/d1b/d47 0 1 2024-05-06T21:26:40.611 INFO:tasks.workunit.client.0.smithi032.stdout:0/355: rename d4/da/d14/d1a/f34 to d4/d3e/d63/f6d 0 2024-05-06T21:26:40.612 INFO:tasks.workunit.client.0.smithi032.stdout:1/385: link db/d16/l1c db/d47/d4a/l72 0 2024-05-06T21:26:40.619 INFO:tasks.workunit.client.0.smithi032.stdout:8/433: truncate d0/d1b/f3e 4893562 0 2024-05-06T21:26:40.619 INFO:tasks.workunit.client.0.smithi032.stdout:8/434: chown d0/d1b/l2a 457 1 2024-05-06T21:26:40.620 INFO:tasks.workunit.client.1.smithi154.stdout:2/57: write db/de/f11 [7739684,22523] 0 2024-05-06T21:26:40.620 INFO:tasks.workunit.client.1.smithi154.stdout:2/58: write db/de/f11 [9108112,66058] 0 2024-05-06T21:26:40.620 INFO:tasks.workunit.client.0.smithi032.stdout:0/356: link d4/da/d16/d33/f5e d4/da/d16/d33/d46/f6e 0 2024-05-06T21:26:40.622 INFO:tasks.workunit.client.0.smithi032.stdout:3/406: read d1/d4/d11/f2b [1809668,62946] 0 2024-05-06T21:26:40.628 INFO:tasks.workunit.client.1.smithi154.stdout:2/59: write fa [3921627,113062] 0 2024-05-06T21:26:40.628 INFO:tasks.workunit.client.1.smithi154.stdout:2/60: chown db/de/f11 177627 1 2024-05-06T21:26:40.629 INFO:tasks.workunit.client.1.smithi154.stdout:8/77: dwrite d3/fe [0,4194304] 0 2024-05-06T21:26:40.629 INFO:tasks.workunit.client.0.smithi032.stdout:1/386: mknod db/d16/c73 0 2024-05-06T21:26:40.630 INFO:tasks.workunit.client.0.smithi032.stdout:8/435: truncate d0/d1b/f61 237328 0 2024-05-06T21:26:40.630 INFO:tasks.workunit.client.0.smithi032.stdout:0/357: mknod d4/d3e/d63/c6f 0 2024-05-06T21:26:40.630 INFO:tasks.workunit.client.1.smithi154.stdout:2/61: mkdir db/d12 0 2024-05-06T21:26:40.630 INFO:tasks.workunit.client.1.smithi154.stdout:2/62: stat db/de 0 2024-05-06T21:26:40.631 INFO:tasks.workunit.client.0.smithi032.stdout:1/387: rename db/d2a/f61 to db/d47/d4a/f74 0 2024-05-06T21:26:40.632 INFO:tasks.workunit.client.0.smithi032.stdout:8/436: mkdir d0/d1c/d5e/d67/d7b 0 2024-05-06T21:26:40.636 INFO:tasks.workunit.client.0.smithi032.stdout:1/388: creat db/d16/f75 x:0 0 0 2024-05-06T21:26:40.637 INFO:tasks.workunit.client.0.smithi032.stdout:8/437: mknod d0/d1b/d39/d3b/c7c 0 2024-05-06T21:26:40.639 INFO:tasks.workunit.client.0.smithi032.stdout:1/389: mknod db/d16/d46/d57/d58/d68/c76 0 2024-05-06T21:26:40.641 INFO:tasks.workunit.client.0.smithi032.stdout:8/438: creat d0/d1b/d47/f7d x:0 0 0 2024-05-06T21:26:40.641 INFO:tasks.workunit.client.0.smithi032.stdout:3/407: dwrite d1/d4/da/d4e/d41/d43/d44/d67/f78 [0,4194304] 0 2024-05-06T21:26:40.642 INFO:tasks.workunit.client.0.smithi032.stdout:1/390: rename db/c3f to db/d16/d46/d57/d58/c77 0 2024-05-06T21:26:40.643 INFO:tasks.workunit.client.0.smithi032.stdout:1/391: creat db/d16/d46/f78 x:0 0 0 2024-05-06T21:26:40.644 INFO:tasks.workunit.client.0.smithi032.stdout:8/439: mknod d0/d1c/d5e/c7e 0 2024-05-06T21:26:40.644 INFO:tasks.workunit.client.0.smithi032.stdout:8/440: truncate d0/f33 450139 0 2024-05-06T21:26:40.651 INFO:tasks.workunit.client.0.smithi032.stdout:1/392: creat db/d2a/f79 x:0 0 0 2024-05-06T21:26:40.651 INFO:tasks.workunit.client.0.smithi032.stdout:8/441: stat d0/d1c/l2c 0 2024-05-06T21:26:40.652 INFO:tasks.workunit.client.0.smithi032.stdout:8/442: readlink d0/d1c/d5e/l71 0 2024-05-06T21:26:40.656 INFO:tasks.workunit.client.0.smithi032.stdout:7/422: sync 2024-05-06T21:26:40.656 INFO:tasks.workunit.client.0.smithi032.stdout:6/365: sync 2024-05-06T21:26:40.656 INFO:tasks.workunit.client.0.smithi032.stdout:4/439: sync 2024-05-06T21:26:40.656 INFO:tasks.workunit.client.0.smithi032.stdout:4/440: rename d2/d2c/d31 to d2/d2c/d31/d7c/d95 22 2024-05-06T21:26:40.657 INFO:tasks.workunit.client.0.smithi032.stdout:4/441: fsync d2/f6c 0 2024-05-06T21:26:40.657 INFO:tasks.workunit.client.0.smithi032.stdout:9/375: sync 2024-05-06T21:26:40.657 INFO:tasks.workunit.client.0.smithi032.stdout:9/376: creat d1/d13/d25/f74 x:0 0 0 2024-05-06T21:26:40.657 INFO:tasks.workunit.client.0.smithi032.stdout:1/393: symlink db/d16/d46/d57/l7a 0 2024-05-06T21:26:40.657 INFO:tasks.workunit.client.0.smithi032.stdout:3/408: unlink d1/d2a/l33 0 2024-05-06T21:26:40.657 INFO:tasks.workunit.client.0.smithi032.stdout:3/409: readlink d1/d4/d11/l1a 0 2024-05-06T21:26:40.660 INFO:tasks.workunit.client.0.smithi032.stdout:4/442: creat d2/f96 x:0 0 0 2024-05-06T21:26:40.660 INFO:tasks.workunit.client.0.smithi032.stdout:9/377: creat d1/d13/d33/d3f/f75 x:0 0 0 2024-05-06T21:26:40.661 INFO:tasks.workunit.client.1.smithi154.stdout:2/63: dwrite f5 [8388608,4194304] 0 2024-05-06T21:26:40.664 INFO:tasks.workunit.client.1.smithi154.stdout:8/78: dwrite d3/f9 [4194304,4194304] 0 2024-05-06T21:26:40.664 INFO:tasks.workunit.client.1.smithi154.stdout:2/64: link f2 db/f13 0 2024-05-06T21:26:40.665 INFO:tasks.workunit.client.0.smithi032.stdout:2/332: sync 2024-05-06T21:26:40.665 INFO:tasks.workunit.client.0.smithi032.stdout:5/222: sync 2024-05-06T21:26:40.665 INFO:tasks.workunit.client.0.smithi032.stdout:5/223: truncate d0/d16/f1e 1180352 0 2024-05-06T21:26:40.666 INFO:tasks.workunit.client.1.smithi154.stdout:2/65: creat db/de/d10/f14 x:0 0 0 2024-05-06T21:26:40.667 INFO:tasks.workunit.client.1.smithi154.stdout:2/66: chown l6 0 1 2024-05-06T21:26:40.668 INFO:tasks.workunit.client.1.smithi154.stdout:8/79: mknod d3/c1f 0 2024-05-06T21:26:40.669 INFO:tasks.workunit.client.1.smithi154.stdout:8/80: fsync d3/f9 0 2024-05-06T21:26:40.669 INFO:tasks.workunit.client.1.smithi154.stdout:8/81: fdatasync d3/d14/f19 0 2024-05-06T21:26:40.671 INFO:tasks.workunit.client.0.smithi032.stdout:0/358: write d4/f6 [2329084,128037] 0 2024-05-06T21:26:40.671 INFO:tasks.workunit.client.0.smithi032.stdout:6/366: dread d8/d3d/d49/f60 [0,4194304] 0 2024-05-06T21:26:40.672 INFO:tasks.workunit.client.0.smithi032.stdout:3/410: write d1/d4/da/d4e/d41/f66 [1111636,35826] 0 2024-05-06T21:26:40.672 INFO:tasks.workunit.client.0.smithi032.stdout:3/411: fsync d1/d4/da/d4e/d41/d43/f70 0 2024-05-06T21:26:40.672 INFO:tasks.workunit.client.1.smithi154.stdout:8/82: creat d3/d14/f20 x:0 0 0 2024-05-06T21:26:40.672 INFO:tasks.workunit.client.1.smithi154.stdout:8/83: write d3/d14/f15 [835599,63737] 0 2024-05-06T21:26:40.672 INFO:tasks.workunit.client.1.smithi154.stdout:8/84: chown d3 829 1 2024-05-06T21:26:40.672 INFO:tasks.workunit.client.1.smithi154.stdout:8/85: write d3/fc [551896,3693] 0 2024-05-06T21:26:40.673 INFO:tasks.workunit.client.0.smithi032.stdout:4/443: dread d2/d16/f5e [0,4194304] 0 2024-05-06T21:26:40.673 INFO:tasks.workunit.client.0.smithi032.stdout:4/444: chown d2/d2c/c75 62613701 1 2024-05-06T21:26:40.673 INFO:tasks.workunit.client.0.smithi032.stdout:4/445: write d2/d16/d44/d74/f8b [1541353,18415] 0 2024-05-06T21:26:40.674 INFO:tasks.workunit.client.0.smithi032.stdout:6/367: rename d8/dd/d18/l30 to d8/d3d/l68 0 2024-05-06T21:26:40.674 INFO:tasks.workunit.client.0.smithi032.stdout:6/368: stat d8/f2b 0 2024-05-06T21:26:40.674 INFO:tasks.workunit.client.0.smithi032.stdout:3/412: mknod d1/d4/da/d4e/d41/d43/c94 0 2024-05-06T21:26:40.676 INFO:tasks.workunit.client.0.smithi032.stdout:4/446: creat d2/d16/d44/d74/d79/f97 x:0 0 0 2024-05-06T21:26:40.678 INFO:tasks.workunit.client.0.smithi032.stdout:6/369: creat d8/dd/d18/f69 x:0 0 0 2024-05-06T21:26:40.679 INFO:tasks.workunit.client.0.smithi032.stdout:6/370: write d8/dd/d18/d13/f5a [2232242,94783] 0 2024-05-06T21:26:40.682 INFO:tasks.workunit.client.0.smithi032.stdout:6/371: rename d8/dd/d18/d13/l2f to d8/dd/d18/d13/d1d/l6a 0 2024-05-06T21:26:40.683 INFO:tasks.workunit.client.0.smithi032.stdout:2/333: dread df/d19/d1e/d1f/d2e/d33/f18 [0,4194304] 0 2024-05-06T21:26:40.684 INFO:tasks.workunit.client.0.smithi032.stdout:6/372: mkdir d8/d3d/d49/d6b 0 2024-05-06T21:26:40.684 INFO:tasks.workunit.client.0.smithi032.stdout:6/373: fsync d8/dd/d18/d13/f28 0 2024-05-06T21:26:40.687 INFO:tasks.workunit.client.0.smithi032.stdout:9/378: dwrite d1/d13/d34/d26/f29 [0,4194304] 0 2024-05-06T21:26:40.687 INFO:tasks.workunit.client.0.smithi032.stdout:8/443: dwrite d0/f4a [0,4194304] 0 2024-05-06T21:26:40.687 INFO:tasks.workunit.client.0.smithi032.stdout:0/359: dread d4/da/f11 [0,4194304] 0 2024-05-06T21:26:40.687 INFO:tasks.workunit.client.0.smithi032.stdout:0/360: getdents d4/da/d16/d4f 0 2024-05-06T21:26:40.687 INFO:tasks.workunit.client.1.smithi154.stdout:8/86: fsync d3/fb 0 2024-05-06T21:26:40.689 INFO:tasks.workunit.client.0.smithi032.stdout:5/224: dread d0/d11/f25 [0,4194304] 0 2024-05-06T21:26:40.692 INFO:tasks.workunit.client.0.smithi032.stdout:8/444: mkdir d0/d1b/d39/d3b/d57/d5d/d63/d7f 0 2024-05-06T21:26:40.692 INFO:tasks.workunit.client.0.smithi032.stdout:3/413: rmdir d1/d2a 39 2024-05-06T21:26:40.692 INFO:tasks.workunit.client.0.smithi032.stdout:3/414: readlink d1/d4/da/d4e/l86 0 2024-05-06T21:26:40.692 INFO:tasks.workunit.client.0.smithi032.stdout:8/445: write d0/f33 [1012915,21239] 0 2024-05-06T21:26:40.692 INFO:tasks.workunit.client.0.smithi032.stdout:8/446: stat d0/f4 0 2024-05-06T21:26:40.694 INFO:tasks.workunit.client.0.smithi032.stdout:0/361: write d4/da/f17 [1466208,119858] 0 2024-05-06T21:26:40.694 INFO:tasks.workunit.client.0.smithi032.stdout:0/362: chown d4/da/d16/l62 6426 1 2024-05-06T21:26:40.695 INFO:tasks.workunit.client.0.smithi032.stdout:4/447: read d2/f18 [1449338,63733] 0 2024-05-06T21:26:40.697 INFO:tasks.workunit.client.0.smithi032.stdout:8/447: rmdir d0/d1c/d5e/d67 39 2024-05-06T21:26:40.697 INFO:tasks.workunit.client.0.smithi032.stdout:9/379: write d1/d13/d34/f32 [7522488,89071] 0 2024-05-06T21:26:40.697 INFO:tasks.workunit.client.0.smithi032.stdout:9/380: chown d1/d13/d34/d26/l3d 34 1 2024-05-06T21:26:40.697 INFO:tasks.workunit.client.0.smithi032.stdout:8/448: write d0/d1b/d39/f3a [170014,9953] 0 2024-05-06T21:26:40.698 INFO:tasks.workunit.client.0.smithi032.stdout:8/449: readlink d0/d1b/d39/l43 0 2024-05-06T21:26:40.698 INFO:tasks.workunit.client.0.smithi032.stdout:8/450: write d0/d1b/f23 [5163575,14447] 0 2024-05-06T21:26:40.698 INFO:tasks.workunit.client.0.smithi032.stdout:0/363: rename d4/da/d16/d33/f5b to d4/da/d14/d1a/d66/f70 0 2024-05-06T21:26:40.699 INFO:tasks.workunit.client.0.smithi032.stdout:0/364: dread - d4/da/d14/d1a/f4d zero size 2024-05-06T21:26:40.700 INFO:tasks.workunit.client.0.smithi032.stdout:4/448: dread d2/d13/f57 [0,4194304] 0 2024-05-06T21:26:40.704 INFO:tasks.workunit.client.0.smithi032.stdout:5/225: dread d0/f27 [0,4194304] 0 2024-05-06T21:26:40.708 INFO:tasks.workunit.client.0.smithi032.stdout:3/415: rmdir d1 39 2024-05-06T21:26:40.710 INFO:tasks.workunit.client.0.smithi032.stdout:2/334: dwrite df/d19/d1e/d54/d72/d65/f74 [0,4194304] 0 2024-05-06T21:26:40.711 INFO:tasks.workunit.client.0.smithi032.stdout:6/374: dwrite d8/dd/d18/d3b/f4c [0,4194304] 0 2024-05-06T21:26:40.711 INFO:tasks.workunit.client.0.smithi032.stdout:6/375: chown d8/d33/d3e/f4d 1 1 2024-05-06T21:26:40.712 INFO:tasks.workunit.client.0.smithi032.stdout:9/381: dread d1/f7 [4194304,4194304] 0 2024-05-06T21:26:40.712 INFO:tasks.workunit.client.0.smithi032.stdout:4/449: mknod d2/d1e/c98 0 2024-05-06T21:26:40.712 INFO:tasks.workunit.client.0.smithi032.stdout:0/365: creat d4/da/d14/f71 x:0 0 0 2024-05-06T21:26:40.712 INFO:tasks.workunit.client.0.smithi032.stdout:5/226: mkdir d0/d24/d26/d32 0 2024-05-06T21:26:40.713 INFO:tasks.workunit.client.0.smithi032.stdout:3/416: symlink d1/d4/da/d4e/d41/d43/d73/d75/d8b/l95 0 2024-05-06T21:26:40.716 INFO:tasks.workunit.client.0.smithi032.stdout:2/335: mknod df/d19/d1e/d54/d72/d65/c7b 0 2024-05-06T21:26:40.717 INFO:tasks.workunit.client.0.smithi032.stdout:6/376: symlink d8/dd/d1b/l6c 0 2024-05-06T21:26:40.722 INFO:tasks.workunit.client.0.smithi032.stdout:4/450: truncate d2/f24 3101062 0 2024-05-06T21:26:40.724 INFO:tasks.workunit.client.0.smithi032.stdout:5/227: creat d0/d28/f33 x:0 0 0 2024-05-06T21:26:40.732 INFO:tasks.workunit.client.0.smithi032.stdout:2/336: rename df/c39 to df/d19/d1e/d1f/d2e/d33/c7c 0 2024-05-06T21:26:40.734 INFO:tasks.workunit.client.0.smithi032.stdout:6/377: creat d8/dd/d18/d22/f6d x:0 0 0 2024-05-06T21:26:40.734 INFO:tasks.workunit.client.0.smithi032.stdout:6/378: chown d8/d3d/d49/f60 129291 1 2024-05-06T21:26:40.734 INFO:tasks.workunit.client.0.smithi032.stdout:6/379: chown d8/dd/d18/f19 305329494 1 2024-05-06T21:26:40.734 INFO:tasks.workunit.client.0.smithi032.stdout:6/380: write d8/dd/d18/d13/f5a [293135,34357] 0 2024-05-06T21:26:40.734 INFO:tasks.workunit.client.0.smithi032.stdout:6/381: chown d8/c41 485286 1 2024-05-06T21:26:40.734 INFO:tasks.workunit.client.0.smithi032.stdout:8/451: dwrite d0/d1b/f23 [0,4194304] 0 2024-05-06T21:26:40.735 INFO:tasks.workunit.client.0.smithi032.stdout:9/382: dwrite d1/d2f/f37 [0,4194304] 0 2024-05-06T21:26:40.735 INFO:tasks.workunit.client.0.smithi032.stdout:0/366: rmdir d4/d3e/d42 39 2024-05-06T21:26:40.736 INFO:tasks.workunit.client.0.smithi032.stdout:4/451: getdents d2/d1e 0 2024-05-06T21:26:40.737 INFO:tasks.workunit.client.0.smithi032.stdout:3/417: unlink d1/d4/da/c15 0 2024-05-06T21:26:40.737 INFO:tasks.workunit.client.0.smithi032.stdout:3/418: readlink d1/d4/da/d4e/l28 0 2024-05-06T21:26:40.737 INFO:tasks.workunit.client.0.smithi032.stdout:3/419: write d1/d4/da/d31/f48 [107151,109722] 0 2024-05-06T21:26:40.738 INFO:tasks.workunit.client.0.smithi032.stdout:2/337: rename df/d19/d1e/d54/d72 to df/d19/d1e/d71/d5f/d7d 0 2024-05-06T21:26:40.739 INFO:tasks.workunit.client.0.smithi032.stdout:6/382: truncate d8/d3d/f4e 2595063 0 2024-05-06T21:26:40.739 INFO:tasks.workunit.client.0.smithi032.stdout:6/383: chown d8/f10 986264 1 2024-05-06T21:26:40.739 INFO:tasks.workunit.client.0.smithi032.stdout:6/384: stat d8/dd/d18/lf 0 2024-05-06T21:26:40.743 INFO:tasks.workunit.client.0.smithi032.stdout:9/383: symlink d1/d13/d33/d3f/l76 0 2024-05-06T21:26:40.743 INFO:tasks.workunit.client.0.smithi032.stdout:0/367: read d4/da/d16/f3b [206005,15189] 0 2024-05-06T21:26:40.745 INFO:tasks.workunit.client.0.smithi032.stdout:5/228: truncate d0/fa 2512271 0 2024-05-06T21:26:40.745 INFO:tasks.workunit.client.0.smithi032.stdout:5/229: write d0/f12 [1211116,117141] 0 2024-05-06T21:26:40.747 INFO:tasks.workunit.client.0.smithi032.stdout:3/420: truncate d1/d4/da/d31/f87 266742 0 2024-05-06T21:26:40.752 INFO:tasks.workunit.client.0.smithi032.stdout:8/452: rename d0/d1b/d39/l3d to d0/d1b/d39/d3b/d57/l80 0 2024-05-06T21:26:40.752 INFO:tasks.workunit.client.0.smithi032.stdout:9/384: mknod d1/d13/d34/d26/c77 0 2024-05-06T21:26:40.752 INFO:tasks.workunit.client.0.smithi032.stdout:9/385: chown d1/l6 61511 1 2024-05-06T21:26:40.753 INFO:tasks.workunit.client.0.smithi032.stdout:5/230: mkdir d0/d24/d34 0 2024-05-06T21:26:40.756 INFO:tasks.workunit.client.0.smithi032.stdout:9/386: write d1/d13/d34/f48 [2258499,35643] 0 2024-05-06T21:26:40.756 INFO:tasks.workunit.client.0.smithi032.stdout:9/387: chown d1/d13 24897321 1 2024-05-06T21:26:40.756 INFO:tasks.workunit.client.0.smithi032.stdout:2/338: getdents df/d19/d1e/d1f 0 2024-05-06T21:26:40.757 INFO:tasks.workunit.client.0.smithi032.stdout:4/452: dwrite d2/d13/f57 [0,4194304] 0 2024-05-06T21:26:40.760 INFO:tasks.workunit.client.0.smithi032.stdout:8/453: creat d0/d1b/d39/f81 x:0 0 0 2024-05-06T21:26:40.763 INFO:tasks.workunit.client.0.smithi032.stdout:2/339: creat df/d19/d1e/d1f/d2e/f7e x:0 0 0 2024-05-06T21:26:40.763 INFO:tasks.workunit.client.0.smithi032.stdout:2/340: write df/d19/d1e/d1f/f2b [896207,10152] 0 2024-05-06T21:26:40.766 INFO:tasks.workunit.client.0.smithi032.stdout:4/453: mknod d2/d2c/c99 0 2024-05-06T21:26:40.766 INFO:tasks.workunit.client.0.smithi032.stdout:4/454: chown d2/d16/d44/d54/d69/c72 1659 1 2024-05-06T21:26:40.768 INFO:tasks.workunit.client.0.smithi032.stdout:8/454: rename d0/d1b/c6f to d0/d1b/c82 0 2024-05-06T21:26:40.768 INFO:tasks.workunit.client.0.smithi032.stdout:8/455: creat d0/d1b/d47/f83 x:0 0 0 2024-05-06T21:26:40.770 INFO:tasks.workunit.client.0.smithi032.stdout:2/341: rename df/d19/d1e/d35/d3f/d46/f75 to df/d19/d1e/d71/d5f/d7d/f7f 0 2024-05-06T21:26:40.770 INFO:tasks.workunit.client.0.smithi032.stdout:2/342: readlink df/d19/d1e/d42/l69 0 2024-05-06T21:26:40.772 INFO:tasks.workunit.client.0.smithi032.stdout:4/455: mknod d2/d2c/c9a 0 2024-05-06T21:26:40.773 INFO:tasks.workunit.client.0.smithi032.stdout:8/456: truncate d0/d1b/f3e 186907 0 2024-05-06T21:26:40.776 INFO:tasks.workunit.client.0.smithi032.stdout:6/385: dwrite d8/dd/d18/d13/f28 [0,4194304] 0 2024-05-06T21:26:40.776 INFO:tasks.workunit.client.0.smithi032.stdout:6/386: readlink d8/dd/l1c 0 2024-05-06T21:26:40.776 INFO:tasks.workunit.client.0.smithi032.stdout:8/457: rename d0/d1b/d39/d3b/l59 to d0/d1b/d39/d3b/d57/d5d/l84 0 2024-05-06T21:26:40.776 INFO:tasks.workunit.client.0.smithi032.stdout:3/421: dwrite d1/d4/f3e [0,4194304] 0 2024-05-06T21:26:40.780 INFO:tasks.workunit.client.0.smithi032.stdout:5/231: dwrite d0/d11/f30 [0,4194304] 0 2024-05-06T21:26:40.782 INFO:tasks.workunit.client.0.smithi032.stdout:6/387: mknod d8/d33/d63/c6e 0 2024-05-06T21:26:40.783 INFO:tasks.workunit.client.0.smithi032.stdout:6/388: chown d8/dd/d1b/d35/f44 2 1 2024-05-06T21:26:40.784 INFO:tasks.workunit.client.0.smithi032.stdout:8/458: mkdir d0/d1b/d39/d3b/d57/d5d/d63/d85 0 2024-05-06T21:26:40.788 INFO:tasks.workunit.client.0.smithi032.stdout:3/422: unlink d1/d4/da/d4e/d41/c59 0 2024-05-06T21:26:40.790 INFO:tasks.workunit.client.0.smithi032.stdout:4/456: dwrite d2/d16/d44/d45/f6d [0,4194304] 0 2024-05-06T21:26:40.790 INFO:tasks.workunit.client.0.smithi032.stdout:4/457: write d2/d16/f94 [795048,24185] 0 2024-05-06T21:26:40.792 INFO:tasks.workunit.client.0.smithi032.stdout:6/389: creat d8/d3d/d49/d6b/f6f x:0 0 0 2024-05-06T21:26:40.792 INFO:tasks.workunit.client.0.smithi032.stdout:6/390: chown d8/dd/l1c 575690532 1 2024-05-06T21:26:40.794 INFO:tasks.workunit.client.0.smithi032.stdout:8/459: creat d0/d1c/d5e/d67/d7b/f86 x:0 0 0 2024-05-06T21:26:40.795 INFO:tasks.workunit.client.0.smithi032.stdout:2/343: rmdir df/d19/d1e/d35/d3f/d46 39 2024-05-06T21:26:40.796 INFO:tasks.workunit.client.0.smithi032.stdout:3/423: dread d1/d4/da/d1d/f42 [0,4194304] 0 2024-05-06T21:26:40.796 INFO:tasks.workunit.client.0.smithi032.stdout:3/424: chown d1/f6 261386 1 2024-05-06T21:26:40.798 INFO:tasks.workunit.client.0.smithi032.stdout:4/458: rmdir d2/d1e 39 2024-05-06T21:26:40.799 INFO:tasks.workunit.client.0.smithi032.stdout:4/459: readlink d2/d16/d44/d45/l5b 0 2024-05-06T21:26:40.799 INFO:tasks.workunit.client.0.smithi032.stdout:4/460: chown d2/d13/c4b 0 1 2024-05-06T21:26:40.800 INFO:tasks.workunit.client.0.smithi032.stdout:5/232: mknod d0/c35 0 2024-05-06T21:26:40.800 INFO:tasks.workunit.client.0.smithi032.stdout:5/233: write d0/d28/f2e [477343,8588] 0 2024-05-06T21:26:40.801 INFO:tasks.workunit.client.0.smithi032.stdout:3/425: rmdir d1/d4/da/d4e/d41/d43/d44/d67 39 2024-05-06T21:26:40.801 INFO:tasks.workunit.client.0.smithi032.stdout:3/426: chown d1/d4/da/d4e/d41/d43/d73 33419416 1 2024-05-06T21:26:40.806 INFO:tasks.workunit.client.0.smithi032.stdout:5/234: rmdir d0/d11 39 2024-05-06T21:26:40.809 INFO:tasks.workunit.client.0.smithi032.stdout:5/235: unlink d0/d28/f2e 0 2024-05-06T21:26:40.809 INFO:tasks.workunit.client.0.smithi032.stdout:9/388: dwrite d1/d13/d34/f48 [0,4194304] 0 2024-05-06T21:26:40.809 INFO:tasks.workunit.client.0.smithi032.stdout:9/389: readlink d1/d13/l6e 0 2024-05-06T21:26:40.811 INFO:tasks.workunit.client.0.smithi032.stdout:8/460: read d0/f4a [1743422,49664] 0 2024-05-06T21:26:40.811 INFO:tasks.workunit.client.0.smithi032.stdout:8/461: creat d0/d1b/d47/f87 x:0 0 0 2024-05-06T21:26:40.811 INFO:tasks.workunit.client.0.smithi032.stdout:8/462: chown d0/d1c/d5e/d67 0 1 2024-05-06T21:26:40.811 INFO:tasks.workunit.client.0.smithi032.stdout:8/463: creat d0/d1c/f88 x:0 0 0 2024-05-06T21:26:40.811 INFO:tasks.workunit.client.0.smithi032.stdout:5/236: link d0/fe d0/d11/f36 0 2024-05-06T21:26:40.811 INFO:tasks.workunit.client.0.smithi032.stdout:5/237: readlink d0/d28/l2d 0 2024-05-06T21:26:40.811 INFO:tasks.workunit.client.0.smithi032.stdout:5/238: chown d0/d16/d2f 0 1 2024-05-06T21:26:40.813 INFO:tasks.workunit.client.0.smithi032.stdout:6/391: dwrite d8/f10 [0,4194304] 0 2024-05-06T21:26:40.814 INFO:tasks.workunit.client.0.smithi032.stdout:9/390: mkdir d1/d13/d33/d5e/d78 0 2024-05-06T21:26:40.817 INFO:tasks.workunit.client.0.smithi032.stdout:5/239: mkdir d0/d11/d37 0 2024-05-06T21:26:40.818 INFO:tasks.workunit.client.0.smithi032.stdout:3/427: write d1/d4/f52 [7233711,57265] 0 2024-05-06T21:26:40.819 INFO:tasks.workunit.client.0.smithi032.stdout:6/392: mknod d8/d33/d63/c70 0 2024-05-06T21:26:40.821 INFO:tasks.workunit.client.0.smithi032.stdout:8/464: dread d0/d1b/d39/d3b/f62 [0,4194304] 0 2024-05-06T21:26:40.823 INFO:tasks.workunit.client.0.smithi032.stdout:8/465: getdents d0/d1b/d39/d3b 0 2024-05-06T21:26:40.823 INFO:tasks.workunit.client.0.smithi032.stdout:8/466: read - d0/d1c/f88 zero size 2024-05-06T21:26:40.824 INFO:tasks.workunit.client.0.smithi032.stdout:8/467: mknod d0/d1c/c89 0 2024-05-06T21:26:40.825 INFO:tasks.workunit.client.0.smithi032.stdout:8/468: truncate d0/d1c/d5e/f7a 567305 0 2024-05-06T21:26:40.825 INFO:tasks.workunit.client.0.smithi032.stdout:8/469: write d0/d1b/d39/d3b/f5b [138461,107141] 0 2024-05-06T21:26:40.825 INFO:tasks.workunit.client.0.smithi032.stdout:8/470: write d0/d1b/f5f [1522892,81938] 0 2024-05-06T21:26:40.826 INFO:tasks.workunit.client.0.smithi032.stdout:8/471: link d0/d1b/c82 d0/c8a 0 2024-05-06T21:26:40.829 INFO:tasks.workunit.client.0.smithi032.stdout:8/472: mknod d0/d1b/d39/d3b/d57/d5d/c8b 0 2024-05-06T21:26:40.829 INFO:tasks.workunit.client.0.smithi032.stdout:8/473: truncate d0/d1b/f31 590934 0 2024-05-06T21:26:40.831 INFO:tasks.workunit.client.0.smithi032.stdout:8/474: rmdir d0/d1b/d76 0 2024-05-06T21:26:40.832 INFO:tasks.workunit.client.0.smithi032.stdout:8/475: dread d0/d1b/f3e [0,4194304] 0 2024-05-06T21:26:40.832 INFO:tasks.workunit.client.0.smithi032.stdout:8/476: chown d0/d1b/f23 0 1 2024-05-06T21:26:40.834 INFO:tasks.workunit.client.0.smithi032.stdout:6/393: write d8/dd/d1b/d35/f3a [4115558,110417] 0 2024-05-06T21:26:40.834 INFO:tasks.workunit.client.0.smithi032.stdout:6/394: fdatasync d8/dd/d18/d13/f2a 0 2024-05-06T21:26:40.834 INFO:tasks.workunit.client.0.smithi032.stdout:5/240: rename d0/d11 to d0/d24/d38 0 2024-05-06T21:26:40.836 INFO:tasks.workunit.client.0.smithi032.stdout:5/241: mknod d0/d24/d26/c39 0 2024-05-06T21:26:40.836 INFO:tasks.workunit.client.0.smithi032.stdout:3/428: write d1/d4/d11/f36 [5640900,85033] 0 2024-05-06T21:26:40.836 INFO:tasks.workunit.client.0.smithi032.stdout:9/391: dwrite d1/d13/f16 [4194304,4194304] 0 2024-05-06T21:26:40.839 INFO:tasks.workunit.client.0.smithi032.stdout:3/429: mknod d1/d2a/d71/d8f/c96 0 2024-05-06T21:26:40.841 INFO:tasks.workunit.client.0.smithi032.stdout:8/477: dread d0/f41 [4194304,4194304] 0 2024-05-06T21:26:40.842 INFO:tasks.workunit.client.0.smithi032.stdout:3/430: rename d1/d4/da/d4e/d41/d43/d44 to d1/d4/da/d4e/d41/d97 0 2024-05-06T21:26:40.842 INFO:tasks.workunit.client.0.smithi032.stdout:6/395: write f4 [1806287,39945] 0 2024-05-06T21:26:40.844 INFO:tasks.workunit.client.0.smithi032.stdout:8/478: link d0/f53 d0/d1b/d39/d3b/d57/d5d/d63/d85/f8c 0 2024-05-06T21:26:40.844 INFO:tasks.workunit.client.0.smithi032.stdout:8/479: write d0/d1b/d47/f87 [265377,51596] 0 2024-05-06T21:26:40.844 INFO:tasks.workunit.client.0.smithi032.stdout:9/392: dread d1/d2f/f37 [0,4194304] 0 2024-05-06T21:26:40.847 INFO:tasks.workunit.client.0.smithi032.stdout:3/431: mknod d1/d4/da/d4e/d41/d43/d73/d75/d8b/c98 0 2024-05-06T21:26:40.847 INFO:tasks.workunit.client.0.smithi032.stdout:5/242: write d0/d24/d38/f30 [2111086,6967] 0 2024-05-06T21:26:40.847 INFO:tasks.workunit.client.0.smithi032.stdout:6/396: creat d8/dd/d18/d13/f71 x:0 0 0 2024-05-06T21:26:40.847 INFO:tasks.workunit.client.0.smithi032.stdout:6/397: fsync d8/d33/d63/f65 0 2024-05-06T21:26:40.847 INFO:tasks.workunit.client.0.smithi032.stdout:6/398: creat d8/d33/f72 x:0 0 0 2024-05-06T21:26:40.848 INFO:tasks.workunit.client.0.smithi032.stdout:9/393: rename d1/d13/l67 to d1/d13/d33/l79 0 2024-05-06T21:26:40.850 INFO:tasks.workunit.client.0.smithi032.stdout:3/432: creat d1/d2a/d71/d8f/f99 x:0 0 0 2024-05-06T21:26:40.851 INFO:tasks.workunit.client.0.smithi032.stdout:5/243: creat d0/d16/d2f/f3a x:0 0 0 2024-05-06T21:26:40.854 INFO:tasks.workunit.client.0.smithi032.stdout:6/399: mkdir d8/d3d/d73 0 2024-05-06T21:26:40.856 INFO:tasks.workunit.client.0.smithi032.stdout:3/433: rename d1/f6 to d1/d4/da/d31/d47/d4a/d68/d7c/f9a 0 2024-05-06T21:26:40.857 INFO:tasks.workunit.client.0.smithi032.stdout:5/244: symlink d0/d24/d34/l3b 0 2024-05-06T21:26:40.857 INFO:tasks.workunit.client.0.smithi032.stdout:5/245: readlink d0/ld 0 2024-05-06T21:26:40.858 INFO:tasks.workunit.client.0.smithi032.stdout:6/400: unlink d8/dd/d18/f23 0 2024-05-06T21:26:40.859 INFO:tasks.workunit.client.0.smithi032.stdout:5/246: creat d0/d24/d38/f3c x:0 0 0 2024-05-06T21:26:40.859 INFO:tasks.workunit.client.0.smithi032.stdout:5/247: truncate d0/fb 571629 0 2024-05-06T21:26:40.859 INFO:tasks.workunit.client.0.smithi032.stdout:5/248: write d0/d24/d38/f36 [2128492,26434] 0 2024-05-06T21:26:40.859 INFO:tasks.workunit.client.0.smithi032.stdout:6/401: mkdir d8/d3d/d49/d74 0 2024-05-06T21:26:40.864 INFO:tasks.workunit.client.0.smithi032.stdout:6/402: dread d8/dd/d18/f19 [4194304,4194304] 0 2024-05-06T21:26:40.864 INFO:tasks.workunit.client.0.smithi032.stdout:5/249: dread d0/d16/f1e [0,4194304] 0 2024-05-06T21:26:40.864 INFO:tasks.workunit.client.0.smithi032.stdout:5/250: chown d0/d24/d38/f3c 9191 1 2024-05-06T21:26:40.865 INFO:tasks.workunit.client.0.smithi032.stdout:6/403: symlink d8/dd/l75 0 2024-05-06T21:26:40.866 INFO:tasks.workunit.client.0.smithi032.stdout:5/251: mkdir d0/d24/d26/d3d 0 2024-05-06T21:26:40.867 INFO:tasks.workunit.client.0.smithi032.stdout:6/404: creat d8/d3d/d49/f76 x:0 0 0 2024-05-06T21:26:40.867 INFO:tasks.workunit.client.0.smithi032.stdout:6/405: write d8/d33/d63/f65 [2260115,26327] 0 2024-05-06T21:26:40.868 INFO:tasks.workunit.client.0.smithi032.stdout:6/406: creat d8/d33/f77 x:0 0 0 2024-05-06T21:26:40.868 INFO:tasks.workunit.client.0.smithi032.stdout:6/407: chown d8/f17 2769637 1 2024-05-06T21:26:40.869 INFO:tasks.workunit.client.0.smithi032.stdout:5/252: dread d0/d16/f1e [0,4194304] 0 2024-05-06T21:26:40.869 INFO:tasks.workunit.client.0.smithi032.stdout:9/394: dwrite d1/d2f/d4f/f56 [0,4194304] 0 2024-05-06T21:26:40.870 INFO:tasks.workunit.client.0.smithi032.stdout:6/408: rmdir d8/dd/d18/d22 39 2024-05-06T21:26:40.870 INFO:tasks.workunit.client.0.smithi032.stdout:3/434: read d1/f58 [1095682,28921] 0 2024-05-06T21:26:40.870 INFO:tasks.workunit.client.0.smithi032.stdout:3/435: truncate d1/d2a/d71/d8f/f92 690793 0 2024-05-06T21:26:40.870 INFO:tasks.workunit.client.0.smithi032.stdout:8/480: dwrite d0/f1f [0,4194304] 0 2024-05-06T21:26:40.870 INFO:tasks.workunit.client.0.smithi032.stdout:8/481: fdatasync d0/f19 0 2024-05-06T21:26:40.871 INFO:tasks.workunit.client.0.smithi032.stdout:3/436: dread d1/d2a/d71/d8f/f92 [0,4194304] 0 2024-05-06T21:26:40.872 INFO:tasks.workunit.client.0.smithi032.stdout:9/395: write d1/f31 [1439022,25586] 0 2024-05-06T21:26:40.875 INFO:tasks.workunit.client.0.smithi032.stdout:6/409: link d8/dd/d18/d13/f24 d8/d3d/d49/d74/f78 0 2024-05-06T21:26:40.875 INFO:tasks.workunit.client.0.smithi032.stdout:6/410: chown d8/f31 14262 1 2024-05-06T21:26:40.875 INFO:tasks.workunit.client.0.smithi032.stdout:6/411: dread - d8/dd/d18/f69 zero size 2024-05-06T21:26:40.875 INFO:tasks.workunit.client.0.smithi032.stdout:6/412: write d8/d33/f72 [76903,9047] 0 2024-05-06T21:26:40.878 INFO:tasks.workunit.client.0.smithi032.stdout:8/482: unlink d0/d1b/d39/d3b/d57/l80 0 2024-05-06T21:26:40.902 INFO:tasks.workunit.client.0.smithi032.stdout:5/253: dwrite d0/fa [0,4194304] 0 2024-05-06T21:26:40.902 INFO:tasks.workunit.client.0.smithi032.stdout:5/254: fdatasync d0/fe 0 2024-05-06T21:26:40.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/255: rename d0/d24/d38/c15 to d0/d16/d2a/c3e 0 2024-05-06T21:26:40.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/256: read d0/d24/d38/f30 [357009,9729] 0 2024-05-06T21:26:40.904 INFO:tasks.workunit.client.0.smithi032.stdout:5/257: rename d0/d24/d38/c22 to d0/d24/d26/d32/c3f 0 2024-05-06T21:26:40.904 INFO:tasks.workunit.client.0.smithi032.stdout:3/437: dwrite d1/d4/da/d31/d47/d4a/d68/d7c/f90 [0,4194304] 0 2024-05-06T21:26:40.906 INFO:tasks.workunit.client.0.smithi032.stdout:6/413: dwrite d8/dd/d18/d13/f2a [0,4194304] 0 2024-05-06T21:26:40.906 INFO:tasks.workunit.client.0.smithi032.stdout:3/438: mkdir d1/d4/da/d31/d9b 0 2024-05-06T21:26:40.907 INFO:tasks.workunit.client.0.smithi032.stdout:3/439: readlink d1/d4/da/d1d/l51 0 2024-05-06T21:26:40.907 INFO:tasks.workunit.client.0.smithi032.stdout:8/483: dwrite d0/d1b/f3e [0,4194304] 0 2024-05-06T21:26:40.907 INFO:tasks.workunit.client.0.smithi032.stdout:8/484: write d0/d1c/f42 [5163056,96829] 0 2024-05-06T21:26:40.907 INFO:tasks.workunit.client.0.smithi032.stdout:8/485: dread - d0/d1c/d5e/d67/d7b/f86 zero size 2024-05-06T21:26:40.909 INFO:tasks.workunit.client.0.smithi032.stdout:6/414: mknod d8/d33/d3e/c79 0 2024-05-06T21:26:40.909 INFO:tasks.workunit.client.0.smithi032.stdout:6/415: stat d8/dd/d18/d3b 0 2024-05-06T21:26:40.909 INFO:tasks.workunit.client.0.smithi032.stdout:6/416: chown d8/d33/d3e/c42 941 1 2024-05-06T21:26:40.909 INFO:tasks.workunit.client.0.smithi032.stdout:3/440: mknod d1/d4/da/d4e/d5e/d84/c9c 0 2024-05-06T21:26:40.909 INFO:tasks.workunit.client.0.smithi032.stdout:3/441: fdatasync d1/d4/f3e 0 2024-05-06T21:26:40.912 INFO:tasks.workunit.client.0.smithi032.stdout:6/417: unlink f4 0 2024-05-06T21:26:40.913 INFO:tasks.workunit.client.0.smithi032.stdout:3/442: mkdir d1/d2a/d71/d9d 0 2024-05-06T21:26:40.920 INFO:tasks.workunit.client.0.smithi032.stdout:5/258: dwrite d0/f27 [0,4194304] 0 2024-05-06T21:26:40.920 INFO:tasks.workunit.client.0.smithi032.stdout:6/418: write d8/f17 [9287688,34705] 0 2024-05-06T21:26:40.921 INFO:tasks.workunit.client.0.smithi032.stdout:5/259: mknod d0/d24/d38/d37/c40 0 2024-05-06T21:26:40.922 INFO:tasks.workunit.client.0.smithi032.stdout:8/486: dread d0/f37 [0,4194304] 0 2024-05-06T21:26:40.922 INFO:tasks.workunit.client.0.smithi032.stdout:8/487: fsync d0/d1b/f70 0 2024-05-06T21:26:40.922 INFO:tasks.workunit.client.0.smithi032.stdout:8/488: write d0/d1b/d39/d3b/d57/f79 [560870,35616] 0 2024-05-06T21:26:40.923 INFO:tasks.workunit.client.0.smithi032.stdout:6/419: mkdir d8/dd/d18/d13/d7a 0 2024-05-06T21:26:40.923 INFO:tasks.workunit.client.0.smithi032.stdout:6/420: write d8/dd/d18/d3b/f56 [611871,101830] 0 2024-05-06T21:26:40.923 INFO:tasks.workunit.client.0.smithi032.stdout:8/489: creat d0/d1c/d5e/d67/f8d x:0 0 0 2024-05-06T21:26:40.925 INFO:tasks.workunit.client.0.smithi032.stdout:6/421: creat d8/dd/d18/d22/f7b x:0 0 0 2024-05-06T21:26:40.927 INFO:tasks.workunit.client.0.smithi032.stdout:8/490: creat d0/d1b/d39/d3b/d57/d5d/d63/f8e x:0 0 0 2024-05-06T21:26:40.927 INFO:tasks.workunit.client.0.smithi032.stdout:8/491: write d0/f1a [4502226,5858] 0 2024-05-06T21:26:40.929 INFO:tasks.workunit.client.0.smithi032.stdout:6/422: unlink d8/d3d/l46 0 2024-05-06T21:26:40.929 INFO:tasks.workunit.client.0.smithi032.stdout:6/423: fdatasync d8/dd/d18/d13/f28 0 2024-05-06T21:26:40.930 INFO:tasks.workunit.client.0.smithi032.stdout:8/492: creat d0/d1b/d39/d3b/d57/d5d/d63/d7f/f8f x:0 0 0 2024-05-06T21:26:40.931 INFO:tasks.workunit.client.0.smithi032.stdout:8/493: creat d0/d1b/d39/d3b/d57/d5d/f90 x:0 0 0 2024-05-06T21:26:40.932 INFO:tasks.workunit.client.0.smithi032.stdout:8/494: truncate d0/d1b/d47/f87 1167593 0 2024-05-06T21:26:40.932 INFO:tasks.workunit.client.0.smithi032.stdout:8/495: truncate d0/d1c/d5e/d67/d7b/f86 82409 0 2024-05-06T21:26:40.932 INFO:tasks.workunit.client.0.smithi032.stdout:8/496: mkdir d0/d1b/d47/d91 0 2024-05-06T21:26:40.933 INFO:tasks.workunit.client.0.smithi032.stdout:8/497: mknod d0/c92 0 2024-05-06T21:26:40.938 INFO:tasks.workunit.client.0.smithi032.stdout:3/443: dwrite d1/d4/da/d31/d47/d4a/d68/d7c/f9a [4194304,4194304] 0 2024-05-06T21:26:40.940 INFO:tasks.workunit.client.0.smithi032.stdout:3/444: creat d1/d4/da/d31/d9b/f9e x:0 0 0 2024-05-06T21:26:40.940 INFO:tasks.workunit.client.0.smithi032.stdout:3/445: dread - d1/d4/da/d4e/d5e/f6d zero size 2024-05-06T21:26:40.944 INFO:tasks.workunit.client.0.smithi032.stdout:5/260: dwrite d0/f27 [4194304,4194304] 0 2024-05-06T21:26:40.945 INFO:tasks.workunit.client.0.smithi032.stdout:5/261: creat d0/d16/d2f/f41 x:0 0 0 2024-05-06T21:26:40.945 INFO:tasks.workunit.client.0.smithi032.stdout:6/424: dwrite d8/dd/d18/d13/f2c [0,4194304] 0 2024-05-06T21:26:40.948 INFO:tasks.workunit.client.0.smithi032.stdout:6/425: symlink d8/d3d/d49/l7c 0 2024-05-06T21:26:40.949 INFO:tasks.workunit.client.0.smithi032.stdout:3/446: dread d1/d4/f2e [0,4194304] 0 2024-05-06T21:26:40.949 INFO:tasks.workunit.client.0.smithi032.stdout:6/426: creat d8/dd/d18/d13/d7a/f7d x:0 0 0 2024-05-06T21:26:40.952 INFO:tasks.workunit.client.0.smithi032.stdout:3/447: rename d1/d4/da/d4e/d41/d43/d73 to d1/d4/da/d9f 0 2024-05-06T21:26:40.953 INFO:tasks.workunit.client.0.smithi032.stdout:6/427: dread d8/d33/f72 [0,4194304] 0 2024-05-06T21:26:40.953 INFO:tasks.workunit.client.0.smithi032.stdout:6/428: chown d8/d3d/d49/f76 74 1 2024-05-06T21:26:40.953 INFO:tasks.workunit.client.0.smithi032.stdout:6/429: chown d8/l5f 1702647 1 2024-05-06T21:26:40.955 INFO:tasks.workunit.client.0.smithi032.stdout:6/430: rename d8/dd/d18/d13/d1d/l6a to d8/d33/l7e 0 2024-05-06T21:26:40.955 INFO:tasks.workunit.client.0.smithi032.stdout:6/431: stat d8/dd/d1b/d35/f37 0 2024-05-06T21:26:40.964 INFO:tasks.workunit.client.0.smithi032.stdout:5/262: dwrite d0/d28/f33 [0,4194304] 0 2024-05-06T21:26:40.969 INFO:tasks.workunit.client.0.smithi032.stdout:3/448: dread d1/d4/d11/f4f [0,4194304] 0 2024-05-06T21:26:40.970 INFO:tasks.workunit.client.0.smithi032.stdout:5/263: creat d0/d24/d26/d32/f42 x:0 0 0 2024-05-06T21:26:40.970 INFO:tasks.workunit.client.0.smithi032.stdout:5/264: creat d0/d16/d2f/f43 x:0 0 0 2024-05-06T21:26:40.970 INFO:tasks.workunit.client.0.smithi032.stdout:5/265: chown d0/d16/f1e 13541 1 2024-05-06T21:26:40.972 INFO:tasks.workunit.client.0.smithi032.stdout:6/432: unlink d8/dd/d18/d3b/f4c 0 2024-05-06T21:26:40.972 INFO:tasks.workunit.client.0.smithi032.stdout:6/433: truncate d8/dd/d18/d22/f6d 938431 0 2024-05-06T21:26:40.972 INFO:tasks.workunit.client.0.smithi032.stdout:6/434: fsync d8/dd/d18/d13/f5a 0 2024-05-06T21:26:40.972 INFO:tasks.workunit.client.0.smithi032.stdout:5/266: dread d0/fb [0,4194304] 0 2024-05-06T21:26:40.973 INFO:tasks.workunit.client.0.smithi032.stdout:3/449: creat d1/d4/da/d9f/d75/fa0 x:0 0 0 2024-05-06T21:26:40.976 INFO:tasks.workunit.client.0.smithi032.stdout:6/435: rename d8/dd/d1b/d35/f37 to d8/d3d/d49/d74/f7f 0 2024-05-06T21:26:40.979 INFO:tasks.workunit.client.0.smithi032.stdout:6/436: link d8/d3d/d49/l7c d8/d33/l80 0 2024-05-06T21:26:40.979 INFO:tasks.workunit.client.0.smithi032.stdout:6/437: dread - d8/dd/d1b/d35/f43 zero size 2024-05-06T21:26:40.979 INFO:tasks.workunit.client.0.smithi032.stdout:6/438: chown d8/d33/d63/c70 1911396 1 2024-05-06T21:26:40.979 INFO:tasks.workunit.client.0.smithi032.stdout:5/267: rmdir d0/d28 39 2024-05-06T21:26:40.981 INFO:tasks.workunit.client.0.smithi032.stdout:6/439: symlink d8/d3d/d73/l81 0 2024-05-06T21:26:40.981 INFO:tasks.workunit.client.0.smithi032.stdout:6/440: readlink d8/l45 0 2024-05-06T21:26:40.983 INFO:tasks.workunit.client.0.smithi032.stdout:5/268: rename d0/d24/d26/d32/c3f to d0/d24/d26/c44 0 2024-05-06T21:26:40.984 INFO:tasks.workunit.client.0.smithi032.stdout:3/450: dwrite d1/d4/d11/f4f [4194304,4194304] 0 2024-05-06T21:26:40.984 INFO:tasks.workunit.client.0.smithi032.stdout:6/441: mknod d8/dd/d18/c82 0 2024-05-06T21:26:40.985 INFO:tasks.workunit.client.0.smithi032.stdout:5/269: creat d0/d24/d34/f45 x:0 0 0 2024-05-06T21:26:40.986 INFO:tasks.workunit.client.0.smithi032.stdout:5/270: fsync d0/fa 0 2024-05-06T21:26:40.987 INFO:tasks.workunit.client.0.smithi032.stdout:3/451: write d1/d4/da/f2f [3342809,85139] 0 2024-05-06T21:26:40.989 INFO:tasks.workunit.client.0.smithi032.stdout:3/452: fsync d1/d2a/f37 0 2024-05-06T21:26:40.991 INFO:tasks.workunit.client.0.smithi032.stdout:6/442: getdents d8/dd/d18/d13/d7a 0 2024-05-06T21:26:40.991 INFO:tasks.workunit.client.0.smithi032.stdout:6/443: fsync d8/d3d/d49/f60 0 2024-05-06T21:26:40.991 INFO:tasks.workunit.client.0.smithi032.stdout:6/444: write d8/d33/f77 [65890,117768] 0 2024-05-06T21:26:40.993 INFO:tasks.workunit.client.0.smithi032.stdout:3/453: creat d1/d4/da/d9f/fa1 x:0 0 0 2024-05-06T21:26:40.993 INFO:tasks.workunit.client.0.smithi032.stdout:5/271: dread d0/fe [0,4194304] 0 2024-05-06T21:26:40.993 INFO:tasks.workunit.client.0.smithi032.stdout:6/445: creat d8/d33/d63/f83 x:0 0 0 2024-05-06T21:26:40.994 INFO:tasks.workunit.client.0.smithi032.stdout:3/454: fsync d1/d2a/f8d 0 2024-05-06T21:26:40.994 INFO:tasks.workunit.client.0.smithi032.stdout:3/455: dread - d1/d4/da/d9f/d75/fa0 zero size 2024-05-06T21:26:40.994 INFO:tasks.workunit.client.0.smithi032.stdout:3/456: chown d1/d4/da/d31/d9b/f9e 115 1 2024-05-06T21:26:40.994 INFO:tasks.workunit.client.0.smithi032.stdout:3/457: chown d1/d4/da/d31/d47 1687849 1 2024-05-06T21:26:40.994 INFO:tasks.workunit.client.0.smithi032.stdout:3/458: readlink d1/d4/d11/l3c 0 2024-05-06T21:26:40.995 INFO:tasks.workunit.client.0.smithi032.stdout:3/459: dread d1/d4/da/d1d/f42 [0,4194304] 0 2024-05-06T21:26:40.995 INFO:tasks.workunit.client.0.smithi032.stdout:5/272: mkdir d0/d16/d46 0 2024-05-06T21:26:40.996 INFO:tasks.workunit.client.0.smithi032.stdout:6/446: unlink d8/dd/l54 0 2024-05-06T21:26:40.997 INFO:tasks.workunit.client.0.smithi032.stdout:5/273: mknod d0/d16/d2f/c47 0 2024-05-06T21:26:40.998 INFO:tasks.workunit.client.0.smithi032.stdout:5/274: chown d0/l20 694028451 1 2024-05-06T21:26:40.998 INFO:tasks.workunit.client.0.smithi032.stdout:5/275: chown d0/f27 43940 1 2024-05-06T21:26:40.998 INFO:tasks.workunit.client.0.smithi032.stdout:6/447: write d8/dd/d18/d3b/f50 [196231,101345] 0 2024-05-06T21:26:40.998 INFO:tasks.workunit.client.0.smithi032.stdout:6/448: truncate d8/d33/d3e/f64 552471 0 2024-05-06T21:26:40.998 INFO:tasks.workunit.client.0.smithi032.stdout:5/276: link d0/d24/d38/l14 d0/d16/d46/l48 0 2024-05-06T21:26:40.999 INFO:tasks.workunit.client.0.smithi032.stdout:5/277: mknod d0/d24/d34/c49 0 2024-05-06T21:26:41.000 INFO:tasks.workunit.client.0.smithi032.stdout:5/278: symlink d0/d16/d2f/l4a 0 2024-05-06T21:26:41.001 INFO:tasks.workunit.client.0.smithi032.stdout:5/279: link d0/d16/d2a/c2b d0/d16/c4b 0 2024-05-06T21:26:41.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/460: dread d1/d4/da/d31/d47/d4a/d68/d7c/f9a [4194304,4194304] 0 2024-05-06T21:26:41.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/461: truncate d1/d4/da/d4e/d41/d45/f7e 991462 0 2024-05-06T21:26:41.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/462: creat d1/d4/da/d9f/d75/fa2 x:0 0 0 2024-05-06T21:26:41.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/463: write d1/f5d [395247,43732] 0 2024-05-06T21:26:41.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/464: truncate d1/d4/f62 982815 0 2024-05-06T21:26:41.003 INFO:tasks.workunit.client.0.smithi032.stdout:3/465: chown d1/d4/f3e 1622088 1 2024-05-06T21:26:41.006 INFO:tasks.workunit.client.0.smithi032.stdout:3/466: dread d1/d4/f9 [0,4194304] 0 2024-05-06T21:26:41.006 INFO:tasks.workunit.client.0.smithi032.stdout:3/467: stat d1/d4/d11/l1a 0 2024-05-06T21:26:41.007 INFO:tasks.workunit.client.0.smithi032.stdout:3/468: rmdir d1/d4/da/d9f/d74 39 2024-05-06T21:26:41.007 INFO:tasks.workunit.client.0.smithi032.stdout:3/469: stat d1/d4/da/d31/f87 0 2024-05-06T21:26:41.009 INFO:tasks.workunit.client.0.smithi032.stdout:6/449: write d8/f10 [2485303,353] 0 2024-05-06T21:26:41.011 INFO:tasks.workunit.client.0.smithi032.stdout:6/450: truncate d8/f31 299504 0 2024-05-06T21:26:41.011 INFO:tasks.workunit.client.0.smithi032.stdout:6/451: fdatasync d8/dd/d1b/d35/f66 0 2024-05-06T21:26:41.012 INFO:tasks.workunit.client.0.smithi032.stdout:5/280: dread d0/f12 [0,4194304] 0 2024-05-06T21:26:41.014 INFO:tasks.workunit.client.0.smithi032.stdout:3/470: write d1/f14 [802266,47023] 0 2024-05-06T21:26:41.014 INFO:tasks.workunit.client.0.smithi032.stdout:3/471: stat d1/d4/da/d31/d47/d4a/d68/d7c/c80 0 2024-05-06T21:26:41.014 INFO:tasks.workunit.client.0.smithi032.stdout:3/472: dread - d1/d4/f7a zero size 2024-05-06T21:26:41.016 INFO:tasks.workunit.client.0.smithi032.stdout:3/473: link d1/d2a/f37 d1/d4/da/d4e/d41/fa3 0 2024-05-06T21:26:41.024 INFO:tasks.workunit.client.0.smithi032.stdout:6/452: dread d8/dd/d1b/d35/f3f [0,4194304] 0 2024-05-06T21:26:41.024 INFO:tasks.workunit.client.0.smithi032.stdout:6/453: write d8/d33/f77 [633693,26422] 0 2024-05-06T21:26:41.024 INFO:tasks.workunit.client.0.smithi032.stdout:6/454: dread - d8/d33/f4a zero size 2024-05-06T21:26:41.026 INFO:tasks.workunit.client.0.smithi032.stdout:6/455: mknod d8/dd/d18/d3b/c84 0 2024-05-06T21:26:41.050 INFO:tasks.workunit.client.0.smithi032.stdout:5/281: dwrite d0/d24/d38/f3c [0,4194304] 0 2024-05-06T21:26:41.050 INFO:tasks.workunit.client.0.smithi032.stdout:3/474: dwrite d1/d4/da/d4e/d41/d45/f56 [0,4194304] 0 2024-05-06T21:26:41.050 INFO:tasks.workunit.client.0.smithi032.stdout:6/456: dwrite d8/dd/d1b/d35/f44 [0,4194304] 0 2024-05-06T21:26:41.054 INFO:tasks.workunit.client.0.smithi032.stdout:3/475: write d1/d4/da/f32 [1206389,127515] 0 2024-05-06T21:26:41.055 INFO:tasks.workunit.client.0.smithi032.stdout:6/457: dread d8/dd/d1b/d35/f3f [0,4194304] 0 2024-05-06T21:26:41.056 INFO:tasks.workunit.client.0.smithi032.stdout:5/282: symlink d0/l4c 0 2024-05-06T21:26:41.058 INFO:tasks.workunit.client.0.smithi032.stdout:3/476: rename d1/d4/da/f2c to d1/d4/da/d9f/d74/fa4 0 2024-05-06T21:26:41.060 INFO:tasks.workunit.client.0.smithi032.stdout:6/458: creat d8/dd/d1b/d67/f85 x:0 0 0 2024-05-06T21:26:41.062 INFO:tasks.workunit.client.0.smithi032.stdout:3/477: creat d1/d4/da/d31/d47/d4a/fa5 x:0 0 0 2024-05-06T21:26:41.062 INFO:tasks.workunit.client.0.smithi032.stdout:3/478: stat d1/d2a/d71/d8f/f99 0 2024-05-06T21:26:41.062 INFO:tasks.workunit.client.0.smithi032.stdout:3/479: write d1/d4/da/d31/d9b/f9e [647228,40313] 0 2024-05-06T21:26:41.062 INFO:tasks.workunit.client.0.smithi032.stdout:3/480: write d1/d4/da/d9f/d74/fa4 [1579919,5128] 0 2024-05-06T21:26:41.063 INFO:tasks.workunit.client.0.smithi032.stdout:3/481: read d1/d4/da/d31/f87 [179815,23948] 0 2024-05-06T21:26:41.069 INFO:tasks.workunit.client.0.smithi032.stdout:6/459: getdents d8/dd/d18/d13 0 2024-05-06T21:26:41.071 INFO:tasks.workunit.client.0.smithi032.stdout:6/460: truncate d8/dd/d18/d13/f2a 1956069 0 2024-05-06T21:26:41.071 INFO:tasks.workunit.client.0.smithi032.stdout:6/461: read d8/d33/f77 [146067,56025] 0 2024-05-06T21:26:41.075 INFO:tasks.workunit.client.0.smithi032.stdout:3/482: rename d1/d2a/d71/d8f to d1/d4/da/d4e/d41/d97/d67/da6 0 2024-05-06T21:26:41.082 INFO:tasks.workunit.client.0.smithi032.stdout:6/462: read d8/dd/d18/f19 [673815,9997] 0 2024-05-06T21:26:41.085 INFO:tasks.workunit.client.0.smithi032.stdout:3/483: mkdir d1/d4/da/d9f/d74/da7 0 2024-05-06T21:26:41.087 INFO:tasks.workunit.client.0.smithi032.stdout:3/484: mkdir d1/d4/da/d31/d47/d4a/d68/d7c/da8 0 2024-05-06T21:26:41.092 INFO:tasks.workunit.client.0.smithi032.stdout:7/423: sync 2024-05-06T21:26:41.092 INFO:tasks.workunit.client.0.smithi032.stdout:1/394: sync 2024-05-06T21:26:41.092 INFO:tasks.workunit.client.0.smithi032.stdout:7/424: creat db/d12/d49/f7c x:0 0 0 2024-05-06T21:26:41.092 INFO:tasks.workunit.client.0.smithi032.stdout:7/425: fdatasync db/d12/f79 0 2024-05-06T21:26:41.092 INFO:tasks.workunit.client.0.smithi032.stdout:7/426: chown db/f20 570058 1 2024-05-06T21:26:41.095 INFO:tasks.workunit.client.0.smithi032.stdout:7/427: mkdir db/d12/d16/d21/d41/d7d 0 2024-05-06T21:26:41.096 INFO:tasks.workunit.client.0.smithi032.stdout:7/428: write db/d12/d49/f75 [575947,66799] 0 2024-05-06T21:26:41.096 INFO:tasks.workunit.client.0.smithi032.stdout:7/429: fsync db/d12/f61 0 2024-05-06T21:26:41.097 INFO:tasks.workunit.client.0.smithi032.stdout:7/430: rename db/d12/d16/d21/d41/d78/c34 to db/d12/c7e 0 2024-05-06T21:26:41.103 INFO:tasks.workunit.client.0.smithi032.stdout:6/463: dwrite d8/dd/d18/d13/f2a [0,4194304] 0 2024-05-06T21:26:41.105 INFO:tasks.workunit.client.0.smithi032.stdout:3/485: dread d1/d4/da/d31/d9b/f9e [0,4194304] 0 2024-05-06T21:26:41.105 INFO:tasks.workunit.client.0.smithi032.stdout:3/486: write d1/d4/da/d31/d47/d4a/fa5 [300217,31465] 0 2024-05-06T21:26:41.107 INFO:tasks.workunit.client.0.smithi032.stdout:3/487: mkdir d1/d2a/d71/d9d/da9 0 2024-05-06T21:26:41.107 INFO:tasks.workunit.client.0.smithi032.stdout:3/488: write d1/f35 [717582,108637] 0 2024-05-06T21:26:41.107 INFO:tasks.workunit.client.0.smithi032.stdout:3/489: stat d1/c1e 0 2024-05-06T21:26:41.107 INFO:tasks.workunit.client.0.smithi032.stdout:3/490: write d1/f14 [2214399,56029] 0 2024-05-06T21:26:41.108 INFO:tasks.workunit.client.0.smithi032.stdout:3/491: chown d1/d4/da/d4e/f91 88085 1 2024-05-06T21:26:41.108 INFO:tasks.workunit.client.0.smithi032.stdout:1/395: dread db/f1f [0,4194304] 0 2024-05-06T21:26:41.108 INFO:tasks.workunit.client.0.smithi032.stdout:1/396: write db/f10 [3120214,117990] 0 2024-05-06T21:26:41.109 INFO:tasks.workunit.client.0.smithi032.stdout:3/492: mkdir d1/d4/da/d31/d9b/daa 0 2024-05-06T21:26:41.111 INFO:tasks.workunit.client.0.smithi032.stdout:7/431: dread db/d12/d16/d2a/d39/d3b/f3d [0,4194304] 0 2024-05-06T21:26:41.112 INFO:tasks.workunit.client.0.smithi032.stdout:1/397: unlink db/f12 0 2024-05-06T21:26:41.113 INFO:tasks.workunit.client.0.smithi032.stdout:7/432: mknod db/d12/d16/d21/d41/c7f 0 2024-05-06T21:26:41.115 INFO:tasks.workunit.client.0.smithi032.stdout:7/433: mknod db/d12/d49/c80 0 2024-05-06T21:26:41.118 INFO:tasks.workunit.client.0.smithi032.stdout:7/434: getdents db/d12/d16/d2a/d39 0 2024-05-06T21:26:41.118 INFO:tasks.workunit.client.0.smithi032.stdout:7/435: chown db/d12/d16/d21/f31 459070622 1 2024-05-06T21:26:41.120 INFO:tasks.workunit.client.0.smithi032.stdout:1/398: rename db/d16/c34 to db/d16/c7b 0 2024-05-06T21:26:41.121 INFO:tasks.workunit.client.0.smithi032.stdout:1/399: truncate db/f1f 7732740 0 2024-05-06T21:26:41.122 INFO:tasks.workunit.client.0.smithi032.stdout:1/400: readlink db/d47/l5c 0 2024-05-06T21:26:41.122 INFO:tasks.workunit.client.0.smithi032.stdout:6/464: dwrite d8/d33/f4a [0,4194304] 0 2024-05-06T21:26:41.122 INFO:tasks.workunit.client.0.smithi032.stdout:6/465: getdents d8/dd/d18/d13/d7a 0 2024-05-06T21:26:41.122 INFO:tasks.workunit.client.0.smithi032.stdout:6/466: dread - d8/d3d/d49/d6b/f6f zero size 2024-05-06T21:26:41.122 INFO:tasks.workunit.client.0.smithi032.stdout:6/467: chown d8/d33/d3e/c42 2072450483 1 2024-05-06T21:26:41.123 INFO:tasks.workunit.client.0.smithi032.stdout:1/401: rename db/l28 to db/d47/d4a/l7c 0 2024-05-06T21:26:41.128 INFO:tasks.workunit.client.0.smithi032.stdout:6/468: link d8/dd/d18/d22/f6d d8/dd/d1b/d35/f86 0 2024-05-06T21:26:41.128 INFO:tasks.workunit.client.0.smithi032.stdout:6/469: chown d8/dd/d1b/l6c 322 1 2024-05-06T21:26:41.129 INFO:tasks.workunit.client.0.smithi032.stdout:6/470: unlink d8/dd/d18/d13/f2a 0 2024-05-06T21:26:41.129 INFO:tasks.workunit.client.0.smithi032.stdout:6/471: chown d8/d33/d63/c6e 1997108 1 2024-05-06T21:26:41.131 INFO:tasks.workunit.client.0.smithi032.stdout:7/436: dwrite db/d12/d16/d2a/f42 [0,4194304] 0 2024-05-06T21:26:41.131 INFO:tasks.workunit.client.0.smithi032.stdout:7/437: dread - db/f48 zero size 2024-05-06T21:26:41.135 INFO:tasks.workunit.client.0.smithi032.stdout:7/438: rename db/d12/d16/d21/f4a to db/d12/f81 0 2024-05-06T21:26:41.136 INFO:tasks.workunit.client.0.smithi032.stdout:7/439: mknod db/d12/c82 0 2024-05-06T21:26:41.136 INFO:tasks.workunit.client.0.smithi032.stdout:7/440: chown db/d12/d16/f57 6 1 2024-05-06T21:26:41.146 INFO:tasks.workunit.client.0.smithi032.stdout:7/441: dread db/d12/d16/f72 [0,4194304] 0 2024-05-06T21:26:41.146 INFO:tasks.workunit.client.0.smithi032.stdout:7/442: mknod db/c83 0 2024-05-06T21:26:41.147 INFO:tasks.workunit.client.0.smithi032.stdout:7/443: mkdir db/d12/d16/d21/d84 0 2024-05-06T21:26:41.147 INFO:tasks.workunit.client.0.smithi032.stdout:7/444: creat db/d12/f85 x:0 0 0 2024-05-06T21:26:41.148 INFO:tasks.workunit.client.0.smithi032.stdout:6/472: write d8/d3d/f4e [1204229,79973] 0 2024-05-06T21:26:41.148 INFO:tasks.workunit.client.0.smithi032.stdout:7/445: mknod db/d12/d16/d21/d41/d4b/c86 0 2024-05-06T21:26:41.151 INFO:tasks.workunit.client.0.smithi032.stdout:6/473: rename d8/d33/d3e to d8/d3d/d73/d87 0 2024-05-06T21:26:41.162 INFO:tasks.workunit.client.0.smithi032.stdout:6/474: dread d8/dd/d1b/d35/f3a [0,4194304] 0 2024-05-06T21:26:41.164 INFO:tasks.workunit.client.0.smithi032.stdout:6/475: link d8/d3d/l3c d8/dd/d1b/d35/l88 0 2024-05-06T21:26:41.165 INFO:tasks.workunit.client.0.smithi032.stdout:6/476: creat d8/d3d/f89 x:0 0 0 2024-05-06T21:26:41.165 INFO:tasks.workunit.client.0.smithi032.stdout:6/477: fdatasync d8/d3d/f89 0 2024-05-06T21:26:41.165 INFO:tasks.workunit.client.0.smithi032.stdout:6/478: creat d8/d3d/d49/d6b/f8a x:0 0 0 2024-05-06T21:26:41.165 INFO:tasks.workunit.client.0.smithi032.stdout:6/479: truncate d8/d33/f36 4258221 0 2024-05-06T21:26:41.165 INFO:tasks.workunit.client.0.smithi032.stdout:6/480: write d8/dd/d1b/d35/f66 [536056,24479] 0 2024-05-06T21:26:41.166 INFO:tasks.workunit.client.0.smithi032.stdout:6/481: symlink d8/dd/d1b/d35/l8b 0 2024-05-06T21:26:41.167 INFO:tasks.workunit.client.0.smithi032.stdout:6/482: creat d8/f8c x:0 0 0 2024-05-06T21:26:41.172 INFO:tasks.workunit.client.0.smithi032.stdout:6/483: write d8/dd/d1b/d35/f3f [1506209,113160] 0 2024-05-06T21:26:41.172 INFO:tasks.workunit.client.0.smithi032.stdout:6/484: write d8/dd/d1b/d35/f3f [4388831,63867] 0 2024-05-06T21:26:41.172 INFO:tasks.workunit.client.0.smithi032.stdout:6/485: creat d8/d3d/d49/d6b/f8d x:0 0 0 2024-05-06T21:26:41.177 INFO:tasks.workunit.client.0.smithi032.stdout:7/446: dwrite f3 [4194304,4194304] 0 2024-05-06T21:26:41.177 INFO:tasks.workunit.client.0.smithi032.stdout:7/447: fdatasync db/d12/d49/f67 0 2024-05-06T21:26:41.178 INFO:tasks.workunit.client.0.smithi032.stdout:7/448: mkdir db/d12/d87 0 2024-05-06T21:26:41.180 INFO:tasks.workunit.client.0.smithi032.stdout:7/449: creat db/d12/d16/d21/d41/d78/f88 x:0 0 0 2024-05-06T21:26:41.181 INFO:tasks.workunit.client.0.smithi032.stdout:7/450: mkdir db/d89 0 2024-05-06T21:26:41.181 INFO:tasks.workunit.client.0.smithi032.stdout:7/451: fdatasync db/d12/f81 0 2024-05-06T21:26:41.182 INFO:tasks.workunit.client.0.smithi032.stdout:7/452: read db/d12/f17 [955201,109959] 0 2024-05-06T21:26:41.182 INFO:tasks.workunit.client.0.smithi032.stdout:7/453: chown db/f1e 623985 1 2024-05-06T21:26:41.184 INFO:tasks.workunit.client.0.smithi032.stdout:7/454: unlink db/f48 0 2024-05-06T21:26:41.184 INFO:tasks.workunit.client.0.smithi032.stdout:7/455: truncate db/f77 3111691 0 2024-05-06T21:26:41.186 INFO:tasks.workunit.client.0.smithi032.stdout:7/456: creat db/d12/d16/f8a x:0 0 0 2024-05-06T21:26:41.189 INFO:tasks.workunit.client.0.smithi032.stdout:6/486: dwrite d8/d3d/f89 [0,4194304] 0 2024-05-06T21:26:41.189 INFO:tasks.workunit.client.0.smithi032.stdout:6/487: write d8/dd/d1b/d35/f3a [3184760,90755] 0 2024-05-06T21:26:41.193 INFO:tasks.workunit.client.0.smithi032.stdout:6/488: rename d8/dd/d18/d13/d1d/c5e to d8/dd/d18/d13/d1d/c8e 0 2024-05-06T21:26:41.199 INFO:tasks.workunit.client.0.smithi032.stdout:6/489: rename d8/d3d/d49/d74 to d8/d3d/d8f 0 2024-05-06T21:26:41.199 INFO:tasks.workunit.client.0.smithi032.stdout:6/490: chown d8/d3d/d49/d6b 46663973 1 2024-05-06T21:26:41.199 INFO:tasks.workunit.client.0.smithi032.stdout:7/457: rmdir db/d12/d16/d21/d41/d78 39 2024-05-06T21:26:41.200 INFO:tasks.workunit.client.0.smithi032.stdout:7/458: readlink db/ld 0 2024-05-06T21:26:41.200 INFO:tasks.workunit.client.0.smithi032.stdout:7/459: dread - db/d12/f85 zero size 2024-05-06T21:26:41.201 INFO:tasks.workunit.client.0.smithi032.stdout:7/460: mkdir db/d12/d16/d2a/d39/d8b 0 2024-05-06T21:26:41.201 INFO:tasks.workunit.client.0.smithi032.stdout:7/461: write db/d12/f61 [3861037,96199] 0 2024-05-06T21:26:41.201 INFO:tasks.workunit.client.0.smithi032.stdout:7/462: symlink db/d12/d16/d21/d41/d7d/l8c 0 2024-05-06T21:26:41.203 INFO:tasks.workunit.client.0.smithi032.stdout:7/463: creat db/d12/d16/d21/f8d x:0 0 0 2024-05-06T21:26:41.203 INFO:tasks.workunit.client.0.smithi032.stdout:7/464: dread - db/d12/d16/f8a zero size 2024-05-06T21:26:41.205 INFO:tasks.workunit.client.0.smithi032.stdout:7/465: dread db/d12/f19 [0,4194304] 0 2024-05-06T21:26:41.206 INFO:tasks.workunit.client.0.smithi032.stdout:7/466: creat db/d12/d16/d2a/d39/d8b/f8e x:0 0 0 2024-05-06T21:26:41.208 INFO:tasks.workunit.client.0.smithi032.stdout:6/491: dread d8/dd/d18/d13/f28 [0,4194304] 0 2024-05-06T21:26:41.211 INFO:tasks.workunit.client.0.smithi032.stdout:6/492: mkdir d8/dd/d18/d3b/d90 0 2024-05-06T21:26:41.212 INFO:tasks.workunit.client.0.smithi032.stdout:6/493: read - d8/d3d/d49/f76 zero size 2024-05-06T21:26:41.213 INFO:tasks.workunit.client.0.smithi032.stdout:6/494: link d8/d3d/f4e d8/dd/d18/d13/f91 0 2024-05-06T21:26:41.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:40 smithi032 ceph-mon[27179]: pgmap v21: 65 pgs: 65 active+clean; 854 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 79 MiB/s rd, 109 MiB/s wr, 729 op/s 2024-05-06T21:26:41.236 INFO:tasks.workunit.client.0.smithi032.stdout:6/495: dwrite d8/d3d/f4e [0,4194304] 0 2024-05-06T21:26:41.237 INFO:tasks.workunit.client.0.smithi032.stdout:6/496: symlink d8/d33/d63/l92 0 2024-05-06T21:26:41.267 INFO:tasks.workunit.client.0.smithi032.stdout:6/497: dwrite d8/d33/d63/f65 [0,4194304] 0 2024-05-06T21:26:41.275 INFO:tasks.workunit.client.0.smithi032.stdout:6/498: read d8/dd/d18/d13/f2c [1083333,108835] 0 2024-05-06T21:26:41.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:40 smithi154 ceph-mon[32880]: pgmap v21: 65 pgs: 65 active+clean; 854 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 79 MiB/s rd, 109 MiB/s wr, 729 op/s 2024-05-06T21:26:41.437 INFO:tasks.workunit.client.0.smithi032.stdout:0/368: sync 2024-05-06T21:26:41.438 INFO:tasks.workunit.client.0.smithi032.stdout:0/369: mknod d4/d3e/d42/c72 0 2024-05-06T21:26:41.452 INFO:tasks.workunit.client.0.smithi032.stdout:0/370: dwrite d4/da/f17 [4194304,4194304] 0 2024-05-06T21:26:41.469 INFO:tasks.workunit.client.0.smithi032.stdout:0/371: dwrite d4/da/d16/d33/f57 [0,4194304] 0 2024-05-06T21:26:41.472 INFO:tasks.workunit.client.0.smithi032.stdout:0/372: mknod d4/da/d14/d1a/c73 0 2024-05-06T21:26:41.478 INFO:tasks.workunit.client.0.smithi032.stdout:0/373: write d4/f9 [1214527,17690] 0 2024-05-06T21:26:41.495 INFO:tasks.workunit.client.0.smithi032.stdout:0/374: dwrite d4/da/d16/f3c [0,4194304] 0 2024-05-06T21:26:41.496 INFO:tasks.workunit.client.0.smithi032.stdout:0/375: write d4/da/d14/d1a/f1b [4562640,50312] 0 2024-05-06T21:26:41.498 INFO:tasks.workunit.client.0.smithi032.stdout:0/376: symlink d4/d3e/l74 0 2024-05-06T21:26:41.506 INFO:tasks.workunit.client.0.smithi032.stdout:0/377: write d4/da/f31 [3649040,50665] 0 2024-05-06T21:26:41.506 INFO:tasks.workunit.client.0.smithi032.stdout:0/378: readlink d4/da/l13 0 2024-05-06T21:26:41.506 INFO:tasks.workunit.client.0.smithi032.stdout:0/379: readlink d4/d3e/l64 0 2024-05-06T21:26:41.507 INFO:tasks.workunit.client.0.smithi032.stdout:0/380: creat d4/da/d16/d4f/f75 x:0 0 0 2024-05-06T21:26:41.508 INFO:tasks.workunit.client.0.smithi032.stdout:0/381: write d4/da/d16/f53 [423714,90491] 0 2024-05-06T21:26:41.517 INFO:tasks.workunit.client.0.smithi032.stdout:0/382: read d4/da/d16/d33/d46/f50 [2628013,97629] 0 2024-05-06T21:26:41.517 INFO:tasks.workunit.client.0.smithi032.stdout:0/383: write d4/da/f39 [4037377,125137] 0 2024-05-06T21:26:41.517 INFO:tasks.workunit.client.0.smithi032.stdout:0/384: creat d4/da/d14/f76 x:0 0 0 2024-05-06T21:26:41.517 INFO:tasks.workunit.client.0.smithi032.stdout:0/385: truncate d4/da/d16/d33/d46/f52 748720 0 2024-05-06T21:26:41.518 INFO:tasks.workunit.client.0.smithi032.stdout:0/386: write d4/da/d16/d33/d46/f52 [1549014,31353] 0 2024-05-06T21:26:41.522 INFO:tasks.workunit.client.0.smithi032.stdout:0/387: dread d4/da/d16/f53 [0,4194304] 0 2024-05-06T21:26:41.533 INFO:tasks.workunit.client.0.smithi032.stdout:0/388: write d4/da/d14/f2d [3378442,122749] 0 2024-05-06T21:26:41.533 INFO:tasks.workunit.client.0.smithi032.stdout:0/389: dread - d4/da/d16/d33/f38 zero size 2024-05-06T21:26:41.534 INFO:tasks.workunit.client.0.smithi032.stdout:0/390: creat d4/d3e/d63/d6c/f77 x:0 0 0 2024-05-06T21:26:41.535 INFO:tasks.workunit.client.0.smithi032.stdout:0/391: link d4/da/cd d4/da/d16/d33/c78 0 2024-05-06T21:26:41.535 INFO:tasks.workunit.client.0.smithi032.stdout:0/392: write d4/da/f39 [1972454,70675] 0 2024-05-06T21:26:41.541 INFO:tasks.workunit.client.0.smithi032.stdout:0/393: dread d4/f3f [0,4194304] 0 2024-05-06T21:26:41.542 INFO:tasks.workunit.client.0.smithi032.stdout:0/394: creat d4/d3e/d42/f79 x:0 0 0 2024-05-06T21:26:41.542 INFO:tasks.workunit.client.0.smithi032.stdout:0/395: fsync d4/da/d14/d4a/f65 0 2024-05-06T21:26:41.543 INFO:tasks.workunit.client.0.smithi032.stdout:0/396: rmdir d4/da/d16/d33/d46 39 2024-05-06T21:26:41.546 INFO:tasks.workunit.client.0.smithi032.stdout:0/397: rename d4/c12 to d4/c7a 0 2024-05-06T21:26:41.547 INFO:tasks.workunit.client.0.smithi032.stdout:0/398: mknod d4/da/d16/c7b 0 2024-05-06T21:26:41.549 INFO:tasks.workunit.client.0.smithi032.stdout:0/399: symlink d4/da/d14/l7c 0 2024-05-06T21:26:41.549 INFO:tasks.workunit.client.0.smithi032.stdout:0/400: stat d4/da/d16/c2e 0 2024-05-06T21:26:41.636 INFO:tasks.workunit.client.0.smithi032.stdout:4/461: sync 2024-05-06T21:26:41.636 INFO:tasks.workunit.client.0.smithi032.stdout:2/344: sync 2024-05-06T21:26:41.639 INFO:tasks.workunit.client.0.smithi032.stdout:4/462: dread d2/f9 [4194304,4194304] 0 2024-05-06T21:26:41.639 INFO:tasks.workunit.client.0.smithi032.stdout:4/463: chown d2/d2c/d31/l37 106811 1 2024-05-06T21:26:41.639 INFO:tasks.workunit.client.0.smithi032.stdout:4/464: fsync d2/f6c 0 2024-05-06T21:26:41.641 INFO:tasks.workunit.client.0.smithi032.stdout:4/465: creat d2/d16/d44/d54/d69/d8a/f9b x:0 0 0 2024-05-06T21:26:41.645 INFO:tasks.workunit.client.0.smithi032.stdout:2/345: dread df/d19/d1e/d71/d5f/d7d/d65/f74 [0,4194304] 0 2024-05-06T21:26:41.646 INFO:tasks.workunit.client.0.smithi032.stdout:4/466: dread d2/d16/f94 [0,4194304] 0 2024-05-06T21:26:41.646 INFO:tasks.workunit.client.0.smithi032.stdout:4/467: chown d2/d16/d44/d54/d69/c7d 23929557 1 2024-05-06T21:26:41.647 INFO:tasks.workunit.client.0.smithi032.stdout:4/468: symlink d2/d16/d44/d45/l9c 0 2024-05-06T21:26:41.647 INFO:tasks.workunit.client.0.smithi032.stdout:2/346: getdents df/d19/d1e/d42 0 2024-05-06T21:26:41.649 INFO:tasks.workunit.client.0.smithi032.stdout:4/469: link d2/d1e/d47/l71 d2/d16/l9d 0 2024-05-06T21:26:41.649 INFO:tasks.workunit.client.0.smithi032.stdout:4/470: creat d2/d13/f9e x:0 0 0 2024-05-06T21:26:41.651 INFO:tasks.workunit.client.0.smithi032.stdout:4/471: unlink d2/d16/l9d 0 2024-05-06T21:26:41.652 INFO:tasks.workunit.client.0.smithi032.stdout:2/347: dread df/d19/d1e/d71/d5f/d7d/d65/f74 [0,4194304] 0 2024-05-06T21:26:41.653 INFO:tasks.workunit.client.0.smithi032.stdout:2/348: chown df/f1c 76983 1 2024-05-06T21:26:41.653 INFO:tasks.workunit.client.0.smithi032.stdout:2/349: stat df/d19/d1e/d71/d5f/d7d/d25/d2d/c62 0 2024-05-06T21:26:41.657 INFO:tasks.workunit.client.0.smithi032.stdout:2/350: write df/d19/d1e/d71/d5f/d7d/d25/f50 [266278,37506] 0 2024-05-06T21:26:41.657 INFO:tasks.workunit.client.0.smithi032.stdout:2/351: dread - df/d19/d1e/d1f/d2e/d33/f27 zero size 2024-05-06T21:26:41.659 INFO:tasks.workunit.client.0.smithi032.stdout:2/352: unlink df/d19/d1e/d71/d5f/c61 0 2024-05-06T21:26:41.661 INFO:tasks.workunit.client.0.smithi032.stdout:4/472: dread d2/fa [0,4194304] 0 2024-05-06T21:26:41.661 INFO:tasks.workunit.client.0.smithi032.stdout:4/473: creat d2/d16/d44/d54/d69/d8a/f9f x:0 0 0 2024-05-06T21:26:41.661 INFO:tasks.workunit.client.0.smithi032.stdout:4/474: stat d2/f6c 0 2024-05-06T21:26:41.661 INFO:tasks.workunit.client.0.smithi032.stdout:4/475: chown d2/d16/d44/d74/c8f 63482 1 2024-05-06T21:26:41.661 INFO:tasks.workunit.client.0.smithi032.stdout:2/353: creat df/d19/d1e/d71/d5f/f80 x:0 0 0 2024-05-06T21:26:41.663 INFO:tasks.workunit.client.0.smithi032.stdout:4/476: symlink d2/d16/d44/d45/d4e/la0 0 2024-05-06T21:26:41.663 INFO:tasks.workunit.client.0.smithi032.stdout:4/477: rename d2/d16/d44/d74 to d2/d16/d44/d74/d76/d81/da1 22 2024-05-06T21:26:41.682 INFO:tasks.workunit.client.0.smithi032.stdout:2/354: dwrite df/f2c [0,4194304] 0 2024-05-06T21:26:41.688 INFO:tasks.workunit.client.0.smithi032.stdout:4/478: dwrite d2/d16/f94 [0,4194304] 0 2024-05-06T21:26:41.688 INFO:tasks.workunit.client.0.smithi032.stdout:4/479: dread - d2/d2c/d31/f91 zero size 2024-05-06T21:26:41.688 INFO:tasks.workunit.client.0.smithi032.stdout:4/480: truncate d2/d13/f1b 1757311 0 2024-05-06T21:26:41.688 INFO:tasks.workunit.client.0.smithi032.stdout:4/481: creat d2/d16/fa2 x:0 0 0 2024-05-06T21:26:41.688 INFO:tasks.workunit.client.0.smithi032.stdout:4/482: readlink d2/d13/l93 0 2024-05-06T21:26:41.700 INFO:tasks.workunit.client.0.smithi032.stdout:4/483: dwrite d2/d13/f1b [0,4194304] 0 2024-05-06T21:26:41.700 INFO:tasks.workunit.client.0.smithi032.stdout:4/484: stat d2/d16/d44/d74/d79/c7b 0 2024-05-06T21:26:41.702 INFO:tasks.workunit.client.0.smithi032.stdout:4/485: mknod d2/d16/d44/d54/d69/d8a/ca3 0 2024-05-06T21:26:41.702 INFO:tasks.workunit.client.0.smithi032.stdout:4/486: readlink d2/d16/d44/d45/l9c 0 2024-05-06T21:26:41.704 INFO:tasks.workunit.client.0.smithi032.stdout:4/487: creat d2/d1e/d47/fa4 x:0 0 0 2024-05-06T21:26:41.704 INFO:tasks.workunit.client.0.smithi032.stdout:4/488: write d2/d16/d44/d45/f48 [293436,49134] 0 2024-05-06T21:26:41.704 INFO:tasks.workunit.client.0.smithi032.stdout:4/489: chown d2/d2c/c99 763181 1 2024-05-06T21:26:41.705 INFO:tasks.workunit.client.0.smithi032.stdout:4/490: dread - d2/d13/f8d zero size 2024-05-06T21:26:41.719 INFO:tasks.workunit.client.0.smithi032.stdout:4/491: dwrite d2/d1e/f80 [0,4194304] 0 2024-05-06T21:26:41.722 INFO:tasks.workunit.client.0.smithi032.stdout:4/492: mkdir d2/d16/d44/d74/d7e/da5 0 2024-05-06T21:26:41.735 INFO:tasks.workunit.client.0.smithi032.stdout:4/493: dwrite d2/d2c/d31/f5a [0,4194304] 0 2024-05-06T21:26:41.735 INFO:tasks.workunit.client.0.smithi032.stdout:4/494: fdatasync d2/d2c/d31/d7c/f32 0 2024-05-06T21:26:41.736 INFO:tasks.workunit.client.0.smithi032.stdout:4/495: creat d2/d2c/d31/d7c/fa6 x:0 0 0 2024-05-06T21:26:41.744 INFO:tasks.workunit.client.0.smithi032.stdout:9/396: sync 2024-05-06T21:26:41.745 INFO:tasks.workunit.client.0.smithi032.stdout:9/397: rmdir d1/d13/d34 39 2024-05-06T21:26:41.751 INFO:tasks.workunit.client.0.smithi032.stdout:4/496: dwrite d2/d16/d44/d74/f92 [0,4194304] 0 2024-05-06T21:26:41.754 INFO:tasks.workunit.client.0.smithi032.stdout:4/497: unlink d2/d16/f94 0 2024-05-06T21:26:41.754 INFO:tasks.workunit.client.0.smithi032.stdout:4/498: truncate d2/d2c/d31/f91 302578 0 2024-05-06T21:26:41.757 INFO:tasks.workunit.client.0.smithi032.stdout:4/499: dread d2/d16/d44/d45/d4e/f6b [0,4194304] 0 2024-05-06T21:26:41.761 INFO:tasks.workunit.client.0.smithi032.stdout:9/398: dwrite d1/d13/d34/d26/f29 [0,4194304] 0 2024-05-06T21:26:41.763 INFO:tasks.workunit.client.0.smithi032.stdout:9/399: creat d1/d2f/f7a x:0 0 0 2024-05-06T21:26:41.763 INFO:tasks.workunit.client.0.smithi032.stdout:9/400: chown d1/fe 4928727 1 2024-05-06T21:26:41.763 INFO:tasks.workunit.client.0.smithi032.stdout:9/401: creat d1/d13/d34/d26/d39/d45/f7b x:0 0 0 2024-05-06T21:26:41.763 INFO:tasks.workunit.client.0.smithi032.stdout:9/402: fsync d1/d13/d34/f48 0 2024-05-06T21:26:41.766 INFO:tasks.workunit.client.0.smithi032.stdout:9/403: rename d1/lc to d1/d13/d33/d3f/l7c 0 2024-05-06T21:26:41.768 INFO:tasks.workunit.client.0.smithi032.stdout:9/404: creat d1/d13/d33/f7d x:0 0 0 2024-05-06T21:26:41.768 INFO:tasks.workunit.client.0.smithi032.stdout:9/405: chown d1/d13/d34/c46 0 1 2024-05-06T21:26:41.768 INFO:tasks.workunit.client.0.smithi032.stdout:9/406: creat d1/d13/d33/d3f/d60/f7e x:0 0 0 2024-05-06T21:26:41.768 INFO:tasks.workunit.client.0.smithi032.stdout:9/407: fsync d1/d13/d25/f2e 0 2024-05-06T21:26:41.770 INFO:tasks.workunit.client.0.smithi032.stdout:4/500: dwrite d2/d16/d44/d54/d69/f8e [0,4194304] 0 2024-05-06T21:26:41.770 INFO:tasks.workunit.client.0.smithi032.stdout:4/501: write d2/d1e/f22 [1279881,20438] 0 2024-05-06T21:26:41.773 INFO:tasks.workunit.client.0.smithi032.stdout:4/502: mknod d2/d16/d44/d54/d69/d8a/ca7 0 2024-05-06T21:26:41.774 INFO:tasks.workunit.client.0.smithi032.stdout:4/503: mkdir d2/d2c/da8 0 2024-05-06T21:26:41.782 INFO:tasks.workunit.client.0.smithi032.stdout:9/408: dwrite d1/d13/d33/d3f/f4e [0,4194304] 0 2024-05-06T21:26:41.782 INFO:tasks.workunit.client.0.smithi032.stdout:9/409: creat d1/d13/d25/f7f x:0 0 0 2024-05-06T21:26:41.782 INFO:tasks.workunit.client.0.smithi032.stdout:9/410: chown d1/d2f 20392 1 2024-05-06T21:26:41.786 INFO:tasks.workunit.client.0.smithi032.stdout:9/411: link d1/d13/d34/d26/d39/d45/f52 d1/d13/d33/d5e/d78/f80 0 2024-05-06T21:26:41.788 INFO:tasks.workunit.client.0.smithi032.stdout:9/412: dread d1/d13/d33/d5e/d78/f80 [0,4194304] 0 2024-05-06T21:26:41.788 INFO:tasks.workunit.client.0.smithi032.stdout:9/413: chown d1/d13/d33/d3f/d60/f7e 137 1 2024-05-06T21:26:41.789 INFO:tasks.workunit.client.0.smithi032.stdout:4/504: dwrite d2/d16/fa2 [0,4194304] 0 2024-05-06T21:26:41.792 INFO:tasks.workunit.client.0.smithi032.stdout:4/505: rename d2/d16/fa2 to d2/d16/d44/d45/d4e/fa9 0 2024-05-06T21:26:41.793 INFO:tasks.workunit.client.0.smithi032.stdout:4/506: mkdir d2/d13/daa 0 2024-05-06T21:26:41.810 INFO:tasks.workunit.client.0.smithi032.stdout:9/414: dwrite d1/d13/d34/d26/f27 [0,4194304] 0 2024-05-06T21:26:41.825 INFO:tasks.workunit.client.0.smithi032.stdout:9/415: dwrite d1/d13/d34/d26/d39/d45/f7b [0,4194304] 0 2024-05-06T21:26:41.828 INFO:tasks.workunit.client.0.smithi032.stdout:9/416: rmdir d1/d13/d25 39 2024-05-06T21:26:41.828 INFO:tasks.workunit.client.0.smithi032.stdout:9/417: truncate d1/d13/d33/f7d 749324 0 2024-05-06T21:26:41.829 INFO:tasks.workunit.client.0.smithi032.stdout:9/418: rename d1/d13/d34/d26/f27 to d1/d13/d34/d26/d49/f81 0 2024-05-06T21:26:41.831 INFO:tasks.workunit.client.0.smithi032.stdout:9/419: creat d1/d13/d25/d59/f82 x:0 0 0 2024-05-06T21:26:41.831 INFO:tasks.workunit.client.0.smithi032.stdout:9/420: write d1/d13/d25/f2e [184186,14494] 0 2024-05-06T21:26:41.850 INFO:tasks.workunit.client.0.smithi032.stdout:9/421: dwrite d1/d13/d25/d59/f82 [0,4194304] 0 2024-05-06T21:26:41.850 INFO:tasks.workunit.client.0.smithi032.stdout:9/422: getdents d1/d13/d25/d64/d72 0 2024-05-06T21:26:41.857 INFO:tasks.workunit.client.0.smithi032.stdout:9/423: write d1/f18 [1387351,28338] 0 2024-05-06T21:26:41.866 INFO:tasks.workunit.client.0.smithi032.stdout:9/424: read d1/d13/f16 [7719455,29155] 0 2024-05-06T21:26:41.866 INFO:tasks.workunit.client.0.smithi032.stdout:9/425: truncate d1/d13/f2a 5119143 0 2024-05-06T21:26:41.867 INFO:tasks.workunit.client.0.smithi032.stdout:9/426: creat d1/d13/d33/d5e/d78/f83 x:0 0 0 2024-05-06T21:26:41.867 INFO:tasks.workunit.client.0.smithi032.stdout:9/427: chown d1/d13/d25/d64 21 1 2024-05-06T21:26:41.867 INFO:tasks.workunit.client.0.smithi032.stdout:9/428: creat d1/d13/d25/d59/f84 x:0 0 0 2024-05-06T21:26:41.868 INFO:tasks.workunit.client.0.smithi032.stdout:9/429: symlink d1/d13/d25/d64/d72/l85 0 2024-05-06T21:26:41.868 INFO:tasks.workunit.client.0.smithi032.stdout:9/430: creat d1/d13/d25/d59/f86 x:0 0 0 2024-05-06T21:26:41.868 INFO:tasks.workunit.client.0.smithi032.stdout:9/431: write d1/d13/d25/f4b [889050,41815] 0 2024-05-06T21:26:41.869 INFO:tasks.workunit.client.0.smithi032.stdout:9/432: symlink d1/d2f/d4f/l87 0 2024-05-06T21:26:41.870 INFO:tasks.workunit.client.0.smithi032.stdout:9/433: creat d1/d13/d25/d64/d72/f88 x:0 0 0 2024-05-06T21:26:41.872 INFO:tasks.workunit.client.0.smithi032.stdout:9/434: rename d1/d13/f62 to d1/d13/d33/d5e/d78/f89 0 2024-05-06T21:26:41.872 INFO:tasks.workunit.client.0.smithi032.stdout:9/435: truncate d1/d13/d25/d59/f84 318221 0 2024-05-06T21:26:41.872 INFO:tasks.workunit.client.0.smithi032.stdout:9/436: fsync d1/d13/d34/f43 0 2024-05-06T21:26:41.873 INFO:tasks.workunit.client.0.smithi032.stdout:9/437: rename d1/d13/l21 to d1/d2f/d4f/l8a 0 2024-05-06T21:26:41.873 INFO:tasks.workunit.client.0.smithi032.stdout:9/438: dread - d1/d13/d25/d59/f86 zero size 2024-05-06T21:26:41.873 INFO:tasks.workunit.client.0.smithi032.stdout:9/439: write d1/d13/d34/d26/f71 [2567154,72377] 0 2024-05-06T21:26:41.873 INFO:tasks.workunit.client.0.smithi032.stdout:9/440: fsync d1/d13/d34/d26/f29 0 2024-05-06T21:26:41.874 INFO:tasks.workunit.client.0.smithi032.stdout:9/441: mkdir d1/d13/d34/d26/d39/d8b 0 2024-05-06T21:26:41.875 INFO:tasks.workunit.client.0.smithi032.stdout:8/498: sync 2024-05-06T21:26:41.875 INFO:tasks.workunit.client.0.smithi032.stdout:3/493: sync 2024-05-06T21:26:41.875 INFO:tasks.workunit.client.0.smithi032.stdout:5/283: sync 2024-05-06T21:26:41.876 INFO:tasks.workunit.client.0.smithi032.stdout:5/284: dread - d0/d24/d26/d32/f42 zero size 2024-05-06T21:26:41.877 INFO:tasks.workunit.client.0.smithi032.stdout:9/442: rename d1/d2f/c5c to d1/d13/d25/d59/c8c 0 2024-05-06T21:26:41.877 INFO:tasks.workunit.client.0.smithi032.stdout:9/443: creat d1/d13/d33/d5e/d78/f8d x:0 0 0 2024-05-06T21:26:41.877 INFO:tasks.workunit.client.0.smithi032.stdout:9/444: write d1/d13/d25/d64/f69 [457859,86858] 0 2024-05-06T21:26:41.877 INFO:tasks.workunit.client.0.smithi032.stdout:8/499: read d0/f33 [512725,58057] 0 2024-05-06T21:26:41.878 INFO:tasks.workunit.client.0.smithi032.stdout:3/494: mkdir d1/d4/da/d4e/d41/dab 0 2024-05-06T21:26:41.879 INFO:tasks.workunit.client.0.smithi032.stdout:5/285: mkdir d0/d16/d2a/d4d 0 2024-05-06T21:26:41.879 INFO:tasks.workunit.client.0.smithi032.stdout:5/286: write d0/d16/d2f/f43 [139030,89630] 0 2024-05-06T21:26:41.880 INFO:tasks.workunit.client.0.smithi032.stdout:5/287: chown d0/d24/d26/d3d 87070 1 2024-05-06T21:26:41.880 INFO:tasks.workunit.client.0.smithi032.stdout:5/288: write d0/d16/d2f/f43 [180321,91404] 0 2024-05-06T21:26:41.880 INFO:tasks.workunit.client.0.smithi032.stdout:5/289: getdents d0/d16/d2a/d4d 0 2024-05-06T21:26:41.881 INFO:tasks.workunit.client.0.smithi032.stdout:9/445: mkdir d1/d13/d33/d8e 0 2024-05-06T21:26:41.882 INFO:tasks.workunit.client.0.smithi032.stdout:8/500: mkdir d0/d1b/d39/d93 0 2024-05-06T21:26:41.883 INFO:tasks.workunit.client.0.smithi032.stdout:3/495: symlink d1/d4/lac 0 2024-05-06T21:26:41.890 INFO:tasks.workunit.client.0.smithi032.stdout:9/446: creat d1/d13/d34/d26/d39/d8b/f8f x:0 0 0 2024-05-06T21:26:41.890 INFO:tasks.workunit.client.0.smithi032.stdout:9/447: write d1/d13/d33/d5e/d78/f8d [49994,48696] 0 2024-05-06T21:26:41.891 INFO:tasks.workunit.client.0.smithi032.stdout:3/496: mknod d1/d4/da/d31/d47/cad 0 2024-05-06T21:26:41.893 INFO:tasks.workunit.client.0.smithi032.stdout:8/501: rmdir d0/d1c/d5e 39 2024-05-06T21:26:41.895 INFO:tasks.workunit.client.0.smithi032.stdout:8/502: getdents d0/d1b/d39/d3b/d57/d5d 0 2024-05-06T21:26:41.895 INFO:tasks.workunit.client.0.smithi032.stdout:8/503: dread - d0/d1b/d39/d3b/d57/d5d/d63/d7f/f8f zero size 2024-05-06T21:26:41.895 INFO:tasks.workunit.client.0.smithi032.stdout:8/504: chown d0/d1b/d39/d3b/d57/f79 8 1 2024-05-06T21:26:41.895 INFO:tasks.workunit.client.0.smithi032.stdout:8/505: creat d0/d1b/d47/f94 x:0 0 0 2024-05-06T21:26:41.895 INFO:tasks.workunit.client.0.smithi032.stdout:8/506: truncate d0/d1b/d39/d3b/d57/d5d/d63/f8e 897754 0 2024-05-06T21:26:41.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/507: dread d0/d1c/d5e/f73 [0,4194304] 0 2024-05-06T21:26:41.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/508: fsync d0/f16 0 2024-05-06T21:26:41.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/509: read - d0/d1b/d47/f7d zero size 2024-05-06T21:26:41.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/510: truncate d0/d1b/d39/d3b/d57/d5d/d63/f8e 1419677 0 2024-05-06T21:26:41.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/511: creat d0/d1b/f95 x:0 0 0 2024-05-06T21:26:41.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/512: stat d0/f16 0 2024-05-06T21:26:41.897 INFO:tasks.workunit.client.0.smithi032.stdout:8/513: creat d0/d1b/d39/f96 x:0 0 0 2024-05-06T21:26:41.897 INFO:tasks.workunit.client.0.smithi032.stdout:5/290: dwrite d0/d16/f1e [0,4194304] 0 2024-05-06T21:26:41.898 INFO:tasks.workunit.client.0.smithi032.stdout:3/497: dread d1/d4/da/d4e/d41/f66 [0,4194304] 0 2024-05-06T21:26:41.898 INFO:tasks.workunit.client.0.smithi032.stdout:3/498: chown d1/d4/da/d4e/d41/d43/c94 7 1 2024-05-06T21:26:41.898 INFO:tasks.workunit.client.0.smithi032.stdout:3/499: chown d1/d4/d11/f4f 183 1 2024-05-06T21:26:41.899 INFO:tasks.workunit.client.0.smithi032.stdout:8/514: mkdir d0/d1b/d39/d3b/d97 0 2024-05-06T21:26:41.900 INFO:tasks.workunit.client.0.smithi032.stdout:3/500: dread d1/d4/da/d31/d9b/f9e [0,4194304] 0 2024-05-06T21:26:41.902 INFO:tasks.workunit.client.0.smithi032.stdout:9/448: getdents d1/d13/d33 0 2024-05-06T21:26:41.903 INFO:tasks.workunit.client.0.smithi032.stdout:9/449: chown d1/d13/d34/d26/f71 959270647 1 2024-05-06T21:26:41.904 INFO:tasks.workunit.client.0.smithi032.stdout:8/515: rename d0/d1b/d39/d3b/d57/f6e to d0/d1b/d39/d3b/d97/f98 0 2024-05-06T21:26:41.905 INFO:tasks.workunit.client.0.smithi032.stdout:3/501: mknod d1/d4/da/d9f/d74/da7/cae 0 2024-05-06T21:26:41.906 INFO:tasks.workunit.client.0.smithi032.stdout:8/516: dread d0/d1b/f34 [0,4194304] 0 2024-05-06T21:26:41.907 INFO:tasks.workunit.client.0.smithi032.stdout:5/291: mkdir d0/d4e 0 2024-05-06T21:26:41.908 INFO:tasks.workunit.client.0.smithi032.stdout:9/450: symlink d1/d13/d25/d64/d72/l90 0 2024-05-06T21:26:41.910 INFO:tasks.workunit.client.0.smithi032.stdout:3/502: symlink d1/d4/da/d31/d9b/daa/laf 0 2024-05-06T21:26:41.910 INFO:tasks.workunit.client.0.smithi032.stdout:3/503: write d1/f58 [2902576,112331] 0 2024-05-06T21:26:41.911 INFO:tasks.workunit.client.0.smithi032.stdout:8/517: mkdir d0/d1b/d39/d3b/d57/d5d/d63/d7f/d99 0 2024-05-06T21:26:41.911 INFO:tasks.workunit.client.0.smithi032.stdout:8/518: chown d0/d1b/d39/d3b/d57/d5d/d63/d85 2305 1 2024-05-06T21:26:41.913 INFO:tasks.workunit.client.0.smithi032.stdout:3/504: mknod d1/d2a/d71/d9d/da9/cb0 0 2024-05-06T21:26:41.914 INFO:tasks.workunit.client.0.smithi032.stdout:5/292: dread d0/d24/d38/f30 [0,4194304] 0 2024-05-06T21:26:41.914 INFO:tasks.workunit.client.0.smithi032.stdout:5/293: fdatasync d0/d16/d2f/f41 0 2024-05-06T21:26:41.914 INFO:tasks.workunit.client.0.smithi032.stdout:5/294: truncate d0/d24/d38/f3c 4589649 0 2024-05-06T21:26:41.914 INFO:tasks.workunit.client.0.smithi032.stdout:5/295: creat d0/d24/d34/f4f x:0 0 0 2024-05-06T21:26:41.915 INFO:tasks.workunit.client.0.smithi032.stdout:8/519: creat d0/f9a x:0 0 0 2024-05-06T21:26:41.915 INFO:tasks.workunit.client.0.smithi032.stdout:5/296: write d0/fe [4410547,74994] 0 2024-05-06T21:26:41.915 INFO:tasks.workunit.client.0.smithi032.stdout:8/520: dread d0/d1c/d5e/d67/d7b/f86 [0,4194304] 0 2024-05-06T21:26:41.917 INFO:tasks.workunit.client.0.smithi032.stdout:5/297: mkdir d0/d24/d26/d3d/d50 0 2024-05-06T21:26:41.918 INFO:tasks.workunit.client.0.smithi032.stdout:8/521: symlink d0/d1b/d39/l9b 0 2024-05-06T21:26:41.921 INFO:tasks.workunit.client.0.smithi032.stdout:8/522: link d0/d1c/d5e/c75 d0/d1b/d47/c9c 0 2024-05-06T21:26:41.926 INFO:tasks.workunit.client.0.smithi032.stdout:9/451: dread d1/f1a [0,4194304] 0 2024-05-06T21:26:41.926 INFO:tasks.workunit.client.0.smithi032.stdout:9/452: write d1/d2f/f3c [2017316,122014] 0 2024-05-06T21:26:41.926 INFO:tasks.workunit.client.0.smithi032.stdout:9/453: fsync d1/d13/d25/f2e 0 2024-05-06T21:26:41.928 INFO:tasks.workunit.client.0.smithi032.stdout:5/298: getdents d0/d24/d26/d3d 0 2024-05-06T21:26:41.933 INFO:tasks.workunit.client.1.smithi154.stdout:2/67: sync 2024-05-06T21:26:41.933 INFO:tasks.workunit.client.1.smithi154.stdout:7/16: sync 2024-05-06T21:26:41.933 INFO:tasks.workunit.client.1.smithi154.stdout:1/65: sync 2024-05-06T21:26:41.934 INFO:tasks.workunit.client.1.smithi154.stdout:6/17: sync 2024-05-06T21:26:41.934 INFO:tasks.workunit.client.1.smithi154.stdout:5/27: sync 2024-05-06T21:26:41.934 INFO:tasks.workunit.client.1.smithi154.stdout:0/38: sync 2024-05-06T21:26:41.934 INFO:tasks.workunit.client.1.smithi154.stdout:3/35: sync 2024-05-06T21:26:41.934 INFO:tasks.workunit.client.1.smithi154.stdout:0/39: getdents d6/dc 0 2024-05-06T21:26:41.934 INFO:tasks.workunit.client.1.smithi154.stdout:6/18: creat f6 x:0 0 0 2024-05-06T21:26:41.934 INFO:tasks.workunit.client.1.smithi154.stdout:1/66: write d6/f8 [4765926,104609] 0 2024-05-06T21:26:41.934 INFO:tasks.workunit.client.1.smithi154.stdout:6/19: creat f7 x:0 0 0 2024-05-06T21:26:41.934 INFO:tasks.workunit.client.1.smithi154.stdout:6/20: readlink l5 0 2024-05-06T21:26:41.935 INFO:tasks.workunit.client.1.smithi154.stdout:4/37: sync 2024-05-06T21:26:41.935 INFO:tasks.workunit.client.1.smithi154.stdout:9/32: sync 2024-05-06T21:26:41.935 INFO:tasks.workunit.client.1.smithi154.stdout:9/33: stat l4 0 2024-05-06T21:26:41.935 INFO:tasks.workunit.client.1.smithi154.stdout:9/34: write d5/fa [699262,17030] 0 2024-05-06T21:26:41.935 INFO:tasks.workunit.client.1.smithi154.stdout:8/87: sync 2024-05-06T21:26:41.935 INFO:tasks.workunit.client.0.smithi032.stdout:9/454: dread d1/fe [0,4194304] 0 2024-05-06T21:26:41.936 INFO:tasks.workunit.client.1.smithi154.stdout:7/17: write f4 [118334,27106] 0 2024-05-06T21:26:41.936 INFO:tasks.workunit.client.1.smithi154.stdout:7/18: rmdir - no directory 2024-05-06T21:26:41.936 INFO:tasks.workunit.client.1.smithi154.stdout:7/19: read f4 [267932,6343] 0 2024-05-06T21:26:41.936 INFO:tasks.workunit.client.1.smithi154.stdout:7/20: stat f4 0 2024-05-06T21:26:41.936 INFO:tasks.workunit.client.1.smithi154.stdout:5/28: creat d2/d3/f9 x:0 0 0 2024-05-06T21:26:41.940 INFO:tasks.workunit.client.1.smithi154.stdout:9/35: link l4 d5/lc 0 2024-05-06T21:26:41.940 INFO:tasks.workunit.client.1.smithi154.stdout:9/36: truncate d5/f8 290123 0 2024-05-06T21:26:41.941 INFO:tasks.workunit.client.1.smithi154.stdout:2/68: symlink db/de/d10/l15 0 2024-05-06T21:26:41.942 INFO:tasks.workunit.client.1.smithi154.stdout:5/29: link d2/d6/f7 d2/d3/fa 0 2024-05-06T21:26:41.944 INFO:tasks.workunit.client.1.smithi154.stdout:9/37: symlink d5/ld 0 2024-05-06T21:26:41.944 INFO:tasks.workunit.client.1.smithi154.stdout:9/38: creat d5/fe x:0 0 0 2024-05-06T21:26:41.944 INFO:tasks.workunit.client.1.smithi154.stdout:9/39: creat d5/ff x:0 0 0 2024-05-06T21:26:41.944 INFO:tasks.workunit.client.1.smithi154.stdout:9/40: chown d5/fa 3620374 1 2024-05-06T21:26:41.945 INFO:tasks.workunit.client.1.smithi154.stdout:2/69: mkdir db/de/d16 0 2024-05-06T21:26:41.947 INFO:tasks.workunit.client.0.smithi032.stdout:3/505: dwrite d1/d4/da/d4e/d41/d45/f6a [0,4194304] 0 2024-05-06T21:26:41.947 INFO:tasks.workunit.client.0.smithi032.stdout:3/506: dread - d1/d4/da/d4e/d41/d97/d67/da6/f99 zero size 2024-05-06T21:26:41.949 INFO:tasks.workunit.client.1.smithi154.stdout:3/36: write d0/f3 [3037611,36528] 0 2024-05-06T21:26:41.950 INFO:tasks.workunit.client.1.smithi154.stdout:2/70: symlink db/de/d10/l17 0 2024-05-06T21:26:41.950 INFO:tasks.workunit.client.1.smithi154.stdout:2/71: truncate db/de/d10/f14 40254 0 2024-05-06T21:26:41.950 INFO:tasks.workunit.client.1.smithi154.stdout:2/72: truncate db/de/d10/f14 837185 0 2024-05-06T21:26:41.954 INFO:tasks.workunit.client.1.smithi154.stdout:3/37: mknod d0/d4/d8/c9 0 2024-05-06T21:26:41.954 INFO:tasks.workunit.client.1.smithi154.stdout:3/38: chown d0/d2 44886830 1 2024-05-06T21:26:41.954 INFO:tasks.workunit.client.1.smithi154.stdout:3/39: write d0/f3 [2519276,44886] 0 2024-05-06T21:26:41.954 INFO:tasks.workunit.client.1.smithi154.stdout:3/40: write d0/f3 [3742492,119227] 0 2024-05-06T21:26:41.963 INFO:tasks.workunit.client.0.smithi032.stdout:8/523: dwrite d0/f4 [0,4194304] 0 2024-05-06T21:26:41.966 INFO:tasks.workunit.client.0.smithi032.stdout:8/524: mkdir d0/d1c/d5e/d67/d9d 0 2024-05-06T21:26:41.966 INFO:tasks.workunit.client.0.smithi032.stdout:8/525: chown d0/d1b/d39/f48 0 1 2024-05-06T21:26:41.966 INFO:tasks.workunit.client.0.smithi032.stdout:8/526: chown d0/d1c/d5e/f7a 7 1 2024-05-06T21:26:41.979 INFO:tasks.workunit.client.0.smithi032.stdout:5/299: dwrite d0/d16/f1e [0,4194304] 0 2024-05-06T21:26:41.979 INFO:tasks.workunit.client.0.smithi032.stdout:5/300: chown d0/f27 9 1 2024-05-06T21:26:41.983 INFO:tasks.workunit.client.0.smithi032.stdout:8/527: write d0/f1f [4086293,72145] 0 2024-05-06T21:26:41.983 INFO:tasks.workunit.client.1.smithi154.stdout:9/41: dwrite d5/f6 [0,4194304] 0 2024-05-06T21:26:41.987 INFO:tasks.workunit.client.1.smithi154.stdout:6/21: getdents . 0 2024-05-06T21:26:41.987 INFO:tasks.workunit.client.1.smithi154.stdout:6/22: chown c0 14 1 2024-05-06T21:26:41.988 INFO:tasks.workunit.client.1.smithi154.stdout:1/67: dwrite d6/f8 [0,4194304] 0 2024-05-06T21:26:41.988 INFO:tasks.workunit.client.1.smithi154.stdout:8/88: dwrite d3/fc [0,4194304] 0 2024-05-06T21:26:41.988 INFO:tasks.workunit.client.0.smithi032.stdout:3/507: dwrite d1/d4/da/d9f/fa1 [0,4194304] 0 2024-05-06T21:26:41.989 INFO:tasks.workunit.client.0.smithi032.stdout:3/508: write d1/d4/da/d4e/d41/fa3 [1376478,76537] 0 2024-05-06T21:26:41.989 INFO:tasks.workunit.client.0.smithi032.stdout:9/455: dwrite d1/d13/d34/d26/f71 [4194304,4194304] 0 2024-05-06T21:26:41.990 INFO:tasks.workunit.client.1.smithi154.stdout:0/40: dwrite d6/f8 [0,4194304] 0 2024-05-06T21:26:41.993 INFO:tasks.workunit.client.1.smithi154.stdout:5/30: rmdir d2/d3 39 2024-05-06T21:26:41.994 INFO:tasks.workunit.client.1.smithi154.stdout:5/31: chown d2/d6 45 1 2024-05-06T21:26:41.994 INFO:tasks.workunit.client.1.smithi154.stdout:5/32: chown d2/d3 438245 1 2024-05-06T21:26:41.994 INFO:tasks.workunit.client.1.smithi154.stdout:5/33: chown d2/d3/fa 0 1 2024-05-06T21:26:41.994 INFO:tasks.workunit.client.1.smithi154.stdout:2/73: dwrite f2 [4194304,4194304] 0 2024-05-06T21:26:41.995 INFO:tasks.workunit.client.1.smithi154.stdout:2/74: readlink db/lf 0 2024-05-06T21:26:41.998 INFO:tasks.workunit.client.1.smithi154.stdout:9/42: rename d5/l9 to d5/l10 0 2024-05-06T21:26:41.999 INFO:tasks.workunit.client.1.smithi154.stdout:6/23: mkdir d8 0 2024-05-06T21:26:42.005 INFO:tasks.workunit.client.1.smithi154.stdout:1/68: dwrite d6/fd [0,4194304] 0 2024-05-06T21:26:42.006 INFO:tasks.workunit.client.1.smithi154.stdout:5/34: rmdir d2/d6 39 2024-05-06T21:26:42.008 INFO:tasks.workunit.client.1.smithi154.stdout:2/75: mkdir db/de/d10/d18 0 2024-05-06T21:26:42.009 INFO:tasks.workunit.client.1.smithi154.stdout:9/43: mknod d5/c11 0 2024-05-06T21:26:42.009 INFO:tasks.workunit.client.1.smithi154.stdout:9/44: creat d5/f12 x:0 0 0 2024-05-06T21:26:42.010 INFO:tasks.workunit.client.1.smithi154.stdout:6/24: mkdir d8/d9 0 2024-05-06T21:26:42.012 INFO:tasks.workunit.client.1.smithi154.stdout:8/89: rename d3/d14/f15 to d3/f21 0 2024-05-06T21:26:42.014 INFO:tasks.workunit.client.1.smithi154.stdout:5/35: rmdir d2/d6 39 2024-05-06T21:26:42.014 INFO:tasks.workunit.client.1.smithi154.stdout:5/36: truncate d2/d3/f9 932016 0 2024-05-06T21:26:42.015 INFO:tasks.workunit.client.1.smithi154.stdout:2/76: mkdir db/d12/d19 0 2024-05-06T21:26:42.016 INFO:tasks.workunit.client.0.smithi032.stdout:5/301: rmdir d0/d16/d2a 39 2024-05-06T21:26:42.017 INFO:tasks.workunit.client.1.smithi154.stdout:8/90: mkdir d3/d14/d1a/d22 0 2024-05-06T21:26:42.017 INFO:tasks.workunit.client.1.smithi154.stdout:1/69: getdents d6/db 0 2024-05-06T21:26:42.018 INFO:tasks.workunit.client.1.smithi154.stdout:9/45: write d5/f6 [1735151,12448] 0 2024-05-06T21:26:42.019 INFO:tasks.workunit.client.1.smithi154.stdout:5/37: creat d2/d6/fb x:0 0 0 2024-05-06T21:26:42.022 INFO:tasks.workunit.client.1.smithi154.stdout:5/38: dread d2/f4 [0,4194304] 0 2024-05-06T21:26:42.023 INFO:tasks.workunit.client.1.smithi154.stdout:5/39: chown d2 65350649 1 2024-05-06T21:26:42.023 INFO:tasks.workunit.client.1.smithi154.stdout:5/40: write d2/d6/f7 [1230591,86704] 0 2024-05-06T21:26:42.023 INFO:tasks.workunit.client.1.smithi154.stdout:3/41: truncate d0/f3 1274821 0 2024-05-06T21:26:42.024 INFO:tasks.workunit.client.1.smithi154.stdout:5/41: mkdir d2/d6/dc 0 2024-05-06T21:26:42.025 INFO:tasks.workunit.client.1.smithi154.stdout:5/42: mkdir d2/d6/dd 0 2024-05-06T21:26:42.029 INFO:tasks.workunit.client.1.smithi154.stdout:2/77: dread f5 [0,4194304] 0 2024-05-06T21:26:42.030 INFO:tasks.workunit.client.1.smithi154.stdout:0/41: truncate d6/f8 908521 0 2024-05-06T21:26:42.030 INFO:tasks.workunit.client.1.smithi154.stdout:0/42: chown f4 194724467 1 2024-05-06T21:26:42.031 INFO:tasks.workunit.client.1.smithi154.stdout:2/78: rmdir db/dd 0 2024-05-06T21:26:42.032 INFO:tasks.workunit.client.1.smithi154.stdout:1/70: dread d6/f8 [0,4194304] 0 2024-05-06T21:26:42.032 INFO:tasks.workunit.client.1.smithi154.stdout:1/71: truncate d6/f8 5628975 0 2024-05-06T21:26:42.032 INFO:tasks.workunit.client.1.smithi154.stdout:6/25: dwrite f7 [0,4194304] 0 2024-05-06T21:26:42.033 INFO:tasks.workunit.client.1.smithi154.stdout:5/43: fsync d2/d3/fa 0 2024-05-06T21:26:42.033 INFO:tasks.workunit.client.1.smithi154.stdout:1/72: mknod d6/db/d10/c13 0 2024-05-06T21:26:42.037 INFO:tasks.workunit.client.1.smithi154.stdout:6/26: rename l5 to d8/la 0 2024-05-06T21:26:42.041 INFO:tasks.workunit.client.1.smithi154.stdout:9/46: truncate d5/f6 1837168 0 2024-05-06T21:26:42.044 INFO:tasks.workunit.client.1.smithi154.stdout:6/27: dread f1 [0,4194304] 0 2024-05-06T21:26:42.047 INFO:tasks.workunit.client.1.smithi154.stdout:6/28: rename d8/d9 to d8/db 0 2024-05-06T21:26:42.047 INFO:tasks.workunit.client.1.smithi154.stdout:0/43: dread f4 [0,4194304] 0 2024-05-06T21:26:42.047 INFO:tasks.workunit.client.1.smithi154.stdout:1/73: write d6/fd [2230353,39429] 0 2024-05-06T21:26:42.047 INFO:tasks.workunit.client.1.smithi154.stdout:1/74: chown d6/f8 4773 1 2024-05-06T21:26:42.048 INFO:tasks.workunit.client.1.smithi154.stdout:0/44: creat d6/dc/fd x:0 0 0 2024-05-06T21:26:42.048 INFO:tasks.workunit.client.1.smithi154.stdout:0/45: fsync f4 0 2024-05-06T21:26:42.053 INFO:tasks.workunit.client.1.smithi154.stdout:2/79: dread db/de/f11 [0,4194304] 0 2024-05-06T21:26:42.054 INFO:tasks.workunit.client.1.smithi154.stdout:2/80: symlink db/de/d10/d18/l1a 0 2024-05-06T21:26:42.062 INFO:tasks.workunit.client.1.smithi154.stdout:1/75: write d6/fc [4320180,87546] 0 2024-05-06T21:26:42.063 INFO:tasks.workunit.client.1.smithi154.stdout:1/76: readlink l1 0 2024-05-06T21:26:42.064 INFO:tasks.workunit.client.1.smithi154.stdout:1/77: mknod d6/db/d10/c14 0 2024-05-06T21:26:42.068 INFO:tasks.workunit.client.0.smithi032.stdout:3/509: mkdir d1/d4/da/d9f/d74/db1 0 2024-05-06T21:26:42.068 INFO:tasks.workunit.client.0.smithi032.stdout:3/510: write d1/d4/da/d4e/d41/d43/f70 [984049,103358] 0 2024-05-06T21:26:42.068 INFO:tasks.workunit.client.0.smithi032.stdout:3/511: chown d1/d4/da/d31/d9b/daa 22 1 2024-05-06T21:26:42.071 INFO:tasks.workunit.client.0.smithi032.stdout:9/456: mkdir d1/d13/d34/d91 0 2024-05-06T21:26:42.071 INFO:tasks.workunit.client.0.smithi032.stdout:9/457: write d1/d13/d33/d3f/f4e [5092315,93658] 0 2024-05-06T21:26:42.071 INFO:tasks.workunit.client.0.smithi032.stdout:9/458: chown d1/d13/d34/f43 59 1 2024-05-06T21:26:42.072 INFO:tasks.workunit.client.0.smithi032.stdout:5/302: mknod d0/d16/d46/c51 0 2024-05-06T21:26:42.072 INFO:tasks.workunit.client.0.smithi032.stdout:5/303: readlink d0/l20 0 2024-05-06T21:26:42.073 INFO:tasks.workunit.client.0.smithi032.stdout:8/528: rmdir d0/d1b/d39/d3b/d57 39 2024-05-06T21:26:42.075 INFO:tasks.workunit.client.0.smithi032.stdout:3/512: symlink d1/lb2 0 2024-05-06T21:26:42.075 INFO:tasks.workunit.client.0.smithi032.stdout:5/304: mkdir d0/d16/d2a/d52 0 2024-05-06T21:26:42.075 INFO:tasks.workunit.client.0.smithi032.stdout:5/305: stat d0/fe 0 2024-05-06T21:26:42.076 INFO:tasks.workunit.client.0.smithi032.stdout:8/529: rmdir d0/d1b/d39/d3b/d57/d5d 39 2024-05-06T21:26:42.076 INFO:tasks.workunit.client.0.smithi032.stdout:8/530: stat d0/f1a 0 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:0/401: sync 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:2/355: sync 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:1/402: sync 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:7/467: sync 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:6/499: sync 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:1/403: chown db/c11 499584 1 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:2/356: chown df/d19/d1e/d1f/d2e/d33/f1d 10 1 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:7/468: chown db/d12/d16/d2a/d39/l5d 948877 1 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:2/357: chown df/d19 1 1 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:3/513: creat d1/d4/da/d4e/d41/d43/fb3 x:0 0 0 2024-05-06T21:26:42.077 INFO:tasks.workunit.client.0.smithi032.stdout:3/514: chown d1/c1f 0 1 2024-05-06T21:26:42.078 INFO:tasks.workunit.client.0.smithi032.stdout:5/306: getdents d0/d24 0 2024-05-06T21:26:42.078 INFO:tasks.workunit.client.0.smithi032.stdout:8/531: dread d0/d1b/d39/f6b [0,4194304] 0 2024-05-06T21:26:42.078 INFO:tasks.workunit.client.0.smithi032.stdout:2/358: truncate df/d19/d1e/d35/f56 64697 0 2024-05-06T21:26:42.079 INFO:tasks.workunit.client.0.smithi032.stdout:7/469: creat db/f8f x:0 0 0 2024-05-06T21:26:42.082 INFO:tasks.workunit.client.0.smithi032.stdout:5/307: unlink d0/d16/d46/c51 0 2024-05-06T21:26:42.082 INFO:tasks.workunit.client.0.smithi032.stdout:3/515: symlink d1/d4/da/d4e/d41/d43/lb4 0 2024-05-06T21:26:42.082 INFO:tasks.workunit.client.0.smithi032.stdout:8/532: rmdir d0/d1b/d39/d3b/d57 39 2024-05-06T21:26:42.082 INFO:tasks.workunit.client.0.smithi032.stdout:8/533: write d0/d1b/f70 [215514,128425] 0 2024-05-06T21:26:42.082 INFO:tasks.workunit.client.0.smithi032.stdout:6/500: dread d8/dd/d18/f19 [0,4194304] 0 2024-05-06T21:26:42.082 INFO:tasks.workunit.client.0.smithi032.stdout:6/501: chown d8/d3d/d49 517350435 1 2024-05-06T21:26:42.082 INFO:tasks.workunit.client.0.smithi032.stdout:6/502: readlink d8/d3d/l3c 0 2024-05-06T21:26:42.083 INFO:tasks.workunit.client.0.smithi032.stdout:2/359: symlink df/d19/d1e/d35/d3f/d46/l81 0 2024-05-06T21:26:42.084 INFO:tasks.workunit.client.0.smithi032.stdout:5/308: creat d0/d24/d38/d37/f53 x:0 0 0 2024-05-06T21:26:42.086 INFO:tasks.workunit.client.0.smithi032.stdout:8/534: mknod d0/d1b/d39/d3b/d57/d5d/d63/d85/c9e 0 2024-05-06T21:26:42.086 INFO:tasks.workunit.client.0.smithi032.stdout:8/535: read d0/d1b/f34 [702882,24809] 0 2024-05-06T21:26:42.088 INFO:tasks.workunit.client.1.smithi154.stdout:5/44: dwrite d2/d3/fa [0,4194304] 0 2024-05-06T21:26:42.088 INFO:tasks.workunit.client.0.smithi032.stdout:6/503: unlink d8/dd/d1b/f57 0 2024-05-06T21:26:42.088 INFO:tasks.workunit.client.1.smithi154.stdout:9/47: dwrite d5/fe [0,4194304] 0 2024-05-06T21:26:42.089 INFO:tasks.workunit.client.0.smithi032.stdout:7/470: getdents db/d12/d16/d2a/d39/d8b 0 2024-05-06T21:26:42.089 INFO:tasks.workunit.client.1.smithi154.stdout:8/91: dwrite d3/fc [4194304,4194304] 0 2024-05-06T21:26:42.090 INFO:tasks.workunit.client.1.smithi154.stdout:3/42: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:42.090 INFO:tasks.workunit.client.1.smithi154.stdout:3/43: getdents d0/d2 0 2024-05-06T21:26:42.090 INFO:tasks.workunit.client.1.smithi154.stdout:0/46: dwrite d6/fb [0,4194304] 0 2024-05-06T21:26:42.091 INFO:tasks.workunit.client.1.smithi154.stdout:6/29: dwrite f2 [0,4194304] 0 2024-05-06T21:26:42.091 INFO:tasks.workunit.client.0.smithi032.stdout:2/360: mknod df/d19/c82 0 2024-05-06T21:26:42.091 INFO:tasks.workunit.client.0.smithi032.stdout:1/404: read db/f1f [3321569,79221] 0 2024-05-06T21:26:42.092 INFO:tasks.workunit.client.0.smithi032.stdout:1/405: write db/d16/d46/f78 [673856,69150] 0 2024-05-06T21:26:42.093 INFO:tasks.workunit.client.1.smithi154.stdout:9/48: rename d5/fa to d5/f13 0 2024-05-06T21:26:42.094 INFO:tasks.workunit.client.0.smithi032.stdout:8/536: dread d0/d1c/f24 [0,4194304] 0 2024-05-06T21:26:42.094 INFO:tasks.workunit.client.0.smithi032.stdout:8/537: chown d0/d1b/d39/d3b/d57/d5d/d63/d85/f8c 308756972 1 2024-05-06T21:26:42.094 INFO:tasks.workunit.client.0.smithi032.stdout:8/538: readlink d0/l56 0 2024-05-06T21:26:42.094 INFO:tasks.workunit.client.0.smithi032.stdout:6/504: truncate d8/dd/d18/d3b/f50 256830 0 2024-05-06T21:26:42.095 INFO:tasks.workunit.client.0.smithi032.stdout:7/471: unlink db/d12/d16/f71 0 2024-05-06T21:26:42.096 INFO:tasks.workunit.client.1.smithi154.stdout:8/92: creat d3/d14/d1a/d22/f23 x:0 0 0 2024-05-06T21:26:42.098 INFO:tasks.workunit.client.0.smithi032.stdout:2/361: rename df/d19/d1e/d35/d3f/d46/l76 to df/d19/d1e/d35/l83 0 2024-05-06T21:26:42.098 INFO:tasks.workunit.client.0.smithi032.stdout:4/507: sync 2024-05-06T21:26:42.099 INFO:tasks.workunit.client.1.smithi154.stdout:2/81: truncate db/de/d10/f14 789747 0 2024-05-06T21:26:42.100 INFO:tasks.workunit.client.1.smithi154.stdout:2/82: creat db/de/d10/f1b x:0 0 0 2024-05-06T21:26:42.100 INFO:tasks.workunit.client.1.smithi154.stdout:2/83: write f5 [3408886,121269] 0 2024-05-06T21:26:42.103 INFO:tasks.workunit.client.1.smithi154.stdout:6/30: rmdir d8/db 0 2024-05-06T21:26:42.105 INFO:tasks.workunit.client.1.smithi154.stdout:9/49: mkdir d5/d14 0 2024-05-06T21:26:42.105 INFO:tasks.workunit.client.1.smithi154.stdout:9/50: stat d5/c11 0 2024-05-06T21:26:42.105 INFO:tasks.workunit.client.1.smithi154.stdout:9/51: dread - d5/f12 zero size 2024-05-06T21:26:42.106 INFO:tasks.workunit.client.1.smithi154.stdout:9/52: write d5/ff [692424,29945] 0 2024-05-06T21:26:42.106 INFO:tasks.workunit.client.1.smithi154.stdout:9/53: chown d5/ld 6888136 1 2024-05-06T21:26:42.106 INFO:tasks.workunit.client.0.smithi032.stdout:9/459: dread d1/d2f/f3c [0,4194304] 0 2024-05-06T21:26:42.106 INFO:tasks.workunit.client.1.smithi154.stdout:9/54: write d5/f8 [130933,99535] 0 2024-05-06T21:26:42.107 INFO:tasks.workunit.client.1.smithi154.stdout:9/55: getdents d5/d14 0 2024-05-06T21:26:42.107 INFO:tasks.workunit.client.0.smithi032.stdout:6/505: mknod d8/d3d/d8f/c93 0 2024-05-06T21:26:42.107 INFO:tasks.workunit.client.0.smithi032.stdout:6/506: write d8/d3d/d73/d87/f64 [991328,4078] 0 2024-05-06T21:26:42.107 INFO:tasks.workunit.client.0.smithi032.stdout:6/507: chown d8/d3d/d49/f60 824637135 1 2024-05-06T21:26:42.108 INFO:tasks.workunit.client.1.smithi154.stdout:3/44: dread d0/f3 [0,4194304] 0 2024-05-06T21:26:42.108 INFO:tasks.workunit.client.1.smithi154.stdout:3/45: chown d0/f3 529065944 1 2024-05-06T21:26:42.108 INFO:tasks.workunit.client.1.smithi154.stdout:3/46: chown d0/f3 3692 1 2024-05-06T21:26:42.108 INFO:tasks.workunit.client.0.smithi032.stdout:7/472: mknod db/c90 0 2024-05-06T21:26:42.109 INFO:tasks.workunit.client.1.smithi154.stdout:2/84: creat db/de/f1c x:0 0 0 2024-05-06T21:26:42.109 INFO:tasks.workunit.client.0.smithi032.stdout:0/402: dwrite d4/da/d16/f43 [4194304,4194304] 0 2024-05-06T21:26:42.110 INFO:tasks.workunit.client.0.smithi032.stdout:0/403: dread - d4/da/d16/d33/d46/f6e zero size 2024-05-06T21:26:42.110 INFO:tasks.workunit.client.1.smithi154.stdout:6/31: creat d8/fc x:0 0 0 2024-05-06T21:26:42.111 INFO:tasks.workunit.client.0.smithi032.stdout:2/362: mknod df/d19/d1e/d1f/d2e/d33/c84 0 2024-05-06T21:26:42.111 INFO:tasks.workunit.client.0.smithi032.stdout:2/363: truncate df/f31 536213 0 2024-05-06T21:26:42.111 INFO:tasks.workunit.client.0.smithi032.stdout:2/364: chown df/d19/d1e/d35/f6d 16454520 1 2024-05-06T21:26:42.112 INFO:tasks.workunit.client.1.smithi154.stdout:3/47: dread d0/f3 [0,4194304] 0 2024-05-06T21:26:42.113 INFO:tasks.workunit.client.0.smithi032.stdout:4/508: creat d2/d16/d44/d74/d76/fab x:0 0 0 2024-05-06T21:26:42.113 INFO:tasks.workunit.client.0.smithi032.stdout:4/509: write d2/d13/f8d [720392,65803] 0 2024-05-06T21:26:42.113 INFO:tasks.workunit.client.0.smithi032.stdout:4/510: read d2/d1e/f78 [212598,130085] 0 2024-05-06T21:26:42.113 INFO:tasks.workunit.client.1.smithi154.stdout:9/56: link d5/l10 d5/l15 0 2024-05-06T21:26:42.114 INFO:tasks.workunit.client.1.smithi154.stdout:9/57: readlink d5/l15 0 2024-05-06T21:26:42.114 INFO:tasks.workunit.client.1.smithi154.stdout:2/85: mkdir db/d12/d1d 0 2024-05-06T21:26:42.114 INFO:tasks.workunit.client.1.smithi154.stdout:0/47: dread f3 [0,4194304] 0 2024-05-06T21:26:42.115 INFO:tasks.workunit.client.1.smithi154.stdout:0/48: chown d6/fb 8651 1 2024-05-06T21:26:42.115 INFO:tasks.workunit.client.0.smithi032.stdout:9/460: mkdir d1/d13/d34/d92 0 2024-05-06T21:26:42.115 INFO:tasks.workunit.client.0.smithi032.stdout:5/309: rmdir d0/d16/d46 39 2024-05-06T21:26:42.115 INFO:tasks.workunit.client.1.smithi154.stdout:9/58: dread d5/f13 [0,4194304] 0 2024-05-06T21:26:42.117 INFO:tasks.workunit.client.1.smithi154.stdout:6/32: link c0 d8/cd 0 2024-05-06T21:26:42.117 INFO:tasks.workunit.client.0.smithi032.stdout:6/508: symlink d8/dd/d18/d13/l94 0 2024-05-06T21:26:42.117 INFO:tasks.workunit.client.0.smithi032.stdout:6/509: write d8/dd/d18/f19 [5538814,20411] 0 2024-05-06T21:26:42.120 INFO:tasks.workunit.client.0.smithi032.stdout:7/473: creat db/d12/d16/d21/d41/d78/f91 x:0 0 0 2024-05-06T21:26:42.120 INFO:tasks.workunit.client.1.smithi154.stdout:6/33: mknod d8/ce 0 2024-05-06T21:26:42.120 INFO:tasks.workunit.client.1.smithi154.stdout:6/34: creat d8/ff x:0 0 0 2024-05-06T21:26:42.120 INFO:tasks.workunit.client.1.smithi154.stdout:6/35: chown f6 11576953 1 2024-05-06T21:26:42.120 INFO:tasks.workunit.client.1.smithi154.stdout:6/36: write f6 [978227,90231] 0 2024-05-06T21:26:42.121 INFO:tasks.workunit.client.1.smithi154.stdout:6/37: write f6 [40435,78841] 0 2024-05-06T21:26:42.122 INFO:tasks.workunit.client.1.smithi154.stdout:3/48: write d0/f3 [3937716,80095] 0 2024-05-06T21:26:42.122 INFO:tasks.workunit.client.1.smithi154.stdout:6/38: chown d8/la 6 1 2024-05-06T21:26:42.122 INFO:tasks.workunit.client.1.smithi154.stdout:3/49: read d0/f3 [3907889,51896] 0 2024-05-06T21:26:42.122 INFO:tasks.workunit.client.1.smithi154.stdout:3/50: chown d0/d4/c6 12844208 1 2024-05-06T21:26:42.122 INFO:tasks.workunit.client.1.smithi154.stdout:8/93: dwrite d3/f8 [0,4194304] 0 2024-05-06T21:26:42.123 INFO:tasks.workunit.client.1.smithi154.stdout:9/59: dread d5/f8 [0,4194304] 0 2024-05-06T21:26:42.125 INFO:tasks.workunit.client.0.smithi032.stdout:0/404: readlink d4/l5 0 2024-05-06T21:26:42.125 INFO:tasks.workunit.client.0.smithi032.stdout:0/405: write d4/da/d16/d33/f38 [642950,51815] 0 2024-05-06T21:26:42.126 INFO:tasks.workunit.client.0.smithi032.stdout:0/406: chown d4/da/d16/f3b 0 1 2024-05-06T21:26:42.126 INFO:tasks.workunit.client.0.smithi032.stdout:0/407: chown d4/da/d14/d4a/f65 52042 1 2024-05-06T21:26:42.126 INFO:tasks.workunit.client.0.smithi032.stdout:0/408: chown d4/d3e/d42/f79 269 1 2024-05-06T21:26:42.126 INFO:tasks.workunit.client.1.smithi154.stdout:9/60: dread d5/f13 [0,4194304] 0 2024-05-06T21:26:42.126 INFO:tasks.workunit.client.1.smithi154.stdout:3/51: mkdir d0/da 0 2024-05-06T21:26:42.128 INFO:tasks.workunit.client.0.smithi032.stdout:2/365: rename df/d19/d1e/d1f/d2e/f3c to df/d19/d1e/d71/d5f/d7d/d65/f85 0 2024-05-06T21:26:42.130 INFO:tasks.workunit.client.0.smithi032.stdout:4/511: mknod d2/d16/d44/d45/d4e/cac 0 2024-05-06T21:26:42.131 INFO:tasks.workunit.client.1.smithi154.stdout:9/61: symlink d5/l16 0 2024-05-06T21:26:42.133 INFO:tasks.workunit.client.0.smithi032.stdout:6/510: symlink d8/dd/d18/d13/d7a/l95 0 2024-05-06T21:26:42.135 INFO:tasks.workunit.client.1.smithi154.stdout:8/94: link d3/l4 d3/d14/l24 0 2024-05-06T21:26:42.135 INFO:tasks.workunit.client.0.smithi032.stdout:7/474: mkdir db/d12/d16/d21/d41/d4b/d92 0 2024-05-06T21:26:42.138 INFO:tasks.workunit.client.0.smithi032.stdout:5/310: rename d0/d16/d2a/c2b to d0/d4e/c54 0 2024-05-06T21:26:42.138 INFO:tasks.workunit.client.0.smithi032.stdout:5/311: creat d0/d24/d38/d37/f55 x:0 0 0 2024-05-06T21:26:42.140 INFO:tasks.workunit.client.0.smithi032.stdout:2/366: creat df/d19/d1e/d71/d5f/d7d/d25/d2d/f86 x:0 0 0 2024-05-06T21:26:42.140 INFO:tasks.workunit.client.0.smithi032.stdout:7/475: dread db/d12/f17 [0,4194304] 0 2024-05-06T21:26:42.140 INFO:tasks.workunit.client.0.smithi032.stdout:2/367: write df/d19/f5b [5152502,55167] 0 2024-05-06T21:26:42.142 INFO:tasks.workunit.client.0.smithi032.stdout:4/512: symlink d2/d16/d44/d74/d76/lad 0 2024-05-06T21:26:42.144 INFO:tasks.workunit.client.0.smithi032.stdout:5/312: rmdir d0/d24/d26/d3d 39 2024-05-06T21:26:42.144 INFO:tasks.workunit.client.1.smithi154.stdout:9/62: link d5/lb d5/d14/l17 0 2024-05-06T21:26:42.144 INFO:tasks.workunit.client.1.smithi154.stdout:9/63: stat d5/d14 0 2024-05-06T21:26:42.145 INFO:tasks.workunit.client.1.smithi154.stdout:8/95: stat d3/d14/l24 0 2024-05-06T21:26:42.146 INFO:tasks.workunit.client.0.smithi032.stdout:7/476: rmdir db/d12/d16/d21/d41/d4b/d92 0 2024-05-06T21:26:42.148 INFO:tasks.workunit.client.0.smithi032.stdout:4/513: dread d2/d16/f67 [0,4194304] 0 2024-05-06T21:26:42.148 INFO:tasks.workunit.client.0.smithi032.stdout:5/313: creat d0/d24/d26/f56 x:0 0 0 2024-05-06T21:26:42.148 INFO:tasks.workunit.client.0.smithi032.stdout:5/314: rename d0/d16/d2a to d0/d16/d2a/d4d/d57 22 2024-05-06T21:26:42.148 INFO:tasks.workunit.client.0.smithi032.stdout:5/315: fdatasync d0/d24/d34/f45 0 2024-05-06T21:26:42.149 INFO:tasks.workunit.client.0.smithi032.stdout:7/477: mknod db/d12/d16/d21/d41/d7d/c93 0 2024-05-06T21:26:42.149 INFO:tasks.workunit.client.0.smithi032.stdout:7/478: stat db/d89 0 2024-05-06T21:26:42.149 INFO:tasks.workunit.client.0.smithi032.stdout:2/368: dread fe [0,4194304] 0 2024-05-06T21:26:42.150 INFO:tasks.workunit.client.0.smithi032.stdout:4/514: symlink d2/d16/d44/d54/lae 0 2024-05-06T21:26:42.150 INFO:tasks.workunit.client.0.smithi032.stdout:7/479: symlink db/d12/l94 0 2024-05-06T21:26:42.150 INFO:tasks.workunit.client.0.smithi032.stdout:7/480: fsync db/d12/f51 0 2024-05-06T21:26:42.152 INFO:tasks.workunit.client.0.smithi032.stdout:2/369: creat df/d19/d1e/d71/d5f/d73/f87 x:0 0 0 2024-05-06T21:26:42.152 INFO:tasks.workunit.client.0.smithi032.stdout:4/515: dread d2/d2c/d31/f91 [0,4194304] 0 2024-05-06T21:26:42.152 INFO:tasks.workunit.client.0.smithi032.stdout:4/516: write d2/d16/d44/d74/f8b [526416,45948] 0 2024-05-06T21:26:42.152 INFO:tasks.workunit.client.0.smithi032.stdout:4/517: readlink d2/d13/l15 0 2024-05-06T21:26:42.152 INFO:tasks.workunit.client.1.smithi154.stdout:9/64: dread d5/f6 [0,4194304] 0 2024-05-06T21:26:42.153 INFO:tasks.workunit.client.1.smithi154.stdout:9/65: symlink d5/l18 0 2024-05-06T21:26:42.153 INFO:tasks.workunit.client.1.smithi154.stdout:9/66: chown l4 9868453 1 2024-05-06T21:26:42.154 INFO:tasks.workunit.client.1.smithi154.stdout:9/67: truncate d5/f13 541708 0 2024-05-06T21:26:42.155 INFO:tasks.workunit.client.1.smithi154.stdout:9/68: creat d5/f19 x:0 0 0 2024-05-06T21:26:42.155 INFO:tasks.workunit.client.1.smithi154.stdout:9/69: creat d5/f1a x:0 0 0 2024-05-06T21:26:42.155 INFO:tasks.workunit.client.1.smithi154.stdout:9/70: write d5/f8 [1126433,33532] 0 2024-05-06T21:26:42.155 INFO:tasks.workunit.client.1.smithi154.stdout:9/71: dread - d5/f12 zero size 2024-05-06T21:26:42.155 INFO:tasks.workunit.client.1.smithi154.stdout:9/72: write d5/f1a [66094,118340] 0 2024-05-06T21:26:42.163 INFO:tasks.workunit.client.0.smithi032.stdout:5/316: write d0/f10 [4066933,80525] 0 2024-05-06T21:26:42.170 INFO:tasks.workunit.client.1.smithi154.stdout:2/86: dwrite db/de/f1c [0,4194304] 0 2024-05-06T21:26:42.171 INFO:tasks.workunit.client.1.smithi154.stdout:0/49: dwrite d6/fb [0,4194304] 0 2024-05-06T21:26:42.180 INFO:tasks.workunit.client.0.smithi032.stdout:5/317: dread d0/f10 [0,4194304] 0 2024-05-06T21:26:42.190 INFO:tasks.workunit.client.0.smithi032.stdout:5/318: dread d0/d24/d38/f3c [0,4194304] 0 2024-05-06T21:26:42.210 INFO:tasks.workunit.client.0.smithi032.stdout:6/511: dwrite d8/dd/d1b/d35/f86 [0,4194304] 0 2024-05-06T21:26:42.210 INFO:tasks.workunit.client.0.smithi032.stdout:6/512: chown d8/dd/d1b/d35/l88 5661 1 2024-05-06T21:26:42.211 INFO:tasks.workunit.client.0.smithi032.stdout:6/513: creat d8/d3d/d49/f96 x:0 0 0 2024-05-06T21:26:42.211 INFO:tasks.workunit.client.0.smithi032.stdout:6/514: chown d8/l5f 7543491 1 2024-05-06T21:26:42.211 INFO:tasks.workunit.client.0.smithi032.stdout:0/409: dwrite d4/da/d14/d1a/f4d [0,4194304] 0 2024-05-06T21:26:42.211 INFO:tasks.workunit.client.0.smithi032.stdout:0/410: chown d4/da/l45 0 1 2024-05-06T21:26:42.212 INFO:tasks.workunit.client.0.smithi032.stdout:9/461: dwrite d1/d13/d33/f7d [0,4194304] 0 2024-05-06T21:26:42.212 INFO:tasks.workunit.client.0.smithi032.stdout:8/539: dwrite d0/d1b/f31 [0,4194304] 0 2024-05-06T21:26:42.213 INFO:tasks.workunit.client.1.smithi154.stdout:6/39: dwrite d8/fc [0,4194304] 0 2024-05-06T21:26:42.214 INFO:tasks.workunit.client.1.smithi154.stdout:6/40: chown d8/cd 106911 1 2024-05-06T21:26:42.214 INFO:tasks.workunit.client.1.smithi154.stdout:6/41: creat d8/f10 x:0 0 0 2024-05-06T21:26:42.214 INFO:tasks.workunit.client.1.smithi154.stdout:6/42: fdatasync f1 0 2024-05-06T21:26:42.218 INFO:tasks.workunit.client.0.smithi032.stdout:4/518: dwrite d2/d2c/f49 [0,4194304] 0 2024-05-06T21:26:42.219 INFO:tasks.workunit.client.1.smithi154.stdout:3/52: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:42.220 INFO:tasks.workunit.client.1.smithi154.stdout:2/87: mknod db/de/d10/d18/c1e 0 2024-05-06T21:26:42.225 INFO:tasks.workunit.client.0.smithi032.stdout:6/515: dwrite d8/dd/f12 [0,4194304] 0 2024-05-06T21:26:42.226 INFO:tasks.workunit.client.1.smithi154.stdout:6/43: mkdir d8/d11 0 2024-05-06T21:26:42.229 INFO:tasks.workunit.client.1.smithi154.stdout:3/53: mkdir d0/da/db 0 2024-05-06T21:26:42.229 INFO:tasks.workunit.client.1.smithi154.stdout:3/54: chown d0/da/db 5762294 1 2024-05-06T21:26:42.232 INFO:tasks.workunit.client.1.smithi154.stdout:2/88: rename fa to db/de/d16/f1f 0 2024-05-06T21:26:42.232 INFO:tasks.workunit.client.1.smithi154.stdout:2/89: read - db/de/d10/f1b zero size 2024-05-06T21:26:42.233 INFO:tasks.workunit.client.1.smithi154.stdout:0/50: rmdir d6 39 2024-05-06T21:26:42.235 INFO:tasks.workunit.client.1.smithi154.stdout:3/55: creat d0/d4/d8/fc x:0 0 0 2024-05-06T21:26:42.237 INFO:tasks.workunit.client.1.smithi154.stdout:2/90: symlink db/d12/d19/l20 0 2024-05-06T21:26:42.238 INFO:tasks.workunit.client.1.smithi154.stdout:0/51: dread d6/f8 [0,4194304] 0 2024-05-06T21:26:42.239 INFO:tasks.workunit.client.1.smithi154.stdout:0/52: mkdir d6/de 0 2024-05-06T21:26:42.243 INFO:tasks.workunit.client.1.smithi154.stdout:9/73: rmdir d5 39 2024-05-06T21:26:42.243 INFO:tasks.workunit.client.1.smithi154.stdout:9/74: readlink l4 0 2024-05-06T21:26:42.243 INFO:tasks.workunit.client.1.smithi154.stdout:9/75: write d5/f8 [1766480,83312] 0 2024-05-06T21:26:42.243 INFO:tasks.workunit.client.1.smithi154.stdout:9/76: chown d5/d14/l17 0 1 2024-05-06T21:26:42.244 INFO:tasks.workunit.client.1.smithi154.stdout:9/77: readlink l3 0 2024-05-06T21:26:42.244 INFO:tasks.workunit.client.1.smithi154.stdout:9/78: truncate d5/f12 865262 0 2024-05-06T21:26:42.244 INFO:tasks.workunit.client.0.smithi032.stdout:6/516: dwrite d8/d3d/d49/d6b/f8a [0,4194304] 0 2024-05-06T21:26:42.245 INFO:tasks.workunit.client.1.smithi154.stdout:9/79: symlink d5/l1b 0 2024-05-06T21:26:42.245 INFO:tasks.workunit.client.1.smithi154.stdout:0/53: dread f3 [0,4194304] 0 2024-05-06T21:26:42.245 INFO:tasks.workunit.client.1.smithi154.stdout:0/54: chown d6/f8 1872196 1 2024-05-06T21:26:42.245 INFO:tasks.workunit.client.1.smithi154.stdout:9/80: creat d5/d14/f1c x:0 0 0 2024-05-06T21:26:42.245 INFO:tasks.workunit.client.1.smithi154.stdout:9/81: chown d5/f1a 72374 1 2024-05-06T21:26:42.246 INFO:tasks.workunit.client.1.smithi154.stdout:9/82: dread d5/f12 [0,4194304] 0 2024-05-06T21:26:42.246 INFO:tasks.workunit.client.1.smithi154.stdout:3/56: write d0/f3 [1479468,38536] 0 2024-05-06T21:26:42.246 INFO:tasks.workunit.client.1.smithi154.stdout:3/57: write d0/f3 [3788121,26108] 0 2024-05-06T21:26:42.247 INFO:tasks.workunit.client.1.smithi154.stdout:0/55: truncate d6/fb 4139186 0 2024-05-06T21:26:42.248 INFO:tasks.workunit.client.1.smithi154.stdout:9/83: mkdir d5/d14/d1d 0 2024-05-06T21:26:42.249 INFO:tasks.workunit.client.1.smithi154.stdout:9/84: truncate d5/ff 1096499 0 2024-05-06T21:26:42.252 INFO:tasks.workunit.client.0.smithi032.stdout:6/517: dread d8/dd/d1b/d35/f86 [0,4194304] 0 2024-05-06T21:26:42.252 INFO:tasks.workunit.client.0.smithi032.stdout:6/518: fdatasync d8/dd/d1b/d35/f44 0 2024-05-06T21:26:42.252 INFO:tasks.workunit.client.1.smithi154.stdout:0/56: mknod d6/de/cf 0 2024-05-06T21:26:42.252 INFO:tasks.workunit.client.1.smithi154.stdout:0/57: write f4 [5172746,115825] 0 2024-05-06T21:26:42.253 INFO:tasks.workunit.client.1.smithi154.stdout:9/85: unlink d5/ld 0 2024-05-06T21:26:42.253 INFO:tasks.workunit.client.1.smithi154.stdout:9/86: chown d5/d14/d1d 3972549 1 2024-05-06T21:26:42.254 INFO:tasks.workunit.client.1.smithi154.stdout:2/91: dwrite db/de/d10/f1b [0,4194304] 0 2024-05-06T21:26:42.258 INFO:tasks.workunit.client.1.smithi154.stdout:9/87: unlink d5/l10 0 2024-05-06T21:26:42.262 INFO:tasks.workunit.client.1.smithi154.stdout:2/92: unlink db/de/d10/l17 0 2024-05-06T21:26:42.263 INFO:tasks.workunit.client.1.smithi154.stdout:9/88: mkdir d5/d14/d1e 0 2024-05-06T21:26:42.264 INFO:tasks.workunit.client.1.smithi154.stdout:9/89: write d5/f12 [196822,47919] 0 2024-05-06T21:26:42.265 INFO:tasks.workunit.client.1.smithi154.stdout:3/58: rename d0/d4/d8 to d0/da/db/dd 0 2024-05-06T21:26:42.270 INFO:tasks.workunit.client.1.smithi154.stdout:0/58: rename d6/de to d6/d10 0 2024-05-06T21:26:42.273 INFO:tasks.workunit.client.1.smithi154.stdout:3/59: creat d0/fe x:0 0 0 2024-05-06T21:26:42.273 INFO:tasks.workunit.client.1.smithi154.stdout:3/60: stat d0 0 2024-05-06T21:26:42.274 INFO:tasks.workunit.client.1.smithi154.stdout:0/59: rmdir d6 39 2024-05-06T21:26:42.274 INFO:tasks.workunit.client.1.smithi154.stdout:0/60: fdatasync d6/fb 0 2024-05-06T21:26:42.276 INFO:tasks.workunit.client.1.smithi154.stdout:0/61: unlink d6/fb 0 2024-05-06T21:26:42.278 INFO:tasks.workunit.client.1.smithi154.stdout:0/62: creat d6/d10/f11 x:0 0 0 2024-05-06T21:26:42.278 INFO:tasks.workunit.client.1.smithi154.stdout:0/63: chown d6/f8 47270 1 2024-05-06T21:26:42.281 INFO:tasks.workunit.client.1.smithi154.stdout:9/90: dwrite d5/ff [0,4194304] 0 2024-05-06T21:26:42.281 INFO:tasks.workunit.client.1.smithi154.stdout:0/64: getdents d6/dc 0 2024-05-06T21:26:42.285 INFO:tasks.workunit.client.1.smithi154.stdout:0/65: symlink d6/dc/l12 0 2024-05-06T21:26:42.286 INFO:tasks.workunit.client.1.smithi154.stdout:3/61: fsync d0/fe 0 2024-05-06T21:26:42.289 INFO:tasks.workunit.client.1.smithi154.stdout:3/62: unlink d0/d4/c6 0 2024-05-06T21:26:42.291 INFO:tasks.workunit.client.1.smithi154.stdout:3/63: creat d0/da/db/dd/ff x:0 0 0 2024-05-06T21:26:42.292 INFO:tasks.workunit.client.1.smithi154.stdout:9/91: symlink d5/l1f 0 2024-05-06T21:26:42.297 INFO:tasks.workunit.client.0.smithi032.stdout:7/481: link l4 db/d12/d16/d21/d84/l95 0 2024-05-06T21:26:42.301 INFO:tasks.workunit.client.1.smithi154.stdout:3/64: rmdir d0 39 2024-05-06T21:26:42.301 INFO:tasks.workunit.client.1.smithi154.stdout:3/65: truncate d0/f3 4204006 0 2024-05-06T21:26:42.302 INFO:tasks.workunit.client.1.smithi154.stdout:3/66: chown d0/da/db/dd/ff 12619115 1 2024-05-06T21:26:42.303 INFO:tasks.workunit.client.1.smithi154.stdout:3/67: creat d0/da/db/f10 x:0 0 0 2024-05-06T21:26:42.304 INFO:tasks.workunit.client.1.smithi154.stdout:9/92: getdents d5/d14 0 2024-05-06T21:26:42.306 INFO:tasks.workunit.client.1.smithi154.stdout:9/93: rename d5/d14/d1d to d5/d20 0 2024-05-06T21:26:42.307 INFO:tasks.workunit.client.1.smithi154.stdout:0/66: dwrite d6/d10/f11 [0,4194304] 0 2024-05-06T21:26:42.308 INFO:tasks.workunit.client.1.smithi154.stdout:9/94: mknod d5/d14/d1e/c21 0 2024-05-06T21:26:42.308 INFO:tasks.workunit.client.1.smithi154.stdout:9/95: chown l1 1075562 1 2024-05-06T21:26:42.310 INFO:tasks.workunit.client.1.smithi154.stdout:9/96: mknod d5/d20/c22 0 2024-05-06T21:26:42.311 INFO:tasks.workunit.client.1.smithi154.stdout:9/97: fdatasync d5/fe 0 2024-05-06T21:26:42.311 INFO:tasks.workunit.client.0.smithi032.stdout:7/482: dwrite db/d12/f17 [0,4194304] 0 2024-05-06T21:26:42.311 INFO:tasks.workunit.client.0.smithi032.stdout:7/483: fsync db/d12/d16/f8a 0 2024-05-06T21:26:42.312 INFO:tasks.workunit.client.1.smithi154.stdout:9/98: stat d5/l1b 0 2024-05-06T21:26:42.313 INFO:tasks.workunit.client.1.smithi154.stdout:0/67: dread f3 [0,4194304] 0 2024-05-06T21:26:42.315 INFO:tasks.workunit.client.1.smithi154.stdout:0/68: getdents d6/dc 0 2024-05-06T21:26:42.315 INFO:tasks.workunit.client.1.smithi154.stdout:0/69: chown d6/d10/cf 16921997 1 2024-05-06T21:26:42.320 INFO:tasks.workunit.client.1.smithi154.stdout:3/68: dwrite d0/da/db/dd/fc [0,4194304] 0 2024-05-06T21:26:42.323 INFO:tasks.workunit.client.1.smithi154.stdout:3/69: creat d0/da/db/dd/f11 x:0 0 0 2024-05-06T21:26:42.323 INFO:tasks.workunit.client.1.smithi154.stdout:3/70: write d0/da/db/f10 [679995,83493] 0 2024-05-06T21:26:42.326 INFO:tasks.workunit.client.1.smithi154.stdout:3/71: symlink d0/d4/l12 0 2024-05-06T21:26:42.326 INFO:tasks.workunit.client.1.smithi154.stdout:3/72: rename d0/da/db to d0/da/db/d13 22 2024-05-06T21:26:42.327 INFO:tasks.workunit.client.1.smithi154.stdout:3/73: mkdir d0/da/d14 0 2024-05-06T21:26:42.327 INFO:tasks.workunit.client.1.smithi154.stdout:3/74: mknod d0/d4/c15 0 2024-05-06T21:26:42.337 INFO:tasks.workunit.client.1.smithi154.stdout:9/99: dwrite d5/f1a [0,4194304] 0 2024-05-06T21:26:42.340 INFO:tasks.workunit.client.1.smithi154.stdout:9/100: creat d5/d20/f23 x:0 0 0 2024-05-06T21:26:42.340 INFO:tasks.workunit.client.1.smithi154.stdout:9/101: fsync d5/fe 0 2024-05-06T21:26:42.342 INFO:tasks.workunit.client.1.smithi154.stdout:9/102: rename d5/ff to d5/d20/f24 0 2024-05-06T21:26:42.342 INFO:tasks.workunit.client.1.smithi154.stdout:9/103: dread - d5/d14/f1c zero size 2024-05-06T21:26:42.344 INFO:tasks.workunit.client.1.smithi154.stdout:9/104: mknod d5/d14/c25 0 2024-05-06T21:26:42.345 INFO:tasks.workunit.client.1.smithi154.stdout:3/75: write d0/da/db/dd/fc [227566,13046] 0 2024-05-06T21:26:42.345 INFO:tasks.workunit.client.1.smithi154.stdout:3/76: read - d0/da/db/dd/f11 zero size 2024-05-06T21:26:42.346 INFO:tasks.workunit.client.1.smithi154.stdout:9/105: creat d5/f26 x:0 0 0 2024-05-06T21:26:42.347 INFO:tasks.workunit.client.1.smithi154.stdout:9/106: chown d5/c11 636594 1 2024-05-06T21:26:42.347 INFO:tasks.workunit.client.1.smithi154.stdout:9/107: symlink d5/d14/l27 0 2024-05-06T21:26:42.348 INFO:tasks.workunit.client.1.smithi154.stdout:0/70: dwrite d6/f8 [0,4194304] 0 2024-05-06T21:26:42.348 INFO:tasks.workunit.client.1.smithi154.stdout:0/71: fsync d6/d10/f11 0 2024-05-06T21:26:42.348 INFO:tasks.workunit.client.1.smithi154.stdout:0/72: chown c5 2161 1 2024-05-06T21:26:42.348 INFO:tasks.workunit.client.1.smithi154.stdout:0/73: fsync f4 0 2024-05-06T21:26:42.348 INFO:tasks.workunit.client.1.smithi154.stdout:9/108: creat d5/f28 x:0 0 0 2024-05-06T21:26:42.350 INFO:tasks.workunit.client.1.smithi154.stdout:0/74: creat d6/dc/f13 x:0 0 0 2024-05-06T21:26:42.350 INFO:tasks.workunit.client.1.smithi154.stdout:0/75: fdatasync f3 0 2024-05-06T21:26:42.350 INFO:tasks.workunit.client.1.smithi154.stdout:9/109: rename d5 to d5/d29 22 2024-05-06T21:26:42.352 INFO:tasks.workunit.client.1.smithi154.stdout:3/77: dread d0/f3 [0,4194304] 0 2024-05-06T21:26:42.352 INFO:tasks.workunit.client.1.smithi154.stdout:3/78: readlink d0/d4/l12 0 2024-05-06T21:26:42.352 INFO:tasks.workunit.client.0.smithi032.stdout:2/370: symlink df/d19/d1e/d71/d5f/d7d/d65/l88 0 2024-05-06T21:26:42.353 INFO:tasks.workunit.client.1.smithi154.stdout:3/79: rmdir d0/da/d14 0 2024-05-06T21:26:42.353 INFO:tasks.workunit.client.1.smithi154.stdout:3/80: truncate d0/fe 833312 0 2024-05-06T21:26:42.353 INFO:tasks.workunit.client.1.smithi154.stdout:3/81: read d0/da/db/dd/fc [1963242,13251] 0 2024-05-06T21:26:42.355 INFO:tasks.workunit.client.1.smithi154.stdout:3/82: symlink d0/da/db/l16 0 2024-05-06T21:26:42.356 INFO:tasks.workunit.client.1.smithi154.stdout:3/83: mkdir d0/d4/d17 0 2024-05-06T21:26:42.356 INFO:tasks.workunit.client.1.smithi154.stdout:3/84: write d0/f3 [1040412,104297] 0 2024-05-06T21:26:42.358 INFO:tasks.workunit.client.1.smithi154.stdout:3/85: creat d0/da/f18 x:0 0 0 2024-05-06T21:26:42.358 INFO:tasks.workunit.client.1.smithi154.stdout:3/86: write d0/da/db/dd/fc [501590,90890] 0 2024-05-06T21:26:42.359 INFO:tasks.workunit.client.1.smithi154.stdout:3/87: readlink d0/da/db/l16 0 2024-05-06T21:26:42.359 INFO:tasks.workunit.client.1.smithi154.stdout:3/88: stat d0/f3 0 2024-05-06T21:26:42.360 INFO:tasks.workunit.client.1.smithi154.stdout:3/89: creat d0/d4/f19 x:0 0 0 2024-05-06T21:26:42.363 INFO:tasks.workunit.client.1.smithi154.stdout:9/110: dread d5/d20/f24 [0,4194304] 0 2024-05-06T21:26:42.363 INFO:tasks.workunit.client.1.smithi154.stdout:9/111: write d5/d14/f1c [967805,27148] 0 2024-05-06T21:26:42.363 INFO:tasks.workunit.client.1.smithi154.stdout:0/76: dread d6/d10/f11 [0,4194304] 0 2024-05-06T21:26:42.363 INFO:tasks.workunit.client.1.smithi154.stdout:0/77: chown d6/dc 8310 1 2024-05-06T21:26:42.363 INFO:tasks.workunit.client.1.smithi154.stdout:0/78: chown d6/dc/f13 526806 1 2024-05-06T21:26:42.366 INFO:tasks.workunit.client.0.smithi032.stdout:0/411: unlink d4/d3e/d42/f79 0 2024-05-06T21:26:42.377 INFO:tasks.workunit.client.0.smithi032.stdout:9/462: rename d1/d13/d33/d5e/l6c to d1/d13/d25/d64/l93 0 2024-05-06T21:26:42.377 INFO:tasks.workunit.client.0.smithi032.stdout:9/463: chown d1/c1d 194218 1 2024-05-06T21:26:42.380 INFO:tasks.workunit.client.0.smithi032.stdout:8/540: rmdir d0/d1b/d39/d3b/d57/d5d/d63/d7f/d99 0 2024-05-06T21:26:42.382 INFO:tasks.workunit.client.1.smithi154.stdout:7/21: sync 2024-05-06T21:26:42.382 INFO:tasks.workunit.client.1.smithi154.stdout:4/38: sync 2024-05-06T21:26:42.382 INFO:tasks.workunit.client.1.smithi154.stdout:1/78: sync 2024-05-06T21:26:42.382 INFO:tasks.workunit.client.1.smithi154.stdout:7/22: stat c3 0 2024-05-06T21:26:42.386 INFO:tasks.workunit.client.0.smithi032.stdout:6/519: symlink d8/d3d/d73/l97 0 2024-05-06T21:26:42.389 INFO:tasks.workunit.client.1.smithi154.stdout:1/79: dread d6/fd [0,4194304] 0 2024-05-06T21:26:42.389 INFO:tasks.workunit.client.1.smithi154.stdout:1/80: read d6/fc [3309766,25335] 0 2024-05-06T21:26:42.394 INFO:tasks.workunit.client.1.smithi154.stdout:4/39: dread d0/f1 [4194304,4194304] 0 2024-05-06T21:26:42.394 INFO:tasks.workunit.client.1.smithi154.stdout:4/40: dread - d0/d2/fa zero size 2024-05-06T21:26:42.394 INFO:tasks.workunit.client.1.smithi154.stdout:4/41: fdatasync d0/d2/f9 0 2024-05-06T21:26:42.394 INFO:tasks.workunit.client.1.smithi154.stdout:4/42: creat d0/d2/fb x:0 0 0 2024-05-06T21:26:42.395 INFO:tasks.workunit.client.1.smithi154.stdout:4/43: chown d0 508672 1 2024-05-06T21:26:42.395 INFO:tasks.workunit.client.1.smithi154.stdout:4/44: write d0/d2/f9 [542390,41959] 0 2024-05-06T21:26:42.397 INFO:tasks.workunit.client.1.smithi154.stdout:9/112: dwrite d5/f8 [0,4194304] 0 2024-05-06T21:26:42.397 INFO:tasks.workunit.client.1.smithi154.stdout:4/45: mkdir d0/d2/dc 0 2024-05-06T21:26:42.397 INFO:tasks.workunit.client.1.smithi154.stdout:4/46: fsync d0/f1 0 2024-05-06T21:26:42.397 INFO:tasks.workunit.client.1.smithi154.stdout:3/90: dwrite d0/d4/f19 [0,4194304] 0 2024-05-06T21:26:42.397 INFO:tasks.workunit.client.1.smithi154.stdout:3/91: write d0/da/f18 [64486,20330] 0 2024-05-06T21:26:42.399 INFO:tasks.workunit.client.1.smithi154.stdout:9/113: creat d5/f2a x:0 0 0 2024-05-06T21:26:42.401 INFO:tasks.workunit.client.1.smithi154.stdout:4/47: link d0/l7 d0/ld 0 2024-05-06T21:26:42.401 INFO:tasks.workunit.client.1.smithi154.stdout:4/48: chown d0/l5 74804138 1 2024-05-06T21:26:42.401 INFO:tasks.workunit.client.1.smithi154.stdout:3/92: mkdir d0/da/d1a 0 2024-05-06T21:26:42.403 INFO:tasks.workunit.client.1.smithi154.stdout:3/93: dread d0/fe [0,4194304] 0 2024-05-06T21:26:42.403 INFO:tasks.workunit.client.1.smithi154.stdout:4/49: creat d0/d2/dc/fe x:0 0 0 2024-05-06T21:26:42.404 INFO:tasks.workunit.client.1.smithi154.stdout:3/94: mknod d0/da/d1a/c1b 0 2024-05-06T21:26:42.404 INFO:tasks.workunit.client.1.smithi154.stdout:3/95: write d0/da/f18 [398846,12885] 0 2024-05-06T21:26:42.404 INFO:tasks.workunit.client.1.smithi154.stdout:0/79: dwrite d6/dc/f13 [0,4194304] 0 2024-05-06T21:26:42.407 INFO:tasks.workunit.client.1.smithi154.stdout:3/96: mkdir d0/da/db/dd/d1c 0 2024-05-06T21:26:42.412 INFO:tasks.workunit.client.1.smithi154.stdout:0/80: dread f3 [0,4194304] 0 2024-05-06T21:26:42.412 INFO:tasks.workunit.client.1.smithi154.stdout:0/81: write d6/dc/fd [252709,58388] 0 2024-05-06T21:26:42.414 INFO:tasks.workunit.client.0.smithi032.stdout:0/412: dwrite d4/d3e/d42/f5f [0,4194304] 0 2024-05-06T21:26:42.420 INFO:tasks.workunit.client.0.smithi032.stdout:7/484: truncate db/d12/f61 1853289 0 2024-05-06T21:26:42.420 INFO:tasks.workunit.client.0.smithi032.stdout:7/485: write db/d12/d16/d21/d41/d78/f4f [439677,9621] 0 2024-05-06T21:26:42.423 INFO:tasks.workunit.client.1.smithi154.stdout:3/97: dread d0/d4/f19 [0,4194304] 0 2024-05-06T21:26:42.430 INFO:tasks.workunit.client.1.smithi154.stdout:9/114: dwrite d5/f13 [0,4194304] 0 2024-05-06T21:26:42.430 INFO:tasks.workunit.client.1.smithi154.stdout:1/81: dwrite d6/f8 [4194304,4194304] 0 2024-05-06T21:26:42.432 INFO:tasks.workunit.client.1.smithi154.stdout:3/98: dread d0/d4/f19 [0,4194304] 0 2024-05-06T21:26:42.433 INFO:tasks.workunit.client.1.smithi154.stdout:9/115: readlink d5/l7 0 2024-05-06T21:26:42.433 INFO:tasks.workunit.client.0.smithi032.stdout:8/541: dwrite d0/d1b/d39/d3b/d97/f98 [0,4194304] 0 2024-05-06T21:26:42.434 INFO:tasks.workunit.client.1.smithi154.stdout:4/50: dwrite d0/f1 [0,4194304] 0 2024-05-06T21:26:42.434 INFO:tasks.workunit.client.1.smithi154.stdout:4/51: fsync d0/d2/f8 0 2024-05-06T21:26:42.434 INFO:tasks.workunit.client.1.smithi154.stdout:1/82: mkdir d6/db/d10/d15 0 2024-05-06T21:26:42.436 INFO:tasks.workunit.client.1.smithi154.stdout:1/83: creat d6/db/d10/d15/f16 x:0 0 0 2024-05-06T21:26:42.439 INFO:tasks.workunit.client.1.smithi154.stdout:1/84: rmdir d6/d12 0 2024-05-06T21:26:42.439 INFO:tasks.workunit.client.1.smithi154.stdout:1/85: chown d6/db/d10/c14 897 1 2024-05-06T21:26:42.439 INFO:tasks.workunit.client.1.smithi154.stdout:1/86: chown d6/f8 50675 1 2024-05-06T21:26:42.446 INFO:tasks.workunit.client.1.smithi154.stdout:9/116: write d5/f1a [1700926,41366] 0 2024-05-06T21:26:42.449 INFO:tasks.workunit.client.1.smithi154.stdout:9/117: symlink d5/d20/l2b 0 2024-05-06T21:26:42.449 INFO:tasks.workunit.client.1.smithi154.stdout:9/118: chown l3 12 1 2024-05-06T21:26:42.450 INFO:tasks.workunit.client.1.smithi154.stdout:9/119: rename d5/f26 to d5/d20/f2c 0 2024-05-06T21:26:42.451 INFO:tasks.workunit.client.1.smithi154.stdout:9/120: stat d5/l18 0 2024-05-06T21:26:42.452 INFO:tasks.workunit.client.0.smithi032.stdout:2/371: getdents df/d19/d1e 0 2024-05-06T21:26:42.452 INFO:tasks.workunit.client.0.smithi032.stdout:2/372: fdatasync df/d19/d1e/d1f/d2e/d33/f20 0 2024-05-06T21:26:42.453 INFO:tasks.workunit.client.0.smithi032.stdout:5/319: symlink d0/l58 0 2024-05-06T21:26:42.453 INFO:tasks.workunit.client.0.smithi032.stdout:5/320: fdatasync d0/f27 0 2024-05-06T21:26:42.453 INFO:tasks.workunit.client.0.smithi032.stdout:5/321: dread - d0/d24/d26/f56 zero size 2024-05-06T21:26:42.454 INFO:tasks.workunit.client.0.smithi032.stdout:9/464: symlink d1/d13/d33/d8e/l94 0 2024-05-06T21:26:42.455 INFO:tasks.workunit.client.0.smithi032.stdout:4/519: getdents d2/d16/d44/d54/d69 0 2024-05-06T21:26:42.457 INFO:tasks.workunit.client.0.smithi032.stdout:6/520: symlink d8/dd/d18/l98 0 2024-05-06T21:26:42.457 INFO:tasks.workunit.client.0.smithi032.stdout:6/521: write d8/f10 [5950239,78888] 0 2024-05-06T21:26:42.462 INFO:tasks.workunit.client.0.smithi032.stdout:7/486: rename db/d12/d16/d21/d41/d7d to db/d12/d16/d2a/d39/d3b/d96 0 2024-05-06T21:26:42.462 INFO:tasks.workunit.client.0.smithi032.stdout:9/465: rename d1 to d1/d2f/d95 22 2024-05-06T21:26:42.462 INFO:tasks.workunit.client.0.smithi032.stdout:7/487: write db/d12/d16/d21/d41/d78/f2c [564429,16678] 0 2024-05-06T21:26:42.462 INFO:tasks.workunit.client.0.smithi032.stdout:7/488: chown db/d12/d16/d21/f8d 14617 1 2024-05-06T21:26:42.464 INFO:tasks.workunit.client.0.smithi032.stdout:0/413: dwrite d4/fc [0,4194304] 0 2024-05-06T21:26:42.464 INFO:tasks.workunit.client.0.smithi032.stdout:8/542: symlink d0/d1c/d5e/d67/d7b/l9f 0 2024-05-06T21:26:42.465 INFO:tasks.workunit.client.1.smithi154.stdout:4/52: dwrite d0/d2/dc/fe [0,4194304] 0 2024-05-06T21:26:42.465 INFO:tasks.workunit.client.1.smithi154.stdout:4/53: dread - d0/d2/f8 zero size 2024-05-06T21:26:42.467 INFO:tasks.workunit.client.0.smithi032.stdout:5/322: truncate d0/f10 2888617 0 2024-05-06T21:26:42.467 INFO:tasks.workunit.client.1.smithi154.stdout:4/54: mkdir d0/df 0 2024-05-06T21:26:42.467 INFO:tasks.workunit.client.1.smithi154.stdout:4/55: chown d0/df 5 1 2024-05-06T21:26:42.468 INFO:tasks.workunit.client.1.smithi154.stdout:3/99: dwrite d0/da/db/dd/ff [0,4194304] 0 2024-05-06T21:26:42.468 INFO:tasks.workunit.client.1.smithi154.stdout:0/82: dwrite d6/f8 [0,4194304] 0 2024-05-06T21:26:42.471 INFO:tasks.workunit.client.1.smithi154.stdout:4/56: rmdir d0/df 0 2024-05-06T21:26:42.472 INFO:tasks.workunit.client.1.smithi154.stdout:4/57: fsync d0/d2/f6 0 2024-05-06T21:26:42.472 INFO:tasks.workunit.client.1.smithi154.stdout:3/100: dread d0/da/db/f10 [0,4194304] 0 2024-05-06T21:26:42.472 INFO:tasks.workunit.client.0.smithi032.stdout:6/522: rename d8/d3d/d73/d87/c79 to d8/dd/d18/c99 0 2024-05-06T21:26:42.472 INFO:tasks.workunit.client.0.smithi032.stdout:6/523: chown d8/dd/d18/d13/f58 489673 1 2024-05-06T21:26:42.472 INFO:tasks.workunit.client.0.smithi032.stdout:6/524: write d8/dd/d1b/d35/f43 [499265,115870] 0 2024-05-06T21:26:42.473 INFO:tasks.workunit.client.0.smithi032.stdout:0/414: creat d4/da/d14/d4a/f7d x:0 0 0 2024-05-06T21:26:42.476 INFO:tasks.workunit.client.1.smithi154.stdout:0/83: creat d6/d10/f14 x:0 0 0 2024-05-06T21:26:42.476 INFO:tasks.workunit.client.0.smithi032.stdout:8/543: creat d0/d1b/d39/d3b/fa0 x:0 0 0 2024-05-06T21:26:42.476 INFO:tasks.workunit.client.0.smithi032.stdout:8/544: readlink d0/l2b 0 2024-05-06T21:26:42.477 INFO:tasks.workunit.client.0.smithi032.stdout:5/323: mkdir d0/d16/d2a/d59 0 2024-05-06T21:26:42.479 INFO:tasks.workunit.client.1.smithi154.stdout:0/84: creat d6/f15 x:0 0 0 2024-05-06T21:26:42.481 INFO:tasks.workunit.client.1.smithi154.stdout:4/58: rmdir d0/d2 39 2024-05-06T21:26:42.481 INFO:tasks.workunit.client.1.smithi154.stdout:4/59: dread - d0/d2/fa zero size 2024-05-06T21:26:42.482 INFO:tasks.workunit.client.0.smithi032.stdout:4/520: dwrite d2/f96 [0,4194304] 0 2024-05-06T21:26:42.483 INFO:tasks.workunit.client.1.smithi154.stdout:0/85: dread d6/dc/fd [0,4194304] 0 2024-05-06T21:26:42.483 INFO:tasks.workunit.client.0.smithi032.stdout:9/466: rename d1/d13/d25/f2e to d1/d2f/d4f/f96 0 2024-05-06T21:26:42.483 INFO:tasks.workunit.client.1.smithi154.stdout:9/121: getdents d5 0 2024-05-06T21:26:42.484 INFO:tasks.workunit.client.0.smithi032.stdout:6/525: symlink d8/dd/d18/d13/l9a 0 2024-05-06T21:26:42.484 INFO:tasks.workunit.client.1.smithi154.stdout:4/60: write d0/d2/dc/fe [4993051,76266] 0 2024-05-06T21:26:42.484 INFO:tasks.workunit.client.1.smithi154.stdout:0/86: dread d6/dc/fd [0,4194304] 0 2024-05-06T21:26:42.485 INFO:tasks.workunit.client.0.smithi032.stdout:7/489: getdents db/d12/d16/d21/d41/d78 0 2024-05-06T21:26:42.485 INFO:tasks.workunit.client.0.smithi032.stdout:7/490: stat db/d12/d49/c80 0 2024-05-06T21:26:42.485 INFO:tasks.workunit.client.1.smithi154.stdout:9/122: rename d5/d20/c22 to d5/d20/c2d 0 2024-05-06T21:26:42.487 INFO:tasks.workunit.client.1.smithi154.stdout:4/61: mkdir d0/d10 0 2024-05-06T21:26:42.487 INFO:tasks.workunit.client.0.smithi032.stdout:4/521: dread d2/d1e/f22 [0,4194304] 0 2024-05-06T21:26:42.487 INFO:tasks.workunit.client.0.smithi032.stdout:1/406: sync 2024-05-06T21:26:42.488 INFO:tasks.workunit.client.0.smithi032.stdout:3/516: sync 2024-05-06T21:26:42.490 INFO:tasks.workunit.client.1.smithi154.stdout:0/87: rename d6/f8 to d6/dc/f16 0 2024-05-06T21:26:42.490 INFO:tasks.workunit.client.0.smithi032.stdout:9/467: mkdir d1/d2f/d4f/d97 0 2024-05-06T21:26:42.491 INFO:tasks.workunit.client.0.smithi032.stdout:6/526: mknod d8/c9b 0 2024-05-06T21:26:42.492 INFO:tasks.workunit.client.0.smithi032.stdout:0/415: dread d4/da/d16/f43 [0,4194304] 0 2024-05-06T21:26:42.492 INFO:tasks.workunit.client.0.smithi032.stdout:0/416: chown d4/da/l13 0 1 2024-05-06T21:26:42.494 INFO:tasks.workunit.client.1.smithi154.stdout:4/62: mkdir d0/d10/d11 0 2024-05-06T21:26:42.494 INFO:tasks.workunit.client.0.smithi032.stdout:4/522: link d2/d1e/f22 d2/d16/d44/d54/d69/faf 0 2024-05-06T21:26:42.495 INFO:tasks.workunit.client.0.smithi032.stdout:3/517: rmdir d1/d4/da/d4e/d41/d97/d67 39 2024-05-06T21:26:42.496 INFO:tasks.workunit.client.1.smithi154.stdout:0/88: symlink d6/dc/l17 0 2024-05-06T21:26:42.498 INFO:tasks.workunit.client.1.smithi154.stdout:9/123: mkdir d5/d2e 0 2024-05-06T21:26:42.498 INFO:tasks.workunit.client.1.smithi154.stdout:9/124: readlink d5/l1b 0 2024-05-06T21:26:42.498 INFO:tasks.workunit.client.1.smithi154.stdout:9/125: read - d5/f2a zero size 2024-05-06T21:26:42.498 INFO:tasks.workunit.client.1.smithi154.stdout:5/45: sync 2024-05-06T21:26:42.498 INFO:tasks.workunit.client.1.smithi154.stdout:5/46: creat d2/d6/fe x:0 0 0 2024-05-06T21:26:42.499 INFO:tasks.workunit.client.0.smithi032.stdout:1/407: creat db/d16/d5d/f7d x:0 0 0 2024-05-06T21:26:42.499 INFO:tasks.workunit.client.0.smithi032.stdout:2/373: symlink df/d19/d1e/d71/d5f/d7d/l89 0 2024-05-06T21:26:42.499 INFO:tasks.workunit.client.0.smithi032.stdout:5/324: dread d0/d24/d38/f30 [0,4194304] 0 2024-05-06T21:26:42.500 INFO:tasks.workunit.client.1.smithi154.stdout:4/63: rename d0/ld to d0/d10/d11/l12 0 2024-05-06T21:26:42.501 INFO:tasks.workunit.client.1.smithi154.stdout:9/126: mknod d5/d14/d1e/c2f 0 2024-05-06T21:26:42.501 INFO:tasks.workunit.client.0.smithi032.stdout:6/527: link d8/c41 d8/dd/d18/d13/c9c 0 2024-05-06T21:26:42.501 INFO:tasks.workunit.client.0.smithi032.stdout:6/528: write d8/f8c [195840,30649] 0 2024-05-06T21:26:42.504 INFO:tasks.workunit.client.1.smithi154.stdout:4/64: creat d0/d2/f13 x:0 0 0 2024-05-06T21:26:42.506 INFO:tasks.workunit.client.0.smithi032.stdout:4/523: rename d2/d16/d44/d45/d4e/la0 to d2/d1e/d47/lb0 0 2024-05-06T21:26:42.506 INFO:tasks.workunit.client.0.smithi032.stdout:1/408: read db/d16/f40 [1562815,17800] 0 2024-05-06T21:26:42.507 INFO:tasks.workunit.client.0.smithi032.stdout:3/518: creat d1/d4/da/d1d/fb5 x:0 0 0 2024-05-06T21:26:42.508 INFO:tasks.workunit.client.1.smithi154.stdout:4/65: unlink d0/d2/f6 0 2024-05-06T21:26:42.508 INFO:tasks.workunit.client.1.smithi154.stdout:4/66: dread - d0/d2/f13 zero size 2024-05-06T21:26:42.508 INFO:tasks.workunit.client.1.smithi154.stdout:4/67: chown d0/c4 4538 1 2024-05-06T21:26:42.509 INFO:tasks.workunit.client.1.smithi154.stdout:5/47: dread d2/d6/f7 [0,4194304] 0 2024-05-06T21:26:42.509 INFO:tasks.workunit.client.1.smithi154.stdout:5/48: write d2/d6/fe [1029484,22471] 0 2024-05-06T21:26:42.509 INFO:tasks.workunit.client.1.smithi154.stdout:5/49: fdatasync d2/f4 0 2024-05-06T21:26:42.510 INFO:tasks.workunit.client.1.smithi154.stdout:4/68: unlink d0/d2/f9 0 2024-05-06T21:26:42.511 INFO:tasks.workunit.client.0.smithi032.stdout:7/491: dwrite db/d12/d16/d21/d41/d78/f91 [0,4194304] 0 2024-05-06T21:26:42.511 INFO:tasks.workunit.client.0.smithi032.stdout:5/325: mkdir d0/d24/d26/d3d/d50/d5a 0 2024-05-06T21:26:42.511 INFO:tasks.workunit.client.1.smithi154.stdout:5/50: mknod d2/d3/cf 0 2024-05-06T21:26:42.512 INFO:tasks.workunit.client.1.smithi154.stdout:3/101: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:42.512 INFO:tasks.workunit.client.0.smithi032.stdout:5/326: write d0/f12 [1422168,21942] 0 2024-05-06T21:26:42.513 INFO:tasks.workunit.client.1.smithi154.stdout:5/51: mknod d2/d6/dd/c10 0 2024-05-06T21:26:42.513 INFO:tasks.workunit.client.0.smithi032.stdout:0/417: rmdir d4/d3e/d63/d6c 39 2024-05-06T21:26:42.514 INFO:tasks.workunit.client.1.smithi154.stdout:9/127: rmdir d5/d20 39 2024-05-06T21:26:42.514 INFO:tasks.workunit.client.0.smithi032.stdout:3/519: mknod d1/d4/da/d4e/d5e/cb6 0 2024-05-06T21:26:42.515 INFO:tasks.workunit.client.0.smithi032.stdout:3/520: fsync d1/d4/da/d4e/d41/d43/f70 0 2024-05-06T21:26:42.517 INFO:tasks.workunit.client.1.smithi154.stdout:3/102: mknod d0/da/db/dd/c1d 0 2024-05-06T21:26:42.519 INFO:tasks.workunit.client.1.smithi154.stdout:9/128: creat d5/d14/f30 x:0 0 0 2024-05-06T21:26:42.519 INFO:tasks.workunit.client.1.smithi154.stdout:9/129: write d5/d14/f30 [694478,9583] 0 2024-05-06T21:26:42.519 INFO:tasks.workunit.client.1.smithi154.stdout:9/130: fdatasync d5/d20/f23 0 2024-05-06T21:26:42.519 INFO:tasks.workunit.client.0.smithi032.stdout:7/492: mkdir db/d12/d49/d97 0 2024-05-06T21:26:42.520 INFO:tasks.workunit.client.0.smithi032.stdout:0/418: mknod d4/da/d16/d4f/c7e 0 2024-05-06T21:26:42.521 INFO:tasks.workunit.client.1.smithi154.stdout:3/103: creat d0/d4/d17/f1e x:0 0 0 2024-05-06T21:26:42.521 INFO:tasks.workunit.client.1.smithi154.stdout:3/104: readlink d0/da/db/l16 0 2024-05-06T21:26:42.521 INFO:tasks.workunit.client.1.smithi154.stdout:3/105: fdatasync d0/da/f18 0 2024-05-06T21:26:42.521 INFO:tasks.workunit.client.1.smithi154.stdout:3/106: stat d0/d4/c15 0 2024-05-06T21:26:42.521 INFO:tasks.workunit.client.1.smithi154.stdout:3/107: chown d0 14788 1 2024-05-06T21:26:42.522 INFO:tasks.workunit.client.1.smithi154.stdout:4/69: write d0/f1 [639941,21882] 0 2024-05-06T21:26:42.523 INFO:tasks.workunit.client.1.smithi154.stdout:9/131: mkdir d5/d14/d31 0 2024-05-06T21:26:42.524 INFO:tasks.workunit.client.1.smithi154.stdout:9/132: fdatasync d5/f28 0 2024-05-06T21:26:42.524 INFO:tasks.workunit.client.0.smithi032.stdout:7/493: creat db/d12/d49/d97/f98 x:0 0 0 2024-05-06T21:26:42.526 INFO:tasks.workunit.client.1.smithi154.stdout:4/70: unlink d0/d10/d11/l12 0 2024-05-06T21:26:42.528 INFO:tasks.workunit.client.1.smithi154.stdout:9/133: link d5/lc d5/d20/l32 0 2024-05-06T21:26:42.529 INFO:tasks.workunit.client.0.smithi032.stdout:7/494: unlink db/d12/d16/d21/d41/c7f 0 2024-05-06T21:26:42.531 INFO:tasks.workunit.client.1.smithi154.stdout:4/71: creat d0/d10/f14 x:0 0 0 2024-05-06T21:26:42.532 INFO:tasks.workunit.client.1.smithi154.stdout:9/134: write d5/d14/f1c [290720,21019] 0 2024-05-06T21:26:42.532 INFO:tasks.workunit.client.1.smithi154.stdout:9/135: fdatasync d5/d20/f2c 0 2024-05-06T21:26:42.533 INFO:tasks.workunit.client.1.smithi154.stdout:9/136: write d5/f2a [897413,92602] 0 2024-05-06T21:26:42.533 INFO:tasks.workunit.client.0.smithi032.stdout:3/521: rename d1/d4/da/d9f/d75 to d1/d4/db7 0 2024-05-06T21:26:42.535 INFO:tasks.workunit.client.1.smithi154.stdout:9/137: rename d5/l15 to d5/d14/d1e/l33 0 2024-05-06T21:26:42.536 INFO:tasks.workunit.client.1.smithi154.stdout:9/138: symlink d5/d2e/l34 0 2024-05-06T21:26:42.537 INFO:tasks.workunit.client.0.smithi032.stdout:0/419: rename d4/l15 to d4/da/d14/d1a/l7f 0 2024-05-06T21:26:42.539 INFO:tasks.workunit.client.0.smithi032.stdout:5/327: dread d0/d16/d2f/f43 [0,4194304] 0 2024-05-06T21:26:42.539 INFO:tasks.workunit.client.0.smithi032.stdout:5/328: chown d0/d16/d46 1576 1 2024-05-06T21:26:42.539 INFO:tasks.workunit.client.0.smithi032.stdout:7/495: rename db/d12/d16/d2a/d39/d8b/f8e to db/d12/d16/d21/d41/f99 0 2024-05-06T21:26:42.539 INFO:tasks.workunit.client.0.smithi032.stdout:7/496: chown db/d12/d16/d2a/d39/d3b 161416372 1 2024-05-06T21:26:42.540 INFO:tasks.workunit.client.1.smithi154.stdout:9/139: creat d5/d2e/f35 x:0 0 0 2024-05-06T21:26:42.542 INFO:tasks.workunit.client.0.smithi032.stdout:5/329: creat d0/d16/d2a/d59/f5b x:0 0 0 2024-05-06T21:26:42.542 INFO:tasks.workunit.client.0.smithi032.stdout:5/330: dread - d0/d24/d34/f45 zero size 2024-05-06T21:26:42.543 INFO:tasks.workunit.client.1.smithi154.stdout:9/140: dread d5/f12 [0,4194304] 0 2024-05-06T21:26:42.546 INFO:tasks.workunit.client.0.smithi032.stdout:0/420: rename d4/d3e/l64 to d4/d3e/d63/l80 0 2024-05-06T21:26:42.546 INFO:tasks.workunit.client.0.smithi032.stdout:0/421: write d4/da/d14/d1a/f6a [867403,91218] 0 2024-05-06T21:26:42.547 INFO:tasks.workunit.client.0.smithi032.stdout:5/331: link d0/d24/d26/c44 d0/d24/d38/d37/c5c 0 2024-05-06T21:26:42.547 INFO:tasks.workunit.client.0.smithi032.stdout:5/332: readlink d0/l58 0 2024-05-06T21:26:42.548 INFO:tasks.workunit.client.0.smithi032.stdout:0/422: creat d4/da/f81 x:0 0 0 2024-05-06T21:26:42.548 INFO:tasks.workunit.client.0.smithi032.stdout:0/423: fsync d4/d3e/d63/d6c/f77 0 2024-05-06T21:26:42.549 INFO:tasks.workunit.client.0.smithi032.stdout:5/333: creat d0/d24/d26/d3d/d50/f5d x:0 0 0 2024-05-06T21:26:42.549 INFO:tasks.workunit.client.0.smithi032.stdout:5/334: read - d0/d24/d34/f4f zero size 2024-05-06T21:26:42.550 INFO:tasks.workunit.client.0.smithi032.stdout:9/468: getdents d1/d2f/d4f 0 2024-05-06T21:26:42.551 INFO:tasks.workunit.client.0.smithi032.stdout:5/335: symlink d0/d24/d34/l5e 0 2024-05-06T21:26:42.552 INFO:tasks.workunit.client.0.smithi032.stdout:7/497: dread db/f77 [0,4194304] 0 2024-05-06T21:26:42.552 INFO:tasks.workunit.client.0.smithi032.stdout:9/469: mknod d1/d13/d25/d59/c98 0 2024-05-06T21:26:42.553 INFO:tasks.workunit.client.0.smithi032.stdout:7/498: mknod db/d12/d16/d2a/d39/c9a 0 2024-05-06T21:26:42.553 INFO:tasks.workunit.client.0.smithi032.stdout:6/529: dwrite d8/f8c [0,4194304] 0 2024-05-06T21:26:42.555 INFO:tasks.workunit.client.0.smithi032.stdout:9/470: mkdir d1/d13/d34/d26/d39/d99 0 2024-05-06T21:26:42.557 INFO:tasks.workunit.client.0.smithi032.stdout:6/530: creat d8/dd/d1b/f9d x:0 0 0 2024-05-06T21:26:42.557 INFO:tasks.workunit.client.0.smithi032.stdout:1/409: dwrite db/d16/f1e [4194304,4194304] 0 2024-05-06T21:26:42.558 INFO:tasks.workunit.client.1.smithi154.stdout:5/52: dwrite d2/f4 [0,4194304] 0 2024-05-06T21:26:42.560 INFO:tasks.workunit.client.0.smithi032.stdout:3/522: dwrite d1/d4/da/d31/d47/d4a/d68/d7c/f90 [0,4194304] 0 2024-05-06T21:26:42.560 INFO:tasks.workunit.client.0.smithi032.stdout:3/523: truncate d1/d2a/f8d 8726533 0 2024-05-06T21:26:42.561 INFO:tasks.workunit.client.1.smithi154.stdout:3/108: dwrite d0/da/db/f10 [0,4194304] 0 2024-05-06T21:26:42.561 INFO:tasks.workunit.client.1.smithi154.stdout:3/109: chown d0/d4 16 1 2024-05-06T21:26:42.562 INFO:tasks.workunit.client.1.smithi154.stdout:9/141: fsync d5/d14/f1c 0 2024-05-06T21:26:42.562 INFO:tasks.workunit.client.1.smithi154.stdout:9/142: dread - d5/f28 zero size 2024-05-06T21:26:42.563 INFO:tasks.workunit.client.0.smithi032.stdout:4/524: dwrite d2/d16/d44/d54/d69/f8e [0,4194304] 0 2024-05-06T21:26:42.563 INFO:tasks.workunit.client.0.smithi032.stdout:9/471: symlink d1/d13/d34/d26/d39/d8b/l9a 0 2024-05-06T21:26:42.565 INFO:tasks.workunit.client.1.smithi154.stdout:3/110: rename d0/d4/c7 to d0/d2/c1f 0 2024-05-06T21:26:42.566 INFO:tasks.workunit.client.1.smithi154.stdout:3/111: stat d0/da/db/dd/c9 0 2024-05-06T21:26:42.568 INFO:tasks.workunit.client.0.smithi032.stdout:1/410: creat db/d16/d46/f7e x:0 0 0 2024-05-06T21:26:42.568 INFO:tasks.workunit.client.0.smithi032.stdout:1/411: write db/d47/d4a/f74 [150267,100071] 0 2024-05-06T21:26:42.569 INFO:tasks.workunit.client.0.smithi032.stdout:5/336: dread d0/f10 [0,4194304] 0 2024-05-06T21:26:42.570 INFO:tasks.workunit.client.1.smithi154.stdout:3/112: symlink d0/da/db/dd/l20 0 2024-05-06T21:26:42.573 INFO:tasks.workunit.client.1.smithi154.stdout:9/143: mkdir d5/d36 0 2024-05-06T21:26:42.577 INFO:tasks.workunit.client.1.smithi154.stdout:9/144: mkdir d5/d20/d37 0 2024-05-06T21:26:42.577 INFO:tasks.workunit.client.1.smithi154.stdout:9/145: dread - d5/f28 zero size 2024-05-06T21:26:42.579 INFO:tasks.workunit.client.1.smithi154.stdout:9/146: creat d5/d20/d37/f38 x:0 0 0 2024-05-06T21:26:42.579 INFO:tasks.workunit.client.1.smithi154.stdout:9/147: write d5/d20/f2c [919896,46418] 0 2024-05-06T21:26:42.581 INFO:tasks.workunit.client.0.smithi032.stdout:3/524: mkdir d1/d4/da/d9f/db8 0 2024-05-06T21:26:42.582 INFO:tasks.workunit.client.1.smithi154.stdout:9/148: mkdir d5/d14/d31/d39 0 2024-05-06T21:26:42.582 INFO:tasks.workunit.client.1.smithi154.stdout:9/149: dread - d5/d20/f23 zero size 2024-05-06T21:26:42.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/150: stat d5/d14/d1e/l33 0 2024-05-06T21:26:42.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/151: write d5/d20/d37/f38 [817573,78237] 0 2024-05-06T21:26:42.584 INFO:tasks.workunit.client.0.smithi032.stdout:9/472: rename d1/f7 to d1/d13/d34/d26/d39/f9b 0 2024-05-06T21:26:42.585 INFO:tasks.workunit.client.0.smithi032.stdout:1/412: fsync db/d37/f4b 0 2024-05-06T21:26:42.586 INFO:tasks.workunit.client.1.smithi154.stdout:9/152: mkdir d5/d14/d3a 0 2024-05-06T21:26:42.588 INFO:tasks.workunit.client.1.smithi154.stdout:9/153: mknod d5/d14/c3b 0 2024-05-06T21:26:42.589 INFO:tasks.workunit.client.0.smithi032.stdout:5/337: mkdir d0/d16/d2a/d5f 0 2024-05-06T21:26:42.589 INFO:tasks.workunit.client.0.smithi032.stdout:3/525: symlink d1/d4/da/d31/d9b/lb9 0 2024-05-06T21:26:42.591 INFO:tasks.workunit.client.0.smithi032.stdout:1/413: dread db/d37/f54 [0,4194304] 0 2024-05-06T21:26:42.591 INFO:tasks.workunit.client.0.smithi032.stdout:9/473: unlink d1/d2f/d4f/f56 0 2024-05-06T21:26:42.592 INFO:tasks.workunit.client.0.smithi032.stdout:5/338: rename d0/f23 to d0/d24/d38/f60 0 2024-05-06T21:26:42.593 INFO:tasks.workunit.client.0.smithi032.stdout:1/414: unlink db/le 0 2024-05-06T21:26:42.594 INFO:tasks.workunit.client.0.smithi032.stdout:9/474: link d1/d13/d34/f48 d1/d13/d34/f9c 0 2024-05-06T21:26:42.595 INFO:tasks.workunit.client.0.smithi032.stdout:9/475: creat d1/d13/d34/d26/d39/d8b/f9d x:0 0 0 2024-05-06T21:26:42.595 INFO:tasks.workunit.client.0.smithi032.stdout:9/476: chown d1/d2f 3271 1 2024-05-06T21:26:42.595 INFO:tasks.workunit.client.0.smithi032.stdout:5/339: symlink d0/d24/d26/d3d/d50/l61 0 2024-05-06T21:26:42.598 INFO:tasks.workunit.client.0.smithi032.stdout:1/415: symlink db/l7f 0 2024-05-06T21:26:42.606 INFO:tasks.workunit.client.0.smithi032.stdout:7/499: dwrite db/d12/f85 [0,4194304] 0 2024-05-06T21:26:42.606 INFO:tasks.workunit.client.0.smithi032.stdout:5/340: dread d0/f12 [0,4194304] 0 2024-05-06T21:26:42.608 INFO:tasks.workunit.client.1.smithi154.stdout:5/53: dwrite d2/d6/fe [0,4194304] 0 2024-05-06T21:26:42.608 INFO:tasks.workunit.client.1.smithi154.stdout:5/54: chown d2/f4 127188171 1 2024-05-06T21:26:42.608 INFO:tasks.workunit.client.1.smithi154.stdout:5/55: chown d2/d3/cf 984 1 2024-05-06T21:26:42.608 INFO:tasks.workunit.client.1.smithi154.stdout:5/56: fsync d2/d3/fa 0 2024-05-06T21:26:42.608 INFO:tasks.workunit.client.1.smithi154.stdout:3/113: dwrite d0/da/db/dd/fc [0,4194304] 0 2024-05-06T21:26:42.608 INFO:tasks.workunit.client.0.smithi032.stdout:4/525: dwrite d2/d2c/d31/f91 [0,4194304] 0 2024-05-06T21:26:42.612 INFO:tasks.workunit.client.1.smithi154.stdout:4/72: dwrite d0/f1 [4194304,4194304] 0 2024-05-06T21:26:42.612 INFO:tasks.workunit.client.1.smithi154.stdout:4/73: creat d0/d10/f15 x:0 0 0 2024-05-06T21:26:42.612 INFO:tasks.workunit.client.1.smithi154.stdout:4/74: write d0/d10/f14 [872814,44602] 0 2024-05-06T21:26:42.612 INFO:tasks.workunit.client.1.smithi154.stdout:4/75: truncate d0/d10/f15 757111 0 2024-05-06T21:26:42.612 INFO:tasks.workunit.client.1.smithi154.stdout:5/57: symlink d2/d6/dd/l11 0 2024-05-06T21:26:42.613 INFO:tasks.workunit.client.0.smithi032.stdout:5/341: link d0/d24/d26/c31 d0/d16/d2a/d5f/c62 0 2024-05-06T21:26:42.613 INFO:tasks.workunit.client.0.smithi032.stdout:1/416: read db/d16/f2c [4326224,24466] 0 2024-05-06T21:26:42.613 INFO:tasks.workunit.client.0.smithi032.stdout:6/531: dwrite d8/dd/d1b/d35/f3a [0,4194304] 0 2024-05-06T21:26:42.615 INFO:tasks.workunit.client.1.smithi154.stdout:3/114: mkdir d0/da/db/dd/d1c/d21 0 2024-05-06T21:26:42.615 INFO:tasks.workunit.client.1.smithi154.stdout:3/115: write d0/da/f18 [875197,44459] 0 2024-05-06T21:26:42.615 INFO:tasks.workunit.client.0.smithi032.stdout:7/500: write db/d12/f17 [136487,99599] 0 2024-05-06T21:26:42.615 INFO:tasks.workunit.client.0.smithi032.stdout:9/477: dwrite d1/d2f/f37 [0,4194304] 0 2024-05-06T21:26:42.615 INFO:tasks.workunit.client.0.smithi032.stdout:9/478: truncate d1/d2f/f7a 121628 0 2024-05-06T21:26:42.615 INFO:tasks.workunit.client.1.smithi154.stdout:9/154: dread d5/d20/d37/f38 [0,4194304] 0 2024-05-06T21:26:42.616 INFO:tasks.workunit.client.0.smithi032.stdout:4/526: rename d2/d13/c14 to d2/d1e/cb1 0 2024-05-06T21:26:42.617 INFO:tasks.workunit.client.0.smithi032.stdout:4/527: creat d2/d16/d44/d74/d76/fb2 x:0 0 0 2024-05-06T21:26:42.617 INFO:tasks.workunit.client.0.smithi032.stdout:4/528: stat d2/d16/d44/d74/d7e 0 2024-05-06T21:26:42.618 INFO:tasks.workunit.client.1.smithi154.stdout:4/76: rename d0/d2/f13 to d0/d2/dc/f16 0 2024-05-06T21:26:42.619 INFO:tasks.workunit.client.0.smithi032.stdout:5/342: symlink d0/d16/d2f/l63 0 2024-05-06T21:26:42.621 INFO:tasks.workunit.client.0.smithi032.stdout:6/532: dread d8/d3d/d49/f60 [0,4194304] 0 2024-05-06T21:26:42.621 INFO:tasks.workunit.client.0.smithi032.stdout:6/533: chown d8/dd/d1b/d35/f66 3630668 1 2024-05-06T21:26:42.621 INFO:tasks.workunit.client.0.smithi032.stdout:6/534: creat d8/d33/d63/f9e x:0 0 0 2024-05-06T21:26:42.621 INFO:tasks.workunit.client.0.smithi032.stdout:6/535: creat d8/d3d/d49/d6b/f9f x:0 0 0 2024-05-06T21:26:42.624 INFO:tasks.workunit.client.0.smithi032.stdout:4/529: dread d2/d16/f52 [4194304,4194304] 0 2024-05-06T21:26:42.625 INFO:tasks.workunit.client.0.smithi032.stdout:4/530: rename d2/d2c to d2/d2c/d31/db3 22 2024-05-06T21:26:42.625 INFO:tasks.workunit.client.0.smithi032.stdout:4/531: truncate d2/d1e/f4c 861579 0 2024-05-06T21:26:42.625 INFO:tasks.workunit.client.0.smithi032.stdout:4/532: truncate d2/d2c/d31/d7c/fa6 387330 0 2024-05-06T21:26:42.625 INFO:tasks.workunit.client.0.smithi032.stdout:7/501: symlink db/l9b 0 2024-05-06T21:26:42.626 INFO:tasks.workunit.client.1.smithi154.stdout:3/116: getdents d0/d4/d17 0 2024-05-06T21:26:42.626 INFO:tasks.workunit.client.1.smithi154.stdout:3/117: stat d0/da/d1a 0 2024-05-06T21:26:42.626 INFO:tasks.workunit.client.1.smithi154.stdout:8/96: sync 2024-05-06T21:26:42.626 INFO:tasks.workunit.client.1.smithi154.stdout:6/44: sync 2024-05-06T21:26:42.627 INFO:tasks.workunit.client.1.smithi154.stdout:2/93: sync 2024-05-06T21:26:42.628 INFO:tasks.workunit.client.1.smithi154.stdout:5/58: read d2/d6/fe [2831016,17772] 0 2024-05-06T21:26:42.628 INFO:tasks.workunit.client.1.smithi154.stdout:5/59: write d2/d6/fb [365719,71350] 0 2024-05-06T21:26:42.629 INFO:tasks.workunit.client.1.smithi154.stdout:9/155: getdents d5/d14/d31 0 2024-05-06T21:26:42.629 INFO:tasks.workunit.client.0.smithi032.stdout:9/479: unlink d1/d13/d33/d3f/l42 0 2024-05-06T21:26:42.631 INFO:tasks.workunit.client.1.smithi154.stdout:5/60: symlink d2/l12 0 2024-05-06T21:26:42.631 INFO:tasks.workunit.client.1.smithi154.stdout:5/61: creat d2/d6/f13 x:0 0 0 2024-05-06T21:26:42.631 INFO:tasks.workunit.client.1.smithi154.stdout:5/62: stat d2/d6/fe 0 2024-05-06T21:26:42.632 INFO:tasks.workunit.client.1.smithi154.stdout:9/156: creat d5/d14/d31/d39/f3c x:0 0 0 2024-05-06T21:26:42.634 INFO:tasks.workunit.client.0.smithi032.stdout:5/343: unlink d0/d16/d46/l48 0 2024-05-06T21:26:42.635 INFO:tasks.workunit.client.1.smithi154.stdout:5/63: creat d2/f14 x:0 0 0 2024-05-06T21:26:42.639 INFO:tasks.workunit.client.0.smithi032.stdout:4/533: mknod d2/cb4 0 2024-05-06T21:26:42.642 INFO:tasks.workunit.client.0.smithi032.stdout:7/502: unlink db/d12/d16/d21/d41/d78/l26 0 2024-05-06T21:26:42.642 INFO:tasks.workunit.client.0.smithi032.stdout:7/503: write db/d12/f30 [3497983,56992] 0 2024-05-06T21:26:42.642 INFO:tasks.workunit.client.0.smithi032.stdout:7/504: write db/d12/f61 [1800045,120078] 0 2024-05-06T21:26:42.642 INFO:tasks.workunit.client.0.smithi032.stdout:7/505: chown db/d12/d16/d21/d41/d78/c69 13 1 2024-05-06T21:26:42.642 INFO:tasks.workunit.client.0.smithi032.stdout:9/480: mknod d1/d13/d33/d5e/d78/c9e 0 2024-05-06T21:26:42.642 INFO:tasks.workunit.client.1.smithi154.stdout:6/45: read f1 [980869,119617] 0 2024-05-06T21:26:42.643 INFO:tasks.workunit.client.0.smithi032.stdout:5/344: symlink d0/d16/d2a/d4d/l64 0 2024-05-06T21:26:42.643 INFO:tasks.workunit.client.0.smithi032.stdout:5/345: chown d0/d28/l2d 8 1 2024-05-06T21:26:42.643 INFO:tasks.workunit.client.0.smithi032.stdout:1/417: dwrite db/d2a/f49 [4194304,4194304] 0 2024-05-06T21:26:42.646 INFO:tasks.workunit.client.0.smithi032.stdout:7/506: mkdir db/d12/d16/d2a/d39/d3b/d9c 0 2024-05-06T21:26:42.647 INFO:tasks.workunit.client.0.smithi032.stdout:1/418: symlink db/d2a/d4f/l80 0 2024-05-06T21:26:42.647 INFO:tasks.workunit.client.1.smithi154.stdout:6/46: symlink d8/d11/l12 0 2024-05-06T21:26:42.648 INFO:tasks.workunit.client.1.smithi154.stdout:6/47: truncate f7 4193358 0 2024-05-06T21:26:42.648 INFO:tasks.workunit.client.0.smithi032.stdout:7/507: symlink db/d12/d16/d2a/d39/d3b/l9d 0 2024-05-06T21:26:42.656 INFO:tasks.workunit.client.1.smithi154.stdout:6/48: mkdir d8/d13 0 2024-05-06T21:26:42.662 INFO:tasks.workunit.client.0.smithi032.stdout:9/481: write d1/d13/d34/d26/d49/f81 [2499128,16587] 0 2024-05-06T21:26:42.662 INFO:tasks.workunit.client.0.smithi032.stdout:9/482: fdatasync d1/d13/d25/f4b 0 2024-05-06T21:26:42.662 INFO:tasks.workunit.client.0.smithi032.stdout:9/483: dread - d1/d13/d33/d5e/d78/f83 zero size 2024-05-06T21:26:42.662 INFO:tasks.workunit.client.0.smithi032.stdout:1/419: dread db/d2a/f5b [0,4194304] 0 2024-05-06T21:26:42.662 INFO:tasks.workunit.client.0.smithi032.stdout:1/420: chown db/d47/d70 1 1 2024-05-06T21:26:42.662 INFO:tasks.workunit.client.0.smithi032.stdout:1/421: fsync db/f43 0 2024-05-06T21:26:42.665 INFO:tasks.workunit.client.0.smithi032.stdout:9/484: mkdir d1/d13/d34/d26/d9f 0 2024-05-06T21:26:42.665 INFO:tasks.workunit.client.0.smithi032.stdout:9/485: write d1/f18 [3012413,5581] 0 2024-05-06T21:26:42.665 INFO:tasks.workunit.client.0.smithi032.stdout:1/422: creat db/d16/d46/d57/d58/f81 x:0 0 0 2024-05-06T21:26:42.666 INFO:tasks.workunit.client.0.smithi032.stdout:1/423: fdatasync db/d2a/f2f 0 2024-05-06T21:26:42.666 INFO:tasks.workunit.client.0.smithi032.stdout:9/486: mkdir d1/d13/d25/da0 0 2024-05-06T21:26:42.670 INFO:tasks.workunit.client.0.smithi032.stdout:9/487: dread d1/d13/d33/d5e/d78/f8d [0,4194304] 0 2024-05-06T21:26:42.671 INFO:tasks.workunit.client.0.smithi032.stdout:9/488: mkdir d1/d2f/da1 0 2024-05-06T21:26:42.672 INFO:tasks.workunit.client.0.smithi032.stdout:9/489: truncate d1/d13/d34/d26/f71 7913888 0 2024-05-06T21:26:42.674 INFO:tasks.workunit.client.0.smithi032.stdout:9/490: symlink d1/d13/la2 0 2024-05-06T21:26:42.674 INFO:tasks.workunit.client.0.smithi032.stdout:9/491: symlink d1/d13/d25/d64/d72/la3 0 2024-05-06T21:26:42.676 INFO:tasks.workunit.client.0.smithi032.stdout:9/492: creat d1/d2f/d4f/d97/fa4 x:0 0 0 2024-05-06T21:26:42.676 INFO:tasks.workunit.client.0.smithi032.stdout:9/493: fsync d1/d13/d33/d5e/d78/f89 0 2024-05-06T21:26:42.676 INFO:tasks.workunit.client.0.smithi032.stdout:9/494: fsync d1/f12 0 2024-05-06T21:26:42.676 INFO:tasks.workunit.client.0.smithi032.stdout:9/495: dread - d1/d13/d25/d59/f65 zero size 2024-05-06T21:26:42.677 INFO:tasks.workunit.client.0.smithi032.stdout:6/536: dwrite d8/dd/d18/d22/f7b [0,4194304] 0 2024-05-06T21:26:42.678 INFO:tasks.workunit.client.0.smithi032.stdout:1/424: getdents db/d2a/d4f 0 2024-05-06T21:26:42.682 INFO:tasks.workunit.client.1.smithi154.stdout:8/97: dwrite d3/d14/f20 [0,4194304] 0 2024-05-06T21:26:42.682 INFO:tasks.workunit.client.1.smithi154.stdout:2/94: dwrite db/de/d10/f14 [0,4194304] 0 2024-05-06T21:26:42.683 INFO:tasks.workunit.client.1.smithi154.stdout:3/118: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:42.683 INFO:tasks.workunit.client.1.smithi154.stdout:3/119: truncate d0/da/db/dd/ff 4435658 0 2024-05-06T21:26:42.683 INFO:tasks.workunit.client.0.smithi032.stdout:6/537: unlink d8/d3d/d8f/f7f 0 2024-05-06T21:26:42.683 INFO:tasks.workunit.client.0.smithi032.stdout:6/538: dread - d8/dd/d1b/f62 zero size 2024-05-06T21:26:42.685 INFO:tasks.workunit.client.0.smithi032.stdout:7/508: dwrite db/d12/d16/d21/d41/f99 [0,4194304] 0 2024-05-06T21:26:42.685 INFO:tasks.workunit.client.0.smithi032.stdout:7/509: write db/d12/d16/d21/d41/d4b/f59 [620342,66816] 0 2024-05-06T21:26:42.685 INFO:tasks.workunit.client.0.smithi032.stdout:1/425: link db/d37/d52/c6c db/d16/d46/c82 0 2024-05-06T21:26:42.685 INFO:tasks.workunit.client.0.smithi032.stdout:1/426: write db/d16/d46/d57/f71 [488848,100022] 0 2024-05-06T21:26:42.686 INFO:tasks.workunit.client.1.smithi154.stdout:5/64: dwrite d2/f14 [0,4194304] 0 2024-05-06T21:26:42.686 INFO:tasks.workunit.client.1.smithi154.stdout:6/49: dwrite f6 [0,4194304] 0 2024-05-06T21:26:42.687 INFO:tasks.workunit.client.0.smithi032.stdout:5/346: dwrite d0/d24/d38/d37/f55 [0,4194304] 0 2024-05-06T21:26:42.689 INFO:tasks.workunit.client.0.smithi032.stdout:7/510: truncate db/d12/d16/f72 307395 0 2024-05-06T21:26:42.690 INFO:tasks.workunit.client.0.smithi032.stdout:1/427: creat db/d16/f83 x:0 0 0 2024-05-06T21:26:42.696 INFO:tasks.workunit.client.0.smithi032.stdout:5/347: rmdir d0/d28 39 2024-05-06T21:26:42.696 INFO:tasks.workunit.client.0.smithi032.stdout:5/348: fdatasync d0/d16/f1e 0 2024-05-06T21:26:42.697 INFO:tasks.workunit.client.0.smithi032.stdout:7/511: symlink db/d12/d16/d21/l9e 0 2024-05-06T21:26:42.697 INFO:tasks.workunit.client.1.smithi154.stdout:6/50: write f2 [1313460,124705] 0 2024-05-06T21:26:42.698 INFO:tasks.workunit.client.0.smithi032.stdout:7/512: getdents db/d12/d16/d2a/d39/d8b 0 2024-05-06T21:26:42.698 INFO:tasks.workunit.client.1.smithi154.stdout:2/95: dread f0 [4194304,4194304] 0 2024-05-06T21:26:42.698 INFO:tasks.workunit.client.1.smithi154.stdout:2/96: fdatasync db/de/f1c 0 2024-05-06T21:26:42.699 INFO:tasks.workunit.client.1.smithi154.stdout:2/97: readlink db/lf 0 2024-05-06T21:26:42.699 INFO:tasks.workunit.client.0.smithi032.stdout:7/513: truncate db/d12/f17 3025514 0 2024-05-06T21:26:42.699 INFO:tasks.workunit.client.0.smithi032.stdout:7/514: creat db/d12/d49/d97/f9f x:0 0 0 2024-05-06T21:26:42.699 INFO:tasks.workunit.client.0.smithi032.stdout:7/515: chown db/d12/d16/d21/d41/d4b/f54 0 1 2024-05-06T21:26:42.701 INFO:tasks.workunit.client.0.smithi032.stdout:9/496: dwrite d1/d13/d34/f9c [0,4194304] 0 2024-05-06T21:26:42.702 INFO:tasks.workunit.client.0.smithi032.stdout:5/349: write d0/f27 [3567544,90786] 0 2024-05-06T21:26:42.702 INFO:tasks.workunit.client.0.smithi032.stdout:6/539: dwrite d8/dd/d18/d13/d7a/f7d [0,4194304] 0 2024-05-06T21:26:42.705 INFO:tasks.workunit.client.0.smithi032.stdout:9/497: creat d1/d13/d34/d92/fa5 x:0 0 0 2024-05-06T21:26:42.706 INFO:tasks.workunit.client.0.smithi032.stdout:5/350: rename d0/d16/d2f/f43 to d0/d24/d26/d3d/d50/f65 0 2024-05-06T21:26:42.706 INFO:tasks.workunit.client.0.smithi032.stdout:5/351: chown d0/d24/d38/d37 936965 1 2024-05-06T21:26:42.710 INFO:tasks.workunit.client.0.smithi032.stdout:9/498: mkdir d1/d13/d33/da6 0 2024-05-06T21:26:42.722 INFO:tasks.workunit.client.1.smithi154.stdout:3/120: mkdir d0/d2/d22 0 2024-05-06T21:26:42.725 INFO:tasks.workunit.client.1.smithi154.stdout:5/65: truncate d2/f4 3549357 0 2024-05-06T21:26:42.728 INFO:tasks.workunit.client.0.smithi032.stdout:5/352: dwrite d0/d28/f33 [0,4194304] 0 2024-05-06T21:26:42.730 INFO:tasks.workunit.client.1.smithi154.stdout:6/51: mknod d8/d11/c14 0 2024-05-06T21:26:42.731 INFO:tasks.workunit.client.1.smithi154.stdout:6/52: stat d8/d11 0 2024-05-06T21:26:42.731 INFO:tasks.workunit.client.0.smithi032.stdout:5/353: creat d0/d24/f66 x:0 0 0 2024-05-06T21:26:42.731 INFO:tasks.workunit.client.0.smithi032.stdout:5/354: write d0/d24/d38/f30 [4100331,38800] 0 2024-05-06T21:26:42.731 INFO:tasks.workunit.client.0.smithi032.stdout:5/355: write d0/d24/d38/d37/f53 [510659,30434] 0 2024-05-06T21:26:42.731 INFO:tasks.workunit.client.0.smithi032.stdout:5/356: dread - d0/d24/d34/f45 zero size 2024-05-06T21:26:42.731 INFO:tasks.workunit.client.0.smithi032.stdout:6/540: dwrite d8/d33/f36 [4194304,4194304] 0 2024-05-06T21:26:42.732 INFO:tasks.workunit.client.1.smithi154.stdout:2/98: creat db/d12/f21 x:0 0 0 2024-05-06T21:26:42.733 INFO:tasks.workunit.client.1.smithi154.stdout:8/98: symlink d3/l25 0 2024-05-06T21:26:42.733 INFO:tasks.workunit.client.1.smithi154.stdout:3/121: mknod d0/da/db/dd/d1c/d21/c23 0 2024-05-06T21:26:42.735 INFO:tasks.workunit.client.0.smithi032.stdout:6/541: rmdir d8/d3d 39 2024-05-06T21:26:42.735 INFO:tasks.workunit.client.1.smithi154.stdout:6/53: rename c0 to d8/d13/c15 0 2024-05-06T21:26:42.737 INFO:tasks.workunit.client.1.smithi154.stdout:8/99: unlink f2 0 2024-05-06T21:26:42.739 INFO:tasks.workunit.client.1.smithi154.stdout:3/122: mknod d0/da/d1a/c24 0 2024-05-06T21:26:42.739 INFO:tasks.workunit.client.1.smithi154.stdout:5/66: fsync d2/f4 0 2024-05-06T21:26:42.747 INFO:tasks.workunit.client.1.smithi154.stdout:6/54: dread f6 [0,4194304] 0 2024-05-06T21:26:42.749 INFO:tasks.workunit.client.1.smithi154.stdout:6/55: mknod d8/c16 0 2024-05-06T21:26:42.750 INFO:tasks.workunit.client.1.smithi154.stdout:6/56: symlink d8/d13/l17 0 2024-05-06T21:26:42.755 INFO:tasks.workunit.client.1.smithi154.stdout:2/99: dwrite db/f13 [0,4194304] 0 2024-05-06T21:26:42.757 INFO:tasks.workunit.client.1.smithi154.stdout:7/23: sync 2024-05-06T21:26:42.757 INFO:tasks.workunit.client.1.smithi154.stdout:1/87: sync 2024-05-06T21:26:42.757 INFO:tasks.workunit.client.1.smithi154.stdout:1/88: chown d6 35553377 1 2024-05-06T21:26:42.757 INFO:tasks.workunit.client.1.smithi154.stdout:7/24: fsync f4 0 2024-05-06T21:26:42.757 INFO:tasks.workunit.client.1.smithi154.stdout:7/25: creat f5 x:0 0 0 2024-05-06T21:26:42.759 INFO:tasks.workunit.client.1.smithi154.stdout:7/26: mkdir d6 0 2024-05-06T21:26:42.760 INFO:tasks.workunit.client.1.smithi154.stdout:7/27: fdatasync f5 0 2024-05-06T21:26:42.760 INFO:tasks.workunit.client.1.smithi154.stdout:7/28: chown f5 5222 1 2024-05-06T21:26:42.760 INFO:tasks.workunit.client.1.smithi154.stdout:7/29: truncate f5 511955 0 2024-05-06T21:26:42.760 INFO:tasks.workunit.client.1.smithi154.stdout:7/30: fdatasync f5 0 2024-05-06T21:26:42.760 INFO:tasks.workunit.client.1.smithi154.stdout:8/100: dread d3/fc [4194304,4194304] 0 2024-05-06T21:26:42.761 INFO:tasks.workunit.client.1.smithi154.stdout:7/31: creat d6/f7 x:0 0 0 2024-05-06T21:26:42.761 INFO:tasks.workunit.client.1.smithi154.stdout:7/32: dread - d6/f7 zero size 2024-05-06T21:26:42.762 INFO:tasks.workunit.client.1.smithi154.stdout:8/101: mkdir d3/d14/d1a/d22/d26 0 2024-05-06T21:26:42.762 INFO:tasks.workunit.client.1.smithi154.stdout:8/102: write d3/f10 [4907840,115535] 0 2024-05-06T21:26:42.762 INFO:tasks.workunit.client.1.smithi154.stdout:8/103: chown d3/fd 115517477 1 2024-05-06T21:26:42.763 INFO:tasks.workunit.client.1.smithi154.stdout:7/33: mkdir d6/d8 0 2024-05-06T21:26:42.765 INFO:tasks.workunit.client.1.smithi154.stdout:6/57: write d8/fc [629474,33935] 0 2024-05-06T21:26:42.767 INFO:tasks.workunit.client.1.smithi154.stdout:6/58: symlink d8/l18 0 2024-05-06T21:26:42.768 INFO:tasks.workunit.client.1.smithi154.stdout:6/59: mknod d8/d13/c19 0 2024-05-06T21:26:42.771 INFO:tasks.workunit.client.1.smithi154.stdout:2/100: read f2 [7870382,126606] 0 2024-05-06T21:26:42.771 INFO:tasks.workunit.client.1.smithi154.stdout:6/60: creat d8/d11/f1a x:0 0 0 2024-05-06T21:26:42.773 INFO:tasks.workunit.client.1.smithi154.stdout:6/61: rename d8/ff to d8/d11/f1b 0 2024-05-06T21:26:42.774 INFO:tasks.workunit.client.1.smithi154.stdout:2/101: mknod db/c22 0 2024-05-06T21:26:42.775 INFO:tasks.workunit.client.1.smithi154.stdout:2/102: fsync db/f13 0 2024-05-06T21:26:42.776 INFO:tasks.workunit.client.1.smithi154.stdout:2/103: rmdir db/d12/d19 39 2024-05-06T21:26:42.777 INFO:tasks.workunit.client.1.smithi154.stdout:2/104: creat db/d12/f23 x:0 0 0 2024-05-06T21:26:42.785 INFO:tasks.workunit.client.0.smithi032.stdout:6/542: dwrite d8/f2b [0,4194304] 0 2024-05-06T21:26:42.785 INFO:tasks.workunit.client.1.smithi154.stdout:5/67: dwrite d2/f4 [0,4194304] 0 2024-05-06T21:26:42.785 INFO:tasks.workunit.client.1.smithi154.stdout:3/123: dwrite d0/f3 [0,4194304] 0 2024-05-06T21:26:42.785 INFO:tasks.workunit.client.1.smithi154.stdout:5/68: chown d2/d6/dc 3 1 2024-05-06T21:26:42.785 INFO:tasks.workunit.client.1.smithi154.stdout:3/124: readlink d0/da/db/l16 0 2024-05-06T21:26:42.787 INFO:tasks.workunit.client.0.smithi032.stdout:6/543: link d8/d3d/d49/l5b d8/dd/la0 0 2024-05-06T21:26:42.792 INFO:tasks.workunit.client.1.smithi154.stdout:1/89: dwrite d6/fd [4194304,4194304] 0 2024-05-06T21:26:42.792 INFO:tasks.workunit.client.1.smithi154.stdout:2/105: dread db/de/f1c [0,4194304] 0 2024-05-06T21:26:42.795 INFO:tasks.workunit.client.1.smithi154.stdout:1/90: rename d6/fc to d6/f17 0 2024-05-06T21:26:42.796 INFO:tasks.workunit.client.1.smithi154.stdout:2/106: rmdir db 39 2024-05-06T21:26:42.797 INFO:tasks.workunit.client.1.smithi154.stdout:2/107: write db/d12/f23 [873234,50895] 0 2024-05-06T21:26:42.799 INFO:tasks.workunit.client.1.smithi154.stdout:1/91: rename d6/c9 to d6/db/c18 0 2024-05-06T21:26:42.799 INFO:tasks.workunit.client.1.smithi154.stdout:1/92: creat d6/f19 x:0 0 0 2024-05-06T21:26:42.801 INFO:tasks.workunit.client.1.smithi154.stdout:2/108: mknod db/d12/d19/c24 0 2024-05-06T21:26:42.804 INFO:tasks.workunit.client.1.smithi154.stdout:1/93: mkdir d6/d1a 0 2024-05-06T21:26:42.804 INFO:tasks.workunit.client.1.smithi154.stdout:1/94: dread - d6/f19 zero size 2024-05-06T21:26:42.806 INFO:tasks.workunit.client.1.smithi154.stdout:1/95: rmdir d6/db/d10/d15 39 2024-05-06T21:26:42.806 INFO:tasks.workunit.client.1.smithi154.stdout:1/96: write d6/f19 [700833,100599] 0 2024-05-06T21:26:42.809 INFO:tasks.workunit.client.1.smithi154.stdout:1/97: unlink d6/fd 0 2024-05-06T21:26:42.810 INFO:tasks.workunit.client.1.smithi154.stdout:6/62: rmdir d8 39 2024-05-06T21:26:42.810 INFO:tasks.workunit.client.1.smithi154.stdout:6/63: write f2 [5149623,21239] 0 2024-05-06T21:26:42.810 INFO:tasks.workunit.client.1.smithi154.stdout:6/64: readlink d8/l18 0 2024-05-06T21:26:42.811 INFO:tasks.workunit.client.1.smithi154.stdout:8/104: dwrite d3/fb [0,4194304] 0 2024-05-06T21:26:42.811 INFO:tasks.workunit.client.1.smithi154.stdout:2/109: dread f0 [4194304,4194304] 0 2024-05-06T21:26:42.812 INFO:tasks.workunit.client.1.smithi154.stdout:2/110: creat db/de/d10/f25 x:0 0 0 2024-05-06T21:26:42.812 INFO:tasks.workunit.client.1.smithi154.stdout:2/111: chown db/d12/d19/l20 2243 1 2024-05-06T21:26:42.812 INFO:tasks.workunit.client.1.smithi154.stdout:2/112: write db/d12/f23 [1308839,130257] 0 2024-05-06T21:26:42.812 INFO:tasks.workunit.client.1.smithi154.stdout:1/98: mkdir d6/d1a/d1b 0 2024-05-06T21:26:42.813 INFO:tasks.workunit.client.1.smithi154.stdout:8/105: symlink d3/d14/d1a/d22/d26/l27 0 2024-05-06T21:26:42.819 INFO:tasks.workunit.client.1.smithi154.stdout:5/69: dwrite d2/f4 [0,4194304] 0 2024-05-06T21:26:42.821 INFO:tasks.workunit.client.1.smithi154.stdout:5/70: creat d2/d6/dc/f15 x:0 0 0 2024-05-06T21:26:42.821 INFO:tasks.workunit.client.1.smithi154.stdout:5/71: stat d2/d3/f9 0 2024-05-06T21:26:42.822 INFO:tasks.workunit.client.0.smithi032.stdout:6/544: dwrite d8/dd/d1b/d35/f43 [0,4194304] 0 2024-05-06T21:26:42.823 INFO:tasks.workunit.client.1.smithi154.stdout:8/106: fdatasync d3/ff 0 2024-05-06T21:26:42.825 INFO:tasks.workunit.client.1.smithi154.stdout:8/107: dread d3/d14/f1e [0,4194304] 0 2024-05-06T21:26:42.828 INFO:tasks.workunit.client.0.smithi032.stdout:6/545: rename d8/dd/d18/d3b/f56 to d8/dd/d18/d13/d1d/fa1 0 2024-05-06T21:26:42.828 INFO:tasks.workunit.client.1.smithi154.stdout:8/108: creat d3/d14/d1a/f28 x:0 0 0 2024-05-06T21:26:42.828 INFO:tasks.workunit.client.1.smithi154.stdout:8/109: write d3/d14/d1a/d22/f23 [121547,66542] 0 2024-05-06T21:26:42.828 INFO:tasks.workunit.client.1.smithi154.stdout:8/110: chown d3/d14/d1a/d22/d26/l27 1 1 2024-05-06T21:26:42.831 INFO:tasks.workunit.client.0.smithi032.stdout:6/546: getdents d8/dd/d18/d3b 0 2024-05-06T21:26:42.831 INFO:tasks.workunit.client.0.smithi032.stdout:6/547: chown c7 0 1 2024-05-06T21:26:42.831 INFO:tasks.workunit.client.0.smithi032.stdout:6/548: write d8/d3d/d49/f60 [5152498,117196] 0 2024-05-06T21:26:42.832 INFO:tasks.workunit.client.0.smithi032.stdout:8/545: sync 2024-05-06T21:26:42.832 INFO:tasks.workunit.client.0.smithi032.stdout:8/546: readlink d0/d1c/l2c 0 2024-05-06T21:26:42.835 INFO:tasks.workunit.client.1.smithi154.stdout:7/34: dwrite f4 [0,4194304] 0 2024-05-06T21:26:42.839 INFO:tasks.workunit.client.1.smithi154.stdout:5/72: dwrite d2/d6/fe [4194304,4194304] 0 2024-05-06T21:26:42.839 INFO:tasks.workunit.client.1.smithi154.stdout:5/73: fsync d2/f14 0 2024-05-06T21:26:42.839 INFO:tasks.workunit.client.1.smithi154.stdout:3/125: dwrite d0/d4/f19 [0,4194304] 0 2024-05-06T21:26:42.843 INFO:tasks.workunit.client.0.smithi032.stdout:6/549: write d8/d3d/d49/d6b/f8a [1841735,73556] 0 2024-05-06T21:26:42.844 INFO:tasks.workunit.client.1.smithi154.stdout:1/99: dread d6/f19 [0,4194304] 0 2024-05-06T21:26:42.844 INFO:tasks.workunit.client.1.smithi154.stdout:1/100: truncate d6/f17 8443332 0 2024-05-06T21:26:42.846 INFO:tasks.workunit.client.1.smithi154.stdout:8/111: dread d3/fc [0,4194304] 0 2024-05-06T21:26:42.846 INFO:tasks.workunit.client.1.smithi154.stdout:7/35: link f4 d6/f9 0 2024-05-06T21:26:42.847 INFO:tasks.workunit.client.1.smithi154.stdout:6/65: dwrite f6 [0,4194304] 0 2024-05-06T21:26:42.848 INFO:tasks.workunit.client.0.smithi032.stdout:6/550: symlink d8/dd/d18/d22/la2 0 2024-05-06T21:26:42.848 INFO:tasks.workunit.client.0.smithi032.stdout:6/551: write d8/dd/d18/f69 [144551,103224] 0 2024-05-06T21:26:42.848 INFO:tasks.workunit.client.1.smithi154.stdout:8/112: write d3/f10 [4591252,36417] 0 2024-05-06T21:26:42.849 INFO:tasks.workunit.client.1.smithi154.stdout:5/74: creat d2/d3/f16 x:0 0 0 2024-05-06T21:26:42.849 INFO:tasks.workunit.client.1.smithi154.stdout:5/75: fdatasync d2/d6/fe 0 2024-05-06T21:26:42.850 INFO:tasks.workunit.client.0.smithi032.stdout:6/552: rename d8/d3d/d73/l97 to d8/dd/d18/d13/d1d/la3 0 2024-05-06T21:26:42.851 INFO:tasks.workunit.client.1.smithi154.stdout:6/66: truncate f7 1122648 0 2024-05-06T21:26:42.851 INFO:tasks.workunit.client.1.smithi154.stdout:6/67: dread - d8/d11/f1a zero size 2024-05-06T21:26:42.852 INFO:tasks.workunit.client.0.smithi032.stdout:6/553: mknod d8/d3d/d49/d6b/ca4 0 2024-05-06T21:26:42.852 INFO:tasks.workunit.client.1.smithi154.stdout:6/68: symlink d8/l1c 0 2024-05-06T21:26:42.853 INFO:tasks.workunit.client.0.smithi032.stdout:6/554: creat d8/dd/d18/d13/fa5 x:0 0 0 2024-05-06T21:26:42.853 INFO:tasks.workunit.client.0.smithi032.stdout:6/555: creat d8/dd/d1b/d67/fa6 x:0 0 0 2024-05-06T21:26:42.853 INFO:tasks.workunit.client.0.smithi032.stdout:6/556: creat d8/dd/d18/d13/fa7 x:0 0 0 2024-05-06T21:26:42.854 INFO:tasks.workunit.client.1.smithi154.stdout:5/76: dread d2/d6/fb [0,4194304] 0 2024-05-06T21:26:42.854 INFO:tasks.workunit.client.1.smithi154.stdout:1/101: write d6/f8 [3110289,127323] 0 2024-05-06T21:26:42.857 INFO:tasks.workunit.client.1.smithi154.stdout:1/102: symlink d6/db/l1c 0 2024-05-06T21:26:42.857 INFO:tasks.workunit.client.1.smithi154.stdout:1/103: fdatasync d6/db/d10/d15/f16 0 2024-05-06T21:26:42.859 INFO:tasks.workunit.client.1.smithi154.stdout:1/104: mkdir d6/db/d10/d15/d1d 0 2024-05-06T21:26:42.859 INFO:tasks.workunit.client.1.smithi154.stdout:1/105: stat d6/db/l1c 0 2024-05-06T21:26:42.861 INFO:tasks.workunit.client.1.smithi154.stdout:1/106: creat d6/d1a/f1e x:0 0 0 2024-05-06T21:26:42.861 INFO:tasks.workunit.client.1.smithi154.stdout:1/107: chown d6/db/l1c 0 1 2024-05-06T21:26:42.878 INFO:tasks.workunit.client.1.smithi154.stdout:2/113: dwrite db/d12/f23 [0,4194304] 0 2024-05-06T21:26:42.879 INFO:tasks.workunit.client.0.smithi032.stdout:6/557: fdatasync d8/dd/d18/f69 0 2024-05-06T21:26:42.879 INFO:tasks.workunit.client.0.smithi032.stdout:6/558: dread - d8/d3d/d49/d6b/f6f zero size 2024-05-06T21:26:42.879 INFO:tasks.workunit.client.0.smithi032.stdout:8/547: dwrite d0/f9a [0,4194304] 0 2024-05-06T21:26:42.880 INFO:tasks.workunit.client.0.smithi032.stdout:6/559: mknod d8/dd/d1b/ca8 0 2024-05-06T21:26:42.880 INFO:tasks.workunit.client.0.smithi032.stdout:6/560: chown d8/dd/l4b 2708 1 2024-05-06T21:26:42.881 INFO:tasks.workunit.client.0.smithi032.stdout:6/561: creat d8/d3d/d49/fa9 x:0 0 0 2024-05-06T21:26:42.881 INFO:tasks.workunit.client.0.smithi032.stdout:6/562: creat d8/dd/d1b/faa x:0 0 0 2024-05-06T21:26:42.881 INFO:tasks.workunit.client.1.smithi154.stdout:8/113: truncate d3/fd 631209 0 2024-05-06T21:26:42.881 INFO:tasks.workunit.client.1.smithi154.stdout:8/114: chown d3/fb 89821 1 2024-05-06T21:26:42.881 INFO:tasks.workunit.client.1.smithi154.stdout:8/115: write d3/d14/f19 [160577,8112] 0 2024-05-06T21:26:42.882 INFO:tasks.workunit.client.0.smithi032.stdout:8/548: symlink d0/d1b/d39/d3b/d97/la1 0 2024-05-06T21:26:42.882 INFO:tasks.workunit.client.0.smithi032.stdout:8/549: chown d0/l17 0 1 2024-05-06T21:26:42.883 INFO:tasks.workunit.client.1.smithi154.stdout:0/89: sync 2024-05-06T21:26:42.884 INFO:tasks.workunit.client.1.smithi154.stdout:2/114: dread db/f13 [4194304,4194304] 0 2024-05-06T21:26:42.884 INFO:tasks.workunit.client.1.smithi154.stdout:2/115: truncate db/de/d10/f14 4510418 0 2024-05-06T21:26:42.884 INFO:tasks.workunit.client.1.smithi154.stdout:2/116: chown db/de/d16/f1f 79 1 2024-05-06T21:26:42.884 INFO:tasks.workunit.client.1.smithi154.stdout:7/36: dwrite d6/f9 [0,4194304] 0 2024-05-06T21:26:42.884 INFO:tasks.workunit.client.1.smithi154.stdout:7/37: readlink - no filename 2024-05-06T21:26:42.885 INFO:tasks.workunit.client.1.smithi154.stdout:3/126: dwrite d0/d4/f19 [0,4194304] 0 2024-05-06T21:26:42.885 INFO:tasks.workunit.client.0.smithi032.stdout:6/563: rename d8/d3d/d8f/c93 to d8/dd/d18/d13/cab 0 2024-05-06T21:26:42.885 INFO:tasks.workunit.client.1.smithi154.stdout:2/117: rmdir db/de/d16 39 2024-05-06T21:26:42.886 INFO:tasks.workunit.client.0.smithi032.stdout:8/550: getdents d0/d1b 0 2024-05-06T21:26:42.886 INFO:tasks.workunit.client.0.smithi032.stdout:8/551: readlink d0/l15 0 2024-05-06T21:26:42.887 INFO:tasks.workunit.client.1.smithi154.stdout:4/77: sync 2024-05-06T21:26:42.887 INFO:tasks.workunit.client.1.smithi154.stdout:4/78: chown d0/d2/dc/fe 682 1 2024-05-06T21:26:42.887 INFO:tasks.workunit.client.1.smithi154.stdout:5/77: dwrite d2/d6/fe [4194304,4194304] 0 2024-05-06T21:26:42.887 INFO:tasks.workunit.client.1.smithi154.stdout:5/78: chown d2/f4 300 1 2024-05-06T21:26:42.887 INFO:tasks.workunit.client.1.smithi154.stdout:5/79: dread - d2/d6/dc/f15 zero size 2024-05-06T21:26:42.887 INFO:tasks.workunit.client.1.smithi154.stdout:9/157: sync 2024-05-06T21:26:42.888 INFO:tasks.workunit.client.0.smithi032.stdout:6/564: truncate d8/f8c 3685089 0 2024-05-06T21:26:42.888 INFO:tasks.workunit.client.1.smithi154.stdout:0/90: write d6/d10/f11 [1731955,31776] 0 2024-05-06T21:26:42.888 INFO:tasks.workunit.client.1.smithi154.stdout:7/38: rmdir d6/d8 0 2024-05-06T21:26:42.889 INFO:tasks.workunit.client.1.smithi154.stdout:7/39: creat d6/fa x:0 0 0 2024-05-06T21:26:42.889 INFO:tasks.workunit.client.1.smithi154.stdout:7/40: creat d6/fb x:0 0 0 2024-05-06T21:26:42.890 INFO:tasks.workunit.client.0.smithi032.stdout:8/552: rename d0/f41 to d0/d1c/fa2 0 2024-05-06T21:26:42.891 INFO:tasks.workunit.client.1.smithi154.stdout:3/127: creat d0/d2/f25 x:0 0 0 2024-05-06T21:26:42.893 INFO:tasks.workunit.client.0.smithi032.stdout:6/565: symlink d8/dd/lac 0 2024-05-06T21:26:42.893 INFO:tasks.workunit.client.1.smithi154.stdout:2/118: dread f0 [4194304,4194304] 0 2024-05-06T21:26:42.894 INFO:tasks.workunit.client.1.smithi154.stdout:4/79: link d0/d10/f15 d0/d10/d11/f17 0 2024-05-06T21:26:42.895 INFO:tasks.workunit.client.0.smithi032.stdout:8/553: link d0/f16 d0/d1b/d47/d91/fa3 0 2024-05-06T21:26:42.899 INFO:tasks.workunit.client.1.smithi154.stdout:9/158: unlink d5/d20/l32 0 2024-05-06T21:26:42.900 INFO:tasks.workunit.client.1.smithi154.stdout:2/119: dread f2 [4194304,4194304] 0 2024-05-06T21:26:42.900 INFO:tasks.workunit.client.1.smithi154.stdout:2/120: stat f2 0 2024-05-06T21:26:42.900 INFO:tasks.workunit.client.0.smithi032.stdout:6/566: getdents d8/d33 0 2024-05-06T21:26:42.901 INFO:tasks.workunit.client.0.smithi032.stdout:6/567: write d8/dd/d1b/d35/f3a [5011328,124574] 0 2024-05-06T21:26:42.901 INFO:tasks.workunit.client.1.smithi154.stdout:5/80: write d2/d3/fa [1779262,83761] 0 2024-05-06T21:26:42.903 INFO:tasks.workunit.client.1.smithi154.stdout:7/41: rename d6/f7 to d6/fc 0 2024-05-06T21:26:42.903 INFO:tasks.workunit.client.1.smithi154.stdout:6/69: rename f7 to d8/d11/f1d 0 2024-05-06T21:26:42.903 INFO:tasks.workunit.client.1.smithi154.stdout:3/128: symlink d0/l26 0 2024-05-06T21:26:42.904 INFO:tasks.workunit.client.0.smithi032.stdout:8/554: rename d0/f4 to d0/d1b/fa4 0 2024-05-06T21:26:42.904 INFO:tasks.workunit.client.0.smithi032.stdout:8/555: chown d0/d1c/d5e 0 1 2024-05-06T21:26:42.904 INFO:tasks.workunit.client.1.smithi154.stdout:2/121: mkdir db/d12/d1d/d26 0 2024-05-06T21:26:42.906 INFO:tasks.workunit.client.0.smithi032.stdout:8/556: creat d0/d1b/d39/d3b/d57/fa5 x:0 0 0 2024-05-06T21:26:42.907 INFO:tasks.workunit.client.1.smithi154.stdout:5/81: link d2/d6/fe d2/f17 0 2024-05-06T21:26:42.908 INFO:tasks.workunit.client.0.smithi032.stdout:8/557: mknod d0/d1b/d39/d3b/d57/d5d/ca6 0 2024-05-06T21:26:42.909 INFO:tasks.workunit.client.0.smithi032.stdout:8/558: read d0/d1b/d47/f87 [32684,16427] 0 2024-05-06T21:26:42.911 INFO:tasks.workunit.client.1.smithi154.stdout:1/108: rename d6/d1a/f1e to d6/db/d10/d15/d1d/f1f 0 2024-05-06T21:26:42.911 INFO:tasks.workunit.client.1.smithi154.stdout:1/109: fsync d6/db/d10/d15/f16 0 2024-05-06T21:26:42.911 INFO:tasks.workunit.client.1.smithi154.stdout:1/110: chown d6/db/d10/d15 1980894 1 2024-05-06T21:26:42.911 INFO:tasks.workunit.client.1.smithi154.stdout:1/111: write d6/db/d10/d15/f16 [604046,5078] 0 2024-05-06T21:26:42.911 INFO:tasks.workunit.client.0.smithi032.stdout:8/559: mkdir d0/d1b/d47/d91/da7 0 2024-05-06T21:26:42.913 INFO:tasks.workunit.client.1.smithi154.stdout:2/122: unlink db/de/d10/f1b 0 2024-05-06T21:26:42.914 INFO:tasks.workunit.client.1.smithi154.stdout:7/42: dread d6/f9 [0,4194304] 0 2024-05-06T21:26:42.914 INFO:tasks.workunit.client.0.smithi032.stdout:8/560: dread d0/d1b/d39/d3b/f72 [4194304,4194304] 0 2024-05-06T21:26:42.915 INFO:tasks.workunit.client.1.smithi154.stdout:5/82: creat d2/d6/dd/f18 x:0 0 0 2024-05-06T21:26:42.915 INFO:tasks.workunit.client.1.smithi154.stdout:5/83: read - d2/d6/f13 zero size 2024-05-06T21:26:42.918 INFO:tasks.workunit.client.1.smithi154.stdout:3/129: read d0/f3 [691785,108939] 0 2024-05-06T21:26:42.918 INFO:tasks.workunit.client.1.smithi154.stdout:5/84: mkdir d2/d3/d19 0 2024-05-06T21:26:42.918 INFO:tasks.workunit.client.1.smithi154.stdout:5/85: chown d2/f4 8880 1 2024-05-06T21:26:42.918 INFO:tasks.workunit.client.1.smithi154.stdout:5/86: readlink d2/l12 0 2024-05-06T21:26:42.918 INFO:tasks.workunit.client.1.smithi154.stdout:5/87: dread - d2/d6/f13 zero size 2024-05-06T21:26:42.919 INFO:tasks.workunit.client.1.smithi154.stdout:3/130: symlink d0/da/db/dd/d1c/l27 0 2024-05-06T21:26:42.920 INFO:tasks.workunit.client.0.smithi032.stdout:8/561: dread d0/f9 [0,4194304] 0 2024-05-06T21:26:42.922 INFO:tasks.workunit.client.1.smithi154.stdout:5/88: link d2/d3/fa d2/f1a 0 2024-05-06T21:26:42.923 INFO:tasks.workunit.client.1.smithi154.stdout:3/131: unlink d0/da/db/dd/f11 0 2024-05-06T21:26:42.923 INFO:tasks.workunit.client.1.smithi154.stdout:3/132: fdatasync d0/f3 0 2024-05-06T21:26:42.925 INFO:tasks.workunit.client.1.smithi154.stdout:3/133: rename d0/d4 to d0/da/d1a/d28 0 2024-05-06T21:26:42.926 INFO:tasks.workunit.client.1.smithi154.stdout:3/134: symlink d0/da/d1a/d28/d17/l29 0 2024-05-06T21:26:42.926 INFO:tasks.workunit.client.1.smithi154.stdout:3/135: readlink d0/da/d1a/d28/d17/l29 0 2024-05-06T21:26:42.929 INFO:tasks.workunit.client.0.smithi032.stdout:6/568: dwrite d8/d3d/d49/d6b/f8d [0,4194304] 0 2024-05-06T21:26:42.930 INFO:tasks.workunit.client.1.smithi154.stdout:4/80: dwrite d0/d10/f15 [0,4194304] 0 2024-05-06T21:26:42.930 INFO:tasks.workunit.client.1.smithi154.stdout:9/159: dwrite d5/d20/d37/f38 [0,4194304] 0 2024-05-06T21:26:42.932 INFO:tasks.workunit.client.1.smithi154.stdout:5/89: dread d2/f14 [0,4194304] 0 2024-05-06T21:26:42.934 INFO:tasks.workunit.client.1.smithi154.stdout:7/43: dwrite f5 [0,4194304] 0 2024-05-06T21:26:42.934 INFO:tasks.workunit.client.1.smithi154.stdout:7/44: readlink - no filename 2024-05-06T21:26:42.934 INFO:tasks.workunit.client.1.smithi154.stdout:7/45: chown d6/f9 26 1 2024-05-06T21:26:42.934 INFO:tasks.workunit.client.1.smithi154.stdout:7/46: creat d6/fd x:0 0 0 2024-05-06T21:26:42.935 INFO:tasks.workunit.client.1.smithi154.stdout:4/81: getdents d0/d2/dc 0 2024-05-06T21:26:42.936 INFO:tasks.workunit.client.1.smithi154.stdout:3/136: read d0/da/db/f10 [3002087,29629] 0 2024-05-06T21:26:42.936 INFO:tasks.workunit.client.1.smithi154.stdout:3/137: chown d0/da/d1a/d28/d17/f1e 65806 1 2024-05-06T21:26:42.936 INFO:tasks.workunit.client.1.smithi154.stdout:3/138: chown d0/da/db/dd/d1c/l27 225626992 1 2024-05-06T21:26:42.936 INFO:tasks.workunit.client.1.smithi154.stdout:3/139: readlink d0/da/db/l16 0 2024-05-06T21:26:42.937 INFO:tasks.workunit.client.1.smithi154.stdout:5/90: dread d2/d6/fb [0,4194304] 0 2024-05-06T21:26:42.937 INFO:tasks.workunit.client.1.smithi154.stdout:9/160: creat d5/d14/d31/f3d x:0 0 0 2024-05-06T21:26:42.937 INFO:tasks.workunit.client.1.smithi154.stdout:9/161: write d5/d20/f2c [1194528,114817] 0 2024-05-06T21:26:42.940 INFO:tasks.workunit.client.0.smithi032.stdout:6/569: write d8/f31 [395200,26866] 0 2024-05-06T21:26:42.942 INFO:tasks.workunit.client.0.smithi032.stdout:6/570: mkdir d8/d3d/d49/dad 0 2024-05-06T21:26:42.943 INFO:tasks.workunit.client.1.smithi154.stdout:4/82: dread d0/d2/dc/fe [0,4194304] 0 2024-05-06T21:26:42.943 INFO:tasks.workunit.client.0.smithi032.stdout:6/571: symlink d8/dd/d18/d13/d1d/lae 0 2024-05-06T21:26:42.944 INFO:tasks.workunit.client.0.smithi032.stdout:6/572: mknod d8/d3d/caf 0 2024-05-06T21:26:42.945 INFO:tasks.workunit.client.1.smithi154.stdout:3/140: dread d0/da/db/dd/fc [0,4194304] 0 2024-05-06T21:26:42.945 INFO:tasks.workunit.client.1.smithi154.stdout:7/47: unlink f5 0 2024-05-06T21:26:42.946 INFO:tasks.workunit.client.0.smithi032.stdout:6/573: symlink d8/dd/d18/d3b/lb0 0 2024-05-06T21:26:42.948 INFO:tasks.workunit.client.1.smithi154.stdout:5/91: rename d2/l12 to d2/d6/dc/l1b 0 2024-05-06T21:26:42.948 INFO:tasks.workunit.client.1.smithi154.stdout:4/83: dread d0/d2/dc/fe [0,4194304] 0 2024-05-06T21:26:42.950 INFO:tasks.workunit.client.1.smithi154.stdout:9/162: mknod d5/d2e/c3e 0 2024-05-06T21:26:42.951 INFO:tasks.workunit.client.0.smithi032.stdout:6/574: write d8/d3d/d49/f60 [2912162,93596] 0 2024-05-06T21:26:42.953 INFO:tasks.workunit.client.0.smithi032.stdout:6/575: symlink d8/dd/d18/d13/lb1 0 2024-05-06T21:26:42.953 INFO:tasks.workunit.client.1.smithi154.stdout:1/112: unlink d6/db/d10/d15/d1d/f1f 0 2024-05-06T21:26:42.954 INFO:tasks.workunit.client.0.smithi032.stdout:6/576: symlink d8/d3d/d49/lb2 0 2024-05-06T21:26:42.954 INFO:tasks.workunit.client.0.smithi032.stdout:6/577: truncate d8/dd/d18/d13/fa5 752278 0 2024-05-06T21:26:42.955 INFO:tasks.workunit.client.1.smithi154.stdout:7/48: mkdir d6/de 0 2024-05-06T21:26:42.955 INFO:tasks.workunit.client.1.smithi154.stdout:3/141: write d0/da/db/dd/ff [2391635,67836] 0 2024-05-06T21:26:42.956 INFO:tasks.workunit.client.1.smithi154.stdout:3/142: creat d0/da/db/f2a x:0 0 0 2024-05-06T21:26:42.957 INFO:tasks.workunit.client.1.smithi154.stdout:4/84: creat d0/d2/dc/f18 x:0 0 0 2024-05-06T21:26:42.958 INFO:tasks.workunit.client.1.smithi154.stdout:9/163: rmdir d5/d14/d1e 39 2024-05-06T21:26:42.958 INFO:tasks.workunit.client.1.smithi154.stdout:9/164: chown d5/f13 33280181 1 2024-05-06T21:26:42.960 INFO:tasks.workunit.client.1.smithi154.stdout:1/113: rename d6/f19 to d6/db/d10/d15/f20 0 2024-05-06T21:26:42.964 INFO:tasks.workunit.client.1.smithi154.stdout:7/49: write f4 [2662203,108200] 0 2024-05-06T21:26:42.964 INFO:tasks.workunit.client.1.smithi154.stdout:3/143: creat d0/f2b x:0 0 0 2024-05-06T21:26:42.964 INFO:tasks.workunit.client.1.smithi154.stdout:3/144: fsync d0/da/f18 0 2024-05-06T21:26:42.968 INFO:tasks.workunit.client.1.smithi154.stdout:5/92: truncate d2/f4 1598627 0 2024-05-06T21:26:42.968 INFO:tasks.workunit.client.1.smithi154.stdout:9/165: dread d5/f13 [0,4194304] 0 2024-05-06T21:26:42.968 INFO:tasks.workunit.client.1.smithi154.stdout:4/85: write d0/d10/d11/f17 [4468316,789] 0 2024-05-06T21:26:42.968 INFO:tasks.workunit.client.1.smithi154.stdout:9/166: read - d5/d14/d31/f3d zero size 2024-05-06T21:26:42.968 INFO:tasks.workunit.client.1.smithi154.stdout:9/167: dread - d5/d14/d31/d39/f3c zero size 2024-05-06T21:26:42.968 INFO:tasks.workunit.client.1.smithi154.stdout:1/114: symlink d6/db/d10/l21 0 2024-05-06T21:26:42.968 INFO:tasks.workunit.client.1.smithi154.stdout:1/115: truncate d6/db/d10/d15/f20 1197114 0 2024-05-06T21:26:42.968 INFO:tasks.workunit.client.1.smithi154.stdout:1/116: fdatasync d6/db/d10/d15/f20 0 2024-05-06T21:26:42.969 INFO:tasks.workunit.client.1.smithi154.stdout:7/50: symlink d6/lf 0 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:7/516: sync 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:3/526: sync 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:0/424: sync 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:0/425: fdatasync d4/da/d16/d33/d46/f50 0 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:4/534: sync 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:4/535: chown d2/d16/d44/d45/f6e 1500883 1 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:1/428: sync 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:9/499: sync 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:2/374: sync 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:4/536: write d2/d16/f41 [429502,83651] 0 2024-05-06T21:26:42.970 INFO:tasks.workunit.client.0.smithi032.stdout:5/357: sync 2024-05-06T21:26:42.971 INFO:tasks.workunit.client.1.smithi154.stdout:4/86: symlink d0/l19 0 2024-05-06T21:26:42.971 INFO:tasks.workunit.client.0.smithi032.stdout:3/527: unlink d1/d4/da/d4e/d5e/cb6 0 2024-05-06T21:26:42.972 INFO:tasks.workunit.client.1.smithi154.stdout:9/168: mknod d5/d14/d31/d39/c3f 0 2024-05-06T21:26:42.972 INFO:tasks.workunit.client.1.smithi154.stdout:9/169: creat d5/d14/d31/f40 x:0 0 0 2024-05-06T21:26:42.972 INFO:tasks.workunit.client.0.smithi032.stdout:5/358: dread d0/d24/d26/d3d/d50/f65 [0,4194304] 0 2024-05-06T21:26:42.972 INFO:tasks.workunit.client.0.smithi032.stdout:7/517: mknod db/d12/d16/d21/ca0 0 2024-05-06T21:26:42.973 INFO:tasks.workunit.client.1.smithi154.stdout:1/117: mknod d6/c22 0 2024-05-06T21:26:42.973 INFO:tasks.workunit.client.0.smithi032.stdout:0/426: symlink d4/da/d16/l82 0 2024-05-06T21:26:42.974 INFO:tasks.workunit.client.0.smithi032.stdout:0/427: chown d4/da/d16/d33/c67 1091 1 2024-05-06T21:26:42.974 INFO:tasks.workunit.client.0.smithi032.stdout:1/429: symlink db/d47/l84 0 2024-05-06T21:26:42.976 INFO:tasks.workunit.client.0.smithi032.stdout:2/375: mknod df/d19/d1e/d35/c8a 0 2024-05-06T21:26:42.977 INFO:tasks.workunit.client.1.smithi154.stdout:7/51: rename f4 to d6/f10 0 2024-05-06T21:26:42.979 INFO:tasks.workunit.client.0.smithi032.stdout:3/528: mknod d1/d4/da/d4e/d41/d97/d67/da6/cba 0 2024-05-06T21:26:42.979 INFO:tasks.workunit.client.0.smithi032.stdout:3/529: write d1/d4/fe [4934394,74200] 0 2024-05-06T21:26:42.979 INFO:tasks.workunit.client.0.smithi032.stdout:3/530: creat d1/d4/da/d4e/d41/d43/fbb x:0 0 0 2024-05-06T21:26:42.980 INFO:tasks.workunit.client.0.smithi032.stdout:7/518: mkdir db/d12/d16/da1 0 2024-05-06T21:26:42.981 INFO:tasks.workunit.client.0.smithi032.stdout:0/428: mknod d4/d3e/d42/c83 0 2024-05-06T21:26:42.983 INFO:tasks.workunit.client.1.smithi154.stdout:4/87: mkdir d0/d10/d11/d1a 0 2024-05-06T21:26:42.983 INFO:tasks.workunit.client.1.smithi154.stdout:4/88: dread - d0/d2/dc/f16 zero size 2024-05-06T21:26:42.983 INFO:tasks.workunit.client.1.smithi154.stdout:4/89: creat d0/d2/f1b x:0 0 0 2024-05-06T21:26:42.984 INFO:tasks.workunit.client.0.smithi032.stdout:1/430: rename db/d2a/f2d to db/d37/d52/f85 0 2024-05-06T21:26:42.984 INFO:tasks.workunit.client.0.smithi032.stdout:9/500: rmdir d1/d13/d33/d5e/d78 39 2024-05-06T21:26:42.988 INFO:tasks.workunit.client.0.smithi032.stdout:3/531: unlink d1/c1f 0 2024-05-06T21:26:42.989 INFO:tasks.workunit.client.0.smithi032.stdout:5/359: read d0/d24/d38/f25 [3185071,102055] 0 2024-05-06T21:26:42.990 INFO:tasks.workunit.client.0.smithi032.stdout:4/537: read d2/d16/d44/d45/f6d [2890134,125518] 0 2024-05-06T21:26:42.990 INFO:tasks.workunit.client.0.smithi032.stdout:6/578: dwrite d8/d33/f36 [4194304,4194304] 0 2024-05-06T21:26:42.990 INFO:tasks.workunit.client.0.smithi032.stdout:6/579: write d8/dd/d1b/d67/f85 [107159,23453] 0 2024-05-06T21:26:42.993 INFO:tasks.workunit.client.0.smithi032.stdout:0/429: getdents d4/da/d14/d1a 0 2024-05-06T21:26:42.993 INFO:tasks.workunit.client.0.smithi032.stdout:0/430: fsync d4/d3e/d42/f5f 0 2024-05-06T21:26:42.994 INFO:tasks.workunit.client.0.smithi032.stdout:5/360: truncate d0/d16/f1c 3740902 0 2024-05-06T21:26:42.995 INFO:tasks.workunit.client.0.smithi032.stdout:1/431: mknod db/d2a/c86 0 2024-05-06T21:26:42.997 INFO:tasks.workunit.client.0.smithi032.stdout:6/580: creat d8/d3d/d73/d87/fb3 x:0 0 0 2024-05-06T21:26:42.997 INFO:tasks.workunit.client.0.smithi032.stdout:9/501: getdents d1/d2f/d4f/d97 0 2024-05-06T21:26:42.997 INFO:tasks.workunit.client.0.smithi032.stdout:9/502: fsync d1/f12 0 2024-05-06T21:26:42.999 INFO:tasks.workunit.client.0.smithi032.stdout:0/431: symlink d4/da/d14/d1a/l84 0 2024-05-06T21:26:43.000 INFO:tasks.workunit.client.1.smithi154.stdout:3/145: dwrite d0/da/d1a/d28/d17/f1e [0,4194304] 0 2024-05-06T21:26:43.000 INFO:tasks.workunit.client.1.smithi154.stdout:3/146: fdatasync d0/f2b 0 2024-05-06T21:26:43.003 INFO:tasks.workunit.client.1.smithi154.stdout:3/147: creat d0/da/d1a/d28/d17/f2c x:0 0 0 2024-05-06T21:26:43.005 INFO:tasks.workunit.client.0.smithi032.stdout:9/503: rename d1/d2f/d4f/c63 to d1/d13/d34/d26/d39/ca7 0 2024-05-06T21:26:43.006 INFO:tasks.workunit.client.0.smithi032.stdout:0/432: rmdir d4/d3e/d63/d6c 39 2024-05-06T21:26:43.006 INFO:tasks.workunit.client.1.smithi154.stdout:3/148: creat d0/da/d1a/d28/f2d x:0 0 0 2024-05-06T21:26:43.006 INFO:tasks.workunit.client.1.smithi154.stdout:3/149: chown d0/da/db/dd/d1c/d21 35920 1 2024-05-06T21:26:43.006 INFO:tasks.workunit.client.1.smithi154.stdout:3/150: stat d0/l26 0 2024-05-06T21:26:43.006 INFO:tasks.workunit.client.0.smithi032.stdout:1/432: mkdir db/d87 0 2024-05-06T21:26:43.007 INFO:tasks.workunit.client.1.smithi154.stdout:3/151: mkdir d0/da/db/dd/d1c/d21/d2e 0 2024-05-06T21:26:43.008 INFO:tasks.workunit.client.0.smithi032.stdout:3/532: dread d1/d4/d11/f2b [0,4194304] 0 2024-05-06T21:26:43.011 INFO:tasks.workunit.client.1.smithi154.stdout:3/152: mkdir d0/da/d1a/d28/d2f 0 2024-05-06T21:26:43.011 INFO:tasks.workunit.client.1.smithi154.stdout:3/153: truncate d0/f2b 1047834 0 2024-05-06T21:26:43.014 INFO:tasks.workunit.client.1.smithi154.stdout:5/93: dwrite d2/d6/fb [0,4194304] 0 2024-05-06T21:26:43.017 INFO:tasks.workunit.client.1.smithi154.stdout:5/94: link d2/d6/dd/l11 d2/d6/dd/l1c 0 2024-05-06T21:26:43.017 INFO:tasks.workunit.client.1.smithi154.stdout:5/95: creat d2/f1d x:0 0 0 2024-05-06T21:26:43.018 INFO:tasks.workunit.client.0.smithi032.stdout:9/504: link d1/d13/d33/d8e/l94 d1/d13/d34/d26/d39/d8b/la8 0 2024-05-06T21:26:43.019 INFO:tasks.workunit.client.0.smithi032.stdout:0/433: creat d4/d3e/f85 x:0 0 0 2024-05-06T21:26:43.020 INFO:tasks.workunit.client.1.smithi154.stdout:5/96: mknod d2/d6/dc/c1e 0 2024-05-06T21:26:43.020 INFO:tasks.workunit.client.1.smithi154.stdout:5/97: write d2/d3/f9 [1642888,50369] 0 2024-05-06T21:26:43.021 INFO:tasks.workunit.client.0.smithi032.stdout:0/434: dread d4/da/f60 [0,4194304] 0 2024-05-06T21:26:43.022 INFO:tasks.workunit.client.1.smithi154.stdout:5/98: symlink d2/d6/dd/l1f 0 2024-05-06T21:26:43.024 INFO:tasks.workunit.client.0.smithi032.stdout:0/435: rename d4/d3e/f54 to d4/d3e/d63/d6c/f86 0 2024-05-06T21:26:43.025 INFO:tasks.workunit.client.1.smithi154.stdout:7/52: getdents d6 0 2024-05-06T21:26:43.025 INFO:tasks.workunit.client.1.smithi154.stdout:7/53: chown d6/f10 119664027 1 2024-05-06T21:26:43.026 INFO:tasks.workunit.client.1.smithi154.stdout:4/90: rmdir d0/d10 39 2024-05-06T21:26:43.026 INFO:tasks.workunit.client.1.smithi154.stdout:4/91: creat d0/d2/f1c x:0 0 0 2024-05-06T21:26:43.027 INFO:tasks.workunit.client.0.smithi032.stdout:0/436: creat d4/da/d14/d1a/d66/f87 x:0 0 0 2024-05-06T21:26:43.027 INFO:tasks.workunit.client.0.smithi032.stdout:0/437: stat d4/da/d14/d1a/d66 0 2024-05-06T21:26:43.027 INFO:tasks.workunit.client.1.smithi154.stdout:1/118: dwrite d6/db/d10/d15/f20 [0,4194304] 0 2024-05-06T21:26:43.030 INFO:tasks.workunit.client.1.smithi154.stdout:4/92: rename d0/f1 to d0/d10/d11/d1a/f1d 0 2024-05-06T21:26:43.038 INFO:tasks.workunit.client.1.smithi154.stdout:5/99: read d2/d6/fb [887841,70183] 0 2024-05-06T21:26:43.038 INFO:tasks.workunit.client.1.smithi154.stdout:5/100: read - d2/d6/dd/f18 zero size 2024-05-06T21:26:43.040 INFO:tasks.workunit.client.1.smithi154.stdout:5/101: rename d2/f17 to d2/d6/dd/f20 0 2024-05-06T21:26:43.042 INFO:tasks.workunit.client.1.smithi154.stdout:5/102: mkdir d2/d3/d21 0 2024-05-06T21:26:43.043 INFO:tasks.workunit.client.1.smithi154.stdout:5/103: mkdir d2/d3/d21/d22 0 2024-05-06T21:26:43.044 INFO:tasks.workunit.client.0.smithi032.stdout:2/376: dwrite df/d19/d1e/d71/d5f/d7d/d25/f3b [0,4194304] 0 2024-05-06T21:26:43.045 INFO:tasks.workunit.client.1.smithi154.stdout:4/93: write d0/d10/d11/f17 [3863325,116716] 0 2024-05-06T21:26:43.045 INFO:tasks.workunit.client.1.smithi154.stdout:4/94: dread - d0/d2/f1b zero size 2024-05-06T21:26:43.045 INFO:tasks.workunit.client.1.smithi154.stdout:4/95: chown d0/d10/d11/f17 493531703 1 2024-05-06T21:26:43.045 INFO:tasks.workunit.client.1.smithi154.stdout:4/96: read - d0/d2/f8 zero size 2024-05-06T21:26:43.045 INFO:tasks.workunit.client.1.smithi154.stdout:4/97: write d0/d2/f1c [905742,73983] 0 2024-05-06T21:26:43.045 INFO:tasks.workunit.client.0.smithi032.stdout:2/377: creat df/f8b x:0 0 0 2024-05-06T21:26:43.046 INFO:tasks.workunit.client.0.smithi032.stdout:2/378: mknod df/d19/c8c 0 2024-05-06T21:26:43.047 INFO:tasks.workunit.client.1.smithi154.stdout:4/98: link d0/d10/f15 d0/d2/dc/f1e 0 2024-05-06T21:26:43.047 INFO:tasks.workunit.client.1.smithi154.stdout:4/99: readlink d0/l19 0 2024-05-06T21:26:43.048 INFO:tasks.workunit.client.0.smithi032.stdout:2/379: link df/d19/d1e/d71/d5f/d7d/f5c df/d19/d1e/d71/d5f/d7d/d65/d78/f8d 0 2024-05-06T21:26:43.048 INFO:tasks.workunit.client.0.smithi032.stdout:2/380: creat df/d19/d1e/d54/f8e x:0 0 0 2024-05-06T21:26:43.048 INFO:tasks.workunit.client.0.smithi032.stdout:2/381: dread - df/d19/d1e/d71/d5f/d7d/d25/d2d/f47 zero size 2024-05-06T21:26:43.048 INFO:tasks.workunit.client.0.smithi032.stdout:2/382: chown df/d19/d1e/d35/f41 2738311 1 2024-05-06T21:26:43.048 INFO:tasks.workunit.client.0.smithi032.stdout:2/383: truncate df/d19/d1e/d71/d5f/d7d/d25/f4b 1042644 0 2024-05-06T21:26:43.049 INFO:tasks.workunit.client.0.smithi032.stdout:2/384: chown df/d19/d1e/d35/f56 4039857 1 2024-05-06T21:26:43.055 INFO:tasks.workunit.client.1.smithi154.stdout:3/154: dwrite d0/da/d1a/d28/d17/f1e [0,4194304] 0 2024-05-06T21:26:43.055 INFO:tasks.workunit.client.0.smithi032.stdout:4/538: dwrite d2/f24 [0,4194304] 0 2024-05-06T21:26:43.056 INFO:tasks.workunit.client.0.smithi032.stdout:1/433: dwrite db/d16/f32 [4194304,4194304] 0 2024-05-06T21:26:43.056 INFO:tasks.workunit.client.0.smithi032.stdout:5/361: dwrite d0/fa [0,4194304] 0 2024-05-06T21:26:43.056 INFO:tasks.workunit.client.0.smithi032.stdout:5/362: write d0/d24/d26/d3d/d50/f65 [1206066,62189] 0 2024-05-06T21:26:43.056 INFO:tasks.workunit.client.0.smithi032.stdout:5/363: write d0/d24/d34/f4f [32871,10490] 0 2024-05-06T21:26:43.057 INFO:tasks.workunit.client.0.smithi032.stdout:4/539: creat d2/d16/d44/d45/fb5 x:0 0 0 2024-05-06T21:26:43.058 INFO:tasks.workunit.client.1.smithi154.stdout:3/155: mkdir d0/da/db/d30 0 2024-05-06T21:26:43.058 INFO:tasks.workunit.client.0.smithi032.stdout:1/434: mkdir db/d2a/d4f/d88 0 2024-05-06T21:26:43.059 INFO:tasks.workunit.client.1.smithi154.stdout:4/100: fdatasync d0/d10/f15 0 2024-05-06T21:26:43.061 INFO:tasks.workunit.client.0.smithi032.stdout:4/540: mknod d2/d16/d44/d74/d7e/da5/cb6 0 2024-05-06T21:26:43.063 INFO:tasks.workunit.client.1.smithi154.stdout:3/156: symlink d0/l31 0 2024-05-06T21:26:43.063 INFO:tasks.workunit.client.1.smithi154.stdout:3/157: creat d0/f32 x:0 0 0 2024-05-06T21:26:43.063 INFO:tasks.workunit.client.1.smithi154.stdout:3/158: dread - d0/da/d1a/d28/d17/f2c zero size 2024-05-06T21:26:43.064 INFO:tasks.workunit.client.0.smithi032.stdout:7/519: dwrite db/d12/d16/f8a [0,4194304] 0 2024-05-06T21:26:43.064 INFO:tasks.workunit.client.0.smithi032.stdout:2/385: dread df/d19/d1e/d71/d5f/d7d/d25/f3b [0,4194304] 0 2024-05-06T21:26:43.064 INFO:tasks.workunit.client.0.smithi032.stdout:9/505: dwrite d1/f12 [0,4194304] 0 2024-05-06T21:26:43.064 INFO:tasks.workunit.client.0.smithi032.stdout:9/506: write d1/f31 [5695740,93348] 0 2024-05-06T21:26:43.064 INFO:tasks.workunit.client.1.smithi154.stdout:4/101: mknod d0/c1f 0 2024-05-06T21:26:43.064 INFO:tasks.workunit.client.1.smithi154.stdout:4/102: readlink d0/l19 0 2024-05-06T21:26:43.064 INFO:tasks.workunit.client.1.smithi154.stdout:4/103: readlink d0/l5 0 2024-05-06T21:26:43.065 INFO:tasks.workunit.client.0.smithi032.stdout:5/364: rmdir d0/d24/d34 39 2024-05-06T21:26:43.068 INFO:tasks.workunit.client.1.smithi154.stdout:3/159: dread d0/da/db/dd/fc [0,4194304] 0 2024-05-06T21:26:43.068 INFO:tasks.workunit.client.1.smithi154.stdout:3/160: dread - d0/da/d1a/d28/f2d zero size 2024-05-06T21:26:43.068 INFO:tasks.workunit.client.1.smithi154.stdout:3/161: chown d0/f3 1840 1 2024-05-06T21:26:43.068 INFO:tasks.workunit.client.1.smithi154.stdout:3/162: write d0/f2b [1737881,52358] 0 2024-05-06T21:26:43.071 INFO:tasks.workunit.client.0.smithi032.stdout:9/507: write d1/d13/d34/f9c [3712042,17228] 0 2024-05-06T21:26:43.071 INFO:tasks.workunit.client.0.smithi032.stdout:9/508: fsync d1/d2f/f7a 0 2024-05-06T21:26:43.071 INFO:tasks.workunit.client.0.smithi032.stdout:9/509: write d1/d13/d25/d59/f84 [352350,95446] 0 2024-05-06T21:26:43.071 INFO:tasks.workunit.client.1.smithi154.stdout:5/104: rmdir d2 39 2024-05-06T21:26:43.072 INFO:tasks.workunit.client.1.smithi154.stdout:5/105: dread - d2/d6/dc/f15 zero size 2024-05-06T21:26:43.072 INFO:tasks.workunit.client.0.smithi032.stdout:6/581: rmdir d8 39 2024-05-06T21:26:43.073 INFO:tasks.workunit.client.1.smithi154.stdout:5/106: mkdir d2/d3/d19/d23 0 2024-05-06T21:26:43.073 INFO:tasks.workunit.client.1.smithi154.stdout:5/107: readlink d2/d6/dd/l1f 0 2024-05-06T21:26:43.074 INFO:tasks.workunit.client.1.smithi154.stdout:5/108: symlink d2/l24 0 2024-05-06T21:26:43.077 INFO:tasks.workunit.client.1.smithi154.stdout:4/104: truncate d0/d2/dc/f1e 1113379 0 2024-05-06T21:26:43.077 INFO:tasks.workunit.client.1.smithi154.stdout:4/105: creat d0/d2/dc/f20 x:0 0 0 2024-05-06T21:26:43.082 INFO:tasks.workunit.client.1.smithi154.stdout:4/106: rename d0/d10/f14 to d0/d10/d11/f21 0 2024-05-06T21:26:43.088 INFO:tasks.workunit.client.0.smithi032.stdout:0/438: write d4/d3e/d63/d6c/f86 [136101,43404] 0 2024-05-06T21:26:43.093 INFO:tasks.workunit.client.0.smithi032.stdout:2/386: symlink df/d19/d1e/d35/l8f 0 2024-05-06T21:26:43.094 INFO:tasks.workunit.client.0.smithi032.stdout:7/520: symlink db/d89/la2 0 2024-05-06T21:26:43.094 INFO:tasks.workunit.client.0.smithi032.stdout:7/521: stat db/d12/d16/d21/l6e 0 2024-05-06T21:26:43.094 INFO:tasks.workunit.client.0.smithi032.stdout:7/522: creat db/d12/d16/d21/fa3 x:0 0 0 2024-05-06T21:26:43.094 INFO:tasks.workunit.client.0.smithi032.stdout:7/523: fsync db/d12/d16/d21/d41/d4b/f59 0 2024-05-06T21:26:43.095 INFO:tasks.workunit.client.0.smithi032.stdout:1/435: getdents db/d2a 0 2024-05-06T21:26:43.096 INFO:tasks.workunit.client.0.smithi032.stdout:4/541: getdents d2/d16/d44/d74/d76 0 2024-05-06T21:26:43.101 INFO:tasks.workunit.client.0.smithi032.stdout:9/510: rename d1/d2f/d4f/f96 to d1/d13/d34/d26/d39/d45/fa9 0 2024-05-06T21:26:43.102 INFO:tasks.workunit.client.0.smithi032.stdout:2/387: truncate f7 3659024 0 2024-05-06T21:26:43.103 INFO:tasks.workunit.client.0.smithi032.stdout:2/388: fdatasync df/d19/f5b 0 2024-05-06T21:26:43.103 INFO:tasks.workunit.client.0.smithi032.stdout:2/389: chown df/d19/d1e/d35/d3f/f68 163868720 1 2024-05-06T21:26:43.105 INFO:tasks.workunit.client.0.smithi032.stdout:7/524: mknod db/d12/d49/ca4 0 2024-05-06T21:26:43.106 INFO:tasks.workunit.client.1.smithi154.stdout:8/116: sync 2024-05-06T21:26:43.107 INFO:tasks.workunit.client.0.smithi032.stdout:4/542: mknod d2/d16/d44/d74/cb7 0 2024-05-06T21:26:43.107 INFO:tasks.workunit.client.0.smithi032.stdout:4/543: read - d2/f53 zero size 2024-05-06T21:26:43.107 INFO:tasks.workunit.client.0.smithi032.stdout:7/525: dread db/d12/d16/f72 [0,4194304] 0 2024-05-06T21:26:43.107 INFO:tasks.workunit.client.0.smithi032.stdout:7/526: fdatasync db/d12/d16/d2a/f42 0 2024-05-06T21:26:43.107 INFO:tasks.workunit.client.0.smithi032.stdout:4/544: read d2/d16/d44/d74/f8b [1532418,66758] 0 2024-05-06T21:26:43.108 INFO:tasks.workunit.client.1.smithi154.stdout:8/117: mkdir d3/d14/d1a/d29 0 2024-05-06T21:26:43.108 INFO:tasks.workunit.client.0.smithi032.stdout:1/436: rename db/c11 to db/d47/c89 0 2024-05-06T21:26:43.108 INFO:tasks.workunit.client.0.smithi032.stdout:1/437: readlink db/d2a/l48 0 2024-05-06T21:26:43.109 INFO:tasks.workunit.client.0.smithi032.stdout:0/439: link d4/c41 d4/da/d14/c88 0 2024-05-06T21:26:43.110 INFO:tasks.workunit.client.0.smithi032.stdout:2/390: mknod df/d19/d1e/d71/d5f/d7d/d65/c90 0 2024-05-06T21:26:43.110 INFO:tasks.workunit.client.0.smithi032.stdout:2/391: fdatasync df/d19/d1e/d54/f59 0 2024-05-06T21:26:43.111 INFO:tasks.workunit.client.0.smithi032.stdout:0/440: readlink d4/l19 0 2024-05-06T21:26:43.112 INFO:tasks.workunit.client.1.smithi154.stdout:8/118: rename d3/d14/l24 to d3/d14/d1a/l2a 0 2024-05-06T21:26:43.113 INFO:tasks.workunit.client.0.smithi032.stdout:9/511: dwrite d1/d13/d25/d64/f69 [0,4194304] 0 2024-05-06T21:26:43.113 INFO:tasks.workunit.client.0.smithi032.stdout:2/392: creat df/d19/d1e/d35/d3f/d46/f91 x:0 0 0 2024-05-06T21:26:43.113 INFO:tasks.workunit.client.0.smithi032.stdout:2/393: fdatasync df/d19/d1e/d35/d3f/d46/f91 0 2024-05-06T21:26:43.114 INFO:tasks.workunit.client.0.smithi032.stdout:5/365: dwrite d0/d24/d38/f25 [0,4194304] 0 2024-05-06T21:26:43.114 INFO:tasks.workunit.client.0.smithi032.stdout:7/527: getdents db/d12/d49/d97 0 2024-05-06T21:26:43.115 INFO:tasks.workunit.client.1.smithi154.stdout:3/163: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:43.115 INFO:tasks.workunit.client.1.smithi154.stdout:4/107: dwrite d0/d10/d11/f21 [0,4194304] 0 2024-05-06T21:26:43.116 INFO:tasks.workunit.client.0.smithi032.stdout:0/441: unlink d4/da/d16/d33/c78 0 2024-05-06T21:26:43.116 INFO:tasks.workunit.client.0.smithi032.stdout:6/582: dwrite d8/f17 [4194304,4194304] 0 2024-05-06T21:26:43.116 INFO:tasks.workunit.client.0.smithi032.stdout:6/583: chown c7 1296406579 1 2024-05-06T21:26:43.116 INFO:tasks.workunit.client.0.smithi032.stdout:6/584: dread - d8/dd/d1b/faa zero size 2024-05-06T21:26:43.117 INFO:tasks.workunit.client.1.smithi154.stdout:5/109: dwrite d2/d6/dd/f18 [0,4194304] 0 2024-05-06T21:26:43.117 INFO:tasks.workunit.client.0.smithi032.stdout:0/442: write d4/f24 [64574,22252] 0 2024-05-06T21:26:43.117 INFO:tasks.workunit.client.1.smithi154.stdout:3/164: mknod d0/d2/d22/c33 0 2024-05-06T21:26:43.118 INFO:tasks.workunit.client.1.smithi154.stdout:1/119: dwrite d6/db/d10/d15/f20 [4194304,4194304] 0 2024-05-06T21:26:43.118 INFO:tasks.workunit.client.1.smithi154.stdout:1/120: creat d6/d1a/f23 x:0 0 0 2024-05-06T21:26:43.118 INFO:tasks.workunit.client.1.smithi154.stdout:1/121: creat d6/f24 x:0 0 0 2024-05-06T21:26:43.118 INFO:tasks.workunit.client.1.smithi154.stdout:1/122: chown d6/d1a/f23 5029 1 2024-05-06T21:26:43.118 INFO:tasks.workunit.client.1.smithi154.stdout:1/123: stat d6/db/d10/d15/d1d 0 2024-05-06T21:26:43.118 INFO:tasks.workunit.client.1.smithi154.stdout:1/124: creat d6/d1a/f25 x:0 0 0 2024-05-06T21:26:43.119 INFO:tasks.workunit.client.0.smithi032.stdout:9/512: mknod d1/d13/d34/d26/d49/caa 0 2024-05-06T21:26:43.121 INFO:tasks.workunit.client.0.smithi032.stdout:2/394: creat df/d19/d1e/d71/d5f/d7d/f92 x:0 0 0 2024-05-06T21:26:43.122 INFO:tasks.workunit.client.0.smithi032.stdout:2/395: write df/d19/d1e/d1f/f2b [941582,103591] 0 2024-05-06T21:26:43.122 INFO:tasks.workunit.client.0.smithi032.stdout:2/396: creat df/d19/d1e/d71/d5f/f93 x:0 0 0 2024-05-06T21:26:43.122 INFO:tasks.workunit.client.0.smithi032.stdout:2/397: write df/f31 [1285863,60537] 0 2024-05-06T21:26:43.122 INFO:tasks.workunit.client.0.smithi032.stdout:2/398: readlink df/d19/d1e/d35/l8f 0 2024-05-06T21:26:43.122 INFO:tasks.workunit.client.1.smithi154.stdout:5/110: mkdir d2/d3/d21/d22/d25 0 2024-05-06T21:26:43.125 INFO:tasks.workunit.client.0.smithi032.stdout:5/366: mkdir d0/d16/d2a/d59/d67 0 2024-05-06T21:26:43.127 INFO:tasks.workunit.client.0.smithi032.stdout:7/528: creat db/d12/d16/d21/d41/d4b/fa5 x:0 0 0 2024-05-06T21:26:43.128 INFO:tasks.workunit.client.1.smithi154.stdout:3/165: fsync d0/f2b 0 2024-05-06T21:26:43.128 INFO:tasks.workunit.client.1.smithi154.stdout:8/119: dread d3/ff [0,4194304] 0 2024-05-06T21:26:43.128 INFO:tasks.workunit.client.1.smithi154.stdout:8/120: chown d3/d14/f18 1300229474 1 2024-05-06T21:26:43.128 INFO:tasks.workunit.client.1.smithi154.stdout:1/125: unlink d6/db/l1c 0 2024-05-06T21:26:43.129 INFO:tasks.workunit.client.1.smithi154.stdout:4/108: getdents d0 0 2024-05-06T21:26:43.131 INFO:tasks.workunit.client.1.smithi154.stdout:5/111: link d2/f1d d2/d3/d21/f26 0 2024-05-06T21:26:43.131 INFO:tasks.workunit.client.1.smithi154.stdout:5/112: chown d2/d6/dd/l1c 50827915 1 2024-05-06T21:26:43.132 INFO:tasks.workunit.client.1.smithi154.stdout:8/121: truncate d3/d14/f20 3782452 0 2024-05-06T21:26:43.133 INFO:tasks.workunit.client.0.smithi032.stdout:0/443: mknod d4/d3e/d42/c89 0 2024-05-06T21:26:43.135 INFO:tasks.workunit.client.1.smithi154.stdout:4/109: creat d0/f22 x:0 0 0 2024-05-06T21:26:43.135 INFO:tasks.workunit.client.1.smithi154.stdout:5/113: mkdir d2/d3/d21/d22/d25/d27 0 2024-05-06T21:26:43.136 INFO:tasks.workunit.client.0.smithi032.stdout:7/529: dread db/d12/d16/d21/d41/d78/f4f [0,4194304] 0 2024-05-06T21:26:43.137 INFO:tasks.workunit.client.1.smithi154.stdout:4/110: readlink d0/l19 0 2024-05-06T21:26:43.138 INFO:tasks.workunit.client.0.smithi032.stdout:5/367: creat d0/d4e/f68 x:0 0 0 2024-05-06T21:26:43.140 INFO:tasks.workunit.client.1.smithi154.stdout:3/166: write d0/fe [745008,25801] 0 2024-05-06T21:26:43.140 INFO:tasks.workunit.client.1.smithi154.stdout:3/167: chown d0/da/d1a/d28/d17/l29 205821 1 2024-05-06T21:26:43.143 INFO:tasks.workunit.client.0.smithi032.stdout:0/444: write d4/da/d16/f43 [4980287,33677] 0 2024-05-06T21:26:43.143 INFO:tasks.workunit.client.0.smithi032.stdout:0/445: truncate d4/f24 1660569 0 2024-05-06T21:26:43.144 INFO:tasks.workunit.client.0.smithi032.stdout:7/530: creat db/d12/d16/d21/d41/fa6 x:0 0 0 2024-05-06T21:26:43.148 INFO:tasks.workunit.client.0.smithi032.stdout:0/446: mkdir d4/da/d14/d1a/d66/d8a 0 2024-05-06T21:26:43.152 INFO:tasks.workunit.client.1.smithi154.stdout:5/114: write d2/f14 [2824610,78780] 0 2024-05-06T21:26:43.155 INFO:tasks.workunit.client.0.smithi032.stdout:7/531: write db/d12/d49/f4d [1905520,86091] 0 2024-05-06T21:26:43.155 INFO:tasks.workunit.client.0.smithi032.stdout:7/532: write db/d12/d16/d21/d41/d4b/f68 [178539,61418] 0 2024-05-06T21:26:43.156 INFO:tasks.workunit.client.0.smithi032.stdout:7/533: creat db/d12/d16/d21/fa7 x:0 0 0 2024-05-06T21:26:43.157 INFO:tasks.workunit.client.0.smithi032.stdout:4/545: dwrite d2/d1e/f25 [0,4194304] 0 2024-05-06T21:26:43.157 INFO:tasks.workunit.client.0.smithi032.stdout:4/546: chown d2/d2c/d31/c66 71211 1 2024-05-06T21:26:43.160 INFO:tasks.workunit.client.0.smithi032.stdout:4/547: mkdir d2/d13/daa/db8 0 2024-05-06T21:26:43.160 INFO:tasks.workunit.client.0.smithi032.stdout:4/548: chown d2/d16/d44/d74/f92 133939 1 2024-05-06T21:26:43.171 INFO:tasks.workunit.client.1.smithi154.stdout:5/115: dread d2/d6/dd/f18 [0,4194304] 0 2024-05-06T21:26:43.172 INFO:tasks.workunit.client.1.smithi154.stdout:5/116: unlink d2/d6/dd/l1f 0 2024-05-06T21:26:43.183 INFO:tasks.workunit.client.0.smithi032.stdout:1/438: dwrite db/d16/d46/f78 [0,4194304] 0 2024-05-06T21:26:43.184 INFO:tasks.workunit.client.0.smithi032.stdout:6/585: dwrite d8/dd/d18/d13/f71 [0,4194304] 0 2024-05-06T21:26:43.184 INFO:tasks.workunit.client.1.smithi154.stdout:5/117: dread d2/d6/fe [0,4194304] 0 2024-05-06T21:26:43.186 INFO:tasks.workunit.client.0.smithi032.stdout:2/399: dwrite df/d19/d1e/f28 [0,4194304] 0 2024-05-06T21:26:43.187 INFO:tasks.workunit.client.0.smithi032.stdout:2/400: read df/d19/d1e/d71/d5f/d7d/d25/f50 [200725,117887] 0 2024-05-06T21:26:43.187 INFO:tasks.workunit.client.1.smithi154.stdout:8/122: dwrite d3/d14/f1e [0,4194304] 0 2024-05-06T21:26:43.189 INFO:tasks.workunit.client.0.smithi032.stdout:5/368: dwrite d0/d24/d38/f36 [4194304,4194304] 0 2024-05-06T21:26:43.189 INFO:tasks.workunit.client.0.smithi032.stdout:5/369: getdents d0/d16/d2a/d59/d67 0 2024-05-06T21:26:43.191 INFO:tasks.workunit.client.0.smithi032.stdout:0/447: dwrite d4/d3e/f85 [0,4194304] 0 2024-05-06T21:26:43.191 INFO:tasks.workunit.client.0.smithi032.stdout:0/448: fdatasync d4/da/d16/d33/d46/f6e 0 2024-05-06T21:26:43.191 INFO:tasks.workunit.client.0.smithi032.stdout:0/449: stat d4/d3e/f85 0 2024-05-06T21:26:43.191 INFO:tasks.workunit.client.0.smithi032.stdout:1/439: getdents db/d16/d46/d57 0 2024-05-06T21:26:43.191 INFO:tasks.workunit.client.0.smithi032.stdout:1/440: chown db/d2a/d4f/d88 0 1 2024-05-06T21:26:43.192 INFO:tasks.workunit.client.1.smithi154.stdout:4/111: dwrite d0/d2/dc/f1e [0,4194304] 0 2024-05-06T21:26:43.192 INFO:tasks.workunit.client.0.smithi032.stdout:2/401: rmdir df/d19/d1e/d71 39 2024-05-06T21:26:43.193 INFO:tasks.workunit.client.0.smithi032.stdout:4/549: dwrite d2/f6c [0,4194304] 0 2024-05-06T21:26:43.193 INFO:tasks.workunit.client.0.smithi032.stdout:4/550: creat d2/d16/d44/d74/d79/fb9 x:0 0 0 2024-05-06T21:26:43.197 INFO:tasks.workunit.client.0.smithi032.stdout:5/370: rename d0/d24/d38/l1a to d0/d16/d2f/l69 0 2024-05-06T21:26:43.197 INFO:tasks.workunit.client.0.smithi032.stdout:5/371: readlink d0/d16/d2a/d4d/l64 0 2024-05-06T21:26:43.202 INFO:tasks.workunit.client.0.smithi032.stdout:0/450: mknod d4/da/d14/c8b 0 2024-05-06T21:26:43.202 INFO:tasks.workunit.client.0.smithi032.stdout:0/451: chown d4/d3e/d63/f56 1913288 1 2024-05-06T21:26:43.202 INFO:tasks.workunit.client.0.smithi032.stdout:0/452: truncate d4/da/d16/d33/f5e 650352 0 2024-05-06T21:26:43.202 INFO:tasks.workunit.client.0.smithi032.stdout:0/453: write d4/da/d16/d33/f57 [4260253,78909] 0 2024-05-06T21:26:43.203 INFO:tasks.workunit.client.1.smithi154.stdout:8/123: write d3/fe [1775751,15789] 0 2024-05-06T21:26:43.203 INFO:tasks.workunit.client.1.smithi154.stdout:8/124: chown d3/fe 26 1 2024-05-06T21:26:43.203 INFO:tasks.workunit.client.1.smithi154.stdout:8/125: fdatasync d3/d14/f19 0 2024-05-06T21:26:43.203 INFO:tasks.workunit.client.1.smithi154.stdout:5/118: dwrite d2/f4 [0,4194304] 0 2024-05-06T21:26:43.203 INFO:tasks.workunit.client.0.smithi032.stdout:1/441: symlink db/d16/d46/d57/d58/l8a 0 2024-05-06T21:26:43.204 INFO:tasks.workunit.client.0.smithi032.stdout:4/551: write d2/d13/f57 [2770082,91336] 0 2024-05-06T21:26:43.204 INFO:tasks.workunit.client.0.smithi032.stdout:4/552: chown d2/d16/d44/d45/f48 57 1 2024-05-06T21:26:43.208 INFO:tasks.workunit.client.1.smithi154.stdout:1/126: rename d6/d1a to d6/db/d10/d26 0 2024-05-06T21:26:43.214 INFO:tasks.workunit.client.0.smithi032.stdout:2/402: creat df/d19/d1e/d1f/d2e/f94 x:0 0 0 2024-05-06T21:26:43.214 INFO:tasks.workunit.client.0.smithi032.stdout:2/403: creat df/f95 x:0 0 0 2024-05-06T21:26:43.218 INFO:tasks.workunit.client.0.smithi032.stdout:5/372: symlink d0/d16/d2a/d52/l6a 0 2024-05-06T21:26:43.218 INFO:tasks.workunit.client.1.smithi154.stdout:8/126: dread d3/f9 [0,4194304] 0 2024-05-06T21:26:43.218 INFO:tasks.workunit.client.1.smithi154.stdout:8/127: write d3/d14/f18 [480153,73293] 0 2024-05-06T21:26:43.233 INFO:tasks.workunit.client.0.smithi032.stdout:2/404: write df/d19/d1e/d1f/d2e/d33/f24 [600180,91886] 0 2024-05-06T21:26:43.236 INFO:tasks.workunit.client.0.smithi032.stdout:2/405: unlink df/d19/d1e/d71/d5f/d7d/d65/l88 0 2024-05-06T21:26:43.247 INFO:tasks.workunit.client.1.smithi154.stdout:5/119: dwrite d2/f1d [0,4194304] 0 2024-05-06T21:26:43.247 INFO:tasks.workunit.client.1.smithi154.stdout:5/120: chown d2/d3/d19 10217867 1 2024-05-06T21:26:43.248 INFO:tasks.workunit.client.1.smithi154.stdout:5/121: fdatasync d2/f14 0 2024-05-06T21:26:43.248 INFO:tasks.workunit.client.0.smithi032.stdout:0/454: dwrite d4/da/d14/f2d [0,4194304] 0 2024-05-06T21:26:43.248 INFO:tasks.workunit.client.0.smithi032.stdout:0/455: getdents d4/da/d14/d1a/d66/d8a 0 2024-05-06T21:26:43.249 INFO:tasks.workunit.client.0.smithi032.stdout:5/373: dwrite d0/d24/d26/d3d/d50/f5d [0,4194304] 0 2024-05-06T21:26:43.249 INFO:tasks.workunit.client.1.smithi154.stdout:4/112: dwrite d0/d2/f1c [0,4194304] 0 2024-05-06T21:26:43.249 INFO:tasks.workunit.client.1.smithi154.stdout:8/128: dwrite d3/d14/f19 [0,4194304] 0 2024-05-06T21:26:43.249 INFO:tasks.workunit.client.0.smithi032.stdout:2/406: dwrite df/d19/d1e/d71/d5f/d7d/d25/f37 [0,4194304] 0 2024-05-06T21:26:43.249 INFO:tasks.workunit.client.0.smithi032.stdout:2/407: creat df/d19/d1e/d71/d5f/f96 x:0 0 0 2024-05-06T21:26:43.251 INFO:tasks.workunit.client.0.smithi032.stdout:0/456: symlink d4/da/d14/d1a/d66/d8a/l8c 0 2024-05-06T21:26:43.251 INFO:tasks.workunit.client.1.smithi154.stdout:4/113: creat d0/f23 x:0 0 0 2024-05-06T21:26:43.252 INFO:tasks.workunit.client.1.smithi154.stdout:8/129: mkdir d3/d14/d1a/d22/d26/d2b 0 2024-05-06T21:26:43.254 INFO:tasks.workunit.client.1.smithi154.stdout:0/91: sync 2024-05-06T21:26:43.255 INFO:tasks.workunit.client.1.smithi154.stdout:6/70: sync 2024-05-06T21:26:43.255 INFO:tasks.workunit.client.1.smithi154.stdout:9/170: sync 2024-05-06T21:26:43.255 INFO:tasks.workunit.client.1.smithi154.stdout:9/171: write d5/d14/f30 [1063053,68657] 0 2024-05-06T21:26:43.255 INFO:tasks.workunit.client.1.smithi154.stdout:9/172: stat d5/d14/d31/f40 0 2024-05-06T21:26:43.255 INFO:tasks.workunit.client.1.smithi154.stdout:2/123: sync 2024-05-06T21:26:43.258 INFO:tasks.workunit.client.0.smithi032.stdout:5/374: unlink d0/fa 0 2024-05-06T21:26:43.258 INFO:tasks.workunit.client.0.smithi032.stdout:5/375: chown d0/d16/c4b 46880555 1 2024-05-06T21:26:43.259 INFO:tasks.workunit.client.1.smithi154.stdout:8/130: write d3/f10 [253493,116835] 0 2024-05-06T21:26:43.260 INFO:tasks.workunit.client.1.smithi154.stdout:8/131: readlink d3/d14/d1a/l2a 0 2024-05-06T21:26:43.262 INFO:tasks.workunit.client.1.smithi154.stdout:8/132: dread d3/d14/f18 [0,4194304] 0 2024-05-06T21:26:43.263 INFO:tasks.workunit.client.0.smithi032.stdout:8/562: sync 2024-05-06T21:26:43.263 INFO:tasks.workunit.client.0.smithi032.stdout:5/376: write d0/d24/d38/f3c [214581,21198] 0 2024-05-06T21:26:43.264 INFO:tasks.workunit.client.0.smithi032.stdout:5/377: write d0/d24/d26/d3d/d50/f65 [299148,107939] 0 2024-05-06T21:26:43.266 INFO:tasks.workunit.client.0.smithi032.stdout:5/378: getdents d0/d16/d2a/d59 0 2024-05-06T21:26:43.267 INFO:tasks.workunit.client.0.smithi032.stdout:5/379: rename d0/d16/d2a/d52/l6a to d0/d24/l6b 0 2024-05-06T21:26:43.267 INFO:tasks.workunit.client.0.smithi032.stdout:5/380: write d0/d24/d38/f36 [3011228,68043] 0 2024-05-06T21:26:43.268 INFO:tasks.workunit.client.0.smithi032.stdout:2/408: dwrite df/d19/d1e/d42/f63 [0,4194304] 0 2024-05-06T21:26:43.274 INFO:tasks.workunit.client.0.smithi032.stdout:2/409: rename df/d19/d1e/d1f/f2a to df/d19/d1e/d54/f97 0 2024-05-06T21:26:43.276 INFO:tasks.workunit.client.0.smithi032.stdout:2/410: mknod df/d19/d1e/d71/d5f/d7d/d25/c98 0 2024-05-06T21:26:43.276 INFO:tasks.workunit.client.0.smithi032.stdout:2/411: dread - df/d19/d1e/d71/d5f/f93 zero size 2024-05-06T21:26:43.287 INFO:tasks.workunit.client.1.smithi154.stdout:4/114: rename d0/l19 to d0/d10/l24 0 2024-05-06T21:26:43.288 INFO:tasks.workunit.client.1.smithi154.stdout:0/92: symlink d6/l18 0 2024-05-06T21:26:43.288 INFO:tasks.workunit.client.1.smithi154.stdout:0/93: write d6/dc/f16 [4478898,116252] 0 2024-05-06T21:26:43.288 INFO:tasks.workunit.client.1.smithi154.stdout:0/94: creat d6/d10/f19 x:0 0 0 2024-05-06T21:26:43.289 INFO:tasks.workunit.client.1.smithi154.stdout:6/71: mknod d8/c1e 0 2024-05-06T21:26:43.289 INFO:tasks.workunit.client.1.smithi154.stdout:5/122: write d2/f1d [5137571,14107] 0 2024-05-06T21:26:43.289 INFO:tasks.workunit.client.0.smithi032.stdout:5/381: dwrite d0/d24/d26/d3d/d50/f5d [0,4194304] 0 2024-05-06T21:26:43.289 INFO:tasks.workunit.client.0.smithi032.stdout:5/382: read d0/fe [3050391,35443] 0 2024-05-06T21:26:43.289 INFO:tasks.workunit.client.0.smithi032.stdout:5/383: write d0/d24/d26/d32/f42 [35535,96861] 0 2024-05-06T21:26:43.290 INFO:tasks.workunit.client.0.smithi032.stdout:5/384: dread d0/d24/d34/f4f [0,4194304] 0 2024-05-06T21:26:43.292 INFO:tasks.workunit.client.1.smithi154.stdout:2/124: rmdir db/d12/d1d/d26 0 2024-05-06T21:26:43.293 INFO:tasks.workunit.client.1.smithi154.stdout:8/133: symlink d3/d14/d1a/d22/l2c 0 2024-05-06T21:26:43.296 INFO:tasks.workunit.client.1.smithi154.stdout:0/95: mknod d6/c1a 0 2024-05-06T21:26:43.298 INFO:tasks.workunit.client.1.smithi154.stdout:6/72: truncate f1 1519035 0 2024-05-06T21:26:43.298 INFO:tasks.workunit.client.1.smithi154.stdout:6/73: fdatasync d8/d11/f1b 0 2024-05-06T21:26:43.298 INFO:tasks.workunit.client.1.smithi154.stdout:6/74: fdatasync d8/d11/f1d 0 2024-05-06T21:26:43.299 INFO:tasks.workunit.client.1.smithi154.stdout:5/123: creat d2/d3/f28 x:0 0 0 2024-05-06T21:26:43.300 INFO:tasks.workunit.client.0.smithi032.stdout:2/412: dwrite df/f12 [4194304,4194304] 0 2024-05-06T21:26:43.300 INFO:tasks.workunit.client.1.smithi154.stdout:9/173: getdents d5/d2e 0 2024-05-06T21:26:43.302 INFO:tasks.workunit.client.1.smithi154.stdout:2/125: stat l6 0 2024-05-06T21:26:43.302 INFO:tasks.workunit.client.1.smithi154.stdout:2/126: dread - db/d12/f21 zero size 2024-05-06T21:26:43.303 INFO:tasks.workunit.client.1.smithi154.stdout:4/115: getdents d0/d10 0 2024-05-06T21:26:43.303 INFO:tasks.workunit.client.1.smithi154.stdout:5/124: fdatasync d2/d3/d21/f26 0 2024-05-06T21:26:43.306 INFO:tasks.workunit.client.1.smithi154.stdout:0/96: rename d6/d10/cf to d6/dc/c1b 0 2024-05-06T21:26:43.306 INFO:tasks.workunit.client.1.smithi154.stdout:0/97: dread - d6/d10/f14 zero size 2024-05-06T21:26:43.307 INFO:tasks.workunit.client.1.smithi154.stdout:4/116: mkdir d0/d2/d25 0 2024-05-06T21:26:43.310 INFO:tasks.workunit.client.1.smithi154.stdout:5/125: creat d2/d6/dc/f29 x:0 0 0 2024-05-06T21:26:43.311 INFO:tasks.workunit.client.1.smithi154.stdout:9/174: dread d5/d14/f30 [0,4194304] 0 2024-05-06T21:26:43.312 INFO:tasks.workunit.client.1.smithi154.stdout:9/175: dread - d5/d14/d31/f40 zero size 2024-05-06T21:26:43.312 INFO:tasks.workunit.client.1.smithi154.stdout:9/176: dread - d5/f28 zero size 2024-05-06T21:26:43.312 INFO:tasks.workunit.client.1.smithi154.stdout:9/177: chown d5/d14/c3b 8402 1 2024-05-06T21:26:43.314 INFO:tasks.workunit.client.1.smithi154.stdout:0/98: rename d6/d10/f19 to d6/f1c 0 2024-05-06T21:26:43.316 INFO:tasks.workunit.client.1.smithi154.stdout:4/117: rmdir d0/d2/d25 0 2024-05-06T21:26:43.323 INFO:tasks.workunit.client.0.smithi032.stdout:9/513: sync 2024-05-06T21:26:43.323 INFO:tasks.workunit.client.0.smithi032.stdout:3/533: sync 2024-05-06T21:26:43.324 INFO:tasks.workunit.client.1.smithi154.stdout:0/99: getdents d6 0 2024-05-06T21:26:43.325 INFO:tasks.workunit.client.1.smithi154.stdout:4/118: dread d0/d10/d11/d1a/f1d [0,4194304] 0 2024-05-06T21:26:43.326 INFO:tasks.workunit.client.1.smithi154.stdout:4/119: write d0/f23 [575995,68691] 0 2024-05-06T21:26:43.326 INFO:tasks.workunit.client.1.smithi154.stdout:4/120: dread - d0/d2/dc/f20 zero size 2024-05-06T21:26:43.326 INFO:tasks.workunit.client.1.smithi154.stdout:4/121: getdents d0/d10 0 2024-05-06T21:26:43.326 INFO:tasks.workunit.client.1.smithi154.stdout:4/122: dread - d0/d2/fb zero size 2024-05-06T21:26:43.326 INFO:tasks.workunit.client.1.smithi154.stdout:5/126: read d2/d6/fe [7093741,65253] 0 2024-05-06T21:26:43.326 INFO:tasks.workunit.client.1.smithi154.stdout:5/127: write d2/d3/f28 [780357,5002] 0 2024-05-06T21:26:43.326 INFO:tasks.workunit.client.1.smithi154.stdout:5/128: chown d2/f1a 16123347 1 2024-05-06T21:26:43.327 INFO:tasks.workunit.client.0.smithi032.stdout:3/534: mkdir d1/d4/da/d31/d47/d4a/d68/d7c/da8/dbc 0 2024-05-06T21:26:43.327 INFO:tasks.workunit.client.0.smithi032.stdout:5/385: dwrite d0/d24/d38/f25 [0,4194304] 0 2024-05-06T21:26:43.327 INFO:tasks.workunit.client.0.smithi032.stdout:5/386: rename d0/d16/d2a/d52 to d0/d16/d2a/d52/d6c 22 2024-05-06T21:26:43.328 INFO:tasks.workunit.client.0.smithi032.stdout:5/387: read d0/d24/d38/f30 [4004637,54184] 0 2024-05-06T21:26:43.328 INFO:tasks.workunit.client.0.smithi032.stdout:5/388: truncate d0/d24/d26/d32/f42 566000 0 2024-05-06T21:26:43.328 INFO:tasks.workunit.client.0.smithi032.stdout:3/535: rmdir d1/d4/da/d4e/d41/d97 39 2024-05-06T21:26:43.329 INFO:tasks.workunit.client.1.smithi154.stdout:0/100: rename d6/c1a to d6/d10/c1d 0 2024-05-06T21:26:43.329 INFO:tasks.workunit.client.1.smithi154.stdout:5/129: mkdir d2/d6/dd/d2a 0 2024-05-06T21:26:43.331 INFO:tasks.workunit.client.1.smithi154.stdout:6/75: dread f6 [0,4194304] 0 2024-05-06T21:26:43.331 INFO:tasks.workunit.client.1.smithi154.stdout:8/134: dwrite d3/f9 [4194304,4194304] 0 2024-05-06T21:26:43.331 INFO:tasks.workunit.client.1.smithi154.stdout:2/127: dwrite db/de/d16/f1f [0,4194304] 0 2024-05-06T21:26:43.332 INFO:tasks.workunit.client.1.smithi154.stdout:5/130: creat d2/d3/d19/f2b x:0 0 0 2024-05-06T21:26:43.332 INFO:tasks.workunit.client.0.smithi032.stdout:3/536: link d1/d4/cd d1/d4/da/d31/d9b/cbd 0 2024-05-06T21:26:43.334 INFO:tasks.workunit.client.0.smithi032.stdout:3/537: mkdir d1/d4/da/d31/d47/d4a/d68/d7c/da8/dbc/dbe 0 2024-05-06T21:26:43.334 INFO:tasks.workunit.client.1.smithi154.stdout:0/101: unlink d6/dc/l17 0 2024-05-06T21:26:43.336 INFO:tasks.workunit.client.1.smithi154.stdout:6/76: dread d8/d11/f1d [0,4194304] 0 2024-05-06T21:26:43.337 INFO:tasks.workunit.client.0.smithi032.stdout:3/538: link d1/d4/d11/f36 d1/d4/da/d31/d47/d4a/d68/d7c/da8/fbf 0 2024-05-06T21:26:43.337 INFO:tasks.workunit.client.0.smithi032.stdout:3/539: stat d1/d4/da/d9f/d74/fa4 0 2024-05-06T21:26:43.337 INFO:tasks.workunit.client.0.smithi032.stdout:3/540: stat d1/d4/lf 0 2024-05-06T21:26:43.341 INFO:tasks.workunit.client.1.smithi154.stdout:9/178: dwrite d5/f6 [0,4194304] 0 2024-05-06T21:26:43.341 INFO:tasks.workunit.client.1.smithi154.stdout:9/179: readlink d5/l7 0 2024-05-06T21:26:43.342 INFO:tasks.workunit.client.1.smithi154.stdout:8/135: mknod d3/d14/c2d 0 2024-05-06T21:26:43.342 INFO:tasks.workunit.client.1.smithi154.stdout:8/136: fsync d3/d14/f1e 0 2024-05-06T21:26:43.343 INFO:tasks.workunit.client.1.smithi154.stdout:2/128: creat db/de/d16/f27 x:0 0 0 2024-05-06T21:26:43.343 INFO:tasks.workunit.client.1.smithi154.stdout:2/129: chown db/de/d10/d18/l1a 80778270 1 2024-05-06T21:26:43.343 INFO:tasks.workunit.client.1.smithi154.stdout:2/130: write db/de/d16/f27 [1044628,93593] 0 2024-05-06T21:26:43.344 INFO:tasks.workunit.client.1.smithi154.stdout:5/131: creat d2/d6/dd/f2c x:0 0 0 2024-05-06T21:26:43.344 INFO:tasks.workunit.client.1.smithi154.stdout:6/77: symlink d8/l1f 0 2024-05-06T21:26:43.348 INFO:tasks.workunit.client.1.smithi154.stdout:9/180: rmdir d5/d36 0 2024-05-06T21:26:43.350 INFO:tasks.workunit.client.1.smithi154.stdout:8/137: mknod d3/d14/d1a/d22/c2e 0 2024-05-06T21:26:43.351 INFO:tasks.workunit.client.1.smithi154.stdout:5/132: mknod d2/d3/d21/d22/d25/d27/c2d 0 2024-05-06T21:26:43.352 INFO:tasks.workunit.client.1.smithi154.stdout:6/78: mkdir d8/d13/d20 0 2024-05-06T21:26:43.354 INFO:tasks.workunit.client.1.smithi154.stdout:9/181: mknod d5/d14/d3a/c41 0 2024-05-06T21:26:43.354 INFO:tasks.workunit.client.1.smithi154.stdout:8/138: dread d3/fb [0,4194304] 0 2024-05-06T21:26:43.354 INFO:tasks.workunit.client.0.smithi032.stdout:9/514: dwrite d1/d2f/f3c [0,4194304] 0 2024-05-06T21:26:43.354 INFO:tasks.workunit.client.0.smithi032.stdout:5/389: dread d0/d16/f1c [0,4194304] 0 2024-05-06T21:26:43.354 INFO:tasks.workunit.client.0.smithi032.stdout:5/390: getdents d0/d24/d26/d3d 0 2024-05-06T21:26:43.355 INFO:tasks.workunit.client.0.smithi032.stdout:5/391: symlink d0/d24/d26/d3d/d50/d5a/l6d 0 2024-05-06T21:26:43.356 INFO:tasks.workunit.client.1.smithi154.stdout:5/133: creat d2/d3/d21/d22/f2e x:0 0 0 2024-05-06T21:26:43.358 INFO:tasks.workunit.client.1.smithi154.stdout:6/79: rename d8/d13/c15 to d8/d11/c21 0 2024-05-06T21:26:43.359 INFO:tasks.workunit.client.1.smithi154.stdout:8/139: rmdir d3/d14/d1a/d22/d26 39 2024-05-06T21:26:43.359 INFO:tasks.workunit.client.1.smithi154.stdout:8/140: write d3/fd [1156842,49263] 0 2024-05-06T21:26:43.362 INFO:tasks.workunit.client.1.smithi154.stdout:5/134: symlink d2/d3/d21/d22/d25/l2f 0 2024-05-06T21:26:43.362 INFO:tasks.workunit.client.1.smithi154.stdout:5/135: creat d2/d6/dc/f30 x:0 0 0 2024-05-06T21:26:43.362 INFO:tasks.workunit.client.1.smithi154.stdout:5/136: fsync d2/f14 0 2024-05-06T21:26:43.362 INFO:tasks.workunit.client.1.smithi154.stdout:5/137: dread - d2/d6/dc/f30 zero size 2024-05-06T21:26:43.362 INFO:tasks.workunit.client.1.smithi154.stdout:5/138: creat d2/d3/f31 x:0 0 0 2024-05-06T21:26:43.363 INFO:tasks.workunit.client.1.smithi154.stdout:4/123: dwrite d0/d2/dc/f20 [0,4194304] 0 2024-05-06T21:26:43.363 INFO:tasks.workunit.client.1.smithi154.stdout:4/124: chown d0/d10 31 1 2024-05-06T21:26:43.363 INFO:tasks.workunit.client.1.smithi154.stdout:6/80: mknod d8/d13/c22 0 2024-05-06T21:26:43.363 INFO:tasks.workunit.client.1.smithi154.stdout:6/81: readlink d8/la 0 2024-05-06T21:26:43.365 INFO:tasks.workunit.client.1.smithi154.stdout:8/141: mknod d3/d14/c2f 0 2024-05-06T21:26:43.371 INFO:tasks.workunit.client.1.smithi154.stdout:0/102: dwrite f4 [4194304,4194304] 0 2024-05-06T21:26:43.376 INFO:tasks.workunit.client.1.smithi154.stdout:6/82: creat d8/f23 x:0 0 0 2024-05-06T21:26:43.376 INFO:tasks.workunit.client.1.smithi154.stdout:7/54: sync 2024-05-06T21:26:43.377 INFO:tasks.workunit.client.1.smithi154.stdout:7/55: write d6/f9 [4571048,127800] 0 2024-05-06T21:26:43.377 INFO:tasks.workunit.client.0.smithi032.stdout:5/392: dread d0/d24/d38/f30 [0,4194304] 0 2024-05-06T21:26:43.377 INFO:tasks.workunit.client.0.smithi032.stdout:3/541: dwrite d1/d2a/f76 [0,4194304] 0 2024-05-06T21:26:43.377 INFO:tasks.workunit.client.0.smithi032.stdout:5/393: creat d0/d24/d26/d3d/d50/f6e x:0 0 0 2024-05-06T21:26:43.377 INFO:tasks.workunit.client.0.smithi032.stdout:5/394: creat d0/d16/d2f/f6f x:0 0 0 2024-05-06T21:26:43.378 INFO:tasks.workunit.client.1.smithi154.stdout:6/83: truncate f6 1126275 0 2024-05-06T21:26:43.378 INFO:tasks.workunit.client.1.smithi154.stdout:6/84: stat d8/d11/l12 0 2024-05-06T21:26:43.378 INFO:tasks.workunit.client.1.smithi154.stdout:9/182: dwrite d5/f6 [0,4194304] 0 2024-05-06T21:26:43.379 INFO:tasks.workunit.client.1.smithi154.stdout:9/183: fsync d5/f6 0 2024-05-06T21:26:43.379 INFO:tasks.workunit.client.0.smithi032.stdout:9/515: dwrite d1/d13/d25/d59/f84 [0,4194304] 0 2024-05-06T21:26:43.379 INFO:tasks.workunit.client.0.smithi032.stdout:9/516: chown d1/d13/d34/d26/d9f 57723 1 2024-05-06T21:26:43.380 INFO:tasks.workunit.client.0.smithi032.stdout:3/542: mkdir d1/d4/da/d1d/dc0 0 2024-05-06T21:26:43.381 INFO:tasks.workunit.client.1.smithi154.stdout:0/103: symlink d6/d10/l1e 0 2024-05-06T21:26:43.383 INFO:tasks.workunit.client.0.smithi032.stdout:5/395: mkdir d0/d24/d38/d37/d70 0 2024-05-06T21:26:43.384 INFO:tasks.workunit.client.1.smithi154.stdout:3/168: sync 2024-05-06T21:26:43.384 INFO:tasks.workunit.client.1.smithi154.stdout:1/127: sync 2024-05-06T21:26:43.384 INFO:tasks.workunit.client.1.smithi154.stdout:1/128: rename d6/db/d10/d15 to d6/db/d10/d15/d1d/d27 22 2024-05-06T21:26:43.384 INFO:tasks.workunit.client.1.smithi154.stdout:1/129: read - d6/f24 zero size 2024-05-06T21:26:43.385 INFO:tasks.workunit.client.1.smithi154.stdout:0/104: dread - d6/f15 zero size 2024-05-06T21:26:43.387 INFO:tasks.workunit.client.1.smithi154.stdout:1/130: unlink l1 0 2024-05-06T21:26:43.389 INFO:tasks.workunit.client.1.smithi154.stdout:9/184: getdents d5/d14/d3a 0 2024-05-06T21:26:43.389 INFO:tasks.workunit.client.1.smithi154.stdout:9/185: dread - d5/d2e/f35 zero size 2024-05-06T21:26:43.389 INFO:tasks.workunit.client.0.smithi032.stdout:9/517: creat d1/d13/d34/fab x:0 0 0 2024-05-06T21:26:43.390 INFO:tasks.workunit.client.0.smithi032.stdout:3/543: creat d1/d4/da/d31/d47/fc1 x:0 0 0 2024-05-06T21:26:43.391 INFO:tasks.workunit.client.0.smithi032.stdout:3/544: fsync d1/d4/d11/f36 0 2024-05-06T21:26:43.391 INFO:tasks.workunit.client.1.smithi154.stdout:0/105: rename d6/dc/l12 to d6/l1f 0 2024-05-06T21:26:43.394 INFO:tasks.workunit.client.1.smithi154.stdout:8/142: write d3/fb [767546,95896] 0 2024-05-06T21:26:43.394 INFO:tasks.workunit.client.1.smithi154.stdout:8/143: write d3/fe [366377,5113] 0 2024-05-06T21:26:43.394 INFO:tasks.workunit.client.1.smithi154.stdout:5/139: getdents d2/d3/d21/d22/d25 0 2024-05-06T21:26:43.394 INFO:tasks.workunit.client.1.smithi154.stdout:5/140: truncate d2/d6/dc/f15 120403 0 2024-05-06T21:26:43.397 INFO:tasks.workunit.client.1.smithi154.stdout:1/131: write d6/db/d10/d15/f20 [2240292,106408] 0 2024-05-06T21:26:43.397 INFO:tasks.workunit.client.1.smithi154.stdout:1/132: creat d6/f28 x:0 0 0 2024-05-06T21:26:43.397 INFO:tasks.workunit.client.0.smithi032.stdout:9/518: truncate d1/d13/d34/f43 1285989 0 2024-05-06T21:26:43.399 INFO:tasks.workunit.client.0.smithi032.stdout:3/545: symlink d1/d4/da/d4e/lc2 0 2024-05-06T21:26:43.399 INFO:tasks.workunit.client.1.smithi154.stdout:6/85: getdents d8/d13 0 2024-05-06T21:26:43.400 INFO:tasks.workunit.client.1.smithi154.stdout:9/186: write d5/fe [2811818,27670] 0 2024-05-06T21:26:43.401 INFO:tasks.workunit.client.1.smithi154.stdout:9/187: truncate d5/f19 310133 0 2024-05-06T21:26:43.401 INFO:tasks.workunit.client.0.smithi032.stdout:3/546: write d1/d4/da/f32 [1175270,108513] 0 2024-05-06T21:26:43.402 INFO:tasks.workunit.client.0.smithi032.stdout:3/547: write d1/d4/da/d1d/f42 [1725472,127690] 0 2024-05-06T21:26:43.402 INFO:tasks.workunit.client.0.smithi032.stdout:3/548: truncate d1/d4/da/d4e/d41/d97/d67/da6/f99 233210 0 2024-05-06T21:26:43.402 INFO:tasks.workunit.client.0.smithi032.stdout:3/549: readlink d1/d4/da/d4e/l28 0 2024-05-06T21:26:43.402 INFO:tasks.workunit.client.0.smithi032.stdout:3/550: write d1/d4/da/d31/f48 [1204940,14828] 0 2024-05-06T21:26:43.402 INFO:tasks.workunit.client.0.smithi032.stdout:3/551: readlink d1/d4/lac 0 2024-05-06T21:26:43.402 INFO:tasks.workunit.client.0.smithi032.stdout:3/552: truncate d1/d4/da/d1d/f42 2420637 0 2024-05-06T21:26:43.403 INFO:tasks.workunit.client.1.smithi154.stdout:4/125: dwrite d0/d2/fb [0,4194304] 0 2024-05-06T21:26:43.403 INFO:tasks.workunit.client.1.smithi154.stdout:4/126: fdatasync d0/d10/f15 0 2024-05-06T21:26:43.403 INFO:tasks.workunit.client.1.smithi154.stdout:4/127: creat d0/d2/dc/f26 x:0 0 0 2024-05-06T21:26:43.403 INFO:tasks.workunit.client.1.smithi154.stdout:5/141: creat d2/d3/d21/d22/d25/f32 x:0 0 0 2024-05-06T21:26:43.403 INFO:tasks.workunit.client.0.smithi032.stdout:3/553: link d1/d4/da/d31/f55 d1/d4/fc3 0 2024-05-06T21:26:43.406 INFO:tasks.workunit.client.1.smithi154.stdout:1/133: mknod d6/db/d10/c29 0 2024-05-06T21:26:43.406 INFO:tasks.workunit.client.1.smithi154.stdout:1/134: read d6/f17 [6867082,73643] 0 2024-05-06T21:26:43.409 INFO:tasks.workunit.client.1.smithi154.stdout:6/86: truncate f6 1610315 0 2024-05-06T21:26:43.410 INFO:tasks.workunit.client.1.smithi154.stdout:9/188: rmdir d5/d14/d1e 39 2024-05-06T21:26:43.412 INFO:tasks.workunit.client.1.smithi154.stdout:8/144: symlink d3/l30 0 2024-05-06T21:26:43.412 INFO:tasks.workunit.client.1.smithi154.stdout:8/145: write d3/f21 [1533329,35564] 0 2024-05-06T21:26:43.413 INFO:tasks.workunit.client.1.smithi154.stdout:0/106: getdents d6/d10 0 2024-05-06T21:26:43.414 INFO:tasks.workunit.client.0.smithi032.stdout:9/519: dread d1/d13/d25/d59/f82 [0,4194304] 0 2024-05-06T21:26:43.418 INFO:tasks.workunit.client.0.smithi032.stdout:9/520: symlink d1/d13/d34/d26/d39/d8b/lac 0 2024-05-06T21:26:43.418 INFO:tasks.workunit.client.0.smithi032.stdout:9/521: readlink d1/d13/d25/d64/d72/la3 0 2024-05-06T21:26:43.418 INFO:tasks.workunit.client.0.smithi032.stdout:9/522: chown d1/d13/d34/d26/d39/d8b/l9a 996223 1 2024-05-06T21:26:43.418 INFO:tasks.workunit.client.0.smithi032.stdout:9/523: readlink d1/d13/d25/d64/d72/l85 0 2024-05-06T21:26:43.419 INFO:tasks.workunit.client.1.smithi154.stdout:6/87: dread d8/fc [0,4194304] 0 2024-05-06T21:26:43.420 INFO:tasks.workunit.client.0.smithi032.stdout:5/396: dwrite d0/d16/d2f/f3a [0,4194304] 0 2024-05-06T21:26:43.420 INFO:tasks.workunit.client.0.smithi032.stdout:3/554: write d1/d2a/f4c [1345454,106785] 0 2024-05-06T21:26:43.421 INFO:tasks.workunit.client.1.smithi154.stdout:7/56: dwrite d6/f9 [0,4194304] 0 2024-05-06T21:26:43.421 INFO:tasks.workunit.client.1.smithi154.stdout:7/57: chown d6/fa 200 1 2024-05-06T21:26:43.421 INFO:tasks.workunit.client.1.smithi154.stdout:7/58: stat c0 0 2024-05-06T21:26:43.421 INFO:tasks.workunit.client.1.smithi154.stdout:7/59: fsync d6/fd 0 2024-05-06T21:26:43.421 INFO:tasks.workunit.client.1.smithi154.stdout:5/142: rename d2/f4 to d2/d3/d19/d23/f33 0 2024-05-06T21:26:43.424 INFO:tasks.workunit.client.1.smithi154.stdout:4/128: link d0/c4 d0/d10/d11/c27 0 2024-05-06T21:26:43.424 INFO:tasks.workunit.client.1.smithi154.stdout:1/135: read d6/f8 [7703591,36670] 0 2024-05-06T21:26:43.424 INFO:tasks.workunit.client.1.smithi154.stdout:8/146: write d3/f8 [865844,44993] 0 2024-05-06T21:26:43.425 INFO:tasks.workunit.client.0.smithi032.stdout:5/397: getdents d0/d24/d34 0 2024-05-06T21:26:43.426 INFO:tasks.workunit.client.1.smithi154.stdout:6/88: creat d8/d11/f24 x:0 0 0 2024-05-06T21:26:43.426 INFO:tasks.workunit.client.1.smithi154.stdout:6/89: dread - d8/d11/f1b zero size 2024-05-06T21:26:43.426 INFO:tasks.workunit.client.1.smithi154.stdout:3/169: dwrite d0/da/f18 [0,4194304] 0 2024-05-06T21:26:43.426 INFO:tasks.workunit.client.1.smithi154.stdout:3/170: dread - d0/da/db/f2a zero size 2024-05-06T21:26:43.427 INFO:tasks.workunit.client.1.smithi154.stdout:7/60: creat d6/f11 x:0 0 0 2024-05-06T21:26:43.427 INFO:tasks.workunit.client.0.smithi032.stdout:5/398: creat d0/d24/d26/d3d/d50/d5a/f71 x:0 0 0 2024-05-06T21:26:43.430 INFO:tasks.workunit.client.0.smithi032.stdout:6/586: sync 2024-05-06T21:26:43.430 INFO:tasks.workunit.client.0.smithi032.stdout:7/534: sync 2024-05-06T21:26:43.430 INFO:tasks.workunit.client.0.smithi032.stdout:6/587: write d8/dd/d18/d13/f5a [3644919,67023] 0 2024-05-06T21:26:43.431 INFO:tasks.workunit.client.0.smithi032.stdout:5/399: creat d0/d24/d38/d37/d70/f72 x:0 0 0 2024-05-06T21:26:43.431 INFO:tasks.workunit.client.1.smithi154.stdout:9/189: rename d5/lc to d5/d20/l42 0 2024-05-06T21:26:43.431 INFO:tasks.workunit.client.1.smithi154.stdout:9/190: dread - d5/f28 zero size 2024-05-06T21:26:43.431 INFO:tasks.workunit.client.1.smithi154.stdout:9/191: creat d5/d14/f43 x:0 0 0 2024-05-06T21:26:43.432 INFO:tasks.workunit.client.0.smithi032.stdout:7/535: mknod db/d12/d16/d21/ca8 0 2024-05-06T21:26:43.433 INFO:tasks.workunit.client.0.smithi032.stdout:6/588: mkdir d8/dd/d1b/d35/db4 0 2024-05-06T21:26:43.434 INFO:tasks.workunit.client.0.smithi032.stdout:6/589: truncate d8/dd/d18/f69 1080637 0 2024-05-06T21:26:43.436 INFO:tasks.workunit.client.0.smithi032.stdout:5/400: truncate d0/d24/d38/f25 1487181 0 2024-05-06T21:26:43.437 INFO:tasks.workunit.client.1.smithi154.stdout:8/147: mknod d3/d14/c31 0 2024-05-06T21:26:43.437 INFO:tasks.workunit.client.1.smithi154.stdout:8/148: chown d3/d14/d1a/d29 325655694 1 2024-05-06T21:26:43.439 INFO:tasks.workunit.client.1.smithi154.stdout:0/107: dwrite d6/d10/f14 [0,4194304] 0 2024-05-06T21:26:43.439 INFO:tasks.workunit.client.1.smithi154.stdout:0/108: write d6/dc/fd [334211,90795] 0 2024-05-06T21:26:43.439 INFO:tasks.workunit.client.1.smithi154.stdout:0/109: fdatasync d6/dc/f13 0 2024-05-06T21:26:43.440 INFO:tasks.workunit.client.0.smithi032.stdout:5/401: rename d0/d16/d2a/d4d to d0/d16/d2a/d59/d67/d73 0 2024-05-06T21:26:43.440 INFO:tasks.workunit.client.0.smithi032.stdout:5/402: write d0/d24/d34/f4f [548697,50683] 0 2024-05-06T21:26:43.441 INFO:tasks.workunit.client.1.smithi154.stdout:3/171: creat d0/da/d1a/d28/d2f/f34 x:0 0 0 2024-05-06T21:26:43.442 INFO:tasks.workunit.client.1.smithi154.stdout:7/61: mknod d6/de/c12 0 2024-05-06T21:26:43.444 INFO:tasks.workunit.client.1.smithi154.stdout:0/110: dread f2 [0,4194304] 0 2024-05-06T21:26:43.446 INFO:tasks.workunit.client.1.smithi154.stdout:8/149: mkdir d3/d14/d1a/d29/d32 0 2024-05-06T21:26:43.447 INFO:tasks.workunit.client.0.smithi032.stdout:5/403: truncate d0/d24/d38/f60 3489797 0 2024-05-06T21:26:43.449 INFO:tasks.workunit.client.0.smithi032.stdout:5/404: truncate d0/d24/d38/f30 3134328 0 2024-05-06T21:26:43.449 INFO:tasks.workunit.client.1.smithi154.stdout:4/129: dread d0/d2/dc/f20 [0,4194304] 0 2024-05-06T21:26:43.450 INFO:tasks.workunit.client.0.smithi032.stdout:9/524: dwrite d1/d13/d33/d5e/d78/f8d [0,4194304] 0 2024-05-06T21:26:43.454 INFO:tasks.workunit.client.1.smithi154.stdout:8/150: dread d3/d14/f18 [0,4194304] 0 2024-05-06T21:26:43.454 INFO:tasks.workunit.client.1.smithi154.stdout:3/172: link d0/d2/f25 d0/da/db/dd/d1c/f35 0 2024-05-06T21:26:43.456 INFO:tasks.workunit.client.1.smithi154.stdout:7/62: symlink d6/l13 0 2024-05-06T21:26:43.458 INFO:tasks.workunit.client.1.smithi154.stdout:0/111: link d6/d10/f11 d6/d10/f20 0 2024-05-06T21:26:43.458 INFO:tasks.workunit.client.1.smithi154.stdout:8/151: mkdir d3/d14/d1a/d29/d32/d33 0 2024-05-06T21:26:43.458 INFO:tasks.workunit.client.1.smithi154.stdout:8/152: chown d3/l17 167 1 2024-05-06T21:26:43.459 INFO:tasks.workunit.client.1.smithi154.stdout:3/173: symlink d0/d2/l36 0 2024-05-06T21:26:43.460 INFO:tasks.workunit.client.1.smithi154.stdout:7/63: mkdir d6/d14 0 2024-05-06T21:26:43.461 INFO:tasks.workunit.client.1.smithi154.stdout:0/112: creat d6/d10/f21 x:0 0 0 2024-05-06T21:26:43.461 INFO:tasks.workunit.client.1.smithi154.stdout:0/113: readlink d6/d10/l1e 0 2024-05-06T21:26:43.461 INFO:tasks.workunit.client.1.smithi154.stdout:8/153: getdents d3/d14/d1a/d22/d26 0 2024-05-06T21:26:43.461 INFO:tasks.workunit.client.1.smithi154.stdout:8/154: fsync d3/fe 0 2024-05-06T21:26:43.462 INFO:tasks.workunit.client.0.smithi032.stdout:9/525: dread d1/f23 [0,4194304] 0 2024-05-06T21:26:43.462 INFO:tasks.workunit.client.0.smithi032.stdout:9/526: chown d1/d13/d33/da6 51821089 1 2024-05-06T21:26:43.462 INFO:tasks.workunit.client.1.smithi154.stdout:7/64: symlink d6/d14/l15 0 2024-05-06T21:26:43.463 INFO:tasks.workunit.client.1.smithi154.stdout:1/136: dread d6/db/d10/d15/f20 [0,4194304] 0 2024-05-06T21:26:43.464 INFO:tasks.workunit.client.1.smithi154.stdout:1/137: read - d6/f24 zero size 2024-05-06T21:26:43.464 INFO:tasks.workunit.client.1.smithi154.stdout:1/138: chown d6/f24 61 1 2024-05-06T21:26:43.464 INFO:tasks.workunit.client.1.smithi154.stdout:1/139: dread - d6/db/d10/d26/f23 zero size 2024-05-06T21:26:43.464 INFO:tasks.workunit.client.1.smithi154.stdout:0/114: chown d6/c9 53 1 2024-05-06T21:26:43.464 INFO:tasks.workunit.client.1.smithi154.stdout:8/155: mknod d3/d14/d1a/d29/d32/d33/c34 0 2024-05-06T21:26:43.464 INFO:tasks.workunit.client.1.smithi154.stdout:8/156: chown d3/d14/f20 29 1 2024-05-06T21:26:43.465 INFO:tasks.workunit.client.1.smithi154.stdout:8/157: getdents d3/d14/d1a 0 2024-05-06T21:26:43.465 INFO:tasks.workunit.client.1.smithi154.stdout:8/158: chown d3/f8 15056749 1 2024-05-06T21:26:43.467 INFO:tasks.workunit.client.1.smithi154.stdout:8/159: mknod d3/d14/c35 0 2024-05-06T21:26:43.467 INFO:tasks.workunit.client.1.smithi154.stdout:8/160: fdatasync d3/f10 0 2024-05-06T21:26:43.469 INFO:tasks.workunit.client.1.smithi154.stdout:8/161: unlink d3/d14/f1e 0 2024-05-06T21:26:43.472 INFO:tasks.workunit.client.1.smithi154.stdout:8/162: mknod d3/c36 0 2024-05-06T21:26:43.476 INFO:tasks.workunit.client.1.smithi154.stdout:0/115: dread d6/d10/f20 [0,4194304] 0 2024-05-06T21:26:43.478 INFO:tasks.workunit.client.1.smithi154.stdout:7/65: write d6/f10 [74043,69310] 0 2024-05-06T21:26:43.480 INFO:tasks.workunit.client.1.smithi154.stdout:7/66: symlink d6/l16 0 2024-05-06T21:26:43.492 INFO:tasks.workunit.client.0.smithi032.stdout:3/555: dwrite d1/d4/db7/fa2 [0,4194304] 0 2024-05-06T21:26:43.492 INFO:tasks.workunit.client.0.smithi032.stdout:3/556: write d1/f35 [986849,52385] 0 2024-05-06T21:26:43.502 INFO:tasks.workunit.client.1.smithi154.stdout:0/116: dread d6/d10/f14 [0,4194304] 0 2024-05-06T21:26:43.510 INFO:tasks.workunit.client.0.smithi032.stdout:3/557: dread d1/d4/d11/f4f [0,4194304] 0 2024-05-06T21:26:43.511 INFO:tasks.workunit.client.0.smithi032.stdout:3/558: fsync d1/d4/d11/f4f 0 2024-05-06T21:26:43.511 INFO:tasks.workunit.client.0.smithi032.stdout:3/559: stat d1/d4/da/d4e/f91 0 2024-05-06T21:26:43.512 INFO:tasks.workunit.client.1.smithi154.stdout:5/143: dwrite d2/d3/f9 [0,4194304] 0 2024-05-06T21:26:43.513 INFO:tasks.workunit.client.0.smithi032.stdout:7/536: dwrite db/d12/d16/f24 [0,4194304] 0 2024-05-06T21:26:43.514 INFO:tasks.workunit.client.0.smithi032.stdout:7/537: write db/d12/d16/d21/f31 [207253,35627] 0 2024-05-06T21:26:43.514 INFO:tasks.workunit.client.0.smithi032.stdout:7/538: symlink db/d12/d16/d2a/d39/d3b/d9c/la9 0 2024-05-06T21:26:43.516 INFO:tasks.workunit.client.0.smithi032.stdout:7/539: unlink db/d12/f81 0 2024-05-06T21:26:43.516 INFO:tasks.workunit.client.0.smithi032.stdout:7/540: write db/d12/d16/d2a/f5a [3658540,93650] 0 2024-05-06T21:26:43.516 INFO:tasks.workunit.client.0.smithi032.stdout:7/541: getdents db/d89 0 2024-05-06T21:26:43.516 INFO:tasks.workunit.client.0.smithi032.stdout:7/542: write db/d12/d49/f67 [587219,5292] 0 2024-05-06T21:26:43.517 INFO:tasks.workunit.client.0.smithi032.stdout:5/405: dwrite d0/d24/d26/d32/f42 [0,4194304] 0 2024-05-06T21:26:43.517 INFO:tasks.workunit.client.1.smithi154.stdout:1/140: dwrite d6/db/d10/d26/f23 [0,4194304] 0 2024-05-06T21:26:43.517 INFO:tasks.workunit.client.1.smithi154.stdout:1/141: truncate d6/f28 949557 0 2024-05-06T21:26:43.517 INFO:tasks.workunit.client.1.smithi154.stdout:1/142: dread - d6/db/d10/d26/f25 zero size 2024-05-06T21:26:43.519 INFO:tasks.workunit.client.0.smithi032.stdout:6/590: dwrite d8/dd/d18/f69 [0,4194304] 0 2024-05-06T21:26:43.519 INFO:tasks.workunit.client.0.smithi032.stdout:6/591: truncate d8/d3d/d49/fa9 719440 0 2024-05-06T21:26:43.520 INFO:tasks.workunit.client.0.smithi032.stdout:6/592: dread d8/d3d/d49/fa9 [0,4194304] 0 2024-05-06T21:26:43.520 INFO:tasks.workunit.client.0.smithi032.stdout:6/593: dread - d8/d3d/d49/f76 zero size 2024-05-06T21:26:43.521 INFO:tasks.workunit.client.0.smithi032.stdout:6/594: write d8/dd/d1b/faa [1005108,20140] 0 2024-05-06T21:26:43.521 INFO:tasks.workunit.client.0.smithi032.stdout:6/595: write d8/dd/d18/d13/d1d/fa1 [1434734,17087] 0 2024-05-06T21:26:43.522 INFO:tasks.workunit.client.1.smithi154.stdout:1/143: unlink d6/db/d10/d15/f16 0 2024-05-06T21:26:43.523 INFO:tasks.workunit.client.0.smithi032.stdout:5/406: symlink d0/d16/d2a/d59/l74 0 2024-05-06T21:26:43.528 INFO:tasks.workunit.client.1.smithi154.stdout:4/130: dwrite d0/d10/f15 [0,4194304] 0 2024-05-06T21:26:43.529 INFO:tasks.workunit.client.1.smithi154.stdout:8/163: dwrite d3/f10 [0,4194304] 0 2024-05-06T21:26:43.530 INFO:tasks.workunit.client.0.smithi032.stdout:6/596: dread d8/d3d/f4e [0,4194304] 0 2024-05-06T21:26:43.533 INFO:tasks.workunit.client.0.smithi032.stdout:5/407: creat d0/d28/f75 x:0 0 0 2024-05-06T21:26:43.535 INFO:tasks.workunit.client.1.smithi154.stdout:4/131: creat d0/d10/d11/d1a/f28 x:0 0 0 2024-05-06T21:26:43.535 INFO:tasks.workunit.client.1.smithi154.stdout:4/132: fdatasync d0/d10/d11/d1a/f1d 0 2024-05-06T21:26:43.535 INFO:tasks.workunit.client.1.smithi154.stdout:9/192: fsync d5/d14/f43 0 2024-05-06T21:26:43.535 INFO:tasks.workunit.client.1.smithi154.stdout:9/193: write d5/d14/d31/f3d [219108,20231] 0 2024-05-06T21:26:43.535 INFO:tasks.workunit.client.0.smithi032.stdout:6/597: creat d8/dd/d18/d13/d7a/fb5 x:0 0 0 2024-05-06T21:26:43.535 INFO:tasks.workunit.client.0.smithi032.stdout:6/598: chown d8/d3d/d49/f76 35197730 1 2024-05-06T21:26:43.536 INFO:tasks.workunit.client.1.smithi154.stdout:9/194: dread d5/f19 [0,4194304] 0 2024-05-06T21:26:43.537 INFO:tasks.workunit.client.0.smithi032.stdout:5/408: creat d0/d16/d2a/d59/d67/d73/f76 x:0 0 0 2024-05-06T21:26:43.537 INFO:tasks.workunit.client.1.smithi154.stdout:9/195: chown d5/f12 9381 1 2024-05-06T21:26:43.537 INFO:tasks.workunit.client.1.smithi154.stdout:9/196: write d5/d2e/f35 [979163,7586] 0 2024-05-06T21:26:43.537 INFO:tasks.workunit.client.1.smithi154.stdout:8/164: symlink d3/d14/d1a/d29/d32/l37 0 2024-05-06T21:26:43.538 INFO:tasks.workunit.client.0.smithi032.stdout:6/599: rmdir d8/d3d/d73/d87 39 2024-05-06T21:26:43.538 INFO:tasks.workunit.client.0.smithi032.stdout:6/600: dread - d8/d33/d63/f83 zero size 2024-05-06T21:26:43.539 INFO:tasks.workunit.client.0.smithi032.stdout:6/601: chown d8/d33/l80 2425718 1 2024-05-06T21:26:43.539 INFO:tasks.workunit.client.0.smithi032.stdout:6/602: truncate d8/dd/d18/d13/f58 262836 0 2024-05-06T21:26:43.540 INFO:tasks.workunit.client.1.smithi154.stdout:4/133: mkdir d0/d2/d29 0 2024-05-06T21:26:43.543 INFO:tasks.workunit.client.1.smithi154.stdout:9/197: dread d5/d20/f2c [0,4194304] 0 2024-05-06T21:26:43.546 INFO:tasks.workunit.client.1.smithi154.stdout:9/198: unlink d5/lb 0 2024-05-06T21:26:43.547 INFO:tasks.workunit.client.0.smithi032.stdout:3/560: dwrite d1/d4/db7/fa0 [0,4194304] 0 2024-05-06T21:26:43.547 INFO:tasks.workunit.client.1.smithi154.stdout:9/199: mkdir d5/d14/d3a/d44 0 2024-05-06T21:26:43.548 INFO:tasks.workunit.client.1.smithi154.stdout:9/200: dread - d5/d14/d31/d39/f3c zero size 2024-05-06T21:26:43.548 INFO:tasks.workunit.client.1.smithi154.stdout:9/201: truncate d5/f13 4840283 0 2024-05-06T21:26:43.548 INFO:tasks.workunit.client.1.smithi154.stdout:5/144: dwrite d2/d3/f16 [0,4194304] 0 2024-05-06T21:26:43.549 INFO:tasks.workunit.client.1.smithi154.stdout:5/145: write d2/d6/fe [1179117,48180] 0 2024-05-06T21:26:43.549 INFO:tasks.workunit.client.1.smithi154.stdout:9/202: mknod d5/d20/d37/c45 0 2024-05-06T21:26:43.549 INFO:tasks.workunit.client.1.smithi154.stdout:9/203: write d5/fe [2747864,107950] 0 2024-05-06T21:26:43.558 INFO:tasks.workunit.client.0.smithi032.stdout:5/409: dread d0/d16/f1e [0,4194304] 0 2024-05-06T21:26:43.559 INFO:tasks.workunit.client.1.smithi154.stdout:5/146: unlink d2/d3/f9 0 2024-05-06T21:26:43.559 INFO:tasks.workunit.client.1.smithi154.stdout:9/204: dread d5/d14/f30 [0,4194304] 0 2024-05-06T21:26:43.559 INFO:tasks.workunit.client.1.smithi154.stdout:9/205: truncate d5/d14/d31/d39/f3c 96429 0 2024-05-06T21:26:43.560 INFO:tasks.workunit.client.1.smithi154.stdout:1/144: getdents d6/db/d10/d15 0 2024-05-06T21:26:43.562 INFO:tasks.workunit.client.1.smithi154.stdout:5/147: creat d2/f34 x:0 0 0 2024-05-06T21:26:43.562 INFO:tasks.workunit.client.0.smithi032.stdout:5/410: mkdir d0/d16/d2f/d77 0 2024-05-06T21:26:43.562 INFO:tasks.workunit.client.0.smithi032.stdout:5/411: stat d0/d24/d34 0 2024-05-06T21:26:43.563 INFO:tasks.workunit.client.1.smithi154.stdout:9/206: symlink d5/d14/l46 0 2024-05-06T21:26:43.563 INFO:tasks.workunit.client.1.smithi154.stdout:9/207: creat d5/d14/d31/f47 x:0 0 0 2024-05-06T21:26:43.564 INFO:tasks.workunit.client.0.smithi032.stdout:5/412: mkdir d0/d16/d46/d78 0 2024-05-06T21:26:43.566 INFO:tasks.workunit.client.1.smithi154.stdout:1/145: rmdir d6/db/d10 39 2024-05-06T21:26:43.566 INFO:tasks.workunit.client.0.smithi032.stdout:5/413: unlink d0/d16/d2f/f3a 0 2024-05-06T21:26:43.568 INFO:tasks.workunit.client.1.smithi154.stdout:5/148: link d2/d6/dc/f30 d2/d3/f35 0 2024-05-06T21:26:43.568 INFO:tasks.workunit.client.1.smithi154.stdout:5/149: chown d2/d6/f7 1 1 2024-05-06T21:26:43.568 INFO:tasks.workunit.client.1.smithi154.stdout:5/150: fdatasync d2/f1a 0 2024-05-06T21:26:43.568 INFO:tasks.workunit.client.1.smithi154.stdout:5/151: creat d2/d3/d21/d22/f36 x:0 0 0 2024-05-06T21:26:43.568 INFO:tasks.workunit.client.1.smithi154.stdout:5/152: fdatasync d2/d3/d19/d23/f33 0 2024-05-06T21:26:43.569 INFO:tasks.workunit.client.0.smithi032.stdout:5/414: mkdir d0/d16/d79 0 2024-05-06T21:26:43.569 INFO:tasks.workunit.client.0.smithi032.stdout:5/415: stat d0/d16/d2a/d59 0 2024-05-06T21:26:43.569 INFO:tasks.workunit.client.0.smithi032.stdout:5/416: write d0/fb [594653,74892] 0 2024-05-06T21:26:43.569 INFO:tasks.workunit.client.0.smithi032.stdout:5/417: write d0/d24/d26/d3d/d50/f6e [597986,52624] 0 2024-05-06T21:26:43.569 INFO:tasks.workunit.client.1.smithi154.stdout:9/208: mknod d5/d2e/c48 0 2024-05-06T21:26:43.570 INFO:tasks.workunit.client.1.smithi154.stdout:5/153: mkdir d2/d3/d21/d22/d25/d37 0 2024-05-06T21:26:43.570 INFO:tasks.workunit.client.1.smithi154.stdout:5/154: write d2/d6/dc/f30 [519037,98774] 0 2024-05-06T21:26:43.571 INFO:tasks.workunit.client.1.smithi154.stdout:5/155: read d2/d3/f28 [290577,10913] 0 2024-05-06T21:26:43.572 INFO:tasks.workunit.client.0.smithi032.stdout:5/418: rename d0/d24/d38/f36 to d0/d16/d46/f7a 0 2024-05-06T21:26:43.573 INFO:tasks.workunit.client.1.smithi154.stdout:5/156: symlink d2/d3/d19/l38 0 2024-05-06T21:26:43.576 INFO:tasks.workunit.client.0.smithi032.stdout:1/442: sync 2024-05-06T21:26:43.577 INFO:tasks.workunit.client.0.smithi032.stdout:1/443: mknod db/d47/c8b 0 2024-05-06T21:26:43.579 INFO:tasks.workunit.client.0.smithi032.stdout:1/444: rmdir db/d87 0 2024-05-06T21:26:43.583 INFO:tasks.workunit.client.0.smithi032.stdout:7/543: dwrite db/d12/d16/d2a/f5a [4194304,4194304] 0 2024-05-06T21:26:43.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/209: read d5/f6 [273006,42422] 0 2024-05-06T21:26:43.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/210: stat d5/d14/d3a/d44 0 2024-05-06T21:26:43.586 INFO:tasks.workunit.client.0.smithi032.stdout:7/544: mkdir db/d89/daa 0 2024-05-06T21:26:43.588 INFO:tasks.workunit.client.0.smithi032.stdout:7/545: rmdir db/d12/d49 39 2024-05-06T21:26:43.588 INFO:tasks.workunit.client.1.smithi154.stdout:9/211: link d5/d14/d31/d39/f3c d5/d14/f49 0 2024-05-06T21:26:43.588 INFO:tasks.workunit.client.1.smithi154.stdout:9/212: creat d5/d14/d31/d39/f4a x:0 0 0 2024-05-06T21:26:43.589 INFO:tasks.workunit.client.0.smithi032.stdout:7/546: chown db/d12/d16/f8a 8702 1 2024-05-06T21:26:43.590 INFO:tasks.workunit.client.1.smithi154.stdout:9/213: creat d5/d20/f4b x:0 0 0 2024-05-06T21:26:43.590 INFO:tasks.workunit.client.0.smithi032.stdout:7/547: link db/d89/la2 db/d12/d16/d2a/d39/d3b/lab 0 2024-05-06T21:26:43.590 INFO:tasks.workunit.client.0.smithi032.stdout:7/548: dread - db/d12/f79 zero size 2024-05-06T21:26:43.591 INFO:tasks.workunit.client.0.smithi032.stdout:7/549: chown db/d12/d16 205 1 2024-05-06T21:26:43.591 INFO:tasks.workunit.client.1.smithi154.stdout:9/214: mknod d5/d14/d1e/c4c 0 2024-05-06T21:26:43.591 INFO:tasks.workunit.client.1.smithi154.stdout:9/215: write d5/d14/d31/f3d [159678,40590] 0 2024-05-06T21:26:43.591 INFO:tasks.workunit.client.1.smithi154.stdout:9/216: write d5/f6 [2791225,54510] 0 2024-05-06T21:26:43.592 INFO:tasks.workunit.client.0.smithi032.stdout:6/603: dwrite d8/f8c [0,4194304] 0 2024-05-06T21:26:43.593 INFO:tasks.workunit.client.1.smithi154.stdout:9/217: link d5/d14/d31/d39/f4a d5/d14/d1e/f4d 0 2024-05-06T21:26:43.594 INFO:tasks.workunit.client.0.smithi032.stdout:7/550: dread db/d12/d49/f4d [0,4194304] 0 2024-05-06T21:26:43.595 INFO:tasks.workunit.client.1.smithi154.stdout:9/218: symlink d5/d14/d31/l4e 0 2024-05-06T21:26:43.596 INFO:tasks.workunit.client.1.smithi154.stdout:7/67: dwrite d6/f9 [0,4194304] 0 2024-05-06T21:26:43.596 INFO:tasks.workunit.client.1.smithi154.stdout:7/68: truncate d6/fb 801610 0 2024-05-06T21:26:43.596 INFO:tasks.workunit.client.1.smithi154.stdout:8/165: dwrite d3/d14/f18 [0,4194304] 0 2024-05-06T21:26:43.597 INFO:tasks.workunit.client.1.smithi154.stdout:7/69: write d6/fb [493804,64933] 0 2024-05-06T21:26:43.599 INFO:tasks.workunit.client.1.smithi154.stdout:9/219: rmdir d5/d14/d3a/d44 0 2024-05-06T21:26:43.599 INFO:tasks.workunit.client.1.smithi154.stdout:4/134: dwrite d0/d10/f15 [4194304,4194304] 0 2024-05-06T21:26:43.600 INFO:tasks.workunit.client.0.smithi032.stdout:3/561: dwrite d1/d4/da/d4e/d41/d97/d67/f7b [0,4194304] 0 2024-05-06T21:26:43.600 INFO:tasks.workunit.client.0.smithi032.stdout:6/604: dread d8/dd/d18/d13/f28 [0,4194304] 0 2024-05-06T21:26:43.601 INFO:tasks.workunit.client.0.smithi032.stdout:1/445: dwrite db/d47/d4a/f74 [0,4194304] 0 2024-05-06T21:26:43.606 INFO:tasks.workunit.client.1.smithi154.stdout:1/146: dwrite d6/f8 [0,4194304] 0 2024-05-06T21:26:43.606 INFO:tasks.workunit.client.1.smithi154.stdout:1/147: chown d6/c22 1 1 2024-05-06T21:26:43.607 INFO:tasks.workunit.client.0.smithi032.stdout:5/419: dwrite d0/d24/f66 [0,4194304] 0 2024-05-06T21:26:43.607 INFO:tasks.workunit.client.0.smithi032.stdout:5/420: dread - d0/d24/d26/d3d/d50/d5a/f71 zero size 2024-05-06T21:26:43.608 INFO:tasks.workunit.client.0.smithi032.stdout:6/605: dread d8/dd/d1b/d35/f86 [0,4194304] 0 2024-05-06T21:26:43.610 INFO:tasks.workunit.client.1.smithi154.stdout:7/70: creat d6/de/f17 x:0 0 0 2024-05-06T21:26:43.610 INFO:tasks.workunit.client.0.smithi032.stdout:6/606: dread d8/dd/d1b/d35/f66 [0,4194304] 0 2024-05-06T21:26:43.613 INFO:tasks.workunit.client.0.smithi032.stdout:1/446: rename db/d16/d46/d57/d58/d68/c76 to db/d2a/c8c 0 2024-05-06T21:26:43.613 INFO:tasks.workunit.client.0.smithi032.stdout:1/447: chown db/d2a/f50 37 1 2024-05-06T21:26:43.614 INFO:tasks.workunit.client.1.smithi154.stdout:9/220: link d5/f2a d5/d14/d1e/f4f 0 2024-05-06T21:26:43.615 INFO:tasks.workunit.client.1.smithi154.stdout:9/221: read d5/d2e/f35 [245939,117967] 0 2024-05-06T21:26:43.618 INFO:tasks.workunit.client.0.smithi032.stdout:6/607: mkdir d8/db6 0 2024-05-06T21:26:43.618 INFO:tasks.workunit.client.1.smithi154.stdout:4/135: mkdir d0/d2/d2a 0 2024-05-06T21:26:43.618 INFO:tasks.workunit.client.1.smithi154.stdout:4/136: creat d0/d2/f2b x:0 0 0 2024-05-06T21:26:43.621 INFO:tasks.workunit.client.0.smithi032.stdout:6/608: dread d8/dd/d18/d13/d1d/fa1 [0,4194304] 0 2024-05-06T21:26:43.622 INFO:tasks.workunit.client.1.smithi154.stdout:1/148: symlink d6/db/d10/d15/d1d/l2a 0 2024-05-06T21:26:43.622 INFO:tasks.workunit.client.1.smithi154.stdout:1/149: rename d6 to d6/db/d2b 22 2024-05-06T21:26:43.623 INFO:tasks.workunit.client.0.smithi032.stdout:5/421: dwrite d0/d24/d38/d37/f53 [0,4194304] 0 2024-05-06T21:26:43.623 INFO:tasks.workunit.client.0.smithi032.stdout:5/422: readlink d0/l20 0 2024-05-06T21:26:43.623 INFO:tasks.workunit.client.0.smithi032.stdout:5/423: truncate d0/f10 3498454 0 2024-05-06T21:26:43.624 INFO:tasks.workunit.client.1.smithi154.stdout:9/222: dread d5/f6 [0,4194304] 0 2024-05-06T21:26:43.624 INFO:tasks.workunit.client.0.smithi032.stdout:6/609: dread d8/dd/d18/d13/f58 [0,4194304] 0 2024-05-06T21:26:43.625 INFO:tasks.workunit.client.0.smithi032.stdout:1/448: getdents db/d16/d46/d57/d58/d68 0 2024-05-06T21:26:43.627 INFO:tasks.workunit.client.0.smithi032.stdout:5/424: mkdir d0/d24/d38/d37/d7b 0 2024-05-06T21:26:43.627 INFO:tasks.workunit.client.0.smithi032.stdout:5/425: truncate d0/d24/d34/f4f 617732 0 2024-05-06T21:26:43.628 INFO:tasks.workunit.client.1.smithi154.stdout:8/166: truncate d3/f10 2186688 0 2024-05-06T21:26:43.628 INFO:tasks.workunit.client.0.smithi032.stdout:6/610: symlink d8/dd/d18/d13/d7a/lb7 0 2024-05-06T21:26:43.628 INFO:tasks.workunit.client.1.smithi154.stdout:5/157: dwrite d2/d6/dd/f20 [4194304,4194304] 0 2024-05-06T21:26:43.630 INFO:tasks.workunit.client.0.smithi032.stdout:5/426: rename d0/d24/f66 to d0/d16/d2f/d77/f7c 0 2024-05-06T21:26:43.630 INFO:tasks.workunit.client.1.smithi154.stdout:4/137: creat d0/d2/d2a/f2c x:0 0 0 2024-05-06T21:26:43.631 INFO:tasks.workunit.client.0.smithi032.stdout:6/611: creat d8/dd/d18/d3b/fb8 x:0 0 0 2024-05-06T21:26:43.631 INFO:tasks.workunit.client.0.smithi032.stdout:6/612: getdents d8/d3d/d49/dad 0 2024-05-06T21:26:43.631 INFO:tasks.workunit.client.0.smithi032.stdout:1/449: dread db/d16/f32 [0,4194304] 0 2024-05-06T21:26:43.632 INFO:tasks.workunit.client.1.smithi154.stdout:9/223: truncate d5/d14/d1e/f4d 63525 0 2024-05-06T21:26:43.632 INFO:tasks.workunit.client.1.smithi154.stdout:9/224: dread - d5/d20/f23 zero size 2024-05-06T21:26:43.633 INFO:tasks.workunit.client.0.smithi032.stdout:6/613: rename d8/d33/d63 to d8/dd/d18/d3b/db9 0 2024-05-06T21:26:43.635 INFO:tasks.workunit.client.0.smithi032.stdout:1/450: mknod db/d16/d46/d55/c8d 0 2024-05-06T21:26:43.635 INFO:tasks.workunit.client.0.smithi032.stdout:1/451: fsync db/d16/d5d/f7d 0 2024-05-06T21:26:43.637 INFO:tasks.workunit.client.0.smithi032.stdout:6/614: rename d8/l45 to d8/d3d/lba 0 2024-05-06T21:26:43.637 INFO:tasks.workunit.client.0.smithi032.stdout:6/615: read d8/dd/d18/d13/f2c [919591,42760] 0 2024-05-06T21:26:43.637 INFO:tasks.workunit.client.1.smithi154.stdout:5/158: mknod d2/d3/d19/d23/c39 0 2024-05-06T21:26:43.638 INFO:tasks.workunit.client.0.smithi032.stdout:1/452: creat db/d47/d4a/f8e x:0 0 0 2024-05-06T21:26:43.640 INFO:tasks.workunit.client.1.smithi154.stdout:4/138: dread d0/d10/d11/f21 [0,4194304] 0 2024-05-06T21:26:43.640 INFO:tasks.workunit.client.1.smithi154.stdout:1/150: rename l3 to d6/db/d10/l2c 0 2024-05-06T21:26:43.640 INFO:tasks.workunit.client.1.smithi154.stdout:1/151: chown d6 699 1 2024-05-06T21:26:43.641 INFO:tasks.workunit.client.0.smithi032.stdout:5/427: write d0/d24/d26/d3d/d50/f5d [1817422,49223] 0 2024-05-06T21:26:43.642 INFO:tasks.workunit.client.1.smithi154.stdout:8/167: mkdir d3/d38 0 2024-05-06T21:26:43.643 INFO:tasks.workunit.client.0.smithi032.stdout:5/428: creat d0/d16/d2f/d77/f7d x:0 0 0 2024-05-06T21:26:43.643 INFO:tasks.workunit.client.0.smithi032.stdout:5/429: read - d0/d16/d2f/f6f zero size 2024-05-06T21:26:43.643 INFO:tasks.workunit.client.0.smithi032.stdout:5/430: dread - d0/d24/d26/f56 zero size 2024-05-06T21:26:43.645 INFO:tasks.workunit.client.0.smithi032.stdout:8/563: sync 2024-05-06T21:26:43.645 INFO:tasks.workunit.client.0.smithi032.stdout:2/413: sync 2024-05-06T21:26:43.645 INFO:tasks.workunit.client.0.smithi032.stdout:9/527: sync 2024-05-06T21:26:43.645 INFO:tasks.workunit.client.0.smithi032.stdout:0/457: sync 2024-05-06T21:26:43.645 INFO:tasks.workunit.client.0.smithi032.stdout:4/553: sync 2024-05-06T21:26:43.645 INFO:tasks.workunit.client.1.smithi154.stdout:5/159: symlink d2/d3/d21/l3a 0 2024-05-06T21:26:43.646 INFO:tasks.workunit.client.0.smithi032.stdout:8/564: rmdir d0/d1b/d39/d3b/d57/d5d 39 2024-05-06T21:26:43.647 INFO:tasks.workunit.client.1.smithi154.stdout:1/152: mknod d6/db/d10/d26/c2d 0 2024-05-06T21:26:43.648 INFO:tasks.workunit.client.0.smithi032.stdout:2/414: creat df/d19/d1e/f99 x:0 0 0 2024-05-06T21:26:43.649 INFO:tasks.workunit.client.0.smithi032.stdout:9/528: creat d1/d2f/fad x:0 0 0 2024-05-06T21:26:43.649 INFO:tasks.workunit.client.1.smithi154.stdout:2/131: sync 2024-05-06T21:26:43.649 INFO:tasks.workunit.client.1.smithi154.stdout:2/132: creat db/de/d16/f28 x:0 0 0 2024-05-06T21:26:43.649 INFO:tasks.workunit.client.1.smithi154.stdout:2/133: stat db/lf 0 2024-05-06T21:26:43.651 INFO:tasks.workunit.client.0.smithi032.stdout:4/554: creat d2/d13/daa/fba x:0 0 0 2024-05-06T21:26:43.651 INFO:tasks.workunit.client.0.smithi032.stdout:4/555: creat d2/d16/d44/d45/d4e/fbb x:0 0 0 2024-05-06T21:26:43.651 INFO:tasks.workunit.client.0.smithi032.stdout:0/458: mkdir d4/d3e/d63/d8d 0 2024-05-06T21:26:43.651 INFO:tasks.workunit.client.0.smithi032.stdout:5/431: dread d0/d24/d38/f60 [0,4194304] 0 2024-05-06T21:26:43.652 INFO:tasks.workunit.client.1.smithi154.stdout:5/160: unlink d2/d6/dc/f29 0 2024-05-06T21:26:43.653 INFO:tasks.workunit.client.0.smithi032.stdout:2/415: creat df/d19/d1e/d1f/d2e/d33/f9a x:0 0 0 2024-05-06T21:26:43.653 INFO:tasks.workunit.client.0.smithi032.stdout:2/416: write df/d19/d1e/d1f/d2e/d33/f9a [673097,9329] 0 2024-05-06T21:26:43.653 INFO:tasks.workunit.client.0.smithi032.stdout:2/417: fsync df/d19/d1e/d71/d5f/d7d/f5c 0 2024-05-06T21:26:43.653 INFO:tasks.workunit.client.0.smithi032.stdout:2/418: dread - df/d19/d1e/d71/d5f/d73/f87 zero size 2024-05-06T21:26:43.653 INFO:tasks.workunit.client.0.smithi032.stdout:9/529: mknod d1/d13/d25/cae 0 2024-05-06T21:26:43.653 INFO:tasks.workunit.client.0.smithi032.stdout:9/530: truncate d1/d2f/fad 674590 0 2024-05-06T21:26:43.654 INFO:tasks.workunit.client.0.smithi032.stdout:9/531: write d1/f9 [753127,27046] 0 2024-05-06T21:26:43.654 INFO:tasks.workunit.client.0.smithi032.stdout:4/556: rmdir d2/d16/d44/d54 39 2024-05-06T21:26:43.656 INFO:tasks.workunit.client.1.smithi154.stdout:2/134: mknod db/c29 0 2024-05-06T21:26:43.656 INFO:tasks.workunit.client.1.smithi154.stdout:2/135: readlink l7 0 2024-05-06T21:26:43.659 INFO:tasks.workunit.client.0.smithi032.stdout:4/557: unlink d2/d16/f52 0 2024-05-06T21:26:43.660 INFO:tasks.workunit.client.1.smithi154.stdout:1/153: link l0 d6/db/d10/d15/l2e 0 2024-05-06T21:26:43.660 INFO:tasks.workunit.client.0.smithi032.stdout:4/558: creat d2/d16/d44/d74/d76/d81/fbc x:0 0 0 2024-05-06T21:26:43.660 INFO:tasks.workunit.client.0.smithi032.stdout:5/432: write d0/d24/d26/d32/f42 [156875,91498] 0 2024-05-06T21:26:43.661 INFO:tasks.workunit.client.0.smithi032.stdout:5/433: creat d0/d24/f7e x:0 0 0 2024-05-06T21:26:43.661 INFO:tasks.workunit.client.0.smithi032.stdout:0/459: rmdir d4/da/d16/d33 39 2024-05-06T21:26:43.663 INFO:tasks.workunit.client.0.smithi032.stdout:4/559: link d2/d16/d44/d54/d69/c72 d2/d16/d44/d54/cbd 0 2024-05-06T21:26:43.665 INFO:tasks.workunit.client.0.smithi032.stdout:4/560: symlink d2/d16/d44/d45/lbe 0 2024-05-06T21:26:43.667 INFO:tasks.workunit.client.0.smithi032.stdout:4/561: rename d2/d1e/d47/fa4 to d2/d16/d44/d45/fbf 0 2024-05-06T21:26:43.669 INFO:tasks.workunit.client.0.smithi032.stdout:4/562: mknod d2/d2c/d31/d7c/cc0 0 2024-05-06T21:26:43.671 INFO:tasks.workunit.client.0.smithi032.stdout:8/565: dread d0/d1b/d39/d3b/f62 [0,4194304] 0 2024-05-06T21:26:43.674 INFO:tasks.workunit.client.0.smithi032.stdout:8/566: truncate d0/f1f 184914 0 2024-05-06T21:26:43.676 INFO:tasks.workunit.client.0.smithi032.stdout:8/567: rmdir d0/d1c/d5e/d67 39 2024-05-06T21:26:43.677 INFO:tasks.workunit.client.1.smithi154.stdout:4/139: dwrite d0/d2/f1b [0,4194304] 0 2024-05-06T21:26:43.677 INFO:tasks.workunit.client.1.smithi154.stdout:4/140: chown d0/d2 5 1 2024-05-06T21:26:43.678 INFO:tasks.workunit.client.0.smithi032.stdout:8/568: mkdir d0/d1b/da8 0 2024-05-06T21:26:43.678 INFO:tasks.workunit.client.0.smithi032.stdout:8/569: stat d0/d1c/d5e/f7a 0 2024-05-06T21:26:43.679 INFO:tasks.workunit.client.0.smithi032.stdout:5/434: write d0/d24/d38/d37/f55 [1769210,69226] 0 2024-05-06T21:26:43.681 INFO:tasks.workunit.client.0.smithi032.stdout:8/570: unlink d0/f6 0 2024-05-06T21:26:43.685 INFO:tasks.workunit.client.0.smithi032.stdout:8/571: dread d0/d1b/f61 [0,4194304] 0 2024-05-06T21:26:43.685 INFO:tasks.workunit.client.0.smithi032.stdout:8/572: truncate d0/d1b/d39/d3b/d57/d5d/d63/f8e 2258156 0 2024-05-06T21:26:43.689 INFO:tasks.workunit.client.0.smithi032.stdout:9/532: dread d1/d13/f16 [0,4194304] 0 2024-05-06T21:26:43.689 INFO:tasks.workunit.client.0.smithi032.stdout:9/533: unlink d1/d13/d34/c73 0 2024-05-06T21:26:43.690 INFO:tasks.workunit.client.0.smithi032.stdout:9/534: write d1/d13/d34/d26/d39/d45/fa9 [452203,16905] 0 2024-05-06T21:26:43.690 INFO:tasks.workunit.client.0.smithi032.stdout:9/535: chown d1/d13/d33/d3f/l7c 41 1 2024-05-06T21:26:43.690 INFO:tasks.workunit.client.0.smithi032.stdout:2/419: dwrite df/d19/d1e/d71/d5f/d7d/f92 [0,4194304] 0 2024-05-06T21:26:43.690 INFO:tasks.workunit.client.0.smithi032.stdout:6/616: dwrite d8/d3d/d49/f60 [0,4194304] 0 2024-05-06T21:26:43.691 INFO:tasks.workunit.client.0.smithi032.stdout:9/536: symlink d1/d13/d25/da0/laf 0 2024-05-06T21:26:43.691 INFO:tasks.workunit.client.1.smithi154.stdout:8/168: dwrite d3/d14/d1a/d22/f23 [0,4194304] 0 2024-05-06T21:26:43.693 INFO:tasks.workunit.client.1.smithi154.stdout:5/161: dwrite d2/d3/fa [0,4194304] 0 2024-05-06T21:26:43.694 INFO:tasks.workunit.client.0.smithi032.stdout:8/573: dread d0/d1b/f5f [0,4194304] 0 2024-05-06T21:26:43.694 INFO:tasks.workunit.client.0.smithi032.stdout:8/574: stat d0/f37 0 2024-05-06T21:26:43.696 INFO:tasks.workunit.client.0.smithi032.stdout:6/617: mknod d8/dd/d18/d13/cbb 0 2024-05-06T21:26:43.696 INFO:tasks.workunit.client.0.smithi032.stdout:6/618: chown d8/f8c 1307624 1 2024-05-06T21:26:43.697 INFO:tasks.workunit.client.0.smithi032.stdout:0/460: dwrite d4/da/d16/d33/d46/f6e [0,4194304] 0 2024-05-06T21:26:43.702 INFO:tasks.workunit.client.1.smithi154.stdout:8/169: read d3/d14/f20 [1603064,51159] 0 2024-05-06T21:26:43.703 INFO:tasks.workunit.client.0.smithi032.stdout:4/563: dwrite f1 [8388608,4194304] 0 2024-05-06T21:26:43.704 INFO:tasks.workunit.client.0.smithi032.stdout:4/564: dread d2/d2c/d31/d7c/fa6 [0,4194304] 0 2024-05-06T21:26:43.706 INFO:tasks.workunit.client.0.smithi032.stdout:8/575: symlink d0/d1c/d5e/la9 0 2024-05-06T21:26:43.706 INFO:tasks.workunit.client.0.smithi032.stdout:8/576: readlink d0/d1b/d39/l43 0 2024-05-06T21:26:43.707 INFO:tasks.workunit.client.0.smithi032.stdout:5/435: dwrite d0/d24/d26/d3d/d50/f6e [0,4194304] 0 2024-05-06T21:26:43.709 INFO:tasks.workunit.client.0.smithi032.stdout:0/461: symlink d4/da/d16/l8e 0 2024-05-06T21:26:43.710 INFO:tasks.workunit.client.0.smithi032.stdout:4/565: truncate d2/f24 1784765 0 2024-05-06T21:26:43.711 INFO:tasks.workunit.client.0.smithi032.stdout:6/619: dread d8/dd/d18/f69 [0,4194304] 0 2024-05-06T21:26:43.712 INFO:tasks.workunit.client.1.smithi154.stdout:2/136: dwrite f0 [4194304,4194304] 0 2024-05-06T21:26:43.712 INFO:tasks.workunit.client.1.smithi154.stdout:2/137: readlink l7 0 2024-05-06T21:26:43.712 INFO:tasks.workunit.client.1.smithi154.stdout:2/138: creat db/d12/f2a x:0 0 0 2024-05-06T21:26:43.712 INFO:tasks.workunit.client.0.smithi032.stdout:8/577: rmdir d0/d1b/d39 39 2024-05-06T21:26:43.712 INFO:tasks.workunit.client.0.smithi032.stdout:8/578: read d0/d1b/f34 [673384,116612] 0 2024-05-06T21:26:43.712 INFO:tasks.workunit.client.0.smithi032.stdout:2/420: dwrite df/d19/d1e/d54/f97 [0,4194304] 0 2024-05-06T21:26:43.716 INFO:tasks.workunit.client.0.smithi032.stdout:5/436: mknod d0/d24/d38/c7f 0 2024-05-06T21:26:43.716 INFO:tasks.workunit.client.0.smithi032.stdout:5/437: fsync d0/d16/d2f/d77/f7c 0 2024-05-06T21:26:43.717 INFO:tasks.workunit.client.0.smithi032.stdout:4/566: truncate d2/d2c/d31/f91 3507557 0 2024-05-06T21:26:43.718 INFO:tasks.workunit.client.0.smithi032.stdout:8/579: write d0/d1c/f42 [1817186,58005] 0 2024-05-06T21:26:43.719 INFO:tasks.workunit.client.0.smithi032.stdout:2/421: mknod df/c9b 0 2024-05-06T21:26:43.721 INFO:tasks.workunit.client.0.smithi032.stdout:4/567: truncate d2/f18 2543196 0 2024-05-06T21:26:43.723 INFO:tasks.workunit.client.0.smithi032.stdout:8/580: rename d0/d1b/f3e to d0/d1b/d39/d3b/d57/d5d/faa 0 2024-05-06T21:26:43.723 INFO:tasks.workunit.client.0.smithi032.stdout:8/581: dread - d0/d1b/d39/d3b/d57/fa5 zero size 2024-05-06T21:26:43.724 INFO:tasks.workunit.client.0.smithi032.stdout:5/438: write d0/f12 [5943540,16225] 0 2024-05-06T21:26:43.724 INFO:tasks.workunit.client.0.smithi032.stdout:5/439: fdatasync d0/d16/d2f/d77/f7c 0 2024-05-06T21:26:43.725 INFO:tasks.workunit.client.0.smithi032.stdout:8/582: fsync d0/f1f 0 2024-05-06T21:26:43.726 INFO:tasks.workunit.client.0.smithi032.stdout:6/620: write d8/dd/d18/d3b/db9/f65 [981961,111303] 0 2024-05-06T21:26:43.726 INFO:tasks.workunit.client.0.smithi032.stdout:4/568: dread d2/d16/f5e [4194304,4194304] 0 2024-05-06T21:26:43.726 INFO:tasks.workunit.client.0.smithi032.stdout:4/569: chown d2/d13/f1b 15294 1 2024-05-06T21:26:43.727 INFO:tasks.workunit.client.1.smithi154.stdout:4/141: mknod d0/d2/dc/c2d 0 2024-05-06T21:26:43.727 INFO:tasks.workunit.client.1.smithi154.stdout:4/142: write d0/f22 [161417,7148] 0 2024-05-06T21:26:43.728 INFO:tasks.workunit.client.0.smithi032.stdout:4/570: write d2/d16/d44/d45/d4e/f6b [22552,88401] 0 2024-05-06T21:26:43.728 INFO:tasks.workunit.client.0.smithi032.stdout:5/440: mknod d0/d16/d46/d78/c80 0 2024-05-06T21:26:43.728 INFO:tasks.workunit.client.1.smithi154.stdout:6/90: sync 2024-05-06T21:26:43.733 INFO:tasks.workunit.client.0.smithi032.stdout:8/583: mkdir d0/d1c/d5e/d67/d7b/dab 0 2024-05-06T21:26:43.733 INFO:tasks.workunit.client.0.smithi032.stdout:8/584: creat d0/d1c/fac x:0 0 0 2024-05-06T21:26:43.733 INFO:tasks.workunit.client.0.smithi032.stdout:6/621: link d8/dd/d18/d13/f28 d8/dd/d18/d3b/d90/fbc 0 2024-05-06T21:26:43.733 INFO:tasks.workunit.client.0.smithi032.stdout:6/622: dread - d8/dd/d18/d13/fa7 zero size 2024-05-06T21:26:43.733 INFO:tasks.workunit.client.1.smithi154.stdout:5/162: symlink d2/d3/d19/d23/l3b 0 2024-05-06T21:26:43.733 INFO:tasks.workunit.client.1.smithi154.stdout:5/163: readlink d2/l24 0 2024-05-06T21:26:43.735 INFO:tasks.workunit.client.0.smithi032.stdout:8/585: dread d0/f33 [0,4194304] 0 2024-05-06T21:26:43.735 INFO:tasks.workunit.client.0.smithi032.stdout:2/422: dread df/d19/d1e/d71/d5f/d7d/d25/f60 [0,4194304] 0 2024-05-06T21:26:43.735 INFO:tasks.workunit.client.0.smithi032.stdout:8/586: dread - d0/d1b/d47/f83 zero size 2024-05-06T21:26:43.737 INFO:tasks.workunit.client.1.smithi154.stdout:9/225: rename d5/d14/f49 to d5/d20/d37/f50 0 2024-05-06T21:26:43.740 INFO:tasks.workunit.client.1.smithi154.stdout:2/139: dwrite db/de/d16/f1f [0,4194304] 0 2024-05-06T21:26:43.743 INFO:tasks.workunit.client.0.smithi032.stdout:6/623: mknod d8/d3d/d49/dad/cbd 0 2024-05-06T21:26:43.743 INFO:tasks.workunit.client.0.smithi032.stdout:6/624: chown d8/d3d/d49/l7c 232868687 1 2024-05-06T21:26:43.747 INFO:tasks.workunit.client.0.smithi032.stdout:2/423: link df/d19/d1e/d1f/d2e/d33/f9a df/d19/d1e/d71/d5f/d7d/f9c 0 2024-05-06T21:26:43.749 INFO:tasks.workunit.client.1.smithi154.stdout:5/164: link d2/d3/d19/f2b d2/d3/d19/f3c 0 2024-05-06T21:26:43.750 INFO:tasks.workunit.client.1.smithi154.stdout:5/165: write d2/d3/d21/d22/d25/f32 [686537,118468] 0 2024-05-06T21:26:43.750 INFO:tasks.workunit.client.1.smithi154.stdout:5/166: fsync d2/f34 0 2024-05-06T21:26:43.751 INFO:tasks.workunit.client.0.smithi032.stdout:8/587: unlink d0/d1b/d47/l52 0 2024-05-06T21:26:43.751 INFO:tasks.workunit.client.0.smithi032.stdout:8/588: fdatasync d0/d1b/d39/d3b/f5b 0 2024-05-06T21:26:43.751 INFO:tasks.workunit.client.0.smithi032.stdout:8/589: write d0/f1a [5598507,101716] 0 2024-05-06T21:26:43.752 INFO:tasks.workunit.client.1.smithi154.stdout:1/154: rename d6/c11 to d6/db/c2f 0 2024-05-06T21:26:43.755 INFO:tasks.workunit.client.0.smithi032.stdout:5/441: dwrite d0/d24/d38/f60 [0,4194304] 0 2024-05-06T21:26:43.755 INFO:tasks.workunit.client.0.smithi032.stdout:5/442: truncate d0/d28/f75 838449 0 2024-05-06T21:26:43.755 INFO:tasks.workunit.client.0.smithi032.stdout:8/590: dread d0/d1c/f42 [0,4194304] 0 2024-05-06T21:26:43.756 INFO:tasks.workunit.client.0.smithi032.stdout:4/571: dwrite d2/d16/f41 [0,4194304] 0 2024-05-06T21:26:43.756 INFO:tasks.workunit.client.0.smithi032.stdout:4/572: write d2/d2c/d31/d7c/fa6 [697574,87983] 0 2024-05-06T21:26:43.757 INFO:tasks.workunit.client.1.smithi154.stdout:5/167: rename d2/d6/dd/f20 to d2/d6/dd/d2a/f3d 0 2024-05-06T21:26:43.758 INFO:tasks.workunit.client.1.smithi154.stdout:5/168: truncate d2/d3/f35 914339 0 2024-05-06T21:26:43.761 INFO:tasks.workunit.client.1.smithi154.stdout:6/91: dread f2 [0,4194304] 0 2024-05-06T21:26:43.761 INFO:tasks.workunit.client.1.smithi154.stdout:5/169: rmdir d2/d3/d21/d22/d25/d27 39 2024-05-06T21:26:43.761 INFO:tasks.workunit.client.1.smithi154.stdout:5/170: dread - d2/f34 zero size 2024-05-06T21:26:43.764 INFO:tasks.workunit.client.1.smithi154.stdout:5/171: mknod d2/d3/d21/c3e 0 2024-05-06T21:26:43.764 INFO:tasks.workunit.client.1.smithi154.stdout:5/172: chown d2/d3/d19/d23/f33 2 1 2024-05-06T21:26:43.764 INFO:tasks.workunit.client.1.smithi154.stdout:5/173: chown d2/d3/d21/d22/d25/f32 177 1 2024-05-06T21:26:43.765 INFO:tasks.workunit.client.1.smithi154.stdout:6/92: rmdir d8/d11 39 2024-05-06T21:26:43.767 INFO:tasks.workunit.client.1.smithi154.stdout:6/93: mknod d8/d13/c25 0 2024-05-06T21:26:43.767 INFO:tasks.workunit.client.1.smithi154.stdout:6/94: write d8/f10 [544918,130917] 0 2024-05-06T21:26:43.768 INFO:tasks.workunit.client.1.smithi154.stdout:6/95: fdatasync f1 0 2024-05-06T21:26:43.769 INFO:tasks.workunit.client.1.smithi154.stdout:5/174: truncate d2/d3/fa 1027278 0 2024-05-06T21:26:43.772 INFO:tasks.workunit.client.1.smithi154.stdout:5/175: dread d2/d3/f35 [0,4194304] 0 2024-05-06T21:26:43.795 INFO:tasks.workunit.client.0.smithi032.stdout:5/443: rmdir d0/d16/d2a/d5f 39 2024-05-06T21:26:43.796 INFO:tasks.workunit.client.1.smithi154.stdout:1/155: dwrite d6/db/d10/d26/f25 [0,4194304] 0 2024-05-06T21:26:43.796 INFO:tasks.workunit.client.1.smithi154.stdout:1/156: fdatasync d6/db/d10/d15/f20 0 2024-05-06T21:26:43.796 INFO:tasks.workunit.client.1.smithi154.stdout:5/176: dwrite d2/d6/fe [4194304,4194304] 0 2024-05-06T21:26:43.796 INFO:tasks.workunit.client.1.smithi154.stdout:1/157: fsync d6/f24 0 2024-05-06T21:26:43.797 INFO:tasks.workunit.client.1.smithi154.stdout:4/143: dwrite d0/d2/fb [0,4194304] 0 2024-05-06T21:26:43.797 INFO:tasks.workunit.client.1.smithi154.stdout:4/144: chown d0/d2/d2a 31037 1 2024-05-06T21:26:43.797 INFO:tasks.workunit.client.0.smithi032.stdout:2/424: dwrite df/d19/d1e/d1f/d2e/f94 [0,4194304] 0 2024-05-06T21:26:43.798 INFO:tasks.workunit.client.0.smithi032.stdout:6/625: dwrite d8/dd/d18/f19 [0,4194304] 0 2024-05-06T21:26:43.798 INFO:tasks.workunit.client.0.smithi032.stdout:8/591: creat d0/d1c/d5e/d67/d9d/fad x:0 0 0 2024-05-06T21:26:43.798 INFO:tasks.workunit.client.0.smithi032.stdout:8/592: write d0/f5 [1114041,22282] 0 2024-05-06T21:26:43.798 INFO:tasks.workunit.client.0.smithi032.stdout:8/593: dread - d0/d1b/d39/d3b/d57/d5d/d63/d85/f8c zero size 2024-05-06T21:26:43.798 INFO:tasks.workunit.client.0.smithi032.stdout:8/594: creat d0/d1c/fae x:0 0 0 2024-05-06T21:26:43.799 INFO:tasks.workunit.client.1.smithi154.stdout:9/226: mkdir d5/d14/d51 0 2024-05-06T21:26:43.799 INFO:tasks.workunit.client.1.smithi154.stdout:7/71: sync 2024-05-06T21:26:43.799 INFO:tasks.workunit.client.1.smithi154.stdout:7/72: chown d6/fb 546896 1 2024-05-06T21:26:43.800 INFO:tasks.workunit.client.0.smithi032.stdout:4/573: mkdir d2/d16/d44/d45/dc1 0 2024-05-06T21:26:43.800 INFO:tasks.workunit.client.0.smithi032.stdout:4/574: chown d2/d13/f1b 0 1 2024-05-06T21:26:43.800 INFO:tasks.workunit.client.0.smithi032.stdout:4/575: chown d2/d13/c82 76 1 2024-05-06T21:26:43.800 INFO:tasks.workunit.client.0.smithi032.stdout:4/576: write d2/d1e/f22 [1358873,122802] 0 2024-05-06T21:26:43.801 INFO:tasks.workunit.client.1.smithi154.stdout:0/117: sync 2024-05-06T21:26:43.801 INFO:tasks.workunit.client.1.smithi154.stdout:3/174: sync 2024-05-06T21:26:43.801 INFO:tasks.workunit.client.1.smithi154.stdout:0/118: chown d6/l1f 0 1 2024-05-06T21:26:43.805 INFO:tasks.workunit.client.1.smithi154.stdout:4/145: creat d0/f2e x:0 0 0 2024-05-06T21:26:43.807 INFO:tasks.workunit.client.1.smithi154.stdout:9/227: truncate d5/d14/d31/f3d 371286 0 2024-05-06T21:26:43.808 INFO:tasks.workunit.client.0.smithi032.stdout:8/595: dread d0/d1b/d47/f54 [0,4194304] 0 2024-05-06T21:26:43.809 INFO:tasks.workunit.client.1.smithi154.stdout:3/175: mkdir d0/da/db/dd/d1c/d21/d37 0 2024-05-06T21:26:43.809 INFO:tasks.workunit.client.1.smithi154.stdout:3/176: write d0/fe [45330,43187] 0 2024-05-06T21:26:43.811 INFO:tasks.workunit.client.1.smithi154.stdout:0/119: symlink d6/d10/l22 0 2024-05-06T21:26:43.812 INFO:tasks.workunit.client.0.smithi032.stdout:2/425: unlink df/d19/d1e/d71/d5f/d7d/l89 0 2024-05-06T21:26:43.812 INFO:tasks.workunit.client.0.smithi032.stdout:2/426: write df/d19/d1e/d35/f3d [1708751,50136] 0 2024-05-06T21:26:43.812 INFO:tasks.workunit.client.1.smithi154.stdout:4/146: truncate d0/d10/d11/d1a/f1d 7893297 0 2024-05-06T21:26:43.812 INFO:tasks.workunit.client.1.smithi154.stdout:4/147: creat d0/d2/f2f x:0 0 0 2024-05-06T21:26:43.813 INFO:tasks.workunit.client.1.smithi154.stdout:4/148: truncate d0/d2/f2f 1011111 0 2024-05-06T21:26:43.813 INFO:tasks.workunit.client.0.smithi032.stdout:4/577: dread d2/d16/f41 [0,4194304] 0 2024-05-06T21:26:43.813 INFO:tasks.workunit.client.0.smithi032.stdout:4/578: chown d2/d16/d44/d45/d4e/f6b 240 1 2024-05-06T21:26:43.815 INFO:tasks.workunit.client.1.smithi154.stdout:9/228: rename d5/d14/d1e to d5/d20/d52 0 2024-05-06T21:26:43.817 INFO:tasks.workunit.client.0.smithi032.stdout:6/626: mknod d8/d3d/d49/cbe 0 2024-05-06T21:26:43.817 INFO:tasks.workunit.client.0.smithi032.stdout:6/627: truncate d8/dd/d18/d13/fa5 1111896 0 2024-05-06T21:26:43.817 INFO:tasks.workunit.client.0.smithi032.stdout:6/628: fsync d8/dd/d18/d13/fa7 0 2024-05-06T21:26:43.818 INFO:tasks.workunit.client.1.smithi154.stdout:3/177: mkdir d0/da/d1a/d28/d2f/d38 0 2024-05-06T21:26:43.818 INFO:tasks.workunit.client.1.smithi154.stdout:3/178: chown d0/da/db/dd/d1c 1675 1 2024-05-06T21:26:43.818 INFO:tasks.workunit.client.1.smithi154.stdout:3/179: fdatasync d0/da/d1a/d28/d17/f1e 0 2024-05-06T21:26:43.819 INFO:tasks.workunit.client.0.smithi032.stdout:4/579: dread d2/fc [0,4194304] 0 2024-05-06T21:26:43.822 INFO:tasks.workunit.client.0.smithi032.stdout:8/596: link d0/d1c/d5e/d67/d7b/l9f d0/d1b/d39/d3b/d57/d5d/d63/laf 0 2024-05-06T21:26:43.823 INFO:tasks.workunit.client.1.smithi154.stdout:0/120: rename d6 to d6/d23 22 2024-05-06T21:26:43.823 INFO:tasks.workunit.client.1.smithi154.stdout:9/229: unlink l3 0 2024-05-06T21:26:43.823 INFO:tasks.workunit.client.1.smithi154.stdout:3/180: link d0/d2/d22/c33 d0/d2/c39 0 2024-05-06T21:26:43.824 INFO:tasks.workunit.client.0.smithi032.stdout:2/427: creat df/d19/d1e/d71/d5f/d7d/d25/f9d x:0 0 0 2024-05-06T21:26:43.824 INFO:tasks.workunit.client.0.smithi032.stdout:2/428: chown df/d19/d1e/d71/d5f/d7d/l40 7338 1 2024-05-06T21:26:43.826 INFO:tasks.workunit.client.0.smithi032.stdout:6/629: getdents d8/dd/d18/d22 0 2024-05-06T21:26:43.826 INFO:tasks.workunit.client.1.smithi154.stdout:0/121: rename d6/dc/fd to d6/dc/f24 0 2024-05-06T21:26:43.827 INFO:tasks.workunit.client.1.smithi154.stdout:9/230: mknod d5/d2e/c53 0 2024-05-06T21:26:43.827 INFO:tasks.workunit.client.1.smithi154.stdout:9/231: chown d5/d20/d37 1 1 2024-05-06T21:26:43.827 INFO:tasks.workunit.client.1.smithi154.stdout:9/232: chown d5/d20/d37/f50 55 1 2024-05-06T21:26:43.827 INFO:tasks.workunit.client.0.smithi032.stdout:4/580: mkdir d2/d13/daa/dc2 0 2024-05-06T21:26:43.828 INFO:tasks.workunit.client.1.smithi154.stdout:1/158: dwrite d6/f8 [0,4194304] 0 2024-05-06T21:26:43.828 INFO:tasks.workunit.client.1.smithi154.stdout:1/159: chown d6/db/d10/d15/l2e 8118953 1 2024-05-06T21:26:43.829 INFO:tasks.workunit.client.1.smithi154.stdout:3/181: symlink d0/da/d1a/d28/d2f/d38/l3a 0 2024-05-06T21:26:43.829 INFO:tasks.workunit.client.1.smithi154.stdout:3/182: truncate d0/f32 474774 0 2024-05-06T21:26:43.829 INFO:tasks.workunit.client.0.smithi032.stdout:8/597: truncate d0/d1b/f23 5145253 0 2024-05-06T21:26:43.829 INFO:tasks.workunit.client.1.smithi154.stdout:9/233: creat d5/d14/f54 x:0 0 0 2024-05-06T21:26:43.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/183: symlink d0/da/d1a/d28/d17/l3b 0 2024-05-06T21:26:43.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/184: truncate d0/da/d1a/d28/d2f/f34 425164 0 2024-05-06T21:26:43.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/185: write d0/f32 [1235886,12992] 0 2024-05-06T21:26:43.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/186: creat d0/da/db/dd/f3c x:0 0 0 2024-05-06T21:26:43.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/187: write d0/da/db/f10 [3716676,31779] 0 2024-05-06T21:26:43.832 INFO:tasks.workunit.client.0.smithi032.stdout:2/429: rename df/d19/d1e/f28 to df/d19/d1e/d1f/d2e/f9e 0 2024-05-06T21:26:43.833 INFO:tasks.workunit.client.0.smithi032.stdout:4/581: mknod d2/d16/d44/d54/cc3 0 2024-05-06T21:26:43.833 INFO:tasks.workunit.client.0.smithi032.stdout:6/630: dread d8/dd/d18/f69 [0,4194304] 0 2024-05-06T21:26:43.833 INFO:tasks.workunit.client.0.smithi032.stdout:6/631: chown d8/d3d/d73/d87/c42 510119316 1 2024-05-06T21:26:43.833 INFO:tasks.workunit.client.0.smithi032.stdout:6/632: chown d8/dd/d18/d13/d1d/fa1 5 1 2024-05-06T21:26:43.833 INFO:tasks.workunit.client.0.smithi032.stdout:6/633: write d8/dd/d18/d3b/db9/f9e [88878,114278] 0 2024-05-06T21:26:43.834 INFO:tasks.workunit.client.0.smithi032.stdout:8/598: symlink d0/d1c/d5e/d67/d9d/lb0 0 2024-05-06T21:26:43.834 INFO:tasks.workunit.client.1.smithi154.stdout:9/234: dread d5/d14/f30 [0,4194304] 0 2024-05-06T21:26:43.834 INFO:tasks.workunit.client.1.smithi154.stdout:9/235: write d5/d20/d52/f4f [1303670,5263] 0 2024-05-06T21:26:43.835 INFO:tasks.workunit.client.0.smithi032.stdout:4/582: dread d2/d16/d44/d45/f6e [0,4194304] 0 2024-05-06T21:26:43.836 INFO:tasks.workunit.client.1.smithi154.stdout:9/236: dread d5/d14/f30 [0,4194304] 0 2024-05-06T21:26:43.837 INFO:tasks.workunit.client.0.smithi032.stdout:8/599: rename d0/f1f to d0/d1b/d39/d3b/d57/d5d/d63/d7f/fb1 0 2024-05-06T21:26:43.837 INFO:tasks.workunit.client.0.smithi032.stdout:8/600: fsync d0/d1b/d39/f96 0 2024-05-06T21:26:43.837 INFO:tasks.workunit.client.0.smithi032.stdout:4/583: mknod d2/d16/d44/d45/dc1/cc4 0 2024-05-06T21:26:43.837 INFO:tasks.workunit.client.0.smithi032.stdout:4/584: chown d2 7 1 2024-05-06T21:26:43.838 INFO:tasks.workunit.client.1.smithi154.stdout:9/237: creat d5/d2e/f55 x:0 0 0 2024-05-06T21:26:43.838 INFO:tasks.workunit.client.1.smithi154.stdout:9/238: read d5/d20/d37/f50 [87205,16703] 0 2024-05-06T21:26:43.839 INFO:tasks.workunit.client.0.smithi032.stdout:8/601: creat d0/d1c/d5e/d67/d7b/fb2 x:0 0 0 2024-05-06T21:26:43.840 INFO:tasks.workunit.client.0.smithi032.stdout:8/602: stat d0/d1c/d5e/f7a 0 2024-05-06T21:26:43.840 INFO:tasks.workunit.client.0.smithi032.stdout:6/634: dread d8/f17 [8388608,4194304] 0 2024-05-06T21:26:43.840 INFO:tasks.workunit.client.0.smithi032.stdout:6/635: write d8/d3d/d73/d87/fb3 [41109,67347] 0 2024-05-06T21:26:43.841 INFO:tasks.workunit.client.0.smithi032.stdout:4/585: link d2/c20 d2/d16/d44/d54/cc5 0 2024-05-06T21:26:43.842 INFO:tasks.workunit.client.1.smithi154.stdout:9/239: rename d5/d14/d51 to d5/d2e/d56 0 2024-05-06T21:26:43.843 INFO:tasks.workunit.client.1.smithi154.stdout:0/122: dread d6/dc/f16 [0,4194304] 0 2024-05-06T21:26:43.843 INFO:tasks.workunit.client.0.smithi032.stdout:5/444: dwrite d0/d24/d26/d3d/d50/f65 [0,4194304] 0 2024-05-06T21:26:43.843 INFO:tasks.workunit.client.0.smithi032.stdout:2/430: dread df/d19/d1e/f48 [0,4194304] 0 2024-05-06T21:26:43.844 INFO:tasks.workunit.client.1.smithi154.stdout:6/96: dwrite d8/f10 [0,4194304] 0 2024-05-06T21:26:43.844 INFO:tasks.workunit.client.1.smithi154.stdout:1/160: read d6/db/d10/d15/f20 [4992945,74514] 0 2024-05-06T21:26:43.844 INFO:tasks.workunit.client.1.smithi154.stdout:7/73: dwrite d6/fd [0,4194304] 0 2024-05-06T21:26:43.845 INFO:tasks.workunit.client.1.smithi154.stdout:9/240: fdatasync d5/d14/f1c 0 2024-05-06T21:26:43.845 INFO:tasks.workunit.client.1.smithi154.stdout:5/177: dwrite d2/d6/f7 [0,4194304] 0 2024-05-06T21:26:43.845 INFO:tasks.workunit.client.1.smithi154.stdout:5/178: fsync d2/d3/d21/d22/f2e 0 2024-05-06T21:26:43.845 INFO:tasks.workunit.client.1.smithi154.stdout:5/179: chown d2/d3/d19/d23/c39 1867 1 2024-05-06T21:26:43.846 INFO:tasks.workunit.client.0.smithi032.stdout:8/603: truncate d0/d1b/d39/d3b/d97/f98 2813835 0 2024-05-06T21:26:43.851 INFO:tasks.workunit.client.1.smithi154.stdout:0/123: rename f2 to d6/d10/f25 0 2024-05-06T21:26:43.860 INFO:tasks.workunit.client.0.smithi032.stdout:5/445: symlink d0/d24/d34/l81 0 2024-05-06T21:26:43.862 INFO:tasks.workunit.client.0.smithi032.stdout:2/431: mkdir df/d19/d1e/d1f/d9f 0 2024-05-06T21:26:43.862 INFO:tasks.workunit.client.0.smithi032.stdout:2/432: readlink df/d19/d1e/d71/d5f/d7d/d25/l4d 0 2024-05-06T21:26:43.862 INFO:tasks.workunit.client.1.smithi154.stdout:6/97: mknod d8/d13/c26 0 2024-05-06T21:26:43.863 INFO:tasks.workunit.client.1.smithi154.stdout:6/98: readlink d8/l18 0 2024-05-06T21:26:43.864 INFO:tasks.workunit.client.1.smithi154.stdout:1/161: dread d6/db/d10/d26/f25 [0,4194304] 0 2024-05-06T21:26:43.864 INFO:tasks.workunit.client.1.smithi154.stdout:1/162: creat d6/f30 x:0 0 0 2024-05-06T21:26:43.866 INFO:tasks.workunit.client.0.smithi032.stdout:6/636: dread d8/f8c [0,4194304] 0 2024-05-06T21:26:43.866 INFO:tasks.workunit.client.1.smithi154.stdout:7/74: rename c3 to d6/d14/c18 0 2024-05-06T21:26:43.866 INFO:tasks.workunit.client.1.smithi154.stdout:7/75: creat d6/de/f19 x:0 0 0 2024-05-06T21:26:43.868 INFO:tasks.workunit.client.1.smithi154.stdout:0/124: symlink d6/d10/l26 0 2024-05-06T21:26:43.868 INFO:tasks.workunit.client.1.smithi154.stdout:0/125: chown d6/d10/f21 98119 1 2024-05-06T21:26:43.868 INFO:tasks.workunit.client.1.smithi154.stdout:0/126: chown d6/d10/f20 1051 1 2024-05-06T21:26:43.869 INFO:tasks.workunit.client.1.smithi154.stdout:1/163: mknod d6/db/d10/d26/c31 0 2024-05-06T21:26:43.870 INFO:tasks.workunit.client.0.smithi032.stdout:5/446: getdents d0/d4e 0 2024-05-06T21:26:43.874 INFO:tasks.workunit.client.1.smithi154.stdout:9/241: rename d5/d14/d31/f3d to d5/d20/d52/f57 0 2024-05-06T21:26:43.875 INFO:tasks.workunit.client.1.smithi154.stdout:9/242: write d5/f28 [984650,44353] 0 2024-05-06T21:26:43.875 INFO:tasks.workunit.client.0.smithi032.stdout:5/447: link d0/d24/d34/l81 d0/d16/l82 0 2024-05-06T21:26:43.876 INFO:tasks.workunit.client.1.smithi154.stdout:9/243: truncate d5/f1a 104737 0 2024-05-06T21:26:43.876 INFO:tasks.workunit.client.1.smithi154.stdout:9/244: truncate d5/fe 4470824 0 2024-05-06T21:26:43.878 INFO:tasks.workunit.client.0.smithi032.stdout:5/448: unlink d0/ld 0 2024-05-06T21:26:43.878 INFO:tasks.workunit.client.1.smithi154.stdout:0/127: mkdir d6/d27 0 2024-05-06T21:26:43.878 INFO:tasks.workunit.client.1.smithi154.stdout:9/245: chown d5/l1f 3247 1 2024-05-06T21:26:43.880 INFO:tasks.workunit.client.0.smithi032.stdout:5/449: stat d0/d16/d2a/d5f/c62 0 2024-05-06T21:26:43.881 INFO:tasks.workunit.client.1.smithi154.stdout:0/128: creat d6/d27/f28 x:0 0 0 2024-05-06T21:26:43.881 INFO:tasks.workunit.client.1.smithi154.stdout:0/129: creat d6/d10/f29 x:0 0 0 2024-05-06T21:26:43.883 INFO:tasks.workunit.client.1.smithi154.stdout:0/130: readlink d6/l18 0 2024-05-06T21:26:43.883 INFO:tasks.workunit.client.1.smithi154.stdout:0/131: rename d6/d27 to d6/d27/d2a 22 2024-05-06T21:26:43.885 INFO:tasks.workunit.client.1.smithi154.stdout:9/246: link d5/d20/l42 d5/d14/l58 0 2024-05-06T21:26:43.886 INFO:tasks.workunit.client.1.smithi154.stdout:0/132: truncate d6/dc/f16 937832 0 2024-05-06T21:26:43.886 INFO:tasks.workunit.client.0.smithi032.stdout:2/433: dread df/d19/d1e/d71/d5f/d7d/d65/f85 [0,4194304] 0 2024-05-06T21:26:43.888 INFO:tasks.workunit.client.1.smithi154.stdout:0/133: mknod d6/dc/c2b 0 2024-05-06T21:26:43.888 INFO:tasks.workunit.client.1.smithi154.stdout:0/134: creat d6/d10/f2c x:0 0 0 2024-05-06T21:26:43.888 INFO:tasks.workunit.client.1.smithi154.stdout:0/135: read d6/d10/f25 [97045,48146] 0 2024-05-06T21:26:43.890 INFO:tasks.workunit.client.0.smithi032.stdout:2/434: creat df/d19/d1e/d35/fa0 x:0 0 0 2024-05-06T21:26:43.890 INFO:tasks.workunit.client.1.smithi154.stdout:3/188: dwrite d0/da/d1a/d28/d2f/f34 [0,4194304] 0 2024-05-06T21:26:43.893 INFO:tasks.workunit.client.0.smithi032.stdout:5/450: write d0/d24/d38/f60 [3783431,114337] 0 2024-05-06T21:26:43.894 INFO:tasks.workunit.client.0.smithi032.stdout:5/451: mknod d0/d24/d26/d32/c83 0 2024-05-06T21:26:43.894 INFO:tasks.workunit.client.0.smithi032.stdout:5/452: chown d0/d28/l2d 869 1 2024-05-06T21:26:43.894 INFO:tasks.workunit.client.0.smithi032.stdout:5/453: write d0/fe [8440615,64628] 0 2024-05-06T21:26:43.894 INFO:tasks.workunit.client.1.smithi154.stdout:3/189: rmdir d0/da/db/dd/d1c/d21/d2e 0 2024-05-06T21:26:43.896 INFO:tasks.workunit.client.0.smithi032.stdout:2/435: getdents df/d19/d1e/d54 0 2024-05-06T21:26:43.896 INFO:tasks.workunit.client.0.smithi032.stdout:2/436: dread - df/d19/d1e/d71/d5f/f93 zero size 2024-05-06T21:26:43.897 INFO:tasks.workunit.client.1.smithi154.stdout:3/190: creat d0/da/db/d30/f3d x:0 0 0 2024-05-06T21:26:43.897 INFO:tasks.workunit.client.1.smithi154.stdout:3/191: dread - d0/da/db/d30/f3d zero size 2024-05-06T21:26:43.900 INFO:tasks.workunit.client.0.smithi032.stdout:6/637: read d8/f2b [2916177,61069] 0 2024-05-06T21:26:43.905 INFO:tasks.workunit.client.0.smithi032.stdout:6/638: dread d8/d3d/d73/d87/f64 [0,4194304] 0 2024-05-06T21:26:43.906 INFO:tasks.workunit.client.0.smithi032.stdout:6/639: mknod d8/dd/d1b/d35/cbf 0 2024-05-06T21:26:43.906 INFO:tasks.workunit.client.0.smithi032.stdout:6/640: readlink d8/dd/la0 0 2024-05-06T21:26:43.911 INFO:tasks.workunit.client.1.smithi154.stdout:5/180: dwrite d2/d6/f13 [0,4194304] 0 2024-05-06T21:26:43.911 INFO:tasks.workunit.client.1.smithi154.stdout:3/192: dread d0/f3 [0,4194304] 0 2024-05-06T21:26:43.913 INFO:tasks.workunit.client.0.smithi032.stdout:4/586: dwrite d2/f53 [0,4194304] 0 2024-05-06T21:26:43.913 INFO:tasks.workunit.client.0.smithi032.stdout:4/587: creat d2/d16/d44/d74/d79/fc6 x:0 0 0 2024-05-06T21:26:43.913 INFO:tasks.workunit.client.0.smithi032.stdout:4/588: fdatasync d2/f35 0 2024-05-06T21:26:43.913 INFO:tasks.workunit.client.0.smithi032.stdout:4/589: chown d2/c4 401 1 2024-05-06T21:26:43.913 INFO:tasks.workunit.client.0.smithi032.stdout:4/590: fdatasync d2/fc 0 2024-05-06T21:26:43.916 INFO:tasks.workunit.client.1.smithi154.stdout:3/193: symlink d0/da/db/dd/d1c/d21/l3e 0 2024-05-06T21:26:43.917 INFO:tasks.workunit.client.0.smithi032.stdout:4/591: getdents d2/d16/d44/d74 0 2024-05-06T21:26:43.918 INFO:tasks.workunit.client.0.smithi032.stdout:7/551: sync 2024-05-06T21:26:43.918 INFO:tasks.workunit.client.1.smithi154.stdout:3/194: rename d0/da/db/dd/d1c/l27 to d0/da/l3f 0 2024-05-06T21:26:43.919 INFO:tasks.workunit.client.1.smithi154.stdout:3/195: getdents d0/da/db/dd/d1c/d21/d37 0 2024-05-06T21:26:43.919 INFO:tasks.workunit.client.0.smithi032.stdout:7/552: mkdir db/d12/d16/d2a/d39/d3b/dac 0 2024-05-06T21:26:43.920 INFO:tasks.workunit.client.1.smithi154.stdout:3/196: mkdir d0/d2/d40 0 2024-05-06T21:26:43.920 INFO:tasks.workunit.client.1.smithi154.stdout:3/197: chown d0/da/db/dd/d1c/f35 316 1 2024-05-06T21:26:43.920 INFO:tasks.workunit.client.0.smithi032.stdout:7/553: creat db/d89/daa/fad x:0 0 0 2024-05-06T21:26:43.921 INFO:tasks.workunit.client.1.smithi154.stdout:3/198: unlink d0/da/d1a/d28/f2d 0 2024-05-06T21:26:43.926 INFO:tasks.workunit.client.1.smithi154.stdout:1/164: dwrite d6/f17 [4194304,4194304] 0 2024-05-06T21:26:43.926 INFO:tasks.workunit.client.1.smithi154.stdout:1/165: getdents d6/db/d10/d26/d1b 0 2024-05-06T21:26:43.927 INFO:tasks.workunit.client.0.smithi032.stdout:8/604: dwrite d0/d1b/d39/d3b/d57/d5d/d63/d85/f8c [0,4194304] 0 2024-05-06T21:26:43.928 INFO:tasks.workunit.client.1.smithi154.stdout:0/136: dwrite d6/d10/f11 [0,4194304] 0 2024-05-06T21:26:43.928 INFO:tasks.workunit.client.1.smithi154.stdout:0/137: creat d6/dc/f2d x:0 0 0 2024-05-06T21:26:43.928 INFO:tasks.workunit.client.1.smithi154.stdout:0/138: chown d6/dc/c1b 29050475 1 2024-05-06T21:26:43.928 INFO:tasks.workunit.client.1.smithi154.stdout:0/139: stat d6/d10/f25 0 2024-05-06T21:26:43.928 INFO:tasks.workunit.client.1.smithi154.stdout:9/247: dwrite d5/d14/f1c [0,4194304] 0 2024-05-06T21:26:43.928 INFO:tasks.workunit.client.0.smithi032.stdout:2/437: dwrite df/d19/d1e/d35/d3f/d46/f4f [4194304,4194304] 0 2024-05-06T21:26:43.929 INFO:tasks.workunit.client.1.smithi154.stdout:6/99: dwrite d8/d11/f1d [0,4194304] 0 2024-05-06T21:26:43.932 INFO:tasks.workunit.client.1.smithi154.stdout:1/166: symlink d6/l32 0 2024-05-06T21:26:43.933 INFO:tasks.workunit.client.1.smithi154.stdout:1/167: dread d6/f28 [0,4194304] 0 2024-05-06T21:26:43.934 INFO:tasks.workunit.client.0.smithi032.stdout:7/554: dread db/d12/d16/d21/f44 [8388608,4194304] 0 2024-05-06T21:26:43.934 INFO:tasks.workunit.client.0.smithi032.stdout:7/555: stat db/d12/f85 0 2024-05-06T21:26:43.934 INFO:tasks.workunit.client.0.smithi032.stdout:7/556: fsync db/d12/d49/d97/f9f 0 2024-05-06T21:26:43.934 INFO:tasks.workunit.client.0.smithi032.stdout:4/592: dread d2/d16/d44/d45/d4e/f90 [0,4194304] 0 2024-05-06T21:26:43.934 INFO:tasks.workunit.client.0.smithi032.stdout:8/605: creat d0/d1b/d39/d93/fb3 x:0 0 0 2024-05-06T21:26:43.942 INFO:tasks.workunit.client.0.smithi032.stdout:7/557: rename db/d12/c7e to db/d12/d49/cae 0 2024-05-06T21:26:43.943 INFO:tasks.workunit.client.0.smithi032.stdout:7/558: dread - db/d12/f79 zero size 2024-05-06T21:26:43.943 INFO:tasks.workunit.client.1.smithi154.stdout:3/199: dwrite d0/da/d1a/d28/d17/f1e [4194304,4194304] 0 2024-05-06T21:26:43.943 INFO:tasks.workunit.client.1.smithi154.stdout:3/200: readlink d0/l31 0 2024-05-06T21:26:43.943 INFO:tasks.workunit.client.1.smithi154.stdout:8/170: sync 2024-05-06T21:26:43.944 INFO:tasks.workunit.client.0.smithi032.stdout:8/606: creat d0/d1c/d5e/d67/fb4 x:0 0 0 2024-05-06T21:26:43.944 INFO:tasks.workunit.client.0.smithi032.stdout:8/607: chown d0/d1b/f23 5573 1 2024-05-06T21:26:43.945 INFO:tasks.workunit.client.0.smithi032.stdout:2/438: rmdir df/d19/d1e/d1f/d2e 39 2024-05-06T21:26:43.946 INFO:tasks.workunit.client.1.smithi154.stdout:9/248: mkdir d5/d20/d52/d59 0 2024-05-06T21:26:43.946 INFO:tasks.workunit.client.1.smithi154.stdout:9/249: dread d5/d14/d31/d39/f3c [0,4194304] 0 2024-05-06T21:26:43.948 INFO:tasks.workunit.client.1.smithi154.stdout:1/168: creat d6/db/d10/f33 x:0 0 0 2024-05-06T21:26:43.950 INFO:tasks.workunit.client.1.smithi154.stdout:0/140: rename d6/f1c to d6/dc/f2e 0 2024-05-06T21:26:43.950 INFO:tasks.workunit.client.1.smithi154.stdout:0/141: write d6/dc/f24 [467194,120692] 0 2024-05-06T21:26:43.950 INFO:tasks.workunit.client.1.smithi154.stdout:0/142: chown d6/d10/f2c 494777768 1 2024-05-06T21:26:43.950 INFO:tasks.workunit.client.1.smithi154.stdout:0/143: dread - d6/d10/f29 zero size 2024-05-06T21:26:43.950 INFO:tasks.workunit.client.1.smithi154.stdout:0/144: truncate d6/dc/f2d 263870 0 2024-05-06T21:26:43.950 INFO:tasks.workunit.client.1.smithi154.stdout:0/145: write d6/d10/f2c [355357,3309] 0 2024-05-06T21:26:43.951 INFO:tasks.workunit.client.1.smithi154.stdout:0/146: readlink d6/l18 0 2024-05-06T21:26:43.951 INFO:tasks.workunit.client.1.smithi154.stdout:0/147: creat d6/dc/f2f x:0 0 0 2024-05-06T21:26:43.951 INFO:tasks.workunit.client.1.smithi154.stdout:0/148: truncate d6/d10/f29 54291 0 2024-05-06T21:26:43.951 INFO:tasks.workunit.client.0.smithi032.stdout:8/608: mkdir d0/d1b/d39/d3b/db5 0 2024-05-06T21:26:43.952 INFO:tasks.workunit.client.1.smithi154.stdout:3/201: mkdir d0/da/db/dd/d1c/d41 0 2024-05-06T21:26:43.953 INFO:tasks.workunit.client.0.smithi032.stdout:8/609: unlink d0/l17 0 2024-05-06T21:26:43.953 INFO:tasks.workunit.client.0.smithi032.stdout:8/610: creat d0/d1c/d5e/d67/d9d/fb6 x:0 0 0 2024-05-06T21:26:43.953 INFO:tasks.workunit.client.0.smithi032.stdout:8/611: readlink d0/d1c/l21 0 2024-05-06T21:26:43.953 INFO:tasks.workunit.client.0.smithi032.stdout:1/453: sync 2024-05-06T21:26:43.953 INFO:tasks.workunit.client.0.smithi032.stdout:3/562: sync 2024-05-06T21:26:43.955 INFO:tasks.workunit.client.0.smithi032.stdout:8/612: rmdir d0/d1b/d39/d3b/d57/d5d/d63 39 2024-05-06T21:26:43.955 INFO:tasks.workunit.client.0.smithi032.stdout:8/613: truncate d0/f33 1358073 0 2024-05-06T21:26:43.956 INFO:tasks.workunit.client.1.smithi154.stdout:8/171: creat d3/d38/f39 x:0 0 0 2024-05-06T21:26:43.957 INFO:tasks.workunit.client.0.smithi032.stdout:5/454: dwrite d0/fe [4194304,4194304] 0 2024-05-06T21:26:43.957 INFO:tasks.workunit.client.1.smithi154.stdout:6/100: rmdir d8 39 2024-05-06T21:26:43.958 INFO:tasks.workunit.client.1.smithi154.stdout:6/101: dread - d8/d11/f1a zero size 2024-05-06T21:26:43.958 INFO:tasks.workunit.client.0.smithi032.stdout:8/614: symlink d0/d1b/d39/lb7 0 2024-05-06T21:26:43.959 INFO:tasks.workunit.client.1.smithi154.stdout:9/250: mknod d5/d14/d31/c5a 0 2024-05-06T21:26:43.959 INFO:tasks.workunit.client.1.smithi154.stdout:9/251: truncate d5/d20/d52/f57 461795 0 2024-05-06T21:26:43.959 INFO:tasks.workunit.client.1.smithi154.stdout:9/252: creat d5/d20/d37/f5b x:0 0 0 2024-05-06T21:26:43.960 INFO:tasks.workunit.client.0.smithi032.stdout:1/454: rename db/d2a/d4f/d88 to db/d8f 0 2024-05-06T21:26:43.960 INFO:tasks.workunit.client.0.smithi032.stdout:1/455: chown db/f1f 9 1 2024-05-06T21:26:43.962 INFO:tasks.workunit.client.1.smithi154.stdout:1/169: creat d6/db/f34 x:0 0 0 2024-05-06T21:26:43.962 INFO:tasks.workunit.client.1.smithi154.stdout:1/170: dread - d6/f30 zero size 2024-05-06T21:26:43.962 INFO:tasks.workunit.client.1.smithi154.stdout:1/171: creat d6/db/d10/f35 x:0 0 0 2024-05-06T21:26:43.963 INFO:tasks.workunit.client.0.smithi032.stdout:8/615: mknod d0/d1b/d47/cb8 0 2024-05-06T21:26:43.963 INFO:tasks.workunit.client.0.smithi032.stdout:8/616: dread - d0/d1b/d39/f96 zero size 2024-05-06T21:26:43.963 INFO:tasks.workunit.client.0.smithi032.stdout:8/617: truncate d0/d1c/fae 712595 0 2024-05-06T21:26:43.963 INFO:tasks.workunit.client.0.smithi032.stdout:8/618: fdatasync d0/d1b/f34 0 2024-05-06T21:26:43.965 INFO:tasks.workunit.client.0.smithi032.stdout:1/456: dread db/d2a/f4d [0,4194304] 0 2024-05-06T21:26:43.965 INFO:tasks.workunit.client.0.smithi032.stdout:0/462: sync 2024-05-06T21:26:43.965 INFO:tasks.workunit.client.0.smithi032.stdout:9/537: sync 2024-05-06T21:26:43.965 INFO:tasks.workunit.client.0.smithi032.stdout:4/593: dwrite d2/d16/d44/d45/fb5 [0,4194304] 0 2024-05-06T21:26:43.967 INFO:tasks.workunit.client.1.smithi154.stdout:0/149: symlink d6/d10/l30 0 2024-05-06T21:26:43.967 INFO:tasks.workunit.client.1.smithi154.stdout:0/150: fsync d6/dc/f13 0 2024-05-06T21:26:43.967 INFO:tasks.workunit.client.1.smithi154.stdout:0/151: chown d6/dc/f2d 2691401 1 2024-05-06T21:26:43.967 INFO:tasks.workunit.client.1.smithi154.stdout:0/152: creat d6/d10/f31 x:0 0 0 2024-05-06T21:26:43.968 INFO:tasks.workunit.client.1.smithi154.stdout:0/153: write d6/d10/f21 [652962,13952] 0 2024-05-06T21:26:43.968 INFO:tasks.workunit.client.1.smithi154.stdout:0/154: stat d6/d27/f28 0 2024-05-06T21:26:43.968 INFO:tasks.workunit.client.0.smithi032.stdout:1/457: symlink db/d8f/l90 0 2024-05-06T21:26:43.968 INFO:tasks.workunit.client.0.smithi032.stdout:8/619: creat d0/d1b/fb9 x:0 0 0 2024-05-06T21:26:43.969 INFO:tasks.workunit.client.1.smithi154.stdout:3/202: creat d0/da/db/dd/d1c/d21/f42 x:0 0 0 2024-05-06T21:26:43.970 INFO:tasks.workunit.client.0.smithi032.stdout:0/463: mkdir d4/d3e/d63/d6c/d8f 0 2024-05-06T21:26:43.973 INFO:tasks.workunit.client.0.smithi032.stdout:7/559: dwrite db/d12/d16/f72 [0,4194304] 0 2024-05-06T21:26:43.973 INFO:tasks.workunit.client.0.smithi032.stdout:4/594: unlink d2/d2c/d31/d7c/l51 0 2024-05-06T21:26:43.974 INFO:tasks.workunit.client.0.smithi032.stdout:1/458: mknod db/d16/d46/d57/d58/d68/c91 0 2024-05-06T21:26:43.975 INFO:tasks.workunit.client.0.smithi032.stdout:1/459: write db/d16/f2c [8791714,53300] 0 2024-05-06T21:26:43.976 INFO:tasks.workunit.client.0.smithi032.stdout:4/595: mknod d2/d16/d44/d45/cc7 0 2024-05-06T21:26:43.977 INFO:tasks.workunit.client.0.smithi032.stdout:1/460: creat db/f92 x:0 0 0 2024-05-06T21:26:43.977 INFO:tasks.workunit.client.0.smithi032.stdout:1/461: truncate db/d47/d4a/f8e 393386 0 2024-05-06T21:26:43.985 INFO:tasks.workunit.client.1.smithi154.stdout:1/172: mknod d6/db/d10/d26/d1b/c36 0 2024-05-06T21:26:43.988 INFO:tasks.workunit.client.1.smithi154.stdout:3/203: mknod d0/da/db/dd/d1c/d21/d37/c43 0 2024-05-06T21:26:43.990 INFO:tasks.workunit.client.0.smithi032.stdout:1/462: rename db/d8f to db/d37/d93 0 2024-05-06T21:26:43.992 INFO:tasks.workunit.client.0.smithi032.stdout:5/455: truncate d0/f12 3677945 0 2024-05-06T21:26:43.992 INFO:tasks.workunit.client.1.smithi154.stdout:1/173: rename d6/db/d10/c29 to d6/db/d10/d26/d1b/c37 0 2024-05-06T21:26:43.993 INFO:tasks.workunit.client.1.smithi154.stdout:0/155: rmdir d6/d27 39 2024-05-06T21:26:43.995 INFO:tasks.workunit.client.1.smithi154.stdout:0/156: dread d6/d10/f25 [0,4194304] 0 2024-05-06T21:26:43.996 INFO:tasks.workunit.client.1.smithi154.stdout:3/204: creat d0/da/d1a/f44 x:0 0 0 2024-05-06T21:26:44.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/563: dwrite d1/d4/db7/fa2 [0,4194304] 0 2024-05-06T21:26:44.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/564: write d1/d4/da/d31/d9b/f9e [1570524,117509] 0 2024-05-06T21:26:44.002 INFO:tasks.workunit.client.0.smithi032.stdout:3/565: chown d1/d4/f7a 1262787584 1 2024-05-06T21:26:44.002 INFO:tasks.workunit.client.1.smithi154.stdout:3/205: rename d0/da/d1a/d28/f19 to d0/d2/f45 0 2024-05-06T21:26:44.004 INFO:tasks.workunit.client.0.smithi032.stdout:3/566: read d1/d4/da/d31/f48 [1107424,47504] 0 2024-05-06T21:26:44.007 INFO:tasks.workunit.client.0.smithi032.stdout:3/567: creat d1/fc4 x:0 0 0 2024-05-06T21:26:44.009 INFO:tasks.workunit.client.0.smithi032.stdout:3/568: creat d1/d4/da/d9f/db8/fc5 x:0 0 0 2024-05-06T21:26:44.010 INFO:tasks.workunit.client.0.smithi032.stdout:3/569: read d1/d4/f62 [867126,11385] 0 2024-05-06T21:26:44.012 INFO:tasks.workunit.client.0.smithi032.stdout:3/570: creat d1/d4/da/d9f/d74/db1/fc6 x:0 0 0 2024-05-06T21:26:44.014 INFO:tasks.workunit.client.0.smithi032.stdout:3/571: rename d1/d4/da/d4e/d41/fa3 to d1/d4/da/d9f/d74/da7/fc7 0 2024-05-06T21:26:44.020 INFO:tasks.workunit.client.0.smithi032.stdout:5/456: dwrite d0/d16/d2f/f41 [0,4194304] 0 2024-05-06T21:26:44.020 INFO:tasks.workunit.client.0.smithi032.stdout:5/457: write d0/d16/d2a/d59/d67/d73/f76 [1041102,19441] 0 2024-05-06T21:26:44.020 INFO:tasks.workunit.client.0.smithi032.stdout:5/458: readlink d0/l58 0 2024-05-06T21:26:44.036 INFO:tasks.workunit.client.1.smithi154.stdout:9/253: dwrite d5/d20/d52/f57 [0,4194304] 0 2024-05-06T21:26:44.036 INFO:tasks.workunit.client.1.smithi154.stdout:0/157: fdatasync d6/d10/f2c 0 2024-05-06T21:26:44.038 INFO:tasks.workunit.client.1.smithi154.stdout:0/158: dread d6/d10/f25 [0,4194304] 0 2024-05-06T21:26:44.043 INFO:tasks.workunit.client.1.smithi154.stdout:0/159: rename f3 to d6/d27/f32 0 2024-05-06T21:26:44.044 INFO:tasks.workunit.client.1.smithi154.stdout:8/172: getdents d3/d38 0 2024-05-06T21:26:44.044 INFO:tasks.workunit.client.1.smithi154.stdout:8/173: fsync d3/d14/f18 0 2024-05-06T21:26:44.046 INFO:tasks.workunit.client.1.smithi154.stdout:6/102: dwrite f2 [0,4194304] 0 2024-05-06T21:26:44.048 INFO:tasks.workunit.client.1.smithi154.stdout:8/174: dread d3/fd [0,4194304] 0 2024-05-06T21:26:44.048 INFO:tasks.workunit.client.1.smithi154.stdout:8/175: creat d3/d14/d1a/d22/f3a x:0 0 0 2024-05-06T21:26:44.048 INFO:tasks.workunit.client.1.smithi154.stdout:8/176: chown d3/d14/f18 26224924 1 2024-05-06T21:26:44.050 INFO:tasks.workunit.client.0.smithi032.stdout:8/620: dwrite d0/d1b/d47/f83 [0,4194304] 0 2024-05-06T21:26:44.050 INFO:tasks.workunit.client.0.smithi032.stdout:9/538: dwrite d1/d13/f2a [0,4194304] 0 2024-05-06T21:26:44.051 INFO:tasks.workunit.client.1.smithi154.stdout:8/177: symlink d3/d14/l3b 0 2024-05-06T21:26:44.051 INFO:tasks.workunit.client.1.smithi154.stdout:8/178: stat d3/f10 0 2024-05-06T21:26:44.051 INFO:tasks.workunit.client.1.smithi154.stdout:8/179: readlink d3/l17 0 2024-05-06T21:26:44.051 INFO:tasks.workunit.client.1.smithi154.stdout:1/174: dwrite d6/f8 [0,4194304] 0 2024-05-06T21:26:44.051 INFO:tasks.workunit.client.1.smithi154.stdout:1/175: write d6/db/d10/f33 [865880,22817] 0 2024-05-06T21:26:44.052 INFO:tasks.workunit.client.0.smithi032.stdout:1/463: dwrite db/d16/d46/f63 [0,4194304] 0 2024-05-06T21:26:44.052 INFO:tasks.workunit.client.0.smithi032.stdout:1/464: readlink db/d2a/d4f/l62 0 2024-05-06T21:26:44.052 INFO:tasks.workunit.client.0.smithi032.stdout:1/465: creat db/d16/d46/f94 x:0 0 0 2024-05-06T21:26:44.052 INFO:tasks.workunit.client.0.smithi032.stdout:1/466: creat db/d47/d4a/f95 x:0 0 0 2024-05-06T21:26:44.052 INFO:tasks.workunit.client.1.smithi154.stdout:3/206: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:44.052 INFO:tasks.workunit.client.1.smithi154.stdout:3/207: stat d0/da/d1a 0 2024-05-06T21:26:44.053 INFO:tasks.workunit.client.0.smithi032.stdout:7/560: dwrite db/d12/d16/d21/d41/d78/f91 [0,4194304] 0 2024-05-06T21:26:44.053 INFO:tasks.workunit.client.0.smithi032.stdout:7/561: fdatasync db/d12/d49/f6f 0 2024-05-06T21:26:44.053 INFO:tasks.workunit.client.0.smithi032.stdout:0/464: dwrite d4/fc [0,4194304] 0 2024-05-06T21:26:44.053 INFO:tasks.workunit.client.1.smithi154.stdout:1/176: mknod d6/db/c38 0 2024-05-06T21:26:44.053 INFO:tasks.workunit.client.1.smithi154.stdout:1/177: stat d6 0 2024-05-06T21:26:44.055 INFO:tasks.workunit.client.0.smithi032.stdout:1/467: write db/d16/f32 [1263933,28798] 0 2024-05-06T21:26:44.055 INFO:tasks.workunit.client.1.smithi154.stdout:6/103: dread d8/fc [0,4194304] 0 2024-05-06T21:26:44.057 INFO:tasks.workunit.client.0.smithi032.stdout:9/539: link d1/d2f/l6a d1/d13/d34/d26/d39/lb0 0 2024-05-06T21:26:44.060 INFO:tasks.workunit.client.1.smithi154.stdout:1/178: rename d6/f30 to d6/db/d10/d15/f39 0 2024-05-06T21:26:44.061 INFO:tasks.workunit.client.1.smithi154.stdout:6/104: truncate f6 962904 0 2024-05-06T21:26:44.061 INFO:tasks.workunit.client.1.smithi154.stdout:6/105: write d8/f23 [259845,105778] 0 2024-05-06T21:26:44.062 INFO:tasks.workunit.client.0.smithi032.stdout:4/596: dwrite d2/d16/d44/d45/f6d [0,4194304] 0 2024-05-06T21:26:44.062 INFO:tasks.workunit.client.0.smithi032.stdout:4/597: creat d2/d13/fc8 x:0 0 0 2024-05-06T21:26:44.062 INFO:tasks.workunit.client.0.smithi032.stdout:4/598: readlink d2/d16/d44/d54/lae 0 2024-05-06T21:26:44.062 INFO:tasks.workunit.client.0.smithi032.stdout:3/572: dwrite d1/d4/da/d31/d47/d4a/d68/d7c/da8/fbf [8388608,4194304] 0 2024-05-06T21:26:44.064 INFO:tasks.workunit.client.1.smithi154.stdout:1/179: link d6/db/d10/l2c d6/db/d10/d15/l3a 0 2024-05-06T21:26:44.065 INFO:tasks.workunit.client.1.smithi154.stdout:9/254: dwrite d5/f2a [0,4194304] 0 2024-05-06T21:26:44.066 INFO:tasks.workunit.client.1.smithi154.stdout:1/180: mknod d6/db/d10/d26/c3b 0 2024-05-06T21:26:44.067 INFO:tasks.workunit.client.1.smithi154.stdout:1/181: read - d6/db/d10/f35 zero size 2024-05-06T21:26:44.067 INFO:tasks.workunit.client.1.smithi154.stdout:2/140: sync 2024-05-06T21:26:44.067 INFO:tasks.workunit.client.1.smithi154.stdout:4/149: sync 2024-05-06T21:26:44.069 INFO:tasks.workunit.client.1.smithi154.stdout:9/255: creat d5/d2e/d56/f5c x:0 0 0 2024-05-06T21:26:44.069 INFO:tasks.workunit.client.1.smithi154.stdout:9/256: truncate d5/d2e/d56/f5c 416581 0 2024-05-06T21:26:44.071 INFO:tasks.workunit.client.1.smithi154.stdout:2/141: truncate db/d12/f23 2758301 0 2024-05-06T21:26:44.071 INFO:tasks.workunit.client.1.smithi154.stdout:9/257: chown d5/d14/d3a 13275490 1 2024-05-06T21:26:44.072 INFO:tasks.workunit.client.1.smithi154.stdout:2/142: mknod db/d12/c2b 0 2024-05-06T21:26:44.072 INFO:tasks.workunit.client.1.smithi154.stdout:2/143: write db/d12/f21 [1031448,113314] 0 2024-05-06T21:26:44.074 INFO:tasks.workunit.client.1.smithi154.stdout:3/208: write d0/fe [1046179,11646] 0 2024-05-06T21:26:44.074 INFO:tasks.workunit.client.1.smithi154.stdout:3/209: chown d0/da/d1a/c24 260301678 1 2024-05-06T21:26:44.074 INFO:tasks.workunit.client.1.smithi154.stdout:2/144: rmdir db 39 2024-05-06T21:26:44.075 INFO:tasks.workunit.client.1.smithi154.stdout:2/145: symlink db/d12/l2c 0 2024-05-06T21:26:44.076 INFO:tasks.workunit.client.0.smithi032.stdout:0/465: mknod d4/d3e/c90 0 2024-05-06T21:26:44.076 INFO:tasks.workunit.client.0.smithi032.stdout:1/468: link db/d37/f54 db/d16/d46/f96 0 2024-05-06T21:26:44.076 INFO:tasks.workunit.client.0.smithi032.stdout:0/466: stat d4/da/d16 0 2024-05-06T21:26:44.076 INFO:tasks.workunit.client.0.smithi032.stdout:0/467: stat d4/da/d16/f18 0 2024-05-06T21:26:44.076 INFO:tasks.workunit.client.0.smithi032.stdout:0/468: chown d4/da/d14/d1a/f1e 888874 1 2024-05-06T21:26:44.076 INFO:tasks.workunit.client.0.smithi032.stdout:0/469: chown d4/d3e/d42/c61 364 1 2024-05-06T21:26:44.076 INFO:tasks.workunit.client.0.smithi032.stdout:1/469: write db/d16/d5d/f7d [1026589,123020] 0 2024-05-06T21:26:44.076 INFO:tasks.workunit.client.0.smithi032.stdout:1/470: creat db/d16/d46/d57/d58/f97 x:0 0 0 2024-05-06T21:26:44.076 INFO:tasks.workunit.client.1.smithi154.stdout:2/146: creat db/f2d x:0 0 0 2024-05-06T21:26:44.077 INFO:tasks.workunit.client.1.smithi154.stdout:6/106: write d8/f10 [3233121,20734] 0 2024-05-06T21:26:44.077 INFO:tasks.workunit.client.0.smithi032.stdout:9/540: creat d1/d13/d25/da0/fb1 x:0 0 0 2024-05-06T21:26:44.079 INFO:tasks.workunit.client.1.smithi154.stdout:1/182: getdents d6/db/d10/d26/d1b 0 2024-05-06T21:26:44.079 INFO:tasks.workunit.client.1.smithi154.stdout:4/150: dread d0/d10/d11/f21 [0,4194304] 0 2024-05-06T21:26:44.081 INFO:tasks.workunit.client.1.smithi154.stdout:1/183: mknod d6/db/c3c 0 2024-05-06T21:26:44.082 INFO:tasks.workunit.client.1.smithi154.stdout:4/151: truncate d0/d10/f15 580993 0 2024-05-06T21:26:44.084 INFO:tasks.workunit.client.1.smithi154.stdout:8/180: read d3/d14/f18 [319165,109906] 0 2024-05-06T21:26:44.084 INFO:tasks.workunit.client.1.smithi154.stdout:1/184: link d6/db/c18 d6/c3d 0 2024-05-06T21:26:44.086 INFO:tasks.workunit.client.1.smithi154.stdout:0/160: dwrite d6/dc/f13 [4194304,4194304] 0 2024-05-06T21:26:44.087 INFO:tasks.workunit.client.1.smithi154.stdout:3/210: dread d0/da/d1a/d28/d17/f1e [4194304,4194304] 0 2024-05-06T21:26:44.087 INFO:tasks.workunit.client.1.smithi154.stdout:3/211: truncate d0/da/db/dd/d1c/f35 741211 0 2024-05-06T21:26:44.088 INFO:tasks.workunit.client.1.smithi154.stdout:4/152: unlink d0/d10/d11/d1a/f1d 0 2024-05-06T21:26:44.088 INFO:tasks.workunit.client.1.smithi154.stdout:4/153: truncate d0/d2/dc/f18 146812 0 2024-05-06T21:26:44.089 INFO:tasks.workunit.client.0.smithi032.stdout:4/599: symlink d2/d16/d44/d74/d79/lc9 0 2024-05-06T21:26:44.089 INFO:tasks.workunit.client.0.smithi032.stdout:4/600: readlink d2/d16/d44/d45/lbe 0 2024-05-06T21:26:44.089 INFO:tasks.workunit.client.0.smithi032.stdout:4/601: chown d2/d13/daa/fba 1725379 1 2024-05-06T21:26:44.089 INFO:tasks.workunit.client.1.smithi154.stdout:1/185: mkdir d6/d3e 0 2024-05-06T21:26:44.090 INFO:tasks.workunit.client.1.smithi154.stdout:1/186: truncate d6/f24 371258 0 2024-05-06T21:26:44.090 INFO:tasks.workunit.client.1.smithi154.stdout:1/187: chown d6/db/d10/d26/d1b/c37 3334290 1 2024-05-06T21:26:44.091 INFO:tasks.workunit.client.0.smithi032.stdout:0/470: symlink d4/da/d16/l91 0 2024-05-06T21:26:44.091 INFO:tasks.workunit.client.0.smithi032.stdout:0/471: dread - d4/da/f81 zero size 2024-05-06T21:26:44.091 INFO:tasks.workunit.client.0.smithi032.stdout:0/472: chown d4/f9 56104 1 2024-05-06T21:26:44.097 INFO:tasks.workunit.client.0.smithi032.stdout:4/602: truncate d2/f9 5823726 0 2024-05-06T21:26:44.097 INFO:tasks.workunit.client.0.smithi032.stdout:0/473: creat d4/d3e/d63/d6c/d8f/f92 x:0 0 0 2024-05-06T21:26:44.097 INFO:tasks.workunit.client.0.smithi032.stdout:0/474: creat d4/da/d14/d4a/f93 x:0 0 0 2024-05-06T21:26:44.098 INFO:tasks.workunit.client.1.smithi154.stdout:3/212: mknod d0/da/db/dd/c46 0 2024-05-06T21:26:44.098 INFO:tasks.workunit.client.1.smithi154.stdout:7/76: sync 2024-05-06T21:26:44.098 INFO:tasks.workunit.client.1.smithi154.stdout:7/77: chown d6/l16 227 1 2024-05-06T21:26:44.099 INFO:tasks.workunit.client.1.smithi154.stdout:7/78: chown d6/f11 200089 1 2024-05-06T21:26:44.099 INFO:tasks.workunit.client.1.smithi154.stdout:7/79: creat d6/f1a x:0 0 0 2024-05-06T21:26:44.100 INFO:tasks.workunit.client.0.smithi032.stdout:7/562: dwrite db/d12/d16/d21/f31 [0,4194304] 0 2024-05-06T21:26:44.100 INFO:tasks.workunit.client.0.smithi032.stdout:7/563: dread - db/d12/d49/d97/f9f zero size 2024-05-06T21:26:44.100 INFO:tasks.workunit.client.1.smithi154.stdout:1/188: mknod d6/db/d10/d26/d1b/c3f 0 2024-05-06T21:26:44.100 INFO:tasks.workunit.client.1.smithi154.stdout:3/213: write d0/f32 [298659,50433] 0 2024-05-06T21:26:44.104 INFO:tasks.workunit.client.1.smithi154.stdout:7/80: rename d6/f11 to d6/d14/f1b 0 2024-05-06T21:26:44.105 INFO:tasks.workunit.client.1.smithi154.stdout:4/154: mknod d0/c30 0 2024-05-06T21:26:44.108 INFO:tasks.workunit.client.1.smithi154.stdout:6/107: write f6 [1187271,10643] 0 2024-05-06T21:26:44.111 INFO:tasks.workunit.client.1.smithi154.stdout:1/189: rename d6/db/d10/d26/f25 to d6/db/d10/f40 0 2024-05-06T21:26:44.111 INFO:tasks.workunit.client.1.smithi154.stdout:1/190: write d6/db/d10/d15/f20 [5753782,84161] 0 2024-05-06T21:26:44.112 INFO:tasks.workunit.client.0.smithi032.stdout:7/564: write db/d12/d16/f57 [2025035,100527] 0 2024-05-06T21:26:44.113 INFO:tasks.workunit.client.0.smithi032.stdout:8/621: dwrite d0/d1c/f88 [0,4194304] 0 2024-05-06T21:26:44.113 INFO:tasks.workunit.client.1.smithi154.stdout:4/155: mkdir d0/d10/d11/d1a/d31 0 2024-05-06T21:26:44.113 INFO:tasks.workunit.client.1.smithi154.stdout:4/156: dread - d0/d2/f8 zero size 2024-05-06T21:26:44.113 INFO:tasks.workunit.client.1.smithi154.stdout:4/157: fsync d0/f2e 0 2024-05-06T21:26:44.115 INFO:tasks.workunit.client.0.smithi032.stdout:7/565: truncate db/d12/f17 2954277 0 2024-05-06T21:26:44.115 INFO:tasks.workunit.client.1.smithi154.stdout:6/108: dread f6 [0,4194304] 0 2024-05-06T21:26:44.115 INFO:tasks.workunit.client.1.smithi154.stdout:7/81: dread d6/f10 [0,4194304] 0 2024-05-06T21:26:44.117 INFO:tasks.workunit.client.0.smithi032.stdout:8/622: creat d0/d1b/d47/d91/da7/fba x:0 0 0 2024-05-06T21:26:44.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:43 smithi154 ceph-mon[32880]: pgmap v22: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 117 MiB/s rd, 160 MiB/s wr, 960 op/s 2024-05-06T21:26:44.119 INFO:tasks.workunit.client.0.smithi032.stdout:7/566: rename db/d12/d49/d97/f9f to db/d12/d16/d2a/d39/d8b/faf 0 2024-05-06T21:26:44.120 INFO:tasks.workunit.client.0.smithi032.stdout:7/567: write db/d12/f30 [1985985,27218] 0 2024-05-06T21:26:44.120 INFO:tasks.workunit.client.0.smithi032.stdout:7/568: chown db/d12/c56 1796857949 1 2024-05-06T21:26:44.120 INFO:tasks.workunit.client.0.smithi032.stdout:8/623: rmdir d0/d1b/d47/d91 39 2024-05-06T21:26:44.120 INFO:tasks.workunit.client.0.smithi032.stdout:8/624: creat d0/d1c/fbb x:0 0 0 2024-05-06T21:26:44.121 INFO:tasks.workunit.client.1.smithi154.stdout:6/109: rename d8/d11/c14 to d8/d11/c27 0 2024-05-06T21:26:44.122 INFO:tasks.workunit.client.0.smithi032.stdout:7/569: link db/d12/f85 db/d12/d16/d21/d41/d78/fb0 0 2024-05-06T21:26:44.122 INFO:tasks.workunit.client.1.smithi154.stdout:7/82: symlink d6/de/l1c 0 2024-05-06T21:26:44.124 INFO:tasks.workunit.client.1.smithi154.stdout:4/158: dread d0/d2/dc/f20 [0,4194304] 0 2024-05-06T21:26:44.124 INFO:tasks.workunit.client.1.smithi154.stdout:4/159: stat d0/d2/dc/f18 0 2024-05-06T21:26:44.124 INFO:tasks.workunit.client.1.smithi154.stdout:4/160: fdatasync d0/d10/f15 0 2024-05-06T21:26:44.124 INFO:tasks.workunit.client.1.smithi154.stdout:4/161: creat d0/d2/d2a/f32 x:0 0 0 2024-05-06T21:26:44.124 INFO:tasks.workunit.client.1.smithi154.stdout:4/162: dread - d0/f2e zero size 2024-05-06T21:26:44.125 INFO:tasks.workunit.client.1.smithi154.stdout:7/83: creat d6/d14/f1d x:0 0 0 2024-05-06T21:26:44.125 INFO:tasks.workunit.client.0.smithi032.stdout:8/625: unlink d0/d1b/f55 0 2024-05-06T21:26:44.125 INFO:tasks.workunit.client.0.smithi032.stdout:8/626: write d0/d1c/d5e/d67/fb4 [717764,101071] 0 2024-05-06T21:26:44.126 INFO:tasks.workunit.client.0.smithi032.stdout:8/627: symlink d0/d1b/d39/d3b/d57/d5d/d63/d7f/lbc 0 2024-05-06T21:26:44.126 INFO:tasks.workunit.client.0.smithi032.stdout:8/628: creat d0/d1b/fbd x:0 0 0 2024-05-06T21:26:44.127 INFO:tasks.workunit.client.1.smithi154.stdout:4/163: symlink d0/d10/l33 0 2024-05-06T21:26:44.128 INFO:tasks.workunit.client.1.smithi154.stdout:7/84: symlink d6/l1e 0 2024-05-06T21:26:44.128 INFO:tasks.workunit.client.1.smithi154.stdout:7/85: fsync d6/fa 0 2024-05-06T21:26:44.128 INFO:tasks.workunit.client.1.smithi154.stdout:7/86: dread - d6/d14/f1d zero size 2024-05-06T21:26:44.129 INFO:tasks.workunit.client.1.smithi154.stdout:7/87: mknod d6/c1f 0 2024-05-06T21:26:44.129 INFO:tasks.workunit.client.1.smithi154.stdout:7/88: readlink d6/l13 0 2024-05-06T21:26:44.130 INFO:tasks.workunit.client.0.smithi032.stdout:4/603: dread d2/f10 [0,4194304] 0 2024-05-06T21:26:44.130 INFO:tasks.workunit.client.0.smithi032.stdout:3/573: dwrite d1/d4/f3e [0,4194304] 0 2024-05-06T21:26:44.130 INFO:tasks.workunit.client.0.smithi032.stdout:3/574: chown d1/d4/da/d31/d47/d4a/d68/d7c/c80 47 1 2024-05-06T21:26:44.130 INFO:tasks.workunit.client.1.smithi154.stdout:8/181: dwrite d3/f10 [0,4194304] 0 2024-05-06T21:26:44.131 INFO:tasks.workunit.client.0.smithi032.stdout:9/541: dwrite d1/d13/d33/d5e/d78/f89 [0,4194304] 0 2024-05-06T21:26:44.131 INFO:tasks.workunit.client.0.smithi032.stdout:9/542: truncate d1/d2f/d4f/d97/fa4 468918 0 2024-05-06T21:26:44.132 INFO:tasks.workunit.client.1.smithi154.stdout:9/258: dwrite d5/d14/d31/f40 [0,4194304] 0 2024-05-06T21:26:44.132 INFO:tasks.workunit.client.1.smithi154.stdout:9/259: chown d5/f6 6617546 1 2024-05-06T21:26:44.132 INFO:tasks.workunit.client.1.smithi154.stdout:9/260: chown d5/d20/d37/f50 9675 1 2024-05-06T21:26:44.132 INFO:tasks.workunit.client.1.smithi154.stdout:9/261: chown d5/d14/d31/d39 365 1 2024-05-06T21:26:44.132 INFO:tasks.workunit.client.1.smithi154.stdout:9/262: getdents d5/d20/d52/d59 0 2024-05-06T21:26:44.132 INFO:tasks.workunit.client.1.smithi154.stdout:9/263: fsync d5/d20/f23 0 2024-05-06T21:26:44.133 INFO:tasks.workunit.client.1.smithi154.stdout:8/182: creat d3/d14/d1a/f3c x:0 0 0 2024-05-06T21:26:44.134 INFO:tasks.workunit.client.0.smithi032.stdout:8/629: mknod d0/d1b/d39/d93/cbe 0 2024-05-06T21:26:44.136 INFO:tasks.workunit.client.0.smithi032.stdout:4/604: mkdir d2/d2c/dca 0 2024-05-06T21:26:44.136 INFO:tasks.workunit.client.1.smithi154.stdout:2/147: getdents db/d12 0 2024-05-06T21:26:44.136 INFO:tasks.workunit.client.1.smithi154.stdout:2/148: read - db/f2d zero size 2024-05-06T21:26:44.137 INFO:tasks.workunit.client.1.smithi154.stdout:4/164: write d0/d2/fb [2716572,469] 0 2024-05-06T21:26:44.138 INFO:tasks.workunit.client.1.smithi154.stdout:0/161: dwrite d6/f15 [0,4194304] 0 2024-05-06T21:26:44.139 INFO:tasks.workunit.client.1.smithi154.stdout:2/149: symlink db/d12/d19/l2e 0 2024-05-06T21:26:44.139 INFO:tasks.workunit.client.0.smithi032.stdout:3/575: mkdir d1/d4/da/d4e/dc8 0 2024-05-06T21:26:44.139 INFO:tasks.workunit.client.0.smithi032.stdout:3/576: fsync d1/d4/f52 0 2024-05-06T21:26:44.140 INFO:tasks.workunit.client.1.smithi154.stdout:9/264: mknod d5/d14/c5d 0 2024-05-06T21:26:44.144 INFO:tasks.workunit.client.0.smithi032.stdout:1/471: fsync db/d16/d46/f96 0 2024-05-06T21:26:44.145 INFO:tasks.workunit.client.0.smithi032.stdout:3/577: dread d1/d2a/f37 [0,4194304] 0 2024-05-06T21:26:44.145 INFO:tasks.workunit.client.0.smithi032.stdout:8/630: rename d0/l12 to d0/d1b/d39/d3b/lbf 0 2024-05-06T21:26:44.150 INFO:tasks.workunit.client.1.smithi154.stdout:0/162: unlink d6/d10/f25 0 2024-05-06T21:26:44.150 INFO:tasks.workunit.client.1.smithi154.stdout:0/163: truncate d6/d27/f28 222608 0 2024-05-06T21:26:44.150 INFO:tasks.workunit.client.1.smithi154.stdout:0/164: read - d6/d10/f31 zero size 2024-05-06T21:26:44.150 INFO:tasks.workunit.client.1.smithi154.stdout:6/110: dwrite d8/d11/f24 [0,4194304] 0 2024-05-06T21:26:44.150 INFO:tasks.workunit.client.0.smithi032.stdout:3/578: rename d1/d4/da/d4e/dc8 to d1/d4/da/d31/d47/d4a/dc9 0 2024-05-06T21:26:44.151 INFO:tasks.workunit.client.1.smithi154.stdout:2/150: symlink db/de/d10/l2f 0 2024-05-06T21:26:44.152 INFO:tasks.workunit.client.0.smithi032.stdout:9/543: dread d1/d13/d34/d26/d39/f9b [4194304,4194304] 0 2024-05-06T21:26:44.152 INFO:tasks.workunit.client.0.smithi032.stdout:1/472: write db/d2a/f50 [175047,54254] 0 2024-05-06T21:26:44.154 INFO:tasks.workunit.client.1.smithi154.stdout:4/165: link d0/d2/dc/f1e d0/f34 0 2024-05-06T21:26:44.154 INFO:tasks.workunit.client.1.smithi154.stdout:4/166: truncate d0/d2/dc/f26 967784 0 2024-05-06T21:26:44.154 INFO:tasks.workunit.client.1.smithi154.stdout:4/167: creat d0/d10/d11/d1a/f35 x:0 0 0 2024-05-06T21:26:44.155 INFO:tasks.workunit.client.1.smithi154.stdout:4/168: creat d0/d2/d2a/f36 x:0 0 0 2024-05-06T21:26:44.155 INFO:tasks.workunit.client.1.smithi154.stdout:6/111: read f2 [4941776,23212] 0 2024-05-06T21:26:44.155 INFO:tasks.workunit.client.0.smithi032.stdout:3/579: symlink d1/d4/da/d4e/lca 0 2024-05-06T21:26:44.155 INFO:tasks.workunit.client.0.smithi032.stdout:3/580: truncate d1/fc4 215809 0 2024-05-06T21:26:44.156 INFO:tasks.workunit.client.0.smithi032.stdout:1/473: symlink db/d47/d70/l98 0 2024-05-06T21:26:44.161 INFO:tasks.workunit.client.0.smithi032.stdout:3/581: mknod d1/d4/da/d31/d9b/ccb 0 2024-05-06T21:26:44.161 INFO:tasks.workunit.client.0.smithi032.stdout:3/582: read d1/f5d [419916,56794] 0 2024-05-06T21:26:44.161 INFO:tasks.workunit.client.1.smithi154.stdout:5/181: sync 2024-05-06T21:26:44.167 INFO:tasks.workunit.client.0.smithi032.stdout:3/583: link d1/d4/da/d4e/d41/d45/f7e d1/d4/da/d1d/fcc 0 2024-05-06T21:26:44.167 INFO:tasks.workunit.client.1.smithi154.stdout:2/151: rename db/d12/f23 to db/de/d10/f30 0 2024-05-06T21:26:44.168 INFO:tasks.workunit.client.1.smithi154.stdout:8/183: dwrite d3/d14/d1a/d22/f23 [0,4194304] 0 2024-05-06T21:26:44.168 INFO:tasks.workunit.client.1.smithi154.stdout:8/184: write d3/d14/d1a/f28 [564552,52958] 0 2024-05-06T21:26:44.169 INFO:tasks.workunit.client.0.smithi032.stdout:3/584: symlink d1/d4/da/d4e/lcd 0 2024-05-06T21:26:44.169 INFO:tasks.workunit.client.0.smithi032.stdout:3/585: chown d1/d4/da/d4e/d41/d43/fbb 240 1 2024-05-06T21:26:44.169 INFO:tasks.workunit.client.0.smithi032.stdout:3/586: truncate d1/d4/da/d4e/f91 815188 0 2024-05-06T21:26:44.169 INFO:tasks.workunit.client.0.smithi032.stdout:3/587: creat d1/d4/da/d4e/d41/d43/fce x:0 0 0 2024-05-06T21:26:44.170 INFO:tasks.workunit.client.0.smithi032.stdout:3/588: creat d1/d4/da/d1d/fcf x:0 0 0 2024-05-06T21:26:44.171 INFO:tasks.workunit.client.1.smithi154.stdout:1/191: rmdir d6 39 2024-05-06T21:26:44.173 INFO:tasks.workunit.client.0.smithi032.stdout:3/589: mkdir d1/d4/da/d9f/db8/dd0 0 2024-05-06T21:26:44.174 INFO:tasks.workunit.client.1.smithi154.stdout:5/182: mknod d2/d3/d19/d23/c3f 0 2024-05-06T21:26:44.174 INFO:tasks.workunit.client.1.smithi154.stdout:5/183: chown d2/d6/dd/f18 1119477 1 2024-05-06T21:26:44.174 INFO:tasks.workunit.client.1.smithi154.stdout:5/184: dread - d2/d6/dd/f2c zero size 2024-05-06T21:26:44.174 INFO:tasks.workunit.client.1.smithi154.stdout:5/185: chown d2/d6/dd/l11 241444 1 2024-05-06T21:26:44.174 INFO:tasks.workunit.client.1.smithi154.stdout:5/186: fdatasync d2/d6/dc/f15 0 2024-05-06T21:26:44.179 INFO:tasks.workunit.client.0.smithi032.stdout:4/605: dwrite d2/d1e/f28 [4194304,4194304] 0 2024-05-06T21:26:44.180 INFO:tasks.workunit.client.1.smithi154.stdout:2/152: mkdir db/de/d16/d31 0 2024-05-06T21:26:44.182 INFO:tasks.workunit.client.1.smithi154.stdout:8/185: write d3/d14/f19 [4112607,1867] 0 2024-05-06T21:26:44.183 INFO:tasks.workunit.client.0.smithi032.stdout:4/606: rmdir d2/d2c/dca 0 2024-05-06T21:26:44.184 INFO:tasks.workunit.client.0.smithi032.stdout:4/607: link d2/d13/daa/fba d2/fcb 0 2024-05-06T21:26:44.184 INFO:tasks.workunit.client.0.smithi032.stdout:4/608: fdatasync d2/d2c/d31/d7c/f32 0 2024-05-06T21:26:44.185 INFO:tasks.workunit.client.1.smithi154.stdout:1/192: truncate d6/f17 3028142 0 2024-05-06T21:26:44.187 INFO:tasks.workunit.client.1.smithi154.stdout:7/89: rename d6/d14 to d6/d20 0 2024-05-06T21:26:44.187 INFO:tasks.workunit.client.1.smithi154.stdout:7/90: chown d6/d20/f1d 665 1 2024-05-06T21:26:44.189 INFO:tasks.workunit.client.1.smithi154.stdout:5/187: dread d2/d3/f16 [0,4194304] 0 2024-05-06T21:26:44.189 INFO:tasks.workunit.client.1.smithi154.stdout:1/193: rename d6/db/d10/d26/c31 to d6/db/d10/d26/c41 0 2024-05-06T21:26:44.190 INFO:tasks.workunit.client.1.smithi154.stdout:2/153: read db/d12/f21 [65345,79620] 0 2024-05-06T21:26:44.190 INFO:tasks.workunit.client.1.smithi154.stdout:2/154: chown db/d12/c2b 586779 1 2024-05-06T21:26:44.191 INFO:tasks.workunit.client.1.smithi154.stdout:5/188: link d2/f1a d2/d3/d21/d22/d25/d37/f40 0 2024-05-06T21:26:44.192 INFO:tasks.workunit.client.1.smithi154.stdout:1/194: mkdir d6/db/d10/d26/d1b/d42 0 2024-05-06T21:26:44.192 INFO:tasks.workunit.client.0.smithi032.stdout:4/609: dread d2/d16/d44/d74/f92 [0,4194304] 0 2024-05-06T21:26:44.194 INFO:tasks.workunit.client.0.smithi032.stdout:4/610: mknod d2/d2c/d31/d7c/ccc 0 2024-05-06T21:26:44.195 INFO:tasks.workunit.client.1.smithi154.stdout:0/165: dwrite d6/d27/f32 [4194304,4194304] 0 2024-05-06T21:26:44.195 INFO:tasks.workunit.client.1.smithi154.stdout:2/155: mknod db/d12/d1d/c32 0 2024-05-06T21:26:44.195 INFO:tasks.workunit.client.1.smithi154.stdout:0/166: dread d6/dc/f2d [0,4194304] 0 2024-05-06T21:26:44.195 INFO:tasks.workunit.client.1.smithi154.stdout:1/195: creat d6/db/d10/d26/d1b/d42/f43 x:0 0 0 2024-05-06T21:26:44.196 INFO:tasks.workunit.client.0.smithi032.stdout:4/611: truncate d2/d13/f57 1748075 0 2024-05-06T21:26:44.196 INFO:tasks.workunit.client.1.smithi154.stdout:5/189: getdents d2/d3/d19 0 2024-05-06T21:26:44.198 INFO:tasks.workunit.client.1.smithi154.stdout:1/196: symlink d6/db/l44 0 2024-05-06T21:26:44.199 INFO:tasks.workunit.client.1.smithi154.stdout:1/197: dread - d6/db/d10/f35 zero size 2024-05-06T21:26:44.201 INFO:tasks.workunit.client.1.smithi154.stdout:1/198: mkdir d6/db/d10/d26/d1b/d45 0 2024-05-06T21:26:44.201 INFO:tasks.workunit.client.1.smithi154.stdout:1/199: readlink l0 0 2024-05-06T21:26:44.201 INFO:tasks.workunit.client.1.smithi154.stdout:1/200: chown d6/db/d10/d26/f23 28843868 1 2024-05-06T21:26:44.201 INFO:tasks.workunit.client.1.smithi154.stdout:1/201: write d6/db/d10/d15/f39 [333291,100503] 0 2024-05-06T21:26:44.201 INFO:tasks.workunit.client.1.smithi154.stdout:1/202: truncate d6/db/d10/d26/d1b/d42/f43 869400 0 2024-05-06T21:26:44.202 INFO:tasks.workunit.client.1.smithi154.stdout:6/112: dwrite d8/d11/f1b [0,4194304] 0 2024-05-06T21:26:44.202 INFO:tasks.workunit.client.0.smithi032.stdout:8/631: dwrite d0/d1b/f70 [0,4194304] 0 2024-05-06T21:26:44.202 INFO:tasks.workunit.client.0.smithi032.stdout:1/474: fdatasync db/d2a/f50 0 2024-05-06T21:26:44.203 INFO:tasks.workunit.client.1.smithi154.stdout:1/203: truncate d6/db/d10/f40 2080102 0 2024-05-06T21:26:44.204 INFO:tasks.workunit.client.1.smithi154.stdout:1/204: read d6/db/d10/d26/d1b/d42/f43 [600285,32555] 0 2024-05-06T21:26:44.207 INFO:tasks.workunit.client.1.smithi154.stdout:2/156: write db/de/f1c [3132810,48234] 0 2024-05-06T21:26:44.208 INFO:tasks.workunit.client.1.smithi154.stdout:6/113: creat d8/d13/f28 x:0 0 0 2024-05-06T21:26:44.209 INFO:tasks.workunit.client.0.smithi032.stdout:1/475: mknod db/d47/d4a/c99 0 2024-05-06T21:26:44.211 INFO:tasks.workunit.client.1.smithi154.stdout:6/114: symlink d8/d11/l29 0 2024-05-06T21:26:44.211 INFO:tasks.workunit.client.0.smithi032.stdout:1/476: mknod db/d16/d46/d57/d58/d68/c9a 0 2024-05-06T21:26:44.211 INFO:tasks.workunit.client.0.smithi032.stdout:1/477: truncate db/d16/d5d/f7d 1241954 0 2024-05-06T21:26:44.212 INFO:tasks.workunit.client.0.smithi032.stdout:1/478: chown db/d16/f1b 14261258 1 2024-05-06T21:26:44.212 INFO:tasks.workunit.client.0.smithi032.stdout:9/544: dwrite d1/d13/d25/f70 [0,4194304] 0 2024-05-06T21:26:44.212 INFO:tasks.workunit.client.1.smithi154.stdout:7/91: dwrite d6/d20/f1b [0,4194304] 0 2024-05-06T21:26:44.212 INFO:tasks.workunit.client.0.smithi032.stdout:0/475: dwrite d4/da/d16/f3b [0,4194304] 0 2024-05-06T21:26:44.214 INFO:tasks.workunit.client.0.smithi032.stdout:1/479: mknod db/d47/c9b 0 2024-05-06T21:26:44.214 INFO:tasks.workunit.client.1.smithi154.stdout:6/115: symlink d8/l2a 0 2024-05-06T21:26:44.216 INFO:tasks.workunit.client.0.smithi032.stdout:9/545: creat d1/d13/d33/da6/fb2 x:0 0 0 2024-05-06T21:26:44.216 INFO:tasks.workunit.client.0.smithi032.stdout:9/546: chown d1/d13/d25/c44 952016 1 2024-05-06T21:26:44.218 INFO:tasks.workunit.client.1.smithi154.stdout:4/169: dwrite d0/d2/dc/fe [4194304,4194304] 0 2024-05-06T21:26:44.218 INFO:tasks.workunit.client.1.smithi154.stdout:4/170: fdatasync d0/d2/f1c 0 2024-05-06T21:26:44.221 INFO:tasks.workunit.client.0.smithi032.stdout:9/547: link d1/d2f/fad d1/d13/d33/d3f/d60/fb3 0 2024-05-06T21:26:44.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:43 smithi032 ceph-mon[27179]: pgmap v22: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 117 MiB/s rd, 160 MiB/s wr, 960 op/s 2024-05-06T21:26:44.224 INFO:tasks.workunit.client.0.smithi032.stdout:9/548: mknod d1/d2f/da1/cb4 0 2024-05-06T21:26:44.224 INFO:tasks.workunit.client.0.smithi032.stdout:8/632: write d0/d1b/d39/d3b/d57/d5d/d63/d85/f8c [3105388,40454] 0 2024-05-06T21:26:44.226 INFO:tasks.workunit.client.0.smithi032.stdout:3/590: getdents d1/d4/da/d31/d9b 0 2024-05-06T21:26:44.228 INFO:tasks.workunit.client.0.smithi032.stdout:9/549: creat d1/d13/d33/fb5 x:0 0 0 2024-05-06T21:26:44.228 INFO:tasks.workunit.client.0.smithi032.stdout:9/550: write d1/d13/d33/d3f/f75 [828738,127760] 0 2024-05-06T21:26:44.231 INFO:tasks.workunit.client.0.smithi032.stdout:8/633: mkdir d0/d1c/d5e/dc0 0 2024-05-06T21:26:44.233 INFO:tasks.workunit.client.0.smithi032.stdout:3/591: rename d1/d4/da/d4e/d41/d45/f56 to d1/d4/da/d31/d47/d4a/fd1 0 2024-05-06T21:26:44.233 INFO:tasks.workunit.client.0.smithi032.stdout:3/592: chown d1/d4/da/d31/d9b/ccb 358053445 1 2024-05-06T21:26:44.236 INFO:tasks.workunit.client.0.smithi032.stdout:9/551: unlink d1/d13/d34/fab 0 2024-05-06T21:26:44.236 INFO:tasks.workunit.client.0.smithi032.stdout:0/476: dread d4/da/d16/d33/f57 [0,4194304] 0 2024-05-06T21:26:44.237 INFO:tasks.workunit.client.0.smithi032.stdout:4/612: dwrite d2/d16/d44/d74/f8b [0,4194304] 0 2024-05-06T21:26:44.239 INFO:tasks.workunit.client.0.smithi032.stdout:3/593: dread d1/d4/f9 [0,4194304] 0 2024-05-06T21:26:44.240 INFO:tasks.workunit.client.0.smithi032.stdout:4/613: rename d2/f10 to d2/d16/d44/d45/fcd 0 2024-05-06T21:26:44.240 INFO:tasks.workunit.client.0.smithi032.stdout:4/614: chown d2/d1e/f22 632898 1 2024-05-06T21:26:44.240 INFO:tasks.workunit.client.0.smithi032.stdout:4/615: fdatasync d2/d1e/f4c 0 2024-05-06T21:26:44.241 INFO:tasks.workunit.client.0.smithi032.stdout:3/594: symlink d1/ld2 0 2024-05-06T21:26:44.244 INFO:tasks.workunit.client.0.smithi032.stdout:3/595: mkdir d1/d4/da/d4e/dd3 0 2024-05-06T21:26:44.244 INFO:tasks.workunit.client.0.smithi032.stdout:9/552: write d1/d13/d25/d64/f69 [296068,31864] 0 2024-05-06T21:26:44.244 INFO:tasks.workunit.client.0.smithi032.stdout:9/553: fsync d1/d13/d34/f9c 0 2024-05-06T21:26:44.244 INFO:tasks.workunit.client.0.smithi032.stdout:9/554: chown d1/d2f 1711321 1 2024-05-06T21:26:44.246 INFO:tasks.workunit.client.0.smithi032.stdout:3/596: write d1/d4/da/d4e/d41/d97/d67/da6/f99 [79670,74195] 0 2024-05-06T21:26:44.247 INFO:tasks.workunit.client.1.smithi154.stdout:0/167: dwrite d6/d10/f29 [0,4194304] 0 2024-05-06T21:26:44.247 INFO:tasks.workunit.client.1.smithi154.stdout:0/168: fsync f4 0 2024-05-06T21:26:44.247 INFO:tasks.workunit.client.1.smithi154.stdout:0/169: chown d6/d10/f11 1 1 2024-05-06T21:26:44.249 INFO:tasks.workunit.client.0.smithi032.stdout:3/597: creat d1/d4/da/d31/d9b/daa/fd4 x:0 0 0 2024-05-06T21:26:44.250 INFO:tasks.workunit.client.1.smithi154.stdout:5/190: dwrite d2/f34 [0,4194304] 0 2024-05-06T21:26:44.250 INFO:tasks.workunit.client.0.smithi032.stdout:1/480: dwrite db/d16/d46/f96 [0,4194304] 0 2024-05-06T21:26:44.251 INFO:tasks.workunit.client.1.smithi154.stdout:0/170: link d6/d10/f29 d6/dc/f33 0 2024-05-06T21:26:44.252 INFO:tasks.workunit.client.0.smithi032.stdout:0/477: dread d4/da/d16/d33/d46/f50 [0,4194304] 0 2024-05-06T21:26:44.252 INFO:tasks.workunit.client.0.smithi032.stdout:3/598: dread d1/d4/da/d31/d47/d4a/d68/d7c/f9a [8388608,4194304] 0 2024-05-06T21:26:44.252 INFO:tasks.workunit.client.0.smithi032.stdout:8/634: dwrite d0/f8 [0,4194304] 0 2024-05-06T21:26:44.252 INFO:tasks.workunit.client.0.smithi032.stdout:8/635: dread - d0/d1c/fac zero size 2024-05-06T21:26:44.252 INFO:tasks.workunit.client.1.smithi154.stdout:1/205: dread d6/db/d10/d15/f39 [0,4194304] 0 2024-05-06T21:26:44.252 INFO:tasks.workunit.client.1.smithi154.stdout:4/171: dwrite d0/d10/d11/f17 [0,4194304] 0 2024-05-06T21:26:44.252 INFO:tasks.workunit.client.1.smithi154.stdout:1/206: readlink d6/db/d10/d15/l3a 0 2024-05-06T21:26:44.256 INFO:tasks.workunit.client.1.smithi154.stdout:0/171: dread d6/dc/f24 [0,4194304] 0 2024-05-06T21:26:44.256 INFO:tasks.workunit.client.1.smithi154.stdout:0/172: readlink d6/d10/l26 0 2024-05-06T21:26:44.257 INFO:tasks.workunit.client.0.smithi032.stdout:0/478: link d4/da/f11 d4/d3e/d63/d6c/f94 0 2024-05-06T21:26:44.257 INFO:tasks.workunit.client.0.smithi032.stdout:0/479: write d4/da/d16/f18 [4266330,71160] 0 2024-05-06T21:26:44.257 INFO:tasks.workunit.client.0.smithi032.stdout:1/481: dread db/f30 [0,4194304] 0 2024-05-06T21:26:44.259 INFO:tasks.workunit.client.0.smithi032.stdout:8/636: truncate d0/d1b/f61 237145 0 2024-05-06T21:26:44.269 INFO:tasks.workunit.client.1.smithi154.stdout:7/92: dwrite d6/f9 [0,4194304] 0 2024-05-06T21:26:44.270 INFO:tasks.workunit.client.1.smithi154.stdout:5/191: mkdir d2/d6/dd/d2a/d41 0 2024-05-06T21:26:44.271 INFO:tasks.workunit.client.1.smithi154.stdout:5/192: stat d2/d3/d21/d22/d25/l2f 0 2024-05-06T21:26:44.271 INFO:tasks.workunit.client.1.smithi154.stdout:5/193: chown d2/f14 494954 1 2024-05-06T21:26:44.271 INFO:tasks.workunit.client.1.smithi154.stdout:5/194: creat d2/f42 x:0 0 0 2024-05-06T21:26:44.271 INFO:tasks.workunit.client.1.smithi154.stdout:5/195: fsync d2/d3/f16 0 2024-05-06T21:26:44.271 INFO:tasks.workunit.client.1.smithi154.stdout:5/196: readlink d2/d6/dd/l1c 0 2024-05-06T21:26:44.271 INFO:tasks.workunit.client.1.smithi154.stdout:5/197: chown d2/d6/f7 5208 1 2024-05-06T21:26:44.271 INFO:tasks.workunit.client.1.smithi154.stdout:5/198: chown d2/f42 27242 1 2024-05-06T21:26:44.272 INFO:tasks.workunit.client.1.smithi154.stdout:6/116: rmdir d8/d13 39 2024-05-06T21:26:44.272 INFO:tasks.workunit.client.1.smithi154.stdout:6/117: write d8/fc [2701130,104192] 0 2024-05-06T21:26:44.273 INFO:tasks.workunit.client.0.smithi032.stdout:0/480: write d4/da/d14/d1a/f1b [1707141,59221] 0 2024-05-06T21:26:44.273 INFO:tasks.workunit.client.0.smithi032.stdout:0/481: readlink d4/da/d16/l82 0 2024-05-06T21:26:44.273 INFO:tasks.workunit.client.0.smithi032.stdout:0/482: creat d4/da/d14/d1a/d66/f95 x:0 0 0 2024-05-06T21:26:44.274 INFO:tasks.workunit.client.0.smithi032.stdout:0/483: chown d4/d3e/d42/c48 546 1 2024-05-06T21:26:44.274 INFO:tasks.workunit.client.0.smithi032.stdout:0/484: stat d4/d3e/d63/f6d 0 2024-05-06T21:26:44.274 INFO:tasks.workunit.client.0.smithi032.stdout:0/485: chown d4/da/d14/d1a/c73 77477 1 2024-05-06T21:26:44.274 INFO:tasks.workunit.client.1.smithi154.stdout:1/207: rename d6/db/c18 to d6/d3e/c46 0 2024-05-06T21:26:44.275 INFO:tasks.workunit.client.0.smithi032.stdout:4/616: dwrite d2/d16/d44/d45/fcd [0,4194304] 0 2024-05-06T21:26:44.275 INFO:tasks.workunit.client.0.smithi032.stdout:3/599: write d1/d2a/f8d [1475814,92928] 0 2024-05-06T21:26:44.276 INFO:tasks.workunit.client.0.smithi032.stdout:3/600: stat d1/f58 0 2024-05-06T21:26:44.280 INFO:tasks.workunit.client.1.smithi154.stdout:5/199: write d2/d3/d21/d22/d25/d37/f40 [3286901,28103] 0 2024-05-06T21:26:44.280 INFO:tasks.workunit.client.1.smithi154.stdout:5/200: dread - d2/d6/dd/f2c zero size 2024-05-06T21:26:44.280 INFO:tasks.workunit.client.1.smithi154.stdout:5/201: write d2/d6/dc/f30 [1806054,80371] 0 2024-05-06T21:26:44.283 INFO:tasks.workunit.client.1.smithi154.stdout:1/208: rename d6/db/d10/f40 to d6/f47 0 2024-05-06T21:26:44.288 INFO:tasks.workunit.client.1.smithi154.stdout:0/173: rmdir d6/d10 39 2024-05-06T21:26:44.288 INFO:tasks.workunit.client.1.smithi154.stdout:7/93: write d6/d20/f1b [4135868,116578] 0 2024-05-06T21:26:44.290 INFO:tasks.workunit.client.1.smithi154.stdout:6/118: dwrite f6 [0,4194304] 0 2024-05-06T21:26:44.291 INFO:tasks.workunit.client.1.smithi154.stdout:5/202: rmdir d2/d6/dd 39 2024-05-06T21:26:44.293 INFO:tasks.workunit.client.1.smithi154.stdout:6/119: creat d8/f2b x:0 0 0 2024-05-06T21:26:44.294 INFO:tasks.workunit.client.0.smithi032.stdout:3/601: dwrite d1/d4/da/d31/d47/d4a/fa5 [0,4194304] 0 2024-05-06T21:26:44.296 INFO:tasks.workunit.client.1.smithi154.stdout:1/209: rename d6/db/d10/d26/d1b/d42 to d6/db/d10/d26/d1b/d45/d48 0 2024-05-06T21:26:44.299 INFO:tasks.workunit.client.1.smithi154.stdout:6/120: link d8/f2b d8/f2c 0 2024-05-06T21:26:44.299 INFO:tasks.workunit.client.1.smithi154.stdout:7/94: dread d6/f9 [0,4194304] 0 2024-05-06T21:26:44.301 INFO:tasks.workunit.client.1.smithi154.stdout:0/174: rename d6/d10/f14 to d6/dc/f34 0 2024-05-06T21:26:44.302 INFO:tasks.workunit.client.1.smithi154.stdout:5/203: getdents d2/d6/dc 0 2024-05-06T21:26:44.303 INFO:tasks.workunit.client.1.smithi154.stdout:6/121: mkdir d8/d11/d2d 0 2024-05-06T21:26:44.304 INFO:tasks.workunit.client.1.smithi154.stdout:7/95: mkdir d6/de/d21 0 2024-05-06T21:26:44.309 INFO:tasks.workunit.client.1.smithi154.stdout:0/175: unlink d6/d10/f21 0 2024-05-06T21:26:44.309 INFO:tasks.workunit.client.1.smithi154.stdout:0/176: readlink d6/d10/l1e 0 2024-05-06T21:26:44.309 INFO:tasks.workunit.client.1.smithi154.stdout:6/122: symlink d8/d11/d2d/l2e 0 2024-05-06T21:26:44.311 INFO:tasks.workunit.client.1.smithi154.stdout:0/177: rename d6/d27/f32 to d6/d10/f35 0 2024-05-06T21:26:44.311 INFO:tasks.workunit.client.1.smithi154.stdout:0/178: readlink d6/d10/l30 0 2024-05-06T21:26:44.311 INFO:tasks.workunit.client.1.smithi154.stdout:0/179: readlink d6/l1f 0 2024-05-06T21:26:44.311 INFO:tasks.workunit.client.1.smithi154.stdout:0/180: mkdir d6/d10/d36 0 2024-05-06T21:26:44.313 INFO:tasks.workunit.client.1.smithi154.stdout:0/181: link f4 d6/d10/d36/f37 0 2024-05-06T21:26:44.313 INFO:tasks.workunit.client.1.smithi154.stdout:0/182: write d6/d10/f31 [255424,89974] 0 2024-05-06T21:26:44.313 INFO:tasks.workunit.client.1.smithi154.stdout:0/183: stat d6/d10/d36 0 2024-05-06T21:26:44.313 INFO:tasks.workunit.client.1.smithi154.stdout:0/184: fdatasync d6/d10/d36/f37 0 2024-05-06T21:26:44.313 INFO:tasks.workunit.client.1.smithi154.stdout:0/185: readlink d6/d10/l30 0 2024-05-06T21:26:44.316 INFO:tasks.workunit.client.1.smithi154.stdout:5/204: dwrite d2/f1d [0,4194304] 0 2024-05-06T21:26:44.322 INFO:tasks.workunit.client.1.smithi154.stdout:6/123: dread f6 [0,4194304] 0 2024-05-06T21:26:44.324 INFO:tasks.workunit.client.0.smithi032.stdout:1/482: rename db/d2a/l48 to db/d16/d46/d55/l9c 0 2024-05-06T21:26:44.324 INFO:tasks.workunit.client.1.smithi154.stdout:6/124: creat d8/d11/d2d/f2f x:0 0 0 2024-05-06T21:26:44.325 INFO:tasks.workunit.client.1.smithi154.stdout:6/125: readlink d8/l1f 0 2024-05-06T21:26:44.325 INFO:tasks.workunit.client.0.smithi032.stdout:8/637: mkdir d0/d1b/d47/d91/da7/dc1 0 2024-05-06T21:26:44.328 INFO:tasks.workunit.client.1.smithi154.stdout:6/126: link d8/d11/l29 d8/l30 0 2024-05-06T21:26:44.328 INFO:tasks.workunit.client.1.smithi154.stdout:6/127: creat d8/f31 x:0 0 0 2024-05-06T21:26:44.340 INFO:tasks.workunit.client.0.smithi032.stdout:3/602: creat d1/d4/fd5 x:0 0 0 2024-05-06T21:26:44.340 INFO:tasks.workunit.client.0.smithi032.stdout:3/603: fsync d1/fc4 0 2024-05-06T21:26:44.341 INFO:tasks.workunit.client.0.smithi032.stdout:8/638: dread d0/fa [0,4194304] 0 2024-05-06T21:26:44.341 INFO:tasks.workunit.client.0.smithi032.stdout:8/639: dread - d0/d1c/fac zero size 2024-05-06T21:26:44.341 INFO:tasks.workunit.client.0.smithi032.stdout:8/640: chown d0/d1c/d5e/d67/f8d 5761 1 2024-05-06T21:26:44.342 INFO:tasks.workunit.client.0.smithi032.stdout:0/486: mkdir d4/d96 0 2024-05-06T21:26:44.342 INFO:tasks.workunit.client.0.smithi032.stdout:0/487: write d4/d3e/f49 [4211723,54793] 0 2024-05-06T21:26:44.343 INFO:tasks.workunit.client.0.smithi032.stdout:4/617: getdents d2/d1e/d47 0 2024-05-06T21:26:44.344 INFO:tasks.workunit.client.0.smithi032.stdout:3/604: dread d1/d4/da/d9f/d74/da7/fc7 [0,4194304] 0 2024-05-06T21:26:44.345 INFO:tasks.workunit.client.0.smithi032.stdout:1/483: rmdir db/d47/d4a 39 2024-05-06T21:26:44.345 INFO:tasks.workunit.client.0.smithi032.stdout:1/484: write db/d16/f18 [5121649,53220] 0 2024-05-06T21:26:44.345 INFO:tasks.workunit.client.0.smithi032.stdout:1/485: stat db/d37 0 2024-05-06T21:26:44.345 INFO:tasks.workunit.client.0.smithi032.stdout:1/486: dread - db/d47/d4a/f95 zero size 2024-05-06T21:26:44.347 INFO:tasks.workunit.client.0.smithi032.stdout:0/488: rename d4/da/d14/d1a/f68 to d4/da/d14/d1a/f97 0 2024-05-06T21:26:44.347 INFO:tasks.workunit.client.0.smithi032.stdout:0/489: write d4/da/d16/d33/f5e [4579318,20290] 0 2024-05-06T21:26:44.348 INFO:tasks.workunit.client.0.smithi032.stdout:4/618: mkdir d2/d16/d44/d74/dce 0 2024-05-06T21:26:44.348 INFO:tasks.workunit.client.0.smithi032.stdout:4/619: chown d2/l1d 144 1 2024-05-06T21:26:44.349 INFO:tasks.workunit.client.0.smithi032.stdout:1/487: symlink db/d16/d46/d57/d58/d68/l9d 0 2024-05-06T21:26:44.350 INFO:tasks.workunit.client.0.smithi032.stdout:6/641: sync 2024-05-06T21:26:44.350 INFO:tasks.workunit.client.0.smithi032.stdout:2/439: sync 2024-05-06T21:26:44.350 INFO:tasks.workunit.client.0.smithi032.stdout:2/440: write df/d19/d1e/d71/d5f/f80 [666107,129785] 0 2024-05-06T21:26:44.351 INFO:tasks.workunit.client.1.smithi154.stdout:0/186: dwrite d6/d10/f11 [0,4194304] 0 2024-05-06T21:26:44.351 INFO:tasks.workunit.client.1.smithi154.stdout:5/205: dwrite d2/f42 [0,4194304] 0 2024-05-06T21:26:44.351 INFO:tasks.workunit.client.1.smithi154.stdout:5/206: write d2/d3/f31 [263175,5785] 0 2024-05-06T21:26:44.351 INFO:tasks.workunit.client.1.smithi154.stdout:6/128: dwrite d8/f2b [0,4194304] 0 2024-05-06T21:26:44.352 INFO:tasks.workunit.client.0.smithi032.stdout:0/490: mkdir d4/da/d98 0 2024-05-06T21:26:44.355 INFO:tasks.workunit.client.1.smithi154.stdout:5/207: rmdir d2/d6/dd 39 2024-05-06T21:26:44.356 INFO:tasks.workunit.client.0.smithi032.stdout:4/620: unlink d2/f24 0 2024-05-06T21:26:44.357 INFO:tasks.workunit.client.1.smithi154.stdout:6/129: rmdir d8/d11 39 2024-05-06T21:26:44.357 INFO:tasks.workunit.client.1.smithi154.stdout:6/130: chown d8/d11 101813101 1 2024-05-06T21:26:44.357 INFO:tasks.workunit.client.1.smithi154.stdout:0/187: write d6/dc/f16 [898655,130619] 0 2024-05-06T21:26:44.358 INFO:tasks.workunit.client.0.smithi032.stdout:1/488: mknod db/d47/c9e 0 2024-05-06T21:26:44.358 INFO:tasks.workunit.client.0.smithi032.stdout:1/489: write db/d16/f40 [3907299,71479] 0 2024-05-06T21:26:44.358 INFO:tasks.workunit.client.1.smithi154.stdout:5/208: rmdir d2/d6/dd/d2a/d41 0 2024-05-06T21:26:44.359 INFO:tasks.workunit.client.1.smithi154.stdout:6/131: symlink d8/d13/l32 0 2024-05-06T21:26:44.359 INFO:tasks.workunit.client.0.smithi032.stdout:6/642: symlink d8/dd/d18/d3b/d90/lc0 0 2024-05-06T21:26:44.360 INFO:tasks.workunit.client.1.smithi154.stdout:5/209: mkdir d2/d3/d21/d22/d25/d27/d43 0 2024-05-06T21:26:44.362 INFO:tasks.workunit.client.0.smithi032.stdout:1/490: creat db/d16/d46/d57/d58/d68/f9f x:0 0 0 2024-05-06T21:26:44.362 INFO:tasks.workunit.client.1.smithi154.stdout:6/132: mkdir d8/d11/d33 0 2024-05-06T21:26:44.362 INFO:tasks.workunit.client.1.smithi154.stdout:6/133: chown d8/d11/c27 206642762 1 2024-05-06T21:26:44.363 INFO:tasks.workunit.client.1.smithi154.stdout:5/210: mkdir d2/d6/dc/d44 0 2024-05-06T21:26:44.364 INFO:tasks.workunit.client.1.smithi154.stdout:0/188: write d6/d10/f2c [304710,68627] 0 2024-05-06T21:26:44.364 INFO:tasks.workunit.client.0.smithi032.stdout:1/491: creat db/d16/d46/d57/fa0 x:0 0 0 2024-05-06T21:26:44.364 INFO:tasks.workunit.client.0.smithi032.stdout:2/441: read df/d19/d1e/d71/d5f/d7d/d25/f37 [2853508,88626] 0 2024-05-06T21:26:44.364 INFO:tasks.workunit.client.0.smithi032.stdout:2/442: dread - df/d19/d1e/d35/d3f/f44 zero size 2024-05-06T21:26:44.364 INFO:tasks.workunit.client.0.smithi032.stdout:2/443: chown df/f8b 3 1 2024-05-06T21:26:44.364 INFO:tasks.workunit.client.0.smithi032.stdout:8/641: dwrite d0/d1b/f31 [4194304,4194304] 0 2024-05-06T21:26:44.366 INFO:tasks.workunit.client.1.smithi154.stdout:5/211: rename d2/d3/cf to d2/d6/dd/c45 0 2024-05-06T21:26:44.366 INFO:tasks.workunit.client.0.smithi032.stdout:0/491: write d4/da/d16/f2c [1608890,68077] 0 2024-05-06T21:26:44.368 INFO:tasks.workunit.client.0.smithi032.stdout:3/605: dwrite d1/d4/da/d4e/d41/d97/d67/f78 [0,4194304] 0 2024-05-06T21:26:44.371 INFO:tasks.workunit.client.1.smithi154.stdout:3/214: sync 2024-05-06T21:26:44.372 INFO:tasks.workunit.client.0.smithi032.stdout:2/444: rename df/d19/d1e/d71/d5f/f96 to df/d19/d1e/d1f/d9f/fa1 0 2024-05-06T21:26:44.372 INFO:tasks.workunit.client.0.smithi032.stdout:8/642: rename d0/d1b/d39/d3b/d57/d5d/d63 to d0/d1b/d39/d3b/d57/d5d/d63/dc2 22 2024-05-06T21:26:44.372 INFO:tasks.workunit.client.0.smithi032.stdout:7/570: sync 2024-05-06T21:26:44.372 INFO:tasks.workunit.client.0.smithi032.stdout:5/459: sync 2024-05-06T21:26:44.372 INFO:tasks.workunit.client.0.smithi032.stdout:4/621: dread d2/d1e/f80 [0,4194304] 0 2024-05-06T21:26:44.374 INFO:tasks.workunit.client.0.smithi032.stdout:3/606: dread d1/fc4 [0,4194304] 0 2024-05-06T21:26:44.374 INFO:tasks.workunit.client.1.smithi154.stdout:5/212: creat d2/d3/d21/d22/d25/d37/f46 x:0 0 0 2024-05-06T21:26:44.376 INFO:tasks.workunit.client.0.smithi032.stdout:0/492: dread d4/da/d16/d33/f36 [0,4194304] 0 2024-05-06T21:26:44.376 INFO:tasks.workunit.client.0.smithi032.stdout:0/493: chown d4/da/d16/d33/c67 62462524 1 2024-05-06T21:26:44.376 INFO:tasks.workunit.client.0.smithi032.stdout:2/445: truncate df/d19/d1e/d71/d5f/d7d/d65/d78/f8d 543846 0 2024-05-06T21:26:44.376 INFO:tasks.workunit.client.0.smithi032.stdout:2/446: creat df/d19/d1e/d35/fa2 x:0 0 0 2024-05-06T21:26:44.376 INFO:tasks.workunit.client.0.smithi032.stdout:2/447: chown df/d19/d1e/d1f/d2e/d33/l66 172906 1 2024-05-06T21:26:44.376 INFO:tasks.workunit.client.0.smithi032.stdout:2/448: chown df/d19/d1e/d54/f58 52102528 1 2024-05-06T21:26:44.376 INFO:tasks.workunit.client.0.smithi032.stdout:2/449: fdatasync df/d19/d1e/d42/f63 0 2024-05-06T21:26:44.376 INFO:tasks.workunit.client.0.smithi032.stdout:2/450: chown df/d19/d1e/d35/d3f/f44 17 1 2024-05-06T21:26:44.377 INFO:tasks.workunit.client.0.smithi032.stdout:2/451: fsync df/f1c 0 2024-05-06T21:26:44.377 INFO:tasks.workunit.client.0.smithi032.stdout:2/452: chown df/d19/d1e/d71/d5f/d73 2 1 2024-05-06T21:26:44.377 INFO:tasks.workunit.client.0.smithi032.stdout:7/571: truncate db/d12/f61 1078629 0 2024-05-06T21:26:44.378 INFO:tasks.workunit.client.0.smithi032.stdout:5/460: mknod d0/d16/c84 0 2024-05-06T21:26:44.378 INFO:tasks.workunit.client.0.smithi032.stdout:5/461: write d0/d24/d38/f25 [2134490,61247] 0 2024-05-06T21:26:44.379 INFO:tasks.workunit.client.0.smithi032.stdout:5/462: creat d0/d16/f85 x:0 0 0 2024-05-06T21:26:44.381 INFO:tasks.workunit.client.0.smithi032.stdout:4/622: link d2/d16/d44/d74/d76/l7a d2/d16/d44/d45/d4e/lcf 0 2024-05-06T21:26:44.381 INFO:tasks.workunit.client.0.smithi032.stdout:4/623: stat d2/d1e 0 2024-05-06T21:26:44.381 INFO:tasks.workunit.client.0.smithi032.stdout:4/624: write d2/d13/f9e [392998,54485] 0 2024-05-06T21:26:44.381 INFO:tasks.workunit.client.0.smithi032.stdout:4/625: creat d2/d2c/d31/d7c/fd0 x:0 0 0 2024-05-06T21:26:44.381 INFO:tasks.workunit.client.0.smithi032.stdout:4/626: fdatasync d2/d16/d44/d45/fbf 0 2024-05-06T21:26:44.383 INFO:tasks.workunit.client.1.smithi154.stdout:3/215: rmdir d0/da/d1a 39 2024-05-06T21:26:44.383 INFO:tasks.workunit.client.1.smithi154.stdout:5/213: write d2/d3/f16 [4067672,33294] 0 2024-05-06T21:26:44.385 INFO:tasks.workunit.client.0.smithi032.stdout:4/627: dread d2/d2c/d31/d7c/fa6 [0,4194304] 0 2024-05-06T21:26:44.386 INFO:tasks.workunit.client.1.smithi154.stdout:3/216: link d0/d2/f25 d0/d2/d22/f47 0 2024-05-06T21:26:44.386 INFO:tasks.workunit.client.1.smithi154.stdout:3/217: chown d0/da/db/d30 44118 1 2024-05-06T21:26:44.386 INFO:tasks.workunit.client.1.smithi154.stdout:6/134: getdents d8/d11 0 2024-05-06T21:26:44.387 INFO:tasks.workunit.client.1.smithi154.stdout:0/189: dwrite d6/dc/f24 [0,4194304] 0 2024-05-06T21:26:44.387 INFO:tasks.workunit.client.1.smithi154.stdout:0/190: creat d6/dc/f38 x:0 0 0 2024-05-06T21:26:44.387 INFO:tasks.workunit.client.1.smithi154.stdout:0/191: fdatasync d6/d10/f20 0 2024-05-06T21:26:44.389 INFO:tasks.workunit.client.0.smithi032.stdout:3/607: mkdir d1/d4/da/d4e/dd3/dd6 0 2024-05-06T21:26:44.389 INFO:tasks.workunit.client.0.smithi032.stdout:3/608: write d1/d4/da/d1d/f24 [1102243,9791] 0 2024-05-06T21:26:44.390 INFO:tasks.workunit.client.0.smithi032.stdout:0/494: dread d4/da/d16/d33/d46/f50 [0,4194304] 0 2024-05-06T21:26:44.390 INFO:tasks.workunit.client.0.smithi032.stdout:0/495: fsync d4/da/d16/d33/d46/f6e 0 2024-05-06T21:26:44.390 INFO:tasks.workunit.client.0.smithi032.stdout:0/496: read - d4/d3e/d63/f5c zero size 2024-05-06T21:26:44.392 INFO:tasks.workunit.client.0.smithi032.stdout:4/628: dread d2/d13/f9e [0,4194304] 0 2024-05-06T21:26:44.392 INFO:tasks.workunit.client.1.smithi154.stdout:0/192: mkdir d6/dc/d39 0 2024-05-06T21:26:44.394 INFO:tasks.workunit.client.1.smithi154.stdout:0/193: read d6/d27/f28 [197402,105588] 0 2024-05-06T21:26:44.394 INFO:tasks.workunit.client.1.smithi154.stdout:0/194: write d6/dc/f34 [5123406,35501] 0 2024-05-06T21:26:44.394 INFO:tasks.workunit.client.1.smithi154.stdout:0/195: chown d6/d10/f20 58251740 1 2024-05-06T21:26:44.394 INFO:tasks.workunit.client.1.smithi154.stdout:0/196: fdatasync d6/d27/f28 0 2024-05-06T21:26:44.394 INFO:tasks.workunit.client.1.smithi154.stdout:0/197: fdatasync d6/d10/d36/f37 0 2024-05-06T21:26:44.399 INFO:tasks.workunit.client.1.smithi154.stdout:0/198: link d6/dc/f16 d6/f3a 0 2024-05-06T21:26:44.400 INFO:tasks.workunit.client.1.smithi154.stdout:5/214: write d2/f42 [3953465,112095] 0 2024-05-06T21:26:44.400 INFO:tasks.workunit.client.1.smithi154.stdout:6/135: write d8/f2c [2916056,31690] 0 2024-05-06T21:26:44.404 INFO:tasks.workunit.client.0.smithi032.stdout:3/609: mkdir d1/d4/da/d31/dd7 0 2024-05-06T21:26:44.405 INFO:tasks.workunit.client.1.smithi154.stdout:3/218: read d0/da/d1a/d28/d2f/f34 [3623299,49033] 0 2024-05-06T21:26:44.407 INFO:tasks.workunit.client.1.smithi154.stdout:3/219: mkdir d0/da/d1a/d28/d2f/d38/d48 0 2024-05-06T21:26:44.407 INFO:tasks.workunit.client.0.smithi032.stdout:0/497: creat d4/d3e/d63/d8d/f99 x:0 0 0 2024-05-06T21:26:44.409 INFO:tasks.workunit.client.0.smithi032.stdout:8/643: rename d0/d1b/d39/d3b to d0/d1c/d5e/d67/dc3 0 2024-05-06T21:26:44.412 INFO:tasks.workunit.client.0.smithi032.stdout:4/629: dread d2/d2c/d31/f91 [0,4194304] 0 2024-05-06T21:26:44.413 INFO:tasks.workunit.client.0.smithi032.stdout:0/498: symlink d4/da/d14/d1a/l9a 0 2024-05-06T21:26:44.414 INFO:tasks.workunit.client.0.smithi032.stdout:1/492: dwrite db/f43 [4194304,4194304] 0 2024-05-06T21:26:44.415 INFO:tasks.workunit.client.0.smithi032.stdout:6/643: dwrite d8/d3d/d49/f60 [0,4194304] 0 2024-05-06T21:26:44.415 INFO:tasks.workunit.client.0.smithi032.stdout:6/644: fdatasync d8/dd/f12 0 2024-05-06T21:26:44.416 INFO:tasks.workunit.client.0.smithi032.stdout:0/499: creat d4/da/d16/d33/d46/f9b x:0 0 0 2024-05-06T21:26:44.422 INFO:tasks.workunit.client.0.smithi032.stdout:1/493: mkdir db/d16/d46/da1 0 2024-05-06T21:26:44.422 INFO:tasks.workunit.client.0.smithi032.stdout:1/494: readlink db/d16/d46/d57/l7a 0 2024-05-06T21:26:44.422 INFO:tasks.workunit.client.0.smithi032.stdout:3/610: write d1/d4/da/d31/d47/d4a/d68/d7c/da8/fbf [2240252,61783] 0 2024-05-06T21:26:44.422 INFO:tasks.workunit.client.0.smithi032.stdout:3/611: fsync d1/d4/da/d4e/d41/d43/fbb 0 2024-05-06T21:26:44.423 INFO:tasks.workunit.client.0.smithi032.stdout:4/630: getdents d2/d16/d44/d74/d79 0 2024-05-06T21:26:44.423 INFO:tasks.workunit.client.0.smithi032.stdout:3/612: truncate d1/d4/db7/fa2 2970109 0 2024-05-06T21:26:44.423 INFO:tasks.workunit.client.0.smithi032.stdout:3/613: readlink d1/d4/da/d4e/lc2 0 2024-05-06T21:26:44.423 INFO:tasks.workunit.client.0.smithi032.stdout:6/645: dread d8/d33/f72 [0,4194304] 0 2024-05-06T21:26:44.424 INFO:tasks.workunit.client.0.smithi032.stdout:6/646: read - d8/d3d/d73/d87/f4d zero size 2024-05-06T21:26:44.424 INFO:tasks.workunit.client.0.smithi032.stdout:4/631: write d2/d1e/f28 [8538507,5356] 0 2024-05-06T21:26:44.426 INFO:tasks.workunit.client.0.smithi032.stdout:3/614: getdents d1/d4/da/d4e 0 2024-05-06T21:26:44.427 INFO:tasks.workunit.client.0.smithi032.stdout:2/453: dwrite df/d19/d1e/d35/f3d [0,4194304] 0 2024-05-06T21:26:44.428 INFO:tasks.workunit.client.0.smithi032.stdout:7/572: dwrite db/d12/f79 [0,4194304] 0 2024-05-06T21:26:44.428 INFO:tasks.workunit.client.1.smithi154.stdout:5/215: fsync d2/f42 0 2024-05-06T21:26:44.428 INFO:tasks.workunit.client.0.smithi032.stdout:8/644: dwrite d0/d1c/d5e/d67/dc3/fa0 [0,4194304] 0 2024-05-06T21:26:44.429 INFO:tasks.workunit.client.0.smithi032.stdout:1/495: dread db/d37/f54 [0,4194304] 0 2024-05-06T21:26:44.429 INFO:tasks.workunit.client.0.smithi032.stdout:8/645: truncate d0/d1b/d47/d91/da7/fba 836465 0 2024-05-06T21:26:44.429 INFO:tasks.workunit.client.1.smithi154.stdout:6/136: dwrite d8/fc [0,4194304] 0 2024-05-06T21:26:44.431 INFO:tasks.workunit.client.1.smithi154.stdout:6/137: truncate f6 2192102 0 2024-05-06T21:26:44.431 INFO:tasks.workunit.client.1.smithi154.stdout:6/138: write d8/f2c [4412319,117244] 0 2024-05-06T21:26:44.431 INFO:tasks.workunit.client.1.smithi154.stdout:6/139: stat d8/f10 0 2024-05-06T21:26:44.433 INFO:tasks.workunit.client.1.smithi154.stdout:3/220: getdents d0/d2/d22 0 2024-05-06T21:26:44.434 INFO:tasks.workunit.client.0.smithi032.stdout:0/500: write d4/da/d16/d33/f5e [3000538,66024] 0 2024-05-06T21:26:44.434 INFO:tasks.workunit.client.0.smithi032.stdout:0/501: readlink d4/da/d16/l91 0 2024-05-06T21:26:44.434 INFO:tasks.workunit.client.0.smithi032.stdout:0/502: write d4/d3e/d63/f56 [396379,45349] 0 2024-05-06T21:26:44.434 INFO:tasks.workunit.client.0.smithi032.stdout:0/503: write d4/da/d14/d1a/f1b [1980900,90510] 0 2024-05-06T21:26:44.435 INFO:tasks.workunit.client.1.smithi154.stdout:5/216: dread d2/d3/d21/d22/d25/f32 [0,4194304] 0 2024-05-06T21:26:44.435 INFO:tasks.workunit.client.1.smithi154.stdout:6/140: stat d8/d11/c21 0 2024-05-06T21:26:44.435 INFO:tasks.workunit.client.1.smithi154.stdout:6/141: write d8/f2b [262549,28026] 0 2024-05-06T21:26:44.435 INFO:tasks.workunit.client.0.smithi032.stdout:2/454: symlink df/la3 0 2024-05-06T21:26:44.436 INFO:tasks.workunit.client.0.smithi032.stdout:2/455: readlink df/l32 0 2024-05-06T21:26:44.436 INFO:tasks.workunit.client.0.smithi032.stdout:2/456: write df/d19/d1e/d71/d5f/d7d/d25/f37 [3315627,89135] 0 2024-05-06T21:26:44.436 INFO:tasks.workunit.client.0.smithi032.stdout:2/457: stat df/d19/d1e/d1f/d2e/d33 0 2024-05-06T21:26:44.437 INFO:tasks.workunit.client.1.smithi154.stdout:3/221: truncate d0/d2/f45 2733618 0 2024-05-06T21:26:44.437 INFO:tasks.workunit.client.0.smithi032.stdout:2/458: read df/d19/d1e/d35/f56 [28575,630] 0 2024-05-06T21:26:44.440 INFO:tasks.workunit.client.1.smithi154.stdout:6/142: rename d8/d11/l12 to d8/d11/d2d/l34 0 2024-05-06T21:26:44.442 INFO:tasks.workunit.client.1.smithi154.stdout:3/222: creat d0/da/d1a/d28/d17/f49 x:0 0 0 2024-05-06T21:26:44.443 INFO:tasks.workunit.client.1.smithi154.stdout:3/223: readlink d0/d2/l36 0 2024-05-06T21:26:44.443 INFO:tasks.workunit.client.0.smithi032.stdout:8/646: symlink d0/d1c/d5e/lc4 0 2024-05-06T21:26:44.443 INFO:tasks.workunit.client.0.smithi032.stdout:7/573: dread db/d12/d16/f72 [0,4194304] 0 2024-05-06T21:26:44.443 INFO:tasks.workunit.client.0.smithi032.stdout:1/496: mkdir db/d2a/da2 0 2024-05-06T21:26:44.445 INFO:tasks.workunit.client.0.smithi032.stdout:4/632: link d2/d16/c42 d2/d13/daa/db8/cd1 0 2024-05-06T21:26:44.447 INFO:tasks.workunit.client.1.smithi154.stdout:6/143: rename d8/cd to d8/d11/c35 0 2024-05-06T21:26:44.449 INFO:tasks.workunit.client.1.smithi154.stdout:0/199: getdents d6 0 2024-05-06T21:26:44.450 INFO:tasks.workunit.client.1.smithi154.stdout:3/224: mknod d0/da/d1a/d28/d2f/d38/d48/c4a 0 2024-05-06T21:26:44.450 INFO:tasks.workunit.client.1.smithi154.stdout:3/225: write d0/f32 [1629924,57417] 0 2024-05-06T21:26:44.451 INFO:tasks.workunit.client.1.smithi154.stdout:6/144: mknod d8/d11/d33/c36 0 2024-05-06T21:26:44.451 INFO:tasks.workunit.client.1.smithi154.stdout:6/145: truncate d8/f31 284334 0 2024-05-06T21:26:44.452 INFO:tasks.workunit.client.1.smithi154.stdout:6/146: stat d8/d11/d2d/f2f 0 2024-05-06T21:26:44.452 INFO:tasks.workunit.client.1.smithi154.stdout:6/147: write d8/f2c [2803508,52546] 0 2024-05-06T21:26:44.452 INFO:tasks.workunit.client.0.smithi032.stdout:6/647: dwrite d8/d33/f36 [4194304,4194304] 0 2024-05-06T21:26:44.452 INFO:tasks.workunit.client.1.smithi154.stdout:0/200: mknod d6/dc/d39/c3b 0 2024-05-06T21:26:44.452 INFO:tasks.workunit.client.1.smithi154.stdout:0/201: getdents d6 0 2024-05-06T21:26:44.453 INFO:tasks.workunit.client.1.smithi154.stdout:6/148: dread d8/f31 [0,4194304] 0 2024-05-06T21:26:44.454 INFO:tasks.workunit.client.0.smithi032.stdout:3/615: dwrite d1/d4/d11/f2b [4194304,4194304] 0 2024-05-06T21:26:44.454 INFO:tasks.workunit.client.0.smithi032.stdout:3/616: fdatasync d1/d4/fd5 0 2024-05-06T21:26:44.454 INFO:tasks.workunit.client.0.smithi032.stdout:3/617: fsync d1/f14 0 2024-05-06T21:26:44.454 INFO:tasks.workunit.client.0.smithi032.stdout:2/459: dwrite df/d19/d1e/d54/f59 [0,4194304] 0 2024-05-06T21:26:44.454 INFO:tasks.workunit.client.0.smithi032.stdout:7/574: rename db/d12/d16/d21/f8d to db/d12/d87/fb1 0 2024-05-06T21:26:44.455 INFO:tasks.workunit.client.1.smithi154.stdout:0/202: mkdir d6/dc/d3c 0 2024-05-06T21:26:44.455 INFO:tasks.workunit.client.1.smithi154.stdout:6/149: mknod d8/d13/d20/c37 0 2024-05-06T21:26:44.455 INFO:tasks.workunit.client.1.smithi154.stdout:6/150: write d8/f10 [124938,118988] 0 2024-05-06T21:26:44.456 INFO:tasks.workunit.client.1.smithi154.stdout:0/203: mkdir d6/d27/d3d 0 2024-05-06T21:26:44.456 INFO:tasks.workunit.client.1.smithi154.stdout:0/204: stat d6/d10/d36/f37 0 2024-05-06T21:26:44.456 INFO:tasks.workunit.client.1.smithi154.stdout:0/205: stat d6/dc/d39 0 2024-05-06T21:26:44.457 INFO:tasks.workunit.client.1.smithi154.stdout:6/151: rename d8/d13/l32 to d8/d13/l38 0 2024-05-06T21:26:44.457 INFO:tasks.workunit.client.1.smithi154.stdout:6/152: chown d8/f31 14765953 1 2024-05-06T21:26:44.461 INFO:tasks.workunit.client.1.smithi154.stdout:0/206: dread d6/dc/f34 [0,4194304] 0 2024-05-06T21:26:44.461 INFO:tasks.workunit.client.1.smithi154.stdout:0/207: stat d6/dc 0 2024-05-06T21:26:44.462 INFO:tasks.workunit.client.0.smithi032.stdout:2/460: dread df/d19/d1e/d54/f59 [0,4194304] 0 2024-05-06T21:26:44.462 INFO:tasks.workunit.client.0.smithi032.stdout:2/461: chown df/d19/d1e/d71/d5f/d7d/d65 888 1 2024-05-06T21:26:44.462 INFO:tasks.workunit.client.0.smithi032.stdout:2/462: write df/d19/d1e/d71/d5f/d7d/d25/d2d/f47 [80702,25440] 0 2024-05-06T21:26:44.462 INFO:tasks.workunit.client.0.smithi032.stdout:2/463: readlink df/d19/d1e/d35/l8f 0 2024-05-06T21:26:44.463 INFO:tasks.workunit.client.1.smithi154.stdout:0/208: rmdir d6/d27/d3d 0 2024-05-06T21:26:44.464 INFO:tasks.workunit.client.0.smithi032.stdout:4/633: fsync d2/d2c/d31/f5a 0 2024-05-06T21:26:44.467 INFO:tasks.workunit.client.0.smithi032.stdout:3/618: rename d1/d4/f3e to d1/d4/da/d31/d9b/daa/fd8 0 2024-05-06T21:26:44.467 INFO:tasks.workunit.client.0.smithi032.stdout:3/619: write d1/d4/da/d4e/f91 [680161,23807] 0 2024-05-06T21:26:44.467 INFO:tasks.workunit.client.0.smithi032.stdout:1/497: mkdir db/d16/da3 0 2024-05-06T21:26:44.468 INFO:tasks.workunit.client.0.smithi032.stdout:0/504: link d4/l3d d4/l9c 0 2024-05-06T21:26:44.470 INFO:tasks.workunit.client.0.smithi032.stdout:7/575: rename db/d12/d16/d2a/d39/d8b/faf to db/d12/d16/d21/d41/fb2 0 2024-05-06T21:26:44.470 INFO:tasks.workunit.client.0.smithi032.stdout:7/576: dread - db/d12/d16/d21/d41/d4b/f65 zero size 2024-05-06T21:26:44.471 INFO:tasks.workunit.client.0.smithi032.stdout:3/620: rename d1/d4/da/d31/dd7 to d1/d4/da/d9f/db8/dd0/dd9 0 2024-05-06T21:26:44.472 INFO:tasks.workunit.client.0.smithi032.stdout:7/577: creat db/d12/d16/d21/d41/d78/fb3 x:0 0 0 2024-05-06T21:26:44.472 INFO:tasks.workunit.client.0.smithi032.stdout:7/578: chown db/d12/d16/d2a/d39/d3b/d9c/la9 6962 1 2024-05-06T21:26:44.474 INFO:tasks.workunit.client.1.smithi154.stdout:9/265: sync 2024-05-06T21:26:44.477 INFO:tasks.workunit.client.1.smithi154.stdout:9/266: link d5/d20/d37/f50 d5/d14/d31/f5e 0 2024-05-06T21:26:44.477 INFO:tasks.workunit.client.1.smithi154.stdout:9/267: stat d5/f6 0 2024-05-06T21:26:44.478 INFO:tasks.workunit.client.0.smithi032.stdout:7/579: creat db/d12/d16/fb4 x:0 0 0 2024-05-06T21:26:44.479 INFO:tasks.workunit.client.1.smithi154.stdout:9/268: link d5/d14/d31/d39/f4a d5/d20/d37/f5f 0 2024-05-06T21:26:44.479 INFO:tasks.workunit.client.1.smithi154.stdout:3/226: dwrite d0/da/d1a/d28/d17/f2c [0,4194304] 0 2024-05-06T21:26:44.483 INFO:tasks.workunit.client.1.smithi154.stdout:3/227: creat d0/da/db/dd/d1c/d21/d37/f4b x:0 0 0 2024-05-06T21:26:44.483 INFO:tasks.workunit.client.1.smithi154.stdout:3/228: write d0/fe [2500796,27578] 0 2024-05-06T21:26:44.484 INFO:tasks.workunit.client.1.smithi154.stdout:9/269: rename d5/f6 to d5/d14/f60 0 2024-05-06T21:26:44.486 INFO:tasks.workunit.client.0.smithi032.stdout:2/464: dread df/d19/d1e/d71/d5f/d7d/d65/f74 [0,4194304] 0 2024-05-06T21:26:44.487 INFO:tasks.workunit.client.1.smithi154.stdout:3/229: rename d0/da/d1a/d28/d17/l3b to d0/l4c 0 2024-05-06T21:26:44.489 INFO:tasks.workunit.client.0.smithi032.stdout:4/634: write d2/d16/d44/d45/fcd [327028,46604] 0 2024-05-06T21:26:44.491 INFO:tasks.workunit.client.0.smithi032.stdout:4/635: truncate d2/d2c/d31/f5a 2531271 0 2024-05-06T21:26:44.491 INFO:tasks.workunit.client.0.smithi032.stdout:4/636: stat d2/d16/d44/d45/d4e/cac 0 2024-05-06T21:26:44.493 INFO:tasks.workunit.client.0.smithi032.stdout:7/580: dwrite db/d12/d16/d2a/d39/d3b/f4e [0,4194304] 0 2024-05-06T21:26:44.495 INFO:tasks.workunit.client.0.smithi032.stdout:0/505: read d4/d3e/f49 [2174919,37737] 0 2024-05-06T21:26:44.495 INFO:tasks.workunit.client.0.smithi032.stdout:0/506: fdatasync d4/da/d16/d4f/f75 0 2024-05-06T21:26:44.496 INFO:tasks.workunit.client.0.smithi032.stdout:0/507: fdatasync d4/da/d16/d33/d46/f50 0 2024-05-06T21:26:44.496 INFO:tasks.workunit.client.0.smithi032.stdout:0/508: creat d4/da/d16/d4f/f9d x:0 0 0 2024-05-06T21:26:44.496 INFO:tasks.workunit.client.0.smithi032.stdout:7/581: mkdir db/d12/d87/db5 0 2024-05-06T21:26:44.496 INFO:tasks.workunit.client.0.smithi032.stdout:0/509: mkdir d4/da/d16/d33/d9e 0 2024-05-06T21:26:44.497 INFO:tasks.workunit.client.0.smithi032.stdout:7/582: rmdir db/d12/d16/d2a/d39 39 2024-05-06T21:26:44.498 INFO:tasks.workunit.client.0.smithi032.stdout:0/510: symlink d4/da/d16/d33/d46/l9f 0 2024-05-06T21:26:44.499 INFO:tasks.workunit.client.0.smithi032.stdout:7/583: symlink db/d12/d87/db5/lb6 0 2024-05-06T21:26:44.500 INFO:tasks.workunit.client.0.smithi032.stdout:0/511: creat d4/da/d16/fa0 x:0 0 0 2024-05-06T21:26:44.501 INFO:tasks.workunit.client.0.smithi032.stdout:7/584: symlink db/d12/d16/d2a/d39/d3b/dac/lb7 0 2024-05-06T21:26:44.501 INFO:tasks.workunit.client.0.smithi032.stdout:0/512: symlink d4/d3e/d63/la1 0 2024-05-06T21:26:44.502 INFO:tasks.workunit.client.0.smithi032.stdout:0/513: write d4/f6 [2860702,101506] 0 2024-05-06T21:26:44.502 INFO:tasks.workunit.client.0.smithi032.stdout:7/585: getdents db/d12/d16/d21/d84 0 2024-05-06T21:26:44.503 INFO:tasks.workunit.client.0.smithi032.stdout:0/514: creat d4/da/d14/d1a/fa2 x:0 0 0 2024-05-06T21:26:44.504 INFO:tasks.workunit.client.0.smithi032.stdout:7/586: symlink db/d12/d16/d2a/d39/lb8 0 2024-05-06T21:26:44.504 INFO:tasks.workunit.client.0.smithi032.stdout:7/587: write db/d12/f61 [519758,42694] 0 2024-05-06T21:26:44.504 INFO:tasks.workunit.client.0.smithi032.stdout:7/588: write db/d12/d16/d21/fa3 [839194,20627] 0 2024-05-06T21:26:44.504 INFO:tasks.workunit.client.0.smithi032.stdout:7/589: chown db/d12/d49 0 1 2024-05-06T21:26:44.504 INFO:tasks.workunit.client.0.smithi032.stdout:0/515: mknod d4/da/d14/ca3 0 2024-05-06T21:26:44.505 INFO:tasks.workunit.client.0.smithi032.stdout:0/516: chown d4/d3e 1 1 2024-05-06T21:26:44.505 INFO:tasks.workunit.client.0.smithi032.stdout:7/590: read db/d12/d16/f3f [2630100,119923] 0 2024-05-06T21:26:44.506 INFO:tasks.workunit.client.0.smithi032.stdout:0/517: link d4/d3e/d42/f5f d4/da/d14/d1a/fa4 0 2024-05-06T21:26:44.506 INFO:tasks.workunit.client.0.smithi032.stdout:0/518: dread - d4/da/f81 zero size 2024-05-06T21:26:44.506 INFO:tasks.workunit.client.0.smithi032.stdout:0/519: creat d4/da/d16/d4f/fa5 x:0 0 0 2024-05-06T21:26:44.506 INFO:tasks.workunit.client.0.smithi032.stdout:7/591: symlink db/d12/d16/d2a/d39/lb9 0 2024-05-06T21:26:44.508 INFO:tasks.workunit.client.0.smithi032.stdout:0/520: readlink d4/l20 0 2024-05-06T21:26:44.508 INFO:tasks.workunit.client.0.smithi032.stdout:0/521: creat d4/da/d14/d4a/fa6 x:0 0 0 2024-05-06T21:26:44.508 INFO:tasks.workunit.client.1.smithi154.stdout:3/230: dwrite d0/da/d1a/d28/d2f/f34 [0,4194304] 0 2024-05-06T21:26:44.508 INFO:tasks.workunit.client.1.smithi154.stdout:3/231: read d0/da/db/f10 [1550290,66007] 0 2024-05-06T21:26:44.508 INFO:tasks.workunit.client.1.smithi154.stdout:3/232: readlink d0/da/d1a/d28/l12 0 2024-05-06T21:26:44.509 INFO:tasks.workunit.client.0.smithi032.stdout:0/522: mkdir d4/da/d16/d33/da7 0 2024-05-06T21:26:44.509 INFO:tasks.workunit.client.0.smithi032.stdout:0/523: dread - d4/da/d16/fa0 zero size 2024-05-06T21:26:44.510 INFO:tasks.workunit.client.0.smithi032.stdout:0/524: creat d4/da/d14/d4a/fa8 x:0 0 0 2024-05-06T21:26:44.510 INFO:tasks.workunit.client.0.smithi032.stdout:0/525: readlink d4/da/d16/d33/d46/l9f 0 2024-05-06T21:26:44.510 INFO:tasks.workunit.client.0.smithi032.stdout:0/526: readlink d4/l4e 0 2024-05-06T21:26:44.510 INFO:tasks.workunit.client.0.smithi032.stdout:0/527: write d4/d3e/f49 [4579769,46097] 0 2024-05-06T21:26:44.511 INFO:tasks.workunit.client.0.smithi032.stdout:0/528: chown d4/f1f 3721121 1 2024-05-06T21:26:44.511 INFO:tasks.workunit.client.0.smithi032.stdout:0/529: creat d4/da/d16/d4f/fa9 x:0 0 0 2024-05-06T21:26:44.513 INFO:tasks.workunit.client.0.smithi032.stdout:0/530: truncate d4/da/d16/f18 3603356 0 2024-05-06T21:26:44.520 INFO:tasks.workunit.client.0.smithi032.stdout:0/531: read d4/f7 [1432885,96203] 0 2024-05-06T21:26:44.520 INFO:tasks.workunit.client.0.smithi032.stdout:0/532: write d4/d3e/d63/d6c/f77 [608634,127488] 0 2024-05-06T21:26:44.521 INFO:tasks.workunit.client.0.smithi032.stdout:0/533: read d4/da/d16/d33/d46/f6e [946047,39571] 0 2024-05-06T21:26:44.521 INFO:tasks.workunit.client.0.smithi032.stdout:7/592: dwrite db/d12/d16/f57 [0,4194304] 0 2024-05-06T21:26:44.591 INFO:tasks.workunit.client.0.smithi032.stdout:8/647: dwrite d0/d1c/d5e/d67/dc3/d57/d5d/faa [0,4194304] 0 2024-05-06T21:26:44.592 INFO:tasks.workunit.client.1.smithi154.stdout:6/153: dwrite d8/d11/f24 [0,4194304] 0 2024-05-06T21:26:44.593 INFO:tasks.workunit.client.0.smithi032.stdout:6/648: dwrite d8/dd/d18/d13/f71 [0,4194304] 0 2024-05-06T21:26:44.594 INFO:tasks.workunit.client.0.smithi032.stdout:3/621: dwrite d1/d4/da/d31/d47/d4a/f5f [0,4194304] 0 2024-05-06T21:26:44.595 INFO:tasks.workunit.client.0.smithi032.stdout:1/498: rename db/d2a to db/d47/d4a/da4 0 2024-05-06T21:26:44.595 INFO:tasks.workunit.client.0.smithi032.stdout:1/499: fsync db/d37/f54 0 2024-05-06T21:26:44.595 INFO:tasks.workunit.client.0.smithi032.stdout:1/500: stat db/d16/d46/d57/d58/d68/c9a 0 2024-05-06T21:26:44.596 INFO:tasks.workunit.client.0.smithi032.stdout:8/648: getdents d0/d1c/d5e/d67/dc3 0 2024-05-06T21:26:44.596 INFO:tasks.workunit.client.0.smithi032.stdout:2/465: dwrite df/d19/d1e/d71/d5f/d7d/d25/f3b [4194304,4194304] 0 2024-05-06T21:26:44.596 INFO:tasks.workunit.client.0.smithi032.stdout:2/466: readlink df/d19/d1e/d1f/d2e/d33/l66 0 2024-05-06T21:26:44.598 INFO:tasks.workunit.client.0.smithi032.stdout:4/637: rmdir d2/d16 39 2024-05-06T21:26:44.598 INFO:tasks.workunit.client.0.smithi032.stdout:6/649: stat d8/d33/l80 0 2024-05-06T21:26:44.598 INFO:tasks.workunit.client.0.smithi032.stdout:6/650: fdatasync d8/d3d/d49/f76 0 2024-05-06T21:26:44.601 INFO:tasks.workunit.client.0.smithi032.stdout:6/651: read d8/d3d/d73/d87/f64 [363594,108504] 0 2024-05-06T21:26:44.604 INFO:tasks.workunit.client.0.smithi032.stdout:3/622: write d1/d4/da/d4e/d41/d97/d67/f7b [2920123,8455] 0 2024-05-06T21:26:44.607 INFO:tasks.workunit.client.1.smithi154.stdout:9/270: rmdir d5/d14/d31 39 2024-05-06T21:26:44.607 INFO:tasks.workunit.client.1.smithi154.stdout:9/271: fsync d5/d14/d31/f47 0 2024-05-06T21:26:44.607 INFO:tasks.workunit.client.0.smithi032.stdout:8/649: dread d0/f37 [0,4194304] 0 2024-05-06T21:26:44.608 INFO:tasks.workunit.client.1.smithi154.stdout:9/272: truncate d5/d20/d52/f4f 662976 0 2024-05-06T21:26:44.609 INFO:tasks.workunit.client.1.smithi154.stdout:9/273: rmdir d5/d2e/d56 39 2024-05-06T21:26:44.610 INFO:tasks.workunit.client.1.smithi154.stdout:9/274: fdatasync d5/f1a 0 2024-05-06T21:26:44.611 INFO:tasks.workunit.client.1.smithi154.stdout:9/275: mknod d5/c61 0 2024-05-06T21:26:44.611 INFO:tasks.workunit.client.1.smithi154.stdout:9/276: chown d5/d2e/l34 672947 1 2024-05-06T21:26:44.616 INFO:tasks.workunit.client.0.smithi032.stdout:4/638: truncate d2/d13/f57 241185 0 2024-05-06T21:26:44.616 INFO:tasks.workunit.client.1.smithi154.stdout:3/233: truncate d0/d2/f45 969330 0 2024-05-06T21:26:44.617 INFO:tasks.workunit.client.0.smithi032.stdout:6/652: creat d8/dd/d18/d3b/d90/fc1 x:0 0 0 2024-05-06T21:26:44.617 INFO:tasks.workunit.client.0.smithi032.stdout:6/653: stat d8/db6 0 2024-05-06T21:26:44.617 INFO:tasks.workunit.client.0.smithi032.stdout:6/654: dread - d8/dd/d18/d13/d7a/fb5 zero size 2024-05-06T21:26:44.618 INFO:tasks.workunit.client.0.smithi032.stdout:2/467: dwrite df/d19/d1e/d35/d3f/d46/f5a [0,4194304] 0 2024-05-06T21:26:44.618 INFO:tasks.workunit.client.1.smithi154.stdout:6/154: dwrite d8/d11/f24 [4194304,4194304] 0 2024-05-06T21:26:44.619 INFO:tasks.workunit.client.0.smithi032.stdout:1/501: rmdir db/d37/d52 39 2024-05-06T21:26:44.619 INFO:tasks.workunit.client.1.smithi154.stdout:3/234: mkdir d0/da/d1a/d28/d4d 0 2024-05-06T21:26:44.620 INFO:tasks.workunit.client.1.smithi154.stdout:3/235: chown d0/da/l3f 39656256 1 2024-05-06T21:26:44.620 INFO:tasks.workunit.client.1.smithi154.stdout:3/236: dread - d0/da/db/dd/d1c/d21/f42 zero size 2024-05-06T21:26:44.622 INFO:tasks.workunit.client.1.smithi154.stdout:8/186: sync 2024-05-06T21:26:44.622 INFO:tasks.workunit.client.1.smithi154.stdout:2/157: sync 2024-05-06T21:26:44.622 INFO:tasks.workunit.client.1.smithi154.stdout:4/172: sync 2024-05-06T21:26:44.622 INFO:tasks.workunit.client.0.smithi032.stdout:6/655: dread d8/f31 [0,4194304] 0 2024-05-06T21:26:44.623 INFO:tasks.workunit.client.0.smithi032.stdout:3/623: creat d1/d4/db7/d8b/fda x:0 0 0 2024-05-06T21:26:44.625 INFO:tasks.workunit.client.1.smithi154.stdout:8/187: truncate d3/ff 1418966 0 2024-05-06T21:26:44.625 INFO:tasks.workunit.client.1.smithi154.stdout:8/188: dread - d3/d14/d1a/d22/f3a zero size 2024-05-06T21:26:44.625 INFO:tasks.workunit.client.0.smithi032.stdout:8/650: mknod d0/d1c/d5e/d67/d9d/cc5 0 2024-05-06T21:26:44.627 INFO:tasks.workunit.client.1.smithi154.stdout:2/158: mkdir db/de/d16/d33 0 2024-05-06T21:26:44.630 INFO:tasks.workunit.client.1.smithi154.stdout:4/173: link d0/d10/d11/f21 d0/d2/d2a/f37 0 2024-05-06T21:26:44.632 INFO:tasks.workunit.client.0.smithi032.stdout:2/468: mknod df/d19/d1e/d35/d3f/ca4 0 2024-05-06T21:26:44.632 INFO:tasks.workunit.client.0.smithi032.stdout:2/469: fdatasync df/d19/d1e/d35/f3d 0 2024-05-06T21:26:44.632 INFO:tasks.workunit.client.1.smithi154.stdout:4/174: creat d0/d10/f38 x:0 0 0 2024-05-06T21:26:44.635 INFO:tasks.workunit.client.1.smithi154.stdout:4/175: mkdir d0/d10/d11/d1a/d31/d39 0 2024-05-06T21:26:44.636 INFO:tasks.workunit.client.0.smithi032.stdout:6/656: rename d8/dd/d18/d22/c48 to d8/d3d/d73/d87/cc2 0 2024-05-06T21:26:44.637 INFO:tasks.workunit.client.1.smithi154.stdout:3/237: write d0/da/db/dd/fc [2702595,64747] 0 2024-05-06T21:26:44.637 INFO:tasks.workunit.client.1.smithi154.stdout:3/238: fsync d0/da/d1a/d28/d17/f1e 0 2024-05-06T21:26:44.637 INFO:tasks.workunit.client.1.smithi154.stdout:3/239: creat d0/da/db/dd/d1c/d21/f4e x:0 0 0 2024-05-06T21:26:44.637 INFO:tasks.workunit.client.1.smithi154.stdout:3/240: creat d0/da/d1a/d28/d17/f4f x:0 0 0 2024-05-06T21:26:44.638 INFO:tasks.workunit.client.1.smithi154.stdout:3/241: chown d0/da/db/dd/d1c/d21/f42 494949 1 2024-05-06T21:26:44.638 INFO:tasks.workunit.client.1.smithi154.stdout:3/242: chown d0/da/d1a/d28/d2f/d38/d48 86110 1 2024-05-06T21:26:44.638 INFO:tasks.workunit.client.1.smithi154.stdout:3/243: stat d0/l26 0 2024-05-06T21:26:44.638 INFO:tasks.workunit.client.1.smithi154.stdout:3/244: creat d0/f50 x:0 0 0 2024-05-06T21:26:44.638 INFO:tasks.workunit.client.1.smithi154.stdout:3/245: dread - d0/da/db/dd/d1c/d21/f42 zero size 2024-05-06T21:26:44.638 INFO:tasks.workunit.client.0.smithi032.stdout:4/639: creat d2/d16/d44/d74/d7e/fd2 x:0 0 0 2024-05-06T21:26:44.639 INFO:tasks.workunit.client.1.smithi154.stdout:4/176: mkdir d0/d10/d11/d1a/d31/d3a 0 2024-05-06T21:26:44.639 INFO:tasks.workunit.client.0.smithi032.stdout:2/470: creat df/d19/d1e/d1f/d2e/d33/fa5 x:0 0 0 2024-05-06T21:26:44.642 INFO:tasks.workunit.client.0.smithi032.stdout:3/624: rename d1/d4/da/d9f/d74/fa4 to d1/d2a/d71/d9d/fdb 0 2024-05-06T21:26:44.642 INFO:tasks.workunit.client.1.smithi154.stdout:3/246: symlink d0/da/d1a/d28/d2f/d38/l51 0 2024-05-06T21:26:44.643 INFO:tasks.workunit.client.0.smithi032.stdout:7/593: rmdir db/d12/d16/d2a/d39/d3b 39 2024-05-06T21:26:44.643 INFO:tasks.workunit.client.0.smithi032.stdout:6/657: dread d8/dd/d18/d3b/d90/fbc [0,4194304] 0 2024-05-06T21:26:44.644 INFO:tasks.workunit.client.1.smithi154.stdout:4/177: creat d0/f3b x:0 0 0 2024-05-06T21:26:44.644 INFO:tasks.workunit.client.1.smithi154.stdout:4/178: chown d0/d10/d11/d1a/f28 2 1 2024-05-06T21:26:44.644 INFO:tasks.workunit.client.1.smithi154.stdout:4/179: chown d0/c4 13283277 1 2024-05-06T21:26:44.644 INFO:tasks.workunit.client.0.smithi032.stdout:3/625: mknod d1/d4/da/d9f/db8/dd0/cdc 0 2024-05-06T21:26:44.644 INFO:tasks.workunit.client.0.smithi032.stdout:3/626: creat d1/fdd x:0 0 0 2024-05-06T21:26:44.644 INFO:tasks.workunit.client.0.smithi032.stdout:3/627: read d1/d2a/f37 [1005195,20882] 0 2024-05-06T21:26:44.644 INFO:tasks.workunit.client.0.smithi032.stdout:3/628: stat d1 0 2024-05-06T21:26:44.645 INFO:tasks.workunit.client.1.smithi154.stdout:5/217: sync 2024-05-06T21:26:44.645 INFO:tasks.workunit.client.1.smithi154.stdout:0/209: sync 2024-05-06T21:26:44.645 INFO:tasks.workunit.client.1.smithi154.stdout:7/96: sync 2024-05-06T21:26:44.645 INFO:tasks.workunit.client.1.smithi154.stdout:7/97: dread - d6/de/f19 zero size 2024-05-06T21:26:44.645 INFO:tasks.workunit.client.1.smithi154.stdout:5/218: truncate d2/d3/d21/d22/f36 778826 0 2024-05-06T21:26:44.645 INFO:tasks.workunit.client.1.smithi154.stdout:3/247: truncate d0/da/d1a/d28/d17/f1e 5317048 0 2024-05-06T21:26:44.646 INFO:tasks.workunit.client.1.smithi154.stdout:3/248: write d0/da/db/dd/d1c/d21/f42 [885586,56405] 0 2024-05-06T21:26:44.646 INFO:tasks.workunit.client.0.smithi032.stdout:7/594: link db/d12/d16/d21/d41/l60 db/d12/d16/d2a/d39/d3b/d9c/lba 0 2024-05-06T21:26:44.646 INFO:tasks.workunit.client.1.smithi154.stdout:4/180: mkdir d0/d10/d11/d1a/d31/d39/d3c 0 2024-05-06T21:26:44.647 INFO:tasks.workunit.client.1.smithi154.stdout:5/219: mknod d2/d3/c47 0 2024-05-06T21:26:44.647 INFO:tasks.workunit.client.1.smithi154.stdout:6/155: dwrite d8/d11/d2d/f2f [0,4194304] 0 2024-05-06T21:26:44.648 INFO:tasks.workunit.client.0.smithi032.stdout:6/658: symlink d8/d33/lc3 0 2024-05-06T21:26:44.648 INFO:tasks.workunit.client.1.smithi154.stdout:0/210: dread d6/f3a [0,4194304] 0 2024-05-06T21:26:44.648 INFO:tasks.workunit.client.1.smithi154.stdout:7/98: symlink d6/d20/l22 0 2024-05-06T21:26:44.648 INFO:tasks.workunit.client.1.smithi154.stdout:7/99: readlink d6/d20/l22 0 2024-05-06T21:26:44.649 INFO:tasks.workunit.client.1.smithi154.stdout:3/249: mkdir d0/da/db/d52 0 2024-05-06T21:26:44.649 INFO:tasks.workunit.client.1.smithi154.stdout:3/250: creat d0/da/db/dd/f53 x:0 0 0 2024-05-06T21:26:44.650 INFO:tasks.workunit.client.1.smithi154.stdout:4/181: rmdir d0/d10/d11/d1a/d31/d39/d3c 0 2024-05-06T21:26:44.651 INFO:tasks.workunit.client.1.smithi154.stdout:5/220: mkdir d2/d48 0 2024-05-06T21:26:44.651 INFO:tasks.workunit.client.0.smithi032.stdout:3/629: link d1/d4/da/d4e/d41/d97/d67/da6/c96 d1/d4/da/d31/d47/d4a/d68/cde 0 2024-05-06T21:26:44.653 INFO:tasks.workunit.client.1.smithi154.stdout:1/210: sync 2024-05-06T21:26:44.653 INFO:tasks.workunit.client.1.smithi154.stdout:1/211: readlink d6/db/l44 0 2024-05-06T21:26:44.653 INFO:tasks.workunit.client.0.smithi032.stdout:0/534: rmdir d4/d3e/d42 39 2024-05-06T21:26:44.653 INFO:tasks.workunit.client.0.smithi032.stdout:0/535: write d4/da/d16/d4f/f75 [428977,51868] 0 2024-05-06T21:26:44.654 INFO:tasks.workunit.client.1.smithi154.stdout:9/277: dwrite d5/d14/d31/d39/f4a [0,4194304] 0 2024-05-06T21:26:44.654 INFO:tasks.workunit.client.1.smithi154.stdout:9/278: write d5/d20/f23 [62159,91833] 0 2024-05-06T21:26:44.654 INFO:tasks.workunit.client.1.smithi154.stdout:6/156: truncate d8/d11/f1d 2062006 0 2024-05-06T21:26:44.655 INFO:tasks.workunit.client.0.smithi032.stdout:6/659: link d8/dd/d1b/ca8 d8/db6/cc4 0 2024-05-06T21:26:44.655 INFO:tasks.workunit.client.0.smithi032.stdout:7/595: dread db/d12/f51 [0,4194304] 0 2024-05-06T21:26:44.655 INFO:tasks.workunit.client.1.smithi154.stdout:0/211: creat d6/dc/d39/f3e x:0 0 0 2024-05-06T21:26:44.656 INFO:tasks.workunit.client.0.smithi032.stdout:4/640: write f1 [6729717,26281] 0 2024-05-06T21:26:44.656 INFO:tasks.workunit.client.0.smithi032.stdout:8/651: dwrite d0/d1c/d5e/f7a [0,4194304] 0 2024-05-06T21:26:44.657 INFO:tasks.workunit.client.0.smithi032.stdout:8/652: fsync d0/d1b/d47/f64 0 2024-05-06T21:26:44.657 INFO:tasks.workunit.client.0.smithi032.stdout:8/653: fdatasync d0/d1b/d47/f87 0 2024-05-06T21:26:44.657 INFO:tasks.workunit.client.0.smithi032.stdout:8/654: readlink d0/d1c/l2c 0 2024-05-06T21:26:44.657 INFO:tasks.workunit.client.0.smithi032.stdout:8/655: write d0/d1c/d5e/d67/dc3/d97/f98 [3388487,17247] 0 2024-05-06T21:26:44.657 INFO:tasks.workunit.client.0.smithi032.stdout:8/656: dread - d0/d1c/d5e/d67/d9d/fad zero size 2024-05-06T21:26:44.657 INFO:tasks.workunit.client.0.smithi032.stdout:1/502: dwrite db/f51 [0,4194304] 0 2024-05-06T21:26:44.657 INFO:tasks.workunit.client.0.smithi032.stdout:3/630: link d1/d4/da/d4e/d41/d45/l54 d1/d4/da/d4e/d41/d97/ldf 0 2024-05-06T21:26:44.658 INFO:tasks.workunit.client.0.smithi032.stdout:0/536: creat d4/da/d16/d33/da7/faa x:0 0 0 2024-05-06T21:26:44.658 INFO:tasks.workunit.client.1.smithi154.stdout:7/100: mkdir d6/de/d23 0 2024-05-06T21:26:44.660 INFO:tasks.workunit.client.0.smithi032.stdout:2/471: dread df/d19/d1e/d71/d5f/d7d/d25/f3b [0,4194304] 0 2024-05-06T21:26:44.661 INFO:tasks.workunit.client.1.smithi154.stdout:2/159: dwrite f5 [4194304,4194304] 0 2024-05-06T21:26:44.661 INFO:tasks.workunit.client.1.smithi154.stdout:2/160: chown db/de/d16/f28 14506997 1 2024-05-06T21:26:44.662 INFO:tasks.workunit.client.1.smithi154.stdout:3/251: dread d0/da/f18 [0,4194304] 0 2024-05-06T21:26:44.662 INFO:tasks.workunit.client.1.smithi154.stdout:3/252: creat d0/da/d1a/d28/d17/f54 x:0 0 0 2024-05-06T21:26:44.663 INFO:tasks.workunit.client.1.smithi154.stdout:5/221: rename d2/d6/dd/c10 to d2/d3/d21/d22/c49 0 2024-05-06T21:26:44.663 INFO:tasks.workunit.client.1.smithi154.stdout:3/253: write d0/da/db/dd/f3c [707353,11088] 0 2024-05-06T21:26:44.666 INFO:tasks.workunit.client.1.smithi154.stdout:1/212: truncate d6/f8 3565852 0 2024-05-06T21:26:44.666 INFO:tasks.workunit.client.1.smithi154.stdout:1/213: fsync d6/f24 0 2024-05-06T21:26:44.667 INFO:tasks.workunit.client.0.smithi032.stdout:8/657: dread d0/d1c/d5e/d67/dc3/f72 [0,4194304] 0 2024-05-06T21:26:44.667 INFO:tasks.workunit.client.0.smithi032.stdout:8/658: fsync d0/d1b/d47/f7d 0 2024-05-06T21:26:44.667 INFO:tasks.workunit.client.0.smithi032.stdout:4/641: rename d2/d16/d44/d45/f6e to d2/d16/d44/d54/d69/fd3 0 2024-05-06T21:26:44.668 INFO:tasks.workunit.client.1.smithi154.stdout:1/214: dread d6/f28 [0,4194304] 0 2024-05-06T21:26:44.668 INFO:tasks.workunit.client.1.smithi154.stdout:1/215: fsync d6/db/d10/d26/f23 0 2024-05-06T21:26:44.668 INFO:tasks.workunit.client.1.smithi154.stdout:9/279: mknod d5/d20/c62 0 2024-05-06T21:26:44.674 INFO:tasks.workunit.client.1.smithi154.stdout:2/161: write db/de/d16/f1f [2490813,94610] 0 2024-05-06T21:26:44.675 INFO:tasks.workunit.client.0.smithi032.stdout:8/659: read d0/d1c/d5e/d67/dc3/d57/d5d/faa [1073478,71905] 0 2024-05-06T21:26:44.676 INFO:tasks.workunit.client.1.smithi154.stdout:6/157: rename d8/d11/c27 to d8/c39 0 2024-05-06T21:26:44.676 INFO:tasks.workunit.client.1.smithi154.stdout:6/158: chown d8/d13/c26 64 1 2024-05-06T21:26:44.678 INFO:tasks.workunit.client.1.smithi154.stdout:6/159: write f1 [517313,5945] 0 2024-05-06T21:26:44.679 INFO:tasks.workunit.client.0.smithi032.stdout:3/631: unlink d1/d4/da/d31/d9b/daa/laf 0 2024-05-06T21:26:44.679 INFO:tasks.workunit.client.0.smithi032.stdout:3/632: dread - d1/fdd zero size 2024-05-06T21:26:44.680 INFO:tasks.workunit.client.1.smithi154.stdout:5/222: mknod d2/d6/dd/c4a 0 2024-05-06T21:26:44.681 INFO:tasks.workunit.client.1.smithi154.stdout:8/189: dread d3/ff [0,4194304] 0 2024-05-06T21:26:44.682 INFO:tasks.workunit.client.1.smithi154.stdout:8/190: fdatasync d3/d14/f20 0 2024-05-06T21:26:44.682 INFO:tasks.workunit.client.0.smithi032.stdout:7/596: mknod db/d12/d16/da1/cbb 0 2024-05-06T21:26:44.683 INFO:tasks.workunit.client.0.smithi032.stdout:7/597: creat db/d12/d16/d21/d41/d78/fbc x:0 0 0 2024-05-06T21:26:44.684 INFO:tasks.workunit.client.1.smithi154.stdout:0/212: dwrite d6/d10/f35 [4194304,4194304] 0 2024-05-06T21:26:44.686 INFO:tasks.workunit.client.0.smithi032.stdout:1/503: rename db/d16/d46/d55/l6e to db/d47/d4a/la5 0 2024-05-06T21:26:44.687 INFO:tasks.workunit.client.0.smithi032.stdout:8/660: symlink d0/d1c/d5e/d67/dc3/d97/lc6 0 2024-05-06T21:26:44.688 INFO:tasks.workunit.client.1.smithi154.stdout:2/162: symlink db/de/d16/d31/l34 0 2024-05-06T21:26:44.689 INFO:tasks.workunit.client.1.smithi154.stdout:6/160: dread d8/f10 [0,4194304] 0 2024-05-06T21:26:44.689 INFO:tasks.workunit.client.0.smithi032.stdout:3/633: creat d1/d4/da/d31/d47/d4a/d68/d7c/fe0 x:0 0 0 2024-05-06T21:26:44.690 INFO:tasks.workunit.client.0.smithi032.stdout:2/472: getdents df 0 2024-05-06T21:26:44.692 INFO:tasks.workunit.client.0.smithi032.stdout:7/598: mknod db/d12/d16/d2a/d39/d3b/d96/cbd 0 2024-05-06T21:26:44.694 INFO:tasks.workunit.client.0.smithi032.stdout:8/661: truncate d0/f19 3864465 0 2024-05-06T21:26:44.696 INFO:tasks.workunit.client.1.smithi154.stdout:8/191: creat d3/d14/d1a/d29/f3d x:0 0 0 2024-05-06T21:26:44.698 INFO:tasks.workunit.client.0.smithi032.stdout:6/660: dwrite d8/dd/d18/d13/f91 [4194304,4194304] 0 2024-05-06T21:26:44.698 INFO:tasks.workunit.client.1.smithi154.stdout:9/280: symlink d5/d14/l63 0 2024-05-06T21:26:44.698 INFO:tasks.workunit.client.1.smithi154.stdout:9/281: creat d5/d20/d37/f64 x:0 0 0 2024-05-06T21:26:44.699 INFO:tasks.workunit.client.0.smithi032.stdout:8/662: dread d0/d1c/d5e/d67/dc3/d57/d5d/faa [0,4194304] 0 2024-05-06T21:26:44.699 INFO:tasks.workunit.client.0.smithi032.stdout:3/634: mknod d1/d4/da/d4e/d5e/d84/ce1 0 2024-05-06T21:26:44.699 INFO:tasks.workunit.client.1.smithi154.stdout:7/101: rmdir d6 39 2024-05-06T21:26:44.700 INFO:tasks.workunit.client.0.smithi032.stdout:8/663: dread d0/d1b/d47/d91/da7/fba [0,4194304] 0 2024-05-06T21:26:44.700 INFO:tasks.workunit.client.1.smithi154.stdout:2/163: mknod db/d12/d19/c35 0 2024-05-06T21:26:44.702 INFO:tasks.workunit.client.1.smithi154.stdout:3/254: rmdir d0/da/db 39 2024-05-06T21:26:44.703 INFO:tasks.workunit.client.0.smithi032.stdout:7/599: link db/d12/d87/db5/lb6 db/d12/d49/d97/lbe 0 2024-05-06T21:26:44.703 INFO:tasks.workunit.client.0.smithi032.stdout:7/600: write db/d12/d49/f67 [1121398,7867] 0 2024-05-06T21:26:44.704 INFO:tasks.workunit.client.1.smithi154.stdout:0/213: dread d6/dc/f13 [4194304,4194304] 0 2024-05-06T21:26:44.704 INFO:tasks.workunit.client.1.smithi154.stdout:0/214: stat d6/dc/f34 0 2024-05-06T21:26:44.704 INFO:tasks.workunit.client.1.smithi154.stdout:0/215: stat d6/d10/l1e 0 2024-05-06T21:26:44.707 INFO:tasks.workunit.client.1.smithi154.stdout:8/192: mkdir d3/d14/d1a/d29/d3e 0 2024-05-06T21:26:44.707 INFO:tasks.workunit.client.1.smithi154.stdout:1/216: write d6/f8 [3797557,41579] 0 2024-05-06T21:26:44.707 INFO:tasks.workunit.client.1.smithi154.stdout:1/217: write d6/f28 [1240078,30879] 0 2024-05-06T21:26:44.709 INFO:tasks.workunit.client.0.smithi032.stdout:2/473: write df/d19/d1e/d1f/d2e/d33/f15 [470002,58611] 0 2024-05-06T21:26:44.709 INFO:tasks.workunit.client.0.smithi032.stdout:2/474: readlink df/d19/d1e/d42/l53 0 2024-05-06T21:26:44.711 INFO:tasks.workunit.client.0.smithi032.stdout:6/661: write d8/d3d/d49/d6b/f8d [785241,16276] 0 2024-05-06T21:26:44.711 INFO:tasks.workunit.client.0.smithi032.stdout:5/463: sync 2024-05-06T21:26:44.712 INFO:tasks.workunit.client.0.smithi032.stdout:9/555: sync 2024-05-06T21:26:44.712 INFO:tasks.workunit.client.0.smithi032.stdout:8/664: mknod d0/d1c/cc7 0 2024-05-06T21:26:44.712 INFO:tasks.workunit.client.1.smithi154.stdout:7/102: dread d6/fd [0,4194304] 0 2024-05-06T21:26:44.712 INFO:tasks.workunit.client.1.smithi154.stdout:7/103: readlink d6/l1e 0 2024-05-06T21:26:44.712 INFO:tasks.workunit.client.1.smithi154.stdout:7/104: read - d6/fc zero size 2024-05-06T21:26:44.713 INFO:tasks.workunit.client.0.smithi032.stdout:8/665: dread d0/d1c/d5e/d67/dc3/d57/d5d/d63/f8e [0,4194304] 0 2024-05-06T21:26:44.714 INFO:tasks.workunit.client.0.smithi032.stdout:8/666: chown d0 504339467 1 2024-05-06T21:26:44.715 INFO:tasks.workunit.client.0.smithi032.stdout:9/556: mknod d1/d13/d33/d3f/cb6 0 2024-05-06T21:26:44.715 INFO:tasks.workunit.client.0.smithi032.stdout:9/557: fsync d1/d13/d33/d3f/d60/fb3 0 2024-05-06T21:26:44.715 INFO:tasks.workunit.client.0.smithi032.stdout:9/558: creat d1/d13/d34/d92/fb7 x:0 0 0 2024-05-06T21:26:44.717 INFO:tasks.workunit.client.0.smithi032.stdout:5/464: mkdir d0/d16/d86 0 2024-05-06T21:26:44.719 INFO:tasks.workunit.client.1.smithi154.stdout:5/223: dwrite d2/d3/d21/f26 [4194304,4194304] 0 2024-05-06T21:26:44.719 INFO:tasks.workunit.client.1.smithi154.stdout:3/255: dread d0/da/db/dd/ff [0,4194304] 0 2024-05-06T21:26:44.719 INFO:tasks.workunit.client.1.smithi154.stdout:3/256: read - d0/f50 zero size 2024-05-06T21:26:44.720 INFO:tasks.workunit.client.0.smithi032.stdout:3/635: symlink d1/d4/da/le2 0 2024-05-06T21:26:44.720 INFO:tasks.workunit.client.0.smithi032.stdout:3/636: creat d1/d4/fe3 x:0 0 0 2024-05-06T21:26:44.722 INFO:tasks.workunit.client.0.smithi032.stdout:6/662: read d8/dd/d1b/d35/f86 [2868359,115546] 0 2024-05-06T21:26:44.722 INFO:tasks.workunit.client.0.smithi032.stdout:6/663: write d8/dd/d18/d3b/db9/f9e [1037160,107364] 0 2024-05-06T21:26:44.722 INFO:tasks.workunit.client.1.smithi154.stdout:1/218: dread d6/f28 [0,4194304] 0 2024-05-06T21:26:44.724 INFO:tasks.workunit.client.0.smithi032.stdout:9/559: symlink d1/d2f/d4f/lb8 0 2024-05-06T21:26:44.725 INFO:tasks.workunit.client.1.smithi154.stdout:0/216: rename d6/dc/f13 to d6/dc/d39/f3f 0 2024-05-06T21:26:44.725 INFO:tasks.workunit.client.0.smithi032.stdout:7/601: dwrite db/d12/d16/f72 [0,4194304] 0 2024-05-06T21:26:44.726 INFO:tasks.workunit.client.1.smithi154.stdout:0/217: dread d6/dc/f2d [0,4194304] 0 2024-05-06T21:26:44.727 INFO:tasks.workunit.client.1.smithi154.stdout:8/193: rmdir d3/d14/d1a/d29/d32 39 2024-05-06T21:26:44.730 INFO:tasks.workunit.client.0.smithi032.stdout:2/475: write df/d19/d1e/d42/f63 [1225162,101471] 0 2024-05-06T21:26:44.730 INFO:tasks.workunit.client.0.smithi032.stdout:1/504: dwrite db/d47/d4a/da4/f2f [0,4194304] 0 2024-05-06T21:26:44.730 INFO:tasks.workunit.client.1.smithi154.stdout:7/105: mknod d6/de/c24 0 2024-05-06T21:26:44.731 INFO:tasks.workunit.client.0.smithi032.stdout:3/637: creat d1/d4/da/d9f/d74/fe4 x:0 0 0 2024-05-06T21:26:44.731 INFO:tasks.workunit.client.1.smithi154.stdout:3/257: mkdir d0/da/d1a/d28/d2f/d38/d55 0 2024-05-06T21:26:44.737 INFO:tasks.workunit.client.1.smithi154.stdout:2/164: rmdir db/de/d10 39 2024-05-06T21:26:44.738 INFO:tasks.workunit.client.1.smithi154.stdout:0/218: truncate d6/dc/f2d 161913 0 2024-05-06T21:26:44.738 INFO:tasks.workunit.client.1.smithi154.stdout:8/194: mknod d3/d14/d1a/d29/d32/d33/c3f 0 2024-05-06T21:26:44.739 INFO:tasks.workunit.client.1.smithi154.stdout:8/195: read d3/fb [422487,47703] 0 2024-05-06T21:26:44.739 INFO:tasks.workunit.client.0.smithi032.stdout:6/664: symlink d8/dd/d18/lc5 0 2024-05-06T21:26:44.740 INFO:tasks.workunit.client.1.smithi154.stdout:7/106: creat d6/f25 x:0 0 0 2024-05-06T21:26:44.742 INFO:tasks.workunit.client.0.smithi032.stdout:3/638: dread d1/d4/da/f32 [0,4194304] 0 2024-05-06T21:26:44.742 INFO:tasks.workunit.client.0.smithi032.stdout:3/639: chown d1/d4/da/d9f/db8/fc5 13763412 1 2024-05-06T21:26:44.742 INFO:tasks.workunit.client.0.smithi032.stdout:3/640: creat d1/d4/da/d1d/fe5 x:0 0 0 2024-05-06T21:26:44.742 INFO:tasks.workunit.client.0.smithi032.stdout:3/641: fdatasync d1/d2a/f8d 0 2024-05-06T21:26:44.742 INFO:tasks.workunit.client.1.smithi154.stdout:9/282: getdents d5/d20/d37 0 2024-05-06T21:26:44.742 INFO:tasks.workunit.client.1.smithi154.stdout:0/219: mkdir d6/dc/d40 0 2024-05-06T21:26:44.743 INFO:tasks.workunit.client.0.smithi032.stdout:9/560: rename d1/d13/d34/d26/d49/f81 to d1/d13/d33/d8e/fb9 0 2024-05-06T21:26:44.744 INFO:tasks.workunit.client.1.smithi154.stdout:8/196: mkdir d3/d14/d1a/d29/d32/d40 0 2024-05-06T21:26:44.744 INFO:tasks.workunit.client.1.smithi154.stdout:8/197: write d3/d14/d1a/d22/f3a [754428,122254] 0 2024-05-06T21:26:44.745 INFO:tasks.workunit.client.0.smithi032.stdout:7/602: link db/d12/d16/d21/d41/d78/c2b db/d12/d49/cbf 0 2024-05-06T21:26:44.745 INFO:tasks.workunit.client.1.smithi154.stdout:9/283: mkdir d5/d2e/d56/d65 0 2024-05-06T21:26:44.746 INFO:tasks.workunit.client.1.smithi154.stdout:8/198: write d3/f10 [1367766,32252] 0 2024-05-06T21:26:44.747 INFO:tasks.workunit.client.1.smithi154.stdout:0/220: mkdir d6/dc/d40/d41 0 2024-05-06T21:26:44.747 INFO:tasks.workunit.client.0.smithi032.stdout:2/476: getdents df/d19/d1e/d1f 0 2024-05-06T21:26:44.748 INFO:tasks.workunit.client.1.smithi154.stdout:9/284: mkdir d5/d2e/d66 0 2024-05-06T21:26:44.749 INFO:tasks.workunit.client.1.smithi154.stdout:9/285: write d5/f19 [232889,34153] 0 2024-05-06T21:26:44.751 INFO:tasks.workunit.client.0.smithi032.stdout:1/505: unlink db/f43 0 2024-05-06T21:26:44.755 INFO:tasks.workunit.client.1.smithi154.stdout:9/286: creat d5/d20/d52/d59/f67 x:0 0 0 2024-05-06T21:26:44.761 INFO:tasks.workunit.client.1.smithi154.stdout:9/287: creat d5/d14/d31/d39/f68 x:0 0 0 2024-05-06T21:26:44.765 INFO:tasks.workunit.client.1.smithi154.stdout:8/199: dread d3/d14/d1a/d22/f23 [0,4194304] 0 2024-05-06T21:26:44.766 INFO:tasks.workunit.client.1.smithi154.stdout:9/288: link d5/d2e/l34 d5/d2e/d56/l69 0 2024-05-06T21:26:44.772 INFO:tasks.workunit.client.1.smithi154.stdout:8/200: rename d3/fe to d3/d14/d1a/d29/d32/d33/f41 0 2024-05-06T21:26:44.772 INFO:tasks.workunit.client.1.smithi154.stdout:7/107: write d6/fd [655608,64739] 0 2024-05-06T21:26:44.773 INFO:tasks.workunit.client.1.smithi154.stdout:9/289: unlink d5/f19 0 2024-05-06T21:26:44.773 INFO:tasks.workunit.client.0.smithi032.stdout:1/506: write db/d47/d4a/da4/f49 [4500302,74785] 0 2024-05-06T21:26:44.773 INFO:tasks.workunit.client.0.smithi032.stdout:1/507: fsync db/d47/d4a/da4/f5b 0 2024-05-06T21:26:44.773 INFO:tasks.workunit.client.0.smithi032.stdout:1/508: chown db/f51 285168 1 2024-05-06T21:26:44.773 INFO:tasks.workunit.client.0.smithi032.stdout:1/509: stat db/f4c 0 2024-05-06T21:26:44.774 INFO:tasks.workunit.client.0.smithi032.stdout:1/510: write db/d16/d46/d57/fa0 [106015,37174] 0 2024-05-06T21:26:44.774 INFO:tasks.workunit.client.1.smithi154.stdout:1/219: dwrite d6/f17 [0,4194304] 0 2024-05-06T21:26:44.775 INFO:tasks.workunit.client.1.smithi154.stdout:1/220: fsync d6/db/d10/d15/f39 0 2024-05-06T21:26:44.775 INFO:tasks.workunit.client.0.smithi032.stdout:8/667: dwrite d0/d1c/d5e/d67/d7b/fb2 [0,4194304] 0 2024-05-06T21:26:44.776 INFO:tasks.workunit.client.1.smithi154.stdout:0/221: dread d6/d10/f29 [0,4194304] 0 2024-05-06T21:26:44.776 INFO:tasks.workunit.client.1.smithi154.stdout:7/108: creat d6/d20/f26 x:0 0 0 2024-05-06T21:26:44.776 INFO:tasks.workunit.client.0.smithi032.stdout:9/561: dread d1/f12 [0,4194304] 0 2024-05-06T21:26:44.778 INFO:tasks.workunit.client.1.smithi154.stdout:9/290: dread d5/f2a [0,4194304] 0 2024-05-06T21:26:44.778 INFO:tasks.workunit.client.1.smithi154.stdout:9/291: readlink d5/d2e/d56/l69 0 2024-05-06T21:26:44.778 INFO:tasks.workunit.client.1.smithi154.stdout:9/292: write d5/d14/d31/d39/f68 [50286,113350] 0 2024-05-06T21:26:44.779 INFO:tasks.workunit.client.0.smithi032.stdout:8/668: creat d0/d1c/d5e/d67/d7b/dab/fc8 x:0 0 0 2024-05-06T21:26:44.779 INFO:tasks.workunit.client.0.smithi032.stdout:8/669: stat d0/f9 0 2024-05-06T21:26:44.779 INFO:tasks.workunit.client.0.smithi032.stdout:8/670: read d0/d1c/d5e/d67/dc3/d57/d5d/faa [755913,21819] 0 2024-05-06T21:26:44.780 INFO:tasks.workunit.client.1.smithi154.stdout:8/201: dread d3/fb [0,4194304] 0 2024-05-06T21:26:44.781 INFO:tasks.workunit.client.0.smithi032.stdout:9/562: creat d1/d13/d25/fba x:0 0 0 2024-05-06T21:26:44.781 INFO:tasks.workunit.client.0.smithi032.stdout:9/563: fdatasync d1/d13/d25/f7f 0 2024-05-06T21:26:44.781 INFO:tasks.workunit.client.0.smithi032.stdout:9/564: write d1/d13/f16 [4846371,73093] 0 2024-05-06T21:26:44.782 INFO:tasks.workunit.client.1.smithi154.stdout:2/165: dwrite db/de/d10/f14 [0,4194304] 0 2024-05-06T21:26:44.782 INFO:tasks.workunit.client.1.smithi154.stdout:2/166: chown db/de/d16/f1f 10 1 2024-05-06T21:26:44.783 INFO:tasks.workunit.client.0.smithi032.stdout:5/465: dwrite d0/d24/d38/f25 [0,4194304] 0 2024-05-06T21:26:44.783 INFO:tasks.workunit.client.0.smithi032.stdout:8/671: mknod d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/cc9 0 2024-05-06T21:26:44.784 INFO:tasks.workunit.client.1.smithi154.stdout:2/167: rename l6 to db/de/d10/d18/l36 0 2024-05-06T21:26:44.784 INFO:tasks.workunit.client.1.smithi154.stdout:2/168: read db/de/d16/f1f [2416532,123802] 0 2024-05-06T21:26:44.785 INFO:tasks.workunit.client.0.smithi032.stdout:9/565: creat d1/fbb x:0 0 0 2024-05-06T21:26:44.786 INFO:tasks.workunit.client.1.smithi154.stdout:5/224: dwrite d2/d3/f31 [0,4194304] 0 2024-05-06T21:26:44.787 INFO:tasks.workunit.client.1.smithi154.stdout:2/169: creat db/d12/f37 x:0 0 0 2024-05-06T21:26:44.789 INFO:tasks.workunit.client.0.smithi032.stdout:5/466: truncate d0/d24/d26/d3d/d50/f6e 3355456 0 2024-05-06T21:26:44.792 INFO:tasks.workunit.client.0.smithi032.stdout:8/672: rmdir d0/d1c/d5e/dc0 0 2024-05-06T21:26:44.793 INFO:tasks.workunit.client.1.smithi154.stdout:5/225: mknod d2/c4b 0 2024-05-06T21:26:44.793 INFO:tasks.workunit.client.1.smithi154.stdout:5/226: write d2/f34 [4969059,88821] 0 2024-05-06T21:26:44.793 INFO:tasks.workunit.client.0.smithi032.stdout:1/511: dread db/f1f [0,4194304] 0 2024-05-06T21:26:44.794 INFO:tasks.workunit.client.0.smithi032.stdout:5/467: truncate d0/d28/f33 1793315 0 2024-05-06T21:26:44.797 INFO:tasks.workunit.client.1.smithi154.stdout:2/170: mknod db/c38 0 2024-05-06T21:26:44.799 INFO:tasks.workunit.client.0.smithi032.stdout:8/673: link d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/f8c d0/d1c/d5e/d67/fca 0 2024-05-06T21:26:44.799 INFO:tasks.workunit.client.1.smithi154.stdout:9/293: dread d5/f28 [0,4194304] 0 2024-05-06T21:26:44.800 INFO:tasks.workunit.client.1.smithi154.stdout:9/294: readlink d5/l7 0 2024-05-06T21:26:44.801 INFO:tasks.workunit.client.0.smithi032.stdout:7/603: dwrite db/d12/d16/f57 [4194304,4194304] 0 2024-05-06T21:26:44.802 INFO:tasks.workunit.client.1.smithi154.stdout:2/171: creat db/d12/d19/f39 x:0 0 0 2024-05-06T21:26:44.802 INFO:tasks.workunit.client.0.smithi032.stdout:5/468: mkdir d0/d87 0 2024-05-06T21:26:44.803 INFO:tasks.workunit.client.1.smithi154.stdout:9/295: symlink d5/d14/d31/l6a 0 2024-05-06T21:26:44.804 INFO:tasks.workunit.client.1.smithi154.stdout:9/296: write d5/d2e/d56/f5c [206578,127318] 0 2024-05-06T21:26:44.804 INFO:tasks.workunit.client.1.smithi154.stdout:2/172: mknod db/c3a 0 2024-05-06T21:26:44.804 INFO:tasks.workunit.client.0.smithi032.stdout:3/642: dwrite d1/d4/da/d31/d47/d4a/f5f [0,4194304] 0 2024-05-06T21:26:44.805 INFO:tasks.workunit.client.0.smithi032.stdout:7/604: unlink db/d12/d49/f75 0 2024-05-06T21:26:44.805 INFO:tasks.workunit.client.1.smithi154.stdout:9/297: read d5/f2a [611324,34744] 0 2024-05-06T21:26:44.806 INFO:tasks.workunit.client.0.smithi032.stdout:5/469: mkdir d0/d24/d38/d88 0 2024-05-06T21:26:44.806 INFO:tasks.workunit.client.0.smithi032.stdout:5/470: stat d0/d24/d26/d3d/d50/f65 0 2024-05-06T21:26:44.806 INFO:tasks.workunit.client.0.smithi032.stdout:5/471: fdatasync d0/d4e/f68 0 2024-05-06T21:26:44.806 INFO:tasks.workunit.client.0.smithi032.stdout:5/472: write d0/fb [827128,6116] 0 2024-05-06T21:26:44.807 INFO:tasks.workunit.client.1.smithi154.stdout:2/173: symlink db/de/d10/d18/l3b 0 2024-05-06T21:26:44.807 INFO:tasks.workunit.client.1.smithi154.stdout:2/174: readlink db/de/d16/d31/l34 0 2024-05-06T21:26:44.808 INFO:tasks.workunit.client.1.smithi154.stdout:8/202: dwrite d3/f9 [4194304,4194304] 0 2024-05-06T21:26:44.808 INFO:tasks.workunit.client.1.smithi154.stdout:8/203: stat d3/d14/f20 0 2024-05-06T21:26:44.808 INFO:tasks.workunit.client.1.smithi154.stdout:9/298: mknod d5/d2e/d56/d65/c6b 0 2024-05-06T21:26:44.809 INFO:tasks.workunit.client.1.smithi154.stdout:9/299: truncate d5/d20/f4b 167896 0 2024-05-06T21:26:44.810 INFO:tasks.workunit.client.0.smithi032.stdout:3/643: creat d1/d4/da/d31/d47/d4a/d68/fe6 x:0 0 0 2024-05-06T21:26:44.810 INFO:tasks.workunit.client.1.smithi154.stdout:9/300: mknod d5/d2e/d56/c6c 0 2024-05-06T21:26:44.811 INFO:tasks.workunit.client.1.smithi154.stdout:9/301: readlink l1 0 2024-05-06T21:26:44.811 INFO:tasks.workunit.client.1.smithi154.stdout:8/204: dread d3/d14/d1a/f28 [0,4194304] 0 2024-05-06T21:26:44.811 INFO:tasks.workunit.client.0.smithi032.stdout:7/605: mknod db/d12/d16/d2a/d39/d3b/d9c/cc0 0 2024-05-06T21:26:44.812 INFO:tasks.workunit.client.1.smithi154.stdout:9/302: rename d5/d20/d37/c45 to d5/d2e/d56/d65/c6d 0 2024-05-06T21:26:44.814 INFO:tasks.workunit.client.1.smithi154.stdout:8/205: link d3/d14/d1a/d29/d32/d33/c34 d3/c42 0 2024-05-06T21:26:44.814 INFO:tasks.workunit.client.1.smithi154.stdout:8/206: dread - d3/d14/d1a/d29/f3d zero size 2024-05-06T21:26:44.814 INFO:tasks.workunit.client.1.smithi154.stdout:8/207: getdents d3/d14/d1a/d22/d26/d2b 0 2024-05-06T21:26:44.814 INFO:tasks.workunit.client.1.smithi154.stdout:8/208: write d3/fd [247243,112905] 0 2024-05-06T21:26:44.815 INFO:tasks.workunit.client.0.smithi032.stdout:2/477: dwrite df/d19/d1e/d71/d5f/d7d/d25/f37 [4194304,4194304] 0 2024-05-06T21:26:44.815 INFO:tasks.workunit.client.0.smithi032.stdout:5/473: mkdir d0/d16/d46/d78/d89 0 2024-05-06T21:26:44.818 INFO:tasks.workunit.client.1.smithi154.stdout:3/258: dwrite d0/da/db/dd/ff [0,4194304] 0 2024-05-06T21:26:44.818 INFO:tasks.workunit.client.0.smithi032.stdout:3/644: truncate d1/d4/db7/fa2 350379 0 2024-05-06T21:26:44.818 INFO:tasks.workunit.client.0.smithi032.stdout:7/606: creat db/d12/d16/fc1 x:0 0 0 2024-05-06T21:26:44.820 INFO:tasks.workunit.client.1.smithi154.stdout:3/259: mknod d0/da/d1a/d28/d2f/d38/c56 0 2024-05-06T21:26:44.821 INFO:tasks.workunit.client.1.smithi154.stdout:2/175: dread f5 [8388608,4194304] 0 2024-05-06T21:26:44.821 INFO:tasks.workunit.client.1.smithi154.stdout:2/176: write db/de/f11 [2253899,99708] 0 2024-05-06T21:26:44.821 INFO:tasks.workunit.client.1.smithi154.stdout:2/177: creat db/f3c x:0 0 0 2024-05-06T21:26:44.822 INFO:tasks.workunit.client.1.smithi154.stdout:3/260: link d0/da/db/dd/d1c/d21/c23 d0/da/d1a/c57 0 2024-05-06T21:26:44.824 INFO:tasks.workunit.client.0.smithi032.stdout:5/474: rename d0/d16/c4b to d0/d24/d38/d37/c8a 0 2024-05-06T21:26:44.825 INFO:tasks.workunit.client.1.smithi154.stdout:7/109: dwrite d6/f25 [0,4194304] 0 2024-05-06T21:26:44.825 INFO:tasks.workunit.client.1.smithi154.stdout:7/110: chown d6/c1f 1 1 2024-05-06T21:26:44.825 INFO:tasks.workunit.client.1.smithi154.stdout:7/111: chown d6/l13 414 1 2024-05-06T21:26:44.828 INFO:tasks.workunit.client.1.smithi154.stdout:3/261: link d0/da/db/l16 d0/l58 0 2024-05-06T21:26:44.830 INFO:tasks.workunit.client.1.smithi154.stdout:1/221: dwrite d6/f28 [0,4194304] 0 2024-05-06T21:26:44.830 INFO:tasks.workunit.client.0.smithi032.stdout:8/674: dwrite d0/d1b/d47/f83 [0,4194304] 0 2024-05-06T21:26:44.830 INFO:tasks.workunit.client.0.smithi032.stdout:8/675: truncate d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/fb1 809132 0 2024-05-06T21:26:44.833 INFO:tasks.workunit.client.1.smithi154.stdout:7/112: rename d6/l1e to d6/de/d23/l27 0 2024-05-06T21:26:44.834 INFO:tasks.workunit.client.1.smithi154.stdout:0/222: dwrite d6/dc/f33 [0,4194304] 0 2024-05-06T21:26:44.835 INFO:tasks.workunit.client.1.smithi154.stdout:9/303: dwrite d5/d20/f2c [0,4194304] 0 2024-05-06T21:26:44.835 INFO:tasks.workunit.client.0.smithi032.stdout:2/478: rmdir df/d19/d1e/d71/d5f 39 2024-05-06T21:26:44.835 INFO:tasks.workunit.client.0.smithi032.stdout:2/479: fdatasync df/d19/d1e/d71/d5f/d7d/d25/d2d/f86 0 2024-05-06T21:26:44.838 INFO:tasks.workunit.client.0.smithi032.stdout:5/475: rename d0/d24/d26/c31 to d0/d24/c8b 0 2024-05-06T21:26:44.839 INFO:tasks.workunit.client.0.smithi032.stdout:5/476: write d0/f12 [1797271,48862] 0 2024-05-06T21:26:44.839 INFO:tasks.workunit.client.0.smithi032.stdout:7/607: dread db/d12/d16/d21/d41/d78/f91 [0,4194304] 0 2024-05-06T21:26:44.840 INFO:tasks.workunit.client.0.smithi032.stdout:8/676: creat d0/d1c/d5e/fcb x:0 0 0 2024-05-06T21:26:44.840 INFO:tasks.workunit.client.0.smithi032.stdout:8/677: write d0/d1c/fbb [114658,71768] 0 2024-05-06T21:26:44.840 INFO:tasks.workunit.client.0.smithi032.stdout:3/645: dwrite d1/d4/db7/d8b/fda [0,4194304] 0 2024-05-06T21:26:44.840 INFO:tasks.workunit.client.1.smithi154.stdout:3/262: mknod d0/da/db/dd/d1c/d21/d37/c59 0 2024-05-06T21:26:44.844 INFO:tasks.workunit.client.1.smithi154.stdout:8/209: getdents d3/d14/d1a/d29/d32/d33 0 2024-05-06T21:26:44.844 INFO:tasks.workunit.client.0.smithi032.stdout:8/678: dread d0/d1c/f42 [4194304,4194304] 0 2024-05-06T21:26:44.847 INFO:tasks.workunit.client.1.smithi154.stdout:1/222: mknod d6/db/d10/d26/d1b/d45/d48/c49 0 2024-05-06T21:26:44.851 INFO:tasks.workunit.client.0.smithi032.stdout:2/480: mkdir df/d19/d1e/d71/d5f/d7d/d65/d78/da6 0 2024-05-06T21:26:44.854 INFO:tasks.workunit.client.0.smithi032.stdout:7/608: write db/d12/d16/d21/d41/f99 [4025240,10059] 0 2024-05-06T21:26:44.855 INFO:tasks.workunit.client.0.smithi032.stdout:5/477: mknod d0/d24/d26/d3d/c8c 0 2024-05-06T21:26:44.855 INFO:tasks.workunit.client.0.smithi032.stdout:5/478: write d0/d16/d46/f7a [1125684,45311] 0 2024-05-06T21:26:44.856 INFO:tasks.workunit.client.1.smithi154.stdout:0/223: mkdir d6/dc/d42 0 2024-05-06T21:26:44.856 INFO:tasks.workunit.client.1.smithi154.stdout:0/224: getdents d6/dc/d42 0 2024-05-06T21:26:44.857 INFO:tasks.workunit.client.0.smithi032.stdout:8/679: dread d0/f4b [0,4194304] 0 2024-05-06T21:26:44.860 INFO:tasks.workunit.client.1.smithi154.stdout:9/304: mkdir d5/d20/d52/d6e 0 2024-05-06T21:26:44.861 INFO:tasks.workunit.client.1.smithi154.stdout:3/263: creat d0/da/d1a/d28/f5a x:0 0 0 2024-05-06T21:26:44.862 INFO:tasks.workunit.client.0.smithi032.stdout:2/481: rename df/d19/d1e/d1f/d2e/d33/c84 to df/d19/d1e/d71/d5f/d73/ca7 0 2024-05-06T21:26:44.862 INFO:tasks.workunit.client.0.smithi032.stdout:7/609: dread db/d12/d16/d21/f31 [0,4194304] 0 2024-05-06T21:26:44.862 INFO:tasks.workunit.client.1.smithi154.stdout:3/264: write d0/d2/f25 [510028,19793] 0 2024-05-06T21:26:44.863 INFO:tasks.workunit.client.0.smithi032.stdout:5/479: creat d0/d24/d38/f8d x:0 0 0 2024-05-06T21:26:44.863 INFO:tasks.workunit.client.1.smithi154.stdout:1/223: creat d6/db/d10/d15/f4a x:0 0 0 2024-05-06T21:26:44.865 INFO:tasks.workunit.client.1.smithi154.stdout:0/225: rename d6/d10/l26 to d6/dc/d40/d41/l43 0 2024-05-06T21:26:44.865 INFO:tasks.workunit.client.0.smithi032.stdout:8/680: creat d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/fcc x:0 0 0 2024-05-06T21:26:44.866 INFO:tasks.workunit.client.0.smithi032.stdout:2/482: rmdir df/d19/d1e/d54 39 2024-05-06T21:26:44.868 INFO:tasks.workunit.client.0.smithi032.stdout:7/610: creat db/d12/d87/fc2 x:0 0 0 2024-05-06T21:26:44.868 INFO:tasks.workunit.client.0.smithi032.stdout:7/611: write db/d12/d16/fb4 [200064,102284] 0 2024-05-06T21:26:44.869 INFO:tasks.workunit.client.0.smithi032.stdout:5/480: creat d0/d16/d2a/d59/f8e x:0 0 0 2024-05-06T21:26:44.870 INFO:tasks.workunit.client.0.smithi032.stdout:8/681: symlink d0/d1c/d5e/d67/d7b/dab/lcd 0 2024-05-06T21:26:44.871 INFO:tasks.workunit.client.0.smithi032.stdout:2/483: rmdir df/d19/d1e/d35/d3f 39 2024-05-06T21:26:44.873 INFO:tasks.workunit.client.0.smithi032.stdout:7/612: rename db/d12/d16/da1/cbb to db/d89/cc3 0 2024-05-06T21:26:44.874 INFO:tasks.workunit.client.1.smithi154.stdout:2/178: rmdir db 39 2024-05-06T21:26:44.874 INFO:tasks.workunit.client.0.smithi032.stdout:8/682: symlink d0/d1b/lce 0 2024-05-06T21:26:44.875 INFO:tasks.workunit.client.0.smithi032.stdout:2/484: rmdir df/d19/d1e/d71/d5f/d7d/d25 39 2024-05-06T21:26:44.875 INFO:tasks.workunit.client.0.smithi032.stdout:2/485: chown df/d19/d1e/d35/c8a 0 1 2024-05-06T21:26:44.875 INFO:tasks.workunit.client.0.smithi032.stdout:2/486: truncate df/d19/d1e/d54/f6a 153005 0 2024-05-06T21:26:44.876 INFO:tasks.workunit.client.0.smithi032.stdout:8/683: symlink d0/d1c/d5e/d67/lcf 0 2024-05-06T21:26:44.876 INFO:tasks.workunit.client.1.smithi154.stdout:2/179: symlink db/d12/d19/l3d 0 2024-05-06T21:26:44.877 INFO:tasks.workunit.client.0.smithi032.stdout:2/487: creat df/d19/d1e/d71/d5f/d7d/fa8 x:0 0 0 2024-05-06T21:26:44.878 INFO:tasks.workunit.client.0.smithi032.stdout:8/684: mkdir d0/d1c/d5e/d67/dc3/db5/dd0 0 2024-05-06T21:26:44.880 INFO:tasks.workunit.client.1.smithi154.stdout:7/113: dwrite d6/fc [0,4194304] 0 2024-05-06T21:26:44.880 INFO:tasks.workunit.client.1.smithi154.stdout:7/114: chown d6/de 373474782 1 2024-05-06T21:26:44.880 INFO:tasks.workunit.client.0.smithi032.stdout:3/646: dwrite d1/d4/fe3 [0,4194304] 0 2024-05-06T21:26:44.881 INFO:tasks.workunit.client.1.smithi154.stdout:7/115: write d6/f9 [5551007,79177] 0 2024-05-06T21:26:44.882 INFO:tasks.workunit.client.1.smithi154.stdout:9/305: dwrite d5/d20/d37/f5b [0,4194304] 0 2024-05-06T21:26:44.883 INFO:tasks.workunit.client.0.smithi032.stdout:8/685: rename d0/d1c/d5e/d67/dc3/f72 to d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/fd1 0 2024-05-06T21:26:44.887 INFO:tasks.workunit.client.0.smithi032.stdout:3/647: mkdir d1/d4/da/d4e/d41/de7 0 2024-05-06T21:26:44.887 INFO:tasks.workunit.client.0.smithi032.stdout:2/488: dread df/d19/d1e/d71/d5f/d7d/d25/f3b [4194304,4194304] 0 2024-05-06T21:26:44.889 INFO:tasks.workunit.client.0.smithi032.stdout:7/613: dread db/f20 [0,4194304] 0 2024-05-06T21:26:44.891 INFO:tasks.workunit.client.0.smithi032.stdout:2/489: symlink df/d19/d1e/d71/d5f/d7d/la9 0 2024-05-06T21:26:44.891 INFO:tasks.workunit.client.0.smithi032.stdout:2/490: creat df/d19/d1e/d1f/d2e/d33/faa x:0 0 0 2024-05-06T21:26:44.892 INFO:tasks.workunit.client.0.smithi032.stdout:3/648: rmdir d1/d4/da/d31/d47/d4a/d68 39 2024-05-06T21:26:44.892 INFO:tasks.workunit.client.0.smithi032.stdout:3/649: chown d1/d4/da/d31/d9b/daa/fd4 1525537034 1 2024-05-06T21:26:44.897 INFO:tasks.workunit.client.0.smithi032.stdout:7/614: creat db/d12/d49/fc4 x:0 0 0 2024-05-06T21:26:44.897 INFO:tasks.workunit.client.0.smithi032.stdout:2/491: rename df/d19/d1e/d42/f63 to df/d19/d1e/d1f/fab 0 2024-05-06T21:26:44.899 INFO:tasks.workunit.client.0.smithi032.stdout:8/686: read d0/d1b/d39/f5a [1708684,97742] 0 2024-05-06T21:26:44.899 INFO:tasks.workunit.client.1.smithi154.stdout:1/224: truncate d6/f28 2142123 0 2024-05-06T21:26:44.902 INFO:tasks.workunit.client.1.smithi154.stdout:9/306: symlink d5/d2e/d56/l6f 0 2024-05-06T21:26:44.902 INFO:tasks.workunit.client.0.smithi032.stdout:5/481: dwrite d0/d28/f33 [0,4194304] 0 2024-05-06T21:26:44.903 INFO:tasks.workunit.client.1.smithi154.stdout:1/225: mknod d6/db/d10/d26/d1b/d45/c4b 0 2024-05-06T21:26:44.904 INFO:tasks.workunit.client.1.smithi154.stdout:1/226: stat d6/db/d10/l21 0 2024-05-06T21:26:44.904 INFO:tasks.workunit.client.1.smithi154.stdout:1/227: write d6/f47 [2260859,22878] 0 2024-05-06T21:26:44.905 INFO:tasks.workunit.client.1.smithi154.stdout:9/307: mknod d5/d14/d31/c70 0 2024-05-06T21:26:44.905 INFO:tasks.workunit.client.1.smithi154.stdout:9/308: fsync d5/f1a 0 2024-05-06T21:26:44.906 INFO:tasks.workunit.client.0.smithi032.stdout:8/687: rename d0/d1b/d47/l78 to d0/d1c/d5e/d67/dc3/ld2 0 2024-05-06T21:26:44.906 INFO:tasks.workunit.client.0.smithi032.stdout:5/482: mknod d0/d16/d46/d78/c8f 0 2024-05-06T21:26:44.907 INFO:tasks.workunit.client.0.smithi032.stdout:3/650: dread d1/d4/d11/f4f [0,4194304] 0 2024-05-06T21:26:44.908 INFO:tasks.workunit.client.1.smithi154.stdout:1/228: symlink d6/db/d10/d26/l4c 0 2024-05-06T21:26:44.908 INFO:tasks.workunit.client.0.smithi032.stdout:7/615: write db/d12/d16/d21/fa3 [451292,33534] 0 2024-05-06T21:26:44.909 INFO:tasks.workunit.client.0.smithi032.stdout:5/483: link d0/d24/d38/d37/c5c d0/d16/d2a/d52/c90 0 2024-05-06T21:26:44.909 INFO:tasks.workunit.client.0.smithi032.stdout:5/484: dread - d0/d24/d38/f8d zero size 2024-05-06T21:26:44.909 INFO:tasks.workunit.client.0.smithi032.stdout:5/485: chown d0/d24 729216395 1 2024-05-06T21:26:44.909 INFO:tasks.workunit.client.0.smithi032.stdout:5/486: creat d0/d16/f91 x:0 0 0 2024-05-06T21:26:44.910 INFO:tasks.workunit.client.1.smithi154.stdout:9/309: mkdir d5/d14/d3a/d71 0 2024-05-06T21:26:44.910 INFO:tasks.workunit.client.0.smithi032.stdout:3/651: link d1/c85 d1/d4/da/d9f/db8/dd0/ce8 0 2024-05-06T21:26:44.910 INFO:tasks.workunit.client.0.smithi032.stdout:3/652: fsync d1/d4/da/d1d/fb5 0 2024-05-06T21:26:44.910 INFO:tasks.workunit.client.0.smithi032.stdout:2/492: read df/d19/d1e/d71/d5f/d7d/f36 [3763871,122654] 0 2024-05-06T21:26:44.911 INFO:tasks.workunit.client.1.smithi154.stdout:1/229: creat d6/d3e/f4d x:0 0 0 2024-05-06T21:26:44.911 INFO:tasks.workunit.client.1.smithi154.stdout:1/230: chown d6/db/d10 17834571 1 2024-05-06T21:26:44.911 INFO:tasks.workunit.client.1.smithi154.stdout:1/231: fdatasync d6/db/d10/d26/f23 0 2024-05-06T21:26:44.912 INFO:tasks.workunit.client.1.smithi154.stdout:9/310: getdents d5/d20/d37 0 2024-05-06T21:26:44.912 INFO:tasks.workunit.client.1.smithi154.stdout:9/311: creat d5/d20/d52/d59/f72 x:0 0 0 2024-05-06T21:26:44.912 INFO:tasks.workunit.client.1.smithi154.stdout:1/232: mknod d6/db/c4e 0 2024-05-06T21:26:44.913 INFO:tasks.workunit.client.0.smithi032.stdout:7/616: truncate db/d12/f2e 1410039 0 2024-05-06T21:26:44.915 INFO:tasks.workunit.client.1.smithi154.stdout:9/312: getdents d5/d14 0 2024-05-06T21:26:44.916 INFO:tasks.workunit.client.0.smithi032.stdout:7/617: dread db/d12/d16/d21/d41/d4b/f59 [0,4194304] 0 2024-05-06T21:26:44.917 INFO:tasks.workunit.client.0.smithi032.stdout:3/653: link d1/d4/da/d4e/d41/d43/c94 d1/d4/da/d4e/d41/de7/ce9 0 2024-05-06T21:26:44.919 INFO:tasks.workunit.client.0.smithi032.stdout:2/493: creat df/d19/d1e/d1f/fac x:0 0 0 2024-05-06T21:26:44.919 INFO:tasks.workunit.client.1.smithi154.stdout:2/180: dwrite f2 [4194304,4194304] 0 2024-05-06T21:26:44.920 INFO:tasks.workunit.client.1.smithi154.stdout:0/226: rename d6/d10 to d6/dc/d44 0 2024-05-06T21:26:44.920 INFO:tasks.workunit.client.1.smithi154.stdout:0/227: stat d6 0 2024-05-06T21:26:44.920 INFO:tasks.workunit.client.1.smithi154.stdout:2/181: write db/d12/f37 [280202,80239] 0 2024-05-06T21:26:44.921 INFO:tasks.workunit.client.1.smithi154.stdout:7/116: dwrite d6/de/f19 [0,4194304] 0 2024-05-06T21:26:44.922 INFO:tasks.workunit.client.1.smithi154.stdout:3/265: rename d0/f3 to d0/da/d1a/d28/f5b 0 2024-05-06T21:26:44.922 INFO:tasks.workunit.client.1.smithi154.stdout:3/266: write d0/d2/f25 [929789,78154] 0 2024-05-06T21:26:44.922 INFO:tasks.workunit.client.0.smithi032.stdout:8/688: dread d0/d1b/f23 [0,4194304] 0 2024-05-06T21:26:44.922 INFO:tasks.workunit.client.0.smithi032.stdout:3/654: mkdir d1/d4/da/d31/d47/d4a/d68/d7c/da8/dea 0 2024-05-06T21:26:44.922 INFO:tasks.workunit.client.0.smithi032.stdout:8/689: chown d0/d1c/d5e/lc4 100516 1 2024-05-06T21:26:44.922 INFO:tasks.workunit.client.0.smithi032.stdout:8/690: stat d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/fb1 0 2024-05-06T21:26:44.923 INFO:tasks.workunit.client.1.smithi154.stdout:0/228: unlink d6/dc/d44/f2c 0 2024-05-06T21:26:44.926 INFO:tasks.workunit.client.1.smithi154.stdout:7/117: rmdir d6/de/d23 39 2024-05-06T21:26:44.927 INFO:tasks.workunit.client.1.smithi154.stdout:9/313: write d5/d20/d37/f5f [1550963,105168] 0 2024-05-06T21:26:44.929 INFO:tasks.workunit.client.1.smithi154.stdout:0/229: mknod d6/d27/c45 0 2024-05-06T21:26:44.930 INFO:tasks.workunit.client.1.smithi154.stdout:0/230: chown d6/dc/d39 425818 1 2024-05-06T21:26:44.931 INFO:tasks.workunit.client.0.smithi032.stdout:2/494: unlink df/d19/d1e/d42/f4e 0 2024-05-06T21:26:44.931 INFO:tasks.workunit.client.0.smithi032.stdout:3/655: unlink d1/lb2 0 2024-05-06T21:26:44.931 INFO:tasks.workunit.client.0.smithi032.stdout:3/656: chown d1/d4/da/d31/d47/d4a/d68/d7c 2103468 1 2024-05-06T21:26:44.934 INFO:tasks.workunit.client.1.smithi154.stdout:7/118: unlink d6/fa 0 2024-05-06T21:26:44.934 INFO:tasks.workunit.client.1.smithi154.stdout:7/119: fsync d6/f9 0 2024-05-06T21:26:44.934 INFO:tasks.workunit.client.1.smithi154.stdout:1/233: write d6/db/d10/d26/f23 [3422478,85400] 0 2024-05-06T21:26:44.935 INFO:tasks.workunit.client.0.smithi032.stdout:8/691: link d0/d1c/d5e/d67/d9d/lb0 d0/d1b/ld3 0 2024-05-06T21:26:44.935 INFO:tasks.workunit.client.0.smithi032.stdout:3/657: dread d1/d2a/d71/d9d/fdb [0,4194304] 0 2024-05-06T21:26:44.935 INFO:tasks.workunit.client.0.smithi032.stdout:3/658: dread - d1/d4/da/d31/d47/d4a/d68/d7c/fe0 zero size 2024-05-06T21:26:44.936 INFO:tasks.workunit.client.1.smithi154.stdout:9/314: creat d5/f73 x:0 0 0 2024-05-06T21:26:44.936 INFO:tasks.workunit.client.1.smithi154.stdout:9/315: chown d5/d14/d31/l6a 427 1 2024-05-06T21:26:44.936 INFO:tasks.workunit.client.0.smithi032.stdout:2/495: mknod df/d19/d1e/d54/cad 0 2024-05-06T21:26:44.937 INFO:tasks.workunit.client.1.smithi154.stdout:2/182: dread db/de/d16/f1f [0,4194304] 0 2024-05-06T21:26:44.937 INFO:tasks.workunit.client.1.smithi154.stdout:0/231: creat d6/dc/d44/f46 x:0 0 0 2024-05-06T21:26:44.937 INFO:tasks.workunit.client.1.smithi154.stdout:0/232: write d6/f3a [1630482,126336] 0 2024-05-06T21:26:44.937 INFO:tasks.workunit.client.1.smithi154.stdout:0/233: dread - d6/dc/f2e zero size 2024-05-06T21:26:44.938 INFO:tasks.workunit.client.0.smithi032.stdout:8/692: creat d0/d1c/d5e/d67/dc3/db5/dd0/fd4 x:0 0 0 2024-05-06T21:26:44.939 INFO:tasks.workunit.client.0.smithi032.stdout:3/659: mknod d1/d4/da/d9f/d74/da7/ceb 0 2024-05-06T21:26:44.940 INFO:tasks.workunit.client.1.smithi154.stdout:9/316: creat d5/d14/f74 x:0 0 0 2024-05-06T21:26:44.940 INFO:tasks.workunit.client.1.smithi154.stdout:9/317: read - d5/d14/f43 zero size 2024-05-06T21:26:44.940 INFO:tasks.workunit.client.1.smithi154.stdout:2/183: symlink db/l3e 0 2024-05-06T21:26:44.942 INFO:tasks.workunit.client.0.smithi032.stdout:2/496: mkdir df/dae 0 2024-05-06T21:26:44.942 INFO:tasks.workunit.client.1.smithi154.stdout:0/234: creat d6/dc/d40/f47 x:0 0 0 2024-05-06T21:26:44.946 INFO:tasks.workunit.client.0.smithi032.stdout:3/660: symlink d1/d4/da/d31/d47/d4a/d68/lec 0 2024-05-06T21:26:44.946 INFO:tasks.workunit.client.0.smithi032.stdout:5/487: write d0/d16/f1c [4226624,128348] 0 2024-05-06T21:26:44.946 INFO:tasks.workunit.client.0.smithi032.stdout:7/618: dwrite db/d12/d49/f6f [0,4194304] 0 2024-05-06T21:26:44.946 INFO:tasks.workunit.client.0.smithi032.stdout:7/619: chown db/d12/d16/d21/d84 2725 1 2024-05-06T21:26:44.946 INFO:tasks.workunit.client.1.smithi154.stdout:9/318: rename d5/fe to d5/d14/d31/f75 0 2024-05-06T21:26:44.948 INFO:tasks.workunit.client.1.smithi154.stdout:2/184: creat db/de/d16/f3f x:0 0 0 2024-05-06T21:26:44.948 INFO:tasks.workunit.client.1.smithi154.stdout:7/120: dread d6/f25 [0,4194304] 0 2024-05-06T21:26:44.949 INFO:tasks.workunit.client.1.smithi154.stdout:3/267: dwrite d0/da/db/d30/f3d [0,4194304] 0 2024-05-06T21:26:44.950 INFO:tasks.workunit.client.1.smithi154.stdout:9/319: creat d5/f76 x:0 0 0 2024-05-06T21:26:44.951 INFO:tasks.workunit.client.1.smithi154.stdout:7/121: creat d6/de/d23/f28 x:0 0 0 2024-05-06T21:26:44.955 INFO:tasks.workunit.client.1.smithi154.stdout:1/234: getdents d6/d3e 0 2024-05-06T21:26:44.955 INFO:tasks.workunit.client.1.smithi154.stdout:1/235: fsync d6/f17 0 2024-05-06T21:26:44.957 INFO:tasks.workunit.client.1.smithi154.stdout:3/268: symlink d0/da/db/dd/d1c/d41/l5c 0 2024-05-06T21:26:44.960 INFO:tasks.workunit.client.1.smithi154.stdout:4/182: sync 2024-05-06T21:26:44.960 INFO:tasks.workunit.client.1.smithi154.stdout:6/161: sync 2024-05-06T21:26:44.960 INFO:tasks.workunit.client.1.smithi154.stdout:6/162: write d8/f31 [602648,36958] 0 2024-05-06T21:26:44.961 INFO:tasks.workunit.client.1.smithi154.stdout:6/163: write d8/f31 [1247647,3607] 0 2024-05-06T21:26:44.961 INFO:tasks.workunit.client.1.smithi154.stdout:6/164: creat d8/d11/d2d/f3a x:0 0 0 2024-05-06T21:26:44.961 INFO:tasks.workunit.client.1.smithi154.stdout:6/165: write d8/f23 [1364716,118331] 0 2024-05-06T21:26:44.961 INFO:tasks.workunit.client.0.smithi032.stdout:8/693: write d0/f19 [1609510,108912] 0 2024-05-06T21:26:44.962 INFO:tasks.workunit.client.0.smithi032.stdout:8/694: dread d0/d1c/d5e/d67/dc3/d57/f79 [0,4194304] 0 2024-05-06T21:26:44.963 INFO:tasks.workunit.client.1.smithi154.stdout:9/320: dread d5/d14/d31/f40 [0,4194304] 0 2024-05-06T21:26:44.971 INFO:tasks.workunit.client.1.smithi154.stdout:4/183: truncate d0/d10/d11/f21 4096573 0 2024-05-06T21:26:44.971 INFO:tasks.workunit.client.1.smithi154.stdout:6/166: truncate f2 3853097 0 2024-05-06T21:26:44.973 INFO:tasks.workunit.client.0.smithi032.stdout:8/695: creat d0/d1c/d5e/d67/dc3/d57/d5d/d63/fd5 x:0 0 0 2024-05-06T21:26:44.974 INFO:tasks.workunit.client.1.smithi154.stdout:3/269: write d0/d2/f45 [137523,13955] 0 2024-05-06T21:26:44.974 INFO:tasks.workunit.client.1.smithi154.stdout:3/270: chown d0/da/f18 100943 1 2024-05-06T21:26:44.974 INFO:tasks.workunit.client.1.smithi154.stdout:9/321: rename d5/d14/f74 to d5/d2e/d66/f77 0 2024-05-06T21:26:44.975 INFO:tasks.workunit.client.1.smithi154.stdout:6/167: mkdir d8/d11/d3b 0 2024-05-06T21:26:44.976 INFO:tasks.workunit.client.0.smithi032.stdout:5/488: dread d0/d24/d26/d3d/d50/f5d [0,4194304] 0 2024-05-06T21:26:44.976 INFO:tasks.workunit.client.0.smithi032.stdout:5/489: readlink d0/d16/d2a/d59/l74 0 2024-05-06T21:26:44.977 INFO:tasks.workunit.client.1.smithi154.stdout:1/236: fsync d6/db/d10/d26/f23 0 2024-05-06T21:26:44.977 INFO:tasks.workunit.client.0.smithi032.stdout:8/696: symlink d0/d1c/d5e/d67/ld6 0 2024-05-06T21:26:44.978 INFO:tasks.workunit.client.0.smithi032.stdout:8/697: write d0/f27 [2333568,26152] 0 2024-05-06T21:26:44.978 INFO:tasks.workunit.client.0.smithi032.stdout:8/698: chown d0/d1c/c51 88207051 1 2024-05-06T21:26:44.978 INFO:tasks.workunit.client.0.smithi032.stdout:8/699: chown d0/d1c/l2c 450020 1 2024-05-06T21:26:44.979 INFO:tasks.workunit.client.1.smithi154.stdout:3/271: link d0/da/db/dd/l20 d0/da/d1a/d28/d2f/l5d 0 2024-05-06T21:26:44.979 INFO:tasks.workunit.client.1.smithi154.stdout:3/272: truncate d0/da/d1a/f44 506201 0 2024-05-06T21:26:44.981 INFO:tasks.workunit.client.0.smithi032.stdout:5/490: creat d0/d24/d34/f92 x:0 0 0 2024-05-06T21:26:44.981 INFO:tasks.workunit.client.0.smithi032.stdout:5/491: readlink d0/d24/d26/l29 0 2024-05-06T21:26:44.981 INFO:tasks.workunit.client.0.smithi032.stdout:5/492: chown d0/d16/d86 8966067 1 2024-05-06T21:26:44.981 INFO:tasks.workunit.client.0.smithi032.stdout:5/493: chown d0 324 1 2024-05-06T21:26:44.981 INFO:tasks.workunit.client.0.smithi032.stdout:5/494: chown d0/fe 22469 1 2024-05-06T21:26:44.981 INFO:tasks.workunit.client.1.smithi154.stdout:1/237: write d6/db/d10/f33 [156566,12855] 0 2024-05-06T21:26:44.981 INFO:tasks.workunit.client.1.smithi154.stdout:1/238: chown d6/d3e/c46 253 1 2024-05-06T21:26:44.982 INFO:tasks.workunit.client.0.smithi032.stdout:8/700: link d0/c4e d0/d1c/cd7 0 2024-05-06T21:26:44.982 INFO:tasks.workunit.client.1.smithi154.stdout:9/322: creat d5/d20/d52/f78 x:0 0 0 2024-05-06T21:26:44.982 INFO:tasks.workunit.client.1.smithi154.stdout:9/323: chown d5/d20/d37/f50 784 1 2024-05-06T21:26:44.982 INFO:tasks.workunit.client.1.smithi154.stdout:9/324: write d5/d20/d52/f4d [4267577,33682] 0 2024-05-06T21:26:44.983 INFO:tasks.workunit.client.1.smithi154.stdout:9/325: chown d5/d2e/d56/l6f 39221915 1 2024-05-06T21:26:44.983 INFO:tasks.workunit.client.1.smithi154.stdout:6/168: truncate f1 1049821 0 2024-05-06T21:26:44.985 INFO:tasks.workunit.client.0.smithi032.stdout:8/701: creat d0/d1c/d5e/d67/dc3/d57/d5d/fd8 x:0 0 0 2024-05-06T21:26:44.986 INFO:tasks.workunit.client.0.smithi032.stdout:8/702: unlink d0/d1b/d47/f64 0 2024-05-06T21:26:44.986 INFO:tasks.workunit.client.0.smithi032.stdout:8/703: dread - d0/d1c/d5e/d67/dc3/d57/d5d/f90 zero size 2024-05-06T21:26:44.986 INFO:tasks.workunit.client.0.smithi032.stdout:8/704: chown d0/d1c/d5e/d67/dc3/d57/d5d 232 1 2024-05-06T21:26:44.988 INFO:tasks.workunit.client.0.smithi032.stdout:8/705: rename d0/d1c/d5e/d67/d9d/fb6 to d0/d1c/d5e/d67/d9d/fd9 0 2024-05-06T21:26:44.991 INFO:tasks.workunit.client.0.smithi032.stdout:2/497: dwrite df/d19/d1e/d71/d5f/d7d/d65/f85 [4194304,4194304] 0 2024-05-06T21:26:44.995 INFO:tasks.workunit.client.0.smithi032.stdout:8/706: write d0/f4b [693464,45239] 0 2024-05-06T21:26:44.995 INFO:tasks.workunit.client.0.smithi032.stdout:3/661: dwrite d1/d4/da/f2f [0,4194304] 0 2024-05-06T21:26:44.995 INFO:tasks.workunit.client.0.smithi032.stdout:3/662: fsync d1/d4/da/d4e/d5e/f6d 0 2024-05-06T21:26:44.995 INFO:tasks.workunit.client.0.smithi032.stdout:7/620: dwrite db/d12/d16/d21/d41/d78/f91 [0,4194304] 0 2024-05-06T21:26:44.995 INFO:tasks.workunit.client.0.smithi032.stdout:7/621: chown db/d12/f85 7432103 1 2024-05-06T21:26:44.996 INFO:tasks.workunit.client.0.smithi032.stdout:3/663: write d1/d4/da/d4e/d41/d43/f70 [755453,24131] 0 2024-05-06T21:26:44.999 INFO:tasks.workunit.client.0.smithi032.stdout:2/498: mkdir df/daf 0 2024-05-06T21:26:45.000 INFO:tasks.workunit.client.0.smithi032.stdout:2/499: creat df/d19/d1e/d1f/d2e/d33/fb0 x:0 0 0 2024-05-06T21:26:45.000 INFO:tasks.workunit.client.1.smithi154.stdout:5/227: sync 2024-05-06T21:26:45.000 INFO:tasks.workunit.client.1.smithi154.stdout:5/228: creat d2/f4c x:0 0 0 2024-05-06T21:26:45.000 INFO:tasks.workunit.client.1.smithi154.stdout:3/273: write d0/da/d1a/d28/d17/f2c [1658030,95243] 0 2024-05-06T21:26:45.001 INFO:tasks.workunit.client.1.smithi154.stdout:0/235: dwrite d6/f3a [0,4194304] 0 2024-05-06T21:26:45.003 INFO:tasks.workunit.client.0.smithi032.stdout:8/707: rename d0/d1b/d39/l9b to d0/d1c/d5e/d67/dc3/db5/lda 0 2024-05-06T21:26:45.003 INFO:tasks.workunit.client.0.smithi032.stdout:8/708: dread - d0/d1b/d47/f7d zero size 2024-05-06T21:26:45.005 INFO:tasks.workunit.client.1.smithi154.stdout:3/274: rmdir d0/da/db/dd/d1c/d21/d37 39 2024-05-06T21:26:45.005 INFO:tasks.workunit.client.1.smithi154.stdout:3/275: write d0/d2/f25 [48754,37310] 0 2024-05-06T21:26:45.005 INFO:tasks.workunit.client.1.smithi154.stdout:3/276: chown d0/da/db/dd/c9 6643989 1 2024-05-06T21:26:45.005 INFO:tasks.workunit.client.1.smithi154.stdout:3/277: fsync d0/da/db/dd/d1c/d21/d37/f4b 0 2024-05-06T21:26:45.007 INFO:tasks.workunit.client.1.smithi154.stdout:0/236: rename d6/d27/c45 to d6/dc/d42/c48 0 2024-05-06T21:26:45.009 INFO:tasks.workunit.client.1.smithi154.stdout:3/278: getdents d0/da/db/dd/d1c 0 2024-05-06T21:26:45.009 INFO:tasks.workunit.client.1.smithi154.stdout:3/279: truncate d0/f50 101948 0 2024-05-06T21:26:45.009 INFO:tasks.workunit.client.0.smithi032.stdout:7/622: mknod db/d12/d16/d2a/d39/d3b/cc5 0 2024-05-06T21:26:45.010 INFO:tasks.workunit.client.1.smithi154.stdout:0/237: symlink d6/l49 0 2024-05-06T21:26:45.011 INFO:tasks.workunit.client.1.smithi154.stdout:0/238: mkdir d6/dc/d40/d4a 0 2024-05-06T21:26:45.011 INFO:tasks.workunit.client.1.smithi154.stdout:0/239: fdatasync d6/dc/d44/f35 0 2024-05-06T21:26:45.013 INFO:tasks.workunit.client.0.smithi032.stdout:2/500: rename df/d19/d1e/d54/f97 to df/fb1 0 2024-05-06T21:26:45.015 INFO:tasks.workunit.client.0.smithi032.stdout:8/709: creat d0/d1b/d47/d91/da7/dc1/fdb x:0 0 0 2024-05-06T21:26:45.016 INFO:tasks.workunit.client.0.smithi032.stdout:7/623: mkdir db/dc6 0 2024-05-06T21:26:45.017 INFO:tasks.workunit.client.0.smithi032.stdout:7/624: write db/d12/f17 [1034259,97502] 0 2024-05-06T21:26:45.018 INFO:tasks.workunit.client.0.smithi032.stdout:8/710: mkdir d0/d1c/d5e/d67/dc3/db5/ddc 0 2024-05-06T21:26:45.018 INFO:tasks.workunit.client.1.smithi154.stdout:2/185: dwrite f0 [0,4194304] 0 2024-05-06T21:26:45.018 INFO:tasks.workunit.client.1.smithi154.stdout:2/186: write db/de/d16/f1f [1299141,20993] 0 2024-05-06T21:26:45.030 INFO:tasks.workunit.client.1.smithi154.stdout:6/169: unlink f2 0 2024-05-06T21:26:45.031 INFO:tasks.workunit.client.1.smithi154.stdout:6/170: creat d8/d11/d3b/f3c x:0 0 0 2024-05-06T21:26:45.046 INFO:tasks.workunit.client.1.smithi154.stdout:4/184: dwrite d0/d10/d11/d1a/f28 [0,4194304] 0 2024-05-06T21:26:45.046 INFO:tasks.workunit.client.1.smithi154.stdout:4/185: chown d0/d2/dc/fe 2206 1 2024-05-06T21:26:45.048 INFO:tasks.workunit.client.1.smithi154.stdout:4/186: rename d0/d10/d11/d1a/d31/d3a to d0/d10/d11/d1a/d31/d3d 0 2024-05-06T21:26:45.048 INFO:tasks.workunit.client.1.smithi154.stdout:4/187: write d0/d2/d2a/f32 [726112,112481] 0 2024-05-06T21:26:45.050 INFO:tasks.workunit.client.1.smithi154.stdout:1/239: dwrite d6/db/f34 [0,4194304] 0 2024-05-06T21:26:45.050 INFO:tasks.workunit.client.0.smithi032.stdout:5/495: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:45.050 INFO:tasks.workunit.client.0.smithi032.stdout:3/664: dwrite d1/d4/da/d1d/fcc [0,4194304] 0 2024-05-06T21:26:45.050 INFO:tasks.workunit.client.0.smithi032.stdout:3/665: fdatasync d1/d4/da/d4e/f91 0 2024-05-06T21:26:45.051 INFO:tasks.workunit.client.1.smithi154.stdout:2/187: dwrite db/f3c [0,4194304] 0 2024-05-06T21:26:45.051 INFO:tasks.workunit.client.1.smithi154.stdout:9/326: dwrite d5/f8 [0,4194304] 0 2024-05-06T21:26:45.052 INFO:tasks.workunit.client.0.smithi032.stdout:8/711: dwrite d0/d1c/d5e/d67/dc3/d57/d5d/fd8 [0,4194304] 0 2024-05-06T21:26:45.052 INFO:tasks.workunit.client.0.smithi032.stdout:8/712: readlink d0/d1c/d5e/d67/dc3/db5/lda 0 2024-05-06T21:26:45.052 INFO:tasks.workunit.client.0.smithi032.stdout:8/713: write d0/d1c/d5e/f73 [1737922,54581] 0 2024-05-06T21:26:45.052 INFO:tasks.workunit.client.0.smithi032.stdout:5/496: creat d0/d16/d2a/d52/f93 x:0 0 0 2024-05-06T21:26:45.052 INFO:tasks.workunit.client.1.smithi154.stdout:5/229: dwrite d2/d6/f7 [0,4194304] 0 2024-05-06T21:26:45.052 INFO:tasks.workunit.client.1.smithi154.stdout:3/280: dwrite d0/da/db/dd/f3c [0,4194304] 0 2024-05-06T21:26:45.054 INFO:tasks.workunit.client.1.smithi154.stdout:1/240: creat d6/db/f4f x:0 0 0 2024-05-06T21:26:45.057 INFO:tasks.workunit.client.1.smithi154.stdout:1/241: write d6/f47 [1198154,120463] 0 2024-05-06T21:26:45.057 INFO:tasks.workunit.client.0.smithi032.stdout:3/666: truncate d1/d4/db7/d8b/fda 348687 0 2024-05-06T21:26:45.063 INFO:tasks.workunit.client.1.smithi154.stdout:4/188: write d0/d2/dc/fe [4129829,100402] 0 2024-05-06T21:26:45.063 INFO:tasks.workunit.client.0.smithi032.stdout:8/714: rename d0/d1b/c82 to d0/d1b/cdd 0 2024-05-06T21:26:45.067 INFO:tasks.workunit.client.1.smithi154.stdout:5/230: symlink d2/d6/dd/l4d 0 2024-05-06T21:26:45.067 INFO:tasks.workunit.client.1.smithi154.stdout:5/231: chown d2/d6/dd/d2a/f3d 3122 1 2024-05-06T21:26:45.067 INFO:tasks.workunit.client.1.smithi154.stdout:5/232: stat d2/d3/d21/d22/d25/d37/f40 0 2024-05-06T21:26:45.068 INFO:tasks.workunit.client.0.smithi032.stdout:3/667: creat d1/d4/db7/fed x:0 0 0 2024-05-06T21:26:45.070 INFO:tasks.workunit.client.1.smithi154.stdout:3/281: mknod d0/da/db/d52/c5e 0 2024-05-06T21:26:45.075 INFO:tasks.workunit.client.0.smithi032.stdout:3/668: getdents d1/d4/da/d9f/db8 0 2024-05-06T21:26:45.076 INFO:tasks.workunit.client.0.smithi032.stdout:3/669: fsync d1/d4/da/d31/d47/d4a/d68/d7c/fe0 0 2024-05-06T21:26:45.078 INFO:tasks.workunit.client.1.smithi154.stdout:1/242: symlink d6/db/d10/d26/l50 0 2024-05-06T21:26:45.078 INFO:tasks.workunit.client.1.smithi154.stdout:1/243: stat d6/db/d10/d15/f4a 0 2024-05-06T21:26:45.079 INFO:tasks.workunit.client.1.smithi154.stdout:4/189: creat d0/f3e x:0 0 0 2024-05-06T21:26:45.079 INFO:tasks.workunit.client.1.smithi154.stdout:4/190: creat d0/d10/d11/d1a/f3f x:0 0 0 2024-05-06T21:26:45.081 INFO:tasks.workunit.client.0.smithi032.stdout:0/537: sync 2024-05-06T21:26:45.082 INFO:tasks.workunit.client.1.smithi154.stdout:3/282: rmdir d0/d2/d40 0 2024-05-06T21:26:45.083 INFO:tasks.workunit.client.0.smithi032.stdout:7/625: rmdir db/d12/d16 39 2024-05-06T21:26:45.083 INFO:tasks.workunit.client.0.smithi032.stdout:7/626: chown db/d12/d16/d21/d41/l52 1 1 2024-05-06T21:26:45.083 INFO:tasks.workunit.client.0.smithi032.stdout:7/627: chown db/d12/d16/d21/d41/d4b/f65 5849480 1 2024-05-06T21:26:45.083 INFO:tasks.workunit.client.0.smithi032.stdout:7/628: chown db/d12/d16/f57 35 1 2024-05-06T21:26:45.084 INFO:tasks.workunit.client.1.smithi154.stdout:6/171: rename d8/d11/d3b to d8/d11/d2d/d3d 0 2024-05-06T21:26:45.084 INFO:tasks.workunit.client.1.smithi154.stdout:6/172: readlink d8/l1f 0 2024-05-06T21:26:45.086 INFO:tasks.workunit.client.0.smithi032.stdout:5/497: dwrite d0/d28/f33 [0,4194304] 0 2024-05-06T21:26:45.086 INFO:tasks.workunit.client.0.smithi032.stdout:5/498: write d0/d24/d38/f3c [3702093,97848] 0 2024-05-06T21:26:45.086 INFO:tasks.workunit.client.0.smithi032.stdout:5/499: readlink d0/d16/d2f/l63 0 2024-05-06T21:26:45.087 INFO:tasks.workunit.client.1.smithi154.stdout:4/191: truncate d0/d2/d2a/f37 2653506 0 2024-05-06T21:26:45.087 INFO:tasks.workunit.client.1.smithi154.stdout:6/173: mknod d8/d11/d2d/c3e 0 2024-05-06T21:26:45.088 INFO:tasks.workunit.client.0.smithi032.stdout:7/629: dread db/d12/d16/fb4 [0,4194304] 0 2024-05-06T21:26:45.088 INFO:tasks.workunit.client.0.smithi032.stdout:7/630: read db/d12/f19 [231027,68859] 0 2024-05-06T21:26:45.090 INFO:tasks.workunit.client.0.smithi032.stdout:5/500: symlink d0/d16/d2a/d59/d67/l94 0 2024-05-06T21:26:45.090 INFO:tasks.workunit.client.0.smithi032.stdout:5/501: read d0/d24/d38/f30 [967432,10486] 0 2024-05-06T21:26:45.091 INFO:tasks.workunit.client.1.smithi154.stdout:6/174: link d8/f2b d8/d13/f3f 0 2024-05-06T21:26:45.091 INFO:tasks.workunit.client.1.smithi154.stdout:6/175: readlink d8/d11/d2d/l34 0 2024-05-06T21:26:45.091 INFO:tasks.workunit.client.1.smithi154.stdout:6/176: truncate d8/f2c 4983841 0 2024-05-06T21:26:45.091 INFO:tasks.workunit.client.1.smithi154.stdout:6/177: readlink d8/d11/d2d/l2e 0 2024-05-06T21:26:45.092 INFO:tasks.workunit.client.1.smithi154.stdout:4/192: getdents d0/d2/dc 0 2024-05-06T21:26:45.094 INFO:tasks.workunit.client.1.smithi154.stdout:6/178: mknod d8/d11/d33/c40 0 2024-05-06T21:26:45.095 INFO:tasks.workunit.client.1.smithi154.stdout:4/193: symlink d0/d2/dc/l40 0 2024-05-06T21:26:45.095 INFO:tasks.workunit.client.1.smithi154.stdout:4/194: creat d0/d10/f41 x:0 0 0 2024-05-06T21:26:45.096 INFO:tasks.workunit.client.0.smithi032.stdout:7/631: link db/d12/d16/d21/c74 db/d12/d16/d21/d41/cc7 0 2024-05-06T21:26:45.097 INFO:tasks.workunit.client.0.smithi032.stdout:3/670: dread d1/d4/fe3 [0,4194304] 0 2024-05-06T21:26:45.097 INFO:tasks.workunit.client.0.smithi032.stdout:3/671: truncate d1/d4/da/d31/d9b/daa/fd4 663624 0 2024-05-06T21:26:45.097 INFO:tasks.workunit.client.0.smithi032.stdout:3/672: chown d1/d4/da/d4e/d41/de7 14505315 1 2024-05-06T21:26:45.099 INFO:tasks.workunit.client.1.smithi154.stdout:1/244: dread d6/f17 [0,4194304] 0 2024-05-06T21:26:45.100 INFO:tasks.workunit.client.1.smithi154.stdout:2/188: dwrite db/de/d10/f25 [0,4194304] 0 2024-05-06T21:26:45.100 INFO:tasks.workunit.client.0.smithi032.stdout:7/632: dread db/d12/d16/d21/f31 [0,4194304] 0 2024-05-06T21:26:45.100 INFO:tasks.workunit.client.1.smithi154.stdout:9/327: dwrite d5/f13 [0,4194304] 0 2024-05-06T21:26:45.102 INFO:tasks.workunit.client.0.smithi032.stdout:3/673: unlink d1/d4/da/d31/f48 0 2024-05-06T21:26:45.102 INFO:tasks.workunit.client.0.smithi032.stdout:3/674: fdatasync d1/d4/da/d1d/fb5 0 2024-05-06T21:26:45.102 INFO:tasks.workunit.client.0.smithi032.stdout:3/675: getdents d1/d4/da/d4e 0 2024-05-06T21:26:45.102 INFO:tasks.workunit.client.1.smithi154.stdout:2/189: truncate f2 2924649 0 2024-05-06T21:26:45.104 INFO:tasks.workunit.client.0.smithi032.stdout:3/676: creat d1/d4/da/d4e/d5e/fee x:0 0 0 2024-05-06T21:26:45.106 INFO:tasks.workunit.client.1.smithi154.stdout:1/245: creat d6/db/d10/f51 x:0 0 0 2024-05-06T21:26:45.108 INFO:tasks.workunit.client.0.smithi032.stdout:3/677: creat d1/d4/da/d1d/dc0/fef x:0 0 0 2024-05-06T21:26:45.110 INFO:tasks.workunit.client.0.smithi032.stdout:3/678: creat d1/d4/da/d4e/d5e/d84/ff0 x:0 0 0 2024-05-06T21:26:45.110 INFO:tasks.workunit.client.0.smithi032.stdout:3/679: read d1/d4/da/d31/f87 [258960,88189] 0 2024-05-06T21:26:45.114 INFO:tasks.workunit.client.0.smithi032.stdout:3/680: mkdir d1/d4/da/d9f/d74/db1/df1 0 2024-05-06T21:26:45.114 INFO:tasks.workunit.client.0.smithi032.stdout:3/681: stat d1/d4/da/d1d 0 2024-05-06T21:26:45.114 INFO:tasks.workunit.client.0.smithi032.stdout:3/682: dread - d1/d4/db7/fed zero size 2024-05-06T21:26:45.114 INFO:tasks.workunit.client.0.smithi032.stdout:3/683: chown d1/d2a/d71/d9d/da9 1530861627 1 2024-05-06T21:26:45.115 INFO:tasks.workunit.client.1.smithi154.stdout:3/283: dwrite d0/da/db/dd/d1c/d21/f4e [0,4194304] 0 2024-05-06T21:26:45.115 INFO:tasks.workunit.client.1.smithi154.stdout:3/284: dread - d0/da/db/f2a zero size 2024-05-06T21:26:45.115 INFO:tasks.workunit.client.1.smithi154.stdout:2/190: dread db/f3c [0,4194304] 0 2024-05-06T21:26:45.116 INFO:tasks.workunit.client.1.smithi154.stdout:5/233: dwrite d2/d3/f28 [0,4194304] 0 2024-05-06T21:26:45.116 INFO:tasks.workunit.client.1.smithi154.stdout:5/234: readlink d2/d3/d21/l3a 0 2024-05-06T21:26:45.119 INFO:tasks.workunit.client.1.smithi154.stdout:3/285: read d0/f2b [468603,48249] 0 2024-05-06T21:26:45.120 INFO:tasks.workunit.client.1.smithi154.stdout:2/191: mknod db/de/d16/d31/c40 0 2024-05-06T21:26:45.122 INFO:tasks.workunit.client.1.smithi154.stdout:4/195: write d0/d10/f15 [2770919,118896] 0 2024-05-06T21:26:45.123 INFO:tasks.workunit.client.1.smithi154.stdout:5/235: rename d2/d3/d21/l3a to d2/d3/l4e 0 2024-05-06T21:26:45.123 INFO:tasks.workunit.client.1.smithi154.stdout:5/236: chown d2/f14 134 1 2024-05-06T21:26:45.124 INFO:tasks.workunit.client.1.smithi154.stdout:3/286: mknod d0/c5f 0 2024-05-06T21:26:45.126 INFO:tasks.workunit.client.1.smithi154.stdout:6/179: write d8/d11/f1d [881350,112510] 0 2024-05-06T21:26:45.126 INFO:tasks.workunit.client.1.smithi154.stdout:6/180: chown d8/d11/c35 49154 1 2024-05-06T21:26:45.126 INFO:tasks.workunit.client.1.smithi154.stdout:6/181: read d8/d11/f1d [1201114,94598] 0 2024-05-06T21:26:45.126 INFO:tasks.workunit.client.1.smithi154.stdout:6/182: truncate d8/d11/d2d/f3a 554095 0 2024-05-06T21:26:45.126 INFO:tasks.workunit.client.1.smithi154.stdout:1/246: dwrite d6/db/d10/d26/d1b/d45/d48/f43 [0,4194304] 0 2024-05-06T21:26:45.126 INFO:tasks.workunit.client.1.smithi154.stdout:1/247: truncate d6/db/d10/d15/f4a 257333 0 2024-05-06T21:26:45.127 INFO:tasks.workunit.client.1.smithi154.stdout:2/192: symlink db/de/l41 0 2024-05-06T21:26:45.127 INFO:tasks.workunit.client.0.smithi032.stdout:0/538: dwrite d4/f1f [4194304,4194304] 0 2024-05-06T21:26:45.127 INFO:tasks.workunit.client.0.smithi032.stdout:0/539: dread - d4/da/d16/d33/da7/faa zero size 2024-05-06T21:26:45.127 INFO:tasks.workunit.client.0.smithi032.stdout:0/540: write d4/da/f81 [259780,110272] 0 2024-05-06T21:26:45.130 INFO:tasks.workunit.client.0.smithi032.stdout:0/541: symlink d4/da/d16/d33/d46/lab 0 2024-05-06T21:26:45.130 INFO:tasks.workunit.client.1.smithi154.stdout:9/328: dwrite d5/d20/d37/f5f [0,4194304] 0 2024-05-06T21:26:45.130 INFO:tasks.workunit.client.1.smithi154.stdout:4/196: unlink d0/d2/d2a/f32 0 2024-05-06T21:26:45.130 INFO:tasks.workunit.client.1.smithi154.stdout:4/197: read d0/f23 [579742,125131] 0 2024-05-06T21:26:45.130 INFO:tasks.workunit.client.1.smithi154.stdout:4/198: truncate d0/f23 1372487 0 2024-05-06T21:26:45.131 INFO:tasks.workunit.client.1.smithi154.stdout:5/237: mknod d2/d6/c4f 0 2024-05-06T21:26:45.132 INFO:tasks.workunit.client.1.smithi154.stdout:3/287: creat d0/da/db/dd/d1c/d21/f60 x:0 0 0 2024-05-06T21:26:45.132 INFO:tasks.workunit.client.1.smithi154.stdout:3/288: truncate d0/da/d1a/d28/d17/f4f 245729 0 2024-05-06T21:26:45.134 INFO:tasks.workunit.client.1.smithi154.stdout:6/183: link d8/d11/d2d/l2e d8/d11/d2d/l41 0 2024-05-06T21:26:45.139 INFO:tasks.workunit.client.1.smithi154.stdout:2/193: mknod db/de/d16/d31/c42 0 2024-05-06T21:26:45.139 INFO:tasks.workunit.client.1.smithi154.stdout:3/289: dread d0/da/f18 [0,4194304] 0 2024-05-06T21:26:45.139 INFO:tasks.workunit.client.1.smithi154.stdout:3/290: write d0/d2/f45 [1318164,93783] 0 2024-05-06T21:26:45.140 INFO:tasks.workunit.client.1.smithi154.stdout:3/291: chown d0/c5f 128569 1 2024-05-06T21:26:45.142 INFO:tasks.workunit.client.1.smithi154.stdout:1/248: creat d6/f52 x:0 0 0 2024-05-06T21:26:45.142 INFO:tasks.workunit.client.1.smithi154.stdout:2/194: read db/d12/f37 [30171,89321] 0 2024-05-06T21:26:45.142 INFO:tasks.workunit.client.1.smithi154.stdout:9/329: mknod d5/d14/d3a/c79 0 2024-05-06T21:26:45.142 INFO:tasks.workunit.client.0.smithi032.stdout:3/684: dwrite d1/d4/da/f2f [0,4194304] 0 2024-05-06T21:26:45.142 INFO:tasks.workunit.client.0.smithi032.stdout:3/685: write d1/d4/f9 [690186,112296] 0 2024-05-06T21:26:45.143 INFO:tasks.workunit.client.1.smithi154.stdout:4/199: symlink d0/d2/dc/l42 0 2024-05-06T21:26:45.143 INFO:tasks.workunit.client.1.smithi154.stdout:5/238: mknod d2/d48/c50 0 2024-05-06T21:26:45.145 INFO:tasks.workunit.client.1.smithi154.stdout:3/292: symlink d0/da/d1a/d28/d2f/d38/d55/l61 0 2024-05-06T21:26:45.146 INFO:tasks.workunit.client.0.smithi032.stdout:5/502: dwrite d0/fe [0,4194304] 0 2024-05-06T21:26:45.150 INFO:tasks.workunit.client.1.smithi154.stdout:9/330: symlink d5/d14/d3a/l7a 0 2024-05-06T21:26:45.150 INFO:tasks.workunit.client.1.smithi154.stdout:2/195: creat db/d12/f43 x:0 0 0 2024-05-06T21:26:45.150 INFO:tasks.workunit.client.1.smithi154.stdout:4/200: getdents d0/d10/d11/d1a/d31/d39 0 2024-05-06T21:26:45.150 INFO:tasks.workunit.client.1.smithi154.stdout:8/210: sync 2024-05-06T21:26:45.151 INFO:tasks.workunit.client.1.smithi154.stdout:5/239: symlink d2/d3/d21/d22/d25/d37/l51 0 2024-05-06T21:26:45.151 INFO:tasks.workunit.client.1.smithi154.stdout:5/240: chown d2/d3/d19/d23/f33 45 1 2024-05-06T21:26:45.153 INFO:tasks.workunit.client.1.smithi154.stdout:4/201: creat d0/d10/d11/d1a/d31/d3d/f43 x:0 0 0 2024-05-06T21:26:45.153 INFO:tasks.workunit.client.1.smithi154.stdout:4/202: write d0/d10/d11/d1a/f35 [581614,125308] 0 2024-05-06T21:26:45.155 INFO:tasks.workunit.client.1.smithi154.stdout:5/241: unlink d2/d3/d19/d23/c39 0 2024-05-06T21:26:45.155 INFO:tasks.workunit.client.1.smithi154.stdout:5/242: dread - d2/d3/d21/d22/f2e zero size 2024-05-06T21:26:45.155 INFO:tasks.workunit.client.1.smithi154.stdout:5/243: chown d2/d3/d19/d23/f33 16316429 1 2024-05-06T21:26:45.157 INFO:tasks.workunit.client.1.smithi154.stdout:4/203: mkdir d0/d10/d11/d1a/d31/d44 0 2024-05-06T21:26:45.157 INFO:tasks.workunit.client.1.smithi154.stdout:8/211: getdents d3 0 2024-05-06T21:26:45.157 INFO:tasks.workunit.client.1.smithi154.stdout:8/212: fdatasync d3/fc 0 2024-05-06T21:26:45.158 INFO:tasks.workunit.client.1.smithi154.stdout:5/244: truncate d2/d6/fe 7687748 0 2024-05-06T21:26:45.161 INFO:tasks.workunit.client.0.smithi032.stdout:3/686: rmdir d1/d4/da/d31 39 2024-05-06T21:26:45.164 INFO:tasks.workunit.client.0.smithi032.stdout:0/542: dwrite d4/da/d14/d1a/d66/f95 [0,4194304] 0 2024-05-06T21:26:45.164 INFO:tasks.workunit.client.1.smithi154.stdout:2/196: dread db/de/d16/f1f [0,4194304] 0 2024-05-06T21:26:45.166 INFO:tasks.workunit.client.0.smithi032.stdout:5/503: read d0/d28/f33 [1068304,103414] 0 2024-05-06T21:26:45.172 INFO:tasks.workunit.client.0.smithi032.stdout:0/543: symlink d4/da/d14/d1a/lac 0 2024-05-06T21:26:45.173 INFO:tasks.workunit.client.0.smithi032.stdout:5/504: creat d0/d24/d26/d3d/f95 x:0 0 0 2024-05-06T21:26:45.173 INFO:tasks.workunit.client.0.smithi032.stdout:5/505: readlink d0/d16/d2a/d59/d67/l94 0 2024-05-06T21:26:45.175 INFO:tasks.workunit.client.0.smithi032.stdout:0/544: dread d4/d3e/d63/d6c/f77 [0,4194304] 0 2024-05-06T21:26:45.175 INFO:tasks.workunit.client.0.smithi032.stdout:0/545: write d4/da/d16/d33/da7/faa [344261,76476] 0 2024-05-06T21:26:45.178 INFO:tasks.workunit.client.1.smithi154.stdout:1/249: dwrite d6/db/d10/d15/f4a [0,4194304] 0 2024-05-06T21:26:45.178 INFO:tasks.workunit.client.1.smithi154.stdout:1/250: dread - d6/d3e/f4d zero size 2024-05-06T21:26:45.179 INFO:tasks.workunit.client.0.smithi032.stdout:5/506: truncate d0/d24/d38/f3c 4343258 0 2024-05-06T21:26:45.179 INFO:tasks.workunit.client.0.smithi032.stdout:5/507: getdents d0/d24/d38/d88 0 2024-05-06T21:26:45.179 INFO:tasks.workunit.client.0.smithi032.stdout:5/508: write d0/d16/d2f/f6f [862771,71545] 0 2024-05-06T21:26:45.179 INFO:tasks.workunit.client.0.smithi032.stdout:5/509: read - d0/d16/d2f/d77/f7d zero size 2024-05-06T21:26:45.182 INFO:tasks.workunit.client.1.smithi154.stdout:1/251: rename d6/db/d10/d26/d1b/d45/d48 to d6/db/d10/d15/d1d/d53 0 2024-05-06T21:26:45.184 INFO:tasks.workunit.client.1.smithi154.stdout:1/252: symlink d6/d3e/l54 0 2024-05-06T21:26:45.186 INFO:tasks.workunit.client.1.smithi154.stdout:1/253: symlink d6/db/d10/d26/l55 0 2024-05-06T21:26:45.188 INFO:tasks.workunit.client.1.smithi154.stdout:1/254: creat d6/db/d10/d15/d1d/f56 x:0 0 0 2024-05-06T21:26:45.188 INFO:tasks.workunit.client.1.smithi154.stdout:1/255: fdatasync d6/db/d10/d15/f4a 0 2024-05-06T21:26:45.193 INFO:tasks.workunit.client.0.smithi032.stdout:5/510: dwrite d0/d16/d2f/f41 [0,4194304] 0 2024-05-06T21:26:45.195 INFO:tasks.workunit.client.1.smithi154.stdout:9/331: dwrite d5/d20/d37/f38 [4194304,4194304] 0 2024-05-06T21:26:45.197 INFO:tasks.workunit.client.0.smithi032.stdout:3/687: dread d1/d2a/f4c [0,4194304] 0 2024-05-06T21:26:45.203 INFO:tasks.workunit.client.0.smithi032.stdout:5/511: dread d0/fb [0,4194304] 0 2024-05-06T21:26:45.205 INFO:tasks.workunit.client.0.smithi032.stdout:5/512: mknod d0/d24/d26/d3d/d50/d5a/c96 0 2024-05-06T21:26:45.205 INFO:tasks.workunit.client.0.smithi032.stdout:5/513: chown d0/d16/f85 534781160 1 2024-05-06T21:26:45.206 INFO:tasks.workunit.client.1.smithi154.stdout:1/256: dread d6/f8 [0,4194304] 0 2024-05-06T21:26:45.216 INFO:tasks.workunit.client.1.smithi154.stdout:1/257: dread d6/f28 [0,4194304] 0 2024-05-06T21:26:45.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/258: dread d6/db/d10/d15/f39 [0,4194304] 0 2024-05-06T21:26:45.225 INFO:tasks.workunit.client.0.smithi032.stdout:3/688: dwrite d1/d4/da/d4e/d41/d97/d67/f78 [0,4194304] 0 2024-05-06T21:26:45.225 INFO:tasks.workunit.client.0.smithi032.stdout:3/689: fdatasync d1/d4/da/d4e/d41/d97/d67/f7b 0 2024-05-06T21:26:45.225 INFO:tasks.workunit.client.1.smithi154.stdout:4/204: dwrite d0/d10/d11/f17 [4194304,4194304] 0 2024-05-06T21:26:45.226 INFO:tasks.workunit.client.1.smithi154.stdout:5/245: dwrite d2/d3/d19/f2b [0,4194304] 0 2024-05-06T21:26:45.226 INFO:tasks.workunit.client.1.smithi154.stdout:5/246: chown d2/d6/dd/l1c 1134 1 2024-05-06T21:26:45.226 INFO:tasks.workunit.client.0.smithi032.stdout:5/514: dread d0/d16/d2f/d77/f7c [0,4194304] 0 2024-05-06T21:26:45.229 INFO:tasks.workunit.client.0.smithi032.stdout:3/690: rename d1/d4/da/d9f/d74/da7 to d1/d4/da/d4e/d5e/d84/df2 0 2024-05-06T21:26:45.230 INFO:tasks.workunit.client.0.smithi032.stdout:5/515: creat d0/d24/d38/d88/f97 x:0 0 0 2024-05-06T21:26:45.230 INFO:tasks.workunit.client.0.smithi032.stdout:5/516: readlink d0/d16/d2a/d59/l74 0 2024-05-06T21:26:45.231 INFO:tasks.workunit.client.1.smithi154.stdout:4/205: symlink d0/d10/l45 0 2024-05-06T21:26:45.231 INFO:tasks.workunit.client.1.smithi154.stdout:2/197: dwrite db/de/f1c [0,4194304] 0 2024-05-06T21:26:45.231 INFO:tasks.workunit.client.1.smithi154.stdout:9/332: dwrite d5/d20/f2c [0,4194304] 0 2024-05-06T21:26:45.231 INFO:tasks.workunit.client.1.smithi154.stdout:9/333: truncate d5/d14/d31/f5e 766061 0 2024-05-06T21:26:45.232 INFO:tasks.workunit.client.1.smithi154.stdout:5/247: link d2/d6/dd/l4d d2/d6/dd/d2a/l52 0 2024-05-06T21:26:45.232 INFO:tasks.workunit.client.0.smithi032.stdout:0/546: dwrite d4/da/d16/d33/d46/f50 [0,4194304] 0 2024-05-06T21:26:45.232 INFO:tasks.workunit.client.0.smithi032.stdout:3/691: rmdir d1/d4/da/d4e/d41/dab 0 2024-05-06T21:26:45.233 INFO:tasks.workunit.client.1.smithi154.stdout:4/206: creat d0/d10/d11/f46 x:0 0 0 2024-05-06T21:26:45.235 INFO:tasks.workunit.client.1.smithi154.stdout:2/198: creat db/de/d16/d33/f44 x:0 0 0 2024-05-06T21:26:45.236 INFO:tasks.workunit.client.1.smithi154.stdout:5/248: dread d2/d3/f35 [0,4194304] 0 2024-05-06T21:26:45.237 INFO:tasks.workunit.client.1.smithi154.stdout:4/207: mkdir d0/d2/d47 0 2024-05-06T21:26:45.237 INFO:tasks.workunit.client.0.smithi032.stdout:0/547: symlink d4/da/d14/d1a/lad 0 2024-05-06T21:26:45.238 INFO:tasks.workunit.client.0.smithi032.stdout:0/548: chown d4/da/d14/d1a/f1b 7 1 2024-05-06T21:26:45.239 INFO:tasks.workunit.client.1.smithi154.stdout:1/259: dwrite d6/db/d10/d26/f23 [0,4194304] 0 2024-05-06T21:26:45.239 INFO:tasks.workunit.client.1.smithi154.stdout:1/260: write d6/db/d10/f51 [810727,89577] 0 2024-05-06T21:26:45.239 INFO:tasks.workunit.client.1.smithi154.stdout:1/261: readlink d6/db/d10/l21 0 2024-05-06T21:26:45.239 INFO:tasks.workunit.client.1.smithi154.stdout:1/262: write d6/f24 [1210105,69310] 0 2024-05-06T21:26:45.239 INFO:tasks.workunit.client.1.smithi154.stdout:1/263: creat d6/db/d10/d15/d1d/f57 x:0 0 0 2024-05-06T21:26:45.239 INFO:tasks.workunit.client.1.smithi154.stdout:1/264: chown d6/d3e/l54 2 1 2024-05-06T21:26:45.240 INFO:tasks.workunit.client.1.smithi154.stdout:5/249: rename d2/f42 to d2/d6/dc/f53 0 2024-05-06T21:26:45.240 INFO:tasks.workunit.client.1.smithi154.stdout:7/122: sync 2024-05-06T21:26:45.241 INFO:tasks.workunit.client.0.smithi032.stdout:0/549: rename d4/da/d14/d1a/f1b to d4/da/d14/d1a/fae 0 2024-05-06T21:26:45.242 INFO:tasks.workunit.client.1.smithi154.stdout:2/199: dread db/f3c [0,4194304] 0 2024-05-06T21:26:45.242 INFO:tasks.workunit.client.1.smithi154.stdout:4/208: creat d0/d2/dc/f48 x:0 0 0 2024-05-06T21:26:45.245 INFO:tasks.workunit.client.0.smithi032.stdout:3/692: dread d1/d4/da/d4e/d41/d45/f6a [0,4194304] 0 2024-05-06T21:26:45.246 INFO:tasks.workunit.client.0.smithi032.stdout:3/693: readlink d1/d4/da/d4e/l28 0 2024-05-06T21:26:45.246 INFO:tasks.workunit.client.0.smithi032.stdout:0/550: link d4/f24 d4/da/d16/d33/d9e/faf 0 2024-05-06T21:26:45.251 INFO:tasks.workunit.client.1.smithi154.stdout:7/123: symlink d6/d20/l29 0 2024-05-06T21:26:45.251 INFO:tasks.workunit.client.1.smithi154.stdout:7/124: stat d6/de/d23/f28 0 2024-05-06T21:26:45.251 INFO:tasks.workunit.client.1.smithi154.stdout:7/125: write d6/fb [1395588,127633] 0 2024-05-06T21:26:45.253 INFO:tasks.workunit.client.1.smithi154.stdout:2/200: mknod db/de/d16/c45 0 2024-05-06T21:26:45.253 INFO:tasks.workunit.client.1.smithi154.stdout:2/201: fdatasync db/de/f11 0 2024-05-06T21:26:45.253 INFO:tasks.workunit.client.1.smithi154.stdout:2/202: truncate db/de/d16/f3f 968268 0 2024-05-06T21:26:45.253 INFO:tasks.workunit.client.1.smithi154.stdout:2/203: write db/d12/f43 [917203,41753] 0 2024-05-06T21:26:45.254 INFO:tasks.workunit.client.1.smithi154.stdout:5/250: write d2/d6/f7 [177538,11643] 0 2024-05-06T21:26:45.255 INFO:tasks.workunit.client.1.smithi154.stdout:4/209: symlink d0/d10/d11/d1a/d31/d3d/l49 0 2024-05-06T21:26:45.260 INFO:tasks.workunit.client.0.smithi032.stdout:9/566: sync 2024-05-06T21:26:45.260 INFO:tasks.workunit.client.0.smithi032.stdout:4/642: sync 2024-05-06T21:26:45.260 INFO:tasks.workunit.client.0.smithi032.stdout:1/512: sync 2024-05-06T21:26:45.260 INFO:tasks.workunit.client.0.smithi032.stdout:4/643: creat d2/d2c/d31/d7c/fd4 x:0 0 0 2024-05-06T21:26:45.260 INFO:tasks.workunit.client.0.smithi032.stdout:9/567: write d1/d13/d25/d59/f84 [4331324,117053] 0 2024-05-06T21:26:45.261 INFO:tasks.workunit.client.1.smithi154.stdout:5/251: rename d2/d3/d21/d22/d25/d27 to d2/d6/dd/d2a/d54 0 2024-05-06T21:26:45.261 INFO:tasks.workunit.client.1.smithi154.stdout:4/210: mkdir d0/d2/d2a/d4a 0 2024-05-06T21:26:45.261 INFO:tasks.workunit.client.1.smithi154.stdout:4/211: read - d0/d2/fa zero size 2024-05-06T21:26:45.261 INFO:tasks.workunit.client.1.smithi154.stdout:4/212: readlink d0/d10/l24 0 2024-05-06T21:26:45.262 INFO:tasks.workunit.client.1.smithi154.stdout:4/213: chown d0/c4 184370 1 2024-05-06T21:26:45.262 INFO:tasks.workunit.client.1.smithi154.stdout:7/126: write d6/f10 [1368033,84251] 0 2024-05-06T21:26:45.262 INFO:tasks.workunit.client.1.smithi154.stdout:7/127: rename d6/de to d6/de/d21/d2a 22 2024-05-06T21:26:45.262 INFO:tasks.workunit.client.1.smithi154.stdout:5/252: mknod d2/d6/dc/d44/c55 0 2024-05-06T21:26:45.263 INFO:tasks.workunit.client.1.smithi154.stdout:7/128: mknod d6/c2b 0 2024-05-06T21:26:45.264 INFO:tasks.workunit.client.0.smithi032.stdout:6/665: sync 2024-05-06T21:26:45.264 INFO:tasks.workunit.client.1.smithi154.stdout:5/253: symlink d2/d3/d21/d22/d25/d37/l56 0 2024-05-06T21:26:45.265 INFO:tasks.workunit.client.1.smithi154.stdout:7/129: mknod d6/de/d23/c2c 0 2024-05-06T21:26:45.267 INFO:tasks.workunit.client.0.smithi032.stdout:8/715: sync 2024-05-06T21:26:45.267 INFO:tasks.workunit.client.0.smithi032.stdout:2/501: sync 2024-05-06T21:26:45.267 INFO:tasks.workunit.client.0.smithi032.stdout:7/633: sync 2024-05-06T21:26:45.267 INFO:tasks.workunit.client.0.smithi032.stdout:8/716: creat d0/d1c/d5e/d67/dc3/db5/dd0/fde x:0 0 0 2024-05-06T21:26:45.267 INFO:tasks.workunit.client.0.smithi032.stdout:8/717: fsync d0/d1b/d39/f6b 0 2024-05-06T21:26:45.268 INFO:tasks.workunit.client.0.smithi032.stdout:0/551: dread d4/da/d14/d1a/f1c [0,4194304] 0 2024-05-06T21:26:45.268 INFO:tasks.workunit.client.0.smithi032.stdout:5/517: dwrite d0/d16/d2f/f6f [0,4194304] 0 2024-05-06T21:26:45.268 INFO:tasks.workunit.client.0.smithi032.stdout:5/518: fsync d0/d16/f85 0 2024-05-06T21:26:45.269 INFO:tasks.workunit.client.0.smithi032.stdout:0/552: fsync d4/da/d14/d1a/fa2 0 2024-05-06T21:26:45.269 INFO:tasks.workunit.client.0.smithi032.stdout:0/553: dread - d4/da/d16/d4f/fa9 zero size 2024-05-06T21:26:45.269 INFO:tasks.workunit.client.0.smithi032.stdout:0/554: chown d4/da/d14/d1a/d66/f95 412964626 1 2024-05-06T21:26:45.269 INFO:tasks.workunit.client.0.smithi032.stdout:0/555: stat d4/da/d14/d1a/l6b 0 2024-05-06T21:26:45.269 INFO:tasks.workunit.client.0.smithi032.stdout:0/556: dread - d4/da/d16/d4f/fa9 zero size 2024-05-06T21:26:45.269 INFO:tasks.workunit.client.0.smithi032.stdout:0/557: write d4/da/d14/d1a/fae [4582422,121551] 0 2024-05-06T21:26:45.269 INFO:tasks.workunit.client.0.smithi032.stdout:9/568: symlink d1/d13/d33/d5e/lbc 0 2024-05-06T21:26:45.270 INFO:tasks.workunit.client.0.smithi032.stdout:1/513: rename db/d16/c3b to db/d16/d46/d57/ca6 0 2024-05-06T21:26:45.270 INFO:tasks.workunit.client.0.smithi032.stdout:6/666: rmdir d8/d3d/d49/d6b 39 2024-05-06T21:26:45.271 INFO:tasks.workunit.client.0.smithi032.stdout:2/502: rmdir df/d19/d1e/d71/d5f/d73 39 2024-05-06T21:26:45.271 INFO:tasks.workunit.client.0.smithi032.stdout:2/503: chown df/d19/c82 10819873 1 2024-05-06T21:26:45.271 INFO:tasks.workunit.client.0.smithi032.stdout:2/504: stat df/d19/d1e/d1f/d2e/d33/f9a 0 2024-05-06T21:26:45.273 INFO:tasks.workunit.client.0.smithi032.stdout:7/634: getdents db/d12/d16/d21/d41/d4b 0 2024-05-06T21:26:45.275 INFO:tasks.workunit.client.0.smithi032.stdout:8/718: mknod d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/cdf 0 2024-05-06T21:26:45.275 INFO:tasks.workunit.client.0.smithi032.stdout:8/719: fdatasync d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/fb1 0 2024-05-06T21:26:45.276 INFO:tasks.workunit.client.0.smithi032.stdout:8/720: chown d0/d1b/d39/d93 1600856064 1 2024-05-06T21:26:45.277 INFO:tasks.workunit.client.0.smithi032.stdout:0/558: getdents d4/da/d14/d1a/d66/d8a 0 2024-05-06T21:26:45.279 INFO:tasks.workunit.client.0.smithi032.stdout:1/514: truncate db/f23 2412256 0 2024-05-06T21:26:45.280 INFO:tasks.workunit.client.0.smithi032.stdout:6/667: creat d8/dd/d18/d13/fc6 x:0 0 0 2024-05-06T21:26:45.281 INFO:tasks.workunit.client.0.smithi032.stdout:2/505: truncate df/d19/d1e/d1f/d2e/d33/f15 1002228 0 2024-05-06T21:26:45.283 INFO:tasks.workunit.client.0.smithi032.stdout:7/635: mknod db/d12/d16/da1/cc8 0 2024-05-06T21:26:45.284 INFO:tasks.workunit.client.0.smithi032.stdout:7/636: creat db/d12/fc9 x:0 0 0 2024-05-06T21:26:45.285 INFO:tasks.workunit.client.1.smithi154.stdout:1/265: rmdir d6 39 2024-05-06T21:26:45.285 INFO:tasks.workunit.client.0.smithi032.stdout:0/559: truncate d4/da/f60 182393 0 2024-05-06T21:26:45.287 INFO:tasks.workunit.client.0.smithi032.stdout:2/506: mknod df/d19/d1e/d71/d5f/d7d/d25/cb2 0 2024-05-06T21:26:45.287 INFO:tasks.workunit.client.0.smithi032.stdout:9/569: write d1/d13/d33/d5e/d78/f8d [71860,124594] 0 2024-05-06T21:26:45.287 INFO:tasks.workunit.client.0.smithi032.stdout:9/570: creat d1/d13/d33/d3f/d60/fbd x:0 0 0 2024-05-06T21:26:45.287 INFO:tasks.workunit.client.0.smithi032.stdout:9/571: chown d1/d13/d33/da6/fb2 14642 1 2024-05-06T21:26:45.288 INFO:tasks.workunit.client.0.smithi032.stdout:7/637: mknod db/d12/d16/d2a/d39/cca 0 2024-05-06T21:26:45.289 INFO:tasks.workunit.client.0.smithi032.stdout:7/638: write db/d12/d16/d2a/d39/d3b/f3d [4347941,31667] 0 2024-05-06T21:26:45.289 INFO:tasks.workunit.client.0.smithi032.stdout:8/721: dread d0/d1b/d47/d91/fa3 [4194304,4194304] 0 2024-05-06T21:26:45.289 INFO:tasks.workunit.client.1.smithi154.stdout:1/266: unlink d6/db/d10/l21 0 2024-05-06T21:26:45.290 INFO:tasks.workunit.client.0.smithi032.stdout:2/507: creat df/d19/d1e/d71/d5f/d7d/d65/d78/da6/fb3 x:0 0 0 2024-05-06T21:26:45.290 INFO:tasks.workunit.client.0.smithi032.stdout:2/508: read df/d19/d1e/d71/d5f/d7d/f5c [126925,35014] 0 2024-05-06T21:26:45.290 INFO:tasks.workunit.client.1.smithi154.stdout:1/267: rename d6/c7 to d6/db/d10/d26/d1b/d45/c58 0 2024-05-06T21:26:45.295 INFO:tasks.workunit.client.0.smithi032.stdout:9/572: mkdir d1/d13/d34/d26/d9f/dbe 0 2024-05-06T21:26:45.296 INFO:tasks.workunit.client.0.smithi032.stdout:9/573: creat d1/d13/d33/da6/fbf x:0 0 0 2024-05-06T21:26:45.296 INFO:tasks.workunit.client.0.smithi032.stdout:9/574: readlink d1/d13/l19 0 2024-05-06T21:26:45.296 INFO:tasks.workunit.client.0.smithi032.stdout:9/575: fdatasync d1/f1a 0 2024-05-06T21:26:45.297 INFO:tasks.workunit.client.0.smithi032.stdout:7/639: mkdir db/d12/d16/d21/dcb 0 2024-05-06T21:26:45.300 INFO:tasks.workunit.client.0.smithi032.stdout:2/509: mknod df/dae/cb4 0 2024-05-06T21:26:45.300 INFO:tasks.workunit.client.0.smithi032.stdout:2/510: chown df/d19/d1e/d54/f59 3047 1 2024-05-06T21:26:45.302 INFO:tasks.workunit.client.0.smithi032.stdout:7/640: truncate db/f77 688302 0 2024-05-06T21:26:45.303 INFO:tasks.workunit.client.0.smithi032.stdout:8/722: getdents d0/d1c 0 2024-05-06T21:26:45.305 INFO:tasks.workunit.client.1.smithi154.stdout:5/254: dread d2/d3/fa [0,4194304] 0 2024-05-06T21:26:45.305 INFO:tasks.workunit.client.1.smithi154.stdout:5/255: chown d2/d6/dc/c1e 27 1 2024-05-06T21:26:45.306 INFO:tasks.workunit.client.1.smithi154.stdout:2/204: dwrite f2 [0,4194304] 0 2024-05-06T21:26:45.309 INFO:tasks.workunit.client.0.smithi032.stdout:6/668: write d8/f8c [1851508,33174] 0 2024-05-06T21:26:45.309 INFO:tasks.workunit.client.0.smithi032.stdout:6/669: chown d8/dd/d18/d13/d7a 1201434 1 2024-05-06T21:26:45.309 INFO:tasks.workunit.client.0.smithi032.stdout:4/644: dwrite d2/fc [4194304,4194304] 0 2024-05-06T21:26:45.309 INFO:tasks.workunit.client.0.smithi032.stdout:7/641: rmdir db/d12/d16/d2a 39 2024-05-06T21:26:45.310 INFO:tasks.workunit.client.1.smithi154.stdout:5/256: mkdir d2/d6/dd/d57 0 2024-05-06T21:26:45.310 INFO:tasks.workunit.client.1.smithi154.stdout:5/257: fdatasync d2/f14 0 2024-05-06T21:26:45.312 INFO:tasks.workunit.client.0.smithi032.stdout:1/515: dread db/d16/f33 [4194304,4194304] 0 2024-05-06T21:26:45.312 INFO:tasks.workunit.client.0.smithi032.stdout:6/670: creat d8/d3d/d8f/fc7 x:0 0 0 2024-05-06T21:26:45.312 INFO:tasks.workunit.client.0.smithi032.stdout:5/519: dwrite d0/d16/d46/f7a [4194304,4194304] 0 2024-05-06T21:26:45.315 INFO:tasks.workunit.client.0.smithi032.stdout:6/671: creat d8/fc8 x:0 0 0 2024-05-06T21:26:45.317 INFO:tasks.workunit.client.0.smithi032.stdout:8/723: dread d0/d1c/d5e/d67/dc3/d57/d5d/faa [0,4194304] 0 2024-05-06T21:26:45.317 INFO:tasks.workunit.client.0.smithi032.stdout:8/724: chown d0/d1c/c50 470 1 2024-05-06T21:26:45.317 INFO:tasks.workunit.client.0.smithi032.stdout:8/725: creat d0/d1c/d5e/d67/dc3/d57/d5d/d63/fe0 x:0 0 0 2024-05-06T21:26:45.317 INFO:tasks.workunit.client.0.smithi032.stdout:8/726: write d0/d1c/d5e/d67/dc3/db5/dd0/fd4 [345365,99138] 0 2024-05-06T21:26:45.317 INFO:tasks.workunit.client.0.smithi032.stdout:8/727: fdatasync d0/d1c/d5e/d67/dc3/d57/d5d/d63/fe0 0 2024-05-06T21:26:45.318 INFO:tasks.workunit.client.1.smithi154.stdout:4/214: rmdir d0/d2/d2a 39 2024-05-06T21:26:45.318 INFO:tasks.workunit.client.1.smithi154.stdout:4/215: chown d0/d2/dc/f26 1523227 1 2024-05-06T21:26:45.318 INFO:tasks.workunit.client.1.smithi154.stdout:4/216: readlink d0/d10/l24 0 2024-05-06T21:26:45.321 INFO:tasks.workunit.client.1.smithi154.stdout:5/258: symlink d2/d6/dd/d57/l58 0 2024-05-06T21:26:45.323 INFO:tasks.workunit.client.0.smithi032.stdout:3/694: dwrite d1/f14 [0,4194304] 0 2024-05-06T21:26:45.323 INFO:tasks.workunit.client.0.smithi032.stdout:3/695: truncate d1/d4/da/d31/d9b/daa/fd4 707270 0 2024-05-06T21:26:45.324 INFO:tasks.workunit.client.1.smithi154.stdout:4/217: creat d0/d10/d11/d1a/d31/d39/f4b x:0 0 0 2024-05-06T21:26:45.324 INFO:tasks.workunit.client.1.smithi154.stdout:4/218: creat d0/d2/f4c x:0 0 0 2024-05-06T21:26:45.324 INFO:tasks.workunit.client.1.smithi154.stdout:4/219: write d0/d10/d11/d1a/f3f [844939,109437] 0 2024-05-06T21:26:45.326 INFO:tasks.workunit.client.1.smithi154.stdout:7/130: getdents d6 0 2024-05-06T21:26:45.327 INFO:tasks.workunit.client.1.smithi154.stdout:5/259: mknod d2/d6/dd/d2a/c59 0 2024-05-06T21:26:45.327 INFO:tasks.workunit.client.0.smithi032.stdout:5/520: write d0/d16/d2f/d77/f7c [1113804,48128] 0 2024-05-06T21:26:45.330 INFO:tasks.workunit.client.1.smithi154.stdout:4/220: rename d0/d2/dc/f1e to d0/d10/d11/d1a/d31/d44/f4d 0 2024-05-06T21:26:45.334 INFO:tasks.workunit.client.1.smithi154.stdout:7/131: mknod d6/c2d 0 2024-05-06T21:26:45.334 INFO:tasks.workunit.client.1.smithi154.stdout:5/260: symlink d2/d3/d21/d22/d25/d37/l5a 0 2024-05-06T21:26:45.334 INFO:tasks.workunit.client.1.smithi154.stdout:5/261: fsync d2/f1d 0 2024-05-06T21:26:45.335 INFO:tasks.workunit.client.0.smithi032.stdout:8/728: truncate d0/d1c/f88 2605828 0 2024-05-06T21:26:45.335 INFO:tasks.workunit.client.1.smithi154.stdout:5/262: creat d2/d6/dc/d44/f5b x:0 0 0 2024-05-06T21:26:45.338 INFO:tasks.workunit.client.0.smithi032.stdout:0/560: dwrite d4/f24 [0,4194304] 0 2024-05-06T21:26:45.340 INFO:tasks.workunit.client.0.smithi032.stdout:3/696: mkdir d1/d4/da/d4e/d5e/d84/df2/df3 0 2024-05-06T21:26:45.343 INFO:tasks.workunit.client.0.smithi032.stdout:5/521: symlink d0/d24/d38/l98 0 2024-05-06T21:26:45.343 INFO:tasks.workunit.client.0.smithi032.stdout:5/522: chown d0/l4c 60871543 1 2024-05-06T21:26:45.345 INFO:tasks.workunit.client.0.smithi032.stdout:8/729: symlink d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/le1 0 2024-05-06T21:26:45.349 INFO:tasks.workunit.client.1.smithi154.stdout:1/268: dwrite d6/db/d10/d15/f4a [4194304,4194304] 0 2024-05-06T21:26:45.349 INFO:tasks.workunit.client.1.smithi154.stdout:1/269: readlink d6/db/d10/d26/l55 0 2024-05-06T21:26:45.349 INFO:tasks.workunit.client.1.smithi154.stdout:1/270: chown d6/db/f4f 739459 1 2024-05-06T21:26:45.354 INFO:tasks.workunit.client.0.smithi032.stdout:5/523: truncate d0/d24/d38/f3c 2451702 0 2024-05-06T21:26:45.355 INFO:tasks.workunit.client.1.smithi154.stdout:1/271: dread d6/db/d10/f33 [0,4194304] 0 2024-05-06T21:26:45.355 INFO:tasks.workunit.client.0.smithi032.stdout:0/561: mkdir d4/db0 0 2024-05-06T21:26:45.368 INFO:tasks.workunit.client.0.smithi032.stdout:0/562: dwrite d4/d3e/d63/f56 [0,4194304] 0 2024-05-06T21:26:45.370 INFO:tasks.workunit.client.0.smithi032.stdout:2/511: dwrite df/d19/d1e/d71/d5f/d7d/d65/f85 [8388608,4194304] 0 2024-05-06T21:26:45.372 INFO:tasks.workunit.client.0.smithi032.stdout:9/576: dwrite d1/d13/d25/fba [0,4194304] 0 2024-05-06T21:26:45.374 INFO:tasks.workunit.client.0.smithi032.stdout:2/512: creat df/daf/fb5 x:0 0 0 2024-05-06T21:26:45.377 INFO:tasks.workunit.client.0.smithi032.stdout:2/513: symlink df/d19/d1e/d35/d3f/d46/lb6 0 2024-05-06T21:26:45.378 INFO:tasks.workunit.client.0.smithi032.stdout:4/645: dwrite d2/d1e/f22 [0,4194304] 0 2024-05-06T21:26:45.378 INFO:tasks.workunit.client.0.smithi032.stdout:9/577: dread d1/d13/d33/d5e/d78/f80 [0,4194304] 0 2024-05-06T21:26:45.381 INFO:tasks.workunit.client.0.smithi032.stdout:2/514: link df/d19/d1e/d71/d5f/d7d/d25/d2d/f86 df/dae/fb7 0 2024-05-06T21:26:45.384 INFO:tasks.workunit.client.0.smithi032.stdout:9/578: rmdir d1/d13/d34/d26/d39/d99 0 2024-05-06T21:26:45.384 INFO:tasks.workunit.client.0.smithi032.stdout:9/579: stat d1/d13/d25/fba 0 2024-05-06T21:26:45.385 INFO:tasks.workunit.client.0.smithi032.stdout:2/515: creat df/d19/d1e/d54/fb8 x:0 0 0 2024-05-06T21:26:45.388 INFO:tasks.workunit.client.0.smithi032.stdout:4/646: unlink d2/c4f 0 2024-05-06T21:26:45.388 INFO:tasks.workunit.client.0.smithi032.stdout:4/647: write d2/d16/d44/d45/fbf [132620,119976] 0 2024-05-06T21:26:45.388 INFO:tasks.workunit.client.0.smithi032.stdout:4/648: fdatasync d2/d16/d44/d45/f6d 0 2024-05-06T21:26:45.389 INFO:tasks.workunit.client.0.smithi032.stdout:4/649: truncate d2/d16/d44/d74/f92 2967593 0 2024-05-06T21:26:45.390 INFO:tasks.workunit.client.0.smithi032.stdout:7/642: dwrite db/f1e [0,4194304] 0 2024-05-06T21:26:45.394 INFO:tasks.workunit.client.0.smithi032.stdout:9/580: read d1/f23 [827287,11758] 0 2024-05-06T21:26:45.394 INFO:tasks.workunit.client.0.smithi032.stdout:3/697: dwrite d1/f5d [0,4194304] 0 2024-05-06T21:26:45.394 INFO:tasks.workunit.client.0.smithi032.stdout:3/698: dread - d1/d4/da/d9f/db8/fc5 zero size 2024-05-06T21:26:45.394 INFO:tasks.workunit.client.0.smithi032.stdout:3/699: read - d1/d4/da/d31/d47/d4a/d68/fe6 zero size 2024-05-06T21:26:45.394 INFO:tasks.workunit.client.1.smithi154.stdout:2/205: dwrite db/f3c [0,4194304] 0 2024-05-06T21:26:45.396 INFO:tasks.workunit.client.0.smithi032.stdout:9/581: symlink d1/d13/d33/d5e/lc0 0 2024-05-06T21:26:45.396 INFO:tasks.workunit.client.0.smithi032.stdout:9/582: write d1/d13/d34/d26/d39/d8b/f9d [707946,75117] 0 2024-05-06T21:26:45.397 INFO:tasks.workunit.client.1.smithi154.stdout:2/206: mkdir db/de/d16/d31/d46 0 2024-05-06T21:26:45.397 INFO:tasks.workunit.client.1.smithi154.stdout:2/207: readlink db/d12/d19/l20 0 2024-05-06T21:26:45.400 INFO:tasks.workunit.client.0.smithi032.stdout:3/700: symlink d1/d4/da/d1d/dc0/lf4 0 2024-05-06T21:26:45.400 INFO:tasks.workunit.client.1.smithi154.stdout:2/208: creat db/d12/d1d/f47 x:0 0 0 2024-05-06T21:26:45.400 INFO:tasks.workunit.client.1.smithi154.stdout:2/209: write db/d12/d19/f39 [194226,121604] 0 2024-05-06T21:26:45.400 INFO:tasks.workunit.client.1.smithi154.stdout:2/210: chown db/d12/d19/f39 2 1 2024-05-06T21:26:45.401 INFO:tasks.workunit.client.0.smithi032.stdout:9/583: symlink d1/d13/d33/d8e/lc1 0 2024-05-06T21:26:45.401 INFO:tasks.workunit.client.0.smithi032.stdout:9/584: fsync d1/d13/d33/d3f/f4e 0 2024-05-06T21:26:45.401 INFO:tasks.workunit.client.0.smithi032.stdout:9/585: write d1/d13/d25/f7f [194676,118543] 0 2024-05-06T21:26:45.401 INFO:tasks.workunit.client.0.smithi032.stdout:9/586: fsync d1/d13/d33/d5e/d78/f80 0 2024-05-06T21:26:45.405 INFO:tasks.workunit.client.1.smithi154.stdout:0/240: sync 2024-05-06T21:26:45.407 INFO:tasks.workunit.client.1.smithi154.stdout:0/241: mknod d6/dc/d40/c4b 0 2024-05-06T21:26:45.408 INFO:tasks.workunit.client.0.smithi032.stdout:1/516: dwrite db/d16/f18 [0,4194304] 0 2024-05-06T21:26:45.408 INFO:tasks.workunit.client.1.smithi154.stdout:0/242: symlink d6/dc/l4c 0 2024-05-06T21:26:45.410 INFO:tasks.workunit.client.1.smithi154.stdout:0/243: rename d6/dc/d44/f35 to d6/dc/d44/d36/f4d 0 2024-05-06T21:26:45.410 INFO:tasks.workunit.client.0.smithi032.stdout:8/730: dwrite d0/d1c/d5e/d67/dc3/d57/d5d/fd8 [0,4194304] 0 2024-05-06T21:26:45.412 INFO:tasks.workunit.client.1.smithi154.stdout:0/244: rmdir d6/dc/d42 39 2024-05-06T21:26:45.416 INFO:tasks.workunit.client.1.smithi154.stdout:2/211: dread db/de/d10/f30 [0,4194304] 0 2024-05-06T21:26:45.417 INFO:tasks.workunit.client.0.smithi032.stdout:1/517: creat db/d47/d4a/fa7 x:0 0 0 2024-05-06T21:26:45.417 INFO:tasks.workunit.client.0.smithi032.stdout:6/672: dwrite d8/dd/d1b/d35/f3f [4194304,4194304] 0 2024-05-06T21:26:45.417 INFO:tasks.workunit.client.0.smithi032.stdout:6/673: fsync d8/dd/d18/d13/d7a/fb5 0 2024-05-06T21:26:45.419 INFO:tasks.workunit.client.1.smithi154.stdout:2/212: link db/f13 db/d12/d1d/f48 0 2024-05-06T21:26:45.420 INFO:tasks.workunit.client.1.smithi154.stdout:2/213: dread - db/d12/d1d/f47 zero size 2024-05-06T21:26:45.423 INFO:tasks.workunit.client.0.smithi032.stdout:9/587: rename d1/d13/d25 to d1/d2f/da1/dc2 0 2024-05-06T21:26:45.427 INFO:tasks.workunit.client.0.smithi032.stdout:6/674: creat d8/dd/d1b/d67/fc9 x:0 0 0 2024-05-06T21:26:45.428 INFO:tasks.workunit.client.0.smithi032.stdout:5/524: dwrite d0/f10 [0,4194304] 0 2024-05-06T21:26:45.428 INFO:tasks.workunit.client.1.smithi154.stdout:1/272: dwrite d6/db/d10/d15/f4a [0,4194304] 0 2024-05-06T21:26:45.428 INFO:tasks.workunit.client.1.smithi154.stdout:5/263: dwrite d2/d6/fb [0,4194304] 0 2024-05-06T21:26:45.430 INFO:tasks.workunit.client.1.smithi154.stdout:7/132: dwrite d6/fb [0,4194304] 0 2024-05-06T21:26:45.430 INFO:tasks.workunit.client.1.smithi154.stdout:7/133: fdatasync d6/d20/f1d 0 2024-05-06T21:26:45.430 INFO:tasks.workunit.client.1.smithi154.stdout:7/134: fsync d6/de/f17 0 2024-05-06T21:26:45.434 INFO:tasks.workunit.client.0.smithi032.stdout:9/588: rename d1/d13/d33/d8e/l94 to d1/d2f/lc3 0 2024-05-06T21:26:45.434 INFO:tasks.workunit.client.1.smithi154.stdout:7/135: unlink d6/d20/l29 0 2024-05-06T21:26:45.434 INFO:tasks.workunit.client.1.smithi154.stdout:2/214: dread db/f3c [0,4194304] 0 2024-05-06T21:26:45.438 INFO:tasks.workunit.client.0.smithi032.stdout:1/518: rename db/d16/c73 to db/d16/ca8 0 2024-05-06T21:26:45.439 INFO:tasks.workunit.client.1.smithi154.stdout:2/215: symlink db/de/d16/l49 0 2024-05-06T21:26:45.439 INFO:tasks.workunit.client.1.smithi154.stdout:2/216: fdatasync db/d12/f37 0 2024-05-06T21:26:45.440 INFO:tasks.workunit.client.0.smithi032.stdout:6/675: link d8/dd/l1c d8/dd/d18/d13/d7a/lca 0 2024-05-06T21:26:45.441 INFO:tasks.workunit.client.0.smithi032.stdout:6/676: dread d8/dd/d18/d3b/f50 [0,4194304] 0 2024-05-06T21:26:45.442 INFO:tasks.workunit.client.0.smithi032.stdout:5/525: mkdir d0/d16/d2f/d77/d99 0 2024-05-06T21:26:45.445 INFO:tasks.workunit.client.1.smithi154.stdout:2/217: dread db/d12/f43 [0,4194304] 0 2024-05-06T21:26:45.446 INFO:tasks.workunit.client.0.smithi032.stdout:9/589: write d1/d13/d33/d3f/f4e [1777128,108311] 0 2024-05-06T21:26:45.446 INFO:tasks.workunit.client.0.smithi032.stdout:9/590: chown d1/d2f/da1/dc2/f4b 478773 1 2024-05-06T21:26:45.446 INFO:tasks.workunit.client.0.smithi032.stdout:9/591: creat d1/d2f/fc4 x:0 0 0 2024-05-06T21:26:45.447 INFO:tasks.workunit.client.0.smithi032.stdout:1/519: rename db/f10 to db/fa9 0 2024-05-06T21:26:45.447 INFO:tasks.workunit.client.0.smithi032.stdout:2/516: dwrite df/dae/fb7 [0,4194304] 0 2024-05-06T21:26:45.448 INFO:tasks.workunit.client.0.smithi032.stdout:0/563: dwrite d4/f24 [0,4194304] 0 2024-05-06T21:26:45.449 INFO:tasks.workunit.client.1.smithi154.stdout:2/218: truncate f5 7214412 0 2024-05-06T21:26:45.449 INFO:tasks.workunit.client.1.smithi154.stdout:2/219: write db/de/d16/f3f [467885,12238] 0 2024-05-06T21:26:45.449 INFO:tasks.workunit.client.1.smithi154.stdout:2/220: write db/de/d16/d33/f44 [621423,85467] 0 2024-05-06T21:26:45.451 INFO:tasks.workunit.client.1.smithi154.stdout:2/221: symlink db/d12/d19/l4a 0 2024-05-06T21:26:45.451 INFO:tasks.workunit.client.1.smithi154.stdout:2/222: chown db/d12/d19/l3d 4214 1 2024-05-06T21:26:45.451 INFO:tasks.workunit.client.1.smithi154.stdout:2/223: chown db/de/d10/d18 965 1 2024-05-06T21:26:45.452 INFO:tasks.workunit.client.0.smithi032.stdout:3/701: dwrite d1/d4/f52 [4194304,4194304] 0 2024-05-06T21:26:45.453 INFO:tasks.workunit.client.1.smithi154.stdout:7/136: dread d6/d20/f1b [0,4194304] 0 2024-05-06T21:26:45.453 INFO:tasks.workunit.client.1.smithi154.stdout:2/224: mkdir db/d12/d19/d4b 0 2024-05-06T21:26:45.456 INFO:tasks.workunit.client.1.smithi154.stdout:2/225: unlink db/d12/d1d/c32 0 2024-05-06T21:26:45.457 INFO:tasks.workunit.client.1.smithi154.stdout:2/226: chown f0 81930 1 2024-05-06T21:26:45.458 INFO:tasks.workunit.client.0.smithi032.stdout:4/650: dwrite d2/d16/d44/d54/d69/d8a/f9b [0,4194304] 0 2024-05-06T21:26:45.458 INFO:tasks.workunit.client.0.smithi032.stdout:4/651: write d2/d16/d44/d74/d76/fab [297725,36841] 0 2024-05-06T21:26:45.458 INFO:tasks.workunit.client.0.smithi032.stdout:7/643: dwrite db/d12/d16/f57 [0,4194304] 0 2024-05-06T21:26:45.458 INFO:tasks.workunit.client.0.smithi032.stdout:7/644: truncate db/d12/fc9 607624 0 2024-05-06T21:26:45.462 INFO:tasks.workunit.client.0.smithi032.stdout:1/520: mknod db/d16/d46/d57/caa 0 2024-05-06T21:26:45.463 INFO:tasks.workunit.client.0.smithi032.stdout:3/702: write d1/d4/da/d31/d47/d4a/d68/d7c/f9a [7457215,88205] 0 2024-05-06T21:26:45.465 INFO:tasks.workunit.client.0.smithi032.stdout:8/731: dwrite d0/f37 [0,4194304] 0 2024-05-06T21:26:45.465 INFO:tasks.workunit.client.0.smithi032.stdout:8/732: fdatasync d0/f9 0 2024-05-06T21:26:45.466 INFO:tasks.workunit.client.0.smithi032.stdout:0/564: mknod d4/d3e/d42/cb1 0 2024-05-06T21:26:45.466 INFO:tasks.workunit.client.0.smithi032.stdout:0/565: creat d4/d3e/d63/d8d/fb2 x:0 0 0 2024-05-06T21:26:45.466 INFO:tasks.workunit.client.0.smithi032.stdout:0/566: write d4/da/d14/f71 [815891,72866] 0 2024-05-06T21:26:45.466 INFO:tasks.workunit.client.0.smithi032.stdout:0/567: chown d4/da/d98 11553485 1 2024-05-06T21:26:45.468 INFO:tasks.workunit.client.1.smithi154.stdout:0/245: rmdir d6/dc/d40 39 2024-05-06T21:26:45.469 INFO:tasks.workunit.client.0.smithi032.stdout:5/526: rename d0/d24/d38/d88 to d0/d16/d2a/d5f/d9a 0 2024-05-06T21:26:45.469 INFO:tasks.workunit.client.0.smithi032.stdout:1/521: dread db/d16/d46/f96 [0,4194304] 0 2024-05-06T21:26:45.469 INFO:tasks.workunit.client.0.smithi032.stdout:5/527: write d0/d24/d34/f45 [494261,26398] 0 2024-05-06T21:26:45.469 INFO:tasks.workunit.client.0.smithi032.stdout:5/528: chown d0/d24/d26/d3d/d50/d5a/c96 6695 1 2024-05-06T21:26:45.474 INFO:tasks.workunit.client.0.smithi032.stdout:8/733: write d0/d1c/d5e/d67/d7b/fb2 [603546,93353] 0 2024-05-06T21:26:45.477 INFO:tasks.workunit.client.0.smithi032.stdout:4/652: rename d2/d2c/d31/d7c/l3a to d2/d1e/ld5 0 2024-05-06T21:26:45.478 INFO:tasks.workunit.client.0.smithi032.stdout:4/653: stat d2/d2c/da8 0 2024-05-06T21:26:45.478 INFO:tasks.workunit.client.1.smithi154.stdout:0/246: dread d6/dc/d44/d36/f37 [4194304,4194304] 0 2024-05-06T21:26:45.479 INFO:tasks.workunit.client.0.smithi032.stdout:5/529: creat d0/d16/d2a/d5f/f9b x:0 0 0 2024-05-06T21:26:45.481 INFO:tasks.workunit.client.0.smithi032.stdout:0/568: dread d4/da/d14/d1a/f1c [0,4194304] 0 2024-05-06T21:26:45.481 INFO:tasks.workunit.client.0.smithi032.stdout:0/569: creat d4/da/d16/fb3 x:0 0 0 2024-05-06T21:26:45.481 INFO:tasks.workunit.client.0.smithi032.stdout:0/570: chown d4/da/d16/f3b 16287042 1 2024-05-06T21:26:45.481 INFO:tasks.workunit.client.0.smithi032.stdout:0/571: fdatasync d4/da/d16/f3c 0 2024-05-06T21:26:45.481 INFO:tasks.workunit.client.1.smithi154.stdout:1/273: dwrite d6/db/f34 [0,4194304] 0 2024-05-06T21:26:45.482 INFO:tasks.workunit.client.0.smithi032.stdout:8/734: rename d0/d1c/d5e/d67/dc3/d57/d5d/ca6 to d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/ce2 0 2024-05-06T21:26:45.483 INFO:tasks.workunit.client.0.smithi032.stdout:1/522: getdents db/d16/d46/d55 0 2024-05-06T21:26:45.483 INFO:tasks.workunit.client.0.smithi032.stdout:1/523: fsync db/d16/d46/d57/d58/f97 0 2024-05-06T21:26:45.485 INFO:tasks.workunit.client.0.smithi032.stdout:8/735: symlink d0/d1c/le3 0 2024-05-06T21:26:45.485 INFO:tasks.workunit.client.1.smithi154.stdout:6/184: sync 2024-05-06T21:26:45.486 INFO:tasks.workunit.client.0.smithi032.stdout:3/703: read d1/d4/da/d31/d47/d4a/d68/d7c/f90 [4082156,104266] 0 2024-05-06T21:26:45.486 INFO:tasks.workunit.client.0.smithi032.stdout:9/592: fdatasync d1/d2f/da1/dc2/d59/f84 0 2024-05-06T21:26:45.486 INFO:tasks.workunit.client.0.smithi032.stdout:9/593: dread - d1/d2f/fc4 zero size 2024-05-06T21:26:45.486 INFO:tasks.workunit.client.1.smithi154.stdout:5/264: dwrite d2/d3/f35 [0,4194304] 0 2024-05-06T21:26:45.486 INFO:tasks.workunit.client.0.smithi032.stdout:6/677: dwrite d8/dd/d1b/d35/f3a [0,4194304] 0 2024-05-06T21:26:45.489 INFO:tasks.workunit.client.0.smithi032.stdout:7/645: rename db/d12/d16/d2a/d39/d3b/d9c/lba to db/d12/d49/d97/lcc 0 2024-05-06T21:26:45.489 INFO:tasks.workunit.client.0.smithi032.stdout:2/517: dwrite df/d19/d1e/d54/f59 [0,4194304] 0 2024-05-06T21:26:45.490 INFO:tasks.workunit.client.0.smithi032.stdout:2/518: chown df/d19/d1e/d1f/d2e/d33/f27 9045 1 2024-05-06T21:26:45.490 INFO:tasks.workunit.client.1.smithi154.stdout:6/185: mkdir d8/d13/d42 0 2024-05-06T21:26:45.494 INFO:tasks.workunit.client.0.smithi032.stdout:3/704: mknod d1/d4/da/d4e/d41/d45/cf5 0 2024-05-06T21:26:45.494 INFO:tasks.workunit.client.0.smithi032.stdout:3/705: fdatasync d1/d4/da/d4e/d41/d97/d67/f78 0 2024-05-06T21:26:45.495 INFO:tasks.workunit.client.0.smithi032.stdout:5/530: dread d0/d16/d46/f7a [0,4194304] 0 2024-05-06T21:26:45.495 INFO:tasks.workunit.client.0.smithi032.stdout:9/594: creat d1/d2f/da1/dc2/d64/fc5 x:0 0 0 2024-05-06T21:26:45.495 INFO:tasks.workunit.client.0.smithi032.stdout:5/531: write d0/d24/d38/d37/d70/f72 [371660,87078] 0 2024-05-06T21:26:45.495 INFO:tasks.workunit.client.0.smithi032.stdout:5/532: write d0/d24/d38/f25 [4607984,86800] 0 2024-05-06T21:26:45.495 INFO:tasks.workunit.client.0.smithi032.stdout:5/533: creat d0/d24/d38/f9c x:0 0 0 2024-05-06T21:26:45.496 INFO:tasks.workunit.client.0.smithi032.stdout:5/534: chown d0/d16/d46/d78 6744562 1 2024-05-06T21:26:45.496 INFO:tasks.workunit.client.0.smithi032.stdout:5/535: chown d0/d28/f33 15906605 1 2024-05-06T21:26:45.496 INFO:tasks.workunit.client.0.smithi032.stdout:5/536: stat d0/d24/d26/d3d/d50/d5a/c96 0 2024-05-06T21:26:45.496 INFO:tasks.workunit.client.1.smithi154.stdout:7/137: dwrite d6/f25 [0,4194304] 0 2024-05-06T21:26:45.496 INFO:tasks.workunit.client.1.smithi154.stdout:0/247: dread d6/dc/d44/f11 [0,4194304] 0 2024-05-06T21:26:45.496 INFO:tasks.workunit.client.1.smithi154.stdout:0/248: chown d6/la 99038 1 2024-05-06T21:26:45.498 INFO:tasks.workunit.client.0.smithi032.stdout:6/678: creat d8/dd/d1b/d35/db4/fcb x:0 0 0 2024-05-06T21:26:45.500 INFO:tasks.workunit.client.1.smithi154.stdout:7/138: mkdir d6/de/d21/d2e 0 2024-05-06T21:26:45.501 INFO:tasks.workunit.client.1.smithi154.stdout:0/249: creat d6/dc/d44/d36/f4e x:0 0 0 2024-05-06T21:26:45.501 INFO:tasks.workunit.client.1.smithi154.stdout:0/250: stat d6/dc/d44/l22 0 2024-05-06T21:26:45.501 INFO:tasks.workunit.client.1.smithi154.stdout:0/251: readlink d6/dc/d40/d41/l43 0 2024-05-06T21:26:45.502 INFO:tasks.workunit.client.1.smithi154.stdout:7/139: mknod d6/d20/c2f 0 2024-05-06T21:26:45.503 INFO:tasks.workunit.client.0.smithi032.stdout:4/654: dwrite d2/d1e/f78 [0,4194304] 0 2024-05-06T21:26:45.503 INFO:tasks.workunit.client.0.smithi032.stdout:0/572: dwrite d4/d3e/d63/d6c/d8f/f92 [0,4194304] 0 2024-05-06T21:26:45.503 INFO:tasks.workunit.client.0.smithi032.stdout:0/573: write d4/d3e/d63/f6d [1332258,110755] 0 2024-05-06T21:26:45.504 INFO:tasks.workunit.client.0.smithi032.stdout:7/646: mkdir db/d12/d16/d2a/d39/d3b/d96/dcd 0 2024-05-06T21:26:45.504 INFO:tasks.workunit.client.1.smithi154.stdout:6/186: read d8/d11/f24 [529272,127165] 0 2024-05-06T21:26:45.504 INFO:tasks.workunit.client.1.smithi154.stdout:1/274: write d6/db/d10/d15/f4a [6001422,81502] 0 2024-05-06T21:26:45.504 INFO:tasks.workunit.client.1.smithi154.stdout:1/275: truncate d6/db/d10/d15/d1d/f57 193123 0 2024-05-06T21:26:45.504 INFO:tasks.workunit.client.1.smithi154.stdout:1/276: dread - d6/d3e/f4d zero size 2024-05-06T21:26:45.504 INFO:tasks.workunit.client.1.smithi154.stdout:1/277: chown d6/d3e/c46 0 1 2024-05-06T21:26:45.504 INFO:tasks.workunit.client.1.smithi154.stdout:0/252: rmdir d6/d27 39 2024-05-06T21:26:45.505 INFO:tasks.workunit.client.1.smithi154.stdout:6/187: symlink d8/d11/d33/l43 0 2024-05-06T21:26:45.506 INFO:tasks.workunit.client.0.smithi032.stdout:3/706: write d1/d4/d11/f4f [8063416,113272] 0 2024-05-06T21:26:45.507 INFO:tasks.workunit.client.1.smithi154.stdout:1/278: symlink d6/db/d10/d15/l59 0 2024-05-06T21:26:45.507 INFO:tasks.workunit.client.1.smithi154.stdout:5/265: dread d2/d6/dc/f30 [0,4194304] 0 2024-05-06T21:26:45.508 INFO:tasks.workunit.client.0.smithi032.stdout:1/524: getdents db/d16/d46 0 2024-05-06T21:26:45.510 INFO:tasks.workunit.client.1.smithi154.stdout:1/279: getdents d6/db/d10/d15/d1d 0 2024-05-06T21:26:45.515 INFO:tasks.workunit.client.0.smithi032.stdout:9/595: mkdir d1/d13/d34/dc6 0 2024-05-06T21:26:45.517 INFO:tasks.workunit.client.0.smithi032.stdout:5/537: symlink d0/d24/d26/d3d/l9d 0 2024-05-06T21:26:45.520 INFO:tasks.workunit.client.0.smithi032.stdout:6/679: truncate d8/dd/d18/d13/f71 2657938 0 2024-05-06T21:26:45.520 INFO:tasks.workunit.client.0.smithi032.stdout:6/680: creat d8/dd/d1b/d35/db4/fcc x:0 0 0 2024-05-06T21:26:45.520 INFO:tasks.workunit.client.0.smithi032.stdout:6/681: creat d8/dd/d18/d3b/d90/fcd x:0 0 0 2024-05-06T21:26:45.520 INFO:tasks.workunit.client.0.smithi032.stdout:6/682: write d8/dd/d18/d3b/db9/f65 [5170670,55337] 0 2024-05-06T21:26:45.523 INFO:tasks.workunit.client.1.smithi154.stdout:1/280: dread d6/db/d10/d15/d1d/d53/f43 [0,4194304] 0 2024-05-06T21:26:45.525 INFO:tasks.workunit.client.1.smithi154.stdout:1/281: read d6/db/d10/f51 [147766,116024] 0 2024-05-06T21:26:45.531 INFO:tasks.workunit.client.0.smithi032.stdout:0/574: creat d4/fb4 x:0 0 0 2024-05-06T21:26:45.533 INFO:tasks.workunit.client.0.smithi032.stdout:7/647: rmdir db/d12/d16/d2a/d39/d3b 39 2024-05-06T21:26:45.535 INFO:tasks.workunit.client.0.smithi032.stdout:5/538: mknod d0/d16/d2a/c9e 0 2024-05-06T21:26:45.535 INFO:tasks.workunit.client.0.smithi032.stdout:5/539: dread - d0/d24/d26/d3d/f95 zero size 2024-05-06T21:26:45.537 INFO:tasks.workunit.client.0.smithi032.stdout:3/707: dread d1/d4/da/d31/d47/d4a/f5f [0,4194304] 0 2024-05-06T21:26:45.537 INFO:tasks.workunit.client.0.smithi032.stdout:3/708: dread - d1/d4/da/d1d/fe5 zero size 2024-05-06T21:26:45.538 INFO:tasks.workunit.client.0.smithi032.stdout:6/683: stat d8/db6/cc4 0 2024-05-06T21:26:45.539 INFO:tasks.workunit.client.0.smithi032.stdout:4/655: truncate d2/f11 841330 0 2024-05-06T21:26:45.540 INFO:tasks.workunit.client.0.smithi032.stdout:4/656: dread d2/d13/f9e [0,4194304] 0 2024-05-06T21:26:45.541 INFO:tasks.workunit.client.0.smithi032.stdout:7/648: unlink db/d12/d16/d21/d41/l7a 0 2024-05-06T21:26:45.544 INFO:tasks.workunit.client.0.smithi032.stdout:6/684: dread d8/dd/d1b/faa [0,4194304] 0 2024-05-06T21:26:45.544 INFO:tasks.workunit.client.0.smithi032.stdout:6/685: write d8/d3d/f89 [4404866,99315] 0 2024-05-06T21:26:45.544 INFO:tasks.workunit.client.0.smithi032.stdout:6/686: readlink d8/dd/d18/d13/d1d/lae 0 2024-05-06T21:26:45.544 INFO:tasks.workunit.client.0.smithi032.stdout:1/525: rmdir db/d16 39 2024-05-06T21:26:45.544 INFO:tasks.workunit.client.0.smithi032.stdout:2/519: dwrite df/d19/d1e/d54/fb8 [0,4194304] 0 2024-05-06T21:26:45.544 INFO:tasks.workunit.client.0.smithi032.stdout:2/520: creat df/d19/d1e/d1f/fb9 x:0 0 0 2024-05-06T21:26:45.544 INFO:tasks.workunit.client.0.smithi032.stdout:2/521: stat df/d19/d1e/d1f/d2e/f9e 0 2024-05-06T21:26:45.544 INFO:tasks.workunit.client.0.smithi032.stdout:5/540: unlink d0/l4c 0 2024-05-06T21:26:45.546 INFO:tasks.workunit.client.0.smithi032.stdout:6/687: dread d8/dd/d18/d13/f24 [0,4194304] 0 2024-05-06T21:26:45.547 INFO:tasks.workunit.client.0.smithi032.stdout:3/709: mkdir d1/d4/da/d9f/d74/db1/df6 0 2024-05-06T21:26:45.548 INFO:tasks.workunit.client.0.smithi032.stdout:0/575: getdents d4/da/d14/d1a 0 2024-05-06T21:26:45.548 INFO:tasks.workunit.client.0.smithi032.stdout:0/576: stat d4/da/d16/d33/f36 0 2024-05-06T21:26:45.553 INFO:tasks.workunit.client.0.smithi032.stdout:4/657: rmdir d2/d2c/da8 0 2024-05-06T21:26:45.553 INFO:tasks.workunit.client.0.smithi032.stdout:4/658: chown d2/d16/d44/d45/dc1 119890 1 2024-05-06T21:26:45.557 INFO:tasks.workunit.client.1.smithi154.stdout:0/253: dwrite d6/dc/f33 [0,4194304] 0 2024-05-06T21:26:45.560 INFO:tasks.workunit.client.0.smithi032.stdout:2/522: creat df/d19/d1e/d71/d5f/d73/fba x:0 0 0 2024-05-06T21:26:45.561 INFO:tasks.workunit.client.0.smithi032.stdout:8/736: dwrite d0/d1c/fae [0,4194304] 0 2024-05-06T21:26:45.562 INFO:tasks.workunit.client.0.smithi032.stdout:9/596: dwrite d1/f1a [0,4194304] 0 2024-05-06T21:26:45.562 INFO:tasks.workunit.client.1.smithi154.stdout:7/140: dwrite d6/d20/f26 [0,4194304] 0 2024-05-06T21:26:45.562 INFO:tasks.workunit.client.1.smithi154.stdout:7/141: rename d6 to d6/de/d23/d30 22 2024-05-06T21:26:45.563 INFO:tasks.workunit.client.1.smithi154.stdout:6/188: dwrite d8/f31 [0,4194304] 0 2024-05-06T21:26:45.566 INFO:tasks.workunit.client.1.smithi154.stdout:1/282: fsync d6/db/d10/d15/f4a 0 2024-05-06T21:26:45.566 INFO:tasks.workunit.client.1.smithi154.stdout:1/283: stat d6/db/d10/d26/d1b 0 2024-05-06T21:26:45.566 INFO:tasks.workunit.client.1.smithi154.stdout:0/254: dread d6/dc/f16 [0,4194304] 0 2024-05-06T21:26:45.566 INFO:tasks.workunit.client.1.smithi154.stdout:0/255: fdatasync d6/dc/d39/f3e 0 2024-05-06T21:26:45.567 INFO:tasks.workunit.client.0.smithi032.stdout:1/526: truncate db/f23 122007 0 2024-05-06T21:26:45.578 INFO:tasks.workunit.client.0.smithi032.stdout:2/523: mknod df/d19/d1e/d42/cbb 0 2024-05-06T21:26:45.580 INFO:tasks.workunit.client.0.smithi032.stdout:4/659: dread d2/d16/d44/d54/d69/faf [0,4194304] 0 2024-05-06T21:26:45.580 INFO:tasks.workunit.client.1.smithi154.stdout:7/142: dread d6/d20/f26 [0,4194304] 0 2024-05-06T21:26:45.580 INFO:tasks.workunit.client.1.smithi154.stdout:7/143: readlink d6/de/d23/l27 0 2024-05-06T21:26:45.580 INFO:tasks.workunit.client.1.smithi154.stdout:7/144: write d6/fd [1913032,47113] 0 2024-05-06T21:26:45.581 INFO:tasks.workunit.client.1.smithi154.stdout:7/145: rename d6/de/f17 to d6/de/f31 0 2024-05-06T21:26:45.583 INFO:tasks.workunit.client.0.smithi032.stdout:8/737: link d0/d1c/c89 d0/d1b/d47/d91/da7/dc1/ce4 0 2024-05-06T21:26:45.585 INFO:tasks.workunit.client.0.smithi032.stdout:9/597: symlink d1/d13/d34/d26/d9f/dbe/lc7 0 2024-05-06T21:26:45.588 INFO:tasks.workunit.client.1.smithi154.stdout:7/146: dread d6/f9 [4194304,4194304] 0 2024-05-06T21:26:45.588 INFO:tasks.workunit.client.1.smithi154.stdout:7/147: chown d6/d20/f26 31450 1 2024-05-06T21:26:45.588 INFO:tasks.workunit.client.0.smithi032.stdout:6/688: dwrite d8/d3d/d8f/f78 [0,4194304] 0 2024-05-06T21:26:45.588 INFO:tasks.workunit.client.0.smithi032.stdout:3/710: dwrite d1/d4/da/d31/d9b/f9e [0,4194304] 0 2024-05-06T21:26:45.588 INFO:tasks.workunit.client.1.smithi154.stdout:1/284: dwrite d6/f47 [0,4194304] 0 2024-05-06T21:26:45.591 INFO:tasks.workunit.client.1.smithi154.stdout:2/227: truncate f5 4862301 0 2024-05-06T21:26:45.591 INFO:tasks.workunit.client.1.smithi154.stdout:2/228: chown db/de/d10/d18/l3b 306334911 1 2024-05-06T21:26:45.593 INFO:tasks.workunit.client.1.smithi154.stdout:2/229: write db/de/d16/f27 [1972343,120031] 0 2024-05-06T21:26:45.599 INFO:tasks.workunit.client.0.smithi032.stdout:1/527: rename db/d47/d4a/da4/c44 to db/d47/cab 0 2024-05-06T21:26:45.601 INFO:tasks.workunit.client.0.smithi032.stdout:2/524: mkdir df/d19/d1e/d1f/d2e/dbc 0 2024-05-06T21:26:45.601 INFO:tasks.workunit.client.0.smithi032.stdout:2/525: creat df/daf/fbd x:0 0 0 2024-05-06T21:26:45.602 INFO:tasks.workunit.client.1.smithi154.stdout:1/285: dread d6/f47 [0,4194304] 0 2024-05-06T21:26:45.602 INFO:tasks.workunit.client.1.smithi154.stdout:8/213: sync 2024-05-06T21:26:45.602 INFO:tasks.workunit.client.1.smithi154.stdout:3/293: sync 2024-05-06T21:26:45.602 INFO:tasks.workunit.client.1.smithi154.stdout:4/221: sync 2024-05-06T21:26:45.602 INFO:tasks.workunit.client.1.smithi154.stdout:9/334: sync 2024-05-06T21:26:45.602 INFO:tasks.workunit.client.1.smithi154.stdout:4/222: fsync d0/d10/f15 0 2024-05-06T21:26:45.602 INFO:tasks.workunit.client.1.smithi154.stdout:4/223: stat d0/d2/d2a/d4a 0 2024-05-06T21:26:45.602 INFO:tasks.workunit.client.1.smithi154.stdout:4/224: read - d0/d2/f8 zero size 2024-05-06T21:26:45.602 INFO:tasks.workunit.client.1.smithi154.stdout:4/225: chown d0/f22 5 1 2024-05-06T21:26:45.603 INFO:tasks.workunit.client.1.smithi154.stdout:9/335: read d5/d20/d37/f50 [332685,44878] 0 2024-05-06T21:26:45.603 INFO:tasks.workunit.client.1.smithi154.stdout:9/336: truncate d5/f73 654819 0 2024-05-06T21:26:45.603 INFO:tasks.workunit.client.1.smithi154.stdout:9/337: write d5/d2e/d66/f77 [1023788,116343] 0 2024-05-06T21:26:45.603 INFO:tasks.workunit.client.1.smithi154.stdout:9/338: chown l4 1456 1 2024-05-06T21:26:45.603 INFO:tasks.workunit.client.1.smithi154.stdout:9/339: stat d5/d20/d52/d59 0 2024-05-06T21:26:45.604 INFO:tasks.workunit.client.1.smithi154.stdout:1/286: mknod d6/db/d10/d15/d1d/d53/c5a 0 2024-05-06T21:26:45.604 INFO:tasks.workunit.client.0.smithi032.stdout:7/649: rmdir db/d12 39 2024-05-06T21:26:45.605 INFO:tasks.workunit.client.1.smithi154.stdout:8/214: mkdir d3/d14/d1a/d29/d43 0 2024-05-06T21:26:45.605 INFO:tasks.workunit.client.1.smithi154.stdout:8/215: write d3/fb [1979966,81772] 0 2024-05-06T21:26:45.606 INFO:tasks.workunit.client.0.smithi032.stdout:8/738: mkdir d0/d1b/d47/d91/de5 0 2024-05-06T21:26:45.606 INFO:tasks.workunit.client.1.smithi154.stdout:3/294: mkdir d0/da/db/d52/d62 0 2024-05-06T21:26:45.606 INFO:tasks.workunit.client.1.smithi154.stdout:3/295: creat d0/da/d1a/d28/d17/f63 x:0 0 0 2024-05-06T21:26:45.606 INFO:tasks.workunit.client.1.smithi154.stdout:3/296: read d0/d2/d22/f47 [542343,109747] 0 2024-05-06T21:26:45.607 INFO:tasks.workunit.client.1.smithi154.stdout:4/226: symlink d0/d10/d11/d1a/d31/d3d/l4e 0 2024-05-06T21:26:45.607 INFO:tasks.workunit.client.0.smithi032.stdout:9/598: creat d1/fc8 x:0 0 0 2024-05-06T21:26:45.607 INFO:tasks.workunit.client.1.smithi154.stdout:9/340: mknod d5/d2e/d56/d65/c7b 0 2024-05-06T21:26:45.608 INFO:tasks.workunit.client.1.smithi154.stdout:1/287: creat d6/db/f5b x:0 0 0 2024-05-06T21:26:45.608 INFO:tasks.workunit.client.1.smithi154.stdout:7/148: dwrite d6/d20/f1b [4194304,4194304] 0 2024-05-06T21:26:45.608 INFO:tasks.workunit.client.1.smithi154.stdout:7/149: chown d6/d20/f1b 2504 1 2024-05-06T21:26:45.610 INFO:tasks.workunit.client.1.smithi154.stdout:4/227: symlink d0/d2/d29/l4f 0 2024-05-06T21:26:45.610 INFO:tasks.workunit.client.1.smithi154.stdout:4/228: stat d0/d2/dc/f48 0 2024-05-06T21:26:45.610 INFO:tasks.workunit.client.1.smithi154.stdout:4/229: readlink d0/d10/l33 0 2024-05-06T21:26:45.611 INFO:tasks.workunit.client.1.smithi154.stdout:9/341: symlink d5/d2e/d56/d65/l7c 0 2024-05-06T21:26:45.611 INFO:tasks.workunit.client.1.smithi154.stdout:9/342: readlink d5/d20/l42 0 2024-05-06T21:26:45.612 INFO:tasks.workunit.client.1.smithi154.stdout:3/297: dread d0/d2/f25 [0,4194304] 0 2024-05-06T21:26:45.612 INFO:tasks.workunit.client.1.smithi154.stdout:3/298: dread - d0/da/d1a/d28/d17/f54 zero size 2024-05-06T21:26:45.612 INFO:tasks.workunit.client.1.smithi154.stdout:3/299: readlink d0/d2/l36 0 2024-05-06T21:26:45.613 INFO:tasks.workunit.client.0.smithi032.stdout:6/689: unlink d8/dd/d18/l98 0 2024-05-06T21:26:45.613 INFO:tasks.workunit.client.1.smithi154.stdout:7/150: creat d6/f32 x:0 0 0 2024-05-06T21:26:45.613 INFO:tasks.workunit.client.1.smithi154.stdout:7/151: write d6/de/f31 [874392,90] 0 2024-05-06T21:26:45.613 INFO:tasks.workunit.client.1.smithi154.stdout:7/152: truncate d6/f32 222041 0 2024-05-06T21:26:45.614 INFO:tasks.workunit.client.1.smithi154.stdout:4/230: getdents d0/d2/d2a 0 2024-05-06T21:26:45.614 INFO:tasks.workunit.client.1.smithi154.stdout:1/288: dread d6/f24 [0,4194304] 0 2024-05-06T21:26:45.617 INFO:tasks.workunit.client.0.smithi032.stdout:3/711: mknod d1/d4/da/d31/d47/cf7 0 2024-05-06T21:26:45.617 INFO:tasks.workunit.client.0.smithi032.stdout:3/712: fsync d1/d4/da/d31/d47/d4a/d68/d7c/da8/fbf 0 2024-05-06T21:26:45.617 INFO:tasks.workunit.client.1.smithi154.stdout:3/300: creat d0/da/d1a/d28/d2f/f64 x:0 0 0 2024-05-06T21:26:45.618 INFO:tasks.workunit.client.1.smithi154.stdout:3/301: write d0/da/d1a/d28/d17/f2c [3189128,48303] 0 2024-05-06T21:26:45.618 INFO:tasks.workunit.client.0.smithi032.stdout:9/599: dread d1/d13/d33/f7d [0,4194304] 0 2024-05-06T21:26:45.618 INFO:tasks.workunit.client.0.smithi032.stdout:1/528: rmdir db/d16/d46/d57/d58 39 2024-05-06T21:26:45.618 INFO:tasks.workunit.client.1.smithi154.stdout:9/343: rmdir d5/d20/d52/d59 39 2024-05-06T21:26:45.619 INFO:tasks.workunit.client.0.smithi032.stdout:4/660: write d2/f96 [3037588,62473] 0 2024-05-06T21:26:45.621 INFO:tasks.workunit.client.1.smithi154.stdout:3/302: creat d0/da/d1a/d28/d2f/d38/d48/f65 x:0 0 0 2024-05-06T21:26:45.622 INFO:tasks.workunit.client.0.smithi032.stdout:2/526: mkdir df/d19/d1e/d1f/d2e/dbe 0 2024-05-06T21:26:45.627 INFO:tasks.workunit.client.1.smithi154.stdout:2/230: dwrite db/de/d16/f1f [0,4194304] 0 2024-05-06T21:26:45.629 INFO:tasks.workunit.client.1.smithi154.stdout:8/216: dwrite d3/d14/d1a/d22/f3a [0,4194304] 0 2024-05-06T21:26:45.629 INFO:tasks.workunit.client.1.smithi154.stdout:8/217: write d3/d14/d1a/f28 [1469532,125412] 0 2024-05-06T21:26:45.629 INFO:tasks.workunit.client.1.smithi154.stdout:8/218: chown d3/d14/c2d 12107 1 2024-05-06T21:26:45.629 INFO:tasks.workunit.client.1.smithi154.stdout:7/153: write d6/fc [1843929,50730] 0 2024-05-06T21:26:45.629 INFO:tasks.workunit.client.0.smithi032.stdout:7/650: creat db/d12/d16/d2a/d39/d3b/fce x:0 0 0 2024-05-06T21:26:45.631 INFO:tasks.workunit.client.1.smithi154.stdout:1/289: write d6/db/f34 [2746307,27175] 0 2024-05-06T21:26:45.632 INFO:tasks.workunit.client.0.smithi032.stdout:8/739: truncate d0/d1b/f61 65578 0 2024-05-06T21:26:45.632 INFO:tasks.workunit.client.0.smithi032.stdout:8/740: write d0/f19 [2656048,26550] 0 2024-05-06T21:26:45.632 INFO:tasks.workunit.client.0.smithi032.stdout:8/741: chown d0/d1c/d5e/d67/dc3/d97/lc6 714466595 1 2024-05-06T21:26:45.632 INFO:tasks.workunit.client.0.smithi032.stdout:6/690: mknod d8/dd/d18/d3b/db9/cce 0 2024-05-06T21:26:45.632 INFO:tasks.workunit.client.0.smithi032.stdout:6/691: creat d8/dd/d18/d3b/fcf x:0 0 0 2024-05-06T21:26:45.632 INFO:tasks.workunit.client.0.smithi032.stdout:6/692: readlink d8/dd/d18/d22/la2 0 2024-05-06T21:26:45.634 INFO:tasks.workunit.client.0.smithi032.stdout:3/713: rename d1/d4/da/d31/d47/d4a/fa5 to d1/d2a/d71/d9d/da9/ff8 0 2024-05-06T21:26:45.636 INFO:tasks.workunit.client.0.smithi032.stdout:4/661: mkdir d2/d16/d44/d74/d79/d88/dd6 0 2024-05-06T21:26:45.636 INFO:tasks.workunit.client.0.smithi032.stdout:4/662: chown d2/d16/f5e 1461 1 2024-05-06T21:26:45.637 INFO:tasks.workunit.client.1.smithi154.stdout:8/219: link d3/d14/d1a/d29/d32/d33/c34 d3/d14/d1a/d29/d32/c44 0 2024-05-06T21:26:45.637 INFO:tasks.workunit.client.1.smithi154.stdout:8/220: truncate d3/d14/d1a/f3c 492528 0 2024-05-06T21:26:45.637 INFO:tasks.workunit.client.0.smithi032.stdout:2/527: mkdir df/d19/dbf 0 2024-05-06T21:26:45.638 INFO:tasks.workunit.client.0.smithi032.stdout:1/529: read db/d16/f1e [3067311,9347] 0 2024-05-06T21:26:45.638 INFO:tasks.workunit.client.0.smithi032.stdout:7/651: getdents db/d12/d87/db5 0 2024-05-06T21:26:45.638 INFO:tasks.workunit.client.0.smithi032.stdout:7/652: write db/d12/d16/fc1 [566266,61149] 0 2024-05-06T21:26:45.639 INFO:tasks.workunit.client.1.smithi154.stdout:7/154: symlink d6/de/d21/l33 0 2024-05-06T21:26:45.639 INFO:tasks.workunit.client.1.smithi154.stdout:7/155: readlink d6/d20/l22 0 2024-05-06T21:26:45.640 INFO:tasks.workunit.client.1.smithi154.stdout:2/231: dread db/f13 [0,4194304] 0 2024-05-06T21:26:45.640 INFO:tasks.workunit.client.0.smithi032.stdout:6/693: unlink d8/dd/d18/d13/d7a/fb5 0 2024-05-06T21:26:45.641 INFO:tasks.workunit.client.1.smithi154.stdout:1/290: rename d6/db/d10/d15/l59 to d6/db/d10/d26/l5c 0 2024-05-06T21:26:45.642 INFO:tasks.workunit.client.1.smithi154.stdout:8/221: mkdir d3/d14/d1a/d45 0 2024-05-06T21:26:45.643 INFO:tasks.workunit.client.0.smithi032.stdout:9/600: rename d1/d13/d33/d5e/d78/f89 to d1/d13/d34/d26/d9f/dbe/fc9 0 2024-05-06T21:26:45.643 INFO:tasks.workunit.client.0.smithi032.stdout:8/742: dread d0/f5 [0,4194304] 0 2024-05-06T21:26:45.644 INFO:tasks.workunit.client.1.smithi154.stdout:4/231: dwrite d0/d10/d11/f17 [0,4194304] 0 2024-05-06T21:26:45.644 INFO:tasks.workunit.client.1.smithi154.stdout:4/232: write d0/d10/d11/d1a/d31/d39/f4b [233647,97837] 0 2024-05-06T21:26:45.644 INFO:tasks.workunit.client.1.smithi154.stdout:4/233: readlink d0/d10/d11/d1a/d31/d3d/l4e 0 2024-05-06T21:26:45.645 INFO:tasks.workunit.client.0.smithi032.stdout:2/528: mkdir df/d19/d1e/d1f/d9f/dc0 0 2024-05-06T21:26:45.645 INFO:tasks.workunit.client.1.smithi154.stdout:2/232: mkdir db/de/d16/d31/d4c 0 2024-05-06T21:26:45.645 INFO:tasks.workunit.client.1.smithi154.stdout:2/233: dread - db/d12/f2a zero size 2024-05-06T21:26:45.646 INFO:tasks.workunit.client.0.smithi032.stdout:1/530: mknod db/d16/d46/d55/cac 0 2024-05-06T21:26:45.647 INFO:tasks.workunit.client.1.smithi154.stdout:9/344: dwrite d5/f8 [4194304,4194304] 0 2024-05-06T21:26:45.647 INFO:tasks.workunit.client.1.smithi154.stdout:9/345: chown d5/d14/d31/d39/f4a 95729 1 2024-05-06T21:26:45.648 INFO:tasks.workunit.client.0.smithi032.stdout:6/694: link d8/d3d/d49/cbe d8/dd/d18/d13/cd0 0 2024-05-06T21:26:45.648 INFO:tasks.workunit.client.0.smithi032.stdout:6/695: readlink d8/dd/la0 0 2024-05-06T21:26:45.649 INFO:tasks.workunit.client.1.smithi154.stdout:1/291: creat d6/db/d10/d15/d1d/f5d x:0 0 0 2024-05-06T21:26:45.651 INFO:tasks.workunit.client.1.smithi154.stdout:8/222: creat d3/d14/d1a/d22/d26/d2b/f46 x:0 0 0 2024-05-06T21:26:45.651 INFO:tasks.workunit.client.0.smithi032.stdout:4/663: write d2/d16/d44/d45/f6d [303030,48869] 0 2024-05-06T21:26:45.652 INFO:tasks.workunit.client.0.smithi032.stdout:9/601: rename d1/d2f/fad to d1/d2f/da1/dc2/da0/fca 0 2024-05-06T21:26:45.652 INFO:tasks.workunit.client.1.smithi154.stdout:3/303: rmdir d0/da/d1a/d28/d2f/d38/d48 39 2024-05-06T21:26:45.652 INFO:tasks.workunit.client.1.smithi154.stdout:3/304: dread - d0/da/db/dd/f53 zero size 2024-05-06T21:26:45.654 INFO:tasks.workunit.client.0.smithi032.stdout:4/664: read d2/d1e/f4c [399351,87936] 0 2024-05-06T21:26:45.655 INFO:tasks.workunit.client.0.smithi032.stdout:8/743: unlink d0/d1b/d39/f45 0 2024-05-06T21:26:45.656 INFO:tasks.workunit.client.0.smithi032.stdout:2/529: dread df/d19/d1e/d1f/fab [0,4194304] 0 2024-05-06T21:26:45.656 INFO:tasks.workunit.client.1.smithi154.stdout:2/234: write db/de/d10/f25 [1364909,21097] 0 2024-05-06T21:26:45.656 INFO:tasks.workunit.client.0.smithi032.stdout:1/531: mknod db/d47/cad 0 2024-05-06T21:26:45.659 INFO:tasks.workunit.client.1.smithi154.stdout:7/156: rmdir d6 39 2024-05-06T21:26:45.660 INFO:tasks.workunit.client.0.smithi032.stdout:9/602: symlink d1/d2f/d4f/lcb 0 2024-05-06T21:26:45.661 INFO:tasks.workunit.client.0.smithi032.stdout:7/653: write db/d12/d16/f24 [4167667,12061] 0 2024-05-06T21:26:45.661 INFO:tasks.workunit.client.0.smithi032.stdout:4/665: mknod d2/d2c/d31/d7c/cd7 0 2024-05-06T21:26:45.664 INFO:tasks.workunit.client.0.smithi032.stdout:8/744: link d0/f53 d0/d1c/d5e/d67/dc3/d57/d5d/fe6 0 2024-05-06T21:26:45.665 INFO:tasks.workunit.client.1.smithi154.stdout:9/346: creat d5/d2e/d66/f7d x:0 0 0 2024-05-06T21:26:45.666 INFO:tasks.workunit.client.0.smithi032.stdout:3/714: dwrite d1/d4/da/d1d/fcc [0,4194304] 0 2024-05-06T21:26:45.666 INFO:tasks.workunit.client.0.smithi032.stdout:3/715: fdatasync d1/d4/da/d9f/d74/db1/fc6 0 2024-05-06T21:26:45.667 INFO:tasks.workunit.client.1.smithi154.stdout:8/223: dread d3/fc [0,4194304] 0 2024-05-06T21:26:45.667 INFO:tasks.workunit.client.1.smithi154.stdout:1/292: rename d6/db/d10/d26/d1b/d45 to d6/db/d5e 0 2024-05-06T21:26:45.667 INFO:tasks.workunit.client.1.smithi154.stdout:1/293: write d6/d3e/f4d [285265,90540] 0 2024-05-06T21:26:45.667 INFO:tasks.workunit.client.1.smithi154.stdout:1/294: truncate d6/db/f5b 792606 0 2024-05-06T21:26:45.668 INFO:tasks.workunit.client.0.smithi032.stdout:1/532: rmdir db/d37 39 2024-05-06T21:26:45.668 INFO:tasks.workunit.client.0.smithi032.stdout:9/603: dread d1/d13/d34/f32 [0,4194304] 0 2024-05-06T21:26:45.669 INFO:tasks.workunit.client.0.smithi032.stdout:9/604: fdatasync d1/d13/f16 0 2024-05-06T21:26:45.669 INFO:tasks.workunit.client.0.smithi032.stdout:9/605: fdatasync d1/d13/d33/d3f/d60/f66 0 2024-05-06T21:26:45.669 INFO:tasks.workunit.client.1.smithi154.stdout:3/305: creat d0/d2/d22/f66 x:0 0 0 2024-05-06T21:26:45.669 INFO:tasks.workunit.client.1.smithi154.stdout:3/306: chown d0/d2/d22/f66 11305 1 2024-05-06T21:26:45.671 INFO:tasks.workunit.client.0.smithi032.stdout:7/654: creat db/d12/d49/d97/fcf x:0 0 0 2024-05-06T21:26:45.671 INFO:tasks.workunit.client.0.smithi032.stdout:7/655: truncate db/d12/d16/d21/d41/d4b/f65 287981 0 2024-05-06T21:26:45.671 INFO:tasks.workunit.client.0.smithi032.stdout:7/656: chown db/d12/d16/d2a/d39/d3b/d96/dcd 40461 1 2024-05-06T21:26:45.671 INFO:tasks.workunit.client.0.smithi032.stdout:7/657: write db/d12/d16/d21/d41/d4b/f65 [942548,7670] 0 2024-05-06T21:26:45.671 INFO:tasks.workunit.client.0.smithi032.stdout:7/658: creat db/d12/d49/d97/fd0 x:0 0 0 2024-05-06T21:26:45.671 INFO:tasks.workunit.client.1.smithi154.stdout:4/234: getdents d0 0 2024-05-06T21:26:45.672 INFO:tasks.workunit.client.0.smithi032.stdout:4/666: mkdir d2/d16/d44/d54/dd8 0 2024-05-06T21:26:45.674 INFO:tasks.workunit.client.0.smithi032.stdout:8/745: creat d0/d1b/da8/fe7 x:0 0 0 2024-05-06T21:26:45.674 INFO:tasks.workunit.client.0.smithi032.stdout:2/530: dread df/d19/d1e/d1f/d2e/d33/f18 [0,4194304] 0 2024-05-06T21:26:45.675 INFO:tasks.workunit.client.1.smithi154.stdout:7/157: rename d6/d20/l15 to d6/d20/l34 0 2024-05-06T21:26:45.676 INFO:tasks.workunit.client.1.smithi154.stdout:7/158: read d6/fc [1079215,120669] 0 2024-05-06T21:26:45.676 INFO:tasks.workunit.client.1.smithi154.stdout:7/159: write d6/d20/f1d [615505,102150] 0 2024-05-06T21:26:45.676 INFO:tasks.workunit.client.1.smithi154.stdout:7/160: write d6/fb [4567203,7436] 0 2024-05-06T21:26:45.677 INFO:tasks.workunit.client.0.smithi032.stdout:1/533: mknod db/d47/d4a/cae 0 2024-05-06T21:26:45.681 INFO:tasks.workunit.client.0.smithi032.stdout:9/606: symlink d1/d13/d34/d26/lcc 0 2024-05-06T21:26:45.681 INFO:tasks.workunit.client.0.smithi032.stdout:9/607: dread - d1/d13/d33/d3f/d60/f7e zero size 2024-05-06T21:26:45.681 INFO:tasks.workunit.client.0.smithi032.stdout:9/608: getdents d1/d13/d34/dc6 0 2024-05-06T21:26:45.682 INFO:tasks.workunit.client.1.smithi154.stdout:8/224: mkdir d3/d14/d1a/d29/d32/d40/d47 0 2024-05-06T21:26:45.682 INFO:tasks.workunit.client.0.smithi032.stdout:9/609: write d1/f9 [4354601,112862] 0 2024-05-06T21:26:45.683 INFO:tasks.workunit.client.0.smithi032.stdout:7/659: symlink db/d89/ld1 0 2024-05-06T21:26:45.685 INFO:tasks.workunit.client.1.smithi154.stdout:9/347: rename d5/d2e/c3e to d5/d20/c7e 0 2024-05-06T21:26:45.685 INFO:tasks.workunit.client.1.smithi154.stdout:1/295: truncate d6/db/d10/d15/f20 1888507 0 2024-05-06T21:26:45.686 INFO:tasks.workunit.client.1.smithi154.stdout:4/235: dread d0/d2/dc/fe [4194304,4194304] 0 2024-05-06T21:26:45.686 INFO:tasks.workunit.client.1.smithi154.stdout:3/307: creat d0/da/d1a/d28/d2f/d38/d48/f67 x:0 0 0 2024-05-06T21:26:45.686 INFO:tasks.workunit.client.1.smithi154.stdout:3/308: write d0/da/d1a/d28/d17/f54 [271603,6476] 0 2024-05-06T21:26:45.691 INFO:tasks.workunit.client.1.smithi154.stdout:7/161: link d6/de/d23/l27 d6/l35 0 2024-05-06T21:26:45.692 INFO:tasks.workunit.client.1.smithi154.stdout:4/236: mkdir d0/d10/d11/d1a/d50 0 2024-05-06T21:26:45.693 INFO:tasks.workunit.client.1.smithi154.stdout:4/237: chown d0/d2/d2a/d4a 77 1 2024-05-06T21:26:45.693 INFO:tasks.workunit.client.1.smithi154.stdout:4/238: getdents d0/d2/d47 0 2024-05-06T21:26:45.693 INFO:tasks.workunit.client.1.smithi154.stdout:4/239: dread - d0/d2/d2a/f2c zero size 2024-05-06T21:26:45.694 INFO:tasks.workunit.client.0.smithi032.stdout:1/534: creat db/faf x:0 0 0 2024-05-06T21:26:45.695 INFO:tasks.workunit.client.1.smithi154.stdout:3/309: rename d0/f32 to d0/da/d1a/f68 0 2024-05-06T21:26:45.695 INFO:tasks.workunit.client.1.smithi154.stdout:3/310: chown d0/l26 5733 1 2024-05-06T21:26:45.696 INFO:tasks.workunit.client.1.smithi154.stdout:4/240: symlink d0/d2/dc/l51 0 2024-05-06T21:26:45.697 INFO:tasks.workunit.client.1.smithi154.stdout:7/162: rename d6/de/d23/c2c to d6/de/d21/d2e/c36 0 2024-05-06T21:26:45.697 INFO:tasks.workunit.client.1.smithi154.stdout:7/163: fsync d6/f1a 0 2024-05-06T21:26:45.698 INFO:tasks.workunit.client.0.smithi032.stdout:9/610: symlink d1/d13/d33/d5e/d78/lcd 0 2024-05-06T21:26:45.699 INFO:tasks.workunit.client.1.smithi154.stdout:3/311: link d0/da/db/dd/c1d d0/da/d1a/d28/d2f/d38/d48/c69 0 2024-05-06T21:26:45.699 INFO:tasks.workunit.client.1.smithi154.stdout:3/312: getdents d0/da/db/d52/d62 0 2024-05-06T21:26:45.699 INFO:tasks.workunit.client.1.smithi154.stdout:3/313: chown d0/da/db 10 1 2024-05-06T21:26:45.699 INFO:tasks.workunit.client.1.smithi154.stdout:3/314: dread - d0/da/db/dd/d1c/d21/d37/f4b zero size 2024-05-06T21:26:45.700 INFO:tasks.workunit.client.1.smithi154.stdout:4/241: mknod d0/d10/d11/d1a/d31/d39/c52 0 2024-05-06T21:26:45.700 INFO:tasks.workunit.client.1.smithi154.stdout:4/242: creat d0/d2/f53 x:0 0 0 2024-05-06T21:26:45.700 INFO:tasks.workunit.client.1.smithi154.stdout:4/243: stat d0/f23 0 2024-05-06T21:26:45.701 INFO:tasks.workunit.client.1.smithi154.stdout:3/315: symlink d0/da/d1a/d28/d4d/l6a 0 2024-05-06T21:26:45.703 INFO:tasks.workunit.client.0.smithi032.stdout:7/660: link db/d12/d49/l6b db/d12/d87/ld2 0 2024-05-06T21:26:45.704 INFO:tasks.workunit.client.1.smithi154.stdout:4/244: mkdir d0/d10/d11/d1a/d31/d39/d54 0 2024-05-06T21:26:45.704 INFO:tasks.workunit.client.0.smithi032.stdout:4/667: symlink d2/ld9 0 2024-05-06T21:26:45.705 INFO:tasks.workunit.client.1.smithi154.stdout:2/235: dwrite f0 [0,4194304] 0 2024-05-06T21:26:45.705 INFO:tasks.workunit.client.1.smithi154.stdout:3/316: truncate d0/da/d1a/d28/d17/f2c 3390777 0 2024-05-06T21:26:45.705 INFO:tasks.workunit.client.1.smithi154.stdout:3/317: write d0/da/db/dd/fc [1567847,110492] 0 2024-05-06T21:26:45.707 INFO:tasks.workunit.client.0.smithi032.stdout:1/535: creat db/d47/d4a/da4/da2/fb0 x:0 0 0 2024-05-06T21:26:45.709 INFO:tasks.workunit.client.0.smithi032.stdout:9/611: symlink d1/d13/d34/d92/lce 0 2024-05-06T21:26:45.709 INFO:tasks.workunit.client.0.smithi032.stdout:9/612: creat d1/d2f/fcf x:0 0 0 2024-05-06T21:26:45.710 INFO:tasks.workunit.client.0.smithi032.stdout:7/661: unlink db/d12/f2e 0 2024-05-06T21:26:45.710 INFO:tasks.workunit.client.1.smithi154.stdout:2/236: rename f2 to db/de/d16/d33/f4d 0 2024-05-06T21:26:45.711 INFO:tasks.workunit.client.1.smithi154.stdout:3/318: creat d0/da/d1a/d28/d2f/d38/f6b x:0 0 0 2024-05-06T21:26:45.713 INFO:tasks.workunit.client.1.smithi154.stdout:2/237: unlink db/lc 0 2024-05-06T21:26:45.713 INFO:tasks.workunit.client.0.smithi032.stdout:9/613: getdents d1/d13/d33/d5e 0 2024-05-06T21:26:45.713 INFO:tasks.workunit.client.0.smithi032.stdout:9/614: write d1/d13/d34/d26/f29 [5842597,79928] 0 2024-05-06T21:26:45.714 INFO:tasks.workunit.client.0.smithi032.stdout:7/662: truncate db/d12/d16/d21/f44 6190985 0 2024-05-06T21:26:45.714 INFO:tasks.workunit.client.1.smithi154.stdout:3/319: mknod d0/da/db/d52/d62/c6c 0 2024-05-06T21:26:45.716 INFO:tasks.workunit.client.0.smithi032.stdout:1/536: dread db/d16/d5d/f7d [0,4194304] 0 2024-05-06T21:26:45.716 INFO:tasks.workunit.client.0.smithi032.stdout:9/615: dread d1/d13/d33/d5e/d78/f80 [0,4194304] 0 2024-05-06T21:26:45.716 INFO:tasks.workunit.client.0.smithi032.stdout:9/616: write d1/d13/d34/f48 [3400456,66601] 0 2024-05-06T21:26:45.720 INFO:tasks.workunit.client.0.smithi032.stdout:7/663: creat db/d12/d16/d2a/fd3 x:0 0 0 2024-05-06T21:26:45.720 INFO:tasks.workunit.client.0.smithi032.stdout:7/664: chown db/d12/d16/d2a/d39/l5d 21 1 2024-05-06T21:26:45.720 INFO:tasks.workunit.client.0.smithi032.stdout:1/537: rmdir db/d47/d4a/da4/d4f 39 2024-05-06T21:26:45.723 INFO:tasks.workunit.client.0.smithi032.stdout:9/617: creat d1/d13/d33/d8e/fd0 x:0 0 0 2024-05-06T21:26:45.725 INFO:tasks.workunit.client.0.smithi032.stdout:3/716: dwrite d1/d4/d11/f2b [0,4194304] 0 2024-05-06T21:26:45.725 INFO:tasks.workunit.client.0.smithi032.stdout:1/538: symlink db/d16/d46/d57/lb1 0 2024-05-06T21:26:45.729 INFO:tasks.workunit.client.0.smithi032.stdout:1/539: mkdir db/d16/d5d/db2 0 2024-05-06T21:26:45.729 INFO:tasks.workunit.client.0.smithi032.stdout:1/540: write db/f2e [1949527,108428] 0 2024-05-06T21:26:45.730 INFO:tasks.workunit.client.0.smithi032.stdout:3/717: dread d1/d4/da/d31/d47/d4a/f5f [0,4194304] 0 2024-05-06T21:26:45.731 INFO:tasks.workunit.client.0.smithi032.stdout:1/541: creat db/d16/d46/d57/d58/d68/fb3 x:0 0 0 2024-05-06T21:26:45.731 INFO:tasks.workunit.client.0.smithi032.stdout:1/542: write db/d16/d46/f94 [146075,115553] 0 2024-05-06T21:26:45.732 INFO:tasks.workunit.client.0.smithi032.stdout:1/543: read db/f4c [238818,37305] 0 2024-05-06T21:26:45.733 INFO:tasks.workunit.client.0.smithi032.stdout:3/718: mkdir d1/d4/da/d4e/d41/d97/d67/da6/df9 0 2024-05-06T21:26:45.734 INFO:tasks.workunit.client.1.smithi154.stdout:3/320: write d0/da/d1a/d28/d2f/f34 [34652,1720] 0 2024-05-06T21:26:45.734 INFO:tasks.workunit.client.1.smithi154.stdout:3/321: chown d0/f50 3 1 2024-05-06T21:26:45.734 INFO:tasks.workunit.client.1.smithi154.stdout:3/322: dread - d0/da/db/dd/f53 zero size 2024-05-06T21:26:45.734 INFO:tasks.workunit.client.1.smithi154.stdout:3/323: chown d0/f2b 1035 1 2024-05-06T21:26:45.734 INFO:tasks.workunit.client.0.smithi032.stdout:1/544: rmdir db/d47/d70 39 2024-05-06T21:26:45.735 INFO:tasks.workunit.client.0.smithi032.stdout:1/545: fsync db/d16/d46/f4e 0 2024-05-06T21:26:45.735 INFO:tasks.workunit.client.0.smithi032.stdout:1/546: chown db/d16/l36 16092278 1 2024-05-06T21:26:45.744 INFO:tasks.workunit.client.0.smithi032.stdout:3/719: dread d1/d4/da/d4e/d41/f66 [0,4194304] 0 2024-05-06T21:26:45.745 INFO:tasks.workunit.client.0.smithi032.stdout:8/746: dwrite d0/d1c/d5e/d67/dc3/f62 [8388608,4194304] 0 2024-05-06T21:26:45.746 INFO:tasks.workunit.client.0.smithi032.stdout:2/531: dwrite df/f8b [0,4194304] 0 2024-05-06T21:26:45.746 INFO:tasks.workunit.client.0.smithi032.stdout:2/532: readlink df/d19/d1e/d35/l3a 0 2024-05-06T21:26:45.746 INFO:tasks.workunit.client.1.smithi154.stdout:9/348: dwrite d5/d14/d31/d39/f68 [0,4194304] 0 2024-05-06T21:26:45.746 INFO:tasks.workunit.client.1.smithi154.stdout:9/349: fsync d5/d20/d37/f5b 0 2024-05-06T21:26:45.750 INFO:tasks.workunit.client.0.smithi032.stdout:2/533: mkdir df/d19/d1e/d35/d3f/d46/dc1 0 2024-05-06T21:26:45.750 INFO:tasks.workunit.client.0.smithi032.stdout:2/534: dread - df/f95 zero size 2024-05-06T21:26:45.751 INFO:tasks.workunit.client.0.smithi032.stdout:2/535: mknod df/d19/d1e/d71/d5f/d7d/d65/cc2 0 2024-05-06T21:26:45.753 INFO:tasks.workunit.client.0.smithi032.stdout:3/720: dread d1/f5d [0,4194304] 0 2024-05-06T21:26:45.754 INFO:tasks.workunit.client.1.smithi154.stdout:7/164: dwrite d6/f10 [0,4194304] 0 2024-05-06T21:26:45.754 INFO:tasks.workunit.client.0.smithi032.stdout:4/668: dwrite d2/d16/d44/d74/d76/fab [0,4194304] 0 2024-05-06T21:26:45.754 INFO:tasks.workunit.client.0.smithi032.stdout:4/669: chown d2/d16/d44/d74/f8b 400680 1 2024-05-06T21:26:45.755 INFO:tasks.workunit.client.1.smithi154.stdout:8/225: dwrite d3/f10 [0,4194304] 0 2024-05-06T21:26:45.755 INFO:tasks.workunit.client.1.smithi154.stdout:8/226: readlink d3/d14/d1a/l2a 0 2024-05-06T21:26:45.755 INFO:tasks.workunit.client.1.smithi154.stdout:2/238: dwrite db/f2d [0,4194304] 0 2024-05-06T21:26:45.757 INFO:tasks.workunit.client.0.smithi032.stdout:3/721: rename d1/fdd to d1/d2a/d71/d9d/ffa 0 2024-05-06T21:26:45.757 INFO:tasks.workunit.client.0.smithi032.stdout:3/722: fdatasync d1/d4/da/f32 0 2024-05-06T21:26:45.758 INFO:tasks.workunit.client.1.smithi154.stdout:7/165: write d6/f9 [5171796,19682] 0 2024-05-06T21:26:45.759 INFO:tasks.workunit.client.1.smithi154.stdout:4/245: dwrite d0/d10/d11/d1a/f28 [4194304,4194304] 0 2024-05-06T21:26:45.759 INFO:tasks.workunit.client.1.smithi154.stdout:4/246: chown d0/d2/dc/f26 1294 1 2024-05-06T21:26:45.760 INFO:tasks.workunit.client.0.smithi032.stdout:9/618: dwrite d1/d2f/fcf [0,4194304] 0 2024-05-06T21:26:45.762 INFO:tasks.workunit.client.1.smithi154.stdout:8/227: rename d3/d14/d1a/d29/d32/d33/c34 to d3/d14/d1a/d22/d26/d2b/c48 0 2024-05-06T21:26:45.767 INFO:tasks.workunit.client.0.smithi032.stdout:8/747: dwrite d0/d1c/fbb [0,4194304] 0 2024-05-06T21:26:45.767 INFO:tasks.workunit.client.0.smithi032.stdout:8/748: write d0/d1c/d5e/d67/dc3/d57/d5d/f90 [383846,101357] 0 2024-05-06T21:26:45.767 INFO:tasks.workunit.client.1.smithi154.stdout:2/239: mkdir db/d12/d4e 0 2024-05-06T21:26:45.768 INFO:tasks.workunit.client.0.smithi032.stdout:1/547: dwrite db/d47/d4a/da4/f49 [4194304,4194304] 0 2024-05-06T21:26:45.771 INFO:tasks.workunit.client.1.smithi154.stdout:2/240: dread db/de/d16/f3f [0,4194304] 0 2024-05-06T21:26:45.773 INFO:tasks.workunit.client.1.smithi154.stdout:8/228: rename d3/d14/d1a/d29/d32/d40/d47 to d3/d14/d1a/d29/d49 0 2024-05-06T21:26:45.778 INFO:tasks.workunit.client.1.smithi154.stdout:2/241: rename db/de/d16/d31 to db/de/d16/d4f 0 2024-05-06T21:26:45.779 INFO:tasks.workunit.client.1.smithi154.stdout:2/242: stat db/de/d10/l15 0 2024-05-06T21:26:45.779 INFO:tasks.workunit.client.0.smithi032.stdout:1/548: dread db/d16/f32 [4194304,4194304] 0 2024-05-06T21:26:45.783 INFO:tasks.workunit.client.1.smithi154.stdout:8/229: truncate d3/fd 792266 0 2024-05-06T21:26:45.784 INFO:tasks.workunit.client.1.smithi154.stdout:8/230: fdatasync d3/f10 0 2024-05-06T21:26:45.788 INFO:tasks.workunit.client.1.smithi154.stdout:2/243: symlink db/d12/d4e/l50 0 2024-05-06T21:26:45.792 INFO:tasks.workunit.client.1.smithi154.stdout:2/244: read db/de/f11 [4695721,108010] 0 2024-05-06T21:26:45.799 INFO:tasks.workunit.client.0.smithi032.stdout:2/536: dwrite df/d19/d1e/d71/d5f/d7d/d65/f67 [0,4194304] 0 2024-05-06T21:26:45.804 INFO:tasks.workunit.client.0.smithi032.stdout:2/537: dread df/d19/d1e/d71/d5f/d7d/d25/f4b [0,4194304] 0 2024-05-06T21:26:45.804 INFO:tasks.workunit.client.0.smithi032.stdout:8/749: getdents d0/d1c/d5e/d67/dc3/d57/d5d/d63 0 2024-05-06T21:26:45.804 INFO:tasks.workunit.client.0.smithi032.stdout:8/750: write d0/d1b/d47/f7d [49882,4927] 0 2024-05-06T21:26:45.806 INFO:tasks.workunit.client.0.smithi032.stdout:8/751: link d0/d1b/d39/f3a d0/d1c/d5e/d67/dc3/fe8 0 2024-05-06T21:26:45.806 INFO:tasks.workunit.client.0.smithi032.stdout:8/752: fdatasync d0/d1c/d5e/d67/d7b/f86 0 2024-05-06T21:26:45.807 INFO:tasks.workunit.client.0.smithi032.stdout:8/753: truncate d0/d1b/d47/f83 2791615 0 2024-05-06T21:26:45.811 INFO:tasks.workunit.client.1.smithi154.stdout:3/324: dwrite d0/da/db/dd/fc [4194304,4194304] 0 2024-05-06T21:26:45.811 INFO:tasks.workunit.client.1.smithi154.stdout:9/350: dread d5/f13 [0,4194304] 0 2024-05-06T21:26:45.811 INFO:tasks.workunit.client.1.smithi154.stdout:3/325: write d0/da/db/f10 [1409622,96025] 0 2024-05-06T21:26:45.811 INFO:tasks.workunit.client.1.smithi154.stdout:3/326: readlink d0/l4c 0 2024-05-06T21:26:45.812 INFO:tasks.workunit.client.1.smithi154.stdout:9/351: mkdir d5/d2e/d7f 0 2024-05-06T21:26:45.815 INFO:tasks.workunit.client.1.smithi154.stdout:3/327: rename d0/da/d1a/d28/d17/f2c to d0/da/d1a/d28/d2f/d38/f6d 0 2024-05-06T21:26:45.821 INFO:tasks.workunit.client.1.smithi154.stdout:5/266: sync 2024-05-06T21:26:45.831 INFO:tasks.workunit.client.0.smithi032.stdout:2/538: dread df/d19/d1e/d71/d5f/d7d/d25/d2d/f86 [0,4194304] 0 2024-05-06T21:26:45.832 INFO:tasks.workunit.client.0.smithi032.stdout:2/539: symlink df/d19/d1e/d1f/d2e/lc3 0 2024-05-06T21:26:45.832 INFO:tasks.workunit.client.0.smithi032.stdout:2/540: chown df/d19/d1e/d71 10124 1 2024-05-06T21:26:45.833 INFO:tasks.workunit.client.0.smithi032.stdout:2/541: creat df/d19/d1e/d1f/d2e/dbe/fc4 x:0 0 0 2024-05-06T21:26:45.834 INFO:tasks.workunit.client.0.smithi032.stdout:2/542: truncate df/d19/d1e/d71/d5f/d7d/d65/f85 2939504 0 2024-05-06T21:26:45.834 INFO:tasks.workunit.client.0.smithi032.stdout:2/543: read - df/d19/d1e/d71/d5f/d7d/fa8 zero size 2024-05-06T21:26:45.837 INFO:tasks.workunit.client.1.smithi154.stdout:7/166: dwrite d6/de/f31 [0,4194304] 0 2024-05-06T21:26:45.837 INFO:tasks.workunit.client.1.smithi154.stdout:4/247: dwrite d0/d2/f2b [0,4194304] 0 2024-05-06T21:26:45.838 INFO:tasks.workunit.client.0.smithi032.stdout:3/723: dwrite d1/d4/da/d1d/f24 [0,4194304] 0 2024-05-06T21:26:45.839 INFO:tasks.workunit.client.0.smithi032.stdout:3/724: mkdir d1/d4/d11/dfb 0 2024-05-06T21:26:45.841 INFO:tasks.workunit.client.0.smithi032.stdout:3/725: truncate d1/d4/da/d31/d47/d4a/fd1 1757926 0 2024-05-06T21:26:45.841 INFO:tasks.workunit.client.0.smithi032.stdout:3/726: write d1/d4/da/d31/d47/d4a/d68/d7c/f9a [6146139,129086] 0 2024-05-06T21:26:45.851 INFO:tasks.workunit.client.0.smithi032.stdout:4/670: dwrite d2/d16/d44/f5c [0,4194304] 0 2024-05-06T21:26:45.851 INFO:tasks.workunit.client.0.smithi032.stdout:4/671: fdatasync d2/d16/f5e 0 2024-05-06T21:26:45.852 INFO:tasks.workunit.client.0.smithi032.stdout:9/619: dwrite d1/f31 [0,4194304] 0 2024-05-06T21:26:45.852 INFO:tasks.workunit.client.0.smithi032.stdout:9/620: chown d1/d13/d33/d5e/d78/f8d 4856 1 2024-05-06T21:26:45.852 INFO:tasks.workunit.client.0.smithi032.stdout:9/621: read - d1/d13/d33/d5e/d78/f83 zero size 2024-05-06T21:26:45.854 INFO:tasks.workunit.client.1.smithi154.stdout:4/248: dread d0/d10/d11/d1a/d31/d44/f4d [0,4194304] 0 2024-05-06T21:26:45.854 INFO:tasks.workunit.client.1.smithi154.stdout:4/249: write d0/d2/f2f [1295222,27995] 0 2024-05-06T21:26:45.854 INFO:tasks.workunit.client.1.smithi154.stdout:4/250: getdents d0/d2/d2a/d4a 0 2024-05-06T21:26:45.854 INFO:tasks.workunit.client.1.smithi154.stdout:2/245: dwrite db/d12/d1d/f47 [0,4194304] 0 2024-05-06T21:26:45.855 INFO:tasks.workunit.client.0.smithi032.stdout:4/672: truncate d2/f35 2646481 0 2024-05-06T21:26:45.855 INFO:tasks.workunit.client.0.smithi032.stdout:4/673: fdatasync d2/d16/d44/d74/d79/fc6 0 2024-05-06T21:26:45.855 INFO:tasks.workunit.client.0.smithi032.stdout:1/549: dwrite db/d47/d4a/da4/f2f [0,4194304] 0 2024-05-06T21:26:45.856 INFO:tasks.workunit.client.0.smithi032.stdout:1/550: dread - db/faf zero size 2024-05-06T21:26:45.856 INFO:tasks.workunit.client.0.smithi032.stdout:1/551: read - db/d16/d46/d57/d58/d68/fb3 zero size 2024-05-06T21:26:45.856 INFO:tasks.workunit.client.0.smithi032.stdout:9/622: mkdir d1/d2f/da1/dc2/da0/dd1 0 2024-05-06T21:26:45.856 INFO:tasks.workunit.client.0.smithi032.stdout:4/674: getdents d2/d2c 0 2024-05-06T21:26:45.856 INFO:tasks.workunit.client.1.smithi154.stdout:4/251: unlink d0/d10/d11/d1a/d31/d3d/f43 0 2024-05-06T21:26:45.857 INFO:tasks.workunit.client.1.smithi154.stdout:4/252: write d0/d2/f1c [5131599,17425] 0 2024-05-06T21:26:45.857 INFO:tasks.workunit.client.1.smithi154.stdout:4/253: fdatasync d0/d10/d11/d1a/d31/d44/f4d 0 2024-05-06T21:26:45.857 INFO:tasks.workunit.client.1.smithi154.stdout:4/254: fdatasync d0/d2/f4c 0 2024-05-06T21:26:45.857 INFO:tasks.workunit.client.0.smithi032.stdout:9/623: mknod d1/d13/d33/d3f/d60/cd2 0 2024-05-06T21:26:45.857 INFO:tasks.workunit.client.0.smithi032.stdout:9/624: stat d1/d2f/fc4 0 2024-05-06T21:26:45.858 INFO:tasks.workunit.client.0.smithi032.stdout:9/625: symlink d1/d13/d34/d26/d49/ld3 0 2024-05-06T21:26:45.859 INFO:tasks.workunit.client.1.smithi154.stdout:5/267: dwrite d2/d6/dd/f18 [0,4194304] 0 2024-05-06T21:26:45.859 INFO:tasks.workunit.client.1.smithi154.stdout:5/268: fdatasync d2/d6/dc/f30 0 2024-05-06T21:26:45.859 INFO:tasks.workunit.client.1.smithi154.stdout:5/269: write d2/d3/d21/d22/f36 [985934,7694] 0 2024-05-06T21:26:45.859 INFO:tasks.workunit.client.1.smithi154.stdout:5/270: readlink d2/d6/dd/d57/l58 0 2024-05-06T21:26:45.859 INFO:tasks.workunit.client.1.smithi154.stdout:3/328: dwrite d0/da/db/dd/d1c/d21/f60 [0,4194304] 0 2024-05-06T21:26:45.859 INFO:tasks.workunit.client.1.smithi154.stdout:3/329: fsync d0/da/db/dd/d1c/d21/d37/f4b 0 2024-05-06T21:26:45.860 INFO:tasks.workunit.client.1.smithi154.stdout:3/330: truncate d0/d2/d22/f66 283461 0 2024-05-06T21:26:45.860 INFO:tasks.workunit.client.1.smithi154.stdout:8/231: dwrite d3/d14/f19 [0,4194304] 0 2024-05-06T21:26:45.860 INFO:tasks.workunit.client.1.smithi154.stdout:2/246: symlink db/de/d16/l51 0 2024-05-06T21:26:45.861 INFO:tasks.workunit.client.0.smithi032.stdout:1/552: dread db/d16/f32 [4194304,4194304] 0 2024-05-06T21:26:45.861 INFO:tasks.workunit.client.0.smithi032.stdout:1/553: write db/d16/f83 [79194,4654] 0 2024-05-06T21:26:45.861 INFO:tasks.workunit.client.0.smithi032.stdout:1/554: fdatasync db/d16/d46/f94 0 2024-05-06T21:26:45.861 INFO:tasks.workunit.client.0.smithi032.stdout:1/555: stat db/d16/d46/d57/d58/d68/l9d 0 2024-05-06T21:26:45.862 INFO:tasks.workunit.client.0.smithi032.stdout:1/556: write db/d16/f75 [809711,41569] 0 2024-05-06T21:26:45.862 INFO:tasks.workunit.client.0.smithi032.stdout:1/557: truncate db/d16/d46/d57/d58/d68/f9f 604718 0 2024-05-06T21:26:45.862 INFO:tasks.workunit.client.0.smithi032.stdout:1/558: chown db/d47/d4a/c99 700441359 1 2024-05-06T21:26:45.862 INFO:tasks.workunit.client.0.smithi032.stdout:1/559: unlink db/d16/d46/f78 0 2024-05-06T21:26:45.862 INFO:tasks.workunit.client.0.smithi032.stdout:1/560: chown db/d16/l1c 2 1 2024-05-06T21:26:45.862 INFO:tasks.workunit.client.1.smithi154.stdout:4/255: mknod d0/d10/d11/d1a/d31/d39/d54/c55 0 2024-05-06T21:26:45.864 INFO:tasks.workunit.client.0.smithi032.stdout:1/561: link db/d47/d4a/da4/c8c db/d16/d46/d55/cb4 0 2024-05-06T21:26:45.864 INFO:tasks.workunit.client.0.smithi032.stdout:1/562: fdatasync db/d47/d4a/f95 0 2024-05-06T21:26:45.864 INFO:tasks.workunit.client.0.smithi032.stdout:4/675: dread d2/d16/d44/d54/d69/f8e [0,4194304] 0 2024-05-06T21:26:45.866 INFO:tasks.workunit.client.0.smithi032.stdout:4/676: rmdir d2/d16/d44/d74/d76/d81 39 2024-05-06T21:26:45.866 INFO:tasks.workunit.client.1.smithi154.stdout:5/271: creat d2/d6/dd/d2a/d54/f5c x:0 0 0 2024-05-06T21:26:45.867 INFO:tasks.workunit.client.1.smithi154.stdout:7/167: dwrite d6/fb [0,4194304] 0 2024-05-06T21:26:45.868 INFO:tasks.workunit.client.1.smithi154.stdout:3/331: creat d0/da/d1a/d28/d2f/d38/d55/f6e x:0 0 0 2024-05-06T21:26:45.868 INFO:tasks.workunit.client.1.smithi154.stdout:3/332: fdatasync d0/da/d1a/d28/d17/f54 0 2024-05-06T21:26:45.872 INFO:tasks.workunit.client.0.smithi032.stdout:3/727: rmdir d1 39 2024-05-06T21:26:45.873 INFO:tasks.workunit.client.1.smithi154.stdout:4/256: write d0/f34 [6550027,126296] 0 2024-05-06T21:26:45.873 INFO:tasks.workunit.client.1.smithi154.stdout:4/257: write d0/d2/dc/f16 [267891,92042] 0 2024-05-06T21:26:45.874 INFO:tasks.workunit.client.0.smithi032.stdout:2/544: dwrite df/d19/f5b [4194304,4194304] 0 2024-05-06T21:26:45.877 INFO:tasks.workunit.client.0.smithi032.stdout:9/626: write d1/d13/d34/d26/d39/f9b [1713426,123834] 0 2024-05-06T21:26:45.878 INFO:tasks.workunit.client.0.smithi032.stdout:9/627: chown d1/c1d 1348592 1 2024-05-06T21:26:45.878 INFO:tasks.workunit.client.0.smithi032.stdout:9/628: readlink d1/d13/d34/d26/d39/d8b/la8 0 2024-05-06T21:26:45.878 INFO:tasks.workunit.client.0.smithi032.stdout:9/629: write d1/d2f/da1/dc2/d59/f65 [468080,88293] 0 2024-05-06T21:26:45.879 INFO:tasks.workunit.client.1.smithi154.stdout:8/232: mkdir d3/d14/d1a/d29/d49/d4a 0 2024-05-06T21:26:45.881 INFO:tasks.workunit.client.1.smithi154.stdout:2/247: rmdir db/de/d16/d4f/d46 0 2024-05-06T21:26:45.883 INFO:tasks.workunit.client.1.smithi154.stdout:5/272: symlink d2/d3/l5d 0 2024-05-06T21:26:45.885 INFO:tasks.workunit.client.0.smithi032.stdout:2/545: rename df/d19/d1e/d1f to df/d19/d1e/d35/dc5 0 2024-05-06T21:26:45.885 INFO:tasks.workunit.client.1.smithi154.stdout:7/168: creat d6/de/f37 x:0 0 0 2024-05-06T21:26:45.886 INFO:tasks.workunit.client.1.smithi154.stdout:7/169: write d6/de/d23/f28 [242406,1086] 0 2024-05-06T21:26:45.888 INFO:tasks.workunit.client.0.smithi032.stdout:3/728: write d1/d4/d11/f4f [2713214,65363] 0 2024-05-06T21:26:45.891 INFO:tasks.workunit.client.0.smithi032.stdout:3/729: creat d1/d4/ffc x:0 0 0 2024-05-06T21:26:45.891 INFO:tasks.workunit.client.1.smithi154.stdout:2/248: unlink db/de/d10/d18/l36 0 2024-05-06T21:26:45.891 INFO:tasks.workunit.client.1.smithi154.stdout:2/249: creat db/de/d16/f52 x:0 0 0 2024-05-06T21:26:45.891 INFO:tasks.workunit.client.1.smithi154.stdout:2/250: chown db/de/d16/l51 750977 1 2024-05-06T21:26:45.892 INFO:tasks.workunit.client.1.smithi154.stdout:2/251: rename db/de to db/de/d16/d4f/d53 22 2024-05-06T21:26:45.892 INFO:tasks.workunit.client.1.smithi154.stdout:6/189: sync 2024-05-06T21:26:45.893 INFO:tasks.workunit.client.0.smithi032.stdout:3/730: mkdir d1/d4/da/d9f/dfd 0 2024-05-06T21:26:45.894 INFO:tasks.workunit.client.1.smithi154.stdout:3/333: rmdir d0/da/d1a/d28/d17 39 2024-05-06T21:26:45.894 INFO:tasks.workunit.client.1.smithi154.stdout:3/334: dread - d0/da/d1a/d28/d17/f63 zero size 2024-05-06T21:26:45.894 INFO:tasks.workunit.client.1.smithi154.stdout:3/335: stat d0/da/db/dd/d1c/d21/f60 0 2024-05-06T21:26:45.894 INFO:tasks.workunit.client.1.smithi154.stdout:3/336: creat d0/d2/f6f x:0 0 0 2024-05-06T21:26:45.894 INFO:tasks.workunit.client.1.smithi154.stdout:7/170: getdents d6/de/d21/d2e 0 2024-05-06T21:26:45.896 INFO:tasks.workunit.client.1.smithi154.stdout:8/233: dread d3/f10 [0,4194304] 0 2024-05-06T21:26:45.896 INFO:tasks.workunit.client.1.smithi154.stdout:8/234: fdatasync d3/ff 0 2024-05-06T21:26:45.904 INFO:tasks.workunit.client.1.smithi154.stdout:0/256: sync 2024-05-06T21:26:45.910 INFO:tasks.workunit.client.0.smithi032.stdout:1/563: dwrite db/d16/f32 [0,4194304] 0 2024-05-06T21:26:45.911 INFO:tasks.workunit.client.0.smithi032.stdout:1/564: write db/d47/d4a/fa7 [649941,16207] 0 2024-05-06T21:26:45.911 INFO:tasks.workunit.client.1.smithi154.stdout:0/257: dread d6/dc/d44/f20 [0,4194304] 0 2024-05-06T21:26:45.911 INFO:tasks.workunit.client.1.smithi154.stdout:0/258: chown d6/l18 0 1 2024-05-06T21:26:45.912 INFO:tasks.workunit.client.1.smithi154.stdout:6/190: symlink d8/d13/l44 0 2024-05-06T21:26:45.913 INFO:tasks.workunit.client.1.smithi154.stdout:6/191: readlink d8/d13/l44 0 2024-05-06T21:26:45.913 INFO:tasks.workunit.client.1.smithi154.stdout:6/192: write d8/d13/f3f [3966621,2626] 0 2024-05-06T21:26:45.914 INFO:tasks.workunit.client.0.smithi032.stdout:1/565: truncate db/d37/d52/f85 3190706 0 2024-05-06T21:26:45.915 INFO:tasks.workunit.client.0.smithi032.stdout:9/630: dwrite d1/f9 [0,4194304] 0 2024-05-06T21:26:45.916 INFO:tasks.workunit.client.0.smithi032.stdout:9/631: dread - d1/d13/d33/d8e/fd0 zero size 2024-05-06T21:26:45.916 INFO:tasks.workunit.client.0.smithi032.stdout:9/632: getdents d1/d13/d33/d5e 0 2024-05-06T21:26:45.916 INFO:tasks.workunit.client.0.smithi032.stdout:8/754: dwrite d0/d1b/d47/f83 [0,4194304] 0 2024-05-06T21:26:45.917 INFO:tasks.workunit.client.1.smithi154.stdout:3/337: rename d0/da/d1a/d28/d2f/d38/d48/f67 to d0/da/f70 0 2024-05-06T21:26:45.917 INFO:tasks.workunit.client.1.smithi154.stdout:3/338: chown d0/da/db/dd 29 1 2024-05-06T21:26:45.918 INFO:tasks.workunit.client.1.smithi154.stdout:7/171: creat d6/d20/f38 x:0 0 0 2024-05-06T21:26:45.918 INFO:tasks.workunit.client.1.smithi154.stdout:7/172: write d6/d20/f1b [2250514,34734] 0 2024-05-06T21:26:45.918 INFO:tasks.workunit.client.0.smithi032.stdout:1/566: creat db/d47/d4a/da4/fb5 x:0 0 0 2024-05-06T21:26:45.920 INFO:tasks.workunit.client.1.smithi154.stdout:8/235: mkdir d3/d14/d1a/d29/d32/d40/d4b 0 2024-05-06T21:26:45.920 INFO:tasks.workunit.client.0.smithi032.stdout:9/633: creat d1/d2f/da1/dc2/d59/fd4 x:0 0 0 2024-05-06T21:26:45.920 INFO:tasks.workunit.client.0.smithi032.stdout:9/634: chown d1/d13/d33/da6 132208 1 2024-05-06T21:26:45.920 INFO:tasks.workunit.client.0.smithi032.stdout:4/677: dwrite d2/d13/f56 [0,4194304] 0 2024-05-06T21:26:45.920 INFO:tasks.workunit.client.0.smithi032.stdout:4/678: chown d2/d1e 404273 1 2024-05-06T21:26:45.921 INFO:tasks.workunit.client.1.smithi154.stdout:0/259: rename d6/dc/f2d to d6/dc/f4f 0 2024-05-06T21:26:45.922 INFO:tasks.workunit.client.1.smithi154.stdout:0/260: dread d6/dc/f4f [0,4194304] 0 2024-05-06T21:26:45.922 INFO:tasks.workunit.client.1.smithi154.stdout:0/261: chown d6/dc/c2b 62768 1 2024-05-06T21:26:45.924 INFO:tasks.workunit.client.1.smithi154.stdout:6/193: mknod d8/d11/d2d/c45 0 2024-05-06T21:26:45.926 INFO:tasks.workunit.client.1.smithi154.stdout:8/236: dread d3/fb [0,4194304] 0 2024-05-06T21:26:45.926 INFO:tasks.workunit.client.1.smithi154.stdout:8/237: fdatasync d3/fd 0 2024-05-06T21:26:45.926 INFO:tasks.workunit.client.1.smithi154.stdout:8/238: truncate d3/fb 1545878 0 2024-05-06T21:26:45.927 INFO:tasks.workunit.client.1.smithi154.stdout:3/339: mkdir d0/da/db/d30/d71 0 2024-05-06T21:26:45.927 INFO:tasks.workunit.client.0.smithi032.stdout:8/755: mkdir d0/d1c/d5e/d67/dc3/de9 0 2024-05-06T21:26:45.927 INFO:tasks.workunit.client.0.smithi032.stdout:1/567: creat db/d16/d5d/db2/fb6 x:0 0 0 2024-05-06T21:26:45.928 INFO:tasks.workunit.client.0.smithi032.stdout:9/635: mknod d1/d13/d33/d8e/cd5 0 2024-05-06T21:26:45.928 INFO:tasks.workunit.client.0.smithi032.stdout:9/636: chown d1/d2f/d4f/lcb 1663304 1 2024-05-06T21:26:45.928 INFO:tasks.workunit.client.0.smithi032.stdout:9/637: readlink d1/d2f/da1/dc2/d64/d72/l90 0 2024-05-06T21:26:45.929 INFO:tasks.workunit.client.1.smithi154.stdout:8/239: symlink d3/d14/d1a/d22/d26/l4c 0 2024-05-06T21:26:45.931 INFO:tasks.workunit.client.1.smithi154.stdout:3/340: symlink d0/da/db/d30/l72 0 2024-05-06T21:26:45.931 INFO:tasks.workunit.client.1.smithi154.stdout:3/341: readlink d0/da/l3f 0 2024-05-06T21:26:45.931 INFO:tasks.workunit.client.1.smithi154.stdout:1/296: sync 2024-05-06T21:26:45.932 INFO:tasks.workunit.client.0.smithi032.stdout:1/568: rename db/d47/d4a/f74 to db/fb7 0 2024-05-06T21:26:45.933 INFO:tasks.workunit.client.1.smithi154.stdout:0/262: write d6/f3a [1107877,66068] 0 2024-05-06T21:26:45.933 INFO:tasks.workunit.client.1.smithi154.stdout:2/252: dwrite db/d12/d19/f39 [0,4194304] 0 2024-05-06T21:26:45.934 INFO:tasks.workunit.client.1.smithi154.stdout:8/240: rename d3/d14/d1a/d29/d49 to d3/d14/d1a/d29/d32/d40/d4b/d4d 0 2024-05-06T21:26:45.934 INFO:tasks.workunit.client.1.smithi154.stdout:8/241: dread - d3/d38/f39 zero size 2024-05-06T21:26:45.934 INFO:tasks.workunit.client.1.smithi154.stdout:0/263: creat d6/dc/f50 x:0 0 0 2024-05-06T21:26:45.934 INFO:tasks.workunit.client.0.smithi032.stdout:4/679: dread d2/d1e/f28 [0,4194304] 0 2024-05-06T21:26:45.935 INFO:tasks.workunit.client.0.smithi032.stdout:9/638: rename d1/d2f/da1/dc2/da0/laf to d1/d13/d34/d26/d9f/ld6 0 2024-05-06T21:26:45.935 INFO:tasks.workunit.client.0.smithi032.stdout:9/639: read - d1/d2f/da1/dc2/d64/fc5 zero size 2024-05-06T21:26:45.937 INFO:tasks.workunit.client.1.smithi154.stdout:3/342: dread d0/f2b [0,4194304] 0 2024-05-06T21:26:45.937 INFO:tasks.workunit.client.0.smithi032.stdout:1/569: rmdir db/d37/d93 39 2024-05-06T21:26:45.938 INFO:tasks.workunit.client.0.smithi032.stdout:1/570: fdatasync db/d47/d4a/da4/f39 0 2024-05-06T21:26:45.938 INFO:tasks.workunit.client.0.smithi032.stdout:1/571: dread - db/d16/d46/d57/d58/d68/fb3 zero size 2024-05-06T21:26:45.938 INFO:tasks.workunit.client.1.smithi154.stdout:6/194: write d8/d11/d2d/f2f [1026993,64653] 0 2024-05-06T21:26:45.939 INFO:tasks.workunit.client.0.smithi032.stdout:8/756: dread d0/fa [0,4194304] 0 2024-05-06T21:26:45.939 INFO:tasks.workunit.client.0.smithi032.stdout:4/680: creat d2/d16/d44/d74/d79/d88/fda x:0 0 0 2024-05-06T21:26:45.940 INFO:tasks.workunit.client.1.smithi154.stdout:8/242: truncate d3/d14/f18 4056745 0 2024-05-06T21:26:45.940 INFO:tasks.workunit.client.1.smithi154.stdout:8/243: write d3/d14/d1a/f3c [988423,126034] 0 2024-05-06T21:26:45.942 INFO:tasks.workunit.client.1.smithi154.stdout:1/297: rename d6/db/d10/d15/d1d/f56 to d6/db/d10/d15/d1d/d53/f5f 0 2024-05-06T21:26:45.942 INFO:tasks.workunit.client.1.smithi154.stdout:1/298: readlink d6/db/d10/d26/l5c 0 2024-05-06T21:26:45.942 INFO:tasks.workunit.client.0.smithi032.stdout:9/640: rename d1/d13/l19 to d1/d13/d34/d26/d39/d45/ld7 0 2024-05-06T21:26:45.943 INFO:tasks.workunit.client.1.smithi154.stdout:0/264: mkdir d6/dc/d51 0 2024-05-06T21:26:45.943 INFO:tasks.workunit.client.1.smithi154.stdout:0/265: chown d6/dc/d40/f47 1 1 2024-05-06T21:26:45.944 INFO:tasks.workunit.client.0.smithi032.stdout:8/757: creat d0/d1c/fea x:0 0 0 2024-05-06T21:26:45.945 INFO:tasks.workunit.client.0.smithi032.stdout:4/681: creat d2/d16/d44/d45/d4e/fdb x:0 0 0 2024-05-06T21:26:45.945 INFO:tasks.workunit.client.0.smithi032.stdout:4/682: dread - d2/d16/d44/d45/d4e/fbb zero size 2024-05-06T21:26:45.945 INFO:tasks.workunit.client.0.smithi032.stdout:4/683: read d2/f96 [3136551,129711] 0 2024-05-06T21:26:45.946 INFO:tasks.workunit.client.1.smithi154.stdout:2/253: write db/de/d16/f1f [1206790,18354] 0 2024-05-06T21:26:45.946 INFO:tasks.workunit.client.1.smithi154.stdout:7/173: dwrite d6/f9 [0,4194304] 0 2024-05-06T21:26:45.947 INFO:tasks.workunit.client.0.smithi032.stdout:9/641: symlink d1/d2f/d4f/ld8 0 2024-05-06T21:26:45.949 INFO:tasks.workunit.client.0.smithi032.stdout:9/642: mkdir d1/d2f/da1/dc2/d64/dd9 0 2024-05-06T21:26:45.949 INFO:tasks.workunit.client.0.smithi032.stdout:9/643: fsync d1/d2f/f7a 0 2024-05-06T21:26:45.950 INFO:tasks.workunit.client.1.smithi154.stdout:3/343: link d0/da/f18 d0/da/db/f73 0 2024-05-06T21:26:45.951 INFO:tasks.workunit.client.0.smithi032.stdout:9/644: link d1/d2f/da1/dc2/f4b d1/d2f/da1/dc2/fda 0 2024-05-06T21:26:45.951 INFO:tasks.workunit.client.0.smithi032.stdout:9/645: readlink d1/d13/l6e 0 2024-05-06T21:26:45.951 INFO:tasks.workunit.client.0.smithi032.stdout:9/646: dread - d1/d13/d33/da6/fbf zero size 2024-05-06T21:26:45.954 INFO:tasks.workunit.client.0.smithi032.stdout:8/758: dread d0/d1c/fbb [0,4194304] 0 2024-05-06T21:26:45.954 INFO:tasks.workunit.client.0.smithi032.stdout:1/572: dwrite db/d16/d46/f63 [0,4194304] 0 2024-05-06T21:26:45.959 INFO:tasks.workunit.client.0.smithi032.stdout:4/684: dread d2/d16/d44/d54/d69/faf [0,4194304] 0 2024-05-06T21:26:45.959 INFO:tasks.workunit.client.0.smithi032.stdout:4/685: write d2/d16/d44/d74/d76/d81/f84 [975919,85380] 0 2024-05-06T21:26:45.960 INFO:tasks.workunit.client.1.smithi154.stdout:6/195: rename d8/l30 to d8/d11/d2d/l46 0 2024-05-06T21:26:45.960 INFO:tasks.workunit.client.1.smithi154.stdout:6/196: write f1 [523251,16304] 0 2024-05-06T21:26:45.960 INFO:tasks.workunit.client.1.smithi154.stdout:6/197: creat d8/d11/d2d/f47 x:0 0 0 2024-05-06T21:26:45.960 INFO:tasks.workunit.client.0.smithi032.stdout:7/665: sync 2024-05-06T21:26:45.960 INFO:tasks.workunit.client.0.smithi032.stdout:5/541: sync 2024-05-06T21:26:45.960 INFO:tasks.workunit.client.0.smithi032.stdout:5/542: fsync d0/d24/d26/d3d/d50/f6e 0 2024-05-06T21:26:45.961 INFO:tasks.workunit.client.0.smithi032.stdout:5/543: read - d0/d16/d2f/d77/f7d zero size 2024-05-06T21:26:45.961 INFO:tasks.workunit.client.0.smithi032.stdout:5/544: fdatasync d0/d16/f1c 0 2024-05-06T21:26:45.961 INFO:tasks.workunit.client.0.smithi032.stdout:5/545: fdatasync d0/d24/d26/f56 0 2024-05-06T21:26:45.961 INFO:tasks.workunit.client.0.smithi032.stdout:0/577: sync 2024-05-06T21:26:45.961 INFO:tasks.workunit.client.0.smithi032.stdout:6/696: sync 2024-05-06T21:26:45.962 INFO:tasks.workunit.client.1.smithi154.stdout:8/244: dwrite d3/f21 [0,4194304] 0 2024-05-06T21:26:45.962 INFO:tasks.workunit.client.1.smithi154.stdout:8/245: chown d3/d14/c2f 196 1 2024-05-06T21:26:45.962 INFO:tasks.workunit.client.1.smithi154.stdout:8/246: chown d3/d14/d1a/d29/d3e 297 1 2024-05-06T21:26:45.963 INFO:tasks.workunit.client.0.smithi032.stdout:9/647: dread d1/d2f/da1/dc2/d64/f69 [0,4194304] 0 2024-05-06T21:26:45.965 INFO:tasks.workunit.client.1.smithi154.stdout:0/266: creat d6/d27/f52 x:0 0 0 2024-05-06T21:26:45.965 INFO:tasks.workunit.client.1.smithi154.stdout:0/267: chown d6/dc/d44/f46 8323 1 2024-05-06T21:26:45.966 INFO:tasks.workunit.client.0.smithi032.stdout:9/648: dread d1/d2f/da1/dc2/f7f [0,4194304] 0 2024-05-06T21:26:45.969 INFO:tasks.workunit.client.0.smithi032.stdout:4/686: dread d2/d16/d44/d74/d76/fab [0,4194304] 0 2024-05-06T21:26:45.969 INFO:tasks.workunit.client.0.smithi032.stdout:4/687: readlink d2/d1e/d47/l73 0 2024-05-06T21:26:45.969 INFO:tasks.workunit.client.0.smithi032.stdout:4/688: truncate d2/d16/d44/d74/d79/fb9 1002818 0 2024-05-06T21:26:45.969 INFO:tasks.workunit.client.0.smithi032.stdout:4/689: chown d2/d13/l38 876976 1 2024-05-06T21:26:45.973 INFO:tasks.workunit.client.1.smithi154.stdout:6/198: read d8/f31 [1272326,15952] 0 2024-05-06T21:26:45.973 INFO:tasks.workunit.client.1.smithi154.stdout:6/199: readlink d8/d11/l29 0 2024-05-06T21:26:45.975 INFO:tasks.workunit.client.1.smithi154.stdout:8/247: link d3/d14/d1a/d22/d26/d2b/f46 d3/d14/d1a/d22/d26/f4e 0 2024-05-06T21:26:45.976 INFO:tasks.workunit.client.0.smithi032.stdout:7/666: dread f3 [0,4194304] 0 2024-05-06T21:26:45.977 INFO:tasks.workunit.client.1.smithi154.stdout:2/254: creat db/d12/d19/f54 x:0 0 0 2024-05-06T21:26:45.977 INFO:tasks.workunit.client.1.smithi154.stdout:2/255: fsync db/d12/d1d/f47 0 2024-05-06T21:26:45.977 INFO:tasks.workunit.client.1.smithi154.stdout:2/256: chown db/de/d16/f52 637 1 2024-05-06T21:26:45.977 INFO:tasks.workunit.client.1.smithi154.stdout:7/174: getdents d6/de 0 2024-05-06T21:26:45.979 INFO:tasks.workunit.client.1.smithi154.stdout:8/248: symlink d3/l4f 0 2024-05-06T21:26:45.981 INFO:tasks.workunit.client.1.smithi154.stdout:6/200: dread d8/d11/d2d/f2f [0,4194304] 0 2024-05-06T21:26:45.981 INFO:tasks.workunit.client.1.smithi154.stdout:6/201: chown d8/l18 70279686 1 2024-05-06T21:26:45.982 INFO:tasks.workunit.client.1.smithi154.stdout:6/202: mknod d8/d13/c48 0 2024-05-06T21:26:45.982 INFO:tasks.workunit.client.1.smithi154.stdout:6/203: chown d8/f10 7152822 1 2024-05-06T21:26:45.982 INFO:tasks.workunit.client.1.smithi154.stdout:6/204: read f1 [658532,70156] 0 2024-05-06T21:26:45.985 INFO:tasks.workunit.client.1.smithi154.stdout:6/205: creat d8/d13/d42/f49 x:0 0 0 2024-05-06T21:26:45.987 INFO:tasks.workunit.client.0.smithi032.stdout:8/759: rmdir d0 39 2024-05-06T21:26:45.987 INFO:tasks.workunit.client.1.smithi154.stdout:6/206: getdents d8 0 2024-05-06T21:26:45.988 INFO:tasks.workunit.client.1.smithi154.stdout:3/344: dwrite d0/da/db/dd/d1c/d21/f60 [4194304,4194304] 0 2024-05-06T21:26:45.988 INFO:tasks.workunit.client.1.smithi154.stdout:3/345: truncate d0/d2/f6f 712381 0 2024-05-06T21:26:45.990 INFO:tasks.workunit.client.0.smithi032.stdout:1/573: mkdir db/d16/db8 0 2024-05-06T21:26:45.990 INFO:tasks.workunit.client.0.smithi032.stdout:1/574: fdatasync db/d37/f54 0 2024-05-06T21:26:45.990 INFO:tasks.workunit.client.1.smithi154.stdout:3/346: dread d0/f50 [0,4194304] 0 2024-05-06T21:26:45.993 INFO:tasks.workunit.client.0.smithi032.stdout:5/546: rmdir d0/d16/d86 0 2024-05-06T21:26:45.993 INFO:tasks.workunit.client.0.smithi032.stdout:5/547: chown d0/d24/d26/d3d/f95 15035 1 2024-05-06T21:26:45.993 INFO:tasks.workunit.client.1.smithi154.stdout:0/268: dwrite d6/dc/d39/f3e [0,4194304] 0 2024-05-06T21:26:45.993 INFO:tasks.workunit.client.1.smithi154.stdout:0/269: fdatasync d6/dc/f4f 0 2024-05-06T21:26:45.994 INFO:tasks.workunit.client.0.smithi032.stdout:0/578: mknod d4/da/d14/d1a/cb5 0 2024-05-06T21:26:45.995 INFO:tasks.workunit.client.0.smithi032.stdout:0/579: chown d4/f7 3440 1 2024-05-06T21:26:45.995 INFO:tasks.workunit.client.0.smithi032.stdout:0/580: write d4/da/d14/d4a/f93 [812658,590] 0 2024-05-06T21:26:45.995 INFO:tasks.workunit.client.0.smithi032.stdout:0/581: fsync d4/da/d16/d4f/fa5 0 2024-05-06T21:26:45.997 INFO:tasks.workunit.client.0.smithi032.stdout:9/649: creat d1/d13/d33/d5e/d78/fdb x:0 0 0 2024-05-06T21:26:45.997 INFO:tasks.workunit.client.0.smithi032.stdout:9/650: chown d1/d13/d33/d3f/d60/f7e 8979657 1 2024-05-06T21:26:45.997 INFO:tasks.workunit.client.1.smithi154.stdout:0/270: creat d6/f53 x:0 0 0 2024-05-06T21:26:45.998 INFO:tasks.workunit.client.0.smithi032.stdout:7/667: mknod db/d12/d16/d21/d41/d4b/cd4 0 2024-05-06T21:26:45.998 INFO:tasks.workunit.client.1.smithi154.stdout:8/249: dread d3/ff [0,4194304] 0 2024-05-06T21:26:45.999 INFO:tasks.workunit.client.0.smithi032.stdout:5/548: mknod d0/d24/d26/c9f 0 2024-05-06T21:26:45.999 INFO:tasks.workunit.client.0.smithi032.stdout:5/549: fdatasync d0/d16/d2f/f41 0 2024-05-06T21:26:46.000 INFO:tasks.workunit.client.0.smithi032.stdout:8/760: dread d0/fe [0,4194304] 0 2024-05-06T21:26:46.000 INFO:tasks.workunit.client.0.smithi032.stdout:5/550: rmdir d0/d16/d46 39 2024-05-06T21:26:46.001 INFO:tasks.workunit.client.0.smithi032.stdout:0/582: getdents d4/da/d14/d1a/d66 0 2024-05-06T21:26:46.001 INFO:tasks.workunit.client.0.smithi032.stdout:0/583: read - d4/da/d14/d4a/f65 zero size 2024-05-06T21:26:46.002 INFO:tasks.workunit.client.1.smithi154.stdout:8/250: getdents d3/d14 0 2024-05-06T21:26:46.002 INFO:tasks.workunit.client.1.smithi154.stdout:8/251: creat d3/d14/d1a/d29/f50 x:0 0 0 2024-05-06T21:26:46.002 INFO:tasks.workunit.client.1.smithi154.stdout:8/252: dread - d3/d38/f39 zero size 2024-05-06T21:26:46.003 INFO:tasks.workunit.client.0.smithi032.stdout:8/761: dread d0/d1b/d39/f6b [0,4194304] 0 2024-05-06T21:26:46.004 INFO:tasks.workunit.client.0.smithi032.stdout:7/668: rmdir db/d12/d49/d97 39 2024-05-06T21:26:46.004 INFO:tasks.workunit.client.0.smithi032.stdout:9/651: dread d1/d2f/da1/dc2/f4b [0,4194304] 0 2024-05-06T21:26:46.005 INFO:tasks.workunit.client.0.smithi032.stdout:5/551: symlink d0/d16/d2a/la0 0 2024-05-06T21:26:46.006 INFO:tasks.workunit.client.0.smithi032.stdout:8/762: mkdir d0/d1c/d5e/d67/dc3/d97/deb 0 2024-05-06T21:26:46.007 INFO:tasks.workunit.client.0.smithi032.stdout:7/669: symlink db/d12/d87/ld5 0 2024-05-06T21:26:46.007 INFO:tasks.workunit.client.0.smithi032.stdout:7/670: dread - db/d12/d87/fc2 zero size 2024-05-06T21:26:46.008 INFO:tasks.workunit.client.0.smithi032.stdout:8/763: mknod d0/d1b/d47/d91/cec 0 2024-05-06T21:26:46.008 INFO:tasks.workunit.client.0.smithi032.stdout:8/764: stat d0/f1a 0 2024-05-06T21:26:46.008 INFO:tasks.workunit.client.0.smithi032.stdout:8/765: stat d0/d1c/d5e/d67/dc3/d97/la1 0 2024-05-06T21:26:46.008 INFO:tasks.workunit.client.1.smithi154.stdout:8/253: dread d3/d14/d1a/f28 [0,4194304] 0 2024-05-06T21:26:46.009 INFO:tasks.workunit.client.1.smithi154.stdout:3/347: write d0/da/db/f73 [3626799,125171] 0 2024-05-06T21:26:46.010 INFO:tasks.workunit.client.0.smithi032.stdout:8/766: symlink d0/d1b/d39/d93/led 0 2024-05-06T21:26:46.010 INFO:tasks.workunit.client.0.smithi032.stdout:7/671: getdents db 0 2024-05-06T21:26:46.012 INFO:tasks.workunit.client.1.smithi154.stdout:0/271: dread d6/f3a [0,4194304] 0 2024-05-06T21:26:46.012 INFO:tasks.workunit.client.1.smithi154.stdout:0/272: fsync d6/dc/d44/f11 0 2024-05-06T21:26:46.014 INFO:tasks.workunit.client.1.smithi154.stdout:0/273: mkdir d6/dc/d51/d54 0 2024-05-06T21:26:46.014 INFO:tasks.workunit.client.1.smithi154.stdout:0/274: dread - d6/dc/f2e zero size 2024-05-06T21:26:46.016 INFO:tasks.workunit.client.1.smithi154.stdout:3/348: dread d0/da/d1a/f68 [0,4194304] 0 2024-05-06T21:26:46.016 INFO:tasks.workunit.client.1.smithi154.stdout:3/349: chown d0/da/db/dd/f53 162515993 1 2024-05-06T21:26:46.018 INFO:tasks.workunit.client.0.smithi032.stdout:9/652: dread d1/f31 [0,4194304] 0 2024-05-06T21:26:46.018 INFO:tasks.workunit.client.0.smithi032.stdout:7/672: dread db/d12/d16/d21/f31 [0,4194304] 0 2024-05-06T21:26:46.019 INFO:tasks.workunit.client.1.smithi154.stdout:3/350: rmdir d0/da/db/dd 39 2024-05-06T21:26:46.020 INFO:tasks.workunit.client.0.smithi032.stdout:7/673: chown db/d12/d16/c22 1665218011 1 2024-05-06T21:26:46.021 INFO:tasks.workunit.client.0.smithi032.stdout:4/690: dwrite f1 [4194304,4194304] 0 2024-05-06T21:26:46.021 INFO:tasks.workunit.client.0.smithi032.stdout:4/691: read d2/f96 [907697,11601] 0 2024-05-06T21:26:46.022 INFO:tasks.workunit.client.1.smithi154.stdout:2/257: dwrite db/de/d16/f3f [0,4194304] 0 2024-05-06T21:26:46.022 INFO:tasks.workunit.client.0.smithi032.stdout:7/674: mkdir db/d12/d16/d21/dcb/dd6 0 2024-05-06T21:26:46.028 INFO:tasks.workunit.client.1.smithi154.stdout:0/275: write d6/dc/d44/f20 [561778,4468] 0 2024-05-06T21:26:46.030 INFO:tasks.workunit.client.1.smithi154.stdout:7/175: dwrite d6/f10 [4194304,4194304] 0 2024-05-06T21:26:46.030 INFO:tasks.workunit.client.1.smithi154.stdout:7/176: write d6/fc [2602934,3516] 0 2024-05-06T21:26:46.031 INFO:tasks.workunit.client.0.smithi032.stdout:8/767: dread d0/f37 [0,4194304] 0 2024-05-06T21:26:46.032 INFO:tasks.workunit.client.0.smithi032.stdout:0/584: write d4/da/d14/d1a/f1e [7687780,85012] 0 2024-05-06T21:26:46.033 INFO:tasks.workunit.client.0.smithi032.stdout:7/675: dread db/d12/d16/d21/fa3 [0,4194304] 0 2024-05-06T21:26:46.033 INFO:tasks.workunit.client.0.smithi032.stdout:8/768: mknod d0/d1c/d5e/d67/dc3/d97/deb/cee 0 2024-05-06T21:26:46.033 INFO:tasks.workunit.client.1.smithi154.stdout:6/207: rename d8/d13/d42 to d8/d11/d33/d4a 0 2024-05-06T21:26:46.034 INFO:tasks.workunit.client.1.smithi154.stdout:7/177: rename d6/de/d21/d2e to d6/de/d21/d2e/d39 22 2024-05-06T21:26:46.034 INFO:tasks.workunit.client.1.smithi154.stdout:7/178: getdents d6/de 0 2024-05-06T21:26:46.035 INFO:tasks.workunit.client.0.smithi032.stdout:0/585: unlink d4/da/d16/f18 0 2024-05-06T21:26:46.036 INFO:tasks.workunit.client.1.smithi154.stdout:6/208: mknod d8/d11/c4b 0 2024-05-06T21:26:46.037 INFO:tasks.workunit.client.0.smithi032.stdout:8/769: rename d0/d1c/d5e/d67/dc3/d57/d5d/fd8 to d0/d1b/d47/d91/da7/fef 0 2024-05-06T21:26:46.037 INFO:tasks.workunit.client.0.smithi032.stdout:8/770: truncate d0/d1b/da8/fe7 769570 0 2024-05-06T21:26:46.038 INFO:tasks.workunit.client.1.smithi154.stdout:6/209: mkdir d8/d11/d2d/d3d/d4c 0 2024-05-06T21:26:46.039 INFO:tasks.workunit.client.0.smithi032.stdout:1/575: dwrite db/d16/f32 [0,4194304] 0 2024-05-06T21:26:46.039 INFO:tasks.workunit.client.0.smithi032.stdout:4/692: write d2/d1e/f25 [2588861,42256] 0 2024-05-06T21:26:46.039 INFO:tasks.workunit.client.0.smithi032.stdout:4/693: readlink d2/d13/l38 0 2024-05-06T21:26:46.040 INFO:tasks.workunit.client.0.smithi032.stdout:8/771: rename d0/f37 to d0/d1b/d47/d91/da7/ff0 0 2024-05-06T21:26:46.042 INFO:tasks.workunit.client.1.smithi154.stdout:0/276: dread d6/f15 [0,4194304] 0 2024-05-06T21:26:46.043 INFO:tasks.workunit.client.0.smithi032.stdout:1/576: link db/f30 db/d47/d4a/da4/da2/fb9 0 2024-05-06T21:26:46.044 INFO:tasks.workunit.client.1.smithi154.stdout:8/254: dwrite d3/f8 [0,4194304] 0 2024-05-06T21:26:46.044 INFO:tasks.workunit.client.1.smithi154.stdout:0/277: creat d6/dc/d51/f55 x:0 0 0 2024-05-06T21:26:46.045 INFO:tasks.workunit.client.0.smithi032.stdout:7/676: write db/d12/d16/d2a/f42 [2976763,3552] 0 2024-05-06T21:26:46.045 INFO:tasks.workunit.client.0.smithi032.stdout:5/552: dwrite d0/d24/d38/f8d [0,4194304] 0 2024-05-06T21:26:46.045 INFO:tasks.workunit.client.0.smithi032.stdout:5/553: chown d0 340 1 2024-05-06T21:26:46.046 INFO:tasks.workunit.client.0.smithi032.stdout:8/772: unlink d0/d1c/l36 0 2024-05-06T21:26:46.047 INFO:tasks.workunit.client.0.smithi032.stdout:8/773: fdatasync d0/d1c/fac 0 2024-05-06T21:26:46.047 INFO:tasks.workunit.client.0.smithi032.stdout:8/774: write d0/f19 [2046069,117002] 0 2024-05-06T21:26:46.047 INFO:tasks.workunit.client.0.smithi032.stdout:8/775: fdatasync d0/d1b/d47/d91/da7/ff0 0 2024-05-06T21:26:46.048 INFO:tasks.workunit.client.0.smithi032.stdout:9/653: dwrite d1/fbb [0,4194304] 0 2024-05-06T21:26:46.048 INFO:tasks.workunit.client.0.smithi032.stdout:8/776: write d0/d1c/d5e/d67/dc3/db5/dd0/fd4 [168104,129578] 0 2024-05-06T21:26:46.048 INFO:tasks.workunit.client.0.smithi032.stdout:8/777: chown d0/f53 1774 1 2024-05-06T21:26:46.050 INFO:tasks.workunit.client.0.smithi032.stdout:1/577: dread db/d47/d4a/da4/f50 [0,4194304] 0 2024-05-06T21:26:46.051 INFO:tasks.workunit.client.1.smithi154.stdout:8/255: rename d3/f21 to d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f51 0 2024-05-06T21:26:46.051 INFO:tasks.workunit.client.1.smithi154.stdout:6/210: dread f1 [0,4194304] 0 2024-05-06T21:26:46.053 INFO:tasks.workunit.client.1.smithi154.stdout:0/278: rmdir d6/dc/d39 39 2024-05-06T21:26:46.053 INFO:tasks.workunit.client.1.smithi154.stdout:7/179: dread d6/f9 [0,4194304] 0 2024-05-06T21:26:46.057 INFO:tasks.workunit.client.0.smithi032.stdout:9/654: read d1/d2f/da1/dc2/f70 [3765219,72991] 0 2024-05-06T21:26:46.057 INFO:tasks.workunit.client.0.smithi032.stdout:9/655: stat d1/d2f/da1/dc2/d64/f69 0 2024-05-06T21:26:46.060 INFO:tasks.workunit.client.0.smithi032.stdout:4/694: truncate d2/f53 1724836 0 2024-05-06T21:26:46.060 INFO:tasks.workunit.client.0.smithi032.stdout:4/695: readlink d2/d16/d44/d45/d4e/l6f 0 2024-05-06T21:26:46.062 INFO:tasks.workunit.client.1.smithi154.stdout:8/256: dread d3/fc [4194304,4194304] 0 2024-05-06T21:26:46.062 INFO:tasks.workunit.client.1.smithi154.stdout:8/257: chown d3 52 1 2024-05-06T21:26:46.063 INFO:tasks.workunit.client.0.smithi032.stdout:7/677: rename db/d12/d16/d21/dcb/dd6 to db/d12/d16/d21/dcb/dd7 0 2024-05-06T21:26:46.063 INFO:tasks.workunit.client.0.smithi032.stdout:7/678: fsync db/d12/d16/d21/d41/f70 0 2024-05-06T21:26:46.063 INFO:tasks.workunit.client.0.smithi032.stdout:7/679: readlink db/d12/d16/d2a/d39/l5d 0 2024-05-06T21:26:46.063 INFO:tasks.workunit.client.1.smithi154.stdout:8/258: unlink d3/d14/d1a/d22/d26/d2b/f46 0 2024-05-06T21:26:46.063 INFO:tasks.workunit.client.1.smithi154.stdout:8/259: readlink d3/l16 0 2024-05-06T21:26:46.065 INFO:tasks.workunit.client.1.smithi154.stdout:8/260: unlink d3/d38/f39 0 2024-05-06T21:26:46.065 INFO:tasks.workunit.client.0.smithi032.stdout:8/778: rmdir d0/d1c/d5e/d67/dc3/db5/ddc 0 2024-05-06T21:26:46.066 INFO:tasks.workunit.client.1.smithi154.stdout:8/261: creat d3/d14/d1a/d29/d3e/f52 x:0 0 0 2024-05-06T21:26:46.066 INFO:tasks.workunit.client.0.smithi032.stdout:1/578: link db/d47/c8b db/d16/da3/cba 0 2024-05-06T21:26:46.067 INFO:tasks.workunit.client.1.smithi154.stdout:8/262: symlink d3/d14/d1a/l53 0 2024-05-06T21:26:46.068 INFO:tasks.workunit.client.0.smithi032.stdout:9/656: mkdir d1/d13/d34/d26/d9f/ddc 0 2024-05-06T21:26:46.068 INFO:tasks.workunit.client.0.smithi032.stdout:9/657: chown d1/d2f/d4f/d97/fa4 1 1 2024-05-06T21:26:46.068 INFO:tasks.workunit.client.0.smithi032.stdout:9/658: chown d1/d13/c24 94 1 2024-05-06T21:26:46.068 INFO:tasks.workunit.client.1.smithi154.stdout:0/279: dread d6/dc/d44/d36/f4d [4194304,4194304] 0 2024-05-06T21:26:46.069 INFO:tasks.workunit.client.1.smithi154.stdout:0/280: fdatasync d6/dc/d39/f3f 0 2024-05-06T21:26:46.069 INFO:tasks.workunit.client.1.smithi154.stdout:0/281: chown d6/dc 80511110 1 2024-05-06T21:26:46.069 INFO:tasks.workunit.client.1.smithi154.stdout:0/282: chown d6/dc/f4f 113 1 2024-05-06T21:26:46.069 INFO:tasks.workunit.client.1.smithi154.stdout:8/263: truncate d3/d14/d1a/f28 223382 0 2024-05-06T21:26:46.069 INFO:tasks.workunit.client.1.smithi154.stdout:8/264: fdatasync d3/fd 0 2024-05-06T21:26:46.069 INFO:tasks.workunit.client.1.smithi154.stdout:8/265: chown d3/fc 934652 1 2024-05-06T21:26:46.069 INFO:tasks.workunit.client.1.smithi154.stdout:2/258: dwrite db/d12/d1d/f48 [4194304,4194304] 0 2024-05-06T21:26:46.070 INFO:tasks.workunit.client.0.smithi032.stdout:4/696: mknod d2/d16/d44/d54/cdc 0 2024-05-06T21:26:46.070 INFO:tasks.workunit.client.0.smithi032.stdout:1/579: dread db/d16/f83 [0,4194304] 0 2024-05-06T21:26:46.070 INFO:tasks.workunit.client.0.smithi032.stdout:1/580: write db/d16/f40 [1523829,100796] 0 2024-05-06T21:26:46.070 INFO:tasks.workunit.client.0.smithi032.stdout:7/680: unlink db/d12/d16/d2a/d39/d3b/dac/lb7 0 2024-05-06T21:26:46.071 INFO:tasks.workunit.client.0.smithi032.stdout:7/681: chown db/d12/f19 1986621237 1 2024-05-06T21:26:46.071 INFO:tasks.workunit.client.1.smithi154.stdout:8/266: dread d3/ff [0,4194304] 0 2024-05-06T21:26:46.071 INFO:tasks.workunit.client.1.smithi154.stdout:8/267: write d3/d14/d1a/d29/f50 [614653,50661] 0 2024-05-06T21:26:46.072 INFO:tasks.workunit.client.1.smithi154.stdout:8/268: creat d3/f54 x:0 0 0 2024-05-06T21:26:46.073 INFO:tasks.workunit.client.1.smithi154.stdout:8/269: chown d3/d14/d1a/d29/d32/d33/f41 16 1 2024-05-06T21:26:46.073 INFO:tasks.workunit.client.0.smithi032.stdout:5/554: rmdir d0/d24/d26/d3d 39 2024-05-06T21:26:46.075 INFO:tasks.workunit.client.0.smithi032.stdout:8/779: mkdir d0/df1 0 2024-05-06T21:26:46.077 INFO:tasks.workunit.client.0.smithi032.stdout:9/659: mknod d1/d13/d34/d91/cdd 0 2024-05-06T21:26:46.077 INFO:tasks.workunit.client.0.smithi032.stdout:9/660: write d1/d2f/da1/dc2/d59/f86 [26243,10850] 0 2024-05-06T21:26:46.077 INFO:tasks.workunit.client.1.smithi154.stdout:2/259: write db/f3c [4081053,50872] 0 2024-05-06T21:26:46.079 INFO:tasks.workunit.client.1.smithi154.stdout:2/260: mkdir db/d12/d4e/d55 0 2024-05-06T21:26:46.079 INFO:tasks.workunit.client.1.smithi154.stdout:3/351: dwrite d0/da/d1a/d28/d2f/d38/f6b [0,4194304] 0 2024-05-06T21:26:46.079 INFO:tasks.workunit.client.1.smithi154.stdout:3/352: chown d0/da/d1a/d28/d2f/d38/d48/c4a 86 1 2024-05-06T21:26:46.080 INFO:tasks.workunit.client.0.smithi032.stdout:0/586: dwrite d4/da/d16/f43 [8388608,4194304] 0 2024-05-06T21:26:46.081 INFO:tasks.workunit.client.0.smithi032.stdout:1/581: mknod db/d47/d4a/da4/da2/cbb 0 2024-05-06T21:26:46.081 INFO:tasks.workunit.client.0.smithi032.stdout:1/582: chown db/d16/d46/d57/d58 9 1 2024-05-06T21:26:46.081 INFO:tasks.workunit.client.0.smithi032.stdout:1/583: write db/d16/d46/d57/f71 [1080314,48813] 0 2024-05-06T21:26:46.081 INFO:tasks.workunit.client.0.smithi032.stdout:5/555: dread d0/d16/d2f/f41 [0,4194304] 0 2024-05-06T21:26:46.082 INFO:tasks.workunit.client.0.smithi032.stdout:5/556: write d0/d16/f85 [872780,79482] 0 2024-05-06T21:26:46.082 INFO:tasks.workunit.client.1.smithi154.stdout:3/353: rmdir d0/da/d1a/d28/d17 39 2024-05-06T21:26:46.082 INFO:tasks.workunit.client.1.smithi154.stdout:3/354: fsync d0/da/d1a/d28/d17/f63 0 2024-05-06T21:26:46.082 INFO:tasks.workunit.client.1.smithi154.stdout:3/355: creat d0/da/d1a/d28/d2f/d38/f74 x:0 0 0 2024-05-06T21:26:46.084 INFO:tasks.workunit.client.0.smithi032.stdout:8/780: mknod d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/cf2 0 2024-05-06T21:26:46.085 INFO:tasks.workunit.client.1.smithi154.stdout:2/261: rmdir db/de/d16 39 2024-05-06T21:26:46.085 INFO:tasks.workunit.client.1.smithi154.stdout:2/262: write db/d12/f2a [1048379,65266] 0 2024-05-06T21:26:46.085 INFO:tasks.workunit.client.1.smithi154.stdout:6/211: dwrite d8/d13/f3f [0,4194304] 0 2024-05-06T21:26:46.087 INFO:tasks.workunit.client.0.smithi032.stdout:9/661: mknod d1/d13/d34/d26/d9f/dbe/cde 0 2024-05-06T21:26:46.087 INFO:tasks.workunit.client.0.smithi032.stdout:9/662: write d1/d2f/da1/dc2/d64/f69 [5391,96453] 0 2024-05-06T21:26:46.087 INFO:tasks.workunit.client.0.smithi032.stdout:9/663: chown d1/d13/d34/d26/d39/d45/c5d 0 1 2024-05-06T21:26:46.088 INFO:tasks.workunit.client.0.smithi032.stdout:9/664: truncate d1/d2f/da1/dc2/d64/fc5 123209 0 2024-05-06T21:26:46.088 INFO:tasks.workunit.client.0.smithi032.stdout:9/665: write d1/d2f/da1/dc2/d59/fd4 [465564,114033] 0 2024-05-06T21:26:46.089 INFO:tasks.workunit.client.1.smithi154.stdout:2/263: truncate db/d12/f43 86731 0 2024-05-06T21:26:46.089 INFO:tasks.workunit.client.1.smithi154.stdout:2/264: write db/de/d10/f25 [3439806,108198] 0 2024-05-06T21:26:46.094 INFO:tasks.workunit.client.0.smithi032.stdout:4/697: rename d2/l1d to d2/d2c/ldd 0 2024-05-06T21:26:46.094 INFO:tasks.workunit.client.0.smithi032.stdout:4/698: fsync d2/d16/d44/d45/d4e/fbb 0 2024-05-06T21:26:46.094 INFO:tasks.workunit.client.0.smithi032.stdout:4/699: fdatasync d2/d16/d44/d45/d4e/f6b 0 2024-05-06T21:26:46.102 INFO:tasks.workunit.client.1.smithi154.stdout:0/283: dwrite d6/dc/d44/f46 [0,4194304] 0 2024-05-06T21:26:46.103 INFO:tasks.workunit.client.0.smithi032.stdout:1/584: symlink db/d47/d4a/da4/d4f/lbc 0 2024-05-06T21:26:46.103 INFO:tasks.workunit.client.0.smithi032.stdout:1/585: fsync db/faf 0 2024-05-06T21:26:46.103 INFO:tasks.workunit.client.0.smithi032.stdout:1/586: readlink db/d37/d52/l6f 0 2024-05-06T21:26:46.104 INFO:tasks.workunit.client.0.smithi032.stdout:8/781: rmdir d0/d1c/d5e/d67/dc3/db5/dd0 39 2024-05-06T21:26:46.104 INFO:tasks.workunit.client.0.smithi032.stdout:8/782: dread - d0/d1c/d5e/fcb zero size 2024-05-06T21:26:46.104 INFO:tasks.workunit.client.0.smithi032.stdout:8/783: write d0/d1c/d5e/d67/d7b/dab/fc8 [749698,104816] 0 2024-05-06T21:26:46.104 INFO:tasks.workunit.client.0.smithi032.stdout:8/784: read - d0/d1c/d5e/d67/dc3/d57/d5d/d63/fd5 zero size 2024-05-06T21:26:46.107 INFO:tasks.workunit.client.0.smithi032.stdout:9/666: mkdir d1/d2f/da1/dc2/d64/ddf 0 2024-05-06T21:26:46.107 INFO:tasks.workunit.client.0.smithi032.stdout:9/667: fdatasync d1/d2f/f3c 0 2024-05-06T21:26:46.107 INFO:tasks.workunit.client.1.smithi154.stdout:0/284: rename d6/dc/d44/l22 to d6/dc/d40/d4a/l56 0 2024-05-06T21:26:46.108 INFO:tasks.workunit.client.1.smithi154.stdout:0/285: creat d6/dc/d44/d36/f57 x:0 0 0 2024-05-06T21:26:46.108 INFO:tasks.workunit.client.1.smithi154.stdout:0/286: write d6/dc/d44/d36/f57 [856897,6261] 0 2024-05-06T21:26:46.109 INFO:tasks.workunit.client.0.smithi032.stdout:7/682: rename db/d12/d16/d2a/d39/l58 to db/d12/d16/d21/ld8 0 2024-05-06T21:26:46.109 INFO:tasks.workunit.client.1.smithi154.stdout:0/287: creat d6/dc/d39/f58 x:0 0 0 2024-05-06T21:26:46.109 INFO:tasks.workunit.client.1.smithi154.stdout:0/288: write d6/dc/f38 [763693,23914] 0 2024-05-06T21:26:46.110 INFO:tasks.workunit.client.0.smithi032.stdout:4/700: creat d2/d16/d44/d74/d79/d88/dd6/fde x:0 0 0 2024-05-06T21:26:46.110 INFO:tasks.workunit.client.0.smithi032.stdout:4/701: dread - d2/d2c/d31/d7c/fd4 zero size 2024-05-06T21:26:46.110 INFO:tasks.workunit.client.0.smithi032.stdout:4/702: dread - d2/d16/d44/d74/d7e/fd2 zero size 2024-05-06T21:26:46.111 INFO:tasks.workunit.client.0.smithi032.stdout:1/587: mknod db/d47/cbd 0 2024-05-06T21:26:46.111 INFO:tasks.workunit.client.0.smithi032.stdout:1/588: truncate db/d16/d46/d57/d58/f81 1039614 0 2024-05-06T21:26:46.111 INFO:tasks.workunit.client.0.smithi032.stdout:1/589: fdatasync db/d16/d46/d57/d58/f97 0 2024-05-06T21:26:46.111 INFO:tasks.workunit.client.0.smithi032.stdout:1/590: write db/d16/d46/f94 [166635,66896] 0 2024-05-06T21:26:46.112 INFO:tasks.workunit.client.0.smithi032.stdout:0/587: rename d4/da/d14/d4a/f7d to d4/da/d14/d1a/fb6 0 2024-05-06T21:26:46.112 INFO:tasks.workunit.client.0.smithi032.stdout:9/668: getdents d1/d2f/d4f 0 2024-05-06T21:26:46.113 INFO:tasks.workunit.client.1.smithi154.stdout:0/289: read d6/f15 [3154511,48998] 0 2024-05-06T21:26:46.113 INFO:tasks.workunit.client.0.smithi032.stdout:1/591: symlink db/d47/lbe 0 2024-05-06T21:26:46.115 INFO:tasks.workunit.client.0.smithi032.stdout:4/703: rename d2/d16/d44/d45/d4e/f90 to d2/d16/d44/d45/dc1/fdf 0 2024-05-06T21:26:46.115 INFO:tasks.workunit.client.1.smithi154.stdout:0/290: getdents d6/dc 0 2024-05-06T21:26:46.116 INFO:tasks.workunit.client.0.smithi032.stdout:0/588: creat d4/da/d16/d33/d9e/fb7 x:0 0 0 2024-05-06T21:26:46.118 INFO:tasks.workunit.client.0.smithi032.stdout:9/669: link d1/d13/d34/d26/f71 d1/d2f/da1/dc2/d64/ddf/fe0 0 2024-05-06T21:26:46.118 INFO:tasks.workunit.client.0.smithi032.stdout:9/670: chown d1/d2f/da1/dc2/d64/d72/l85 387 1 2024-05-06T21:26:46.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:45 smithi154 ceph-mon[32880]: pgmap v23: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 90 MiB/s rd, 112 MiB/s wr, 685 op/s 2024-05-06T21:26:46.119 INFO:tasks.workunit.client.0.smithi032.stdout:1/592: creat db/d16/db8/fbf x:0 0 0 2024-05-06T21:26:46.119 INFO:tasks.workunit.client.0.smithi032.stdout:1/593: readlink l3 0 2024-05-06T21:26:46.120 INFO:tasks.workunit.client.0.smithi032.stdout:0/589: creat d4/fb8 x:0 0 0 2024-05-06T21:26:46.120 INFO:tasks.workunit.client.1.smithi154.stdout:8/270: dwrite d3/d14/f19 [4194304,4194304] 0 2024-05-06T21:26:46.121 INFO:tasks.workunit.client.0.smithi032.stdout:8/785: dread d0/d1c/f24 [0,4194304] 0 2024-05-06T21:26:46.121 INFO:tasks.workunit.client.0.smithi032.stdout:0/590: truncate d4/da/d14/f2d 2050126 0 2024-05-06T21:26:46.122 INFO:tasks.workunit.client.0.smithi032.stdout:5/557: dwrite d0/d28/f75 [0,4194304] 0 2024-05-06T21:26:46.123 INFO:tasks.workunit.client.0.smithi032.stdout:0/591: symlink d4/da/d14/d1a/d66/d8a/lb9 0 2024-05-06T21:26:46.127 INFO:tasks.workunit.client.1.smithi154.stdout:3/356: dwrite d0/da/d1a/d28/d17/f4f [0,4194304] 0 2024-05-06T21:26:46.129 INFO:tasks.workunit.client.1.smithi154.stdout:6/212: dwrite d8/f23 [0,4194304] 0 2024-05-06T21:26:46.133 INFO:tasks.workunit.client.0.smithi032.stdout:5/558: unlink d0/d24/d26/d3d/l9d 0 2024-05-06T21:26:46.133 INFO:tasks.workunit.client.0.smithi032.stdout:0/592: rmdir d4/d3e/d63/d6c 39 2024-05-06T21:26:46.133 INFO:tasks.workunit.client.0.smithi032.stdout:0/593: creat d4/d3e/d63/d6c/d8f/fba x:0 0 0 2024-05-06T21:26:46.134 INFO:tasks.workunit.client.0.smithi032.stdout:5/559: link d0/d16/c84 d0/d16/d2a/d59/ca1 0 2024-05-06T21:26:46.135 INFO:tasks.workunit.client.1.smithi154.stdout:8/271: creat d3/d14/d1a/d29/d32/d33/f55 x:0 0 0 2024-05-06T21:26:46.135 INFO:tasks.workunit.client.0.smithi032.stdout:0/594: mknod d4/d96/cbb 0 2024-05-06T21:26:46.136 INFO:tasks.workunit.client.1.smithi154.stdout:2/265: dwrite db/de/d16/d33/f44 [0,4194304] 0 2024-05-06T21:26:46.137 INFO:tasks.workunit.client.1.smithi154.stdout:2/266: write db/de/d16/f1f [3770101,54311] 0 2024-05-06T21:26:46.137 INFO:tasks.workunit.client.1.smithi154.stdout:2/267: write db/de/d16/f1f [4570275,57941] 0 2024-05-06T21:26:46.137 INFO:tasks.workunit.client.1.smithi154.stdout:2/268: creat db/d12/d19/f56 x:0 0 0 2024-05-06T21:26:46.138 INFO:tasks.workunit.client.0.smithi032.stdout:5/560: mknod d0/d24/d26/d3d/ca2 0 2024-05-06T21:26:46.140 INFO:tasks.workunit.client.1.smithi154.stdout:3/357: mkdir d0/da/db/d52/d75 0 2024-05-06T21:26:46.141 INFO:tasks.workunit.client.1.smithi154.stdout:0/291: dread d6/dc/d44/f29 [0,4194304] 0 2024-05-06T21:26:46.142 INFO:tasks.workunit.client.0.smithi032.stdout:0/595: mkdir d4/da/d14/d1a/d66/dbc 0 2024-05-06T21:26:46.142 INFO:tasks.workunit.client.0.smithi032.stdout:0/596: readlink d4/da/d16/d33/d46/l9f 0 2024-05-06T21:26:46.144 INFO:tasks.workunit.client.0.smithi032.stdout:5/561: mkdir d0/d16/d2a/d59/d67/d73/da3 0 2024-05-06T21:26:46.149 INFO:tasks.workunit.client.0.smithi032.stdout:1/594: dread db/f2e [0,4194304] 0 2024-05-06T21:26:46.149 INFO:tasks.workunit.client.1.smithi154.stdout:6/213: mknod d8/d11/d2d/d3d/d4c/c4d 0 2024-05-06T21:26:46.149 INFO:tasks.workunit.client.1.smithi154.stdout:6/214: stat d8/d13 0 2024-05-06T21:26:46.151 INFO:tasks.workunit.client.0.smithi032.stdout:8/786: dread d0/d1c/d5e/d67/d7b/dab/fc8 [0,4194304] 0 2024-05-06T21:26:46.151 INFO:tasks.workunit.client.0.smithi032.stdout:8/787: truncate d0/d1c/d5e/d67/dc3/d57/d5d/d63/fe0 671789 0 2024-05-06T21:26:46.153 INFO:tasks.workunit.client.0.smithi032.stdout:7/683: dwrite db/d12/d16/d2a/f42 [0,4194304] 0 2024-05-06T21:26:46.155 INFO:tasks.workunit.client.0.smithi032.stdout:4/704: dwrite d2/d2c/d31/d7c/f32 [4194304,4194304] 0 2024-05-06T21:26:46.157 INFO:tasks.workunit.client.1.smithi154.stdout:2/269: mknod db/d12/d19/d4b/c57 0 2024-05-06T21:26:46.157 INFO:tasks.workunit.client.0.smithi032.stdout:0/597: dread d4/d3e/d63/d6c/f94 [0,4194304] 0 2024-05-06T21:26:46.158 INFO:tasks.workunit.client.0.smithi032.stdout:5/562: dread d0/f27 [0,4194304] 0 2024-05-06T21:26:46.159 INFO:tasks.workunit.client.1.smithi154.stdout:3/358: mkdir d0/da/d1a/d28/d2f/d38/d55/d76 0 2024-05-06T21:26:46.160 INFO:tasks.workunit.client.1.smithi154.stdout:0/292: creat d6/dc/d42/f59 x:0 0 0 2024-05-06T21:26:46.162 INFO:tasks.workunit.client.1.smithi154.stdout:4/258: sync 2024-05-06T21:26:46.163 INFO:tasks.workunit.client.0.smithi032.stdout:5/563: unlink d0/d28/l2d 0 2024-05-06T21:26:46.164 INFO:tasks.workunit.client.0.smithi032.stdout:8/788: dread d0/fa [0,4194304] 0 2024-05-06T21:26:46.166 INFO:tasks.workunit.client.1.smithi154.stdout:6/215: unlink d8/d13/c26 0 2024-05-06T21:26:46.167 INFO:tasks.workunit.client.1.smithi154.stdout:9/352: sync 2024-05-06T21:26:46.167 INFO:tasks.workunit.client.1.smithi154.stdout:6/216: fsync d8/d11/d2d/f2f 0 2024-05-06T21:26:46.167 INFO:tasks.workunit.client.1.smithi154.stdout:9/353: read - d5/d14/d31/f47 zero size 2024-05-06T21:26:46.168 INFO:tasks.workunit.client.1.smithi154.stdout:2/270: symlink db/de/d16/d33/l58 0 2024-05-06T21:26:46.171 INFO:tasks.workunit.client.1.smithi154.stdout:3/359: truncate d0/da/db/d30/f3d 981332 0 2024-05-06T21:26:46.171 INFO:tasks.workunit.client.1.smithi154.stdout:3/360: chown d0/d2/c1f 49966105 1 2024-05-06T21:26:46.171 INFO:tasks.workunit.client.1.smithi154.stdout:3/361: chown d0/da/db/dd/d1c/d21/d37/f4b 628059 1 2024-05-06T21:26:46.172 INFO:tasks.workunit.client.1.smithi154.stdout:0/293: symlink d6/dc/d44/d36/l5a 0 2024-05-06T21:26:46.172 INFO:tasks.workunit.client.1.smithi154.stdout:9/354: dread d5/f12 [0,4194304] 0 2024-05-06T21:26:46.173 INFO:tasks.workunit.client.1.smithi154.stdout:0/294: write d6/dc/d42/f59 [50850,859] 0 2024-05-06T21:26:46.174 INFO:tasks.workunit.client.0.smithi032.stdout:8/789: dread d0/d1c/d5e/d67/dc3/d57/d5d/faa [0,4194304] 0 2024-05-06T21:26:46.175 INFO:tasks.workunit.client.1.smithi154.stdout:8/272: dwrite d3/f8 [4194304,4194304] 0 2024-05-06T21:26:46.175 INFO:tasks.workunit.client.0.smithi032.stdout:2/546: sync 2024-05-06T21:26:46.175 INFO:tasks.workunit.client.0.smithi032.stdout:2/547: chown df 143 1 2024-05-06T21:26:46.176 INFO:tasks.workunit.client.1.smithi154.stdout:4/259: creat d0/d2/d29/f56 x:0 0 0 2024-05-06T21:26:46.176 INFO:tasks.workunit.client.1.smithi154.stdout:4/260: chown d0/d10/d11/d1a/d31/d39/c52 1351785 1 2024-05-06T21:26:46.176 INFO:tasks.workunit.client.1.smithi154.stdout:4/261: write d0/d2/f8 [665255,45521] 0 2024-05-06T21:26:46.176 INFO:tasks.workunit.client.1.smithi154.stdout:9/355: dread d5/d2e/d66/f77 [0,4194304] 0 2024-05-06T21:26:46.176 INFO:tasks.workunit.client.1.smithi154.stdout:9/356: read d5/d20/d52/f4f [470118,124820] 0 2024-05-06T21:26:46.176 INFO:tasks.workunit.client.1.smithi154.stdout:9/357: stat d5/l1f 0 2024-05-06T21:26:46.178 INFO:tasks.workunit.client.0.smithi032.stdout:2/548: unlink df/d19/d1e/d35/dc5/d2e/d33/f20 0 2024-05-06T21:26:46.180 INFO:tasks.workunit.client.0.smithi032.stdout:5/564: rmdir d0/d24 39 2024-05-06T21:26:46.180 INFO:tasks.workunit.client.0.smithi032.stdout:2/549: truncate df/d19/d1e/d71/d5f/d7d/d65/f85 1460928 0 2024-05-06T21:26:46.184 INFO:tasks.workunit.client.1.smithi154.stdout:4/262: mknod d0/d2/d2a/c57 0 2024-05-06T21:26:46.184 INFO:tasks.workunit.client.1.smithi154.stdout:4/263: fsync d0/d10/d11/f21 0 2024-05-06T21:26:46.184 INFO:tasks.workunit.client.1.smithi154.stdout:4/264: chown d0/c30 51 1 2024-05-06T21:26:46.185 INFO:tasks.workunit.client.1.smithi154.stdout:4/265: dread - d0/f3e zero size 2024-05-06T21:26:46.186 INFO:tasks.workunit.client.0.smithi032.stdout:5/565: dread d0/f27 [0,4194304] 0 2024-05-06T21:26:46.186 INFO:tasks.workunit.client.0.smithi032.stdout:5/566: fsync d0/d24/d38/f9c 0 2024-05-06T21:26:46.186 INFO:tasks.workunit.client.0.smithi032.stdout:1/595: dwrite db/d16/d46/d57/d58/f81 [0,4194304] 0 2024-05-06T21:26:46.186 INFO:tasks.workunit.client.0.smithi032.stdout:1/596: readlink db/d37/l3a 0 2024-05-06T21:26:46.186 INFO:tasks.workunit.client.0.smithi032.stdout:7/684: dwrite db/d12/d16/f72 [4194304,4194304] 0 2024-05-06T21:26:46.188 INFO:tasks.workunit.client.0.smithi032.stdout:4/705: dwrite d2/d16/f2e [0,4194304] 0 2024-05-06T21:26:46.189 INFO:tasks.workunit.client.1.smithi154.stdout:9/358: unlink d5/d20/c62 0 2024-05-06T21:26:46.189 INFO:tasks.workunit.client.1.smithi154.stdout:3/362: getdents d0/da/d1a/d28/d2f/d38/d55 0 2024-05-06T21:26:46.189 INFO:tasks.workunit.client.1.smithi154.stdout:3/363: fsync d0/da/d1a/d28/d2f/d38/d48/f65 0 2024-05-06T21:26:46.191 INFO:tasks.workunit.client.1.smithi154.stdout:4/266: symlink d0/d10/d11/d1a/d31/l58 0 2024-05-06T21:26:46.191 INFO:tasks.workunit.client.1.smithi154.stdout:4/267: fdatasync d0/d2/dc/f48 0 2024-05-06T21:26:46.193 INFO:tasks.workunit.client.0.smithi032.stdout:3/731: sync 2024-05-06T21:26:46.193 INFO:tasks.workunit.client.0.smithi032.stdout:6/697: sync 2024-05-06T21:26:46.194 INFO:tasks.workunit.client.1.smithi154.stdout:0/295: write f4 [6822942,19320] 0 2024-05-06T21:26:46.194 INFO:tasks.workunit.client.1.smithi154.stdout:0/296: fdatasync d6/dc/d44/f11 0 2024-05-06T21:26:46.194 INFO:tasks.workunit.client.1.smithi154.stdout:0/297: write d6/dc/d44/f11 [1552557,81516] 0 2024-05-06T21:26:46.194 INFO:tasks.workunit.client.1.smithi154.stdout:9/359: creat d5/d20/d52/d59/f80 x:0 0 0 2024-05-06T21:26:46.194 INFO:tasks.workunit.client.1.smithi154.stdout:8/273: dread d3/fd [0,4194304] 0 2024-05-06T21:26:46.195 INFO:tasks.workunit.client.0.smithi032.stdout:8/790: dwrite d0/d1c/d5e/d67/dc3/d57/d5d/d63/fe0 [0,4194304] 0 2024-05-06T21:26:46.196 INFO:tasks.workunit.client.0.smithi032.stdout:1/597: getdents db/d16/d46/d57/d58 0 2024-05-06T21:26:46.196 INFO:tasks.workunit.client.0.smithi032.stdout:1/598: fsync db/d37/d52/f85 0 2024-05-06T21:26:46.197 INFO:tasks.workunit.client.1.smithi154.stdout:3/364: link d0/d2/f6f d0/da/d1a/d28/d2f/d38/d55/f77 0 2024-05-06T21:26:46.197 INFO:tasks.workunit.client.0.smithi032.stdout:7/685: mknod db/d12/d16/d21/cd9 0 2024-05-06T21:26:46.198 INFO:tasks.workunit.client.1.smithi154.stdout:4/268: mknod d0/d10/d11/d1a/d50/c59 0 2024-05-06T21:26:46.203 INFO:tasks.workunit.client.0.smithi032.stdout:3/732: write d1/d4/da/d4e/d41/d45/f7e [3255248,91449] 0 2024-05-06T21:26:46.203 INFO:tasks.workunit.client.0.smithi032.stdout:3/733: write d1/d4/da/d4e/d41/d43/fbb [686352,113043] 0 2024-05-06T21:26:46.203 INFO:tasks.workunit.client.0.smithi032.stdout:8/791: truncate d0/d1b/d39/f48 1379886 0 2024-05-06T21:26:46.203 INFO:tasks.workunit.client.1.smithi154.stdout:0/298: mknod d6/dc/d42/c5b 0 2024-05-06T21:26:46.204 INFO:tasks.workunit.client.1.smithi154.stdout:0/299: chown d6/dc/d51 7529 1 2024-05-06T21:26:46.204 INFO:tasks.workunit.client.1.smithi154.stdout:0/300: chown d6/l18 333572658 1 2024-05-06T21:26:46.204 INFO:tasks.workunit.client.1.smithi154.stdout:9/360: truncate d5/d14/d31/f5e 538738 0 2024-05-06T21:26:46.205 INFO:tasks.workunit.client.1.smithi154.stdout:9/361: write d5/d14/d31/f40 [5181600,126633] 0 2024-05-06T21:26:46.205 INFO:tasks.workunit.client.0.smithi032.stdout:5/567: dwrite d0/d24/d34/f92 [0,4194304] 0 2024-05-06T21:26:46.206 INFO:tasks.workunit.client.1.smithi154.stdout:8/274: mkdir d3/d56 0 2024-05-06T21:26:46.207 INFO:tasks.workunit.client.1.smithi154.stdout:2/271: dwrite db/d12/f21 [0,4194304] 0 2024-05-06T21:26:46.207 INFO:tasks.workunit.client.1.smithi154.stdout:3/365: mknod d0/da/db/d52/d62/c78 0 2024-05-06T21:26:46.208 INFO:tasks.workunit.client.0.smithi032.stdout:6/698: dread d8/dd/d18/d3b/db9/f65 [0,4194304] 0 2024-05-06T21:26:46.209 INFO:tasks.workunit.client.1.smithi154.stdout:4/269: symlink d0/d2/d29/l5a 0 2024-05-06T21:26:46.210 INFO:tasks.workunit.client.1.smithi154.stdout:4/270: write d0/d2/f4c [154559,36422] 0 2024-05-06T21:26:46.210 INFO:tasks.workunit.client.1.smithi154.stdout:4/271: dread - d0/d10/d11/f46 zero size 2024-05-06T21:26:46.210 INFO:tasks.workunit.client.0.smithi032.stdout:2/550: rename df/d19/d1e/d35/d3f/d46 to df/d19/d1e/d42/dc6 0 2024-05-06T21:26:46.212 INFO:tasks.workunit.client.1.smithi154.stdout:1/299: sync 2024-05-06T21:26:46.212 INFO:tasks.workunit.client.1.smithi154.stdout:5/273: sync 2024-05-06T21:26:46.213 INFO:tasks.workunit.client.1.smithi154.stdout:3/366: dread d0/da/d1a/f68 [0,4194304] 0 2024-05-06T21:26:46.215 INFO:tasks.workunit.client.1.smithi154.stdout:3/367: write d0/da/d1a/f44 [155572,100543] 0 2024-05-06T21:26:46.215 INFO:tasks.workunit.client.1.smithi154.stdout:3/368: truncate d0/da/f70 273426 0 2024-05-06T21:26:46.215 INFO:tasks.workunit.client.0.smithi032.stdout:6/699: dread d8/d33/f72 [0,4194304] 0 2024-05-06T21:26:46.215 INFO:tasks.workunit.client.0.smithi032.stdout:6/700: stat d8/dd/d18/d3b/d90 0 2024-05-06T21:26:46.216 INFO:tasks.workunit.client.1.smithi154.stdout:8/275: symlink d3/d14/l57 0 2024-05-06T21:26:46.216 INFO:tasks.workunit.client.1.smithi154.stdout:8/276: stat d3/c1f 0 2024-05-06T21:26:46.216 INFO:tasks.workunit.client.1.smithi154.stdout:2/272: symlink db/de/d16/d4f/l59 0 2024-05-06T21:26:46.218 INFO:tasks.workunit.client.1.smithi154.stdout:5/274: mknod d2/d48/c5e 0 2024-05-06T21:26:46.218 INFO:tasks.workunit.client.1.smithi154.stdout:2/273: creat db/de/d10/d18/f5a x:0 0 0 2024-05-06T21:26:46.219 INFO:tasks.workunit.client.1.smithi154.stdout:0/301: dread d6/dc/d44/d36/f4d [0,4194304] 0 2024-05-06T21:26:46.220 INFO:tasks.workunit.client.1.smithi154.stdout:9/362: dread d5/d14/d31/d39/f68 [0,4194304] 0 2024-05-06T21:26:46.221 INFO:tasks.workunit.client.1.smithi154.stdout:0/302: mknod d6/dc/d40/d41/c5c 0 2024-05-06T21:26:46.221 INFO:tasks.workunit.client.0.smithi032.stdout:3/734: unlink d1/d4/fe3 0 2024-05-06T21:26:46.221 INFO:tasks.workunit.client.1.smithi154.stdout:0/303: rename d6 to d6/dc/d40/d5d 22 2024-05-06T21:26:46.221 INFO:tasks.workunit.client.1.smithi154.stdout:0/304: fsync d6/dc/d44/d36/f4e 0 2024-05-06T21:26:46.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:45 smithi032 ceph-mon[27179]: pgmap v23: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 90 MiB/s rd, 112 MiB/s wr, 685 op/s 2024-05-06T21:26:46.224 INFO:tasks.workunit.client.0.smithi032.stdout:8/792: creat d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/ff3 x:0 0 0 2024-05-06T21:26:46.226 INFO:tasks.workunit.client.1.smithi154.stdout:5/275: dread d2/d3/d21/d22/d25/f32 [0,4194304] 0 2024-05-06T21:26:46.226 INFO:tasks.workunit.client.0.smithi032.stdout:1/599: dwrite db/d16/d5d/f7d [0,4194304] 0 2024-05-06T21:26:46.227 INFO:tasks.workunit.client.0.smithi032.stdout:1/600: chown db/d37/d93/l90 3434 1 2024-05-06T21:26:46.229 INFO:tasks.workunit.client.0.smithi032.stdout:5/568: creat d0/d24/d34/fa4 x:0 0 0 2024-05-06T21:26:46.229 INFO:tasks.workunit.client.0.smithi032.stdout:5/569: fdatasync d0/d24/d34/f45 0 2024-05-06T21:26:46.232 INFO:tasks.workunit.client.0.smithi032.stdout:2/551: mkdir df/d19/d1e/d42/dc6/dc1/dc7 0 2024-05-06T21:26:46.232 INFO:tasks.workunit.client.1.smithi154.stdout:0/305: read d6/dc/d44/d36/f57 [203,124746] 0 2024-05-06T21:26:46.233 INFO:tasks.workunit.client.0.smithi032.stdout:2/552: fdatasync df/d19/d1e/f99 0 2024-05-06T21:26:46.233 INFO:tasks.workunit.client.1.smithi154.stdout:5/276: creat d2/d6/f5f x:0 0 0 2024-05-06T21:26:46.233 INFO:tasks.workunit.client.1.smithi154.stdout:5/277: write d2/f1a [4060027,40457] 0 2024-05-06T21:26:46.234 INFO:tasks.workunit.client.1.smithi154.stdout:0/306: truncate d6/f3a 153953 0 2024-05-06T21:26:46.235 INFO:tasks.workunit.client.0.smithi032.stdout:6/701: mknod d8/d3d/d8f/cd1 0 2024-05-06T21:26:46.235 INFO:tasks.workunit.client.0.smithi032.stdout:6/702: chown d8/dd/d1b/d35/c51 187 1 2024-05-06T21:26:46.238 INFO:tasks.workunit.client.0.smithi032.stdout:3/735: truncate d1/d4/da/d4e/d41/d97/d67/da6/f99 135799 0 2024-05-06T21:26:46.239 INFO:tasks.workunit.client.1.smithi154.stdout:2/274: dread db/de/d16/d33/f4d [4194304,4194304] 0 2024-05-06T21:26:46.241 INFO:tasks.workunit.client.1.smithi154.stdout:0/307: mkdir d6/dc/d40/d5e 0 2024-05-06T21:26:46.243 INFO:tasks.workunit.client.0.smithi032.stdout:1/601: rename db/d47/cad to db/d47/d4a/da4/cc0 0 2024-05-06T21:26:46.243 INFO:tasks.workunit.client.0.smithi032.stdout:1/602: fdatasync db/f29 0 2024-05-06T21:26:46.244 INFO:tasks.workunit.client.1.smithi154.stdout:2/275: mknod db/d12/d4e/d55/c5b 0 2024-05-06T21:26:46.244 INFO:tasks.workunit.client.1.smithi154.stdout:5/278: fdatasync d2/f1a 0 2024-05-06T21:26:46.244 INFO:tasks.workunit.client.1.smithi154.stdout:4/272: dwrite d0/d10/f38 [0,4194304] 0 2024-05-06T21:26:46.245 INFO:tasks.workunit.client.1.smithi154.stdout:3/369: dwrite d0/d2/d22/f47 [0,4194304] 0 2024-05-06T21:26:46.246 INFO:tasks.workunit.client.0.smithi032.stdout:6/703: truncate d8/dd/f12 170572 0 2024-05-06T21:26:46.246 INFO:tasks.workunit.client.0.smithi032.stdout:6/704: chown d8/d3d/d8f/fc7 24970 1 2024-05-06T21:26:46.246 INFO:tasks.workunit.client.1.smithi154.stdout:0/308: mknod d6/dc/d44/c5f 0 2024-05-06T21:26:46.247 INFO:tasks.workunit.client.0.smithi032.stdout:3/736: symlink d1/d4/da/d4e/d41/lfe 0 2024-05-06T21:26:46.247 INFO:tasks.workunit.client.0.smithi032.stdout:3/737: chown d1/d4/da/d31/d47/c72 10090 1 2024-05-06T21:26:46.247 INFO:tasks.workunit.client.0.smithi032.stdout:3/738: write d1/d4/da/d31/d9b/f9e [4540047,124498] 0 2024-05-06T21:26:46.248 INFO:tasks.workunit.client.0.smithi032.stdout:1/603: link db/d16/l36 db/d16/da3/lc1 0 2024-05-06T21:26:46.249 INFO:tasks.workunit.client.1.smithi154.stdout:2/276: creat db/de/d16/d4f/d4c/f5c x:0 0 0 2024-05-06T21:26:46.249 INFO:tasks.workunit.client.1.smithi154.stdout:2/277: truncate db/d12/d19/f54 192024 0 2024-05-06T21:26:46.250 INFO:tasks.workunit.client.1.smithi154.stdout:5/279: rmdir d2/d3/d21 39 2024-05-06T21:26:46.250 INFO:tasks.workunit.client.1.smithi154.stdout:5/280: read - d2/d6/dd/d2a/d54/f5c zero size 2024-05-06T21:26:46.250 INFO:tasks.workunit.client.0.smithi032.stdout:5/570: getdents d0/d16/d2f/d77 0 2024-05-06T21:26:46.251 INFO:tasks.workunit.client.0.smithi032.stdout:5/571: readlink d0/d16/d2a/d59/l74 0 2024-05-06T21:26:46.253 INFO:tasks.workunit.client.1.smithi154.stdout:4/273: mknod d0/d10/d11/c5b 0 2024-05-06T21:26:46.253 INFO:tasks.workunit.client.1.smithi154.stdout:4/274: creat d0/d2/dc/f5c x:0 0 0 2024-05-06T21:26:46.256 INFO:tasks.workunit.client.1.smithi154.stdout:0/309: mknod d6/dc/c60 0 2024-05-06T21:26:46.256 INFO:tasks.workunit.client.1.smithi154.stdout:2/278: creat db/de/f5d x:0 0 0 2024-05-06T21:26:46.257 INFO:tasks.workunit.client.1.smithi154.stdout:5/281: truncate d2/d6/dd/f18 3012088 0 2024-05-06T21:26:46.257 INFO:tasks.workunit.client.0.smithi032.stdout:3/739: rmdir d1/d4/da/d4e/d41 39 2024-05-06T21:26:46.257 INFO:tasks.workunit.client.0.smithi032.stdout:3/740: readlink d1/d4/da/d4e/d41/d97/ldf 0 2024-05-06T21:26:46.258 INFO:tasks.workunit.client.1.smithi154.stdout:3/370: dread d0/da/d1a/d28/d2f/f34 [0,4194304] 0 2024-05-06T21:26:46.258 INFO:tasks.workunit.client.1.smithi154.stdout:4/275: rename d0/d10/l24 to d0/d10/d11/d1a/d31/d39/l5d 0 2024-05-06T21:26:46.258 INFO:tasks.workunit.client.1.smithi154.stdout:4/276: truncate d0/d2/f2f 2040315 0 2024-05-06T21:26:46.260 INFO:tasks.workunit.client.1.smithi154.stdout:5/282: unlink d2/d6/dd/l4d 0 2024-05-06T21:26:46.260 INFO:tasks.workunit.client.1.smithi154.stdout:5/283: write d2/d6/f13 [4318415,25163] 0 2024-05-06T21:26:46.261 INFO:tasks.workunit.client.0.smithi032.stdout:1/604: dread db/f23 [0,4194304] 0 2024-05-06T21:26:46.261 INFO:tasks.workunit.client.0.smithi032.stdout:1/605: write db/d16/d46/d57/d58/f97 [1008406,106932] 0 2024-05-06T21:26:46.261 INFO:tasks.workunit.client.0.smithi032.stdout:1/606: write db/d47/d4a/da4/fb5 [853969,104625] 0 2024-05-06T21:26:46.262 INFO:tasks.workunit.client.1.smithi154.stdout:3/371: creat d0/da/db/dd/d1c/d41/f79 x:0 0 0 2024-05-06T21:26:46.262 INFO:tasks.workunit.client.1.smithi154.stdout:3/372: fdatasync d0/da/d1a/d28/f5b 0 2024-05-06T21:26:46.262 INFO:tasks.workunit.client.0.smithi032.stdout:5/572: creat d0/d16/d79/fa5 x:0 0 0 2024-05-06T21:26:46.263 INFO:tasks.workunit.client.1.smithi154.stdout:4/277: creat d0/d10/d11/d1a/d31/f5e x:0 0 0 2024-05-06T21:26:46.264 INFO:tasks.workunit.client.0.smithi032.stdout:7/686: truncate db/d12/d16/f72 2882141 0 2024-05-06T21:26:46.264 INFO:tasks.workunit.client.0.smithi032.stdout:7/687: write db/d12/d87/fb1 [220375,20784] 0 2024-05-06T21:26:46.265 INFO:tasks.workunit.client.1.smithi154.stdout:2/279: rename db/f2d to db/d12/d4e/d55/f5e 0 2024-05-06T21:26:46.265 INFO:tasks.workunit.client.0.smithi032.stdout:5/573: mkdir d0/d24/d38/d37/da6 0 2024-05-06T21:26:46.265 INFO:tasks.workunit.client.0.smithi032.stdout:5/574: dread - d0/d24/f7e zero size 2024-05-06T21:26:46.265 INFO:tasks.workunit.client.0.smithi032.stdout:8/793: dwrite d0/d1c/d5e/d67/dc3/f62 [8388608,4194304] 0 2024-05-06T21:26:46.267 INFO:tasks.workunit.client.0.smithi032.stdout:8/794: dread d0/d1b/d47/d91/da7/fba [0,4194304] 0 2024-05-06T21:26:46.267 INFO:tasks.workunit.client.0.smithi032.stdout:7/688: rename db/d12/d49/fc4 to db/d12/d16/d2a/d39/d8b/fda 0 2024-05-06T21:26:46.267 INFO:tasks.workunit.client.1.smithi154.stdout:3/373: creat d0/da/d1a/d28/d2f/d38/d55/f7a x:0 0 0 2024-05-06T21:26:46.267 INFO:tasks.workunit.client.1.smithi154.stdout:4/278: rmdir d0 39 2024-05-06T21:26:46.268 INFO:tasks.workunit.client.0.smithi032.stdout:5/575: mknod d0/d24/d38/ca7 0 2024-05-06T21:26:46.269 INFO:tasks.workunit.client.1.smithi154.stdout:2/280: creat db/de/d10/f5f x:0 0 0 2024-05-06T21:26:46.270 INFO:tasks.workunit.client.0.smithi032.stdout:8/795: unlink d0/d1b/d39/f96 0 2024-05-06T21:26:46.271 INFO:tasks.workunit.client.1.smithi154.stdout:3/374: creat d0/da/db/d52/d75/f7b x:0 0 0 2024-05-06T21:26:46.272 INFO:tasks.workunit.client.0.smithi032.stdout:3/741: dread d1/d4/da/d4e/d5e/d84/df2/fc7 [0,4194304] 0 2024-05-06T21:26:46.272 INFO:tasks.workunit.client.0.smithi032.stdout:7/689: rename db/d12/d16/d21/l9e to db/d12/d16/d2a/d39/d3b/d9c/ldb 0 2024-05-06T21:26:46.272 INFO:tasks.workunit.client.0.smithi032.stdout:7/690: getdents db/d12/d87/db5 0 2024-05-06T21:26:46.273 INFO:tasks.workunit.client.0.smithi032.stdout:5/576: mknod d0/d16/d46/d78/ca8 0 2024-05-06T21:26:46.273 INFO:tasks.workunit.client.1.smithi154.stdout:4/279: unlink d0/d10/d11/d1a/d31/d3d/l4e 0 2024-05-06T21:26:46.273 INFO:tasks.workunit.client.1.smithi154.stdout:3/375: mkdir d0/da/db/d7c 0 2024-05-06T21:26:46.274 INFO:tasks.workunit.client.1.smithi154.stdout:4/280: creat d0/d2/d2a/f5f x:0 0 0 2024-05-06T21:26:46.274 INFO:tasks.workunit.client.1.smithi154.stdout:4/281: fdatasync d0/f23 0 2024-05-06T21:26:46.274 INFO:tasks.workunit.client.1.smithi154.stdout:4/282: fdatasync d0/d2/f53 0 2024-05-06T21:26:46.275 INFO:tasks.workunit.client.1.smithi154.stdout:3/376: mknod d0/da/d1a/d28/d4d/c7d 0 2024-05-06T21:26:46.275 INFO:tasks.workunit.client.1.smithi154.stdout:4/283: write d0/d2/f4c [18749,49991] 0 2024-05-06T21:26:46.275 INFO:tasks.workunit.client.1.smithi154.stdout:4/284: stat d0/d10/d11/d1a/d31/d3d 0 2024-05-06T21:26:46.276 INFO:tasks.workunit.client.0.smithi032.stdout:8/796: rename d0/f4b to d0/d1c/d5e/d67/ff4 0 2024-05-06T21:26:46.277 INFO:tasks.workunit.client.1.smithi154.stdout:3/377: link d0/da/db/dd/l20 d0/da/d1a/d28/d17/l7e 0 2024-05-06T21:26:46.278 INFO:tasks.workunit.client.1.smithi154.stdout:3/378: rmdir d0/d2/d22 39 2024-05-06T21:26:46.280 INFO:tasks.workunit.client.0.smithi032.stdout:7/691: symlink db/d12/d16/d21/d41/d78/ldc 0 2024-05-06T21:26:46.283 INFO:tasks.workunit.client.0.smithi032.stdout:5/577: mkdir d0/d16/d46/da9 0 2024-05-06T21:26:46.284 INFO:tasks.workunit.client.0.smithi032.stdout:5/578: chown d0/d16/d46/d78 109 1 2024-05-06T21:26:46.284 INFO:tasks.workunit.client.0.smithi032.stdout:6/705: write d8/dd/f12 [193861,53323] 0 2024-05-06T21:26:46.284 INFO:tasks.workunit.client.1.smithi154.stdout:0/310: dread d6/dc/d44/f46 [0,4194304] 0 2024-05-06T21:26:46.285 INFO:tasks.workunit.client.0.smithi032.stdout:8/797: mknod d0/d1b/d47/d91/da7/dc1/cf5 0 2024-05-06T21:26:46.286 INFO:tasks.workunit.client.1.smithi154.stdout:0/311: creat d6/dc/f61 x:0 0 0 2024-05-06T21:26:46.286 INFO:tasks.workunit.client.1.smithi154.stdout:0/312: chown d6/dc/d42/f59 61681221 1 2024-05-06T21:26:46.286 INFO:tasks.workunit.client.1.smithi154.stdout:0/313: chown d6/dc/d40/d41 1387 1 2024-05-06T21:26:46.286 INFO:tasks.workunit.client.1.smithi154.stdout:0/314: write d6/dc/d44/d36/f57 [819285,55357] 0 2024-05-06T21:26:46.287 INFO:tasks.workunit.client.0.smithi032.stdout:7/692: mknod db/d12/d16/d21/cdd 0 2024-05-06T21:26:46.288 INFO:tasks.workunit.client.0.smithi032.stdout:5/579: link d0/d24/d26/d3d/d50/d5a/l6d d0/d16/d46/da9/laa 0 2024-05-06T21:26:46.288 INFO:tasks.workunit.client.0.smithi032.stdout:6/706: truncate d8/d3d/d8f/f78 2833650 0 2024-05-06T21:26:46.288 INFO:tasks.workunit.client.0.smithi032.stdout:1/607: dread db/d37/d52/f85 [0,4194304] 0 2024-05-06T21:26:46.288 INFO:tasks.workunit.client.0.smithi032.stdout:6/707: chown d8/d3d/d49/dad 3036043 1 2024-05-06T21:26:46.290 INFO:tasks.workunit.client.0.smithi032.stdout:8/798: unlink d0/d1b/f70 0 2024-05-06T21:26:46.290 INFO:tasks.workunit.client.1.smithi154.stdout:0/315: fsync d6/f3a 0 2024-05-06T21:26:46.290 INFO:tasks.workunit.client.1.smithi154.stdout:0/316: creat d6/dc/d44/d36/f62 x:0 0 0 2024-05-06T21:26:46.290 INFO:tasks.workunit.client.1.smithi154.stdout:0/317: write d6/dc/d39/f58 [897164,7510] 0 2024-05-06T21:26:46.291 INFO:tasks.workunit.client.0.smithi032.stdout:5/580: rename d0/d24/d34/l81 to d0/d28/lab 0 2024-05-06T21:26:46.293 INFO:tasks.workunit.client.0.smithi032.stdout:6/708: unlink d8/d3d/d49/d6b/ca4 0 2024-05-06T21:26:46.294 INFO:tasks.workunit.client.0.smithi032.stdout:1/608: mknod db/d16/d46/da1/cc2 0 2024-05-06T21:26:46.295 INFO:tasks.workunit.client.0.smithi032.stdout:1/609: dread db/d16/f75 [0,4194304] 0 2024-05-06T21:26:46.296 INFO:tasks.workunit.client.0.smithi032.stdout:8/799: creat d0/d1c/d5e/d67/d7b/ff6 x:0 0 0 2024-05-06T21:26:46.297 INFO:tasks.workunit.client.1.smithi154.stdout:9/363: dwrite d5/f1a [0,4194304] 0 2024-05-06T21:26:46.300 INFO:tasks.workunit.client.1.smithi154.stdout:1/300: dwrite d6/db/d10/d15/f39 [0,4194304] 0 2024-05-06T21:26:46.301 INFO:tasks.workunit.client.0.smithi032.stdout:5/581: mknod d0/d16/d2a/d5f/d9a/cac 0 2024-05-06T21:26:46.301 INFO:tasks.workunit.client.0.smithi032.stdout:1/610: chown db/d37/c45 121 1 2024-05-06T21:26:46.301 INFO:tasks.workunit.client.0.smithi032.stdout:1/611: stat db/d47/d4a/da4/f4d 0 2024-05-06T21:26:46.301 INFO:tasks.workunit.client.0.smithi032.stdout:4/706: dwrite d2/f11 [0,4194304] 0 2024-05-06T21:26:46.301 INFO:tasks.workunit.client.0.smithi032.stdout:5/582: write d0/d16/d2a/d59/f5b [573795,70845] 0 2024-05-06T21:26:46.303 INFO:tasks.workunit.client.0.smithi032.stdout:2/553: dwrite df/d19/d1e/d35/f6d [0,4194304] 0 2024-05-06T21:26:46.304 INFO:tasks.workunit.client.0.smithi032.stdout:3/742: dwrite d1/d4/da/d31/d47/d4a/d68/d7c/fe0 [0,4194304] 0 2024-05-06T21:26:46.304 INFO:tasks.workunit.client.0.smithi032.stdout:3/743: truncate d1/d4/da/d4e/d41/d97/d67/f7b 4272825 0 2024-05-06T21:26:46.305 INFO:tasks.workunit.client.0.smithi032.stdout:3/744: fdatasync d1/d4/f7a 0 2024-05-06T21:26:46.305 INFO:tasks.workunit.client.0.smithi032.stdout:3/745: chown d1/d4/da/d4e/d41/d97/d67/f7b 2476 1 2024-05-06T21:26:46.305 INFO:tasks.workunit.client.0.smithi032.stdout:8/800: link d0/d1b/d39/lb7 d0/d1c/d5e/d67/dc3/db5/dd0/lf7 0 2024-05-06T21:26:46.305 INFO:tasks.workunit.client.1.smithi154.stdout:1/301: rename d6/db/d10/d15/d1d/f5d to d6/db/d10/d15/f60 0 2024-05-06T21:26:46.305 INFO:tasks.workunit.client.1.smithi154.stdout:1/302: chown d6/db/c4e 13 1 2024-05-06T21:26:46.305 INFO:tasks.workunit.client.1.smithi154.stdout:1/303: truncate d6/f24 2075392 0 2024-05-06T21:26:46.306 INFO:tasks.workunit.client.1.smithi154.stdout:1/304: truncate d6/db/d10/f51 1699188 0 2024-05-06T21:26:46.306 INFO:tasks.workunit.client.0.smithi032.stdout:7/693: dread db/d12/d49/f6f [0,4194304] 0 2024-05-06T21:26:46.311 INFO:tasks.workunit.client.0.smithi032.stdout:4/707: mkdir d2/d16/d44/d74/d79/de0 0 2024-05-06T21:26:46.313 INFO:tasks.workunit.client.0.smithi032.stdout:5/583: mkdir d0/d28/dad 0 2024-05-06T21:26:46.319 INFO:tasks.workunit.client.0.smithi032.stdout:3/746: mkdir d1/d4/da/d4e/d41/de7/dff 0 2024-05-06T21:26:46.321 INFO:tasks.workunit.client.0.smithi032.stdout:8/801: link d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/ce2 d0/d1b/d39/cf8 0 2024-05-06T21:26:46.322 INFO:tasks.workunit.client.0.smithi032.stdout:8/802: fdatasync d0/d1c/d5e/f7a 0 2024-05-06T21:26:46.322 INFO:tasks.workunit.client.0.smithi032.stdout:8/803: read d0/f19 [3794798,35076] 0 2024-05-06T21:26:46.324 INFO:tasks.workunit.client.1.smithi154.stdout:9/364: dread d5/d14/d31/f40 [0,4194304] 0 2024-05-06T21:26:46.324 INFO:tasks.workunit.client.1.smithi154.stdout:9/365: truncate d5/d14/d31/f5e 1024008 0 2024-05-06T21:26:46.324 INFO:tasks.workunit.client.1.smithi154.stdout:9/366: creat d5/d20/f81 x:0 0 0 2024-05-06T21:26:46.324 INFO:tasks.workunit.client.1.smithi154.stdout:9/367: dread - d5/d14/f43 zero size 2024-05-06T21:26:46.324 INFO:tasks.workunit.client.0.smithi032.stdout:7/694: link db/d12/d16/fc1 db/d12/d16/d21/fde 0 2024-05-06T21:26:46.324 INFO:tasks.workunit.client.0.smithi032.stdout:1/612: write db/f27 [697110,116837] 0 2024-05-06T21:26:46.325 INFO:tasks.workunit.client.0.smithi032.stdout:5/584: creat d0/d16/d46/fae x:0 0 0 2024-05-06T21:26:46.328 INFO:tasks.workunit.client.1.smithi154.stdout:0/318: dwrite d6/f15 [0,4194304] 0 2024-05-06T21:26:46.328 INFO:tasks.workunit.client.1.smithi154.stdout:0/319: stat d6/l49 0 2024-05-06T21:26:46.328 INFO:tasks.workunit.client.0.smithi032.stdout:4/708: rename d2/f18 to d2/d13/daa/fe1 0 2024-05-06T21:26:46.329 INFO:tasks.workunit.client.0.smithi032.stdout:6/709: dwrite d8/dd/d1b/d35/f43 [4194304,4194304] 0 2024-05-06T21:26:46.330 INFO:tasks.workunit.client.1.smithi154.stdout:5/284: dwrite d2/d6/f13 [4194304,4194304] 0 2024-05-06T21:26:46.331 INFO:tasks.workunit.client.0.smithi032.stdout:5/585: unlink d0/d16/d2a/d59/d67/d73/l64 0 2024-05-06T21:26:46.331 INFO:tasks.workunit.client.0.smithi032.stdout:4/709: symlink d2/d1e/le2 0 2024-05-06T21:26:46.334 INFO:tasks.workunit.client.1.smithi154.stdout:9/368: unlink d5/d14/f54 0 2024-05-06T21:26:46.334 INFO:tasks.workunit.client.1.smithi154.stdout:3/379: rmdir d0/da 39 2024-05-06T21:26:46.334 INFO:tasks.workunit.client.1.smithi154.stdout:3/380: dread - d0/da/d1a/d28/d2f/d38/f74 zero size 2024-05-06T21:26:46.334 INFO:tasks.workunit.client.1.smithi154.stdout:3/381: dread - d0/da/d1a/d28/d17/f63 zero size 2024-05-06T21:26:46.335 INFO:tasks.workunit.client.1.smithi154.stdout:9/369: dread d5/d14/d31/d39/f3c [0,4194304] 0 2024-05-06T21:26:46.335 INFO:tasks.workunit.client.1.smithi154.stdout:9/370: chown d5/f1a 22420302 1 2024-05-06T21:26:46.337 INFO:tasks.workunit.client.0.smithi032.stdout:8/804: write d0/d1b/d47/d91/da7/fef [2459041,119697] 0 2024-05-06T21:26:46.337 INFO:tasks.workunit.client.0.smithi032.stdout:6/710: mknod d8/d3d/d49/dad/cd2 0 2024-05-06T21:26:46.337 INFO:tasks.workunit.client.0.smithi032.stdout:6/711: write d8/dd/d18/d22/f6d [2083196,112356] 0 2024-05-06T21:26:46.339 INFO:tasks.workunit.client.1.smithi154.stdout:5/285: creat d2/d3/d21/f60 x:0 0 0 2024-05-06T21:26:46.339 INFO:tasks.workunit.client.1.smithi154.stdout:5/286: dread - d2/d3/d21/d22/f2e zero size 2024-05-06T21:26:46.339 INFO:tasks.workunit.client.1.smithi154.stdout:5/287: fdatasync d2/d3/fa 0 2024-05-06T21:26:46.339 INFO:tasks.workunit.client.1.smithi154.stdout:5/288: creat d2/d6/f61 x:0 0 0 2024-05-06T21:26:46.342 INFO:tasks.workunit.client.0.smithi032.stdout:7/695: dwrite db/d12/f51 [0,4194304] 0 2024-05-06T21:26:46.344 INFO:tasks.workunit.client.1.smithi154.stdout:1/305: dwrite d6/f52 [0,4194304] 0 2024-05-06T21:26:46.344 INFO:tasks.workunit.client.0.smithi032.stdout:8/805: read d0/fa [1094807,78713] 0 2024-05-06T21:26:46.345 INFO:tasks.workunit.client.0.smithi032.stdout:5/586: mknod d0/d24/d26/d3d/d50/d5a/caf 0 2024-05-06T21:26:46.346 INFO:tasks.workunit.client.0.smithi032.stdout:4/710: rmdir d2/d16/d44/d54/d69 39 2024-05-06T21:26:46.347 INFO:tasks.workunit.client.0.smithi032.stdout:5/587: read d0/d16/f85 [226408,37412] 0 2024-05-06T21:26:46.348 INFO:tasks.workunit.client.0.smithi032.stdout:1/613: rename db/d37/l3d to db/d16/d46/d55/lc3 0 2024-05-06T21:26:46.350 INFO:tasks.workunit.client.1.smithi154.stdout:3/382: link d0/da/db/dd/d1c/d41/l5c d0/da/db/dd/d1c/d21/l7f 0 2024-05-06T21:26:46.350 INFO:tasks.workunit.client.1.smithi154.stdout:3/383: fdatasync d0/da/db/dd/fc 0 2024-05-06T21:26:46.354 INFO:tasks.workunit.client.1.smithi154.stdout:9/371: unlink d5/d20/d37/f50 0 2024-05-06T21:26:46.354 INFO:tasks.workunit.client.1.smithi154.stdout:0/320: dwrite d6/dc/f16 [0,4194304] 0 2024-05-06T21:26:46.354 INFO:tasks.workunit.client.1.smithi154.stdout:9/372: dread - d5/d14/d31/f47 zero size 2024-05-06T21:26:46.357 INFO:tasks.workunit.client.0.smithi032.stdout:6/712: creat d8/dd/fd3 x:0 0 0 2024-05-06T21:26:46.357 INFO:tasks.workunit.client.0.smithi032.stdout:6/713: truncate d8/dd/d1b/d35/db4/fcc 995166 0 2024-05-06T21:26:46.357 INFO:tasks.workunit.client.0.smithi032.stdout:6/714: dread - d8/fc8 zero size 2024-05-06T21:26:46.358 INFO:tasks.workunit.client.1.smithi154.stdout:5/289: symlink d2/d6/l62 0 2024-05-06T21:26:46.358 INFO:tasks.workunit.client.1.smithi154.stdout:5/290: dread - d2/f4c zero size 2024-05-06T21:26:46.358 INFO:tasks.workunit.client.1.smithi154.stdout:5/291: fdatasync d2/d3/d21/d22/f36 0 2024-05-06T21:26:46.359 INFO:tasks.workunit.client.0.smithi032.stdout:7/696: symlink db/d12/d16/d2a/d39/ldf 0 2024-05-06T21:26:46.359 INFO:tasks.workunit.client.0.smithi032.stdout:7/697: write db/f77 [977031,103334] 0 2024-05-06T21:26:46.359 INFO:tasks.workunit.client.0.smithi032.stdout:7/698: stat db/d12/d16/d2a/d39/d8b/fda 0 2024-05-06T21:26:46.359 INFO:tasks.workunit.client.0.smithi032.stdout:7/699: fsync db/d12/d16/d2a/d39/d3b/fce 0 2024-05-06T21:26:46.359 INFO:tasks.workunit.client.0.smithi032.stdout:7/700: fsync db/d12/d16/d21/d41/d4b/f54 0 2024-05-06T21:26:46.362 INFO:tasks.workunit.client.0.smithi032.stdout:8/806: mknod d0/d1b/d47/cf9 0 2024-05-06T21:26:46.362 INFO:tasks.workunit.client.1.smithi154.stdout:1/306: rename d6/db/f4f to d6/db/d10/d15/d1d/f61 0 2024-05-06T21:26:46.366 INFO:tasks.workunit.client.0.smithi032.stdout:1/614: dwrite db/d47/d4a/da4/f4d [0,4194304] 0 2024-05-06T21:26:46.366 INFO:tasks.workunit.client.0.smithi032.stdout:5/588: mkdir d0/d24/d38/db0 0 2024-05-06T21:26:46.366 INFO:tasks.workunit.client.1.smithi154.stdout:3/384: mkdir d0/da/db/d7c/d80 0 2024-05-06T21:26:46.366 INFO:tasks.workunit.client.1.smithi154.stdout:3/385: stat d0/da/db/dd/c46 0 2024-05-06T21:26:46.366 INFO:tasks.workunit.client.1.smithi154.stdout:0/321: mknod d6/dc/d44/d36/c63 0 2024-05-06T21:26:46.366 INFO:tasks.workunit.client.1.smithi154.stdout:5/292: symlink d2/d3/d21/l63 0 2024-05-06T21:26:46.367 INFO:tasks.workunit.client.1.smithi154.stdout:1/307: link d6/f17 d6/db/d10/d15/f62 0 2024-05-06T21:26:46.368 INFO:tasks.workunit.client.0.smithi032.stdout:4/711: rename d2/d16/d44/d74/f8b to d2/d16/fe3 0 2024-05-06T21:26:46.368 INFO:tasks.workunit.client.0.smithi032.stdout:4/712: chown d2/d16/d44/d45/d4e/f6b 491728971 1 2024-05-06T21:26:46.369 INFO:tasks.workunit.client.0.smithi032.stdout:4/713: creat d2/d13/fe4 x:0 0 0 2024-05-06T21:26:46.369 INFO:tasks.workunit.client.0.smithi032.stdout:4/714: read - d2/d16/d44/d74/d76/d81/fbc zero size 2024-05-06T21:26:46.369 INFO:tasks.workunit.client.1.smithi154.stdout:3/386: rename d0/da/d1a/d28/d2f/d38 to d0/da/d1a/d28/d2f/d81 0 2024-05-06T21:26:46.371 INFO:tasks.workunit.client.0.smithi032.stdout:8/807: read d0/d1c/f88 [694357,39891] 0 2024-05-06T21:26:46.371 INFO:tasks.workunit.client.1.smithi154.stdout:1/308: truncate d6/db/d10/f51 1164926 0 2024-05-06T21:26:46.372 INFO:tasks.workunit.client.0.smithi032.stdout:7/701: creat db/d12/d16/d2a/d39/d3b/d96/fe0 x:0 0 0 2024-05-06T21:26:46.372 INFO:tasks.workunit.client.0.smithi032.stdout:7/702: fsync db/f8f 0 2024-05-06T21:26:46.372 INFO:tasks.workunit.client.0.smithi032.stdout:7/703: write db/d12/f61 [1019727,115424] 0 2024-05-06T21:26:46.373 INFO:tasks.workunit.client.1.smithi154.stdout:3/387: mkdir d0/da/d82 0 2024-05-06T21:26:46.374 INFO:tasks.workunit.client.1.smithi154.stdout:3/388: symlink d0/da/d82/l83 0 2024-05-06T21:26:46.374 INFO:tasks.workunit.client.1.smithi154.stdout:3/389: write d0/fe [2726525,105652] 0 2024-05-06T21:26:46.375 INFO:tasks.workunit.client.1.smithi154.stdout:3/390: symlink d0/da/db/d30/d71/l84 0 2024-05-06T21:26:46.378 INFO:tasks.workunit.client.0.smithi032.stdout:1/615: dread db/d16/f1b [0,4194304] 0 2024-05-06T21:26:46.378 INFO:tasks.workunit.client.0.smithi032.stdout:1/616: write db/d16/d46/d57/fa0 [1151803,105507] 0 2024-05-06T21:26:46.378 INFO:tasks.workunit.client.0.smithi032.stdout:1/617: creat db/d16/d46/d57/d58/d68/fc4 x:0 0 0 2024-05-06T21:26:46.378 INFO:tasks.workunit.client.1.smithi154.stdout:3/391: link d0/da/d1a/d28/d2f/d81/d48/f65 d0/da/db/dd/d1c/d21/d37/f85 0 2024-05-06T21:26:46.378 INFO:tasks.workunit.client.1.smithi154.stdout:3/392: truncate d0/da/d1a/d28/d2f/d81/d55/f6e 668344 0 2024-05-06T21:26:46.380 INFO:tasks.workunit.client.1.smithi154.stdout:3/393: rename d0/da/d1a/d28/d2f/d81/f6d to d0/da/db/dd/d1c/f86 0 2024-05-06T21:26:46.380 INFO:tasks.workunit.client.1.smithi154.stdout:5/293: dread d2/d3/fa [0,4194304] 0 2024-05-06T21:26:46.380 INFO:tasks.workunit.client.1.smithi154.stdout:5/294: fsync d2/d3/f16 0 2024-05-06T21:26:46.381 INFO:tasks.workunit.client.0.smithi032.stdout:6/715: rename d8/dd/d1b/d35/f66 to d8/dd/fd4 0 2024-05-06T21:26:46.381 INFO:tasks.workunit.client.1.smithi154.stdout:3/394: link d0/d2/l36 d0/da/d82/l87 0 2024-05-06T21:26:46.382 INFO:tasks.workunit.client.1.smithi154.stdout:3/395: dread d0/da/d1a/d28/d2f/d81/d55/f77 [0,4194304] 0 2024-05-06T21:26:46.384 INFO:tasks.workunit.client.1.smithi154.stdout:3/396: creat d0/da/db/d30/d71/f88 x:0 0 0 2024-05-06T21:26:46.387 INFO:tasks.workunit.client.0.smithi032.stdout:7/704: write db/d12/d16/f8a [893601,103109] 0 2024-05-06T21:26:46.387 INFO:tasks.workunit.client.0.smithi032.stdout:7/705: write db/d12/f85 [4231725,4196] 0 2024-05-06T21:26:46.389 INFO:tasks.workunit.client.1.smithi154.stdout:9/373: dwrite d5/d14/d31/f47 [0,4194304] 0 2024-05-06T21:26:46.389 INFO:tasks.workunit.client.1.smithi154.stdout:9/374: dread - d5/d20/d52/f78 zero size 2024-05-06T21:26:46.393 INFO:tasks.workunit.client.0.smithi032.stdout:7/706: dread db/d12/d16/f3f [0,4194304] 0 2024-05-06T21:26:46.393 INFO:tasks.workunit.client.0.smithi032.stdout:7/707: fdatasync db/d12/d16/d2a/d39/d8b/fda 0 2024-05-06T21:26:46.393 INFO:tasks.workunit.client.0.smithi032.stdout:7/708: creat db/d12/d16/d2a/d39/d3b/fe1 x:0 0 0 2024-05-06T21:26:46.394 INFO:tasks.workunit.client.1.smithi154.stdout:7/180: sync 2024-05-06T21:26:46.395 INFO:tasks.workunit.client.0.smithi032.stdout:1/618: rmdir db/d16/d46/d57 39 2024-05-06T21:26:46.399 INFO:tasks.workunit.client.0.smithi032.stdout:4/715: rename d2/d16/d44/d54/cbd to d2/d2c/d31/ce5 0 2024-05-06T21:26:46.399 INFO:tasks.workunit.client.0.smithi032.stdout:4/716: write d2/d2c/f89 [449616,83699] 0 2024-05-06T21:26:46.399 INFO:tasks.workunit.client.0.smithi032.stdout:4/717: chown d2/d16/d44/d74/d79/d88/dd6/fde 1 1 2024-05-06T21:26:46.399 INFO:tasks.workunit.client.1.smithi154.stdout:7/181: write d6/d20/f26 [2610842,129638] 0 2024-05-06T21:26:46.399 INFO:tasks.workunit.client.1.smithi154.stdout:0/322: dwrite d6/dc/d44/f46 [0,4194304] 0 2024-05-06T21:26:46.399 INFO:tasks.workunit.client.1.smithi154.stdout:5/295: dwrite d2/d3/d19/f3c [4194304,4194304] 0 2024-05-06T21:26:46.399 INFO:tasks.workunit.client.1.smithi154.stdout:7/182: write d6/de/f37 [368478,3616] 0 2024-05-06T21:26:46.400 INFO:tasks.workunit.client.1.smithi154.stdout:0/323: creat d6/dc/f64 x:0 0 0 2024-05-06T21:26:46.400 INFO:tasks.workunit.client.0.smithi032.stdout:8/808: rmdir d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f 39 2024-05-06T21:26:46.400 INFO:tasks.workunit.client.0.smithi032.stdout:8/809: fdatasync d0/d1c/f2d 0 2024-05-06T21:26:46.400 INFO:tasks.workunit.client.0.smithi032.stdout:8/810: fsync d0/d1c/fbb 0 2024-05-06T21:26:46.401 INFO:tasks.workunit.client.0.smithi032.stdout:8/811: fsync d0/d1b/d39/f81 0 2024-05-06T21:26:46.401 INFO:tasks.workunit.client.1.smithi154.stdout:3/397: getdents d0/da/db/d7c 0 2024-05-06T21:26:46.405 INFO:tasks.workunit.client.0.smithi032.stdout:5/589: rmdir d0 39 2024-05-06T21:26:46.406 INFO:tasks.workunit.client.0.smithi032.stdout:7/709: mknod db/d12/d16/d2a/d39/d3b/dac/ce2 0 2024-05-06T21:26:46.406 INFO:tasks.workunit.client.0.smithi032.stdout:7/710: fdatasync db/d12/d16/fc1 0 2024-05-06T21:26:46.408 INFO:tasks.workunit.client.0.smithi032.stdout:1/619: creat db/d37/d52/fc5 x:0 0 0 2024-05-06T21:26:46.410 INFO:tasks.workunit.client.1.smithi154.stdout:9/375: dwrite d5/d20/d52/f78 [0,4194304] 0 2024-05-06T21:26:46.410 INFO:tasks.workunit.client.1.smithi154.stdout:9/376: fdatasync d5/f1a 0 2024-05-06T21:26:46.412 INFO:tasks.workunit.client.0.smithi032.stdout:6/716: rmdir d8/dd/d18/d3b 39 2024-05-06T21:26:46.412 INFO:tasks.workunit.client.0.smithi032.stdout:4/718: write f1 [5974684,29207] 0 2024-05-06T21:26:46.412 INFO:tasks.workunit.client.0.smithi032.stdout:4/719: write d2/f35 [3611508,63967] 0 2024-05-06T21:26:46.412 INFO:tasks.workunit.client.0.smithi032.stdout:4/720: chown d2/d16/d44/d45/cc7 88934633 1 2024-05-06T21:26:46.412 INFO:tasks.workunit.client.1.smithi154.stdout:7/183: mknod d6/de/d23/c3a 0 2024-05-06T21:26:46.412 INFO:tasks.workunit.client.1.smithi154.stdout:7/184: dread - d6/f1a zero size 2024-05-06T21:26:46.412 INFO:tasks.workunit.client.1.smithi154.stdout:7/185: dread - d6/f1a zero size 2024-05-06T21:26:46.412 INFO:tasks.workunit.client.1.smithi154.stdout:7/186: read d6/d20/f1b [224807,118912] 0 2024-05-06T21:26:46.412 INFO:tasks.workunit.client.1.smithi154.stdout:5/296: write d2/d3/f28 [2781670,90491] 0 2024-05-06T21:26:46.414 INFO:tasks.workunit.client.0.smithi032.stdout:5/590: unlink d0/d24/d34/l5e 0 2024-05-06T21:26:46.416 INFO:tasks.workunit.client.0.smithi032.stdout:7/711: dread db/d12/d16/f57 [0,4194304] 0 2024-05-06T21:26:46.417 INFO:tasks.workunit.client.0.smithi032.stdout:6/717: rmdir d8/d3d/d73 39 2024-05-06T21:26:46.419 INFO:tasks.workunit.client.0.smithi032.stdout:4/721: stat d2/d2c/d31/l3c 0 2024-05-06T21:26:46.419 INFO:tasks.workunit.client.0.smithi032.stdout:4/722: fsync d2/d13/fe4 0 2024-05-06T21:26:46.420 INFO:tasks.workunit.client.0.smithi032.stdout:5/591: unlink d0/d16/d2a/d59/f8e 0 2024-05-06T21:26:46.423 INFO:tasks.workunit.client.0.smithi032.stdout:6/718: creat d8/d3d/fd5 x:0 0 0 2024-05-06T21:26:46.423 INFO:tasks.workunit.client.0.smithi032.stdout:8/812: dwrite d0/d1c/d5e/d67/d7b/dab/fc8 [0,4194304] 0 2024-05-06T21:26:46.423 INFO:tasks.workunit.client.0.smithi032.stdout:7/712: dread db/d12/d49/f67 [0,4194304] 0 2024-05-06T21:26:46.423 INFO:tasks.workunit.client.0.smithi032.stdout:8/813: read d0/d1b/d39/f3a [495802,126402] 0 2024-05-06T21:26:46.425 INFO:tasks.workunit.client.0.smithi032.stdout:5/592: mkdir d0/d24/d38/db0/db1 0 2024-05-06T21:26:46.425 INFO:tasks.workunit.client.0.smithi032.stdout:5/593: chown d0/d24/d38/f8d 100 1 2024-05-06T21:26:46.426 INFO:tasks.workunit.client.0.smithi032.stdout:4/723: dread d2/d2c/d31/d7c/fa6 [0,4194304] 0 2024-05-06T21:26:46.428 INFO:tasks.workunit.client.1.smithi154.stdout:5/297: creat d2/d6/dd/f64 x:0 0 0 2024-05-06T21:26:46.429 INFO:tasks.workunit.client.0.smithi032.stdout:7/713: rename db/d12/d16/d2a/d39/d3b/f3d to db/fe3 0 2024-05-06T21:26:46.430 INFO:tasks.workunit.client.1.smithi154.stdout:0/324: getdents d6 0 2024-05-06T21:26:46.430 INFO:tasks.workunit.client.1.smithi154.stdout:0/325: chown d6/dc/d40/d4a/l56 2 1 2024-05-06T21:26:46.430 INFO:tasks.workunit.client.0.smithi032.stdout:5/594: creat d0/d24/d38/d37/d70/fb2 x:0 0 0 2024-05-06T21:26:46.430 INFO:tasks.workunit.client.0.smithi032.stdout:5/595: stat d0/d24/d38/db0 0 2024-05-06T21:26:46.431 INFO:tasks.workunit.client.1.smithi154.stdout:3/398: mknod d0/da/d1a/d28/d2f/d81/d55/d76/c89 0 2024-05-06T21:26:46.431 INFO:tasks.workunit.client.1.smithi154.stdout:3/399: fsync d0/da/f18 0 2024-05-06T21:26:46.432 INFO:tasks.workunit.client.0.smithi032.stdout:4/724: mkdir d2/d16/d44/d74/d79/de6 0 2024-05-06T21:26:46.432 INFO:tasks.workunit.client.0.smithi032.stdout:4/725: chown d2/d16/d44/d74 8 1 2024-05-06T21:26:46.433 INFO:tasks.workunit.client.0.smithi032.stdout:7/714: read db/d12/d16/d21/d41/d4b/f65 [152820,9196] 0 2024-05-06T21:26:46.433 INFO:tasks.workunit.client.0.smithi032.stdout:7/715: fdatasync db/d12/d16/d21/d41/f70 0 2024-05-06T21:26:46.433 INFO:tasks.workunit.client.0.smithi032.stdout:7/716: chown db/d12/d16/d21/d41/d4b/c86 1 1 2024-05-06T21:26:46.433 INFO:tasks.workunit.client.1.smithi154.stdout:9/377: rename d5/d20/d52/d59/f72 to d5/d14/f82 0 2024-05-06T21:26:46.433 INFO:tasks.workunit.client.1.smithi154.stdout:9/378: truncate d5/d20/d52/d59/f80 431857 0 2024-05-06T21:26:46.434 INFO:tasks.workunit.client.0.smithi032.stdout:8/814: dread d0/f1a [0,4194304] 0 2024-05-06T21:26:46.434 INFO:tasks.workunit.client.0.smithi032.stdout:8/815: fsync d0/d1b/d39/f3a 0 2024-05-06T21:26:46.434 INFO:tasks.workunit.client.0.smithi032.stdout:1/620: dwrite db/f51 [0,4194304] 0 2024-05-06T21:26:46.436 INFO:tasks.workunit.client.0.smithi032.stdout:5/596: link d0/d24/d26/d3d/ca2 d0/d24/d26/d32/cb3 0 2024-05-06T21:26:46.438 INFO:tasks.workunit.client.0.smithi032.stdout:4/726: rename d2/d16/d44/d54/d69/d8a to d2/d13/daa/db8/de7 0 2024-05-06T21:26:46.438 INFO:tasks.workunit.client.0.smithi032.stdout:4/727: fdatasync d2/d16/d44/d74/d79/fb9 0 2024-05-06T21:26:46.439 INFO:tasks.workunit.client.0.smithi032.stdout:7/717: creat db/d12/d16/d21/dcb/dd7/fe4 x:0 0 0 2024-05-06T21:26:46.439 INFO:tasks.workunit.client.1.smithi154.stdout:6/217: sync 2024-05-06T21:26:46.440 INFO:tasks.workunit.client.1.smithi154.stdout:0/326: mknod d6/dc/d40/d4a/c65 0 2024-05-06T21:26:46.440 INFO:tasks.workunit.client.1.smithi154.stdout:0/327: creat d6/dc/f66 x:0 0 0 2024-05-06T21:26:46.440 INFO:tasks.workunit.client.1.smithi154.stdout:0/328: dread - d6/dc/f61 zero size 2024-05-06T21:26:46.442 INFO:tasks.workunit.client.1.smithi154.stdout:3/400: mkdir d0/d2/d8a 0 2024-05-06T21:26:46.442 INFO:tasks.workunit.client.1.smithi154.stdout:3/401: write d0/da/db/dd/d1c/f86 [1716152,103405] 0 2024-05-06T21:26:46.444 INFO:tasks.workunit.client.1.smithi154.stdout:9/379: read d5/d20/d37/f5f [3210032,122296] 0 2024-05-06T21:26:46.444 INFO:tasks.workunit.client.0.smithi032.stdout:5/597: symlink d0/d24/d26/d3d/lb4 0 2024-05-06T21:26:46.444 INFO:tasks.workunit.client.0.smithi032.stdout:5/598: chown d0/d16/d79 265544173 1 2024-05-06T21:26:46.444 INFO:tasks.workunit.client.0.smithi032.stdout:6/719: dwrite d8/dd/d18/d13/d1d/fa1 [0,4194304] 0 2024-05-06T21:26:46.445 INFO:tasks.workunit.client.1.smithi154.stdout:7/187: rename d6/de/f37 to d6/f3b 0 2024-05-06T21:26:46.446 INFO:tasks.workunit.client.1.smithi154.stdout:5/298: getdents d2/d3/d21/d22 0 2024-05-06T21:26:46.446 INFO:tasks.workunit.client.1.smithi154.stdout:5/299: chown d2/d3/d19/d23/c3f 236132473 1 2024-05-06T21:26:46.446 INFO:tasks.workunit.client.0.smithi032.stdout:1/621: getdents db/d16/d5d/db2 0 2024-05-06T21:26:46.448 INFO:tasks.workunit.client.1.smithi154.stdout:6/218: mknod d8/c4e 0 2024-05-06T21:26:46.448 INFO:tasks.workunit.client.0.smithi032.stdout:1/622: symlink db/d16/d46/d57/d58/lc6 0 2024-05-06T21:26:46.451 INFO:tasks.workunit.client.0.smithi032.stdout:1/623: creat db/d47/fc7 x:0 0 0 2024-05-06T21:26:46.451 INFO:tasks.workunit.client.0.smithi032.stdout:1/624: truncate db/d16/d46/d57/f71 1448332 0 2024-05-06T21:26:46.451 INFO:tasks.workunit.client.1.smithi154.stdout:0/329: symlink d6/dc/d3c/l67 0 2024-05-06T21:26:46.452 INFO:tasks.workunit.client.1.smithi154.stdout:9/380: dread d5/d20/f2c [0,4194304] 0 2024-05-06T21:26:46.453 INFO:tasks.workunit.client.1.smithi154.stdout:3/402: creat d0/d2/d22/f8b x:0 0 0 2024-05-06T21:26:46.453 INFO:tasks.workunit.client.0.smithi032.stdout:4/728: write d2/d1e/f22 [2704269,46990] 0 2024-05-06T21:26:46.454 INFO:tasks.workunit.client.0.smithi032.stdout:1/625: mkdir db/dc8 0 2024-05-06T21:26:46.454 INFO:tasks.workunit.client.1.smithi154.stdout:7/188: unlink d6/fc 0 2024-05-06T21:26:46.456 INFO:tasks.workunit.client.0.smithi032.stdout:1/626: getdents db/d37 0 2024-05-06T21:26:46.457 INFO:tasks.workunit.client.1.smithi154.stdout:6/219: rename d8/d11/d33/c36 to d8/c4f 0 2024-05-06T21:26:46.458 INFO:tasks.workunit.client.1.smithi154.stdout:6/220: write d8/d13/f28 [499966,112118] 0 2024-05-06T21:26:46.458 INFO:tasks.workunit.client.0.smithi032.stdout:8/816: dwrite d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/fb1 [0,4194304] 0 2024-05-06T21:26:46.458 INFO:tasks.workunit.client.0.smithi032.stdout:7/718: dwrite db/d12/d16/d2a/f2d [0,4194304] 0 2024-05-06T21:26:46.460 INFO:tasks.workunit.client.0.smithi032.stdout:8/817: creat d0/d1c/d5e/ffa x:0 0 0 2024-05-06T21:26:46.460 INFO:tasks.workunit.client.0.smithi032.stdout:8/818: stat d0/d1b/d47/f87 0 2024-05-06T21:26:46.461 INFO:tasks.workunit.client.1.smithi154.stdout:0/330: link d6/dc/d40/f47 d6/dc/d44/d36/f68 0 2024-05-06T21:26:46.461 INFO:tasks.workunit.client.1.smithi154.stdout:0/331: creat d6/d27/f69 x:0 0 0 2024-05-06T21:26:46.461 INFO:tasks.workunit.client.1.smithi154.stdout:9/381: mkdir d5/d20/d52/d6e/d83 0 2024-05-06T21:26:46.463 INFO:tasks.workunit.client.0.smithi032.stdout:7/719: getdents db/d12/d16/d2a/d39/d8b 0 2024-05-06T21:26:46.463 INFO:tasks.workunit.client.0.smithi032.stdout:7/720: dread - db/d12/d16/d21/fa7 zero size 2024-05-06T21:26:46.464 INFO:tasks.workunit.client.0.smithi032.stdout:1/627: rmdir db/d16/db8 39 2024-05-06T21:26:46.465 INFO:tasks.workunit.client.1.smithi154.stdout:7/189: link d6/de/d23/l27 d6/de/d23/l3c 0 2024-05-06T21:26:46.466 INFO:tasks.workunit.client.0.smithi032.stdout:8/819: link d0/d1c/d5e/d67/ld6 d0/d1c/d5e/d67/dc3/d97/deb/lfb 0 2024-05-06T21:26:46.466 INFO:tasks.workunit.client.0.smithi032.stdout:8/820: read d0/f5 [2461803,63108] 0 2024-05-06T21:26:46.468 INFO:tasks.workunit.client.1.smithi154.stdout:6/221: rename d8/l1f to d8/d13/l50 0 2024-05-06T21:26:46.468 INFO:tasks.workunit.client.1.smithi154.stdout:6/222: readlink d8/d13/l17 0 2024-05-06T21:26:46.470 INFO:tasks.workunit.client.1.smithi154.stdout:9/382: truncate d5/d20/d37/f38 634866 0 2024-05-06T21:26:46.471 INFO:tasks.workunit.client.0.smithi032.stdout:8/821: symlink d0/d1c/d5e/d67/d7b/lfc 0 2024-05-06T21:26:46.471 INFO:tasks.workunit.client.0.smithi032.stdout:8/822: write d0/d1c/d5e/d67/dc3/db5/dd0/fde [749174,50284] 0 2024-05-06T21:26:46.471 INFO:tasks.workunit.client.1.smithi154.stdout:6/223: mkdir d8/d11/d51 0 2024-05-06T21:26:46.474 INFO:tasks.workunit.client.1.smithi154.stdout:0/332: dread d6/f3a [0,4194304] 0 2024-05-06T21:26:46.474 INFO:tasks.workunit.client.1.smithi154.stdout:0/333: write d6/dc/d44/d36/f57 [1168613,1720] 0 2024-05-06T21:26:46.474 INFO:tasks.workunit.client.1.smithi154.stdout:0/334: truncate d6/dc/d44/d36/f62 722718 0 2024-05-06T21:26:46.474 INFO:tasks.workunit.client.1.smithi154.stdout:0/335: rename d6 to d6/dc/d44/d6a 22 2024-05-06T21:26:46.474 INFO:tasks.workunit.client.1.smithi154.stdout:0/336: write d6/d27/f28 [1091631,72145] 0 2024-05-06T21:26:46.474 INFO:tasks.workunit.client.1.smithi154.stdout:0/337: dread - d6/dc/f2e zero size 2024-05-06T21:26:46.475 INFO:tasks.workunit.client.1.smithi154.stdout:0/338: fsync d6/dc/d44/f11 0 2024-05-06T21:26:46.475 INFO:tasks.workunit.client.1.smithi154.stdout:0/339: write d6/dc/d44/d36/f4e [706004,79037] 0 2024-05-06T21:26:46.475 INFO:tasks.workunit.client.1.smithi154.stdout:0/340: readlink d6/dc/d3c/l67 0 2024-05-06T21:26:46.475 INFO:tasks.workunit.client.0.smithi032.stdout:8/823: mknod d0/d1b/d47/d91/cfd 0 2024-05-06T21:26:46.477 INFO:tasks.workunit.client.0.smithi032.stdout:4/729: rename d2/d16/d44/d54 to d2/d16/d44/d74/d79/de6/de8 0 2024-05-06T21:26:46.477 INFO:tasks.workunit.client.0.smithi032.stdout:4/730: chown d2 25720 1 2024-05-06T21:26:46.478 INFO:tasks.workunit.client.0.smithi032.stdout:7/721: dread db/d12/d16/d21/d41/f99 [0,4194304] 0 2024-05-06T21:26:46.478 INFO:tasks.workunit.client.0.smithi032.stdout:4/731: rmdir d2/d16 39 2024-05-06T21:26:46.481 INFO:tasks.workunit.client.0.smithi032.stdout:7/722: creat db/d12/d16/d21/d41/fe5 x:0 0 0 2024-05-06T21:26:46.481 INFO:tasks.workunit.client.0.smithi032.stdout:7/723: fsync db/d12/d16/f3f 0 2024-05-06T21:26:46.481 INFO:tasks.workunit.client.0.smithi032.stdout:7/724: truncate db/d12/d16/d21/d41/d78/fb0 4412468 0 2024-05-06T21:26:46.481 INFO:tasks.workunit.client.0.smithi032.stdout:7/725: creat db/d12/d16/d2a/fe6 x:0 0 0 2024-05-06T21:26:46.483 INFO:tasks.workunit.client.1.smithi154.stdout:6/224: dread d8/f31 [0,4194304] 0 2024-05-06T21:26:46.486 INFO:tasks.workunit.client.1.smithi154.stdout:6/225: symlink d8/d11/d33/l52 0 2024-05-06T21:26:46.486 INFO:tasks.workunit.client.1.smithi154.stdout:5/300: read d2/d6/dd/d2a/f3d [6460702,87183] 0 2024-05-06T21:26:46.490 INFO:tasks.workunit.client.1.smithi154.stdout:9/383: dread d5/f1a [0,4194304] 0 2024-05-06T21:26:46.491 INFO:tasks.workunit.client.1.smithi154.stdout:7/190: dwrite d6/de/d23/f28 [0,4194304] 0 2024-05-06T21:26:46.493 INFO:tasks.workunit.client.1.smithi154.stdout:5/301: rename d2/d3/f28 to d2/d6/dd/d2a/d54/f65 0 2024-05-06T21:26:46.494 INFO:tasks.workunit.client.1.smithi154.stdout:9/384: mkdir d5/d20/d84 0 2024-05-06T21:26:46.494 INFO:tasks.workunit.client.1.smithi154.stdout:9/385: write d5/d20/f81 [476428,96709] 0 2024-05-06T21:26:46.494 INFO:tasks.workunit.client.1.smithi154.stdout:9/386: stat d5/c11 0 2024-05-06T21:26:46.494 INFO:tasks.workunit.client.1.smithi154.stdout:9/387: chown d5/d20/f2c 4681 1 2024-05-06T21:26:46.497 INFO:tasks.workunit.client.1.smithi154.stdout:3/403: dwrite d0/da/d1a/f68 [0,4194304] 0 2024-05-06T21:26:46.498 INFO:tasks.workunit.client.1.smithi154.stdout:7/191: unlink d6/d20/f26 0 2024-05-06T21:26:46.499 INFO:tasks.workunit.client.1.smithi154.stdout:9/388: mknod d5/d2e/d66/c85 0 2024-05-06T21:26:46.503 INFO:tasks.workunit.client.1.smithi154.stdout:3/404: creat d0/da/d1a/d28/f8c x:0 0 0 2024-05-06T21:26:46.503 INFO:tasks.workunit.client.1.smithi154.stdout:3/405: readlink d0/da/d1a/d28/d17/l7e 0 2024-05-06T21:26:46.503 INFO:tasks.workunit.client.0.smithi032.stdout:1/628: dwrite db/d47/d4a/f95 [0,4194304] 0 2024-05-06T21:26:46.505 INFO:tasks.workunit.client.1.smithi154.stdout:7/192: symlink d6/de/d21/d2e/l3d 0 2024-05-06T21:26:46.505 INFO:tasks.workunit.client.1.smithi154.stdout:7/193: chown d6/d20/f1b 24279 1 2024-05-06T21:26:46.506 INFO:tasks.workunit.client.1.smithi154.stdout:9/389: mknod d5/d14/d31/c86 0 2024-05-06T21:26:46.506 INFO:tasks.workunit.client.1.smithi154.stdout:9/390: chown d5/d14/d31/f40 2 1 2024-05-06T21:26:46.506 INFO:tasks.workunit.client.1.smithi154.stdout:9/391: write d5/d14/f43 [1046152,76550] 0 2024-05-06T21:26:46.506 INFO:tasks.workunit.client.0.smithi032.stdout:1/629: symlink db/d16/d46/d57/d58/lc9 0 2024-05-06T21:26:46.507 INFO:tasks.workunit.client.1.smithi154.stdout:7/194: mknod d6/de/c3e 0 2024-05-06T21:26:46.508 INFO:tasks.workunit.client.1.smithi154.stdout:9/392: rmdir d5/d14/d31 39 2024-05-06T21:26:46.510 INFO:tasks.workunit.client.0.smithi032.stdout:1/630: rmdir db/d47/d4a/da4/da2 39 2024-05-06T21:26:46.510 INFO:tasks.workunit.client.0.smithi032.stdout:1/631: read - db/d47/fc7 zero size 2024-05-06T21:26:46.511 INFO:tasks.workunit.client.0.smithi032.stdout:1/632: rmdir db/d16/da3 39 2024-05-06T21:26:46.511 INFO:tasks.workunit.client.0.smithi032.stdout:1/633: write db/d47/d4a/da4/fb5 [1002977,74217] 0 2024-05-06T21:26:46.511 INFO:tasks.workunit.client.0.smithi032.stdout:1/634: chown db/d16/d46/d55/c64 132046529 1 2024-05-06T21:26:46.512 INFO:tasks.workunit.client.1.smithi154.stdout:9/393: rename d5/d2e/d56 to d5/d14/d87 0 2024-05-06T21:26:46.512 INFO:tasks.workunit.client.1.smithi154.stdout:9/394: creat d5/d2e/d66/f88 x:0 0 0 2024-05-06T21:26:46.515 INFO:tasks.workunit.client.0.smithi032.stdout:1/635: rename db/d37/l5e to db/d47/d70/lca 0 2024-05-06T21:26:46.525 INFO:tasks.workunit.client.1.smithi154.stdout:9/395: write d5/d14/d31/f47 [3744753,19226] 0 2024-05-06T21:26:46.527 INFO:tasks.workunit.client.1.smithi154.stdout:9/396: mkdir d5/d89 0 2024-05-06T21:26:46.528 INFO:tasks.workunit.client.1.smithi154.stdout:9/397: mknod d5/d14/d3a/d71/c8a 0 2024-05-06T21:26:46.530 INFO:tasks.workunit.client.0.smithi032.stdout:8/824: dwrite d0/d1c/d5e/d67/d7b/dab/fc8 [4194304,4194304] 0 2024-05-06T21:26:46.530 INFO:tasks.workunit.client.0.smithi032.stdout:8/825: dread - d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/fcc zero size 2024-05-06T21:26:46.530 INFO:tasks.workunit.client.0.smithi032.stdout:8/826: write d0/d1c/f88 [2284144,41445] 0 2024-05-06T21:26:46.530 INFO:tasks.workunit.client.0.smithi032.stdout:8/827: write d0/d1b/d39/f5a [3745764,76439] 0 2024-05-06T21:26:46.531 INFO:tasks.workunit.client.1.smithi154.stdout:0/341: dwrite d6/f3a [0,4194304] 0 2024-05-06T21:26:46.531 INFO:tasks.workunit.client.0.smithi032.stdout:8/828: write d0/d1b/d47/d91/da7/fba [324329,24871] 0 2024-05-06T21:26:46.532 INFO:tasks.workunit.client.0.smithi032.stdout:8/829: read - d0/d1c/d5e/d67/d7b/ff6 zero size 2024-05-06T21:26:46.532 INFO:tasks.workunit.client.0.smithi032.stdout:8/830: chown d0/d1c/d5e/d67/dc3/d57/d5d/d63/laf 87573 1 2024-05-06T21:26:46.532 INFO:tasks.workunit.client.0.smithi032.stdout:8/831: truncate d0/d1b/fb9 995129 0 2024-05-06T21:26:46.532 INFO:tasks.workunit.client.0.smithi032.stdout:8/832: write d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/fcc [503410,50763] 0 2024-05-06T21:26:46.532 INFO:tasks.workunit.client.1.smithi154.stdout:0/342: symlink d6/dc/d42/l6b 0 2024-05-06T21:26:46.532 INFO:tasks.workunit.client.1.smithi154.stdout:0/343: readlink d6/l1f 0 2024-05-06T21:26:46.532 INFO:tasks.workunit.client.1.smithi154.stdout:0/344: write d6/dc/f50 [913832,41601] 0 2024-05-06T21:26:46.535 INFO:tasks.workunit.client.1.smithi154.stdout:6/226: dwrite d8/f2c [4194304,4194304] 0 2024-05-06T21:26:46.535 INFO:tasks.workunit.client.1.smithi154.stdout:6/227: readlink d8/d11/d2d/l41 0 2024-05-06T21:26:46.535 INFO:tasks.workunit.client.1.smithi154.stdout:5/302: dwrite d2/d6/f61 [0,4194304] 0 2024-05-06T21:26:46.535 INFO:tasks.workunit.client.0.smithi032.stdout:8/833: mkdir d0/d1c/d5e/d67/dfe 0 2024-05-06T21:26:46.536 INFO:tasks.workunit.client.1.smithi154.stdout:3/406: dwrite d0/da/d1a/d28/d17/f4f [0,4194304] 0 2024-05-06T21:26:46.537 INFO:tasks.workunit.client.0.smithi032.stdout:8/834: unlink d0/d1c/c1e 0 2024-05-06T21:26:46.540 INFO:tasks.workunit.client.0.smithi032.stdout:8/835: symlink d0/d1c/d5e/d67/dc3/d97/deb/lff 0 2024-05-06T21:26:46.540 INFO:tasks.workunit.client.0.smithi032.stdout:8/836: fdatasync d0/f9a 0 2024-05-06T21:26:46.541 INFO:tasks.workunit.client.1.smithi154.stdout:7/195: dwrite d6/f10 [4194304,4194304] 0 2024-05-06T21:26:46.541 INFO:tasks.workunit.client.1.smithi154.stdout:7/196: write d6/d20/f38 [1009400,38685] 0 2024-05-06T21:26:46.542 INFO:tasks.workunit.client.0.smithi032.stdout:8/837: symlink d0/d1c/d5e/d67/dc3/d57/d5d/d63/l100 0 2024-05-06T21:26:46.545 INFO:tasks.workunit.client.1.smithi154.stdout:5/303: creat d2/d6/dc/f66 x:0 0 0 2024-05-06T21:26:46.545 INFO:tasks.workunit.client.1.smithi154.stdout:5/304: readlink d2/d6/dd/l11 0 2024-05-06T21:26:46.545 INFO:tasks.workunit.client.0.smithi032.stdout:8/838: creat d0/d1b/d47/d91/da7/f101 x:0 0 0 2024-05-06T21:26:46.546 INFO:tasks.workunit.client.0.smithi032.stdout:8/839: write d0/d1c/d5e/d67/dc3/d57/d5d/faa [2838971,94877] 0 2024-05-06T21:26:46.546 INFO:tasks.workunit.client.0.smithi032.stdout:1/636: getdents db/d37 0 2024-05-06T21:26:46.547 INFO:tasks.workunit.client.1.smithi154.stdout:0/345: getdents d6/dc/d44/d36 0 2024-05-06T21:26:46.547 INFO:tasks.workunit.client.1.smithi154.stdout:0/346: dread - d6/dc/f64 zero size 2024-05-06T21:26:46.552 INFO:tasks.workunit.client.1.smithi154.stdout:3/407: symlink d0/da/d1a/d28/d2f/d81/d48/l8d 0 2024-05-06T21:26:46.552 INFO:tasks.workunit.client.1.smithi154.stdout:3/408: fdatasync d0/da/d1a/d28/f8c 0 2024-05-06T21:26:46.553 INFO:tasks.workunit.client.1.smithi154.stdout:5/305: symlink d2/l67 0 2024-05-06T21:26:46.554 INFO:tasks.workunit.client.1.smithi154.stdout:0/347: dread d6/dc/f33 [0,4194304] 0 2024-05-06T21:26:46.555 INFO:tasks.workunit.client.1.smithi154.stdout:3/409: creat d0/da/d1a/d28/d2f/d81/d48/f8e x:0 0 0 2024-05-06T21:26:46.555 INFO:tasks.workunit.client.1.smithi154.stdout:3/410: fdatasync d0/da/d1a/d28/d17/f1e 0 2024-05-06T21:26:46.555 INFO:tasks.workunit.client.1.smithi154.stdout:3/411: fdatasync d0/da/db/dd/fc 0 2024-05-06T21:26:46.556 INFO:tasks.workunit.client.1.smithi154.stdout:3/412: write d0/da/d1a/f44 [1189725,122455] 0 2024-05-06T21:26:46.558 INFO:tasks.workunit.client.1.smithi154.stdout:3/413: getdents d0/da 0 2024-05-06T21:26:46.558 INFO:tasks.workunit.client.1.smithi154.stdout:3/414: dread - d0/da/d1a/d28/d2f/f64 zero size 2024-05-06T21:26:46.558 INFO:tasks.workunit.client.1.smithi154.stdout:3/415: chown d0/da/d1a/d28/d2f/d81/d55/d76/c89 22920 1 2024-05-06T21:26:46.562 INFO:tasks.workunit.client.1.smithi154.stdout:0/348: dread d6/dc/d44/f11 [0,4194304] 0 2024-05-06T21:26:46.562 INFO:tasks.workunit.client.0.smithi032.stdout:8/840: dread d0/d1c/d5e/f65 [0,4194304] 0 2024-05-06T21:26:46.563 INFO:tasks.workunit.client.1.smithi154.stdout:0/349: mkdir d6/dc/d40/d4a/d6c 0 2024-05-06T21:26:46.564 INFO:tasks.workunit.client.0.smithi032.stdout:8/841: mkdir d0/d1c/d5e/d67/d102 0 2024-05-06T21:26:46.565 INFO:tasks.workunit.client.0.smithi032.stdout:8/842: symlink d0/d1c/d5e/d67/d9d/l103 0 2024-05-06T21:26:46.565 INFO:tasks.workunit.client.1.smithi154.stdout:9/398: dwrite d5/d20/d37/f38 [0,4194304] 0 2024-05-06T21:26:46.565 INFO:tasks.workunit.client.1.smithi154.stdout:0/350: rename d6/d27/f52 to d6/dc/d44/f6d 0 2024-05-06T21:26:46.566 INFO:tasks.workunit.client.0.smithi032.stdout:1/637: write db/d47/d4a/f95 [2680724,80919] 0 2024-05-06T21:26:46.566 INFO:tasks.workunit.client.0.smithi032.stdout:1/638: write db/d47/d4a/da4/f4d [4534356,49352] 0 2024-05-06T21:26:46.566 INFO:tasks.workunit.client.0.smithi032.stdout:1/639: stat db/d16/d46/d55/cac 0 2024-05-06T21:26:46.566 INFO:tasks.workunit.client.1.smithi154.stdout:9/399: truncate d5/f1a 1576283 0 2024-05-06T21:26:46.566 INFO:tasks.workunit.client.1.smithi154.stdout:9/400: readlink d5/d14/d87/d65/l7c 0 2024-05-06T21:26:46.567 INFO:tasks.workunit.client.0.smithi032.stdout:1/640: mkdir db/d47/d4a/dcb 0 2024-05-06T21:26:46.567 INFO:tasks.workunit.client.0.smithi032.stdout:1/641: fsync db/d47/d4a/f66 0 2024-05-06T21:26:46.568 INFO:tasks.workunit.client.1.smithi154.stdout:0/351: rename d6/dc/d44/d36/f37 to d6/dc/d40/d5e/f6e 0 2024-05-06T21:26:46.568 INFO:tasks.workunit.client.1.smithi154.stdout:0/352: readlink d6/dc/l4c 0 2024-05-06T21:26:46.568 INFO:tasks.workunit.client.1.smithi154.stdout:0/353: creat d6/dc/d51/f6f x:0 0 0 2024-05-06T21:26:46.568 INFO:tasks.workunit.client.1.smithi154.stdout:0/354: fsync d6/dc/d39/f3f 0 2024-05-06T21:26:46.569 INFO:tasks.workunit.client.1.smithi154.stdout:6/228: dwrite d8/d11/d2d/d3d/f3c [0,4194304] 0 2024-05-06T21:26:46.569 INFO:tasks.workunit.client.1.smithi154.stdout:9/401: mkdir d5/d2e/d8b 0 2024-05-06T21:26:46.569 INFO:tasks.workunit.client.1.smithi154.stdout:7/197: dwrite d6/f32 [0,4194304] 0 2024-05-06T21:26:46.570 INFO:tasks.workunit.client.0.smithi032.stdout:1/642: symlink db/d16/lcc 0 2024-05-06T21:26:46.570 INFO:tasks.workunit.client.0.smithi032.stdout:1/643: write db/d47/d4a/da4/da2/fb0 [221667,16873] 0 2024-05-06T21:26:46.570 INFO:tasks.workunit.client.0.smithi032.stdout:1/644: read db/fa9 [4034754,57243] 0 2024-05-06T21:26:46.570 INFO:tasks.workunit.client.0.smithi032.stdout:1/645: creat db/d16/d46/d57/d58/d68/fcd x:0 0 0 2024-05-06T21:26:46.570 INFO:tasks.workunit.client.0.smithi032.stdout:8/843: dread d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/fd1 [0,4194304] 0 2024-05-06T21:26:46.570 INFO:tasks.workunit.client.1.smithi154.stdout:0/355: mkdir d6/dc/d40/d41/d70 0 2024-05-06T21:26:46.571 INFO:tasks.workunit.client.1.smithi154.stdout:9/402: symlink d5/d20/d52/d6e/d83/l8c 0 2024-05-06T21:26:46.573 INFO:tasks.workunit.client.1.smithi154.stdout:7/198: mknod d6/de/c3f 0 2024-05-06T21:26:46.574 INFO:tasks.workunit.client.1.smithi154.stdout:3/416: dread d0/d2/f25 [0,4194304] 0 2024-05-06T21:26:46.574 INFO:tasks.workunit.client.1.smithi154.stdout:3/417: fdatasync d0/da/d1a/d28/d2f/f64 0 2024-05-06T21:26:46.574 INFO:tasks.workunit.client.1.smithi154.stdout:0/356: truncate d6/dc/f24 1861639 0 2024-05-06T21:26:46.575 INFO:tasks.workunit.client.1.smithi154.stdout:9/403: mknod d5/d14/d3a/c8d 0 2024-05-06T21:26:46.575 INFO:tasks.workunit.client.0.smithi032.stdout:0/598: sync 2024-05-06T21:26:46.575 INFO:tasks.workunit.client.0.smithi032.stdout:9/671: sync 2024-05-06T21:26:46.575 INFO:tasks.workunit.client.0.smithi032.stdout:9/672: write d1/d13/d33/d5e/d78/f8d [4707309,102098] 0 2024-05-06T21:26:46.576 INFO:tasks.workunit.client.0.smithi032.stdout:0/599: mkdir d4/da/d16/d33/da7/dbd 0 2024-05-06T21:26:46.576 INFO:tasks.workunit.client.1.smithi154.stdout:3/418: unlink d0/da/d1a/d28/d2f/d81/d48/l8d 0 2024-05-06T21:26:46.577 INFO:tasks.workunit.client.0.smithi032.stdout:9/673: mkdir d1/d2f/de1 0 2024-05-06T21:26:46.577 INFO:tasks.workunit.client.0.smithi032.stdout:9/674: creat d1/d13/d33/d8e/fe2 x:0 0 0 2024-05-06T21:26:46.577 INFO:tasks.workunit.client.0.smithi032.stdout:9/675: creat d1/d13/d33/d5e/d78/fe3 x:0 0 0 2024-05-06T21:26:46.577 INFO:tasks.workunit.client.0.smithi032.stdout:9/676: dread - d1/fc8 zero size 2024-05-06T21:26:46.578 INFO:tasks.workunit.client.0.smithi032.stdout:9/677: write d1/d13/d33/d5e/d78/f8d [3921991,90469] 0 2024-05-06T21:26:46.578 INFO:tasks.workunit.client.0.smithi032.stdout:9/678: creat d1/d13/d34/fe4 x:0 0 0 2024-05-06T21:26:46.578 INFO:tasks.workunit.client.1.smithi154.stdout:0/357: truncate d6/dc/f38 2519 0 2024-05-06T21:26:46.579 INFO:tasks.workunit.client.0.smithi032.stdout:0/600: truncate d4/d3e/d63/f56 1859926 0 2024-05-06T21:26:46.579 INFO:tasks.workunit.client.0.smithi032.stdout:0/601: chown d4/da/d16/d4f/fa9 99789 1 2024-05-06T21:26:46.579 INFO:tasks.workunit.client.0.smithi032.stdout:0/602: creat d4/d3e/fbe x:0 0 0 2024-05-06T21:26:46.580 INFO:tasks.workunit.client.1.smithi154.stdout:3/419: mknod d0/da/d1a/d28/d17/c8f 0 2024-05-06T21:26:46.580 INFO:tasks.workunit.client.1.smithi154.stdout:3/420: write d0/da/db/f2a [684681,37522] 0 2024-05-06T21:26:46.580 INFO:tasks.workunit.client.1.smithi154.stdout:3/421: write d0/da/d1a/d28/d17/f54 [424241,21725] 0 2024-05-06T21:26:46.581 INFO:tasks.workunit.client.1.smithi154.stdout:0/358: creat d6/dc/d40/d41/d70/f71 x:0 0 0 2024-05-06T21:26:46.582 INFO:tasks.workunit.client.1.smithi154.stdout:9/404: symlink d5/l8e 0 2024-05-06T21:26:46.583 INFO:tasks.workunit.client.1.smithi154.stdout:6/229: dread d8/fc [0,4194304] 0 2024-05-06T21:26:46.583 INFO:tasks.workunit.client.1.smithi154.stdout:6/230: fdatasync f1 0 2024-05-06T21:26:46.583 INFO:tasks.workunit.client.1.smithi154.stdout:3/422: mkdir d0/da/db/dd/d1c/d90 0 2024-05-06T21:26:46.584 INFO:tasks.workunit.client.0.smithi032.stdout:9/679: rename d1/d13/d34/d26/d39/d8b/f8f to d1/d2f/d4f/d97/fe5 0 2024-05-06T21:26:46.584 INFO:tasks.workunit.client.1.smithi154.stdout:7/199: dread d6/f25 [0,4194304] 0 2024-05-06T21:26:46.585 INFO:tasks.workunit.client.1.smithi154.stdout:0/359: creat d6/dc/d44/f72 x:0 0 0 2024-05-06T21:26:46.586 INFO:tasks.workunit.client.0.smithi032.stdout:0/603: rename d4/da/d14/d1a/fae to d4/d3e/fbf 0 2024-05-06T21:26:46.588 INFO:tasks.workunit.client.0.smithi032.stdout:9/680: truncate d1/d13/d34/d26/d39/d45/f6d 3627716 0 2024-05-06T21:26:46.588 INFO:tasks.workunit.client.0.smithi032.stdout:9/681: chown d1/d13/d33/d5e/d78/fe3 14346 1 2024-05-06T21:26:46.588 INFO:tasks.workunit.client.0.smithi032.stdout:9/682: fsync d1/d13/f16 0 2024-05-06T21:26:46.588 INFO:tasks.workunit.client.0.smithi032.stdout:9/683: readlink d1/d13/d33/d3f/l7c 0 2024-05-06T21:26:46.588 INFO:tasks.workunit.client.0.smithi032.stdout:1/646: dread db/d47/d4a/da4/f49 [0,4194304] 0 2024-05-06T21:26:46.588 INFO:tasks.workunit.client.0.smithi032.stdout:1/647: chown db/d47/d4a/da4 274998194 1 2024-05-06T21:26:46.588 INFO:tasks.workunit.client.0.smithi032.stdout:1/648: chown db/d37/d52/f85 170931509 1 2024-05-06T21:26:46.589 INFO:tasks.workunit.client.1.smithi154.stdout:6/231: dread d8/fc [0,4194304] 0 2024-05-06T21:26:46.589 INFO:tasks.workunit.client.1.smithi154.stdout:9/405: creat d5/d14/d87/f8f x:0 0 0 2024-05-06T21:26:46.589 INFO:tasks.workunit.client.1.smithi154.stdout:9/406: creat d5/d20/f90 x:0 0 0 2024-05-06T21:26:46.589 INFO:tasks.workunit.client.1.smithi154.stdout:7/200: mkdir d6/d20/d40 0 2024-05-06T21:26:46.590 INFO:tasks.workunit.client.1.smithi154.stdout:4/285: sync 2024-05-06T21:26:46.590 INFO:tasks.workunit.client.1.smithi154.stdout:4/286: fdatasync d0/d2/d2a/f37 0 2024-05-06T21:26:46.590 INFO:tasks.workunit.client.1.smithi154.stdout:2/281: sync 2024-05-06T21:26:46.591 INFO:tasks.workunit.client.0.smithi032.stdout:0/604: truncate d4/da/d16/d33/f57 2107065 0 2024-05-06T21:26:46.591 INFO:tasks.workunit.client.0.smithi032.stdout:0/605: readlink d4/da/d14/d1a/l7f 0 2024-05-06T21:26:46.591 INFO:tasks.workunit.client.1.smithi154.stdout:0/360: symlink d6/dc/d40/l73 0 2024-05-06T21:26:46.597 INFO:tasks.workunit.client.1.smithi154.stdout:7/201: mknod d6/de/c41 0 2024-05-06T21:26:46.597 INFO:tasks.workunit.client.1.smithi154.stdout:8/277: sync 2024-05-06T21:26:46.597 INFO:tasks.workunit.client.1.smithi154.stdout:1/309: sync 2024-05-06T21:26:46.597 INFO:tasks.workunit.client.1.smithi154.stdout:1/310: truncate d6/f28 2727518 0 2024-05-06T21:26:46.597 INFO:tasks.workunit.client.1.smithi154.stdout:1/311: chown d6/db/d10/d26/d1b 74642 1 2024-05-06T21:26:46.597 INFO:tasks.workunit.client.1.smithi154.stdout:1/312: dread - d6/db/d10/f35 zero size 2024-05-06T21:26:46.598 INFO:tasks.workunit.client.1.smithi154.stdout:2/282: getdents db/d12/d19/d4b 0 2024-05-06T21:26:46.598 INFO:tasks.workunit.client.1.smithi154.stdout:2/283: chown db/de/d10/d18/l3b 328736 1 2024-05-06T21:26:46.601 INFO:tasks.workunit.client.0.smithi032.stdout:0/606: link d4/da/d14/d1a/fb6 d4/fc0 0 2024-05-06T21:26:46.603 INFO:tasks.workunit.client.0.smithi032.stdout:0/607: rename d4/da/f22 to d4/d3e/fc1 0 2024-05-06T21:26:46.605 INFO:tasks.workunit.client.1.smithi154.stdout:0/361: dread d6/dc/d39/f3f [0,4194304] 0 2024-05-06T21:26:46.605 INFO:tasks.workunit.client.1.smithi154.stdout:0/362: chown d6/la 61313793 1 2024-05-06T21:26:46.605 INFO:tasks.workunit.client.1.smithi154.stdout:7/202: mkdir d6/d42 0 2024-05-06T21:26:46.606 INFO:tasks.workunit.client.0.smithi032.stdout:1/649: write db/d47/d4a/da4/f2f [2026167,102887] 0 2024-05-06T21:26:46.607 INFO:tasks.workunit.client.0.smithi032.stdout:0/608: unlink d4/f9 0 2024-05-06T21:26:46.608 INFO:tasks.workunit.client.1.smithi154.stdout:1/313: unlink d6/db/d10/d26/c3b 0 2024-05-06T21:26:46.610 INFO:tasks.workunit.client.0.smithi032.stdout:9/684: link d1/d2f/d4f/d97/fe5 d1/d2f/da1/fe6 0 2024-05-06T21:26:46.612 INFO:tasks.workunit.client.1.smithi154.stdout:3/423: dwrite d0/da/d1a/d28/f5b [4194304,4194304] 0 2024-05-06T21:26:46.612 INFO:tasks.workunit.client.1.smithi154.stdout:3/424: dread - d0/da/d1a/d28/d2f/f64 zero size 2024-05-06T21:26:46.613 INFO:tasks.workunit.client.0.smithi032.stdout:1/650: mkdir db/d37/d93/dce 0 2024-05-06T21:26:46.613 INFO:tasks.workunit.client.0.smithi032.stdout:1/651: write db/d47/d4a/f66 [2183284,86438] 0 2024-05-06T21:26:46.614 INFO:tasks.workunit.client.0.smithi032.stdout:8/844: dwrite d0/d1b/d39/f5a [0,4194304] 0 2024-05-06T21:26:46.614 INFO:tasks.workunit.client.0.smithi032.stdout:8/845: chown d0/d1c/le3 252919 1 2024-05-06T21:26:46.615 INFO:tasks.workunit.client.1.smithi154.stdout:0/363: link d6/dc/d51/f6f d6/dc/d51/d54/f74 0 2024-05-06T21:26:46.615 INFO:tasks.workunit.client.1.smithi154.stdout:0/364: read - d6/dc/d51/d54/f74 zero size 2024-05-06T21:26:46.615 INFO:tasks.workunit.client.1.smithi154.stdout:4/287: dwrite d0/d2/f53 [0,4194304] 0 2024-05-06T21:26:46.615 INFO:tasks.workunit.client.1.smithi154.stdout:4/288: chown d0/d10/l33 202 1 2024-05-06T21:26:46.615 INFO:tasks.workunit.client.1.smithi154.stdout:4/289: stat d0/f23 0 2024-05-06T21:26:46.616 INFO:tasks.workunit.client.0.smithi032.stdout:0/609: mkdir d4/d3e/d63/d6c/d8f/dc2 0 2024-05-06T21:26:46.617 INFO:tasks.workunit.client.0.smithi032.stdout:0/610: write d4/da/d16/d33/d46/f6e [1227082,61773] 0 2024-05-06T21:26:46.617 INFO:tasks.workunit.client.0.smithi032.stdout:0/611: chown d4/da/d16/d33/f5e 385208 1 2024-05-06T21:26:46.617 INFO:tasks.workunit.client.0.smithi032.stdout:0/612: read d4/da/d16/d33/f5e [2589987,96419] 0 2024-05-06T21:26:46.617 INFO:tasks.workunit.client.1.smithi154.stdout:9/407: getdents d5/d2e 0 2024-05-06T21:26:46.618 INFO:tasks.workunit.client.1.smithi154.stdout:4/290: dread d0/d10/d11/d1a/f35 [0,4194304] 0 2024-05-06T21:26:46.620 INFO:tasks.workunit.client.1.smithi154.stdout:8/278: dread d3/ff [0,4194304] 0 2024-05-06T21:26:46.624 INFO:tasks.workunit.client.0.smithi032.stdout:8/846: mkdir d0/d1c/d5e/d67/dfe/d104 0 2024-05-06T21:26:46.624 INFO:tasks.workunit.client.0.smithi032.stdout:8/847: chown d0/l18 95669474 1 2024-05-06T21:26:46.629 INFO:tasks.workunit.client.1.smithi154.stdout:2/284: rmdir db 39 2024-05-06T21:26:46.630 INFO:tasks.workunit.client.0.smithi032.stdout:9/685: read d1/d13/f1f [1780563,66038] 0 2024-05-06T21:26:46.630 INFO:tasks.workunit.client.0.smithi032.stdout:9/686: truncate d1/d2f/da1/dc2/d59/f86 703594 0 2024-05-06T21:26:46.630 INFO:tasks.workunit.client.0.smithi032.stdout:8/848: symlink d0/l105 0 2024-05-06T21:26:46.630 INFO:tasks.workunit.client.0.smithi032.stdout:0/613: getdents d4/da/d14 0 2024-05-06T21:26:46.631 INFO:tasks.workunit.client.0.smithi032.stdout:9/687: symlink d1/d13/d34/d26/d39/d8b/le7 0 2024-05-06T21:26:46.633 INFO:tasks.workunit.client.0.smithi032.stdout:8/849: truncate d0/d1b/d47/f54 3376195 0 2024-05-06T21:26:46.634 INFO:tasks.workunit.client.0.smithi032.stdout:9/688: symlink d1/d13/d33/d5e/le8 0 2024-05-06T21:26:46.635 INFO:tasks.workunit.client.1.smithi154.stdout:7/203: dwrite d6/f3b [0,4194304] 0 2024-05-06T21:26:46.635 INFO:tasks.workunit.client.1.smithi154.stdout:7/204: chown d6/c1f 23 1 2024-05-06T21:26:46.635 INFO:tasks.workunit.client.1.smithi154.stdout:7/205: fdatasync d6/fb 0 2024-05-06T21:26:46.636 INFO:tasks.workunit.client.0.smithi032.stdout:0/614: rmdir d4/da/d16/d33/d46 39 2024-05-06T21:26:46.636 INFO:tasks.workunit.client.0.smithi032.stdout:9/689: dread d1/d13/d33/d3f/d60/fb3 [0,4194304] 0 2024-05-06T21:26:46.637 INFO:tasks.workunit.client.0.smithi032.stdout:8/850: rename d0/d1b/d47/d91/da7/fba to d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/f106 0 2024-05-06T21:26:46.637 INFO:tasks.workunit.client.0.smithi032.stdout:0/615: rename d4/d96 to d4/d96/dc3 22 2024-05-06T21:26:46.637 INFO:tasks.workunit.client.0.smithi032.stdout:0/616: creat d4/da/d16/fc4 x:0 0 0 2024-05-06T21:26:46.638 INFO:tasks.workunit.client.1.smithi154.stdout:8/279: symlink d3/d14/d1a/d29/d43/l58 0 2024-05-06T21:26:46.638 INFO:tasks.workunit.client.0.smithi032.stdout:9/690: truncate d1/d13/d34/d26/f71 6870384 0 2024-05-06T21:26:46.638 INFO:tasks.workunit.client.0.smithi032.stdout:8/851: symlink d0/d1c/d5e/d67/dc3/de9/l107 0 2024-05-06T21:26:46.639 INFO:tasks.workunit.client.0.smithi032.stdout:0/617: creat d4/d3e/d63/d6c/d8f/dc2/fc5 x:0 0 0 2024-05-06T21:26:46.640 INFO:tasks.workunit.client.0.smithi032.stdout:8/852: creat d0/d1c/d5e/d67/dc3/d97/f108 x:0 0 0 2024-05-06T21:26:46.641 INFO:tasks.workunit.client.0.smithi032.stdout:0/618: mknod d4/cc6 0 2024-05-06T21:26:46.641 INFO:tasks.workunit.client.0.smithi032.stdout:0/619: creat d4/da/d14/d4a/fc7 x:0 0 0 2024-05-06T21:26:46.642 INFO:tasks.workunit.client.0.smithi032.stdout:1/652: dwrite db/d47/d4a/fa7 [0,4194304] 0 2024-05-06T21:26:46.642 INFO:tasks.workunit.client.0.smithi032.stdout:1/653: readlink db/d16/d46/d55/l59 0 2024-05-06T21:26:46.646 INFO:tasks.workunit.client.0.smithi032.stdout:1/654: creat db/d47/d4a/dcb/fcf x:0 0 0 2024-05-06T21:26:46.650 INFO:tasks.workunit.client.1.smithi154.stdout:7/206: rename d6/de/c41 to d6/de/d21/c43 0 2024-05-06T21:26:46.650 INFO:tasks.workunit.client.1.smithi154.stdout:0/365: dwrite d6/dc/d44/f11 [0,4194304] 0 2024-05-06T21:26:46.650 INFO:tasks.workunit.client.1.smithi154.stdout:4/291: dwrite d0/d2/d2a/f2c [0,4194304] 0 2024-05-06T21:26:46.651 INFO:tasks.workunit.client.1.smithi154.stdout:8/280: write d3/d14/f19 [3293058,57697] 0 2024-05-06T21:26:46.651 INFO:tasks.workunit.client.1.smithi154.stdout:8/281: write d3/d14/d1a/f3c [1095416,71173] 0 2024-05-06T21:26:46.651 INFO:tasks.workunit.client.1.smithi154.stdout:2/285: rmdir db/d12/d4e/d55 39 2024-05-06T21:26:46.651 INFO:tasks.workunit.client.1.smithi154.stdout:9/408: dwrite d5/d14/d31/f40 [4194304,4194304] 0 2024-05-06T21:26:46.651 INFO:tasks.workunit.client.1.smithi154.stdout:9/409: read - d5/d14/f82 zero size 2024-05-06T21:26:46.651 INFO:tasks.workunit.client.0.smithi032.stdout:1/655: mkdir db/d47/d4a/da4/d4f/dd0 0 2024-05-06T21:26:46.652 INFO:tasks.workunit.client.0.smithi032.stdout:1/656: creat db/d47/d4a/fd1 x:0 0 0 2024-05-06T21:26:46.653 INFO:tasks.workunit.client.1.smithi154.stdout:7/207: unlink d6/de/d21/l33 0 2024-05-06T21:26:46.653 INFO:tasks.workunit.client.1.smithi154.stdout:7/208: write d6/d20/f1b [8803601,78117] 0 2024-05-06T21:26:46.653 INFO:tasks.workunit.client.1.smithi154.stdout:7/209: write d6/f1a [633108,105444] 0 2024-05-06T21:26:46.654 INFO:tasks.workunit.client.0.smithi032.stdout:1/657: creat db/d16/d46/d57/d58/fd2 x:0 0 0 2024-05-06T21:26:46.657 INFO:tasks.workunit.client.1.smithi154.stdout:0/366: rename d6/dc/d44/c1d to d6/dc/d3c/c75 0 2024-05-06T21:26:46.659 INFO:tasks.workunit.client.1.smithi154.stdout:4/292: mkdir d0/d2/d29/d60 0 2024-05-06T21:26:46.661 INFO:tasks.workunit.client.0.smithi032.stdout:1/658: rmdir db/d37 39 2024-05-06T21:26:46.661 INFO:tasks.workunit.client.0.smithi032.stdout:1/659: creat db/d47/d4a/dcb/fd3 x:0 0 0 2024-05-06T21:26:46.663 INFO:tasks.workunit.client.1.smithi154.stdout:2/286: mkdir db/d12/d1d/d60 0 2024-05-06T21:26:46.665 INFO:tasks.workunit.client.1.smithi154.stdout:9/410: truncate d5/f13 3441000 0 2024-05-06T21:26:46.665 INFO:tasks.workunit.client.0.smithi032.stdout:1/660: link db/d16/d46/f63 db/d16/d5d/fd4 0 2024-05-06T21:26:46.665 INFO:tasks.workunit.client.0.smithi032.stdout:1/661: write db/d47/d4a/f66 [3238262,75134] 0 2024-05-06T21:26:46.665 INFO:tasks.workunit.client.0.smithi032.stdout:1/662: chown db/d47/fc7 616725802 1 2024-05-06T21:26:46.666 INFO:tasks.workunit.client.1.smithi154.stdout:0/367: mknod d6/dc/c76 0 2024-05-06T21:26:46.667 INFO:tasks.workunit.client.1.smithi154.stdout:8/282: rmdir d3/d14/d1a/d29/d32/d33 39 2024-05-06T21:26:46.667 INFO:tasks.workunit.client.1.smithi154.stdout:0/368: dread d6/dc/d44/d36/f62 [0,4194304] 0 2024-05-06T21:26:46.668 INFO:tasks.workunit.client.1.smithi154.stdout:0/369: dread d6/dc/d44/d36/f62 [0,4194304] 0 2024-05-06T21:26:46.668 INFO:tasks.workunit.client.1.smithi154.stdout:2/287: creat db/de/d16/d33/f61 x:0 0 0 2024-05-06T21:26:46.669 INFO:tasks.workunit.client.0.smithi032.stdout:1/663: creat db/d16/da3/fd5 x:0 0 0 2024-05-06T21:26:46.669 INFO:tasks.workunit.client.1.smithi154.stdout:2/288: read db/d12/f43 [70469,59400] 0 2024-05-06T21:26:46.671 INFO:tasks.workunit.client.1.smithi154.stdout:0/370: rmdir d6/dc/d51 39 2024-05-06T21:26:46.671 INFO:tasks.workunit.client.1.smithi154.stdout:0/371: write d6/dc/d44/f11 [5219485,87738] 0 2024-05-06T21:26:46.671 INFO:tasks.workunit.client.1.smithi154.stdout:0/372: write d6/dc/f66 [1029028,61799] 0 2024-05-06T21:26:46.672 INFO:tasks.workunit.client.0.smithi032.stdout:1/664: unlink db/d16/d46/d57/lb1 0 2024-05-06T21:26:46.673 INFO:tasks.workunit.client.1.smithi154.stdout:0/373: rename d6/dc/d44/f20 to d6/dc/d51/d54/f77 0 2024-05-06T21:26:46.673 INFO:tasks.workunit.client.1.smithi154.stdout:0/374: write d6/dc/f2e [267622,92256] 0 2024-05-06T21:26:46.674 INFO:tasks.workunit.client.1.smithi154.stdout:9/411: write d5/d14/d31/f40 [887431,63369] 0 2024-05-06T21:26:46.676 INFO:tasks.workunit.client.1.smithi154.stdout:0/375: symlink d6/dc/d39/l78 0 2024-05-06T21:26:46.678 INFO:tasks.workunit.client.1.smithi154.stdout:9/412: unlink d5/d14/d87/f5c 0 2024-05-06T21:26:46.679 INFO:tasks.workunit.client.1.smithi154.stdout:9/413: chown d5/d14/d87/l6f 11410 1 2024-05-06T21:26:46.683 INFO:tasks.workunit.client.0.smithi032.stdout:9/691: dwrite d1/d13/d34/f43 [0,4194304] 0 2024-05-06T21:26:46.685 INFO:tasks.workunit.client.1.smithi154.stdout:7/210: fsync d6/f1a 0 2024-05-06T21:26:46.687 INFO:tasks.workunit.client.0.smithi032.stdout:9/692: link d1/d13/d34/d26/lcc d1/d13/d34/d26/d39/d45/le9 0 2024-05-06T21:26:46.687 INFO:tasks.workunit.client.0.smithi032.stdout:9/693: write d1/d13/d33/d3f/d60/fbd [213729,37345] 0 2024-05-06T21:26:46.687 INFO:tasks.workunit.client.0.smithi032.stdout:9/694: write d1/d13/d33/d3f/d60/f66 [390337,126299] 0 2024-05-06T21:26:46.687 INFO:tasks.workunit.client.0.smithi032.stdout:9/695: chown d1/d2f/da1/dc2/d64/dd9 25485 1 2024-05-06T21:26:46.687 INFO:tasks.workunit.client.1.smithi154.stdout:4/293: dwrite d0/d2/f1b [0,4194304] 0 2024-05-06T21:26:46.688 INFO:tasks.workunit.client.1.smithi154.stdout:7/211: symlink d6/de/d21/l44 0 2024-05-06T21:26:46.689 INFO:tasks.workunit.client.1.smithi154.stdout:4/294: read d0/f23 [305798,12903] 0 2024-05-06T21:26:46.690 INFO:tasks.workunit.client.0.smithi032.stdout:1/665: dread db/f29 [4194304,4194304] 0 2024-05-06T21:26:46.692 INFO:tasks.workunit.client.0.smithi032.stdout:9/696: creat d1/d13/d34/d26/d49/fea x:0 0 0 2024-05-06T21:26:46.692 INFO:tasks.workunit.client.0.smithi032.stdout:9/697: chown d1/d13/d34/d26/d9f/ld6 7752544 1 2024-05-06T21:26:46.692 INFO:tasks.workunit.client.0.smithi032.stdout:9/698: fsync d1/d2f/da1/dc2/f55 0 2024-05-06T21:26:46.692 INFO:tasks.workunit.client.1.smithi154.stdout:7/212: creat d6/de/d21/d2e/f45 x:0 0 0 2024-05-06T21:26:46.693 INFO:tasks.workunit.client.0.smithi032.stdout:0/620: dwrite d4/da/d14/d4a/fc7 [0,4194304] 0 2024-05-06T21:26:46.697 INFO:tasks.workunit.client.0.smithi032.stdout:9/699: mknod d1/d13/d34/d26/d39/d8b/ceb 0 2024-05-06T21:26:46.704 INFO:tasks.workunit.client.0.smithi032.stdout:0/621: symlink d4/da/lc8 0 2024-05-06T21:26:46.704 INFO:tasks.workunit.client.0.smithi032.stdout:0/622: stat d4/da/d16/l2b 0 2024-05-06T21:26:46.706 INFO:tasks.workunit.client.0.smithi032.stdout:0/623: unlink d4/da/d14/d1a/f6a 0 2024-05-06T21:26:46.712 INFO:tasks.workunit.client.1.smithi154.stdout:7/213: dread d6/f9 [4194304,4194304] 0 2024-05-06T21:26:46.717 INFO:tasks.workunit.client.0.smithi032.stdout:9/700: dread d1/f23 [0,4194304] 0 2024-05-06T21:26:46.717 INFO:tasks.workunit.client.0.smithi032.stdout:9/701: chown d1/d13/d33/fb5 693980 1 2024-05-06T21:26:46.718 INFO:tasks.workunit.client.0.smithi032.stdout:0/624: dwrite d4/da/d16/fa0 [0,4194304] 0 2024-05-06T21:26:46.721 INFO:tasks.workunit.client.0.smithi032.stdout:0/625: mkdir d4/da/d16/d33/d9e/dc9 0 2024-05-06T21:26:46.724 INFO:tasks.workunit.client.0.smithi032.stdout:0/626: rename d4/da/d16/d33/d46 to d4/d3e/d63/dca 0 2024-05-06T21:26:46.730 INFO:tasks.workunit.client.0.smithi032.stdout:9/702: dread d1/f12 [0,4194304] 0 2024-05-06T21:26:46.731 INFO:tasks.workunit.client.0.smithi032.stdout:9/703: mkdir d1/d2f/da1/dc2/d64/ddf/dec 0 2024-05-06T21:26:46.731 INFO:tasks.workunit.client.0.smithi032.stdout:9/704: stat d1/d13/d34/d92/fa5 0 2024-05-06T21:26:46.732 INFO:tasks.workunit.client.0.smithi032.stdout:9/705: mknod d1/d2f/da1/dc2/d64/ddf/ced 0 2024-05-06T21:26:46.733 INFO:tasks.workunit.client.0.smithi032.stdout:9/706: dread d1/d13/d34/d26/d39/d45/f52 [0,4194304] 0 2024-05-06T21:26:46.733 INFO:tasks.workunit.client.0.smithi032.stdout:9/707: readlink d1/d2f/da1/dc2/d64/d72/l90 0 2024-05-06T21:26:46.733 INFO:tasks.workunit.client.1.smithi154.stdout:0/376: dwrite d6/dc/d42/f59 [0,4194304] 0 2024-05-06T21:26:46.733 INFO:tasks.workunit.client.1.smithi154.stdout:0/377: readlink d6/dc/d3c/l67 0 2024-05-06T21:26:46.734 INFO:tasks.workunit.client.1.smithi154.stdout:9/414: truncate d5/d14/d31/f40 45549 0 2024-05-06T21:26:46.735 INFO:tasks.workunit.client.1.smithi154.stdout:0/378: symlink d6/dc/d40/l79 0 2024-05-06T21:26:46.736 INFO:tasks.workunit.client.1.smithi154.stdout:9/415: truncate d5/d20/d37/f5f 2788 0 2024-05-06T21:26:46.737 INFO:tasks.workunit.client.1.smithi154.stdout:4/295: dwrite d0/d2/dc/f18 [0,4194304] 0 2024-05-06T21:26:46.737 INFO:tasks.workunit.client.1.smithi154.stdout:4/296: write d0/d2/d2a/f5f [517978,9038] 0 2024-05-06T21:26:46.737 INFO:tasks.workunit.client.1.smithi154.stdout:0/379: rename d6/dc/d40/d4a/c65 to d6/dc/d44/d36/c7a 0 2024-05-06T21:26:46.737 INFO:tasks.workunit.client.1.smithi154.stdout:2/289: dwrite db/de/d16/d33/f4d [4194304,4194304] 0 2024-05-06T21:26:46.738 INFO:tasks.workunit.client.0.smithi032.stdout:1/666: dwrite db/f92 [0,4194304] 0 2024-05-06T21:26:46.738 INFO:tasks.workunit.client.1.smithi154.stdout:8/283: dwrite d3/d14/d1a/d29/d32/d33/f55 [0,4194304] 0 2024-05-06T21:26:46.739 INFO:tasks.workunit.client.1.smithi154.stdout:7/214: dwrite d6/f32 [0,4194304] 0 2024-05-06T21:26:46.739 INFO:tasks.workunit.client.1.smithi154.stdout:9/416: mknod d5/d20/d52/d59/c91 0 2024-05-06T21:26:46.739 INFO:tasks.workunit.client.1.smithi154.stdout:9/417: chown d5/d14/c5d 1 1 2024-05-06T21:26:46.739 INFO:tasks.workunit.client.1.smithi154.stdout:9/418: creat d5/d2e/d66/f92 x:0 0 0 2024-05-06T21:26:46.740 INFO:tasks.workunit.client.1.smithi154.stdout:4/297: symlink d0/d10/d11/d1a/d31/d39/d54/l61 0 2024-05-06T21:26:46.741 INFO:tasks.workunit.client.1.smithi154.stdout:0/380: rmdir d6/dc/d3c 39 2024-05-06T21:26:46.743 INFO:tasks.workunit.client.0.smithi032.stdout:1/667: unlink db/lc 0 2024-05-06T21:26:46.743 INFO:tasks.workunit.client.0.smithi032.stdout:3/747: sync 2024-05-06T21:26:46.743 INFO:tasks.workunit.client.0.smithi032.stdout:2/554: sync 2024-05-06T21:26:46.744 INFO:tasks.workunit.client.1.smithi154.stdout:7/215: write d6/f25 [2625088,104268] 0 2024-05-06T21:26:46.744 INFO:tasks.workunit.client.1.smithi154.stdout:2/290: rename db/de/d16/l49 to db/de/l62 0 2024-05-06T21:26:46.745 INFO:tasks.workunit.client.0.smithi032.stdout:2/555: creat df/d19/d1e/d42/dc6/dc1/fc8 x:0 0 0 2024-05-06T21:26:46.745 INFO:tasks.workunit.client.0.smithi032.stdout:2/556: chown df/l11 3820 1 2024-05-06T21:26:46.745 INFO:tasks.workunit.client.0.smithi032.stdout:2/557: truncate df/d19/d1e/d35/f6d 4894242 0 2024-05-06T21:26:46.752 INFO:tasks.workunit.client.0.smithi032.stdout:5/599: sync 2024-05-06T21:26:46.752 INFO:tasks.workunit.client.0.smithi032.stdout:6/720: sync 2024-05-06T21:26:46.753 INFO:tasks.workunit.client.0.smithi032.stdout:5/600: symlink d0/d16/d2a/d59/d67/d73/lb5 0 2024-05-06T21:26:46.757 INFO:tasks.workunit.client.0.smithi032.stdout:6/721: read d8/dd/d18/d13/fa5 [1052695,35627] 0 2024-05-06T21:26:46.760 INFO:tasks.workunit.client.0.smithi032.stdout:6/722: unlink d8/d3d/d49/cbe 0 2024-05-06T21:26:46.761 INFO:tasks.workunit.client.0.smithi032.stdout:5/601: dread d0/fe [4194304,4194304] 0 2024-05-06T21:26:46.762 INFO:tasks.workunit.client.1.smithi154.stdout:9/419: mknod d5/d20/d84/c93 0 2024-05-06T21:26:46.762 INFO:tasks.workunit.client.1.smithi154.stdout:4/298: mknod d0/d2/dc/c62 0 2024-05-06T21:26:46.763 INFO:tasks.workunit.client.1.smithi154.stdout:9/420: dread d5/d20/f4b [0,4194304] 0 2024-05-06T21:26:46.763 INFO:tasks.workunit.client.0.smithi032.stdout:5/602: rename d0/d24/d26/l29 to d0/d24/d26/d3d/d50/d5a/lb6 0 2024-05-06T21:26:46.764 INFO:tasks.workunit.client.0.smithi032.stdout:5/603: fsync d0/d16/f1c 0 2024-05-06T21:26:46.764 INFO:tasks.workunit.client.0.smithi032.stdout:5/604: dread - d0/d16/d46/fae zero size 2024-05-06T21:26:46.764 INFO:tasks.workunit.client.1.smithi154.stdout:0/381: creat d6/dc/d40/d4a/d6c/f7b x:0 0 0 2024-05-06T21:26:46.764 INFO:tasks.workunit.client.0.smithi032.stdout:6/723: write d8/f31 [230638,34120] 0 2024-05-06T21:26:46.766 INFO:tasks.workunit.client.0.smithi032.stdout:6/724: unlink d8/d3d/d8f/fc7 0 2024-05-06T21:26:46.767 INFO:tasks.workunit.client.1.smithi154.stdout:7/216: mkdir d6/d46 0 2024-05-06T21:26:46.768 INFO:tasks.workunit.client.1.smithi154.stdout:2/291: mkdir db/d12/d1d/d60/d63 0 2024-05-06T21:26:46.768 INFO:tasks.workunit.client.1.smithi154.stdout:2/292: chown db/d12/d19/l20 37 1 2024-05-06T21:26:46.769 INFO:tasks.workunit.client.0.smithi032.stdout:6/725: creat d8/dd/d18/d3b/db9/fd6 x:0 0 0 2024-05-06T21:26:46.769 INFO:tasks.workunit.client.0.smithi032.stdout:6/726: write d8/dd/d1b/d67/fa6 [707658,102309] 0 2024-05-06T21:26:46.770 INFO:tasks.workunit.client.0.smithi032.stdout:6/727: creat d8/d3d/d49/dad/fd7 x:0 0 0 2024-05-06T21:26:46.774 INFO:tasks.workunit.client.0.smithi032.stdout:2/558: dwrite df/d19/d1e/d71/d5f/d7d/d65/f67 [0,4194304] 0 2024-05-06T21:26:46.774 INFO:tasks.workunit.client.0.smithi032.stdout:6/728: creat d8/d3d/d73/d87/fd8 x:0 0 0 2024-05-06T21:26:46.775 INFO:tasks.workunit.client.1.smithi154.stdout:4/299: mkdir d0/d10/d11/d1a/d31/d39/d63 0 2024-05-06T21:26:46.775 INFO:tasks.workunit.client.1.smithi154.stdout:9/421: creat d5/d14/f94 x:0 0 0 2024-05-06T21:26:46.775 INFO:tasks.workunit.client.1.smithi154.stdout:2/293: rename db/de/d10/f14 to db/d12/d1d/f64 0 2024-05-06T21:26:46.775 INFO:tasks.workunit.client.1.smithi154.stdout:8/284: dwrite d3/f54 [0,4194304] 0 2024-05-06T21:26:46.775 INFO:tasks.workunit.client.1.smithi154.stdout:5/306: sync 2024-05-06T21:26:46.775 INFO:tasks.workunit.client.1.smithi154.stdout:1/314: sync 2024-05-06T21:26:46.775 INFO:tasks.workunit.client.1.smithi154.stdout:5/307: stat d2/d3/d21/c3e 0 2024-05-06T21:26:46.776 INFO:tasks.workunit.client.1.smithi154.stdout:3/425: sync 2024-05-06T21:26:46.776 INFO:tasks.workunit.client.1.smithi154.stdout:6/232: sync 2024-05-06T21:26:46.776 INFO:tasks.workunit.client.1.smithi154.stdout:3/426: chown d0/da/d1a/d28/d4d 0 1 2024-05-06T21:26:46.776 INFO:tasks.workunit.client.1.smithi154.stdout:3/427: dread - d0/da/d1a/d28/d2f/d81/f74 zero size 2024-05-06T21:26:46.776 INFO:tasks.workunit.client.1.smithi154.stdout:9/422: unlink d5/d14/d31/f75 0 2024-05-06T21:26:46.776 INFO:tasks.workunit.client.1.smithi154.stdout:9/423: chown d5/d14/d31/c86 106280397 1 2024-05-06T21:26:46.776 INFO:tasks.workunit.client.1.smithi154.stdout:9/424: truncate d5/d2e/d66/f92 156520 0 2024-05-06T21:26:46.776 INFO:tasks.workunit.client.0.smithi032.stdout:6/729: mkdir d8/d3d/d49/dd9 0 2024-05-06T21:26:46.777 INFO:tasks.workunit.client.1.smithi154.stdout:2/294: creat db/de/d16/f65 x:0 0 0 2024-05-06T21:26:46.777 INFO:tasks.workunit.client.1.smithi154.stdout:2/295: write db/de/f5d [493580,101547] 0 2024-05-06T21:26:46.778 INFO:tasks.workunit.client.0.smithi032.stdout:5/605: write d0/d16/d2f/f6f [1754782,61854] 0 2024-05-06T21:26:46.778 INFO:tasks.workunit.client.0.smithi032.stdout:5/606: readlink d0/d24/d26/d3d/lb4 0 2024-05-06T21:26:46.781 INFO:tasks.workunit.client.1.smithi154.stdout:5/308: dread d2/d6/f7 [0,4194304] 0 2024-05-06T21:26:46.781 INFO:tasks.workunit.client.0.smithi032.stdout:5/607: creat d0/d16/d2a/d59/d67/d73/da3/fb7 x:0 0 0 2024-05-06T21:26:46.783 INFO:tasks.workunit.client.1.smithi154.stdout:8/285: rename d3/d14/d1a/d29/d32/d33 to d3/d14/d1a/d29/d32/d40/d59 0 2024-05-06T21:26:46.783 INFO:tasks.workunit.client.1.smithi154.stdout:9/425: rename d5/d2e/d66 to d5/d2e/d66/d95 22 2024-05-06T21:26:46.784 INFO:tasks.workunit.client.1.smithi154.stdout:1/315: truncate d6/f17 3675625 0 2024-05-06T21:26:46.784 INFO:tasks.workunit.client.0.smithi032.stdout:5/608: unlink d0/d16/d2f/c47 0 2024-05-06T21:26:46.784 INFO:tasks.workunit.client.0.smithi032.stdout:5/609: fsync d0/d4e/f68 0 2024-05-06T21:26:46.787 INFO:tasks.workunit.client.1.smithi154.stdout:6/233: symlink d8/d11/d51/l53 0 2024-05-06T21:26:46.787 INFO:tasks.workunit.client.1.smithi154.stdout:3/428: symlink d0/da/d1a/d28/d2f/d81/l91 0 2024-05-06T21:26:46.788 INFO:tasks.workunit.client.1.smithi154.stdout:6/234: chown d8/f23 4 1 2024-05-06T21:26:46.788 INFO:tasks.workunit.client.1.smithi154.stdout:0/382: dread d6/dc/d51/d54/f77 [0,4194304] 0 2024-05-06T21:26:46.788 INFO:tasks.workunit.client.1.smithi154.stdout:8/286: creat d3/d14/d1a/d45/f5a x:0 0 0 2024-05-06T21:26:46.790 INFO:tasks.workunit.client.1.smithi154.stdout:2/296: rename db/de/d16/d4f/d4c/f5c to db/d12/d1d/d60/d63/f66 0 2024-05-06T21:26:46.790 INFO:tasks.workunit.client.1.smithi154.stdout:9/426: write d5/d14/d31/d39/f68 [2823461,91461] 0 2024-05-06T21:26:46.791 INFO:tasks.workunit.client.1.smithi154.stdout:6/235: creat d8/d11/d33/d4a/f54 x:0 0 0 2024-05-06T21:26:46.793 INFO:tasks.workunit.client.1.smithi154.stdout:3/429: symlink d0/da/d1a/d28/d2f/d81/d48/l92 0 2024-05-06T21:26:46.794 INFO:tasks.workunit.client.0.smithi032.stdout:5/610: write d0/d24/d34/f92 [4153822,115874] 0 2024-05-06T21:26:46.795 INFO:tasks.workunit.client.1.smithi154.stdout:0/383: symlink d6/dc/d40/d41/d70/l7c 0 2024-05-06T21:26:46.795 INFO:tasks.workunit.client.1.smithi154.stdout:7/217: dwrite d6/de/f31 [0,4194304] 0 2024-05-06T21:26:46.796 INFO:tasks.workunit.client.1.smithi154.stdout:7/218: chown d6/de/c12 4623 1 2024-05-06T21:26:46.796 INFO:tasks.workunit.client.1.smithi154.stdout:3/430: dread d0/da/d1a/d28/d17/f54 [0,4194304] 0 2024-05-06T21:26:46.796 INFO:tasks.workunit.client.1.smithi154.stdout:3/431: write d0/da/db/dd/d1c/f86 [4352372,114081] 0 2024-05-06T21:26:46.797 INFO:tasks.workunit.client.1.smithi154.stdout:8/287: link d3/d14/c2d d3/d14/d1a/d29/d32/c5b 0 2024-05-06T21:26:46.800 INFO:tasks.workunit.client.1.smithi154.stdout:2/297: creat db/de/d10/f67 x:0 0 0 2024-05-06T21:26:46.801 INFO:tasks.workunit.client.1.smithi154.stdout:9/427: rename d5/d14/c5d to d5/d20/d37/c96 0 2024-05-06T21:26:46.803 INFO:tasks.workunit.client.1.smithi154.stdout:0/384: creat d6/dc/d3c/f7d x:0 0 0 2024-05-06T21:26:46.803 INFO:tasks.workunit.client.1.smithi154.stdout:0/385: fdatasync d6/dc/f24 0 2024-05-06T21:26:46.804 INFO:tasks.workunit.client.1.smithi154.stdout:7/219: rmdir d6/de/d23 39 2024-05-06T21:26:46.804 INFO:tasks.workunit.client.1.smithi154.stdout:7/220: chown d6/de/d21/d2e/f45 23 1 2024-05-06T21:26:46.804 INFO:tasks.workunit.client.1.smithi154.stdout:7/221: chown d6/f1a 1456449242 1 2024-05-06T21:26:46.804 INFO:tasks.workunit.client.1.smithi154.stdout:4/300: dwrite d0/d2/dc/f5c [0,4194304] 0 2024-05-06T21:26:46.804 INFO:tasks.workunit.client.1.smithi154.stdout:4/301: write d0/d2/dc/f16 [1230194,72823] 0 2024-05-06T21:26:46.806 INFO:tasks.workunit.client.1.smithi154.stdout:2/298: mknod db/d12/d4e/c68 0 2024-05-06T21:26:46.807 INFO:tasks.workunit.client.1.smithi154.stdout:3/432: dread d0/da/d1a/d28/d2f/f34 [0,4194304] 0 2024-05-06T21:26:46.807 INFO:tasks.workunit.client.1.smithi154.stdout:3/433: write d0/da/db/dd/d1c/f86 [4581487,74335] 0 2024-05-06T21:26:46.808 INFO:tasks.workunit.client.1.smithi154.stdout:9/428: mknod d5/d89/c97 0 2024-05-06T21:26:46.810 INFO:tasks.workunit.client.1.smithi154.stdout:5/309: dwrite d2/d6/f13 [0,4194304] 0 2024-05-06T21:26:46.810 INFO:tasks.workunit.client.1.smithi154.stdout:5/310: readlink d2/d6/dd/l1c 0 2024-05-06T21:26:46.810 INFO:tasks.workunit.client.1.smithi154.stdout:5/311: dread - d2/d3/d21/f60 zero size 2024-05-06T21:26:46.812 INFO:tasks.workunit.client.1.smithi154.stdout:0/386: link d6/dc/d44/f31 d6/dc/d40/d41/d70/f7e 0 2024-05-06T21:26:46.812 INFO:tasks.workunit.client.1.smithi154.stdout:1/316: dwrite d6/d3e/f4d [0,4194304] 0 2024-05-06T21:26:46.812 INFO:tasks.workunit.client.1.smithi154.stdout:1/317: chown d6/db/d10/c13 3930 1 2024-05-06T21:26:46.815 INFO:tasks.workunit.client.1.smithi154.stdout:0/387: read d6/dc/f66 [1008390,62187] 0 2024-05-06T21:26:46.815 INFO:tasks.workunit.client.1.smithi154.stdout:0/388: readlink d6/dc/d40/d4a/l56 0 2024-05-06T21:26:46.816 INFO:tasks.workunit.client.0.smithi032.stdout:6/730: rename d8/d3d/d8f to d8/dd/d18/dda 0 2024-05-06T21:26:46.816 INFO:tasks.workunit.client.0.smithi032.stdout:6/731: write d8/dd/d18/d3b/fcf [101494,49042] 0 2024-05-06T21:26:46.817 INFO:tasks.workunit.client.1.smithi154.stdout:3/434: mknod d0/da/d1a/d28/d4d/c93 0 2024-05-06T21:26:46.817 INFO:tasks.workunit.client.1.smithi154.stdout:7/222: dread d6/de/d23/f28 [0,4194304] 0 2024-05-06T21:26:46.820 INFO:tasks.workunit.client.0.smithi032.stdout:5/611: rename d0/d24/d26/d3d/d50/d5a/f71 to d0/d24/d38/db0/db1/fb8 0 2024-05-06T21:26:46.822 INFO:tasks.workunit.client.1.smithi154.stdout:8/288: dwrite d3/f9 [4194304,4194304] 0 2024-05-06T21:26:46.822 INFO:tasks.workunit.client.1.smithi154.stdout:8/289: rename d3/d14/d1a/d22 to d3/d14/d1a/d22/d5c 22 2024-05-06T21:26:46.822 INFO:tasks.workunit.client.1.smithi154.stdout:8/290: fsync d3/d14/d1a/d22/f23 0 2024-05-06T21:26:46.822 INFO:tasks.workunit.client.1.smithi154.stdout:5/312: truncate d2/d3/f35 3532063 0 2024-05-06T21:26:46.822 INFO:tasks.workunit.client.1.smithi154.stdout:5/313: write d2/d3/d21/d22/d25/d37/f40 [5051196,79720] 0 2024-05-06T21:26:46.822 INFO:tasks.workunit.client.0.smithi032.stdout:5/612: creat d0/d24/d26/d32/fb9 x:0 0 0 2024-05-06T21:26:46.824 INFO:tasks.workunit.client.0.smithi032.stdout:5/613: symlink d0/d24/d26/d3d/lba 0 2024-05-06T21:26:46.825 INFO:tasks.workunit.client.1.smithi154.stdout:1/318: creat d6/db/d10/f63 x:0 0 0 2024-05-06T21:26:46.825 INFO:tasks.workunit.client.1.smithi154.stdout:1/319: truncate d6/db/d10/d15/d1d/f61 944303 0 2024-05-06T21:26:46.826 INFO:tasks.workunit.client.0.smithi032.stdout:5/614: creat d0/d28/dad/fbb x:0 0 0 2024-05-06T21:26:46.827 INFO:tasks.workunit.client.0.smithi032.stdout:5/615: mkdir d0/d16/d2f/d77/d99/dbc 0 2024-05-06T21:26:46.828 INFO:tasks.workunit.client.0.smithi032.stdout:5/616: stat d0/l20 0 2024-05-06T21:26:46.828 INFO:tasks.workunit.client.0.smithi032.stdout:5/617: dread - d0/d24/d38/f9c zero size 2024-05-06T21:26:46.829 INFO:tasks.workunit.client.1.smithi154.stdout:7/223: truncate d6/f10 36958 0 2024-05-06T21:26:46.829 INFO:tasks.workunit.client.1.smithi154.stdout:3/435: symlink d0/da/db/d7c/d80/l94 0 2024-05-06T21:26:46.831 INFO:tasks.workunit.client.1.smithi154.stdout:4/302: dwrite d0/d2/d29/f56 [0,4194304] 0 2024-05-06T21:26:46.831 INFO:tasks.workunit.client.1.smithi154.stdout:4/303: chown d0/d10/d11/d1a/d31/d39/c52 195252 1 2024-05-06T21:26:46.831 INFO:tasks.workunit.client.1.smithi154.stdout:8/291: chown d3/d14/d1a/d22/d26/l4c 1952401 1 2024-05-06T21:26:46.831 INFO:tasks.workunit.client.1.smithi154.stdout:8/292: chown d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f51 98751 1 2024-05-06T21:26:46.833 INFO:tasks.workunit.client.1.smithi154.stdout:5/314: mkdir d2/d6/dc/d68 0 2024-05-06T21:26:46.839 INFO:tasks.workunit.client.1.smithi154.stdout:1/320: dread d6/db/f34 [0,4194304] 0 2024-05-06T21:26:46.841 INFO:tasks.workunit.client.1.smithi154.stdout:7/224: read d6/f32 [2942966,94320] 0 2024-05-06T21:26:46.841 INFO:tasks.workunit.client.1.smithi154.stdout:7/225: fdatasync d6/fd 0 2024-05-06T21:26:46.842 INFO:tasks.workunit.client.1.smithi154.stdout:3/436: mknod d0/da/d1a/c95 0 2024-05-06T21:26:46.842 INFO:tasks.workunit.client.1.smithi154.stdout:4/304: truncate d0/d2/f1c 5147263 0 2024-05-06T21:26:46.842 INFO:tasks.workunit.client.1.smithi154.stdout:5/315: rename d2/d6/dd/d57 to d2/d6/dc/d68/d69 0 2024-05-06T21:26:46.842 INFO:tasks.workunit.client.1.smithi154.stdout:8/293: dread d3/fc [0,4194304] 0 2024-05-06T21:26:46.843 INFO:tasks.workunit.client.1.smithi154.stdout:3/437: creat d0/da/d1a/d28/d4d/f96 x:0 0 0 2024-05-06T21:26:46.844 INFO:tasks.workunit.client.1.smithi154.stdout:3/438: fdatasync d0/da/db/dd/d1c/d21/f4e 0 2024-05-06T21:26:46.845 INFO:tasks.workunit.client.1.smithi154.stdout:1/321: dread d6/f24 [0,4194304] 0 2024-05-06T21:26:46.845 INFO:tasks.workunit.client.1.smithi154.stdout:1/322: rename d6 to d6/db/d10/d15/d64 22 2024-05-06T21:26:46.845 INFO:tasks.workunit.client.1.smithi154.stdout:1/323: stat d6/db/d10/d15/f39 0 2024-05-06T21:26:46.845 INFO:tasks.workunit.client.1.smithi154.stdout:1/324: write d6/db/d10/f51 [2024468,5743] 0 2024-05-06T21:26:46.845 INFO:tasks.workunit.client.1.smithi154.stdout:8/294: unlink d3/d14/d1a/d22/c2e 0 2024-05-06T21:26:46.845 INFO:tasks.workunit.client.1.smithi154.stdout:8/295: readlink d3/d14/d1a/d29/d32/l37 0 2024-05-06T21:26:46.846 INFO:tasks.workunit.client.1.smithi154.stdout:1/325: symlink d6/d3e/l65 0 2024-05-06T21:26:46.851 INFO:tasks.workunit.client.1.smithi154.stdout:8/296: truncate d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f51 891246 0 2024-05-06T21:26:46.851 INFO:tasks.workunit.client.1.smithi154.stdout:4/305: write d0/d2/d2a/f37 [919491,59991] 0 2024-05-06T21:26:46.851 INFO:tasks.workunit.client.1.smithi154.stdout:1/326: truncate d6/f28 1613255 0 2024-05-06T21:26:46.851 INFO:tasks.workunit.client.1.smithi154.stdout:1/327: write d6/db/d10/f35 [964545,76117] 0 2024-05-06T21:26:46.852 INFO:tasks.workunit.client.1.smithi154.stdout:0/389: dwrite d6/f53 [0,4194304] 0 2024-05-06T21:26:46.852 INFO:tasks.workunit.client.1.smithi154.stdout:0/390: chown d6/dc/d44/f6d 5 1 2024-05-06T21:26:46.852 INFO:tasks.workunit.client.1.smithi154.stdout:0/391: chown d6/dc/d40/d41 3 1 2024-05-06T21:26:46.852 INFO:tasks.workunit.client.1.smithi154.stdout:0/392: chown d6/l49 0 1 2024-05-06T21:26:46.853 INFO:tasks.workunit.client.1.smithi154.stdout:2/299: dwrite db/de/d16/d33/f44 [0,4194304] 0 2024-05-06T21:26:46.853 INFO:tasks.workunit.client.1.smithi154.stdout:4/306: mknod d0/d2/d29/c64 0 2024-05-06T21:26:46.855 INFO:tasks.workunit.client.0.smithi032.stdout:5/618: dwrite d0/d24/d34/f4f [0,4194304] 0 2024-05-06T21:26:46.855 INFO:tasks.workunit.client.1.smithi154.stdout:8/297: creat d3/d14/d1a/d29/d43/f5d x:0 0 0 2024-05-06T21:26:46.857 INFO:tasks.workunit.client.1.smithi154.stdout:1/328: creat d6/f66 x:0 0 0 2024-05-06T21:26:46.857 INFO:tasks.workunit.client.1.smithi154.stdout:1/329: chown d6/db/d10/f33 276004294 1 2024-05-06T21:26:46.860 INFO:tasks.workunit.client.0.smithi032.stdout:5/619: creat d0/d16/d46/da9/fbd x:0 0 0 2024-05-06T21:26:46.860 INFO:tasks.workunit.client.0.smithi032.stdout:5/620: fsync d0/d16/f85 0 2024-05-06T21:26:46.860 INFO:tasks.workunit.client.0.smithi032.stdout:5/621: chown d0/d24/d26/d3d/d50/f5d 11 1 2024-05-06T21:26:46.860 INFO:tasks.workunit.client.0.smithi032.stdout:5/622: truncate d0/d24/d26/d3d/d50/f6e 1975607 0 2024-05-06T21:26:46.862 INFO:tasks.workunit.client.1.smithi154.stdout:0/393: rmdir d6/dc/d40/d41 39 2024-05-06T21:26:46.862 INFO:tasks.workunit.client.1.smithi154.stdout:0/394: readlink d6/dc/d40/d41/l43 0 2024-05-06T21:26:46.862 INFO:tasks.workunit.client.1.smithi154.stdout:0/395: creat d6/dc/d42/f7f x:0 0 0 2024-05-06T21:26:46.863 INFO:tasks.workunit.client.0.smithi032.stdout:5/623: rename d0/d24/d38/d37/c8a to d0/d24/d34/cbe 0 2024-05-06T21:26:46.863 INFO:tasks.workunit.client.0.smithi032.stdout:5/624: fsync d0/d24/d38/f3c 0 2024-05-06T21:26:46.865 INFO:tasks.workunit.client.1.smithi154.stdout:2/300: truncate db/d12/d4e/d55/f5e 1512646 0 2024-05-06T21:26:46.865 INFO:tasks.workunit.client.1.smithi154.stdout:2/301: stat db/de/d16/d4f/l34 0 2024-05-06T21:26:46.865 INFO:tasks.workunit.client.1.smithi154.stdout:2/302: stat db/de/d16/f65 0 2024-05-06T21:26:46.871 INFO:tasks.workunit.client.1.smithi154.stdout:0/396: creat d6/dc/d51/f80 x:0 0 0 2024-05-06T21:26:46.871 INFO:tasks.workunit.client.1.smithi154.stdout:0/397: fdatasync d6/dc/d51/d54/f74 0 2024-05-06T21:26:46.872 INFO:tasks.workunit.client.1.smithi154.stdout:2/303: rmdir db/de 39 2024-05-06T21:26:46.874 INFO:tasks.workunit.client.1.smithi154.stdout:7/226: dwrite d6/f3b [0,4194304] 0 2024-05-06T21:26:46.875 INFO:tasks.workunit.client.1.smithi154.stdout:5/316: dwrite d2/d6/f5f [0,4194304] 0 2024-05-06T21:26:46.875 INFO:tasks.workunit.client.1.smithi154.stdout:5/317: dread - d2/d3/d21/d22/f2e zero size 2024-05-06T21:26:46.877 INFO:tasks.workunit.client.1.smithi154.stdout:8/298: symlink d3/d14/d1a/d22/d26/d2b/l5e 0 2024-05-06T21:26:46.877 INFO:tasks.workunit.client.1.smithi154.stdout:8/299: creat d3/d14/d1a/d45/f5f x:0 0 0 2024-05-06T21:26:46.878 INFO:tasks.workunit.client.1.smithi154.stdout:8/300: truncate d3/f54 4580270 0 2024-05-06T21:26:46.878 INFO:tasks.workunit.client.1.smithi154.stdout:8/301: fdatasync d3/d14/d1a/d45/f5a 0 2024-05-06T21:26:46.881 INFO:tasks.workunit.client.1.smithi154.stdout:2/304: truncate db/f13 5489361 0 2024-05-06T21:26:46.881 INFO:tasks.workunit.client.1.smithi154.stdout:2/305: readlink db/de/d10/l2f 0 2024-05-06T21:26:46.881 INFO:tasks.workunit.client.1.smithi154.stdout:2/306: creat db/de/d10/f69 x:0 0 0 2024-05-06T21:26:46.883 INFO:tasks.workunit.client.1.smithi154.stdout:1/330: rmdir d6/db/d10 39 2024-05-06T21:26:46.885 INFO:tasks.workunit.client.0.smithi032.stdout:5/625: dwrite d0/d16/d2f/f6f [0,4194304] 0 2024-05-06T21:26:46.887 INFO:tasks.workunit.client.1.smithi154.stdout:5/318: truncate d2/d6/dd/d2a/d54/f65 2796212 0 2024-05-06T21:26:46.887 INFO:tasks.workunit.client.0.smithi032.stdout:5/626: mknod d0/d24/cbf 0 2024-05-06T21:26:46.888 INFO:tasks.workunit.client.1.smithi154.stdout:3/439: dwrite d0/d2/d22/f47 [0,4194304] 0 2024-05-06T21:26:46.888 INFO:tasks.workunit.client.1.smithi154.stdout:3/440: fsync d0/da/d1a/f44 0 2024-05-06T21:26:46.889 INFO:tasks.workunit.client.0.smithi032.stdout:5/627: mkdir d0/d24/d38/d37/d7b/dc0 0 2024-05-06T21:26:46.893 INFO:tasks.workunit.client.0.smithi032.stdout:5/628: dread d0/d16/d2f/f41 [0,4194304] 0 2024-05-06T21:26:46.893 INFO:tasks.workunit.client.0.smithi032.stdout:5/629: dread - d0/d16/d2a/d5f/f9b zero size 2024-05-06T21:26:46.894 INFO:tasks.workunit.client.0.smithi032.stdout:5/630: symlink d0/d16/d46/lc1 0 2024-05-06T21:26:46.895 INFO:tasks.workunit.client.0.smithi032.stdout:5/631: creat d0/d24/d38/d37/d7b/fc2 x:0 0 0 2024-05-06T21:26:46.896 INFO:tasks.workunit.client.0.smithi032.stdout:5/632: mknod d0/d24/d38/db0/cc3 0 2024-05-06T21:26:46.896 INFO:tasks.workunit.client.0.smithi032.stdout:5/633: getdents d0/d16/d2f/d77/d99/dbc 0 2024-05-06T21:26:46.897 INFO:tasks.workunit.client.1.smithi154.stdout:2/307: symlink db/d12/d1d/d60/d63/l6a 0 2024-05-06T21:26:46.897 INFO:tasks.workunit.client.1.smithi154.stdout:2/308: truncate db/de/d10/f67 37967 0 2024-05-06T21:26:46.897 INFO:tasks.workunit.client.1.smithi154.stdout:2/309: fdatasync db/de/d10/f5f 0 2024-05-06T21:26:46.897 INFO:tasks.workunit.client.1.smithi154.stdout:2/310: read db/de/d16/f1f [2943086,63714] 0 2024-05-06T21:26:46.897 INFO:tasks.workunit.client.0.smithi032.stdout:5/634: unlink d0/d16/d2a/c9e 0 2024-05-06T21:26:46.898 INFO:tasks.workunit.client.0.smithi032.stdout:5/635: mkdir d0/d24/d38/dc4 0 2024-05-06T21:26:46.899 INFO:tasks.workunit.client.1.smithi154.stdout:1/331: mknod d6/db/d10/d26/d1b/c67 0 2024-05-06T21:26:46.900 INFO:tasks.workunit.client.0.smithi032.stdout:5/636: mkdir d0/d16/d2a/d59/dc5 0 2024-05-06T21:26:46.900 INFO:tasks.workunit.client.0.smithi032.stdout:5/637: readlink d0/d24/d26/d3d/lba 0 2024-05-06T21:26:46.900 INFO:tasks.workunit.client.0.smithi032.stdout:5/638: chown d0/d24/d38/db0/db1 7 1 2024-05-06T21:26:46.900 INFO:tasks.workunit.client.0.smithi032.stdout:5/639: chown d0/d24/d26/d3d/d50/f6e 201570 1 2024-05-06T21:26:46.900 INFO:tasks.workunit.client.0.smithi032.stdout:5/640: fdatasync d0/d28/dad/fbb 0 2024-05-06T21:26:46.900 INFO:tasks.workunit.client.0.smithi032.stdout:5/641: stat d0/d24 0 2024-05-06T21:26:46.901 INFO:tasks.workunit.client.0.smithi032.stdout:5/642: creat d0/d24/d38/d37/d7b/dc0/fc6 x:0 0 0 2024-05-06T21:26:46.901 INFO:tasks.workunit.client.1.smithi154.stdout:3/441: dread d0/da/db/dd/f3c [0,4194304] 0 2024-05-06T21:26:46.901 INFO:tasks.workunit.client.1.smithi154.stdout:5/319: mknod d2/d3/d21/d22/d25/c6a 0 2024-05-06T21:26:46.901 INFO:tasks.workunit.client.1.smithi154.stdout:5/320: stat d2/d48/c5e 0 2024-05-06T21:26:46.901 INFO:tasks.workunit.client.1.smithi154.stdout:5/321: dread - d2/d6/dd/f64 zero size 2024-05-06T21:26:46.901 INFO:tasks.workunit.client.1.smithi154.stdout:5/322: fsync d2/d6/f7 0 2024-05-06T21:26:46.902 INFO:tasks.workunit.client.0.smithi032.stdout:5/643: mkdir d0/d16/d2a/dc7 0 2024-05-06T21:26:46.902 INFO:tasks.workunit.client.0.smithi032.stdout:5/644: fdatasync d0/d16/d2a/d59/d67/d73/f76 0 2024-05-06T21:26:46.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/645: fsync d0/d4e/f68 0 2024-05-06T21:26:46.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/646: chown d0/d24/f7e 1 1 2024-05-06T21:26:46.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/647: fdatasync d0/d24/d38/f3c 0 2024-05-06T21:26:46.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/648: getdents d0/d16/d2a/d5f/d9a 0 2024-05-06T21:26:46.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/649: dread - d0/d16/d2a/d59/d67/d73/da3/fb7 zero size 2024-05-06T21:26:46.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/650: fdatasync d0/d24/d38/f8d 0 2024-05-06T21:26:46.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/651: chown d0/d24/d38/db0 3665 1 2024-05-06T21:26:46.903 INFO:tasks.workunit.client.1.smithi154.stdout:2/311: unlink db/de/l41 0 2024-05-06T21:26:46.905 INFO:tasks.workunit.client.1.smithi154.stdout:1/332: unlink d6/db/d10/d26/l4c 0 2024-05-06T21:26:46.908 INFO:tasks.workunit.client.1.smithi154.stdout:8/302: dwrite d3/f10 [0,4194304] 0 2024-05-06T21:26:46.908 INFO:tasks.workunit.client.1.smithi154.stdout:3/442: mkdir d0/da/db/dd/d1c/d90/d97 0 2024-05-06T21:26:46.908 INFO:tasks.workunit.client.1.smithi154.stdout:0/398: dwrite d6/dc/d51/d54/f74 [0,4194304] 0 2024-05-06T21:26:46.909 INFO:tasks.workunit.client.1.smithi154.stdout:7/227: dwrite d6/d20/f1d [0,4194304] 0 2024-05-06T21:26:46.911 INFO:tasks.workunit.client.1.smithi154.stdout:2/312: unlink db/d12/d1d/d60/d63/l6a 0 2024-05-06T21:26:46.911 INFO:tasks.workunit.client.1.smithi154.stdout:2/313: stat db/d12/d4e/d55/f5e 0 2024-05-06T21:26:46.911 INFO:tasks.workunit.client.1.smithi154.stdout:2/314: write db/de/d16/f28 [89839,104260] 0 2024-05-06T21:26:46.912 INFO:tasks.workunit.client.1.smithi154.stdout:1/333: symlink d6/db/d10/l68 0 2024-05-06T21:26:46.912 INFO:tasks.workunit.client.1.smithi154.stdout:4/307: rmdir d0/d2 39 2024-05-06T21:26:46.912 INFO:tasks.workunit.client.1.smithi154.stdout:4/308: creat d0/d10/f65 x:0 0 0 2024-05-06T21:26:46.915 INFO:tasks.workunit.client.1.smithi154.stdout:8/303: creat d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f60 x:0 0 0 2024-05-06T21:26:46.921 INFO:tasks.workunit.client.1.smithi154.stdout:7/228: mkdir d6/d42/d47 0 2024-05-06T21:26:46.922 INFO:tasks.workunit.client.1.smithi154.stdout:2/315: truncate db/de/d16/f1f 1993048 0 2024-05-06T21:26:46.922 INFO:tasks.workunit.client.1.smithi154.stdout:2/316: stat db/c29 0 2024-05-06T21:26:46.923 INFO:tasks.workunit.client.1.smithi154.stdout:1/334: mkdir d6/db/d69 0 2024-05-06T21:26:46.923 INFO:tasks.workunit.client.1.smithi154.stdout:3/443: write d0/da/d1a/d28/d17/f1e [3763554,13574] 0 2024-05-06T21:26:46.926 INFO:tasks.workunit.client.1.smithi154.stdout:4/309: creat d0/d2/f66 x:0 0 0 2024-05-06T21:26:46.926 INFO:tasks.workunit.client.1.smithi154.stdout:4/310: chown d0/d10/d11/c27 1846 1 2024-05-06T21:26:46.927 INFO:tasks.workunit.client.1.smithi154.stdout:8/304: mkdir d3/d14/d1a/d22/d61 0 2024-05-06T21:26:46.930 INFO:tasks.workunit.client.1.smithi154.stdout:1/335: rename d6/db/c38 to d6/db/d10/d15/d1d/d53/c6a 0 2024-05-06T21:26:46.932 INFO:tasks.workunit.client.1.smithi154.stdout:3/444: creat d0/da/db/d30/f98 x:0 0 0 2024-05-06T21:26:46.934 INFO:tasks.workunit.client.1.smithi154.stdout:4/311: mknod d0/c67 0 2024-05-06T21:26:46.934 INFO:tasks.workunit.client.1.smithi154.stdout:2/317: dread db/de/d10/f30 [0,4194304] 0 2024-05-06T21:26:46.935 INFO:tasks.workunit.client.1.smithi154.stdout:8/305: symlink d3/d14/d1a/d29/d32/d40/d4b/d4d/l62 0 2024-05-06T21:26:46.936 INFO:tasks.workunit.client.1.smithi154.stdout:1/336: getdents d6/db/d10/d15/d1d 0 2024-05-06T21:26:46.936 INFO:tasks.workunit.client.1.smithi154.stdout:1/337: fsync d6/f52 0 2024-05-06T21:26:46.939 INFO:tasks.workunit.client.1.smithi154.stdout:3/445: creat d0/da/db/dd/d1c/d21/d37/f99 x:0 0 0 2024-05-06T21:26:46.941 INFO:tasks.workunit.client.1.smithi154.stdout:4/312: creat d0/d10/d11/d1a/d31/d44/f68 x:0 0 0 2024-05-06T21:26:46.942 INFO:tasks.workunit.client.1.smithi154.stdout:5/323: dwrite d2/f1d [4194304,4194304] 0 2024-05-06T21:26:46.942 INFO:tasks.workunit.client.1.smithi154.stdout:5/324: truncate d2/d3/f16 4547826 0 2024-05-06T21:26:46.943 INFO:tasks.workunit.client.0.smithi032.stdout:5/652: dwrite d0/d24/d26/d3d/f95 [0,4194304] 0 2024-05-06T21:26:46.944 INFO:tasks.workunit.client.1.smithi154.stdout:0/399: dwrite d6/dc/d44/f31 [0,4194304] 0 2024-05-06T21:26:46.944 INFO:tasks.workunit.client.1.smithi154.stdout:8/306: creat d3/d38/f63 x:0 0 0 2024-05-06T21:26:46.944 INFO:tasks.workunit.client.1.smithi154.stdout:7/229: dwrite d6/fb [0,4194304] 0 2024-05-06T21:26:46.945 INFO:tasks.workunit.client.1.smithi154.stdout:3/446: mkdir d0/da/d1a/d28/d2f/d81/d55/d76/d9a 0 2024-05-06T21:26:46.946 INFO:tasks.workunit.client.1.smithi154.stdout:5/325: mknod d2/d3/d19/c6b 0 2024-05-06T21:26:46.947 INFO:tasks.workunit.client.1.smithi154.stdout:5/326: write d2/d3/d21/d22/f2e [499208,121273] 0 2024-05-06T21:26:46.953 INFO:tasks.workunit.client.1.smithi154.stdout:1/338: dwrite d6/db/d10/d15/d1d/f61 [0,4194304] 0 2024-05-06T21:26:46.953 INFO:tasks.workunit.client.1.smithi154.stdout:3/447: creat d0/da/d1a/d28/d2f/f9b x:0 0 0 2024-05-06T21:26:46.953 INFO:tasks.workunit.client.1.smithi154.stdout:3/448: readlink d0/l31 0 2024-05-06T21:26:46.953 INFO:tasks.workunit.client.1.smithi154.stdout:3/449: chown d0/da/db/d30/d71/f88 0 1 2024-05-06T21:26:46.955 INFO:tasks.workunit.client.1.smithi154.stdout:7/230: read d6/fb [1999804,99887] 0 2024-05-06T21:26:46.955 INFO:tasks.workunit.client.1.smithi154.stdout:7/231: chown d6/de/d21/c43 455 1 2024-05-06T21:26:46.958 INFO:tasks.workunit.client.0.smithi032.stdout:5/653: getdents d0/d24/d38/d37/d7b/dc0 0 2024-05-06T21:26:46.958 INFO:tasks.workunit.client.0.smithi032.stdout:5/654: creat d0/d16/d46/da9/fc8 x:0 0 0 2024-05-06T21:26:46.963 INFO:tasks.workunit.client.0.smithi032.stdout:5/655: rename d0/d16/d46/da9/laa to d0/d16/d79/lc9 0 2024-05-06T21:26:46.963 INFO:tasks.workunit.client.0.smithi032.stdout:5/656: stat d0/d16/f85 0 2024-05-06T21:26:46.965 INFO:tasks.workunit.client.1.smithi154.stdout:5/327: dwrite d2/d3/d21/f60 [0,4194304] 0 2024-05-06T21:26:46.967 INFO:tasks.workunit.client.0.smithi032.stdout:5/657: rename d0/d24/d34 to d0/d16/d2a/d5f/dca 0 2024-05-06T21:26:46.968 INFO:tasks.workunit.client.0.smithi032.stdout:5/658: creat d0/d87/fcb x:0 0 0 2024-05-06T21:26:46.980 INFO:tasks.workunit.client.1.smithi154.stdout:0/400: getdents d6/dc/d40/d4a/d6c 0 2024-05-06T21:26:46.980 INFO:tasks.workunit.client.1.smithi154.stdout:5/328: dwrite d2/d3/d21/d22/f36 [0,4194304] 0 2024-05-06T21:26:46.980 INFO:tasks.workunit.client.1.smithi154.stdout:5/329: stat d2/d3/d21/d22/d25/d37/f40 0 2024-05-06T21:26:46.980 INFO:tasks.workunit.client.1.smithi154.stdout:5/330: creat d2/d3/d21/d22/d25/d37/f6c x:0 0 0 2024-05-06T21:26:46.981 INFO:tasks.workunit.client.1.smithi154.stdout:5/331: read d2/d3/d21/d22/d25/f32 [68891,104076] 0 2024-05-06T21:26:46.982 INFO:tasks.workunit.client.0.smithi032.stdout:5/659: rmdir d0/d87 39 2024-05-06T21:26:46.983 INFO:tasks.workunit.client.1.smithi154.stdout:1/339: creat d6/db/d10/d26/f6b x:0 0 0 2024-05-06T21:26:46.983 INFO:tasks.workunit.client.1.smithi154.stdout:3/450: mkdir d0/da/d1a/d28/d2f/d81/d9c 0 2024-05-06T21:26:46.984 INFO:tasks.workunit.client.0.smithi032.stdout:5/660: truncate d0/d24/d26/d3d/d50/f65 550989 0 2024-05-06T21:26:46.984 INFO:tasks.workunit.client.0.smithi032.stdout:5/661: fsync d0/d28/f75 0 2024-05-06T21:26:46.984 INFO:tasks.workunit.client.0.smithi032.stdout:5/662: read - d0/d24/f7e zero size 2024-05-06T21:26:46.986 INFO:tasks.workunit.client.0.smithi032.stdout:5/663: mknod d0/d16/d2a/d5f/ccc 0 2024-05-06T21:26:46.991 INFO:tasks.workunit.client.0.smithi032.stdout:5/664: rename d0/d24/d26/d3d/ca2 to d0/d24/d26/d32/ccd 0 2024-05-06T21:26:46.993 INFO:tasks.workunit.client.0.smithi032.stdout:5/665: creat d0/d16/fce x:0 0 0 2024-05-06T21:26:47.001 INFO:tasks.workunit.client.0.smithi032.stdout:5/666: write d0/d24/d26/d3d/d50/f6e [1475376,24559] 0 2024-05-06T21:26:47.004 INFO:tasks.workunit.client.1.smithi154.stdout:5/332: dwrite d2/d3/d21/d22/d25/d37/f40 [0,4194304] 0 2024-05-06T21:26:47.008 INFO:tasks.workunit.client.1.smithi154.stdout:3/451: dwrite d0/da/db/f73 [0,4194304] 0 2024-05-06T21:26:47.017 INFO:tasks.workunit.client.0.smithi032.stdout:7/726: sync 2024-05-06T21:26:47.017 INFO:tasks.workunit.client.0.smithi032.stdout:4/732: sync 2024-05-06T21:26:47.017 INFO:tasks.workunit.client.0.smithi032.stdout:8/853: sync 2024-05-06T21:26:47.018 INFO:tasks.workunit.client.0.smithi032.stdout:7/727: creat db/d12/d16/d2a/d39/d3b/d96/dcd/fe7 x:0 0 0 2024-05-06T21:26:47.019 INFO:tasks.workunit.client.0.smithi032.stdout:7/728: rmdir db/d12/d16/d2a/d39/d8b 39 2024-05-06T21:26:47.020 INFO:tasks.workunit.client.1.smithi154.stdout:7/232: link d6/f10 d6/de/d21/f48 0 2024-05-06T21:26:47.020 INFO:tasks.workunit.client.0.smithi032.stdout:7/729: write db/d12/d49/f67 [285974,3503] 0 2024-05-06T21:26:47.024 INFO:tasks.workunit.client.0.smithi032.stdout:7/730: truncate db/d12/f30 3552336 0 2024-05-06T21:26:47.027 INFO:tasks.workunit.client.0.smithi032.stdout:5/667: dwrite d0/d24/d26/d3d/d50/f65 [0,4194304] 0 2024-05-06T21:26:47.030 INFO:tasks.workunit.client.0.smithi032.stdout:5/668: creat d0/d16/d2a/d5f/fcf x:0 0 0 2024-05-06T21:26:47.041 INFO:tasks.workunit.client.0.smithi032.stdout:5/669: write d0/d28/f75 [16992,126478] 0 2024-05-06T21:26:47.043 INFO:tasks.workunit.client.0.smithi032.stdout:5/670: symlink d0/d24/d26/d3d/d50/d5a/ld0 0 2024-05-06T21:26:47.046 INFO:tasks.workunit.client.1.smithi154.stdout:2/318: write db/de/d16/f1f [1525983,57681] 0 2024-05-06T21:26:47.054 INFO:tasks.workunit.client.0.smithi032.stdout:4/733: dwrite d2/d16/d44/d74/f92 [0,4194304] 0 2024-05-06T21:26:47.054 INFO:tasks.workunit.client.0.smithi032.stdout:4/734: chown d2/d16/d44/d74 63654 1 2024-05-06T21:26:47.054 INFO:tasks.workunit.client.0.smithi032.stdout:8/854: dwrite d0/d1b/f95 [0,4194304] 0 2024-05-06T21:26:47.055 INFO:tasks.workunit.client.0.smithi032.stdout:7/731: dwrite db/d12/d16/d21/d41/f70 [0,4194304] 0 2024-05-06T21:26:47.057 INFO:tasks.workunit.client.0.smithi032.stdout:4/735: rmdir d2/d16/d44/d74/d79/de6 39 2024-05-06T21:26:47.057 INFO:tasks.workunit.client.0.smithi032.stdout:5/671: write d0/d16/d2f/f6f [3589199,131049] 0 2024-05-06T21:26:47.057 INFO:tasks.workunit.client.0.smithi032.stdout:5/672: chown d0/d16/l82 153 1 2024-05-06T21:26:47.057 INFO:tasks.workunit.client.0.smithi032.stdout:5/673: chown d0/d16/d2f/d77/d99/dbc 607568 1 2024-05-06T21:26:47.061 INFO:tasks.workunit.client.0.smithi032.stdout:8/855: unlink d0/d1c/d5e/d67/dc3/d57/d5d/d63/f8e 0 2024-05-06T21:26:47.064 INFO:tasks.workunit.client.0.smithi032.stdout:7/732: mkdir db/d12/d16/d21/de8 0 2024-05-06T21:26:47.064 INFO:tasks.workunit.client.0.smithi032.stdout:7/733: write db/d12/d49/d97/fcf [35637,84809] 0 2024-05-06T21:26:47.064 INFO:tasks.workunit.client.0.smithi032.stdout:7/734: chown db/d12/d16/d21/d41/d78/f2c 13179980 1 2024-05-06T21:26:47.066 INFO:tasks.workunit.client.0.smithi032.stdout:4/736: creat d2/d16/d44/d45/dc1/fe9 x:0 0 0 2024-05-06T21:26:47.066 INFO:tasks.workunit.client.0.smithi032.stdout:4/737: fdatasync d2/f11 0 2024-05-06T21:26:47.068 INFO:tasks.workunit.client.0.smithi032.stdout:5/674: mknod d0/d28/cd1 0 2024-05-06T21:26:47.071 INFO:tasks.workunit.client.0.smithi032.stdout:4/738: unlink d2/d1e/d47/c59 0 2024-05-06T21:26:47.072 INFO:tasks.workunit.client.0.smithi032.stdout:5/675: rmdir d0/d87 39 2024-05-06T21:26:47.074 INFO:tasks.workunit.client.0.smithi032.stdout:5/676: getdents d0/d24/d38/d37 0 2024-05-06T21:26:47.076 INFO:tasks.workunit.client.0.smithi032.stdout:5/677: rename d0/d24/d38/db0 to d0/d16/d2a/dc7/dd2 0 2024-05-06T21:26:47.078 INFO:tasks.workunit.client.0.smithi032.stdout:5/678: rename d0/d24/d38/f8d to d0/d24/d26/d32/fd3 0 2024-05-06T21:26:47.078 INFO:tasks.workunit.client.0.smithi032.stdout:5/679: creat d0/d16/d2a/d5f/fd4 x:0 0 0 2024-05-06T21:26:47.079 INFO:tasks.workunit.client.0.smithi032.stdout:4/739: write d2/d16/d44/d45/d4e/f6b [3652464,78762] 0 2024-05-06T21:26:47.081 INFO:tasks.workunit.client.0.smithi032.stdout:8/856: dwrite d0/d1c/d5e/d67/d7b/fb2 [4194304,4194304] 0 2024-05-06T21:26:47.082 INFO:tasks.workunit.client.0.smithi032.stdout:4/740: rename d2/d16/d44/d74/d79/de6/de8/cdc to d2/d2c/d31/d7c/cea 0 2024-05-06T21:26:47.086 INFO:tasks.workunit.client.0.smithi032.stdout:4/741: symlink d2/d16/d44/d74/leb 0 2024-05-06T21:26:47.086 INFO:tasks.workunit.client.0.smithi032.stdout:4/742: write d2/d16/d44/d74/d76/fb2 [635112,105865] 0 2024-05-06T21:26:47.087 INFO:tasks.workunit.client.1.smithi154.stdout:0/401: symlink d6/dc/d40/l81 0 2024-05-06T21:26:47.093 INFO:tasks.workunit.client.1.smithi154.stdout:1/340: mknod d6/db/d10/d15/d1d/c6c 0 2024-05-06T21:26:47.093 INFO:tasks.workunit.client.1.smithi154.stdout:1/341: chown d6/db/f5b 2295116 1 2024-05-06T21:26:47.095 INFO:tasks.workunit.client.1.smithi154.stdout:5/333: getdents d2/d48 0 2024-05-06T21:26:47.095 INFO:tasks.workunit.client.1.smithi154.stdout:5/334: write d2/d6/fe [5402307,103564] 0 2024-05-06T21:26:47.098 INFO:tasks.workunit.client.1.smithi154.stdout:3/452: creat d0/da/db/d7c/d80/f9d x:0 0 0 2024-05-06T21:26:47.099 INFO:tasks.workunit.client.1.smithi154.stdout:7/233: unlink d6/d20/f38 0 2024-05-06T21:26:47.100 INFO:tasks.workunit.client.1.smithi154.stdout:0/402: read d6/dc/f16 [2588045,97692] 0 2024-05-06T21:26:47.100 INFO:tasks.workunit.client.1.smithi154.stdout:0/403: dread - d6/dc/d40/f47 zero size 2024-05-06T21:26:47.100 INFO:tasks.workunit.client.1.smithi154.stdout:0/404: write d6/dc/f2e [652094,123019] 0 2024-05-06T21:26:47.100 INFO:tasks.workunit.client.0.smithi032.stdout:4/743: dread d2/d2c/f49 [0,4194304] 0 2024-05-06T21:26:47.103 INFO:tasks.workunit.client.1.smithi154.stdout:5/335: dread d2/d6/dd/f18 [0,4194304] 0 2024-05-06T21:26:47.104 INFO:tasks.workunit.client.1.smithi154.stdout:1/342: creat d6/d3e/f6d x:0 0 0 2024-05-06T21:26:47.108 INFO:tasks.workunit.client.1.smithi154.stdout:3/453: unlink d0/da/d1a/d28/d2f/d81/d48/l92 0 2024-05-06T21:26:47.110 INFO:tasks.workunit.client.1.smithi154.stdout:7/234: rename d6/de/d21/f48 to d6/de/f49 0 2024-05-06T21:26:47.112 INFO:tasks.workunit.client.1.smithi154.stdout:5/336: dread d2/f1a [0,4194304] 0 2024-05-06T21:26:47.112 INFO:tasks.workunit.client.1.smithi154.stdout:5/337: creat d2/d3/f6d x:0 0 0 2024-05-06T21:26:47.112 INFO:tasks.workunit.client.1.smithi154.stdout:5/338: write d2/d6/f61 [4248460,32604] 0 2024-05-06T21:26:47.112 INFO:tasks.workunit.client.1.smithi154.stdout:0/405: symlink d6/dc/l82 0 2024-05-06T21:26:47.112 INFO:tasks.workunit.client.1.smithi154.stdout:0/406: chown d6/dc/d51/f6f 3 1 2024-05-06T21:26:47.113 INFO:tasks.workunit.client.0.smithi032.stdout:8/857: dwrite d0/d1c/d5e/d67/dc3/d57/d5d/fe6 [0,4194304] 0 2024-05-06T21:26:47.116 INFO:tasks.workunit.client.1.smithi154.stdout:7/235: unlink d6/lf 0 2024-05-06T21:26:47.117 INFO:tasks.workunit.client.0.smithi032.stdout:8/858: truncate d0/d1b/d47/d91/fa3 1654046 0 2024-05-06T21:26:47.119 INFO:tasks.workunit.client.0.smithi032.stdout:8/859: symlink d0/d1b/d47/d91/l109 0 2024-05-06T21:26:47.123 INFO:tasks.workunit.client.1.smithi154.stdout:0/407: link d6/dc/d40/d4a/d6c/f7b d6/f83 0 2024-05-06T21:26:47.123 INFO:tasks.workunit.client.1.smithi154.stdout:0/408: truncate d6/dc/f64 525769 0 2024-05-06T21:26:47.131 INFO:tasks.workunit.client.0.smithi032.stdout:8/860: dread d0/f19 [0,4194304] 0 2024-05-06T21:26:47.143 INFO:tasks.workunit.client.1.smithi154.stdout:3/454: dwrite d0/da/d1a/d28/d2f/d81/f6b [0,4194304] 0 2024-05-06T21:26:47.144 INFO:tasks.workunit.client.1.smithi154.stdout:7/236: dwrite d6/f10 [0,4194304] 0 2024-05-06T21:26:47.144 INFO:tasks.workunit.client.1.smithi154.stdout:7/237: write d6/f25 [2675644,33077] 0 2024-05-06T21:26:47.144 INFO:tasks.workunit.client.1.smithi154.stdout:2/319: dwrite f0 [4194304,4194304] 0 2024-05-06T21:26:47.144 INFO:tasks.workunit.client.1.smithi154.stdout:2/320: chown db/de/d10/f5f 761895 1 2024-05-06T21:26:47.145 INFO:tasks.workunit.client.1.smithi154.stdout:3/455: symlink d0/da/db/l9e 0 2024-05-06T21:26:47.145 INFO:tasks.workunit.client.1.smithi154.stdout:3/456: read - d0/d2/d22/f8b zero size 2024-05-06T21:26:47.145 INFO:tasks.workunit.client.1.smithi154.stdout:3/457: write d0/d2/f6f [1631109,95895] 0 2024-05-06T21:26:47.146 INFO:tasks.workunit.client.0.smithi032.stdout:4/744: dwrite d2/d1e/f22 [0,4194304] 0 2024-05-06T21:26:47.146 INFO:tasks.workunit.client.0.smithi032.stdout:8/861: dread d0/d1b/fa4 [0,4194304] 0 2024-05-06T21:26:47.147 INFO:tasks.workunit.client.1.smithi154.stdout:7/238: truncate d6/d20/f1d 4027136 0 2024-05-06T21:26:47.148 INFO:tasks.workunit.client.0.smithi032.stdout:4/745: link d2/d13/c2b d2/d16/d44/d74/d79/d88/dd6/cec 0 2024-05-06T21:26:47.148 INFO:tasks.workunit.client.0.smithi032.stdout:4/746: chown d2/d2c/d31/d7c/l77 1504432 1 2024-05-06T21:26:47.149 INFO:tasks.workunit.client.1.smithi154.stdout:3/458: creat d0/da/db/d52/f9f x:0 0 0 2024-05-06T21:26:47.152 INFO:tasks.workunit.client.1.smithi154.stdout:3/459: symlink d0/da/db/d7c/d80/la0 0 2024-05-06T21:26:47.157 INFO:tasks.workunit.client.0.smithi032.stdout:8/862: dread d0/f27 [0,4194304] 0 2024-05-06T21:26:47.160 INFO:tasks.workunit.client.0.smithi032.stdout:8/863: symlink d0/d1c/d5e/d67/dfe/d104/l10a 0 2024-05-06T21:26:47.174 INFO:tasks.workunit.client.1.smithi154.stdout:6/236: sync 2024-05-06T21:26:47.175 INFO:tasks.workunit.client.1.smithi154.stdout:9/429: sync 2024-05-06T21:26:47.175 INFO:tasks.workunit.client.1.smithi154.stdout:6/237: readlink d8/d11/d51/l53 0 2024-05-06T21:26:47.175 INFO:tasks.workunit.client.1.smithi154.stdout:6/238: stat d8/d11/d2d/d3d/f3c 0 2024-05-06T21:26:47.175 INFO:tasks.workunit.client.1.smithi154.stdout:6/239: truncate d8/d11/d2d/f47 123921 0 2024-05-06T21:26:47.176 INFO:tasks.workunit.client.1.smithi154.stdout:9/430: rename d5/d14/d87/d65/c6d to d5/d14/d3a/c98 0 2024-05-06T21:26:47.177 INFO:tasks.workunit.client.1.smithi154.stdout:9/431: write d5/d14/d31/f40 [286308,28718] 0 2024-05-06T21:26:47.177 INFO:tasks.workunit.client.1.smithi154.stdout:9/432: creat d5/d20/d52/f99 x:0 0 0 2024-05-06T21:26:47.178 INFO:tasks.workunit.client.1.smithi154.stdout:6/240: truncate d8/f31 2061326 0 2024-05-06T21:26:47.178 INFO:tasks.workunit.client.1.smithi154.stdout:6/241: truncate d8/d11/d33/d4a/f49 88834 0 2024-05-06T21:26:47.182 INFO:tasks.workunit.client.1.smithi154.stdout:9/433: mknod d5/d20/d52/d59/c9a 0 2024-05-06T21:26:47.186 INFO:tasks.workunit.client.1.smithi154.stdout:1/343: getdents d6/d3e 0 2024-05-06T21:26:47.186 INFO:tasks.workunit.client.1.smithi154.stdout:1/344: write d6/db/d10/d15/d1d/f57 [710867,97964] 0 2024-05-06T21:26:47.186 INFO:tasks.workunit.client.1.smithi154.stdout:1/345: getdents d6/db/d69 0 2024-05-06T21:26:47.186 INFO:tasks.workunit.client.1.smithi154.stdout:1/346: truncate d6/f47 4535639 0 2024-05-06T21:26:47.186 INFO:tasks.workunit.client.1.smithi154.stdout:1/347: chown d6/c22 26528 1 2024-05-06T21:26:47.188 INFO:tasks.workunit.client.1.smithi154.stdout:1/348: creat d6/db/d10/d15/f6e x:0 0 0 2024-05-06T21:26:47.188 INFO:tasks.workunit.client.1.smithi154.stdout:1/349: dread - d6/d3e/f6d zero size 2024-05-06T21:26:47.192 INFO:tasks.workunit.client.1.smithi154.stdout:0/409: truncate d6/dc/f2e 353188 0 2024-05-06T21:26:47.192 INFO:tasks.workunit.client.1.smithi154.stdout:4/313: sync 2024-05-06T21:26:47.192 INFO:tasks.workunit.client.1.smithi154.stdout:8/307: sync 2024-05-06T21:26:47.193 INFO:tasks.workunit.client.1.smithi154.stdout:8/308: write d3/d14/f18 [1990020,107385] 0 2024-05-06T21:26:47.193 INFO:tasks.workunit.client.1.smithi154.stdout:2/321: dwrite f0 [4194304,4194304] 0 2024-05-06T21:26:47.194 INFO:tasks.workunit.client.1.smithi154.stdout:6/242: read d8/d13/f3f [6558187,41330] 0 2024-05-06T21:26:47.195 INFO:tasks.workunit.client.1.smithi154.stdout:0/410: creat d6/dc/d51/d54/f84 x:0 0 0 2024-05-06T21:26:47.196 INFO:tasks.workunit.client.1.smithi154.stdout:3/460: dwrite d0/da/db/f2a [0,4194304] 0 2024-05-06T21:26:47.199 INFO:tasks.workunit.client.1.smithi154.stdout:1/350: dread d6/db/d10/d15/d1d/d53/f43 [0,4194304] 0 2024-05-06T21:26:47.199 INFO:tasks.workunit.client.1.smithi154.stdout:1/351: dread - d6/db/d10/d15/f6e zero size 2024-05-06T21:26:47.199 INFO:tasks.workunit.client.1.smithi154.stdout:1/352: creat d6/db/f6f x:0 0 0 2024-05-06T21:26:47.199 INFO:tasks.workunit.client.1.smithi154.stdout:1/353: stat d6/db/d10/d26/c2d 0 2024-05-06T21:26:47.200 INFO:tasks.workunit.client.1.smithi154.stdout:6/243: truncate d8/d11/d2d/d3d/f3c 2462462 0 2024-05-06T21:26:47.203 INFO:tasks.workunit.client.1.smithi154.stdout:0/411: write d6/dc/d44/f11 [1940681,12044] 0 2024-05-06T21:26:47.204 INFO:tasks.workunit.client.1.smithi154.stdout:7/239: dwrite d6/de/f19 [0,4194304] 0 2024-05-06T21:26:47.204 INFO:tasks.workunit.client.0.smithi032.stdout:4/747: dwrite d2/f11 [0,4194304] 0 2024-05-06T21:26:47.205 INFO:tasks.workunit.client.0.smithi032.stdout:8/864: dwrite d0/d1b/d39/f3a [0,4194304] 0 2024-05-06T21:26:47.205 INFO:tasks.workunit.client.0.smithi032.stdout:8/865: fdatasync d0/f69 0 2024-05-06T21:26:47.205 INFO:tasks.workunit.client.1.smithi154.stdout:3/461: rename d0/da/d1a/d28/d2f/d81/l51 to d0/da/d1a/d28/la1 0 2024-05-06T21:26:47.206 INFO:tasks.workunit.client.0.smithi032.stdout:4/748: creat d2/d16/d44/d74/d76/fed x:0 0 0 2024-05-06T21:26:47.206 INFO:tasks.workunit.client.0.smithi032.stdout:4/749: stat d2/d2c/d31/f91 0 2024-05-06T21:26:47.208 INFO:tasks.workunit.client.0.smithi032.stdout:8/866: truncate d0/fe 2078644 0 2024-05-06T21:26:47.208 INFO:tasks.workunit.client.0.smithi032.stdout:4/750: getdents d2/d16/d44/d74/d7e/da5 0 2024-05-06T21:26:47.208 INFO:tasks.workunit.client.1.smithi154.stdout:1/354: getdents d6/db/d10/d15/d1d 0 2024-05-06T21:26:47.209 INFO:tasks.workunit.client.0.smithi032.stdout:8/867: symlink d0/d1c/d5e/d67/dc3/d57/l10b 0 2024-05-06T21:26:47.209 INFO:tasks.workunit.client.0.smithi032.stdout:4/751: chown d2/fa 15118 1 2024-05-06T21:26:47.210 INFO:tasks.workunit.client.1.smithi154.stdout:6/244: creat d8/d11/d33/f55 x:0 0 0 2024-05-06T21:26:47.210 INFO:tasks.workunit.client.0.smithi032.stdout:8/868: creat d0/d1c/d5e/d67/dc3/db5/f10c x:0 0 0 2024-05-06T21:26:47.211 INFO:tasks.workunit.client.0.smithi032.stdout:8/869: fsync d0/d1c/d5e/d67/dc3/f5b 0 2024-05-06T21:26:47.211 INFO:tasks.workunit.client.0.smithi032.stdout:8/870: write d0/d1c/d5e/d67/d9d/fd9 [829291,121748] 0 2024-05-06T21:26:47.211 INFO:tasks.workunit.client.0.smithi032.stdout:4/752: mknod d2/d16/d44/d74/d76/cee 0 2024-05-06T21:26:47.213 INFO:tasks.workunit.client.0.smithi032.stdout:8/871: creat d0/d1c/d5e/d67/dc3/de9/f10d x:0 0 0 2024-05-06T21:26:47.214 INFO:tasks.workunit.client.1.smithi154.stdout:0/412: write d6/dc/d42/f59 [3214484,121536] 0 2024-05-06T21:26:47.214 INFO:tasks.workunit.client.1.smithi154.stdout:0/413: write d6/dc/f50 [1416558,128485] 0 2024-05-06T21:26:47.215 INFO:tasks.workunit.client.0.smithi032.stdout:4/753: unlink d2/d16/d44/d45/d4e/f6b 0 2024-05-06T21:26:47.216 INFO:tasks.workunit.client.0.smithi032.stdout:4/754: dread d2/d2c/f89 [0,4194304] 0 2024-05-06T21:26:47.216 INFO:tasks.workunit.client.0.smithi032.stdout:4/755: fsync d2/d16/f5e 0 2024-05-06T21:26:47.217 INFO:tasks.workunit.client.0.smithi032.stdout:8/872: unlink d0/d1b/d39/f5a 0 2024-05-06T21:26:47.217 INFO:tasks.workunit.client.1.smithi154.stdout:6/245: write f6 [640087,110408] 0 2024-05-06T21:26:47.217 INFO:tasks.workunit.client.1.smithi154.stdout:1/355: symlink d6/db/d10/l70 0 2024-05-06T21:26:47.217 INFO:tasks.workunit.client.1.smithi154.stdout:3/462: read d0/da/db/dd/d1c/d21/f60 [2475199,47738] 0 2024-05-06T21:26:47.218 INFO:tasks.workunit.client.0.smithi032.stdout:4/756: mkdir d2/d16/d44/d74/def 0 2024-05-06T21:26:47.219 INFO:tasks.workunit.client.0.smithi032.stdout:4/757: creat d2/d16/d44/d45/ff0 x:0 0 0 2024-05-06T21:26:47.220 INFO:tasks.workunit.client.1.smithi154.stdout:6/246: getdents d8/d11/d2d/d3d/d4c 0 2024-05-06T21:26:47.220 INFO:tasks.workunit.client.0.smithi032.stdout:4/758: rename d2/d16/d44/d74/d76/l7a to d2/d16/d44/d45/lf1 0 2024-05-06T21:26:47.221 INFO:tasks.workunit.client.0.smithi032.stdout:4/759: chown d2/ld9 0 1 2024-05-06T21:26:47.221 INFO:tasks.workunit.client.0.smithi032.stdout:4/760: write d2/d16/f67 [430753,95133] 0 2024-05-06T21:26:47.222 INFO:tasks.workunit.client.0.smithi032.stdout:4/761: mkdir d2/d16/d44/d74/d79/d88/dd6/df2 0 2024-05-06T21:26:47.223 INFO:tasks.workunit.client.1.smithi154.stdout:1/356: rename d6/d3e/f4d to d6/db/d69/f71 0 2024-05-06T21:26:47.225 INFO:tasks.workunit.client.0.smithi032.stdout:4/762: creat d2/d16/d44/d74/d79/ff3 x:0 0 0 2024-05-06T21:26:47.225 INFO:tasks.workunit.client.0.smithi032.stdout:4/763: chown d2/d13/l34 226 1 2024-05-06T21:26:47.225 INFO:tasks.workunit.client.1.smithi154.stdout:1/357: dread d6/db/f5b [0,4194304] 0 2024-05-06T21:26:47.226 INFO:tasks.workunit.client.1.smithi154.stdout:1/358: write d6/db/d10/f63 [500855,76122] 0 2024-05-06T21:26:47.226 INFO:tasks.workunit.client.1.smithi154.stdout:5/339: creat d2/f6e x:0 0 0 2024-05-06T21:26:47.226 INFO:tasks.workunit.client.1.smithi154.stdout:5/340: readlink d2/d3/l4e 0 2024-05-06T21:26:47.227 INFO:tasks.workunit.client.1.smithi154.stdout:9/434: dwrite d5/d14/d31/d39/f68 [0,4194304] 0 2024-05-06T21:26:47.228 INFO:tasks.workunit.client.1.smithi154.stdout:5/341: read d2/f34 [4809768,24747] 0 2024-05-06T21:26:47.234 INFO:tasks.workunit.client.1.smithi154.stdout:5/342: dread d2/d3/fa [0,4194304] 0 2024-05-06T21:26:47.235 INFO:tasks.workunit.client.1.smithi154.stdout:9/435: creat d5/d20/d52/d6e/f9b x:0 0 0 2024-05-06T21:26:47.236 INFO:tasks.workunit.client.1.smithi154.stdout:1/359: dread d6/db/d10/d15/d1d/f61 [0,4194304] 0 2024-05-06T21:26:47.238 INFO:tasks.workunit.client.1.smithi154.stdout:5/343: creat d2/d3/d21/d22/f6f x:0 0 0 2024-05-06T21:26:47.238 INFO:tasks.workunit.client.1.smithi154.stdout:5/344: creat d2/d6/dd/f70 x:0 0 0 2024-05-06T21:26:47.240 INFO:tasks.workunit.client.1.smithi154.stdout:1/360: truncate d6/f28 173443 0 2024-05-06T21:26:47.241 INFO:tasks.workunit.client.1.smithi154.stdout:8/309: mkdir d3/d64 0 2024-05-06T21:26:47.244 INFO:tasks.workunit.client.1.smithi154.stdout:5/345: mkdir d2/d6/dc/d71 0 2024-05-06T21:26:47.244 INFO:tasks.workunit.client.0.smithi032.stdout:8/873: dwrite d0/d1c/d5e/d67/dc3/db5/f10c [0,4194304] 0 2024-05-06T21:26:47.247 INFO:tasks.workunit.client.0.smithi032.stdout:8/874: symlink d0/d1c/d5e/d67/dc3/d57/d5d/l10e 0 2024-05-06T21:26:47.249 INFO:tasks.workunit.client.0.smithi032.stdout:8/875: creat d0/d1c/d5e/d67/d102/f10f x:0 0 0 2024-05-06T21:26:47.250 INFO:tasks.workunit.client.1.smithi154.stdout:6/247: fsync d8/d11/d2d/d3d/f3c 0 2024-05-06T21:26:47.251 INFO:tasks.workunit.client.1.smithi154.stdout:3/463: dread d0/da/d1a/d28/d17/f4f [0,4194304] 0 2024-05-06T21:26:47.251 INFO:tasks.workunit.client.1.smithi154.stdout:3/464: stat d0/da/db/dd/ff 0 2024-05-06T21:26:47.251 INFO:tasks.workunit.client.1.smithi154.stdout:3/465: fdatasync d0/da/d1a/d28/d17/f4f 0 2024-05-06T21:26:47.251 INFO:tasks.workunit.client.1.smithi154.stdout:1/361: dread d6/db/f34 [0,4194304] 0 2024-05-06T21:26:47.251 INFO:tasks.workunit.client.1.smithi154.stdout:1/362: chown d6/l32 130698164 1 2024-05-06T21:26:47.251 INFO:tasks.workunit.client.0.smithi032.stdout:8/876: mknod d0/df1/c110 0 2024-05-06T21:26:47.252 INFO:tasks.workunit.client.0.smithi032.stdout:8/877: write d0/f10 [416457,35125] 0 2024-05-06T21:26:47.253 INFO:tasks.workunit.client.0.smithi032.stdout:4/764: dwrite d2/d16/d44/d74/f92 [0,4194304] 0 2024-05-06T21:26:47.254 INFO:tasks.workunit.client.1.smithi154.stdout:2/322: dwrite db/de/d10/f25 [0,4194304] 0 2024-05-06T21:26:47.254 INFO:tasks.workunit.client.1.smithi154.stdout:2/323: truncate db/de/d16/d33/f44 4894778 0 2024-05-06T21:26:47.254 INFO:tasks.workunit.client.1.smithi154.stdout:2/324: fsync db/de/d10/f30 0 2024-05-06T21:26:47.254 INFO:tasks.workunit.client.1.smithi154.stdout:6/248: getdents d8/d11 0 2024-05-06T21:26:47.254 INFO:tasks.workunit.client.1.smithi154.stdout:0/414: dwrite d6/dc/d51/d54/f84 [0,4194304] 0 2024-05-06T21:26:47.256 INFO:tasks.workunit.client.1.smithi154.stdout:3/466: rmdir d0/d2/d8a 0 2024-05-06T21:26:47.256 INFO:tasks.workunit.client.1.smithi154.stdout:3/467: write d0/da/d1a/d28/d2f/f9b [636938,21486] 0 2024-05-06T21:26:47.256 INFO:tasks.workunit.client.1.smithi154.stdout:3/468: readlink d0/da/db/dd/d1c/d41/l5c 0 2024-05-06T21:26:47.258 INFO:tasks.workunit.client.0.smithi032.stdout:4/765: mkdir d2/d13/daa/df4 0 2024-05-06T21:26:47.260 INFO:tasks.workunit.client.1.smithi154.stdout:6/249: link d8/c1e d8/d11/d2d/d3d/c56 0 2024-05-06T21:26:47.261 INFO:tasks.workunit.client.0.smithi032.stdout:4/766: unlink d2/d16/d44/d74/d79/d88/dd6/fde 0 2024-05-06T21:26:47.261 INFO:tasks.workunit.client.0.smithi032.stdout:4/767: readlink d2/d2c/d31/l55 0 2024-05-06T21:26:47.264 INFO:tasks.workunit.client.0.smithi032.stdout:4/768: chown d2/fcb 8362 1 2024-05-06T21:26:47.268 INFO:tasks.workunit.client.1.smithi154.stdout:0/415: mkdir d6/dc/d40/d85 0 2024-05-06T21:26:47.269 INFO:tasks.workunit.client.1.smithi154.stdout:6/250: dread d8/d11/f1d [0,4194304] 0 2024-05-06T21:26:47.274 INFO:tasks.workunit.client.1.smithi154.stdout:3/469: mknod d0/da/d1a/d28/d2f/ca2 0 2024-05-06T21:26:47.274 INFO:tasks.workunit.client.1.smithi154.stdout:3/470: chown d0/da/d1a/d28/d2f/d81/d55/d76/d9a 5231623 1 2024-05-06T21:26:47.277 INFO:tasks.workunit.client.1.smithi154.stdout:0/416: creat d6/dc/d40/d41/f86 x:0 0 0 2024-05-06T21:26:47.278 INFO:tasks.workunit.client.1.smithi154.stdout:6/251: mkdir d8/d11/d2d/d57 0 2024-05-06T21:26:47.281 INFO:tasks.workunit.client.1.smithi154.stdout:3/471: getdents d0/da/db/d30/d71 0 2024-05-06T21:26:47.281 INFO:tasks.workunit.client.1.smithi154.stdout:3/472: stat d0/da/db 0 2024-05-06T21:26:47.282 INFO:tasks.workunit.client.0.smithi032.stdout:8/878: dwrite d0/d1c/d5e/d67/dc3/d57/d5d/d63/fe0 [0,4194304] 0 2024-05-06T21:26:47.282 INFO:tasks.workunit.client.1.smithi154.stdout:3/473: getdents d0/da/db 0 2024-05-06T21:26:47.283 INFO:tasks.workunit.client.0.smithi032.stdout:8/879: truncate d0/d1c/d5e/d67/dc3/fe8 3380571 0 2024-05-06T21:26:47.283 INFO:tasks.workunit.client.1.smithi154.stdout:5/346: dwrite d2/d6/dd/d2a/f3d [0,4194304] 0 2024-05-06T21:26:47.283 INFO:tasks.workunit.client.1.smithi154.stdout:6/252: dread d8/d11/d2d/f2f [0,4194304] 0 2024-05-06T21:26:47.284 INFO:tasks.workunit.client.0.smithi032.stdout:8/880: rmdir d0/d1c/d5e/d67/dc3/d57 39 2024-05-06T21:26:47.285 INFO:tasks.workunit.client.1.smithi154.stdout:1/363: dwrite d6/db/d10/d26/f23 [0,4194304] 0 2024-05-06T21:26:47.286 INFO:tasks.workunit.client.0.smithi032.stdout:8/881: truncate d0/d1c/f24 4176268 0 2024-05-06T21:26:47.286 INFO:tasks.workunit.client.0.smithi032.stdout:8/882: write d0/d1c/d5e/d67/dc3/db5/dd0/fde [1370259,91014] 0 2024-05-06T21:26:47.288 INFO:tasks.workunit.client.0.smithi032.stdout:4/769: dwrite d2/d16/f5e [8388608,4194304] 0 2024-05-06T21:26:47.288 INFO:tasks.workunit.client.0.smithi032.stdout:8/883: truncate d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/fcc 531169 0 2024-05-06T21:26:47.288 INFO:tasks.workunit.client.1.smithi154.stdout:5/347: symlink d2/l72 0 2024-05-06T21:26:47.288 INFO:tasks.workunit.client.1.smithi154.stdout:2/325: dwrite db/de/d16/f52 [0,4194304] 0 2024-05-06T21:26:47.289 INFO:tasks.workunit.client.1.smithi154.stdout:2/326: read - db/de/d10/f69 zero size 2024-05-06T21:26:47.290 INFO:tasks.workunit.client.1.smithi154.stdout:6/253: creat d8/d11/d2d/d3d/d4c/f58 x:0 0 0 2024-05-06T21:26:47.290 INFO:tasks.workunit.client.1.smithi154.stdout:2/327: dread db/d12/f43 [0,4194304] 0 2024-05-06T21:26:47.293 INFO:tasks.workunit.client.1.smithi154.stdout:9/436: rmdir d5 39 2024-05-06T21:26:47.298 INFO:tasks.workunit.client.0.smithi032.stdout:8/884: read d0/d1b/f95 [4146045,39124] 0 2024-05-06T21:26:47.300 INFO:tasks.workunit.client.0.smithi032.stdout:4/770: dread d2/d16/d44/d45/fcd [0,4194304] 0 2024-05-06T21:26:47.302 INFO:tasks.workunit.client.1.smithi154.stdout:0/417: dwrite d6/dc/d3c/f7d [0,4194304] 0 2024-05-06T21:26:47.303 INFO:tasks.workunit.client.1.smithi154.stdout:2/328: write db/d12/d1d/f47 [3407613,72478] 0 2024-05-06T21:26:47.312 INFO:tasks.workunit.client.1.smithi154.stdout:3/474: dwrite d0/da/db/dd/d1c/d21/f4e [4194304,4194304] 0 2024-05-06T21:26:47.312 INFO:tasks.workunit.client.1.smithi154.stdout:1/364: dwrite d6/db/d10/f63 [0,4194304] 0 2024-05-06T21:26:47.314 INFO:tasks.workunit.client.1.smithi154.stdout:2/329: dread db/de/f11 [0,4194304] 0 2024-05-06T21:26:47.316 INFO:tasks.workunit.client.0.smithi032.stdout:0/627: sync 2024-05-06T21:26:47.317 INFO:tasks.workunit.client.0.smithi032.stdout:0/628: readlink d4/da/l13 0 2024-05-06T21:26:47.321 INFO:tasks.workunit.client.1.smithi154.stdout:5/348: mkdir d2/d6/dd/d2a/d54/d43/d73 0 2024-05-06T21:26:47.321 INFO:tasks.workunit.client.1.smithi154.stdout:5/349: chown d2/d3/d21/d22/d25/l2f 21418 1 2024-05-06T21:26:47.321 INFO:tasks.workunit.client.1.smithi154.stdout:6/254: mkdir d8/d11/d2d/d59 0 2024-05-06T21:26:47.322 INFO:tasks.workunit.client.1.smithi154.stdout:1/365: write d6/f17 [38838,58183] 0 2024-05-06T21:26:47.324 INFO:tasks.workunit.client.1.smithi154.stdout:9/437: rename d5/d14/d31/f47 to d5/d20/d52/d6e/f9c 0 2024-05-06T21:26:47.327 INFO:tasks.workunit.client.1.smithi154.stdout:0/418: truncate d6/f15 1875250 0 2024-05-06T21:26:47.327 INFO:tasks.workunit.client.0.smithi032.stdout:8/885: mknod d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/c111 0 2024-05-06T21:26:47.327 INFO:tasks.workunit.client.0.smithi032.stdout:8/886: truncate d0/d1c/d5e/d67/dc3/d57/d5d/fe6 5048708 0 2024-05-06T21:26:47.330 INFO:tasks.workunit.client.1.smithi154.stdout:2/330: rmdir db/d12/d19/d4b 39 2024-05-06T21:26:47.332 INFO:tasks.workunit.client.1.smithi154.stdout:5/350: mkdir d2/d6/dd/d2a/d54/d43/d73/d74 0 2024-05-06T21:26:47.332 INFO:tasks.workunit.client.1.smithi154.stdout:5/351: write d2/f34 [4975632,23648] 0 2024-05-06T21:26:47.333 INFO:tasks.workunit.client.1.smithi154.stdout:5/352: readlink d2/d3/d21/d22/d25/d37/l56 0 2024-05-06T21:26:47.336 INFO:tasks.workunit.client.1.smithi154.stdout:1/366: link d6/db/d10/d26/f23 d6/d3e/f72 0 2024-05-06T21:26:47.336 INFO:tasks.workunit.client.1.smithi154.stdout:1/367: chown d6/f17 0 1 2024-05-06T21:26:47.339 INFO:tasks.workunit.client.1.smithi154.stdout:3/475: rename d0/d2/d22/f66 to d0/da/d1a/d28/d2f/d81/d9c/fa3 0 2024-05-06T21:26:47.339 INFO:tasks.workunit.client.1.smithi154.stdout:3/476: chown d0/da/db/dd/f53 76657738 1 2024-05-06T21:26:47.339 INFO:tasks.workunit.client.1.smithi154.stdout:3/477: truncate d0/da/d1a/d28/d2f/d81/f74 315219 0 2024-05-06T21:26:47.341 INFO:tasks.workunit.client.1.smithi154.stdout:0/419: symlink d6/l87 0 2024-05-06T21:26:47.343 INFO:tasks.workunit.client.1.smithi154.stdout:5/353: unlink d2/d3/d21/d22/d25/d37/l5a 0 2024-05-06T21:26:47.344 INFO:tasks.workunit.client.0.smithi032.stdout:3/748: sync 2024-05-06T21:26:47.344 INFO:tasks.workunit.client.0.smithi032.stdout:1/668: sync 2024-05-06T21:26:47.344 INFO:tasks.workunit.client.0.smithi032.stdout:6/732: sync 2024-05-06T21:26:47.344 INFO:tasks.workunit.client.0.smithi032.stdout:1/669: chown db/d37/d52/fc5 232 1 2024-05-06T21:26:47.345 INFO:tasks.workunit.client.0.smithi032.stdout:2/559: sync 2024-05-06T21:26:47.345 INFO:tasks.workunit.client.0.smithi032.stdout:1/670: dread - db/d47/d4a/dcb/fcf zero size 2024-05-06T21:26:47.345 INFO:tasks.workunit.client.0.smithi032.stdout:9/708: sync 2024-05-06T21:26:47.346 INFO:tasks.workunit.client.1.smithi154.stdout:1/368: getdents d6/db/d10 0 2024-05-06T21:26:47.346 INFO:tasks.workunit.client.1.smithi154.stdout:1/369: write d6/db/d10/d15/d1d/d53/f43 [4973702,70924] 0 2024-05-06T21:26:47.347 INFO:tasks.workunit.client.1.smithi154.stdout:1/370: readlink d6/l32 0 2024-05-06T21:26:47.347 INFO:tasks.workunit.client.1.smithi154.stdout:3/478: symlink d0/da/db/dd/d1c/la4 0 2024-05-06T21:26:47.347 INFO:tasks.workunit.client.1.smithi154.stdout:3/479: chown d0/da/d1a/d28/c15 151200 1 2024-05-06T21:26:47.351 INFO:tasks.workunit.client.1.smithi154.stdout:3/480: rmdir d0/da/d1a/d28/d4d 39 2024-05-06T21:26:47.354 INFO:tasks.workunit.client.1.smithi154.stdout:3/481: symlink d0/da/d1a/d28/la5 0 2024-05-06T21:26:47.354 INFO:tasks.workunit.client.1.smithi154.stdout:3/482: stat d0/da/d1a/d28/d2f 0 2024-05-06T21:26:47.354 INFO:tasks.workunit.client.1.smithi154.stdout:3/483: dread - d0/da/db/dd/d1c/d21/d37/f4b zero size 2024-05-06T21:26:47.354 INFO:tasks.workunit.client.1.smithi154.stdout:3/484: dread - d0/da/db/d30/f98 zero size 2024-05-06T21:26:47.359 INFO:tasks.workunit.client.1.smithi154.stdout:9/438: dwrite d5/d2e/d66/f7d [0,4194304] 0 2024-05-06T21:26:47.360 INFO:tasks.workunit.client.1.smithi154.stdout:1/371: write d6/db/d10/f63 [919075,39564] 0 2024-05-06T21:26:47.360 INFO:tasks.workunit.client.1.smithi154.stdout:6/255: dwrite d8/d11/d2d/f2f [0,4194304] 0 2024-05-06T21:26:47.360 INFO:tasks.workunit.client.1.smithi154.stdout:2/331: dwrite db/de/f1c [0,4194304] 0 2024-05-06T21:26:47.360 INFO:tasks.workunit.client.1.smithi154.stdout:2/332: readlink db/de/d10/l15 0 2024-05-06T21:26:47.367 INFO:tasks.workunit.client.1.smithi154.stdout:1/372: creat d6/db/d5e/f73 x:0 0 0 2024-05-06T21:26:47.369 INFO:tasks.workunit.client.1.smithi154.stdout:6/256: creat d8/d13/d20/f5a x:0 0 0 2024-05-06T21:26:47.372 INFO:tasks.workunit.client.1.smithi154.stdout:9/439: mknod d5/d14/c9d 0 2024-05-06T21:26:47.374 INFO:tasks.workunit.client.1.smithi154.stdout:1/373: mkdir d6/db/d74 0 2024-05-06T21:26:47.374 INFO:tasks.workunit.client.1.smithi154.stdout:1/374: write d6/f28 [526885,98371] 0 2024-05-06T21:26:47.374 INFO:tasks.workunit.client.1.smithi154.stdout:3/485: dwrite d0/d2/f25 [0,4194304] 0 2024-05-06T21:26:47.374 INFO:tasks.workunit.client.1.smithi154.stdout:3/486: dread - d0/da/d1a/d28/d2f/d81/d48/f65 zero size 2024-05-06T21:26:47.375 INFO:tasks.workunit.client.1.smithi154.stdout:3/487: write d0/da/db/dd/fc [1126150,25961] 0 2024-05-06T21:26:47.376 INFO:tasks.workunit.client.1.smithi154.stdout:6/257: mknod d8/d11/d2d/d57/c5b 0 2024-05-06T21:26:47.376 INFO:tasks.workunit.client.1.smithi154.stdout:6/258: fdatasync d8/d11/d2d/f47 0 2024-05-06T21:26:47.376 INFO:tasks.workunit.client.1.smithi154.stdout:6/259: write d8/d11/f1a [629276,34306] 0 2024-05-06T21:26:47.377 INFO:tasks.workunit.client.1.smithi154.stdout:1/375: truncate d6/db/f34 3723805 0 2024-05-06T21:26:47.378 INFO:tasks.workunit.client.1.smithi154.stdout:1/376: dread - d6/f66 zero size 2024-05-06T21:26:47.378 INFO:tasks.workunit.client.1.smithi154.stdout:0/420: getdents d6 0 2024-05-06T21:26:47.384 INFO:tasks.workunit.client.1.smithi154.stdout:5/354: rmdir d2/d3/d21/d22/d25 39 2024-05-06T21:26:47.384 INFO:tasks.workunit.client.1.smithi154.stdout:3/488: creat d0/da/db/d7c/fa6 x:0 0 0 2024-05-06T21:26:47.387 INFO:tasks.workunit.client.1.smithi154.stdout:1/377: truncate d6/db/d10/f33 340546 0 2024-05-06T21:26:47.388 INFO:tasks.workunit.client.1.smithi154.stdout:6/260: write d8/f23 [2847940,94418] 0 2024-05-06T21:26:47.388 INFO:tasks.workunit.client.1.smithi154.stdout:1/378: write d6/db/d10/d15/f20 [663710,34811] 0 2024-05-06T21:26:47.388 INFO:tasks.workunit.client.1.smithi154.stdout:5/355: link d2/d6/dc/f53 d2/d6/dc/d71/f75 0 2024-05-06T21:26:47.388 INFO:tasks.workunit.client.0.smithi032.stdout:0/629: mkdir d4/da/d16/d33/d9e/dc9/dcb 0 2024-05-06T21:26:47.390 INFO:tasks.workunit.client.1.smithi154.stdout:3/489: mknod d0/da/db/ca7 0 2024-05-06T21:26:47.390 INFO:tasks.workunit.client.1.smithi154.stdout:3/490: chown d0/d2/d22 4758329 1 2024-05-06T21:26:47.390 INFO:tasks.workunit.client.1.smithi154.stdout:3/491: dread - d0/da/d1a/d28/d17/f63 zero size 2024-05-06T21:26:47.390 INFO:tasks.workunit.client.1.smithi154.stdout:3/492: creat d0/da/d1a/d28/d2f/fa8 x:0 0 0 2024-05-06T21:26:47.390 INFO:tasks.workunit.client.1.smithi154.stdout:3/493: write d0/da/db/dd/d1c/d21/d37/f99 [231837,57420] 0 2024-05-06T21:26:47.390 INFO:tasks.workunit.client.1.smithi154.stdout:3/494: truncate d0/da/db/dd/d1c/d41/f79 738993 0 2024-05-06T21:26:47.394 INFO:tasks.workunit.client.1.smithi154.stdout:6/261: rename d8/d11/d2d/l34 to d8/d11/d2d/d3d/d4c/l5c 0 2024-05-06T21:26:47.396 INFO:tasks.workunit.client.1.smithi154.stdout:5/356: mknod d2/d3/d21/d22/d25/d37/c76 0 2024-05-06T21:26:47.399 INFO:tasks.workunit.client.1.smithi154.stdout:3/495: mkdir d0/da/d1a/d28/d2f/d81/d48/da9 0 2024-05-06T21:26:47.399 INFO:tasks.workunit.client.1.smithi154.stdout:3/496: chown d0/d2/c1f 1610443940 1 2024-05-06T21:26:47.400 INFO:tasks.workunit.client.0.smithi032.stdout:4/771: creat d2/d1e/d47/ff5 x:0 0 0 2024-05-06T21:26:47.400 INFO:tasks.workunit.client.0.smithi032.stdout:4/772: read - d2/d13/daa/db8/de7/f9f zero size 2024-05-06T21:26:47.402 INFO:tasks.workunit.client.1.smithi154.stdout:5/357: rename d2/d3/d19/d23/l3b to d2/d3/d21/d22/l77 0 2024-05-06T21:26:47.402 INFO:tasks.workunit.client.1.smithi154.stdout:5/358: fdatasync d2/d6/dd/f64 0 2024-05-06T21:26:47.402 INFO:tasks.workunit.client.1.smithi154.stdout:5/359: read - d2/d6/dc/f66 zero size 2024-05-06T21:26:47.403 INFO:tasks.workunit.client.1.smithi154.stdout:0/421: dwrite d6/dc/d44/f72 [0,4194304] 0 2024-05-06T21:26:47.403 INFO:tasks.workunit.client.0.smithi032.stdout:3/749: rename d1/d4/da/d31/d47/d4a/d68/c89 to d1/d4/da/d4e/d5e/c100 0 2024-05-06T21:26:47.403 INFO:tasks.workunit.client.0.smithi032.stdout:3/750: chown d1/d4/da/d4e/d41/d97/d67/f7b 217580 1 2024-05-06T21:26:47.405 INFO:tasks.workunit.client.0.smithi032.stdout:2/560: mknod df/d19/d1e/d35/dc5/cc9 0 2024-05-06T21:26:47.407 INFO:tasks.workunit.client.1.smithi154.stdout:1/379: dwrite d6/db/f5b [0,4194304] 0 2024-05-06T21:26:47.408 INFO:tasks.workunit.client.1.smithi154.stdout:6/262: dread d8/d11/f1b [0,4194304] 0 2024-05-06T21:26:47.408 INFO:tasks.workunit.client.1.smithi154.stdout:6/263: chown d8/d13/d20 157 1 2024-05-06T21:26:47.408 INFO:tasks.workunit.client.1.smithi154.stdout:6/264: fdatasync d8/f31 0 2024-05-06T21:26:47.409 INFO:tasks.workunit.client.1.smithi154.stdout:0/422: mkdir d6/dc/d40/d4a/d6c/d88 0 2024-05-06T21:26:47.411 INFO:tasks.workunit.client.1.smithi154.stdout:9/440: dwrite d5/d20/d52/f4f [0,4194304] 0 2024-05-06T21:26:47.412 INFO:tasks.workunit.client.0.smithi032.stdout:7/735: sync 2024-05-06T21:26:47.412 INFO:tasks.workunit.client.0.smithi032.stdout:5/680: sync 2024-05-06T21:26:47.413 INFO:tasks.workunit.client.0.smithi032.stdout:3/751: mkdir d1/d4/da/d9f/db8/dd0/dd9/d101 0 2024-05-06T21:26:47.415 INFO:tasks.workunit.client.1.smithi154.stdout:5/360: dread d2/f14 [0,4194304] 0 2024-05-06T21:26:47.416 INFO:tasks.workunit.client.0.smithi032.stdout:4/773: write d2/d13/f56 [1668991,49706] 0 2024-05-06T21:26:47.416 INFO:tasks.workunit.client.1.smithi154.stdout:3/497: rmdir d0/da/db/d7c 39 2024-05-06T21:26:47.419 INFO:tasks.workunit.client.0.smithi032.stdout:5/681: creat d0/d24/d38/fd5 x:0 0 0 2024-05-06T21:26:47.421 INFO:tasks.workunit.client.0.smithi032.stdout:3/752: creat d1/d4/da/d9f/d74/f102 x:0 0 0 2024-05-06T21:26:47.425 INFO:tasks.workunit.client.1.smithi154.stdout:1/380: creat d6/d3e/f75 x:0 0 0 2024-05-06T21:26:47.425 INFO:tasks.workunit.client.1.smithi154.stdout:0/423: write d6/dc/d44/f46 [2872733,66846] 0 2024-05-06T21:26:47.426 INFO:tasks.workunit.client.0.smithi032.stdout:5/682: mkdir d0/d16/d2a/d5f/dd6 0 2024-05-06T21:26:47.426 INFO:tasks.workunit.client.0.smithi032.stdout:5/683: fsync d0/d24/d26/d32/fd3 0 2024-05-06T21:26:47.426 INFO:tasks.workunit.client.0.smithi032.stdout:4/774: mkdir d2/d16/df6 0 2024-05-06T21:26:47.427 INFO:tasks.workunit.client.1.smithi154.stdout:3/498: dread d0/da/db/dd/ff [0,4194304] 0 2024-05-06T21:26:47.427 INFO:tasks.workunit.client.1.smithi154.stdout:3/499: stat d0/da/d1a/d28/d17/f4f 0 2024-05-06T21:26:47.427 INFO:tasks.workunit.client.1.smithi154.stdout:3/500: write d0/d2/f45 [223467,38564] 0 2024-05-06T21:26:47.429 INFO:tasks.workunit.client.0.smithi032.stdout:5/684: creat d0/d24/d38/d37/da6/fd7 x:0 0 0 2024-05-06T21:26:47.430 INFO:tasks.workunit.client.0.smithi032.stdout:5/685: getdents d0/d16/d2a/d59/d67 0 2024-05-06T21:26:47.431 INFO:tasks.workunit.client.0.smithi032.stdout:5/686: chown d0/d24/d26/c39 8 1 2024-05-06T21:26:47.431 INFO:tasks.workunit.client.0.smithi032.stdout:5/687: dread - d0/d16/fce zero size 2024-05-06T21:26:47.431 INFO:tasks.workunit.client.0.smithi032.stdout:5/688: dread - d0/d16/d46/fae zero size 2024-05-06T21:26:47.431 INFO:tasks.workunit.client.1.smithi154.stdout:9/441: truncate d5/d20/f2c 617750 0 2024-05-06T21:26:47.432 INFO:tasks.workunit.client.1.smithi154.stdout:5/361: creat d2/d3/d19/d23/f78 x:0 0 0 2024-05-06T21:26:47.433 INFO:tasks.workunit.client.1.smithi154.stdout:1/381: dread d6/db/d10/f51 [0,4194304] 0 2024-05-06T21:26:47.433 INFO:tasks.workunit.client.1.smithi154.stdout:1/382: fdatasync d6/f47 0 2024-05-06T21:26:47.433 INFO:tasks.workunit.client.1.smithi154.stdout:0/424: mkdir d6/dc/d44/d36/d89 0 2024-05-06T21:26:47.434 INFO:tasks.workunit.client.0.smithi032.stdout:7/736: rmdir db/d12/d16/da1 39 2024-05-06T21:26:47.434 INFO:tasks.workunit.client.0.smithi032.stdout:7/737: chown db/d12/d16 0 1 2024-05-06T21:26:47.434 INFO:tasks.workunit.client.0.smithi032.stdout:7/738: getdents db/d12/d16/d2a/d39/d8b 0 2024-05-06T21:26:47.436 INFO:tasks.workunit.client.1.smithi154.stdout:3/501: mknod d0/da/db/d7c/caa 0 2024-05-06T21:26:47.437 INFO:tasks.workunit.client.1.smithi154.stdout:5/362: unlink d2/d6/dc/f53 0 2024-05-06T21:26:47.438 INFO:tasks.workunit.client.1.smithi154.stdout:5/363: mknod d2/d6/dc/d68/c79 0 2024-05-06T21:26:47.439 INFO:tasks.workunit.client.0.smithi032.stdout:5/689: read d0/d24/d38/d37/f53 [738517,14376] 0 2024-05-06T21:26:47.440 INFO:tasks.workunit.client.0.smithi032.stdout:5/690: write d0/d16/d2a/d5f/dca/f92 [3758650,121156] 0 2024-05-06T21:26:47.440 INFO:tasks.workunit.client.0.smithi032.stdout:5/691: getdents d0/d24/d38/d37/d7b/dc0 0 2024-05-06T21:26:47.440 INFO:tasks.workunit.client.0.smithi032.stdout:2/561: dwrite df/d19/d1e/d35/dc5/fb9 [0,4194304] 0 2024-05-06T21:26:47.440 INFO:tasks.workunit.client.0.smithi032.stdout:2/562: write df/d19/d1e/d35/f56 [842546,58432] 0 2024-05-06T21:26:47.440 INFO:tasks.workunit.client.0.smithi032.stdout:2/563: chown df/f2c 14254074 1 2024-05-06T21:26:47.440 INFO:tasks.workunit.client.0.smithi032.stdout:2/564: stat df/d19/d1e/d42/dc6/dc1 0 2024-05-06T21:26:47.440 INFO:tasks.workunit.client.1.smithi154.stdout:5/364: rmdir d2/d3/d21/d22/d25/d37 39 2024-05-06T21:26:47.441 INFO:tasks.workunit.client.0.smithi032.stdout:0/630: mkdir d4/da/d16/dcc 0 2024-05-06T21:26:47.443 INFO:tasks.workunit.client.1.smithi154.stdout:5/365: symlink d2/d48/l7a 0 2024-05-06T21:26:47.443 INFO:tasks.workunit.client.1.smithi154.stdout:5/366: chown d2/d6/dd/d2a/d54/d43 367020439 1 2024-05-06T21:26:47.443 INFO:tasks.workunit.client.1.smithi154.stdout:5/367: write d2/d6/dd/d2a/f3d [6815404,23086] 0 2024-05-06T21:26:47.443 INFO:tasks.workunit.client.1.smithi154.stdout:5/368: chown d2/d6/l62 507 1 2024-05-06T21:26:47.443 INFO:tasks.workunit.client.1.smithi154.stdout:6/265: dwrite d8/d11/d2d/d3d/f3c [0,4194304] 0 2024-05-06T21:26:47.445 INFO:tasks.workunit.client.1.smithi154.stdout:5/369: getdents d2/d3/d21/d22/d25 0 2024-05-06T21:26:47.447 INFO:tasks.workunit.client.0.smithi032.stdout:8/887: unlink d0/d1c/d5e/d67/dc3/d57/f79 0 2024-05-06T21:26:47.452 INFO:tasks.workunit.client.1.smithi154.stdout:6/266: creat d8/d11/d2d/d57/f5d x:0 0 0 2024-05-06T21:26:47.453 INFO:tasks.workunit.client.0.smithi032.stdout:2/565: unlink df/d19/d1e/d35/dc5/fac 0 2024-05-06T21:26:47.453 INFO:tasks.workunit.client.0.smithi032.stdout:2/566: fsync df/f12 0 2024-05-06T21:26:47.456 INFO:tasks.workunit.client.1.smithi154.stdout:5/370: rmdir d2/d48 39 2024-05-06T21:26:47.456 INFO:tasks.workunit.client.0.smithi032.stdout:0/631: mknod d4/da/d16/d33/d9e/dc9/ccd 0 2024-05-06T21:26:47.456 INFO:tasks.workunit.client.0.smithi032.stdout:0/632: write d4/da/d14/d1a/fa4 [4609000,34221] 0 2024-05-06T21:26:47.457 INFO:tasks.workunit.client.0.smithi032.stdout:8/888: mkdir d0/d1b/d47/d91/da7/dc1/d112 0 2024-05-06T21:26:47.458 INFO:tasks.workunit.client.0.smithi032.stdout:2/567: mknod df/d19/d1e/cca 0 2024-05-06T21:26:47.458 INFO:tasks.workunit.client.0.smithi032.stdout:0/633: read d4/d3e/d63/dca/f6e [4463897,2038] 0 2024-05-06T21:26:47.458 INFO:tasks.workunit.client.0.smithi032.stdout:0/634: chown d4/d3e/d42/cb1 400 1 2024-05-06T21:26:47.459 INFO:tasks.workunit.client.0.smithi032.stdout:4/775: dwrite d2/d16/d44/d74/d76/fb2 [0,4194304] 0 2024-05-06T21:26:47.459 INFO:tasks.workunit.client.0.smithi032.stdout:4/776: chown d2/d2c/c87 0 1 2024-05-06T21:26:47.463 INFO:tasks.workunit.client.0.smithi032.stdout:8/889: mknod d0/d1c/d5e/d67/d7b/dab/c113 0 2024-05-06T21:26:47.464 INFO:tasks.workunit.client.0.smithi032.stdout:2/568: creat df/d19/d1e/d35/dc5/d2e/fcb x:0 0 0 2024-05-06T21:26:47.465 INFO:tasks.workunit.client.0.smithi032.stdout:0/635: creat d4/d3e/d42/fce x:0 0 0 2024-05-06T21:26:47.466 INFO:tasks.workunit.client.0.smithi032.stdout:8/890: getdents d0/d1b/d39/d93 0 2024-05-06T21:26:47.467 INFO:tasks.workunit.client.0.smithi032.stdout:5/692: dwrite d0/d16/d2f/f41 [0,4194304] 0 2024-05-06T21:26:47.467 INFO:tasks.workunit.client.0.smithi032.stdout:5/693: write d0/fb [1761127,45561] 0 2024-05-06T21:26:47.470 INFO:tasks.workunit.client.0.smithi032.stdout:2/569: creat df/d19/d1e/d35/dc5/d9f/dc0/fcc x:0 0 0 2024-05-06T21:26:47.470 INFO:tasks.workunit.client.0.smithi032.stdout:2/570: read - df/d19/d1e/d35/dc5/d9f/fa1 zero size 2024-05-06T21:26:47.472 INFO:tasks.workunit.client.0.smithi032.stdout:0/636: mkdir d4/da/d16/d33/d9e/dcf 0 2024-05-06T21:26:47.474 INFO:tasks.workunit.client.0.smithi032.stdout:8/891: mkdir d0/d1b/d47/d91/de5/d114 0 2024-05-06T21:26:47.476 INFO:tasks.workunit.client.1.smithi154.stdout:5/371: dread d2/d6/fb [0,4194304] 0 2024-05-06T21:26:47.478 INFO:tasks.workunit.client.0.smithi032.stdout:2/571: mknod df/d19/d1e/d71/d5f/d7d/d25/d2d/ccd 0 2024-05-06T21:26:47.478 INFO:tasks.workunit.client.0.smithi032.stdout:2/572: chown df/d19/d1e/d71/d5f/d7d/d25/c98 87694263 1 2024-05-06T21:26:47.480 INFO:tasks.workunit.client.0.smithi032.stdout:0/637: mkdir d4/da/d14/d1a/d66/d8a/dd0 0 2024-05-06T21:26:47.483 INFO:tasks.workunit.client.1.smithi154.stdout:1/383: dwrite d6/d3e/f75 [0,4194304] 0 2024-05-06T21:26:47.483 INFO:tasks.workunit.client.1.smithi154.stdout:1/384: write d6/f66 [139947,63579] 0 2024-05-06T21:26:47.484 INFO:tasks.workunit.client.0.smithi032.stdout:2/573: creat df/d19/d1e/d71/d5f/d7d/d65/fce x:0 0 0 2024-05-06T21:26:47.485 INFO:tasks.workunit.client.0.smithi032.stdout:0/638: creat d4/da/d16/dcc/fd1 x:0 0 0 2024-05-06T21:26:47.486 INFO:tasks.workunit.client.1.smithi154.stdout:1/385: mknod d6/db/d69/c76 0 2024-05-06T21:26:47.487 INFO:tasks.workunit.client.0.smithi032.stdout:0/639: getdents d4/d3e/d63 0 2024-05-06T21:26:47.490 INFO:tasks.workunit.client.1.smithi154.stdout:5/372: write d2/d3/f31 [1717179,52781] 0 2024-05-06T21:26:47.490 INFO:tasks.workunit.client.1.smithi154.stdout:5/373: readlink d2/d6/dd/l1c 0 2024-05-06T21:26:47.490 INFO:tasks.workunit.client.1.smithi154.stdout:5/374: truncate d2/d6/dd/d2a/d54/f5c 780774 0 2024-05-06T21:26:47.490 INFO:tasks.workunit.client.1.smithi154.stdout:9/442: dwrite d5/d14/f43 [0,4194304] 0 2024-05-06T21:26:47.491 INFO:tasks.workunit.client.0.smithi032.stdout:6/733: rename d8/dd/d18/d3b/l4f to d8/d3d/d49/ldb 0 2024-05-06T21:26:47.492 INFO:tasks.workunit.client.1.smithi154.stdout:5/375: rmdir d2/d6/dd/d2a/d54/d43/d73/d74 0 2024-05-06T21:26:47.492 INFO:tasks.workunit.client.1.smithi154.stdout:5/376: fsync d2/f6e 0 2024-05-06T21:26:47.493 INFO:tasks.workunit.client.1.smithi154.stdout:5/377: readlink d2/d6/dd/l1c 0 2024-05-06T21:26:47.493 INFO:tasks.workunit.client.1.smithi154.stdout:5/378: write d2/d3/f6d [230236,123318] 0 2024-05-06T21:26:47.493 INFO:tasks.workunit.client.0.smithi032.stdout:6/734: mknod d8/dd/d18/d22/cdc 0 2024-05-06T21:26:47.494 INFO:tasks.workunit.client.0.smithi032.stdout:5/694: dwrite d0/d16/d46/da9/fbd [0,4194304] 0 2024-05-06T21:26:47.494 INFO:tasks.workunit.client.0.smithi032.stdout:5/695: write d0/d16/f91 [32910,32120] 0 2024-05-06T21:26:47.494 INFO:tasks.workunit.client.1.smithi154.stdout:9/443: creat d5/d14/d87/f9e x:0 0 0 2024-05-06T21:26:47.494 INFO:tasks.workunit.client.1.smithi154.stdout:9/444: stat d5/f1a 0 2024-05-06T21:26:47.495 INFO:tasks.workunit.client.1.smithi154.stdout:9/445: fdatasync d5/d20/f81 0 2024-05-06T21:26:47.495 INFO:tasks.workunit.client.1.smithi154.stdout:1/386: write d6/db/d10/d15/d1d/f61 [1050345,120869] 0 2024-05-06T21:26:47.496 INFO:tasks.workunit.client.0.smithi032.stdout:9/709: creat d1/d2f/da1/dc2/d64/fee x:0 0 0 2024-05-06T21:26:47.497 INFO:tasks.workunit.client.1.smithi154.stdout:0/425: dwrite d6/dc/f2f [0,4194304] 0 2024-05-06T21:26:47.497 INFO:tasks.workunit.client.1.smithi154.stdout:0/426: read - d6/dc/d42/f7f zero size 2024-05-06T21:26:47.497 INFO:tasks.workunit.client.1.smithi154.stdout:3/502: dwrite d0/da/db/f2a [0,4194304] 0 2024-05-06T21:26:47.497 INFO:tasks.workunit.client.1.smithi154.stdout:1/387: creat d6/db/d10/f77 x:0 0 0 2024-05-06T21:26:47.498 INFO:tasks.workunit.client.0.smithi032.stdout:6/735: symlink d8/d3d/ldd 0 2024-05-06T21:26:47.499 INFO:tasks.workunit.client.1.smithi154.stdout:0/427: rename d6/dc/d40/d4a/d6c/d88 to d6/dc/d40/d4a/d6c/d8a 0 2024-05-06T21:26:47.499 INFO:tasks.workunit.client.0.smithi032.stdout:4/777: dwrite d2/d16/d44/d45/dc1/fe9 [0,4194304] 0 2024-05-06T21:26:47.500 INFO:tasks.workunit.client.1.smithi154.stdout:3/503: rmdir d0/da/d1a/d28/d2f/d81/d9c 39 2024-05-06T21:26:47.501 INFO:tasks.workunit.client.1.smithi154.stdout:3/504: dread - d0/da/db/d7c/fa6 zero size 2024-05-06T21:26:47.501 INFO:tasks.workunit.client.1.smithi154.stdout:3/505: creat d0/da/db/d30/fab x:0 0 0 2024-05-06T21:26:47.501 INFO:tasks.workunit.client.1.smithi154.stdout:3/506: read d0/da/db/f10 [1051089,73926] 0 2024-05-06T21:26:47.501 INFO:tasks.workunit.client.0.smithi032.stdout:8/892: dwrite d0/f8 [0,4194304] 0 2024-05-06T21:26:47.502 INFO:tasks.workunit.client.1.smithi154.stdout:0/428: creat d6/dc/d44/d36/d89/f8b x:0 0 0 2024-05-06T21:26:47.503 INFO:tasks.workunit.client.0.smithi032.stdout:5/696: symlink d0/d87/ld8 0 2024-05-06T21:26:47.504 INFO:tasks.workunit.client.0.smithi032.stdout:5/697: truncate d0/d16/fce 636986 0 2024-05-06T21:26:47.504 INFO:tasks.workunit.client.0.smithi032.stdout:5/698: fsync d0/d16/d2a/d59/f5b 0 2024-05-06T21:26:47.509 INFO:tasks.workunit.client.1.smithi154.stdout:6/267: dwrite d8/d11/d2d/f3a [0,4194304] 0 2024-05-06T21:26:47.510 INFO:tasks.workunit.client.1.smithi154.stdout:0/429: link d6/dc/d51/f6f d6/dc/d40/d5e/f8c 0 2024-05-06T21:26:47.510 INFO:tasks.workunit.client.1.smithi154.stdout:0/430: readlink d6/dc/d42/l6b 0 2024-05-06T21:26:47.511 INFO:tasks.workunit.client.0.smithi032.stdout:8/893: link d0/f7 d0/d1c/d5e/d67/dc3/db5/f115 0 2024-05-06T21:26:47.514 INFO:tasks.workunit.client.0.smithi032.stdout:6/736: unlink d8/dd/d18/d13/f58 0 2024-05-06T21:26:47.519 INFO:tasks.workunit.client.0.smithi032.stdout:6/737: symlink d8/d33/lde 0 2024-05-06T21:26:47.520 INFO:tasks.workunit.client.1.smithi154.stdout:5/379: dwrite d2/d6/dc/f15 [0,4194304] 0 2024-05-06T21:26:47.524 INFO:tasks.workunit.client.1.smithi154.stdout:3/507: write d0/da/db/dd/ff [2852313,72667] 0 2024-05-06T21:26:47.526 INFO:tasks.workunit.client.0.smithi032.stdout:3/753: unlink d1/d4/fe 0 2024-05-06T21:26:47.527 INFO:tasks.workunit.client.0.smithi032.stdout:1/671: rename db/d37/d52/fc5 to db/fd6 0 2024-05-06T21:26:47.528 INFO:tasks.workunit.client.1.smithi154.stdout:0/431: link d6/dc/f50 d6/dc/d42/f8d 0 2024-05-06T21:26:47.532 INFO:tasks.workunit.client.1.smithi154.stdout:5/380: unlink d2/d3/d21/d22/d25/d37/l56 0 2024-05-06T21:26:47.534 INFO:tasks.workunit.client.0.smithi032.stdout:6/738: link d8/dd/d18/d3b/db9/c6e d8/dd/d18/d13/d7a/cdf 0 2024-05-06T21:26:47.534 INFO:tasks.workunit.client.0.smithi032.stdout:3/754: truncate d1/d4/da/d4e/d41/d45/f4d 1391696 0 2024-05-06T21:26:47.535 INFO:tasks.workunit.client.0.smithi032.stdout:6/739: chown d8/dd/d18/d3b/lb0 9104484 1 2024-05-06T21:26:47.535 INFO:tasks.workunit.client.1.smithi154.stdout:0/432: rename d6/dc/d44/f31 to d6/f8e 0 2024-05-06T21:26:47.535 INFO:tasks.workunit.client.1.smithi154.stdout:0/433: write d6/dc/d44/d36/f57 [725266,29992] 0 2024-05-06T21:26:47.538 INFO:tasks.workunit.client.0.smithi032.stdout:7/739: rename db/d12/d16/d21/de8 to db/d12/de9 0 2024-05-06T21:26:47.544 INFO:tasks.workunit.client.0.smithi032.stdout:3/755: creat d1/d4/da/d9f/db8/dd0/dd9/d101/f103 x:0 0 0 2024-05-06T21:26:47.546 INFO:tasks.workunit.client.0.smithi032.stdout:2/574: rename c6 to df/d19/d1e/d71/d5f/d7d/d25/d2d/ccf 0 2024-05-06T21:26:47.546 INFO:tasks.workunit.client.1.smithi154.stdout:6/268: dwrite d8/d11/d33/d4a/f49 [0,4194304] 0 2024-05-06T21:26:47.546 INFO:tasks.workunit.client.1.smithi154.stdout:6/269: chown d8/d11/d33/d4a 40933716 1 2024-05-06T21:26:47.546 INFO:tasks.workunit.client.1.smithi154.stdout:4/314: sync 2024-05-06T21:26:47.547 INFO:tasks.workunit.client.1.smithi154.stdout:4/315: creat d0/d2/f69 x:0 0 0 2024-05-06T21:26:47.547 INFO:tasks.workunit.client.1.smithi154.stdout:8/310: sync 2024-05-06T21:26:47.547 INFO:tasks.workunit.client.1.smithi154.stdout:7/240: sync 2024-05-06T21:26:47.547 INFO:tasks.workunit.client.1.smithi154.stdout:7/241: fsync d6/d20/f1d 0 2024-05-06T21:26:47.550 INFO:tasks.workunit.client.1.smithi154.stdout:4/316: mknod d0/d10/c6a 0 2024-05-06T21:26:47.551 INFO:tasks.workunit.client.0.smithi032.stdout:7/740: dread db/d12/d49/d97/fcf [0,4194304] 0 2024-05-06T21:26:47.551 INFO:tasks.workunit.client.0.smithi032.stdout:7/741: write db/d12/d16/fb4 [451654,37873] 0 2024-05-06T21:26:47.551 INFO:tasks.workunit.client.0.smithi032.stdout:7/742: chown db/d12/d16/d21/d41/d78/c69 1646373 1 2024-05-06T21:26:47.552 INFO:tasks.workunit.client.1.smithi154.stdout:8/311: mknod d3/d14/d1a/d45/c65 0 2024-05-06T21:26:47.552 INFO:tasks.workunit.client.1.smithi154.stdout:8/312: fsync d3/d14/d1a/d45/f5a 0 2024-05-06T21:26:47.552 INFO:tasks.workunit.client.1.smithi154.stdout:8/313: creat d3/d14/d1a/d29/d3e/f66 x:0 0 0 2024-05-06T21:26:47.552 INFO:tasks.workunit.client.1.smithi154.stdout:7/242: truncate d6/de/f31 2616999 0 2024-05-06T21:26:47.552 INFO:tasks.workunit.client.0.smithi032.stdout:3/756: mknod d1/d4/da/d31/d47/d4a/d68/d7c/da8/dea/c104 0 2024-05-06T21:26:47.552 INFO:tasks.workunit.client.0.smithi032.stdout:3/757: dread - d1/d4/da/d31/d47/fc1 zero size 2024-05-06T21:26:47.554 INFO:tasks.workunit.client.1.smithi154.stdout:4/317: creat d0/d10/d11/d1a/d31/d3d/f6b x:0 0 0 2024-05-06T21:26:47.556 INFO:tasks.workunit.client.0.smithi032.stdout:0/640: rename d4/da/d16/l59 to d4/da/d14/ld2 0 2024-05-06T21:26:47.556 INFO:tasks.workunit.client.0.smithi032.stdout:0/641: write d4/da/d14/d1a/fb6 [955871,18136] 0 2024-05-06T21:26:47.556 INFO:tasks.workunit.client.0.smithi032.stdout:0/642: fdatasync d4/f7 0 2024-05-06T21:26:47.556 INFO:tasks.workunit.client.0.smithi032.stdout:0/643: readlink d4/da/d14/ld2 0 2024-05-06T21:26:47.556 INFO:tasks.workunit.client.0.smithi032.stdout:0/644: truncate d4/da/f60 902614 0 2024-05-06T21:26:47.556 INFO:tasks.workunit.client.0.smithi032.stdout:0/645: chown d4/da/d16/d33/c67 206 1 2024-05-06T21:26:47.556 INFO:tasks.workunit.client.0.smithi032.stdout:4/778: dwrite d2/d13/f8d [0,4194304] 0 2024-05-06T21:26:47.556 INFO:tasks.workunit.client.0.smithi032.stdout:2/575: rmdir df/d19/d1e/d71/d5f/d7d/d25/d2d 39 2024-05-06T21:26:47.557 INFO:tasks.workunit.client.1.smithi154.stdout:8/314: mkdir d3/d14/d1a/d29/d32/d40/d59/d67 0 2024-05-06T21:26:47.559 INFO:tasks.workunit.client.1.smithi154.stdout:7/243: symlink d6/l4a 0 2024-05-06T21:26:47.559 INFO:tasks.workunit.client.0.smithi032.stdout:3/758: write d1/d4/db7/d8b/fda [180213,103036] 0 2024-05-06T21:26:47.559 INFO:tasks.workunit.client.0.smithi032.stdout:3/759: truncate d1/d4/da/d9f/db8/dd0/dd9/d101/f103 170591 0 2024-05-06T21:26:47.560 INFO:tasks.workunit.client.0.smithi032.stdout:7/743: getdents db/d12/d16/d21/dcb/dd7 0 2024-05-06T21:26:47.562 INFO:tasks.workunit.client.0.smithi032.stdout:0/646: creat d4/da/d14/d1a/d66/fd3 x:0 0 0 2024-05-06T21:26:47.562 INFO:tasks.workunit.client.1.smithi154.stdout:4/318: symlink d0/d10/d11/d1a/d31/d44/l6c 0 2024-05-06T21:26:47.564 INFO:tasks.workunit.client.0.smithi032.stdout:9/710: rename d1/d13/d33/d3f/cb6 to d1/d2f/da1/cef 0 2024-05-06T21:26:47.565 INFO:tasks.workunit.client.1.smithi154.stdout:4/319: link d0/d2/f53 d0/d2/d47/f6d 0 2024-05-06T21:26:47.566 INFO:tasks.workunit.client.0.smithi032.stdout:4/779: truncate d2/d16/d44/d74/d76/fab 309473 0 2024-05-06T21:26:47.567 INFO:tasks.workunit.client.0.smithi032.stdout:4/780: chown d2/d13 486 1 2024-05-06T21:26:47.569 INFO:tasks.workunit.client.1.smithi154.stdout:8/315: rename d3/d14/d1a/d22 to d3/d14/d1a/d29/d68 0 2024-05-06T21:26:47.569 INFO:tasks.workunit.client.1.smithi154.stdout:9/446: dwrite d5/d20/d37/f5f [0,4194304] 0 2024-05-06T21:26:47.569 INFO:tasks.workunit.client.0.smithi032.stdout:7/744: creat db/d12/d16/d21/dcb/fea x:0 0 0 2024-05-06T21:26:47.569 INFO:tasks.workunit.client.0.smithi032.stdout:7/745: write db/d12/d16/d2a/d39/d3b/fce [357497,87203] 0 2024-05-06T21:26:47.570 INFO:tasks.workunit.client.1.smithi154.stdout:7/244: dread d6/f1a [0,4194304] 0 2024-05-06T21:26:47.570 INFO:tasks.workunit.client.1.smithi154.stdout:4/320: rename d0/d2/dc/l51 to d0/d10/d11/d1a/d31/d44/l6e 0 2024-05-06T21:26:47.571 INFO:tasks.workunit.client.0.smithi032.stdout:0/647: symlink d4/da/d14/d4a/ld4 0 2024-05-06T21:26:47.571 INFO:tasks.workunit.client.1.smithi154.stdout:6/270: dread d8/f31 [0,4194304] 0 2024-05-06T21:26:47.572 INFO:tasks.workunit.client.0.smithi032.stdout:3/760: mknod d1/d2a/c105 0 2024-05-06T21:26:47.572 INFO:tasks.workunit.client.1.smithi154.stdout:8/316: link d3/c36 d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/c69 0 2024-05-06T21:26:47.573 INFO:tasks.workunit.client.0.smithi032.stdout:7/746: symlink db/d12/d16/d21/d41/d4b/leb 0 2024-05-06T21:26:47.574 INFO:tasks.workunit.client.0.smithi032.stdout:3/761: mknod d1/d4/da/d4e/c106 0 2024-05-06T21:26:47.574 INFO:tasks.workunit.client.0.smithi032.stdout:9/711: dread d1/fe [0,4194304] 0 2024-05-06T21:26:47.575 INFO:tasks.workunit.client.1.smithi154.stdout:9/447: mknod d5/d14/d87/c9f 0 2024-05-06T21:26:47.575 INFO:tasks.workunit.client.0.smithi032.stdout:3/762: mknod d1/d4/da/d9f/db8/dd0/dd9/c107 0 2024-05-06T21:26:47.577 INFO:tasks.workunit.client.1.smithi154.stdout:7/245: rmdir d6/d42/d47 0 2024-05-06T21:26:47.577 INFO:tasks.workunit.client.1.smithi154.stdout:7/246: fdatasync d6/de/f19 0 2024-05-06T21:26:47.578 INFO:tasks.workunit.client.1.smithi154.stdout:4/321: symlink d0/d10/d11/d1a/d31/d3d/l6f 0 2024-05-06T21:26:47.579 INFO:tasks.workunit.client.1.smithi154.stdout:9/448: mkdir d5/d2e/da0 0 2024-05-06T21:26:47.579 INFO:tasks.workunit.client.1.smithi154.stdout:9/449: readlink d5/d14/d31/l4e 0 2024-05-06T21:26:47.579 INFO:tasks.workunit.client.1.smithi154.stdout:9/450: read - d5/d14/d87/f9e zero size 2024-05-06T21:26:47.580 INFO:tasks.workunit.client.0.smithi032.stdout:7/747: dread db/d12/d16/d21/d41/d4b/f59 [0,4194304] 0 2024-05-06T21:26:47.581 INFO:tasks.workunit.client.1.smithi154.stdout:7/247: rename d6/d20/l34 to d6/d20/d40/l4b 0 2024-05-06T21:26:47.581 INFO:tasks.workunit.client.0.smithi032.stdout:0/648: write d4/d3e/f85 [1617736,80798] 0 2024-05-06T21:26:47.582 INFO:tasks.workunit.client.1.smithi154.stdout:4/322: mknod d0/d2/d29/d60/c70 0 2024-05-06T21:26:47.582 INFO:tasks.workunit.client.1.smithi154.stdout:4/323: stat d0/d2/f1c 0 2024-05-06T21:26:47.583 INFO:tasks.workunit.client.0.smithi032.stdout:0/649: creat d4/d3e/d63/fd5 x:0 0 0 2024-05-06T21:26:47.583 INFO:tasks.workunit.client.0.smithi032.stdout:9/712: dread d1/d13/d33/f7d [0,4194304] 0 2024-05-06T21:26:47.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/451: creat d5/d14/d3a/fa1 x:0 0 0 2024-05-06T21:26:47.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/452: readlink d5/d14/d87/l69 0 2024-05-06T21:26:47.584 INFO:tasks.workunit.client.0.smithi032.stdout:5/699: dwrite d0/d16/d2f/d77/f7d [0,4194304] 0 2024-05-06T21:26:47.584 INFO:tasks.workunit.client.0.smithi032.stdout:9/713: symlink d1/d13/d34/d26/d9f/dbe/lf0 0 2024-05-06T21:26:47.585 INFO:tasks.workunit.client.1.smithi154.stdout:3/508: dwrite d0/fe [4194304,4194304] 0 2024-05-06T21:26:47.585 INFO:tasks.workunit.client.1.smithi154.stdout:3/509: fdatasync d0/da/db/f2a 0 2024-05-06T21:26:47.585 INFO:tasks.workunit.client.1.smithi154.stdout:4/324: mknod d0/d10/d11/d1a/d31/d44/c71 0 2024-05-06T21:26:47.586 INFO:tasks.workunit.client.1.smithi154.stdout:4/325: write d0/d10/f41 [766115,61939] 0 2024-05-06T21:26:47.588 INFO:tasks.workunit.client.1.smithi154.stdout:2/333: sync 2024-05-06T21:26:47.588 INFO:tasks.workunit.client.1.smithi154.stdout:2/334: rename db/d12/d1d to db/d12/d1d/d60/d63/d6b 22 2024-05-06T21:26:47.588 INFO:tasks.workunit.client.1.smithi154.stdout:2/335: write db/d12/f2a [1546958,42097] 0 2024-05-06T21:26:47.588 INFO:tasks.workunit.client.1.smithi154.stdout:9/453: mkdir d5/d20/d52/d6e/d83/da2 0 2024-05-06T21:26:47.588 INFO:tasks.workunit.client.1.smithi154.stdout:9/454: fdatasync d5/d20/d37/f64 0 2024-05-06T21:26:47.588 INFO:tasks.workunit.client.0.smithi032.stdout:9/714: mkdir d1/d13/d34/d26/d39/d8b/df1 0 2024-05-06T21:26:47.589 INFO:tasks.workunit.client.0.smithi032.stdout:9/715: dread d1/d2f/d4f/d97/fa4 [0,4194304] 0 2024-05-06T21:26:47.590 INFO:tasks.workunit.client.0.smithi032.stdout:1/672: dwrite db/d16/d46/d57/fa0 [0,4194304] 0 2024-05-06T21:26:47.590 INFO:tasks.workunit.client.0.smithi032.stdout:9/716: chown d1/d13/d34/d26/c77 2047 1 2024-05-06T21:26:47.590 INFO:tasks.workunit.client.1.smithi154.stdout:1/388: dwrite d6/db/d10/d15/f4a [4194304,4194304] 0 2024-05-06T21:26:47.590 INFO:tasks.workunit.client.1.smithi154.stdout:1/389: fdatasync d6/db/d10/d26/f23 0 2024-05-06T21:26:47.590 INFO:tasks.workunit.client.1.smithi154.stdout:0/434: dwrite d6/dc/f4f [0,4194304] 0 2024-05-06T21:26:47.591 INFO:tasks.workunit.client.1.smithi154.stdout:8/317: dread d3/f8 [0,4194304] 0 2024-05-06T21:26:47.591 INFO:tasks.workunit.client.1.smithi154.stdout:8/318: dread - d3/d14/d1a/d45/f5f zero size 2024-05-06T21:26:47.591 INFO:tasks.workunit.client.0.smithi032.stdout:0/650: write d4/da/d14/d1a/fa4 [627103,53752] 0 2024-05-06T21:26:47.592 INFO:tasks.workunit.client.0.smithi032.stdout:4/781: read d2/d16/f5e [4987698,44229] 0 2024-05-06T21:26:47.593 INFO:tasks.workunit.client.1.smithi154.stdout:3/510: creat d0/da/d1a/d28/d2f/d81/d48/da9/fac x:0 0 0 2024-05-06T21:26:47.594 INFO:tasks.workunit.client.0.smithi032.stdout:1/673: symlink db/d47/d4a/da4/ld7 0 2024-05-06T21:26:47.597 INFO:tasks.workunit.client.0.smithi032.stdout:5/700: truncate d0/fb 1342330 0 2024-05-06T21:26:47.597 INFO:tasks.workunit.client.0.smithi032.stdout:0/651: mknod d4/d3e/d42/cd6 0 2024-05-06T21:26:47.597 INFO:tasks.workunit.client.0.smithi032.stdout:5/701: creat d0/d24/d38/d37/da6/fd9 x:0 0 0 2024-05-06T21:26:47.597 INFO:tasks.workunit.client.0.smithi032.stdout:8/894: dwrite d0/d1b/d47/d91/fa3 [0,4194304] 0 2024-05-06T21:26:47.599 INFO:tasks.workunit.client.1.smithi154.stdout:5/381: dwrite d2/d6/dc/f30 [0,4194304] 0 2024-05-06T21:26:47.599 INFO:tasks.workunit.client.1.smithi154.stdout:2/336: unlink db/de/d10/l2f 0 2024-05-06T21:26:47.599 INFO:tasks.workunit.client.1.smithi154.stdout:5/382: fdatasync d2/d3/f16 0 2024-05-06T21:26:47.600 INFO:tasks.workunit.client.0.smithi032.stdout:6/740: dwrite d8/d3d/fd5 [0,4194304] 0 2024-05-06T21:26:47.600 INFO:tasks.workunit.client.0.smithi032.stdout:6/741: write d8/dd/fd3 [208163,61553] 0 2024-05-06T21:26:47.600 INFO:tasks.workunit.client.0.smithi032.stdout:6/742: write d8/dd/d18/d22/f6d [1302737,58395] 0 2024-05-06T21:26:47.600 INFO:tasks.workunit.client.0.smithi032.stdout:0/652: truncate d4/da/d16/f3b 2469928 0 2024-05-06T21:26:47.601 INFO:tasks.workunit.client.1.smithi154.stdout:9/455: creat d5/d20/fa3 x:0 0 0 2024-05-06T21:26:47.601 INFO:tasks.workunit.client.1.smithi154.stdout:8/319: dread d3/f9 [4194304,4194304] 0 2024-05-06T21:26:47.601 INFO:tasks.workunit.client.0.smithi032.stdout:5/702: rmdir d0/d24/d26/d3d/d50 39 2024-05-06T21:26:47.603 INFO:tasks.workunit.client.0.smithi032.stdout:8/895: symlink d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/l116 0 2024-05-06T21:26:47.603 INFO:tasks.workunit.client.0.smithi032.stdout:8/896: write d0/d1c/d5e/f65 [4724617,113154] 0 2024-05-06T21:26:47.606 INFO:tasks.workunit.client.1.smithi154.stdout:0/435: mknod d6/dc/d44/d36/c8f 0 2024-05-06T21:26:47.606 INFO:tasks.workunit.client.1.smithi154.stdout:0/436: fdatasync d6/dc/d42/f8d 0 2024-05-06T21:26:47.606 INFO:tasks.workunit.client.1.smithi154.stdout:0/437: dread - d6/dc/d40/d4a/d6c/f7b zero size 2024-05-06T21:26:47.606 INFO:tasks.workunit.client.1.smithi154.stdout:0/438: chown d6/dc/d44/l1e 64222502 1 2024-05-06T21:26:47.606 INFO:tasks.workunit.client.1.smithi154.stdout:0/439: creat d6/dc/d42/f90 x:0 0 0 2024-05-06T21:26:47.607 INFO:tasks.workunit.client.1.smithi154.stdout:3/511: symlink d0/da/db/dd/d1c/d21/d37/lad 0 2024-05-06T21:26:47.612 INFO:tasks.workunit.client.1.smithi154.stdout:1/390: dwrite d6/f24 [0,4194304] 0 2024-05-06T21:26:47.612 INFO:tasks.workunit.client.1.smithi154.stdout:1/391: write d6/db/d10/f77 [64446,42359] 0 2024-05-06T21:26:47.613 INFO:tasks.workunit.client.1.smithi154.stdout:2/337: symlink db/d12/d1d/l6c 0 2024-05-06T21:26:47.615 INFO:tasks.workunit.client.1.smithi154.stdout:5/383: creat d2/d6/dd/d2a/d54/d43/f7b x:0 0 0 2024-05-06T21:26:47.615 INFO:tasks.workunit.client.1.smithi154.stdout:5/384: write d2/f6e [362373,42209] 0 2024-05-06T21:26:47.615 INFO:tasks.workunit.client.1.smithi154.stdout:5/385: readlink d2/d6/dd/l1c 0 2024-05-06T21:26:47.616 INFO:tasks.workunit.client.0.smithi032.stdout:0/653: unlink d4/f6 0 2024-05-06T21:26:47.617 INFO:tasks.workunit.client.1.smithi154.stdout:8/320: mknod d3/d14/d1a/c6a 0 2024-05-06T21:26:47.619 INFO:tasks.workunit.client.0.smithi032.stdout:8/897: mknod d0/d1b/d47/d91/de5/c117 0 2024-05-06T21:26:47.620 INFO:tasks.workunit.client.1.smithi154.stdout:0/440: symlink d6/dc/d3c/l91 0 2024-05-06T21:26:47.620 INFO:tasks.workunit.client.1.smithi154.stdout:0/441: dread - d6/dc/d40/f47 zero size 2024-05-06T21:26:47.620 INFO:tasks.workunit.client.1.smithi154.stdout:0/442: creat d6/dc/d3c/f92 x:0 0 0 2024-05-06T21:26:47.620 INFO:tasks.workunit.client.1.smithi154.stdout:0/443: write d6/dc/f66 [163647,100801] 0 2024-05-06T21:26:47.621 INFO:tasks.workunit.client.0.smithi032.stdout:0/654: write d4/da/d14/d4a/f93 [672685,59260] 0 2024-05-06T21:26:47.621 INFO:tasks.workunit.client.0.smithi032.stdout:0/655: chown d4/fc 149 1 2024-05-06T21:26:47.621 INFO:tasks.workunit.client.0.smithi032.stdout:0/656: read - d4/d3e/d63/f5c zero size 2024-05-06T21:26:47.621 INFO:tasks.workunit.client.0.smithi032.stdout:0/657: fsync d4/da/d16/d4f/f75 0 2024-05-06T21:26:47.622 INFO:tasks.workunit.client.0.smithi032.stdout:5/703: write d0/d24/d26/d3d/d50/f65 [3985012,82401] 0 2024-05-06T21:26:47.622 INFO:tasks.workunit.client.0.smithi032.stdout:5/704: fsync d0/f12 0 2024-05-06T21:26:47.622 INFO:tasks.workunit.client.0.smithi032.stdout:5/705: write d0/d16/d46/da9/fc8 [660600,14557] 0 2024-05-06T21:26:47.622 INFO:tasks.workunit.client.0.smithi032.stdout:5/706: fdatasync d0/d16/d2a/d5f/dca/f92 0 2024-05-06T21:26:47.622 INFO:tasks.workunit.client.0.smithi032.stdout:8/898: creat d0/d1c/f118 x:0 0 0 2024-05-06T21:26:47.623 INFO:tasks.workunit.client.1.smithi154.stdout:3/512: rename d0/da/d1a/d28/d2f/d81/d48/c69 to d0/da/d1a/d28/d2f/d81/d55/d76/d9a/cae 0 2024-05-06T21:26:47.623 INFO:tasks.workunit.client.0.smithi032.stdout:0/658: mknod d4/da/d14/d4a/cd7 0 2024-05-06T21:26:47.623 INFO:tasks.workunit.client.0.smithi032.stdout:0/659: fsync d4/da/d16/f3c 0 2024-05-06T21:26:47.624 INFO:tasks.workunit.client.0.smithi032.stdout:0/660: getdents d4/da/d16/d33/d9e/dc9/dcb 0 2024-05-06T21:26:47.624 INFO:tasks.workunit.client.0.smithi032.stdout:8/899: truncate d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/fd1 5539945 0 2024-05-06T21:26:47.624 INFO:tasks.workunit.client.0.smithi032.stdout:8/900: dread - d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/f8f zero size 2024-05-06T21:26:47.624 INFO:tasks.workunit.client.0.smithi032.stdout:8/901: chown d0/d1c/d5e/d67/d7b/dab/fc8 242 1 2024-05-06T21:26:47.626 INFO:tasks.workunit.client.0.smithi032.stdout:0/661: mkdir d4/da/d16/d33/d9e/dc9/dd8 0 2024-05-06T21:26:47.627 INFO:tasks.workunit.client.0.smithi032.stdout:8/902: mkdir d0/d1c/d5e/d119 0 2024-05-06T21:26:47.627 INFO:tasks.workunit.client.0.smithi032.stdout:8/903: chown d0/d1b/l2a 1707194 1 2024-05-06T21:26:47.628 INFO:tasks.workunit.client.1.smithi154.stdout:2/338: rmdir db/d12 39 2024-05-06T21:26:47.629 INFO:tasks.workunit.client.0.smithi032.stdout:8/904: mkdir d0/d1c/d5e/d67/dc3/d57/d5d/d63/d11a 0 2024-05-06T21:26:47.629 INFO:tasks.workunit.client.0.smithi032.stdout:8/905: truncate d0/d1c/d5e/f7a 4931576 0 2024-05-06T21:26:47.630 INFO:tasks.workunit.client.1.smithi154.stdout:9/456: dwrite d5/d14/d31/d39/f4a [0,4194304] 0 2024-05-06T21:26:47.633 INFO:tasks.workunit.client.1.smithi154.stdout:5/386: creat d2/d48/f7c x:0 0 0 2024-05-06T21:26:47.633 INFO:tasks.workunit.client.0.smithi032.stdout:3/763: rename d1/d4/da/d9f to d1/d4/da/d4e/d5e/d84/df2/d108 0 2024-05-06T21:26:47.637 INFO:tasks.workunit.client.1.smithi154.stdout:8/321: mkdir d3/d14/d1a/d29/d68/d6b 0 2024-05-06T21:26:47.637 INFO:tasks.workunit.client.1.smithi154.stdout:5/387: write d2/d3/d21/d22/d25/d37/f40 [567877,78035] 0 2024-05-06T21:26:47.638 INFO:tasks.workunit.client.1.smithi154.stdout:8/322: read d3/fb [289377,57006] 0 2024-05-06T21:26:47.638 INFO:tasks.workunit.client.0.smithi032.stdout:3/764: dread d1/d2a/f37 [0,4194304] 0 2024-05-06T21:26:47.638 INFO:tasks.workunit.client.0.smithi032.stdout:4/782: rename d2/d16/d44/d74/d79/d88/dd6/cec to d2/d16/d44/d74/d76/d81/cf7 0 2024-05-06T21:26:47.639 INFO:tasks.workunit.client.1.smithi154.stdout:0/444: mknod d6/dc/d44/c93 0 2024-05-06T21:26:47.640 INFO:tasks.workunit.client.1.smithi154.stdout:0/445: dread - d6/dc/d40/d41/f86 zero size 2024-05-06T21:26:47.640 INFO:tasks.workunit.client.1.smithi154.stdout:7/248: getdents d6/d20/d40 0 2024-05-06T21:26:47.640 INFO:tasks.workunit.client.1.smithi154.stdout:7/249: readlink d6/de/d23/l27 0 2024-05-06T21:26:47.642 INFO:tasks.workunit.client.0.smithi032.stdout:1/674: rename db/d16/d46/d57/d58/f81 to db/d16/d5d/fd8 0 2024-05-06T21:26:47.644 INFO:tasks.workunit.client.1.smithi154.stdout:2/339: unlink db/de/f5d 0 2024-05-06T21:26:47.644 INFO:tasks.workunit.client.1.smithi154.stdout:2/340: fsync db/d12/d19/f56 0 2024-05-06T21:26:47.644 INFO:tasks.workunit.client.1.smithi154.stdout:1/392: dwrite d6/db/d10/f51 [0,4194304] 0 2024-05-06T21:26:47.645 INFO:tasks.workunit.client.0.smithi032.stdout:6/743: rename d8/dd/d18/d22/f7b to d8/dd/d1b/fe0 0 2024-05-06T21:26:47.646 INFO:tasks.workunit.client.0.smithi032.stdout:3/765: dread d1/f14 [4194304,4194304] 0 2024-05-06T21:26:47.647 INFO:tasks.workunit.client.1.smithi154.stdout:9/457: truncate d5/d20/d52/f4f 2071138 0 2024-05-06T21:26:47.649 INFO:tasks.workunit.client.1.smithi154.stdout:0/446: mknod d6/dc/d40/d85/c94 0 2024-05-06T21:26:47.649 INFO:tasks.workunit.client.1.smithi154.stdout:0/447: chown d6/l87 4033 1 2024-05-06T21:26:47.650 INFO:tasks.workunit.client.0.smithi032.stdout:3/766: dread d1/f14 [4194304,4194304] 0 2024-05-06T21:26:47.650 INFO:tasks.workunit.client.0.smithi032.stdout:3/767: write d1/d4/da/d4e/d41/d43/f70 [1880763,45605] 0 2024-05-06T21:26:47.650 INFO:tasks.workunit.client.0.smithi032.stdout:3/768: truncate d1/d4/da/d1d/fe5 949251 0 2024-05-06T21:26:47.651 INFO:tasks.workunit.client.1.smithi154.stdout:7/250: mknod d6/de/c4c 0 2024-05-06T21:26:47.651 INFO:tasks.workunit.client.1.smithi154.stdout:8/323: dread d3/d14/d1a/d29/d32/d40/d59/f55 [0,4194304] 0 2024-05-06T21:26:47.652 INFO:tasks.workunit.client.0.smithi032.stdout:8/906: rename d0/d1c/d5e/d67/dc3/d57/d5d/d63/d85/cc9 to d0/d1b/d39/d93/c11b 0 2024-05-06T21:26:47.652 INFO:tasks.workunit.client.1.smithi154.stdout:2/341: mknod db/de/d16/d33/c6d 0 2024-05-06T21:26:47.653 INFO:tasks.workunit.client.0.smithi032.stdout:3/769: dread d1/d4/da/d1d/f6e [0,4194304] 0 2024-05-06T21:26:47.653 INFO:tasks.workunit.client.0.smithi032.stdout:6/744: link d8/dd/d18/c5c d8/db6/ce1 0 2024-05-06T21:26:47.656 INFO:tasks.workunit.client.0.smithi032.stdout:4/783: dread d2/d1e/f22 [0,4194304] 0 2024-05-06T21:26:47.656 INFO:tasks.workunit.client.0.smithi032.stdout:4/784: getdents d2/d16/df6 0 2024-05-06T21:26:47.657 INFO:tasks.workunit.client.0.smithi032.stdout:1/675: rename db/f51 to db/d47/d4a/dcb/fd9 0 2024-05-06T21:26:47.657 INFO:tasks.workunit.client.0.smithi032.stdout:1/676: read - db/d47/d4a/da4/f79 zero size 2024-05-06T21:26:47.657 INFO:tasks.workunit.client.0.smithi032.stdout:1/677: fsync db/d47/d4a/f95 0 2024-05-06T21:26:47.657 INFO:tasks.workunit.client.1.smithi154.stdout:1/393: rename d6/db/d69/c76 to d6/db/d10/d15/d1d/d53/c78 0 2024-05-06T21:26:47.658 INFO:tasks.workunit.client.1.smithi154.stdout:9/458: creat d5/d2e/d8b/fa4 x:0 0 0 2024-05-06T21:26:47.659 INFO:tasks.workunit.client.0.smithi032.stdout:3/770: mknod d1/d4/da/d31/d9b/daa/c109 0 2024-05-06T21:26:47.659 INFO:tasks.workunit.client.1.smithi154.stdout:5/388: getdents d2/d6 0 2024-05-06T21:26:47.659 INFO:tasks.workunit.client.1.smithi154.stdout:5/389: fsync d2/d6/f5f 0 2024-05-06T21:26:47.659 INFO:tasks.workunit.client.1.smithi154.stdout:5/390: creat d2/d6/dd/d2a/d54/f7d x:0 0 0 2024-05-06T21:26:47.659 INFO:tasks.workunit.client.1.smithi154.stdout:5/391: truncate d2/d6/dd/f64 387821 0 2024-05-06T21:26:47.661 INFO:tasks.workunit.client.1.smithi154.stdout:0/448: link d6/dc/d51/f6f d6/dc/f95 0 2024-05-06T21:26:47.661 INFO:tasks.workunit.client.1.smithi154.stdout:5/392: dread d2/d3/f6d [0,4194304] 0 2024-05-06T21:26:47.662 INFO:tasks.workunit.client.0.smithi032.stdout:4/785: symlink d2/d2c/d31/lf8 0 2024-05-06T21:26:47.662 INFO:tasks.workunit.client.1.smithi154.stdout:8/324: symlink d3/l6c 0 2024-05-06T21:26:47.662 INFO:tasks.workunit.client.0.smithi032.stdout:5/707: dwrite d0/d16/f91 [0,4194304] 0 2024-05-06T21:26:47.663 INFO:tasks.workunit.client.1.smithi154.stdout:2/342: mknod db/de/d16/d33/c6e 0 2024-05-06T21:26:47.665 INFO:tasks.workunit.client.0.smithi032.stdout:1/678: getdents db/d16/d46/da1 0 2024-05-06T21:26:47.665 INFO:tasks.workunit.client.0.smithi032.stdout:1/679: creat db/d47/d4a/da4/fda x:0 0 0 2024-05-06T21:26:47.665 INFO:tasks.workunit.client.0.smithi032.stdout:1/680: readlink db/d47/d4a/da4/d4f/l62 0 2024-05-06T21:26:47.665 INFO:tasks.workunit.client.0.smithi032.stdout:3/771: mknod d1/d4/da/d4e/d41/d97/d67/da6/c10a 0 2024-05-06T21:26:47.665 INFO:tasks.workunit.client.0.smithi032.stdout:3/772: fdatasync d1/d4/da/d4e/d41/d45/f4d 0 2024-05-06T21:26:47.666 INFO:tasks.workunit.client.1.smithi154.stdout:7/251: rename d6/de/c24 to d6/de/d21/c4d 0 2024-05-06T21:26:47.667 INFO:tasks.workunit.client.1.smithi154.stdout:1/394: rmdir d6/db/d10/d15/d1d 39 2024-05-06T21:26:47.667 INFO:tasks.workunit.client.1.smithi154.stdout:1/395: readlink d6/db/d10/l70 0 2024-05-06T21:26:47.668 INFO:tasks.workunit.client.1.smithi154.stdout:9/459: mknod d5/d14/d87/d65/ca5 0 2024-05-06T21:26:47.668 INFO:tasks.workunit.client.1.smithi154.stdout:9/460: write d5/d14/d87/f9e [319055,88224] 0 2024-05-06T21:26:47.668 INFO:tasks.workunit.client.1.smithi154.stdout:9/461: truncate d5/d14/d3a/fa1 1046608 0 2024-05-06T21:26:47.669 INFO:tasks.workunit.client.0.smithi032.stdout:5/708: link d0/d24/d38/d37/d7b/fc2 d0/d4e/fda 0 2024-05-06T21:26:47.669 INFO:tasks.workunit.client.0.smithi032.stdout:5/709: creat d0/d16/d2a/d59/d67/d73/da3/fdb x:0 0 0 2024-05-06T21:26:47.669 INFO:tasks.workunit.client.0.smithi032.stdout:5/710: chown d0/d16/d79 229 1 2024-05-06T21:26:47.669 INFO:tasks.workunit.client.0.smithi032.stdout:5/711: fsync d0/d16/d2a/d52/f93 0 2024-05-06T21:26:47.669 INFO:tasks.workunit.client.1.smithi154.stdout:0/449: mkdir d6/dc/d40/d41/d70/d96 0 2024-05-06T21:26:47.671 INFO:tasks.workunit.client.1.smithi154.stdout:8/325: mkdir d3/d64/d6d 0 2024-05-06T21:26:47.672 INFO:tasks.workunit.client.0.smithi032.stdout:1/681: creat db/d16/d46/d57/fdb x:0 0 0 2024-05-06T21:26:47.675 INFO:tasks.workunit.client.1.smithi154.stdout:7/252: creat d6/d20/d40/f4e x:0 0 0 2024-05-06T21:26:47.675 INFO:tasks.workunit.client.1.smithi154.stdout:7/253: truncate d6/fd 5007937 0 2024-05-06T21:26:47.675 INFO:tasks.workunit.client.1.smithi154.stdout:7/254: write d6/d20/f1b [2191941,71203] 0 2024-05-06T21:26:47.675 INFO:tasks.workunit.client.1.smithi154.stdout:7/255: read d6/fb [2447286,33668] 0 2024-05-06T21:26:47.675 INFO:tasks.workunit.client.1.smithi154.stdout:7/256: chown d6/de/c3e 15394 1 2024-05-06T21:26:47.675 INFO:tasks.workunit.client.1.smithi154.stdout:9/462: getdents d5/d20/d84 0 2024-05-06T21:26:47.675 INFO:tasks.workunit.client.1.smithi154.stdout:7/257: write d6/fd [4446658,82594] 0 2024-05-06T21:26:47.675 INFO:tasks.workunit.client.1.smithi154.stdout:5/393: dread d2/d3/d19/f3c [4194304,4194304] 0 2024-05-06T21:26:47.676 INFO:tasks.workunit.client.1.smithi154.stdout:5/394: chown d2/d3/d19/c6b 443306 1 2024-05-06T21:26:47.676 INFO:tasks.workunit.client.1.smithi154.stdout:5/395: dread d2/d6/dd/f64 [0,4194304] 0 2024-05-06T21:26:47.676 INFO:tasks.workunit.client.1.smithi154.stdout:5/396: stat d2/d6/dd/f70 0 2024-05-06T21:26:47.676 INFO:tasks.workunit.client.1.smithi154.stdout:5/397: stat d2/d48/c50 0 2024-05-06T21:26:47.676 INFO:tasks.workunit.client.1.smithi154.stdout:0/450: rename d6/dc/d40/d41/c5c to d6/dc/d51/c97 0 2024-05-06T21:26:47.677 INFO:tasks.workunit.client.0.smithi032.stdout:5/712: creat d0/d16/d2a/dc7/dd2/db1/fdc x:0 0 0 2024-05-06T21:26:47.677 INFO:tasks.workunit.client.0.smithi032.stdout:5/713: fdatasync d0/d24/d38/fd5 0 2024-05-06T21:26:47.677 INFO:tasks.workunit.client.0.smithi032.stdout:3/773: symlink d1/d2a/l10b 0 2024-05-06T21:26:47.678 INFO:tasks.workunit.client.0.smithi032.stdout:5/714: creat d0/d24/d26/d3d/d50/fdd x:0 0 0 2024-05-06T21:26:47.681 INFO:tasks.workunit.client.0.smithi032.stdout:5/715: mkdir d0/d16/d2a/d59/d67/d73/dde 0 2024-05-06T21:26:47.681 INFO:tasks.workunit.client.0.smithi032.stdout:5/716: fsync d0/d16/d2a/d59/d67/d73/f76 0 2024-05-06T21:26:47.682 INFO:tasks.workunit.client.1.smithi154.stdout:9/463: rename d5/d2e/d66/f77 to d5/d14/d87/d65/fa6 0 2024-05-06T21:26:47.682 INFO:tasks.workunit.client.1.smithi154.stdout:9/464: chown d5/d14/d87/d65/ca5 64893 1 2024-05-06T21:26:47.682 INFO:tasks.workunit.client.1.smithi154.stdout:9/465: truncate d5/d20/f23 318150 0 2024-05-06T21:26:47.683 INFO:tasks.workunit.client.1.smithi154.stdout:0/451: symlink d6/dc/d42/l98 0 2024-05-06T21:26:47.684 INFO:tasks.workunit.client.0.smithi032.stdout:5/717: getdents d0/d24/d38/d37/d7b 0 2024-05-06T21:26:47.687 INFO:tasks.workunit.client.0.smithi032.stdout:5/718: link d0/d16/d2a/d59/d67/d73/lb5 d0/d16/d2a/d5f/d9a/ldf 0 2024-05-06T21:26:47.687 INFO:tasks.workunit.client.0.smithi032.stdout:5/719: truncate d0/d16/d46/da9/fc8 859190 0 2024-05-06T21:26:47.689 INFO:tasks.workunit.client.0.smithi032.stdout:5/720: rename d0/d24/d26/f56 to d0/d24/d38/d37/d7b/dc0/fe0 0 2024-05-06T21:26:47.689 INFO:tasks.workunit.client.0.smithi032.stdout:5/721: truncate d0/d16/d2f/d77/f7c 3025241 0 2024-05-06T21:26:47.690 INFO:tasks.workunit.client.1.smithi154.stdout:5/398: rmdir d2/d3 39 2024-05-06T21:26:47.693 INFO:tasks.workunit.client.1.smithi154.stdout:7/258: rename d6/de/d21/d2e/f45 to d6/de/f4f 0 2024-05-06T21:26:47.694 INFO:tasks.workunit.client.1.smithi154.stdout:7/259: chown d6/de/c4c 10612 1 2024-05-06T21:26:47.695 INFO:tasks.workunit.client.1.smithi154.stdout:9/466: mknod d5/d20/d52/ca7 0 2024-05-06T21:26:47.696 INFO:tasks.workunit.client.1.smithi154.stdout:5/399: symlink d2/d3/d21/l7e 0 2024-05-06T21:26:47.696 INFO:tasks.workunit.client.1.smithi154.stdout:5/400: write d2/d6/dc/f15 [4386063,11943] 0 2024-05-06T21:26:47.699 INFO:tasks.workunit.client.1.smithi154.stdout:9/467: rename l1 to d5/d2e/la8 0 2024-05-06T21:26:47.702 INFO:tasks.workunit.client.1.smithi154.stdout:9/468: mknod d5/d20/d52/d6e/d83/da2/ca9 0 2024-05-06T21:26:47.703 INFO:tasks.workunit.client.1.smithi154.stdout:9/469: mkdir d5/d14/d3a/daa 0 2024-05-06T21:26:47.704 INFO:tasks.workunit.client.1.smithi154.stdout:7/260: dread d6/f32 [0,4194304] 0 2024-05-06T21:26:47.706 INFO:tasks.workunit.client.1.smithi154.stdout:7/261: rename d6/d20/d40/f4e to d6/d20/d40/f50 0 2024-05-06T21:26:47.708 INFO:tasks.workunit.client.1.smithi154.stdout:7/262: getdents d6 0 2024-05-06T21:26:47.722 INFO:tasks.workunit.client.1.smithi154.stdout:7/263: write d6/d20/f1b [5288124,67949] 0 2024-05-06T21:26:47.722 INFO:tasks.workunit.client.1.smithi154.stdout:7/264: getdents d6/d46 0 2024-05-06T21:26:47.725 INFO:tasks.workunit.client.1.smithi154.stdout:7/265: dread d6/f32 [0,4194304] 0 2024-05-06T21:26:47.727 INFO:tasks.workunit.client.1.smithi154.stdout:7/266: unlink d6/d20/f1d 0 2024-05-06T21:26:47.727 INFO:tasks.workunit.client.1.smithi154.stdout:7/267: chown c0 6325920 1 2024-05-06T21:26:47.757 INFO:tasks.workunit.client.1.smithi154.stdout:3/513: dwrite d0/da/db/d30/fab [0,4194304] 0 2024-05-06T21:26:47.759 INFO:tasks.workunit.client.0.smithi032.stdout:0/662: dwrite d4/d3e/d63/f5c [0,4194304] 0 2024-05-06T21:26:47.759 INFO:tasks.workunit.client.0.smithi032.stdout:0/663: chown d4/da/d14/f47 96771 1 2024-05-06T21:26:47.759 INFO:tasks.workunit.client.0.smithi032.stdout:6/745: write d8/dd/d18/d3b/db9/f9e [487025,6718] 0 2024-05-06T21:26:47.759 INFO:tasks.workunit.client.0.smithi032.stdout:6/746: chown d8/d3d/d49/d6b/f9f 1 1 2024-05-06T21:26:47.759 INFO:tasks.workunit.client.0.smithi032.stdout:6/747: fsync d8/d33/f72 0 2024-05-06T21:26:47.762 INFO:tasks.workunit.client.0.smithi032.stdout:6/748: mkdir d8/d3d/d49/d6b/de2 0 2024-05-06T21:26:47.766 INFO:tasks.workunit.client.0.smithi032.stdout:6/749: rename d8/d3d/d49/ldb to d8/db6/le3 0 2024-05-06T21:26:47.766 INFO:tasks.workunit.client.0.smithi032.stdout:6/750: creat d8/d3d/fe4 x:0 0 0 2024-05-06T21:26:47.767 INFO:tasks.workunit.client.1.smithi154.stdout:1/396: dread d6/db/d10/f35 [0,4194304] 0 2024-05-06T21:26:47.767 INFO:tasks.workunit.client.1.smithi154.stdout:1/397: write d6/db/d10/d15/d1d/d53/f5f [422831,31226] 0 2024-05-06T21:26:47.767 INFO:tasks.workunit.client.1.smithi154.stdout:1/398: chown d6/f52 12 1 2024-05-06T21:26:47.767 INFO:tasks.workunit.client.1.smithi154.stdout:4/326: truncate d0/d10/f41 170556 0 2024-05-06T21:26:47.770 INFO:tasks.workunit.client.0.smithi032.stdout:6/751: unlink d8/dd/d18/dda/f78 0 2024-05-06T21:26:47.773 INFO:tasks.workunit.client.0.smithi032.stdout:0/664: dread d4/f24 [0,4194304] 0 2024-05-06T21:26:47.773 INFO:tasks.workunit.client.0.smithi032.stdout:6/752: link d8/dd/d18/d13/lb1 d8/le5 0 2024-05-06T21:26:47.773 INFO:tasks.workunit.client.0.smithi032.stdout:6/753: chown d8/d3d/d49/fa9 73276 1 2024-05-06T21:26:47.774 INFO:tasks.workunit.client.1.smithi154.stdout:8/326: read d3/d14/f19 [6165827,79923] 0 2024-05-06T21:26:47.775 INFO:tasks.workunit.client.0.smithi032.stdout:0/665: symlink d4/d3e/d42/ld9 0 2024-05-06T21:26:47.775 INFO:tasks.workunit.client.1.smithi154.stdout:1/399: write d6/f47 [769715,74722] 0 2024-05-06T21:26:47.778 INFO:tasks.workunit.client.1.smithi154.stdout:4/327: rmdir d0/d10/d11/d1a/d31/d39 39 2024-05-06T21:26:47.780 INFO:tasks.workunit.client.0.smithi032.stdout:8/907: dwrite d0/d1c/d5e/d67/fb4 [0,4194304] 0 2024-05-06T21:26:47.782 INFO:tasks.workunit.client.1.smithi154.stdout:4/328: write d0/d2/d2a/f5f [154252,112794] 0 2024-05-06T21:26:47.782 INFO:tasks.workunit.client.1.smithi154.stdout:4/329: fsync d0/d2/d29/f56 0 2024-05-06T21:26:47.788 INFO:tasks.workunit.client.1.smithi154.stdout:1/400: symlink d6/db/l79 0 2024-05-06T21:26:47.788 INFO:tasks.workunit.client.1.smithi154.stdout:1/401: fdatasync d6/d3e/f75 0 2024-05-06T21:26:47.788 INFO:tasks.workunit.client.1.smithi154.stdout:1/402: fdatasync d6/db/d10/f63 0 2024-05-06T21:26:47.788 INFO:tasks.workunit.client.1.smithi154.stdout:1/403: chown d6/c3d 6100566 1 2024-05-06T21:26:47.788 INFO:tasks.workunit.client.0.smithi032.stdout:5/722: dwrite d0/d24/d26/d32/fb9 [0,4194304] 0 2024-05-06T21:26:47.794 INFO:tasks.workunit.client.0.smithi032.stdout:8/908: rmdir d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f 39 2024-05-06T21:26:47.795 INFO:tasks.workunit.client.1.smithi154.stdout:9/470: dwrite d5/d20/d37/f38 [0,4194304] 0 2024-05-06T21:26:47.795 INFO:tasks.workunit.client.1.smithi154.stdout:9/471: readlink d5/l18 0 2024-05-06T21:26:47.798 INFO:tasks.workunit.client.0.smithi032.stdout:8/909: creat d0/d1b/da8/f11c x:0 0 0 2024-05-06T21:26:47.798 INFO:tasks.workunit.client.0.smithi032.stdout:8/910: fdatasync d0/d1c/d5e/d67/dc3/d57/d5d/faa 0 2024-05-06T21:26:47.800 INFO:tasks.workunit.client.0.smithi032.stdout:8/911: mknod d0/d1c/d5e/d67/dfe/c11d 0 2024-05-06T21:26:47.801 INFO:tasks.workunit.client.1.smithi154.stdout:9/472: dread d5/d14/d31/f40 [0,4194304] 0 2024-05-06T21:26:47.802 INFO:tasks.workunit.client.1.smithi154.stdout:9/473: creat d5/fab x:0 0 0 2024-05-06T21:26:47.802 INFO:tasks.workunit.client.1.smithi154.stdout:9/474: chown d5/l1f 1680761 1 2024-05-06T21:26:47.804 INFO:tasks.workunit.client.1.smithi154.stdout:1/404: write d6/db/d10/f51 [1422472,78197] 0 2024-05-06T21:26:47.804 INFO:tasks.workunit.client.1.smithi154.stdout:1/405: stat d6/db/l44 0 2024-05-06T21:26:47.805 INFO:tasks.workunit.client.1.smithi154.stdout:1/406: link d6/db/l44 d6/db/d74/l7a 0 2024-05-06T21:26:47.807 INFO:tasks.workunit.client.1.smithi154.stdout:5/401: dwrite d2/d3/d21/f60 [4194304,4194304] 0 2024-05-06T21:26:47.807 INFO:tasks.workunit.client.1.smithi154.stdout:5/402: readlink d2/d6/dd/l1c 0 2024-05-06T21:26:47.807 INFO:tasks.workunit.client.1.smithi154.stdout:5/403: dread - d2/d6/dd/d2a/d54/f7d zero size 2024-05-06T21:26:47.810 INFO:tasks.workunit.client.1.smithi154.stdout:5/404: truncate d2/d6/f61 3332518 0 2024-05-06T21:26:47.811 INFO:tasks.workunit.client.0.smithi032.stdout:0/666: write d4/da/d14/d1a/f1c [1058284,55346] 0 2024-05-06T21:26:47.812 INFO:tasks.workunit.client.1.smithi154.stdout:5/405: mknod d2/d6/dc/d44/c7f 0 2024-05-06T21:26:47.813 INFO:tasks.workunit.client.0.smithi032.stdout:0/667: symlink d4/d3e/d63/d6c/d8f/lda 0 2024-05-06T21:26:47.813 INFO:tasks.workunit.client.0.smithi032.stdout:0/668: write d4/d3e/d63/dca/f52 [2011507,88252] 0 2024-05-06T21:26:47.813 INFO:tasks.workunit.client.0.smithi032.stdout:0/669: chown d4/l9c 9380957 1 2024-05-06T21:26:47.813 INFO:tasks.workunit.client.0.smithi032.stdout:0/670: stat d4/d3e/d63/f56 0 2024-05-06T21:26:47.814 INFO:tasks.workunit.client.0.smithi032.stdout:0/671: symlink d4/d3e/d42/ldb 0 2024-05-06T21:26:47.814 INFO:tasks.workunit.client.0.smithi032.stdout:0/672: fsync d4/d3e/d63/f5c 0 2024-05-06T21:26:47.815 INFO:tasks.workunit.client.0.smithi032.stdout:0/673: mknod d4/d3e/d63/d6c/d8f/cdc 0 2024-05-06T21:26:47.815 INFO:tasks.workunit.client.0.smithi032.stdout:0/674: write d4/d3e/fbe [767659,127225] 0 2024-05-06T21:26:47.815 INFO:tasks.workunit.client.0.smithi032.stdout:0/675: truncate d4/f24 4992183 0 2024-05-06T21:26:47.816 INFO:tasks.workunit.client.0.smithi032.stdout:0/676: rename d4/d3e/f85 to d4/d96/fdd 0 2024-05-06T21:26:47.820 INFO:tasks.workunit.client.1.smithi154.stdout:5/406: write d2/f1d [6269861,72824] 0 2024-05-06T21:26:47.829 INFO:tasks.workunit.client.1.smithi154.stdout:9/475: dread d5/d14/d31/d39/f68 [0,4194304] 0 2024-05-06T21:26:47.829 INFO:tasks.workunit.client.1.smithi154.stdout:9/476: getdents d5/d14/d3a/d71 0 2024-05-06T21:26:47.830 INFO:tasks.workunit.client.1.smithi154.stdout:5/407: dread d2/d6/dd/f18 [0,4194304] 0 2024-05-06T21:26:47.830 INFO:tasks.workunit.client.1.smithi154.stdout:5/408: write d2/f1a [6045456,54424] 0 2024-05-06T21:26:47.830 INFO:tasks.workunit.client.1.smithi154.stdout:0/452: dwrite d6/dc/f33 [0,4194304] 0 2024-05-06T21:26:47.831 INFO:tasks.workunit.client.1.smithi154.stdout:5/409: unlink d2/d6/dd/d2a/d54/f65 0 2024-05-06T21:26:47.831 INFO:tasks.workunit.client.1.smithi154.stdout:5/410: write d2/d48/f7c [688945,86678] 0 2024-05-06T21:26:47.831 INFO:tasks.workunit.client.1.smithi154.stdout:5/411: write d2/d3/f6d [956576,18172] 0 2024-05-06T21:26:47.831 INFO:tasks.workunit.client.1.smithi154.stdout:5/412: chown d2/d6/dd/f2c 689983237 1 2024-05-06T21:26:47.832 INFO:tasks.workunit.client.1.smithi154.stdout:0/453: truncate d6/dc/f4f 1483110 0 2024-05-06T21:26:47.832 INFO:tasks.workunit.client.1.smithi154.stdout:3/514: dwrite d0/da/db/f10 [0,4194304] 0 2024-05-06T21:26:47.832 INFO:tasks.workunit.client.1.smithi154.stdout:1/407: write d6/f24 [1858154,120492] 0 2024-05-06T21:26:47.833 INFO:tasks.workunit.client.1.smithi154.stdout:1/408: stat d6/db/c4e 0 2024-05-06T21:26:47.833 INFO:tasks.workunit.client.1.smithi154.stdout:1/409: stat d6/d3e/l65 0 2024-05-06T21:26:47.833 INFO:tasks.workunit.client.1.smithi154.stdout:5/413: mknod d2/d3/d21/c80 0 2024-05-06T21:26:47.833 INFO:tasks.workunit.client.1.smithi154.stdout:5/414: chown d2/d6/dc/c1e 3109001 1 2024-05-06T21:26:47.833 INFO:tasks.workunit.client.1.smithi154.stdout:5/415: fdatasync d2/f6e 0 2024-05-06T21:26:47.833 INFO:tasks.workunit.client.1.smithi154.stdout:5/416: write d2/d3/d21/d22/d25/f32 [1280569,7147] 0 2024-05-06T21:26:47.833 INFO:tasks.workunit.client.1.smithi154.stdout:5/417: truncate d2/f4c 884582 0 2024-05-06T21:26:47.835 INFO:tasks.workunit.client.0.smithi032.stdout:6/754: dwrite d8/dd/fd4 [0,4194304] 0 2024-05-06T21:26:47.835 INFO:tasks.workunit.client.1.smithi154.stdout:0/454: mknod d6/dc/d51/d54/c99 0 2024-05-06T21:26:47.835 INFO:tasks.workunit.client.1.smithi154.stdout:3/515: symlink d0/da/d82/laf 0 2024-05-06T21:26:47.837 INFO:tasks.workunit.client.1.smithi154.stdout:1/410: unlink d6/db/d5e/c4b 0 2024-05-06T21:26:47.838 INFO:tasks.workunit.client.0.smithi032.stdout:5/723: dwrite d0/d24/d26/d3d/f95 [0,4194304] 0 2024-05-06T21:26:47.838 INFO:tasks.workunit.client.0.smithi032.stdout:5/724: fdatasync d0/d16/d2a/d5f/dca/f45 0 2024-05-06T21:26:47.839 INFO:tasks.workunit.client.1.smithi154.stdout:3/516: rename d0/da/d1a/d28/d2f/d81/d55 to d0/da/d1a/d28/d17/db0 0 2024-05-06T21:26:47.841 INFO:tasks.workunit.client.0.smithi032.stdout:5/725: mkdir d0/d16/d2a/dc7/dd2/de1 0 2024-05-06T21:26:47.841 INFO:tasks.workunit.client.1.smithi154.stdout:9/477: truncate d5/d14/d3a/fa1 550537 0 2024-05-06T21:26:47.842 INFO:tasks.workunit.client.0.smithi032.stdout:5/726: symlink d0/d24/d38/d37/le2 0 2024-05-06T21:26:47.842 INFO:tasks.workunit.client.0.smithi032.stdout:5/727: dread - d0/d24/d38/fd5 zero size 2024-05-06T21:26:47.842 INFO:tasks.workunit.client.0.smithi032.stdout:5/728: readlink d0/d16/d46/lc1 0 2024-05-06T21:26:47.842 INFO:tasks.workunit.client.0.smithi032.stdout:5/729: truncate d0/d16/d2a/d59/f5b 1484801 0 2024-05-06T21:26:47.850 INFO:tasks.workunit.client.1.smithi154.stdout:0/455: write d6/dc/f2f [1463486,21179] 0 2024-05-06T21:26:47.856 INFO:tasks.workunit.client.0.smithi032.stdout:3/774: dwrite d1/d4/da/d4e/d41/d43/fbb [0,4194304] 0 2024-05-06T21:26:47.858 INFO:tasks.workunit.client.1.smithi154.stdout:3/517: write d0/da/f18 [378708,122844] 0 2024-05-06T21:26:47.861 INFO:tasks.workunit.client.1.smithi154.stdout:3/518: creat d0/da/fb1 x:0 0 0 2024-05-06T21:26:47.862 INFO:tasks.workunit.client.1.smithi154.stdout:0/456: write d6/f8e [835177,86455] 0 2024-05-06T21:26:47.862 INFO:tasks.workunit.client.1.smithi154.stdout:0/457: fdatasync d6/dc/d44/f6d 0 2024-05-06T21:26:47.862 INFO:tasks.workunit.client.1.smithi154.stdout:0/458: truncate d6/dc/d42/f90 377767 0 2024-05-06T21:26:47.864 INFO:tasks.workunit.client.1.smithi154.stdout:3/519: symlink d0/da/d1a/lb2 0 2024-05-06T21:26:47.871 INFO:tasks.workunit.client.1.smithi154.stdout:1/411: dread d6/db/d10/d15/d1d/f61 [0,4194304] 0 2024-05-06T21:26:47.871 INFO:tasks.workunit.client.1.smithi154.stdout:1/412: write d6/db/d5e/f73 [95651,105365] 0 2024-05-06T21:26:47.873 INFO:tasks.workunit.client.1.smithi154.stdout:8/327: dwrite d3/d14/d1a/f3c [0,4194304] 0 2024-05-06T21:26:47.874 INFO:tasks.workunit.client.1.smithi154.stdout:8/328: chown d3/d14/d1a/d29/d32/d40/d59 681 1 2024-05-06T21:26:47.876 INFO:tasks.workunit.client.0.smithi032.stdout:3/775: dread d1/d4/da/d4e/d41/d97/d67/f7b [0,4194304] 0 2024-05-06T21:26:47.877 INFO:tasks.workunit.client.0.smithi032.stdout:3/776: chown d1/d4/da/d4e/d5e/d84/df2/cae 86563 1 2024-05-06T21:26:47.877 INFO:tasks.workunit.client.0.smithi032.stdout:3/777: fdatasync d1/f14 0 2024-05-06T21:26:47.877 INFO:tasks.workunit.client.0.smithi032.stdout:3/778: chown d1/d4/da/d4e/d5e/d84/ff0 3 1 2024-05-06T21:26:47.877 INFO:tasks.workunit.client.0.smithi032.stdout:1/682: dwrite db/d47/d4a/dcb/fd3 [0,4194304] 0 2024-05-06T21:26:47.877 INFO:tasks.workunit.client.0.smithi032.stdout:1/683: getdents db/d47/d4a/da4/d4f/dd0 0 2024-05-06T21:26:47.878 INFO:tasks.workunit.client.0.smithi032.stdout:6/755: dwrite d8/dd/d1b/d67/fc9 [0,4194304] 0 2024-05-06T21:26:47.879 INFO:tasks.workunit.client.1.smithi154.stdout:4/330: dwrite d0/d2/f2b [0,4194304] 0 2024-05-06T21:26:47.879 INFO:tasks.workunit.client.1.smithi154.stdout:5/418: dwrite d2/d6/f13 [0,4194304] 0 2024-05-06T21:26:47.879 INFO:tasks.workunit.client.1.smithi154.stdout:5/419: fdatasync d2/d6/f5f 0 2024-05-06T21:26:47.881 INFO:tasks.workunit.client.0.smithi032.stdout:3/779: symlink d1/d4/da/d4e/d5e/d84/df2/d108/db8/dd0/dd9/d101/l10c 0 2024-05-06T21:26:47.881 INFO:tasks.workunit.client.0.smithi032.stdout:5/730: dwrite d0/d24/d38/d37/da6/fd9 [0,4194304] 0 2024-05-06T21:26:47.881 INFO:tasks.workunit.client.0.smithi032.stdout:1/684: mkdir db/d37/d93/ddc 0 2024-05-06T21:26:47.882 INFO:tasks.workunit.client.0.smithi032.stdout:1/685: dread db/d16/d46/d57/d58/d68/f9f [0,4194304] 0 2024-05-06T21:26:47.883 INFO:tasks.workunit.client.0.smithi032.stdout:6/756: dread d8/d3d/d73/d87/f64 [0,4194304] 0 2024-05-06T21:26:47.884 INFO:tasks.workunit.client.0.smithi032.stdout:3/780: unlink d1/d2a/d71/d9d/da9/cb0 0 2024-05-06T21:26:47.885 INFO:tasks.workunit.client.1.smithi154.stdout:9/478: dwrite d5/d2e/f55 [0,4194304] 0 2024-05-06T21:26:47.886 INFO:tasks.workunit.client.1.smithi154.stdout:9/479: chown d5/d14/d87/f9e 13308682 1 2024-05-06T21:26:47.887 INFO:tasks.workunit.client.1.smithi154.stdout:8/329: dread d3/d14/f18 [0,4194304] 0 2024-05-06T21:26:47.888 INFO:tasks.workunit.client.0.smithi032.stdout:1/686: symlink db/d16/d46/ldd 0 2024-05-06T21:26:47.888 INFO:tasks.workunit.client.0.smithi032.stdout:1/687: truncate db/d47/fc7 889645 0 2024-05-06T21:26:47.888 INFO:tasks.workunit.client.0.smithi032.stdout:6/757: chown d8/dd/d18/d13/f24 23261 1 2024-05-06T21:26:47.889 INFO:tasks.workunit.client.0.smithi032.stdout:5/731: rmdir d0/d24/d38/d37/d70 39 2024-05-06T21:26:47.889 INFO:tasks.workunit.client.0.smithi032.stdout:5/732: chown d0/d24/d26 104174675 1 2024-05-06T21:26:47.890 INFO:tasks.workunit.client.0.smithi032.stdout:5/733: chown d0/d24/d38/d37/c40 20 1 2024-05-06T21:26:47.890 INFO:tasks.workunit.client.0.smithi032.stdout:5/734: rename d0/d24/d38/d37 to d0/d24/d38/d37/da6/de3 22 2024-05-06T21:26:47.890 INFO:tasks.workunit.client.1.smithi154.stdout:3/520: dwrite d0/da/d1a/d28/f5a [0,4194304] 0 2024-05-06T21:26:47.891 INFO:tasks.workunit.client.0.smithi032.stdout:1/688: mknod db/d37/d52/cde 0 2024-05-06T21:26:47.892 INFO:tasks.workunit.client.0.smithi032.stdout:1/689: truncate db/d16/d46/f4e 3250861 0 2024-05-06T21:26:47.892 INFO:tasks.workunit.client.0.smithi032.stdout:1/690: stat db/d47/lbe 0 2024-05-06T21:26:47.892 INFO:tasks.workunit.client.1.smithi154.stdout:0/459: dwrite d6/f83 [0,4194304] 0 2024-05-06T21:26:47.892 INFO:tasks.workunit.client.1.smithi154.stdout:0/460: truncate d6/dc/d40/d41/d70/f71 73471 0 2024-05-06T21:26:47.892 INFO:tasks.workunit.client.1.smithi154.stdout:0/461: stat d6/dc/d40/d41/d70/l7c 0 2024-05-06T21:26:47.892 INFO:tasks.workunit.client.1.smithi154.stdout:0/462: fdatasync d6/dc/d39/f3e 0 2024-05-06T21:26:47.892 INFO:tasks.workunit.client.1.smithi154.stdout:0/463: creat d6/dc/d39/f9a x:0 0 0 2024-05-06T21:26:47.893 INFO:tasks.workunit.client.1.smithi154.stdout:4/331: mkdir d0/d72 0 2024-05-06T21:26:47.893 INFO:tasks.workunit.client.1.smithi154.stdout:4/332: truncate d0/d10/f65 305262 0 2024-05-06T21:26:47.893 INFO:tasks.workunit.client.1.smithi154.stdout:4/333: truncate d0/d10/d11/d1a/d31/d44/f68 769039 0 2024-05-06T21:26:47.893 INFO:tasks.workunit.client.1.smithi154.stdout:4/334: chown d0/d2/d29/d60/c70 1 1 2024-05-06T21:26:47.894 INFO:tasks.workunit.client.0.smithi032.stdout:6/758: symlink d8/dd/le6 0 2024-05-06T21:26:47.894 INFO:tasks.workunit.client.0.smithi032.stdout:6/759: fdatasync d8/d3d/d49/d6b/f8d 0 2024-05-06T21:26:47.895 INFO:tasks.workunit.client.1.smithi154.stdout:9/480: symlink d5/d20/d52/d6e/lac 0 2024-05-06T21:26:47.896 INFO:tasks.workunit.client.0.smithi032.stdout:5/735: creat d0/d16/d2a/d5f/d9a/fe4 x:0 0 0 2024-05-06T21:26:47.901 INFO:tasks.workunit.client.0.smithi032.stdout:6/760: link d8/dd/d18/d13/fa7 d8/d3d/fe7 0 2024-05-06T21:26:47.902 INFO:tasks.workunit.client.1.smithi154.stdout:0/464: mknod d6/dc/d39/c9b 0 2024-05-06T21:26:47.903 INFO:tasks.workunit.client.1.smithi154.stdout:0/465: chown d6/f53 15 1 2024-05-06T21:26:47.903 INFO:tasks.workunit.client.1.smithi154.stdout:0/466: fsync d6/dc/d44/f11 0 2024-05-06T21:26:47.903 INFO:tasks.workunit.client.1.smithi154.stdout:0/467: stat d6/dc/d3c 0 2024-05-06T21:26:47.903 INFO:tasks.workunit.client.1.smithi154.stdout:0/468: dread - d6/dc/d39/f9a zero size 2024-05-06T21:26:47.903 INFO:tasks.workunit.client.1.smithi154.stdout:0/469: dread - d6/dc/d44/d36/d89/f8b zero size 2024-05-06T21:26:47.903 INFO:tasks.workunit.client.1.smithi154.stdout:0/470: chown d6/l18 1763446 1 2024-05-06T21:26:47.905 INFO:tasks.workunit.client.1.smithi154.stdout:5/420: rename d2/d3/f31 to d2/d6/dc/d71/f81 0 2024-05-06T21:26:47.907 INFO:tasks.workunit.client.1.smithi154.stdout:4/335: dread d0/d10/d11/f17 [0,4194304] 0 2024-05-06T21:26:47.909 INFO:tasks.workunit.client.1.smithi154.stdout:9/481: symlink d5/d20/d52/d6e/d83/da2/lad 0 2024-05-06T21:26:47.909 INFO:tasks.workunit.client.1.smithi154.stdout:9/482: dread - d5/d14/f82 zero size 2024-05-06T21:26:47.911 INFO:tasks.workunit.client.1.smithi154.stdout:0/471: rename d6/dc/d40/c4b to d6/dc/d40/d4a/d6c/d8a/c9c 0 2024-05-06T21:26:47.913 INFO:tasks.workunit.client.1.smithi154.stdout:9/483: getdents d5/d20/d37 0 2024-05-06T21:26:47.914 INFO:tasks.workunit.client.1.smithi154.stdout:5/421: rename d2/d6/fb to d2/d6/dd/d2a/d54/d43/d73/f82 0 2024-05-06T21:26:47.914 INFO:tasks.workunit.client.0.smithi032.stdout:6/761: dread d8/d3d/fd5 [0,4194304] 0 2024-05-06T21:26:47.915 INFO:tasks.workunit.client.1.smithi154.stdout:9/484: getdents d5/d89 0 2024-05-06T21:26:47.916 INFO:tasks.workunit.client.1.smithi154.stdout:9/485: write d5/d20/d52/d6e/f9b [73044,118733] 0 2024-05-06T21:26:47.916 INFO:tasks.workunit.client.1.smithi154.stdout:0/472: dread d6/d27/f28 [0,4194304] 0 2024-05-06T21:26:47.916 INFO:tasks.workunit.client.0.smithi032.stdout:6/762: stat d8/dd/d18/d13/d1d/la3 0 2024-05-06T21:26:47.917 INFO:tasks.workunit.client.1.smithi154.stdout:9/486: rename d5/d14/d31/d39/f3c to d5/d20/d52/d6e/fae 0 2024-05-06T21:26:47.918 INFO:tasks.workunit.client.1.smithi154.stdout:0/473: symlink d6/dc/d40/l9d 0 2024-05-06T21:26:47.920 INFO:tasks.workunit.client.1.smithi154.stdout:9/487: mkdir d5/d14/daf 0 2024-05-06T21:26:47.922 INFO:tasks.workunit.client.1.smithi154.stdout:9/488: link d5/d14/f30 d5/d2e/d66/fb0 0 2024-05-06T21:26:47.924 INFO:tasks.workunit.client.1.smithi154.stdout:9/489: rename d5/d14/d3a/daa to d5/d14/d3a/d71/db1 0 2024-05-06T21:26:47.924 INFO:tasks.workunit.client.1.smithi154.stdout:9/490: creat d5/d2e/d8b/fb2 x:0 0 0 2024-05-06T21:26:47.926 INFO:tasks.workunit.client.1.smithi154.stdout:9/491: creat d5/d20/d52/d6e/fb3 x:0 0 0 2024-05-06T21:26:47.927 INFO:tasks.workunit.client.1.smithi154.stdout:9/492: readlink l4 0 2024-05-06T21:26:47.931 INFO:tasks.workunit.client.1.smithi154.stdout:0/474: write d6/dc/d40/d5e/f8c [3533674,112361] 0 2024-05-06T21:26:47.931 INFO:tasks.workunit.client.1.smithi154.stdout:0/475: write d6/dc/d51/f55 [253507,90950] 0 2024-05-06T21:26:47.935 INFO:tasks.workunit.client.1.smithi154.stdout:5/422: dwrite d2/d3/f6d [0,4194304] 0 2024-05-06T21:26:47.943 INFO:tasks.workunit.client.1.smithi154.stdout:3/521: dwrite d0/da/d1a/d28/f8c [0,4194304] 0 2024-05-06T21:26:47.943 INFO:tasks.workunit.client.1.smithi154.stdout:3/522: fdatasync d0/d2/f6f 0 2024-05-06T21:26:47.943 INFO:tasks.workunit.client.1.smithi154.stdout:3/523: chown d0/da/d1a/d28/d2f/d81/d48/f65 87849827 1 2024-05-06T21:26:47.943 INFO:tasks.workunit.client.1.smithi154.stdout:8/330: dwrite d3/d14/d1a/d45/f5a [0,4194304] 0 2024-05-06T21:26:47.943 INFO:tasks.workunit.client.1.smithi154.stdout:8/331: readlink d3/d14/d1a/l2a 0 2024-05-06T21:26:47.944 INFO:tasks.workunit.client.0.smithi032.stdout:3/781: dwrite d1/d4/da/d31/d47/d4a/d68/d7c/fe0 [0,4194304] 0 2024-05-06T21:26:47.946 INFO:tasks.workunit.client.0.smithi032.stdout:3/782: dread d1/d4/da/d31/f87 [0,4194304] 0 2024-05-06T21:26:47.946 INFO:tasks.workunit.client.0.smithi032.stdout:3/783: truncate d1/d4/db7/fed 205735 0 2024-05-06T21:26:47.946 INFO:tasks.workunit.client.0.smithi032.stdout:3/784: write d1/d4/d11/f4f [295776,104156] 0 2024-05-06T21:26:47.946 INFO:tasks.workunit.client.0.smithi032.stdout:3/785: write d1/d4/db7/fed [313840,42047] 0 2024-05-06T21:26:47.946 INFO:tasks.workunit.client.0.smithi032.stdout:5/736: dwrite d0/d24/f7e [0,4194304] 0 2024-05-06T21:26:47.946 INFO:tasks.workunit.client.0.smithi032.stdout:5/737: chown d0/d24/d26/d3d/d50/f5d 0 1 2024-05-06T21:26:47.946 INFO:tasks.workunit.client.0.smithi032.stdout:6/763: dwrite d8/d3d/f4e [0,4194304] 0 2024-05-06T21:26:47.947 INFO:tasks.workunit.client.1.smithi154.stdout:4/336: dwrite d0/d10/f15 [0,4194304] 0 2024-05-06T21:26:47.947 INFO:tasks.workunit.client.1.smithi154.stdout:9/493: fdatasync d5/d20/d52/d6e/f9b 0 2024-05-06T21:26:47.947 INFO:tasks.workunit.client.0.smithi032.stdout:3/786: creat d1/d4/da/f10d x:0 0 0 2024-05-06T21:26:47.947 INFO:tasks.workunit.client.0.smithi032.stdout:3/787: truncate d1/d4/f7a 810695 0 2024-05-06T21:26:47.950 INFO:tasks.workunit.client.1.smithi154.stdout:5/423: dread d2/d3/d21/f60 [4194304,4194304] 0 2024-05-06T21:26:47.950 INFO:tasks.workunit.client.0.smithi032.stdout:5/738: creat d0/d16/d46/d78/fe5 x:0 0 0 2024-05-06T21:26:47.951 INFO:tasks.workunit.client.0.smithi032.stdout:6/764: symlink d8/dd/d1b/d67/le8 0 2024-05-06T21:26:47.951 INFO:tasks.workunit.client.0.smithi032.stdout:6/765: chown d8/d3d/d49/f60 21363205 1 2024-05-06T21:26:47.953 INFO:tasks.workunit.client.0.smithi032.stdout:3/788: symlink d1/d4/da/d4e/d5e/d84/df2/l10e 0 2024-05-06T21:26:47.953 INFO:tasks.workunit.client.0.smithi032.stdout:3/789: chown d1/d4/da/d1d/l88 487533 1 2024-05-06T21:26:47.955 INFO:tasks.workunit.client.0.smithi032.stdout:3/790: creat d1/d4/da/d31/d47/d4a/d68/d7c/da8/dea/f10f x:0 0 0 2024-05-06T21:26:47.956 INFO:tasks.workunit.client.0.smithi032.stdout:3/791: fsync d1/d4/da/d31/d47/d4a/d68/fe6 0 2024-05-06T21:26:47.957 INFO:tasks.workunit.client.1.smithi154.stdout:4/337: write d0/d2/dc/f18 [187089,103614] 0 2024-05-06T21:26:47.957 INFO:tasks.workunit.client.1.smithi154.stdout:4/338: write d0/d2/f8 [1160787,44170] 0 2024-05-06T21:26:47.963 INFO:tasks.workunit.client.0.smithi032.stdout:6/766: write d8/dd/fd4 [3502859,40215] 0 2024-05-06T21:26:47.965 INFO:tasks.workunit.client.0.smithi032.stdout:6/767: unlink d8/dd/d18/d13/d7a/lb7 0 2024-05-06T21:26:47.965 INFO:tasks.workunit.client.0.smithi032.stdout:6/768: write d8/d3d/d49/d6b/f9f [320688,41353] 0 2024-05-06T21:26:47.966 INFO:tasks.workunit.client.0.smithi032.stdout:6/769: mknod d8/dd/d18/d13/ce9 0 2024-05-06T21:26:47.966 INFO:tasks.workunit.client.0.smithi032.stdout:6/770: write d8/d33/f77 [961404,16649] 0 2024-05-06T21:26:47.967 INFO:tasks.workunit.client.0.smithi032.stdout:6/771: unlink d8/d3d/d49/lb2 0 2024-05-06T21:26:47.967 INFO:tasks.workunit.client.0.smithi032.stdout:6/772: readlink d8/dd/d18/d3b/db9/l92 0 2024-05-06T21:26:47.967 INFO:tasks.workunit.client.0.smithi032.stdout:6/773: write d8/f8c [3192140,102034] 0 2024-05-06T21:26:47.967 INFO:tasks.workunit.client.0.smithi032.stdout:6/774: write d8/dd/d18/d3b/db9/fd6 [1037786,31607] 0 2024-05-06T21:26:47.969 INFO:tasks.workunit.client.0.smithi032.stdout:6/775: dread d8/dd/d18/d3b/f50 [0,4194304] 0 2024-05-06T21:26:47.969 INFO:tasks.workunit.client.1.smithi154.stdout:4/339: write d0/d2/d2a/f2c [335439,24229] 0 2024-05-06T21:26:47.969 INFO:tasks.workunit.client.1.smithi154.stdout:4/340: fdatasync d0/f22 0 2024-05-06T21:26:47.972 INFO:tasks.workunit.client.0.smithi032.stdout:3/792: dwrite d1/d4/da/d1d/f24 [4194304,4194304] 0 2024-05-06T21:26:47.973 INFO:tasks.workunit.client.0.smithi032.stdout:3/793: dread d1/fc4 [0,4194304] 0 2024-05-06T21:26:47.975 INFO:tasks.workunit.client.0.smithi032.stdout:3/794: creat d1/d4/da/d4e/d41/d43/f110 x:0 0 0 2024-05-06T21:26:47.983 INFO:tasks.workunit.client.1.smithi154.stdout:4/341: dread d0/d2/fb [0,4194304] 0 2024-05-06T21:26:47.983 INFO:tasks.workunit.client.1.smithi154.stdout:4/342: dread - d0/f3e zero size 2024-05-06T21:26:47.983 INFO:tasks.workunit.client.1.smithi154.stdout:4/343: chown d0/d10/d11/d1a/d31/d39/f4b 2 1 2024-05-06T21:26:47.983 INFO:tasks.workunit.client.1.smithi154.stdout:4/344: dread - d0/d10/d11/d1a/d31/f5e zero size 2024-05-06T21:26:47.983 INFO:tasks.workunit.client.1.smithi154.stdout:4/345: chown d0/d2/f2f 625 1 2024-05-06T21:26:47.997 INFO:tasks.workunit.client.1.smithi154.stdout:0/476: unlink d6/dc/l4c 0 2024-05-06T21:26:47.998 INFO:tasks.workunit.client.1.smithi154.stdout:0/477: read d6/dc/f66 [602201,42091] 0 2024-05-06T21:26:47.998 INFO:tasks.workunit.client.1.smithi154.stdout:4/346: write d0/f34 [365151,43588] 0 2024-05-06T21:26:47.998 INFO:tasks.workunit.client.1.smithi154.stdout:4/347: write d0/d10/d11/d1a/d31/d44/f4d [4829782,103393] 0 2024-05-06T21:26:47.998 INFO:tasks.workunit.client.1.smithi154.stdout:4/348: truncate d0/d2/f8 1441917 0 2024-05-06T21:26:47.999 INFO:tasks.workunit.client.0.smithi032.stdout:3/795: dwrite d1/d4/da/d31/d9b/f9e [0,4194304] 0 2024-05-06T21:26:48.000 INFO:tasks.workunit.client.1.smithi154.stdout:3/524: mkdir d0/da/d1a/d28/d2f/d81/d48/da9/db3 0 2024-05-06T21:26:48.002 INFO:tasks.workunit.client.1.smithi154.stdout:8/332: dread - d3/d14/d1a/d29/d68/d26/f4e zero size 2024-05-06T21:26:48.005 INFO:tasks.workunit.client.1.smithi154.stdout:7/268: sync 2024-05-06T21:26:48.005 INFO:tasks.workunit.client.1.smithi154.stdout:2/343: sync 2024-05-06T21:26:48.005 INFO:tasks.workunit.client.1.smithi154.stdout:6/271: sync 2024-05-06T21:26:48.005 INFO:tasks.workunit.client.1.smithi154.stdout:6/272: fdatasync f6 0 2024-05-06T21:26:48.005 INFO:tasks.workunit.client.1.smithi154.stdout:2/344: chown db/de/d10/d18/l1a 364950 1 2024-05-06T21:26:48.005 INFO:tasks.workunit.client.1.smithi154.stdout:7/269: chown d6/de/d21/c4d 1978146 1 2024-05-06T21:26:48.006 INFO:tasks.workunit.client.1.smithi154.stdout:2/345: chown db/f3c 116558 1 2024-05-06T21:26:48.006 INFO:tasks.workunit.client.1.smithi154.stdout:9/494: creat d5/d2e/da0/fb4 x:0 0 0 2024-05-06T21:26:48.007 INFO:tasks.workunit.client.1.smithi154.stdout:5/424: link d2/d6/f5f d2/d6/f83 0 2024-05-06T21:26:48.007 INFO:tasks.workunit.client.1.smithi154.stdout:5/425: chown d2/d48 48 1 2024-05-06T21:26:48.008 INFO:tasks.workunit.client.1.smithi154.stdout:6/273: dread d8/d11/f1a [0,4194304] 0 2024-05-06T21:26:48.013 INFO:tasks.workunit.client.1.smithi154.stdout:0/478: unlink d6/c9 0 2024-05-06T21:26:48.014 INFO:tasks.workunit.client.1.smithi154.stdout:3/525: mkdir d0/da/db/d30/db4 0 2024-05-06T21:26:48.015 INFO:tasks.workunit.client.1.smithi154.stdout:6/274: dread d8/f10 [0,4194304] 0 2024-05-06T21:26:48.015 INFO:tasks.workunit.client.1.smithi154.stdout:8/333: mkdir d3/d14/d1a/d6e 0 2024-05-06T21:26:48.015 INFO:tasks.workunit.client.1.smithi154.stdout:8/334: dread - d3/d14/d1a/d29/d3e/f52 zero size 2024-05-06T21:26:48.016 INFO:tasks.workunit.client.1.smithi154.stdout:2/346: dread db/de/d10/f30 [0,4194304] 0 2024-05-06T21:26:48.016 INFO:tasks.workunit.client.1.smithi154.stdout:7/270: mknod d6/de/d21/c51 0 2024-05-06T21:26:48.016 INFO:tasks.workunit.client.1.smithi154.stdout:7/271: chown d6/de/c4c 2 1 2024-05-06T21:26:48.017 INFO:tasks.workunit.client.1.smithi154.stdout:5/426: rename d2/d3/d19/f2b to d2/d3/d19/d23/f84 0 2024-05-06T21:26:48.022 INFO:tasks.workunit.client.1.smithi154.stdout:4/349: dwrite d0/d10/d11/d1a/d31/d44/f4d [4194304,4194304] 0 2024-05-06T21:26:48.022 INFO:tasks.workunit.client.1.smithi154.stdout:4/350: write d0/d10/f65 [605979,76910] 0 2024-05-06T21:26:48.022 INFO:tasks.workunit.client.1.smithi154.stdout:4/351: read d0/d2/dc/f18 [3043294,104418] 0 2024-05-06T21:26:48.022 INFO:tasks.workunit.client.1.smithi154.stdout:4/352: write d0/d2/f2f [2793494,41775] 0 2024-05-06T21:26:48.022 INFO:tasks.workunit.client.1.smithi154.stdout:4/353: fsync d0/d2/f4c 0 2024-05-06T21:26:48.022 INFO:tasks.workunit.client.1.smithi154.stdout:4/354: fdatasync d0/f23 0 2024-05-06T21:26:48.022 INFO:tasks.workunit.client.1.smithi154.stdout:3/526: link d0/da/db/l16 d0/da/d1a/d28/d17/db0/d76/d9a/lb5 0 2024-05-06T21:26:48.022 INFO:tasks.workunit.client.1.smithi154.stdout:3/527: creat d0/d2/fb6 x:0 0 0 2024-05-06T21:26:48.022 INFO:tasks.workunit.client.1.smithi154.stdout:3/528: dread - d0/da/db/d7c/fa6 zero size 2024-05-06T21:26:48.024 INFO:tasks.workunit.client.1.smithi154.stdout:8/335: mkdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f 0 2024-05-06T21:26:48.025 INFO:tasks.workunit.client.1.smithi154.stdout:2/347: mkdir db/de/d6f 0 2024-05-06T21:26:48.026 INFO:tasks.workunit.client.1.smithi154.stdout:7/272: dread d6/de/f19 [0,4194304] 0 2024-05-06T21:26:48.026 INFO:tasks.workunit.client.1.smithi154.stdout:6/275: rename d8/d11/d2d/f2f to d8/d13/f5e 0 2024-05-06T21:26:48.027 INFO:tasks.workunit.client.1.smithi154.stdout:5/427: creat d2/d6/dd/d2a/f85 x:0 0 0 2024-05-06T21:26:48.033 INFO:tasks.workunit.client.1.smithi154.stdout:3/529: truncate d0/da/d1a/d28/d17/f4f 288875 0 2024-05-06T21:26:48.033 INFO:tasks.workunit.client.1.smithi154.stdout:3/530: write d0/f2b [2557956,127405] 0 2024-05-06T21:26:48.033 INFO:tasks.workunit.client.1.smithi154.stdout:3/531: read - d0/da/db/d30/d71/f88 zero size 2024-05-06T21:26:48.033 INFO:tasks.workunit.client.1.smithi154.stdout:3/532: creat d0/da/d1a/d28/d2f/d81/d48/da9/fb7 x:0 0 0 2024-05-06T21:26:48.034 INFO:tasks.workunit.client.1.smithi154.stdout:2/348: dread db/f3c [0,4194304] 0 2024-05-06T21:26:48.034 INFO:tasks.workunit.client.1.smithi154.stdout:8/336: mknod d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/c70 0 2024-05-06T21:26:48.035 INFO:tasks.workunit.client.1.smithi154.stdout:7/273: mkdir d6/d20/d40/d52 0 2024-05-06T21:26:48.035 INFO:tasks.workunit.client.1.smithi154.stdout:7/274: write d6/de/f31 [2695589,63031] 0 2024-05-06T21:26:48.036 INFO:tasks.workunit.client.1.smithi154.stdout:7/275: read d6/f1a [544918,86700] 0 2024-05-06T21:26:48.037 INFO:tasks.workunit.client.1.smithi154.stdout:4/355: rename d0/d2/d2a to d0/d10/d11/d1a/d31/d44/d73 0 2024-05-06T21:26:48.038 INFO:tasks.workunit.client.1.smithi154.stdout:5/428: write d2/d6/dc/d71/f75 [2175934,104303] 0 2024-05-06T21:26:48.041 INFO:tasks.workunit.client.1.smithi154.stdout:2/349: truncate db/d12/f21 1362600 0 2024-05-06T21:26:48.043 INFO:tasks.workunit.client.1.smithi154.stdout:8/337: getdents d3/d14/d1a/d29/d32/d40 0 2024-05-06T21:26:48.046 INFO:tasks.workunit.client.1.smithi154.stdout:7/276: symlink d6/l53 0 2024-05-06T21:26:48.047 INFO:tasks.workunit.client.1.smithi154.stdout:4/356: mkdir d0/d10/d11/d1a/d31/d44/d73/d4a/d74 0 2024-05-06T21:26:48.047 INFO:tasks.workunit.client.1.smithi154.stdout:1/413: sync 2024-05-06T21:26:48.049 INFO:tasks.workunit.client.1.smithi154.stdout:0/479: getdents d6 0 2024-05-06T21:26:48.052 INFO:tasks.workunit.client.1.smithi154.stdout:5/429: creat d2/d3/d19/d23/f86 x:0 0 0 2024-05-06T21:26:48.055 INFO:tasks.workunit.client.1.smithi154.stdout:8/338: link d3/d14/d1a/d29/d3e/f52 d3/d56/f71 0 2024-05-06T21:26:48.057 INFO:tasks.workunit.client.1.smithi154.stdout:2/350: dwrite db/de/d16/f28 [0,4194304] 0 2024-05-06T21:26:48.057 INFO:tasks.workunit.client.1.smithi154.stdout:2/351: readlink db/d12/d19/l3d 0 2024-05-06T21:26:48.057 INFO:tasks.workunit.client.1.smithi154.stdout:3/533: dwrite d0/d2/f6f [0,4194304] 0 2024-05-06T21:26:48.058 INFO:tasks.workunit.client.1.smithi154.stdout:7/277: mkdir d6/d54 0 2024-05-06T21:26:48.058 INFO:tasks.workunit.client.1.smithi154.stdout:7/278: chown d6/l4a 65 1 2024-05-06T21:26:48.058 INFO:tasks.workunit.client.1.smithi154.stdout:7/279: chown d6/d20/c18 200 1 2024-05-06T21:26:48.058 INFO:tasks.workunit.client.1.smithi154.stdout:2/352: dread db/d12/f43 [0,4194304] 0 2024-05-06T21:26:48.058 INFO:tasks.workunit.client.1.smithi154.stdout:2/353: chown db/d12/d4e 6 1 2024-05-06T21:26:48.059 INFO:tasks.workunit.client.1.smithi154.stdout:1/414: link d6/d3e/l65 d6/db/d69/l7b 0 2024-05-06T21:26:48.060 INFO:tasks.workunit.client.1.smithi154.stdout:0/480: creat d6/dc/d40/d4a/d6c/f9e x:0 0 0 2024-05-06T21:26:48.062 INFO:tasks.workunit.client.1.smithi154.stdout:5/430: rename d2/l72 to d2/d6/dd/l87 0 2024-05-06T21:26:48.065 INFO:tasks.workunit.client.1.smithi154.stdout:6/276: rmdir d8/d13 39 2024-05-06T21:26:48.065 INFO:tasks.workunit.client.1.smithi154.stdout:5/431: dread d2/f34 [4194304,4194304] 0 2024-05-06T21:26:48.066 INFO:tasks.workunit.client.1.smithi154.stdout:1/415: write d6/d3e/f72 [1069520,67712] 0 2024-05-06T21:26:48.067 INFO:tasks.workunit.client.1.smithi154.stdout:4/357: dwrite d0/d10/d11/d1a/f28 [0,4194304] 0 2024-05-06T21:26:48.070 INFO:tasks.workunit.client.1.smithi154.stdout:3/534: link d0/da/db/dd/ff d0/da/fb8 0 2024-05-06T21:26:48.072 INFO:tasks.workunit.client.1.smithi154.stdout:7/280: link d6/de/d21/l44 d6/d46/l55 0 2024-05-06T21:26:48.074 INFO:tasks.workunit.client.1.smithi154.stdout:2/354: creat db/d12/d1d/d60/d63/f70 x:0 0 0 2024-05-06T21:26:48.075 INFO:tasks.workunit.client.1.smithi154.stdout:2/355: chown db/d12/d1d/f47 1 1 2024-05-06T21:26:48.075 INFO:tasks.workunit.client.1.smithi154.stdout:2/356: write db/de/f11 [2577375,68504] 0 2024-05-06T21:26:48.075 INFO:tasks.workunit.client.1.smithi154.stdout:2/357: readlink db/d12/d4e/l50 0 2024-05-06T21:26:48.075 INFO:tasks.workunit.client.1.smithi154.stdout:0/481: mkdir d6/dc/d44/d9f 0 2024-05-06T21:26:48.076 INFO:tasks.workunit.client.1.smithi154.stdout:8/339: mkdir d3/d14/d1a/d29/d68/d26/d72 0 2024-05-06T21:26:48.077 INFO:tasks.workunit.client.1.smithi154.stdout:8/340: fdatasync d3/d56/f71 0 2024-05-06T21:26:48.080 INFO:tasks.workunit.client.1.smithi154.stdout:4/358: mkdir d0/d10/d11/d1a/d31/d44/d73/d4a/d74/d75 0 2024-05-06T21:26:48.080 INFO:tasks.workunit.client.1.smithi154.stdout:8/341: dread d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f51 [0,4194304] 0 2024-05-06T21:26:48.080 INFO:tasks.workunit.client.1.smithi154.stdout:8/342: chown d3/d14/d1a/d29/d3e 7568652 1 2024-05-06T21:26:48.081 INFO:tasks.workunit.client.1.smithi154.stdout:3/535: creat d0/da/db/d7c/fb9 x:0 0 0 2024-05-06T21:26:48.085 INFO:tasks.workunit.client.1.smithi154.stdout:7/281: link d6/de/d21/l44 d6/d54/l56 0 2024-05-06T21:26:48.085 INFO:tasks.workunit.client.1.smithi154.stdout:5/432: dwrite d2/d3/d19/d23/f84 [0,4194304] 0 2024-05-06T21:26:48.088 INFO:tasks.workunit.client.1.smithi154.stdout:1/416: getdents d6/db/d5e 0 2024-05-06T21:26:48.089 INFO:tasks.workunit.client.1.smithi154.stdout:0/482: dread d6/dc/d44/d36/f4d [0,4194304] 0 2024-05-06T21:26:48.089 INFO:tasks.workunit.client.1.smithi154.stdout:4/359: mkdir d0/d72/d76 0 2024-05-06T21:26:48.090 INFO:tasks.workunit.client.1.smithi154.stdout:4/360: stat d0/d2/d29/l4f 0 2024-05-06T21:26:48.090 INFO:tasks.workunit.client.1.smithi154.stdout:3/536: stat d0/l58 0 2024-05-06T21:26:48.090 INFO:tasks.workunit.client.1.smithi154.stdout:3/537: readlink d0/da/l3f 0 2024-05-06T21:26:48.092 INFO:tasks.workunit.client.1.smithi154.stdout:7/282: rename d6/de/f4f to d6/d20/f57 0 2024-05-06T21:26:48.094 INFO:tasks.workunit.client.1.smithi154.stdout:5/433: creat d2/d3/f88 x:0 0 0 2024-05-06T21:26:48.094 INFO:tasks.workunit.client.1.smithi154.stdout:5/434: stat d2/d3/d19/d23/f33 0 2024-05-06T21:26:48.095 INFO:tasks.workunit.client.1.smithi154.stdout:1/417: getdents d6/db/d10/d15/d1d/d53 0 2024-05-06T21:26:48.097 INFO:tasks.workunit.client.1.smithi154.stdout:0/483: write d6/dc/f4f [888680,34649] 0 2024-05-06T21:26:48.097 INFO:tasks.workunit.client.1.smithi154.stdout:0/484: rename d6/dc/d40 to d6/dc/d40/da0 22 2024-05-06T21:26:48.097 INFO:tasks.workunit.client.1.smithi154.stdout:0/485: truncate d6/dc/f64 1227866 0 2024-05-06T21:26:48.097 INFO:tasks.workunit.client.1.smithi154.stdout:0/486: write d6/dc/d40/f47 [910962,81184] 0 2024-05-06T21:26:48.098 INFO:tasks.workunit.client.1.smithi154.stdout:4/361: link d0/d10/f38 d0/d10/d11/d1a/d31/f77 0 2024-05-06T21:26:48.098 INFO:tasks.workunit.client.1.smithi154.stdout:2/358: dwrite db/de/d10/f25 [0,4194304] 0 2024-05-06T21:26:48.099 INFO:tasks.workunit.client.1.smithi154.stdout:3/538: link d0/da/db/d7c/d80/f9d d0/da/d1a/d28/d2f/fba 0 2024-05-06T21:26:48.100 INFO:tasks.workunit.client.1.smithi154.stdout:7/283: creat d6/d54/f58 x:0 0 0 2024-05-06T21:26:48.104 INFO:tasks.workunit.client.1.smithi154.stdout:4/362: rename d0/d2/d29/d60/c70 to d0/d10/d11/d1a/d31/d44/c78 0 2024-05-06T21:26:48.105 INFO:tasks.workunit.client.1.smithi154.stdout:2/359: creat db/f71 x:0 0 0 2024-05-06T21:26:48.106 INFO:tasks.workunit.client.1.smithi154.stdout:0/487: write d6/dc/f33 [2080832,14624] 0 2024-05-06T21:26:48.106 INFO:tasks.workunit.client.1.smithi154.stdout:8/343: dwrite d3/d14/d1a/d29/f50 [0,4194304] 0 2024-05-06T21:26:48.106 INFO:tasks.workunit.client.1.smithi154.stdout:8/344: read d3/d14/f19 [6714171,81255] 0 2024-05-06T21:26:48.109 INFO:tasks.workunit.client.1.smithi154.stdout:7/284: mknod d6/c59 0 2024-05-06T21:26:48.109 INFO:tasks.workunit.client.1.smithi154.stdout:7/285: write d6/fb [4709268,27070] 0 2024-05-06T21:26:48.111 INFO:tasks.workunit.client.1.smithi154.stdout:5/435: unlink d2/d6/dd/d2a/l52 0 2024-05-06T21:26:48.111 INFO:tasks.workunit.client.1.smithi154.stdout:0/488: dread d6/f3a [0,4194304] 0 2024-05-06T21:26:48.112 INFO:tasks.workunit.client.1.smithi154.stdout:4/363: mknod d0/d10/d11/d1a/d31/d39/c79 0 2024-05-06T21:26:48.113 INFO:tasks.workunit.client.1.smithi154.stdout:2/360: symlink db/de/d16/d33/l72 0 2024-05-06T21:26:48.115 INFO:tasks.workunit.client.1.smithi154.stdout:7/286: write d6/de/f31 [1465705,109049] 0 2024-05-06T21:26:48.116 INFO:tasks.workunit.client.1.smithi154.stdout:8/345: unlink d3/d14/d1a/d29/d32/c44 0 2024-05-06T21:26:48.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:47 smithi154 ceph-mon[32880]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 217 MiB/s rd, 269 MiB/s wr, 890 op/s 2024-05-06T21:26:48.121 INFO:tasks.workunit.client.1.smithi154.stdout:3/539: rmdir d0/da/d1a/d28/d2f 39 2024-05-06T21:26:48.121 INFO:tasks.workunit.client.1.smithi154.stdout:3/540: write d0/da/db/d52/d75/f7b [344356,36041] 0 2024-05-06T21:26:48.125 INFO:tasks.workunit.client.1.smithi154.stdout:5/436: link d2/d48/c5e d2/d3/d21/d22/c89 0 2024-05-06T21:26:48.129 INFO:tasks.workunit.client.1.smithi154.stdout:0/489: link d6/dc/d44/f46 d6/dc/d39/fa1 0 2024-05-06T21:26:48.136 INFO:tasks.workunit.client.1.smithi154.stdout:2/361: dwrite db/de/d16/f52 [0,4194304] 0 2024-05-06T21:26:48.136 INFO:tasks.workunit.client.1.smithi154.stdout:4/364: mknod d0/d10/c7a 0 2024-05-06T21:26:48.140 INFO:tasks.workunit.client.1.smithi154.stdout:8/346: creat d3/d14/d1a/d29/d32/d40/d4b/f73 x:0 0 0 2024-05-06T21:26:48.140 INFO:tasks.workunit.client.1.smithi154.stdout:8/347: read d3/d14/f20 [116170,36131] 0 2024-05-06T21:26:48.140 INFO:tasks.workunit.client.1.smithi154.stdout:8/348: readlink d3/d14/d1a/l2a 0 2024-05-06T21:26:48.140 INFO:tasks.workunit.client.1.smithi154.stdout:8/349: creat d3/d14/d1a/d29/f74 x:0 0 0 2024-05-06T21:26:48.141 INFO:tasks.workunit.client.1.smithi154.stdout:5/437: mknod d2/d3/d21/d22/d25/c8a 0 2024-05-06T21:26:48.141 INFO:tasks.workunit.client.1.smithi154.stdout:5/438: readlink d2/l67 0 2024-05-06T21:26:48.145 INFO:tasks.workunit.client.1.smithi154.stdout:2/362: mknod db/d12/d4e/c73 0 2024-05-06T21:26:48.147 INFO:tasks.workunit.client.1.smithi154.stdout:4/365: symlink d0/d10/d11/d1a/d31/l7b 0 2024-05-06T21:26:48.149 INFO:tasks.workunit.client.1.smithi154.stdout:5/439: truncate d2/d6/dc/d71/f81 3671971 0 2024-05-06T21:26:48.149 INFO:tasks.workunit.client.1.smithi154.stdout:7/287: dwrite d6/de/f19 [0,4194304] 0 2024-05-06T21:26:48.149 INFO:tasks.workunit.client.1.smithi154.stdout:8/350: dread d3/d14/d1a/d29/f50 [0,4194304] 0 2024-05-06T21:26:48.150 INFO:tasks.workunit.client.1.smithi154.stdout:3/541: dwrite d0/d2/f6f [0,4194304] 0 2024-05-06T21:26:48.150 INFO:tasks.workunit.client.1.smithi154.stdout:2/363: creat db/de/f74 x:0 0 0 2024-05-06T21:26:48.150 INFO:tasks.workunit.client.1.smithi154.stdout:2/364: chown db/de/d10/d18/l1a 7 1 2024-05-06T21:26:48.150 INFO:tasks.workunit.client.1.smithi154.stdout:2/365: dread - db/d12/d19/f56 zero size 2024-05-06T21:26:48.151 INFO:tasks.workunit.client.1.smithi154.stdout:4/366: creat d0/d10/d11/d1a/d31/d3d/f7c x:0 0 0 2024-05-06T21:26:48.151 INFO:tasks.workunit.client.1.smithi154.stdout:0/490: dwrite d6/dc/d51/f6f [0,4194304] 0 2024-05-06T21:26:48.151 INFO:tasks.workunit.client.1.smithi154.stdout:8/351: mknod d3/d14/d1a/d45/c75 0 2024-05-06T21:26:48.156 INFO:tasks.workunit.client.1.smithi154.stdout:7/288: dread d6/f25 [0,4194304] 0 2024-05-06T21:26:48.161 INFO:tasks.workunit.client.1.smithi154.stdout:2/366: creat db/d12/d19/d4b/f75 x:0 0 0 2024-05-06T21:26:48.162 INFO:tasks.workunit.client.1.smithi154.stdout:5/440: dwrite d2/d3/d19/d23/f84 [4194304,4194304] 0 2024-05-06T21:26:48.163 INFO:tasks.workunit.client.1.smithi154.stdout:5/441: dread - d2/d3/d19/d23/f78 zero size 2024-05-06T21:26:48.163 INFO:tasks.workunit.client.1.smithi154.stdout:0/491: symlink d6/dc/d40/d41/d70/d96/la2 0 2024-05-06T21:26:48.163 INFO:tasks.workunit.client.1.smithi154.stdout:0/492: chown d6/dc/d42/f8d 36550 1 2024-05-06T21:26:48.164 INFO:tasks.workunit.client.1.smithi154.stdout:8/352: mknod d3/d64/d6d/c76 0 2024-05-06T21:26:48.165 INFO:tasks.workunit.client.1.smithi154.stdout:7/289: rename d6/c2d to d6/c5a 0 2024-05-06T21:26:48.166 INFO:tasks.workunit.client.1.smithi154.stdout:3/542: getdents d0/da 0 2024-05-06T21:26:48.166 INFO:tasks.workunit.client.1.smithi154.stdout:3/543: stat d0/da/d1a/d28/d17/db0/f77 0 2024-05-06T21:26:48.167 INFO:tasks.workunit.client.1.smithi154.stdout:2/367: link db/de/d16/d4f/c40 db/d12/d4e/d55/c76 0 2024-05-06T21:26:48.169 INFO:tasks.workunit.client.1.smithi154.stdout:4/367: getdents d0/d10/d11/d1a 0 2024-05-06T21:26:48.171 INFO:tasks.workunit.client.1.smithi154.stdout:5/442: mkdir d2/d3/d8b 0 2024-05-06T21:26:48.171 INFO:tasks.workunit.client.0.smithi032.stdout:2/576: sync 2024-05-06T21:26:48.171 INFO:tasks.workunit.client.0.smithi032.stdout:9/717: sync 2024-05-06T21:26:48.171 INFO:tasks.workunit.client.0.smithi032.stdout:7/748: sync 2024-05-06T21:26:48.171 INFO:tasks.workunit.client.0.smithi032.stdout:7/749: read - db/d12/d16/d21/d41/fa6 zero size 2024-05-06T21:26:48.171 INFO:tasks.workunit.client.0.smithi032.stdout:2/577: dread - df/d19/d1e/d35/dc5/d2e/d33/fa5 zero size 2024-05-06T21:26:48.171 INFO:tasks.workunit.client.0.smithi032.stdout:7/750: write db/d12/d16/fb4 [622171,96944] 0 2024-05-06T21:26:48.172 INFO:tasks.workunit.client.1.smithi154.stdout:0/493: mkdir d6/dc/d40/d4a/da3 0 2024-05-06T21:26:48.173 INFO:tasks.workunit.client.1.smithi154.stdout:7/290: mkdir d6/d54/d5b 0 2024-05-06T21:26:48.173 INFO:tasks.workunit.client.0.smithi032.stdout:9/718: creat d1/d13/d33/d5e/ff2 x:0 0 0 2024-05-06T21:26:48.173 INFO:tasks.workunit.client.0.smithi032.stdout:9/719: dread - d1/fc8 zero size 2024-05-06T21:26:48.174 INFO:tasks.workunit.client.1.smithi154.stdout:2/368: getdents db/d12/d4e 0 2024-05-06T21:26:48.174 INFO:tasks.workunit.client.1.smithi154.stdout:2/369: dread - db/d12/d1d/d60/d63/f66 zero size 2024-05-06T21:26:48.174 INFO:tasks.workunit.client.1.smithi154.stdout:2/370: dread - db/de/f74 zero size 2024-05-06T21:26:48.175 INFO:tasks.workunit.client.0.smithi032.stdout:2/578: creat df/d19/d1e/d35/d3f/fd0 x:0 0 0 2024-05-06T21:26:48.175 INFO:tasks.workunit.client.0.smithi032.stdout:2/579: chown df/d19/d1e/d42/dc6/lb6 44505 1 2024-05-06T21:26:48.176 INFO:tasks.workunit.client.0.smithi032.stdout:9/720: truncate d1/d13/f1f 1919069 0 2024-05-06T21:26:48.176 INFO:tasks.workunit.client.1.smithi154.stdout:5/443: link d2/d6/dd/f18 d2/d6/f8c 0 2024-05-06T21:26:48.176 INFO:tasks.workunit.client.1.smithi154.stdout:5/444: fsync d2/d3/f16 0 2024-05-06T21:26:48.178 INFO:tasks.workunit.client.1.smithi154.stdout:0/494: rmdir d6/dc/d40/d4a 39 2024-05-06T21:26:48.178 INFO:tasks.workunit.client.1.smithi154.stdout:0/495: truncate d6/dc/d51/f80 1015577 0 2024-05-06T21:26:48.178 INFO:tasks.workunit.client.1.smithi154.stdout:0/496: write d6/dc/f38 [566105,16046] 0 2024-05-06T21:26:48.178 INFO:tasks.workunit.client.1.smithi154.stdout:0/497: truncate d6/dc/d44/d36/f57 2044714 0 2024-05-06T21:26:48.178 INFO:tasks.workunit.client.0.smithi032.stdout:2/580: rename df/d19/d1e/d71/d5f/d7d/d25/d2d/f86 to df/d19/d1e/d71/d5f/d7d/d65/d78/fd1 0 2024-05-06T21:26:48.179 INFO:tasks.workunit.client.0.smithi032.stdout:2/581: creat df/d19/d1e/d35/d3f/fd2 x:0 0 0 2024-05-06T21:26:48.179 INFO:tasks.workunit.client.0.smithi032.stdout:9/721: truncate d1/f12 3282391 0 2024-05-06T21:26:48.179 INFO:tasks.workunit.client.1.smithi154.stdout:7/291: unlink d6/de/c3e 0 2024-05-06T21:26:48.180 INFO:tasks.workunit.client.1.smithi154.stdout:7/292: write d6/fb [2385570,52699] 0 2024-05-06T21:26:48.181 INFO:tasks.workunit.client.1.smithi154.stdout:4/368: dread d0/d2/f2b [0,4194304] 0 2024-05-06T21:26:48.181 INFO:tasks.workunit.client.0.smithi032.stdout:2/582: symlink df/daf/ld3 0 2024-05-06T21:26:48.181 INFO:tasks.workunit.client.0.smithi032.stdout:2/583: chown df/d19/d1e/d71/d5f/d73/f87 987670 1 2024-05-06T21:26:48.182 INFO:tasks.workunit.client.1.smithi154.stdout:2/371: unlink db/d12/l2c 0 2024-05-06T21:26:48.183 INFO:tasks.workunit.client.0.smithi032.stdout:9/722: creat d1/d2f/da1/dc2/ff3 x:0 0 0 2024-05-06T21:26:48.183 INFO:tasks.workunit.client.0.smithi032.stdout:9/723: chown d1/d13/d33/f7d 15 1 2024-05-06T21:26:48.184 INFO:tasks.workunit.client.0.smithi032.stdout:2/584: dread df/d19/d1e/d71/d5f/d7d/f5c [0,4194304] 0 2024-05-06T21:26:48.184 INFO:tasks.workunit.client.0.smithi032.stdout:2/585: write df/d19/d1e/d42/dc6/dc1/fc8 [444928,106718] 0 2024-05-06T21:26:48.184 INFO:tasks.workunit.client.0.smithi032.stdout:2/586: chown df/d19/d1e/d42/cbb 0 1 2024-05-06T21:26:48.184 INFO:tasks.workunit.client.0.smithi032.stdout:2/587: creat df/d19/d1e/d35/fd4 x:0 0 0 2024-05-06T21:26:48.184 INFO:tasks.workunit.client.0.smithi032.stdout:2/588: write df/d19/d1e/d35/fd4 [788039,125891] 0 2024-05-06T21:26:48.184 INFO:tasks.workunit.client.0.smithi032.stdout:9/724: creat d1/d2f/de1/ff4 x:0 0 0 2024-05-06T21:26:48.184 INFO:tasks.workunit.client.1.smithi154.stdout:0/498: mknod d6/dc/d40/d85/ca4 0 2024-05-06T21:26:48.185 INFO:tasks.workunit.client.0.smithi032.stdout:7/751: write db/d12/d16/d21/f44 [1426921,40916] 0 2024-05-06T21:26:48.185 INFO:tasks.workunit.client.0.smithi032.stdout:9/725: mknod d1/d13/d33/da6/cf5 0 2024-05-06T21:26:48.186 INFO:tasks.workunit.client.1.smithi154.stdout:7/293: mkdir d6/d46/d5c 0 2024-05-06T21:26:48.187 INFO:tasks.workunit.client.0.smithi032.stdout:2/589: getdents df/d19/d1e/d71/d5f/d7d/d65/d78/da6 0 2024-05-06T21:26:48.188 INFO:tasks.workunit.client.1.smithi154.stdout:4/369: link d0/d2/fb d0/d72/d76/f7d 0 2024-05-06T21:26:48.188 INFO:tasks.workunit.client.0.smithi032.stdout:2/590: symlink df/d19/d1e/d71/d5f/d73/ld5 0 2024-05-06T21:26:48.189 INFO:tasks.workunit.client.0.smithi032.stdout:2/591: write df/d19/d1e/d35/dc5/f43 [966614,44252] 0 2024-05-06T21:26:48.190 INFO:tasks.workunit.client.0.smithi032.stdout:2/592: truncate df/d19/d1e/d71/d5f/d7d/d65/f74 1268508 0 2024-05-06T21:26:48.190 INFO:tasks.workunit.client.1.smithi154.stdout:2/372: creat db/d12/f77 x:0 0 0 2024-05-06T21:26:48.191 INFO:tasks.workunit.client.1.smithi154.stdout:2/373: readlink db/de/d16/d33/l58 0 2024-05-06T21:26:48.191 INFO:tasks.workunit.client.1.smithi154.stdout:2/374: dread - db/de/f74 zero size 2024-05-06T21:26:48.191 INFO:tasks.workunit.client.1.smithi154.stdout:2/375: dread - db/de/d16/d33/f61 zero size 2024-05-06T21:26:48.191 INFO:tasks.workunit.client.1.smithi154.stdout:5/445: dread d2/d6/f83 [0,4194304] 0 2024-05-06T21:26:48.192 INFO:tasks.workunit.client.1.smithi154.stdout:0/499: rename d6/dc/d51/f6f to d6/dc/d3c/fa5 0 2024-05-06T21:26:48.196 INFO:tasks.workunit.client.1.smithi154.stdout:8/353: dwrite d3/d14/d1a/d29/d43/f5d [0,4194304] 0 2024-05-06T21:26:48.199 INFO:tasks.workunit.client.1.smithi154.stdout:3/544: dwrite d0/da/db/dd/fc [0,4194304] 0 2024-05-06T21:26:48.199 INFO:tasks.workunit.client.1.smithi154.stdout:3/545: write d0/da/d1a/d28/d17/f4f [452507,108497] 0 2024-05-06T21:26:48.199 INFO:tasks.workunit.client.1.smithi154.stdout:7/294: write d6/de/f19 [1479501,72455] 0 2024-05-06T21:26:48.199 INFO:tasks.workunit.client.1.smithi154.stdout:7/295: write d6/f1a [1227951,100608] 0 2024-05-06T21:26:48.199 INFO:tasks.workunit.client.1.smithi154.stdout:7/296: rename d6/d46/d5c to d6/d46/d5c/d5d 22 2024-05-06T21:26:48.202 INFO:tasks.workunit.client.0.smithi032.stdout:9/726: write d1/d13/d34/d26/d39/d45/f7b [1048263,30311] 0 2024-05-06T21:26:48.207 INFO:tasks.workunit.client.1.smithi154.stdout:8/354: symlink d3/l77 0 2024-05-06T21:26:48.208 INFO:tasks.workunit.client.1.smithi154.stdout:4/370: write d0/d10/f15 [6085629,55992] 0 2024-05-06T21:26:48.209 INFO:tasks.workunit.client.1.smithi154.stdout:0/500: dread d6/dc/f33 [0,4194304] 0 2024-05-06T21:26:48.209 INFO:tasks.workunit.client.1.smithi154.stdout:0/501: fdatasync d6/dc/d44/d36/f68 0 2024-05-06T21:26:48.209 INFO:tasks.workunit.client.1.smithi154.stdout:0/502: chown d6/dc/f33 70 1 2024-05-06T21:26:48.210 INFO:tasks.workunit.client.0.smithi032.stdout:9/727: rename d1/d13/d33/fb5 to d1/ff6 0 2024-05-06T21:26:48.210 INFO:tasks.workunit.client.0.smithi032.stdout:9/728: dread - d1/d13/d33/d5e/d78/f83 zero size 2024-05-06T21:26:48.210 INFO:tasks.workunit.client.0.smithi032.stdout:9/729: fsync d1/d2f/da1/dc2/d59/f86 0 2024-05-06T21:26:48.210 INFO:tasks.workunit.client.0.smithi032.stdout:9/730: truncate d1/d2f/da1/dc2/f7f 559382 0 2024-05-06T21:26:48.210 INFO:tasks.workunit.client.0.smithi032.stdout:9/731: fsync d1/d13/d33/d5e/d78/fe3 0 2024-05-06T21:26:48.210 INFO:tasks.workunit.client.1.smithi154.stdout:5/446: mkdir d2/d6/dd/d2a/d8d 0 2024-05-06T21:26:48.210 INFO:tasks.workunit.client.1.smithi154.stdout:7/297: dread d6/f25 [0,4194304] 0 2024-05-06T21:26:48.215 INFO:tasks.workunit.client.1.smithi154.stdout:8/355: symlink d3/d14/d1a/d29/d3e/l78 0 2024-05-06T21:26:48.216 INFO:tasks.workunit.client.0.smithi032.stdout:7/752: dwrite f3 [0,4194304] 0 2024-05-06T21:26:48.216 INFO:tasks.workunit.client.0.smithi032.stdout:7/753: write db/d12/d16/d2a/d39/d8b/fda [1027804,13095] 0 2024-05-06T21:26:48.216 INFO:tasks.workunit.client.0.smithi032.stdout:7/754: fsync db/d12/d16/d21/d41/fe5 0 2024-05-06T21:26:48.217 INFO:tasks.workunit.client.1.smithi154.stdout:4/371: mkdir d0/d10/d11/d1a/d7e 0 2024-05-06T21:26:48.219 INFO:tasks.workunit.client.1.smithi154.stdout:7/298: mkdir d6/de/d5e 0 2024-05-06T21:26:48.219 INFO:tasks.workunit.client.1.smithi154.stdout:7/299: readlink d6/de/l1c 0 2024-05-06T21:26:48.219 INFO:tasks.workunit.client.1.smithi154.stdout:7/300: write d6/fd [4393976,23755] 0 2024-05-06T21:26:48.219 INFO:tasks.workunit.client.1.smithi154.stdout:7/301: chown d6/l13 3172054 1 2024-05-06T21:26:48.219 INFO:tasks.workunit.client.1.smithi154.stdout:7/302: truncate d6/d20/f57 973712 0 2024-05-06T21:26:48.219 INFO:tasks.workunit.client.1.smithi154.stdout:8/356: readlink d3/d14/d1a/d29/d68/d26/l27 0 2024-05-06T21:26:48.221 INFO:tasks.workunit.client.1.smithi154.stdout:8/357: write d3/d38/f63 [443727,48152] 0 2024-05-06T21:26:48.222 INFO:tasks.workunit.client.1.smithi154.stdout:4/372: mknod d0/d10/d11/d1a/d31/d44/c7f 0 2024-05-06T21:26:48.222 INFO:tasks.workunit.client.1.smithi154.stdout:4/373: chown d0/d2/f66 1022 1 2024-05-06T21:26:48.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:47 smithi032 ceph-mon[27179]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 217 MiB/s rd, 269 MiB/s wr, 890 op/s 2024-05-06T21:26:48.225 INFO:tasks.workunit.client.0.smithi032.stdout:9/732: dread d1/d13/d34/d26/d39/d45/f6d [0,4194304] 0 2024-05-06T21:26:48.225 INFO:tasks.workunit.client.0.smithi032.stdout:9/733: chown d1/d13/d34/d26/f29 3576136 1 2024-05-06T21:26:48.225 INFO:tasks.workunit.client.1.smithi154.stdout:4/374: symlink d0/d2/d47/l80 0 2024-05-06T21:26:48.226 INFO:tasks.workunit.client.0.smithi032.stdout:7/755: dread db/d12/d16/d21/d41/d78/f4f [0,4194304] 0 2024-05-06T21:26:48.228 INFO:tasks.workunit.client.1.smithi154.stdout:0/503: dread d6/dc/d42/f59 [0,4194304] 0 2024-05-06T21:26:48.228 INFO:tasks.workunit.client.1.smithi154.stdout:0/504: chown d6/dc/d3c/l91 377476 1 2024-05-06T21:26:48.229 INFO:tasks.workunit.client.1.smithi154.stdout:4/375: mkdir d0/d2/d47/d81 0 2024-05-06T21:26:48.229 INFO:tasks.workunit.client.1.smithi154.stdout:9/495: sync 2024-05-06T21:26:48.233 INFO:tasks.workunit.client.1.smithi154.stdout:2/376: rmdir db/de 39 2024-05-06T21:26:48.233 INFO:tasks.workunit.client.1.smithi154.stdout:9/496: dread d5/d20/f23 [0,4194304] 0 2024-05-06T21:26:48.233 INFO:tasks.workunit.client.1.smithi154.stdout:9/497: fdatasync d5/d14/f94 0 2024-05-06T21:26:48.234 INFO:tasks.workunit.client.0.smithi032.stdout:7/756: dread db/d12/d16/f72 [0,4194304] 0 2024-05-06T21:26:48.234 INFO:tasks.workunit.client.0.smithi032.stdout:7/757: truncate db/d12/d49/d97/fcf 774604 0 2024-05-06T21:26:48.234 INFO:tasks.workunit.client.0.smithi032.stdout:7/758: stat db/d12/d16/d2a/d39/d3b/cc5 0 2024-05-06T21:26:48.235 INFO:tasks.workunit.client.1.smithi154.stdout:3/546: dwrite d0/da/d1a/d28/d2f/d81/d48/f65 [0,4194304] 0 2024-05-06T21:26:48.237 INFO:tasks.workunit.client.1.smithi154.stdout:0/505: write d6/dc/d44/d36/f4d [1431408,2760] 0 2024-05-06T21:26:48.237 INFO:tasks.workunit.client.1.smithi154.stdout:0/506: stat d6/d27/f28 0 2024-05-06T21:26:48.239 INFO:tasks.workunit.client.0.smithi032.stdout:7/759: unlink db/d12/d16/d21/d41/fb2 0 2024-05-06T21:26:48.241 INFO:tasks.workunit.client.0.smithi032.stdout:7/760: mknod db/d12/d16/d21/cec 0 2024-05-06T21:26:48.241 INFO:tasks.workunit.client.0.smithi032.stdout:7/761: write db/d12/d16/d21/d41/d78/fb3 [684419,56678] 0 2024-05-06T21:26:48.242 INFO:tasks.workunit.client.0.smithi032.stdout:2/593: dwrite df/d19/d1e/f48 [0,4194304] 0 2024-05-06T21:26:48.242 INFO:tasks.workunit.client.0.smithi032.stdout:7/762: symlink db/d12/d16/d21/dcb/dd7/led 0 2024-05-06T21:26:48.245 INFO:tasks.workunit.client.1.smithi154.stdout:0/507: mknod d6/dc/d40/d5e/ca6 0 2024-05-06T21:26:48.245 INFO:tasks.workunit.client.0.smithi032.stdout:7/763: symlink db/d12/d16/d2a/lee 0 2024-05-06T21:26:48.247 INFO:tasks.workunit.client.0.smithi032.stdout:2/594: getdents df/d19/d1e/d35/dc5 0 2024-05-06T21:26:48.247 INFO:tasks.workunit.client.0.smithi032.stdout:2/595: dread - df/d19/d1e/d54/f8e zero size 2024-05-06T21:26:48.249 INFO:tasks.workunit.client.1.smithi154.stdout:4/376: dread d0/d10/d11/d1a/d31/d44/d73/f37 [0,4194304] 0 2024-05-06T21:26:48.254 INFO:tasks.workunit.client.1.smithi154.stdout:3/547: read d0/fe [8277454,16156] 0 2024-05-06T21:26:48.255 INFO:tasks.workunit.client.1.smithi154.stdout:9/498: write d5/d2e/f55 [3889769,35671] 0 2024-05-06T21:26:48.258 INFO:tasks.workunit.client.1.smithi154.stdout:3/548: creat d0/da/d1a/d28/d2f/d81/d48/fbb x:0 0 0 2024-05-06T21:26:48.260 INFO:tasks.workunit.client.1.smithi154.stdout:0/508: write d6/dc/d3c/fa5 [63168,112366] 0 2024-05-06T21:26:48.260 INFO:tasks.workunit.client.1.smithi154.stdout:9/499: mknod d5/d20/d52/cb5 0 2024-05-06T21:26:48.267 INFO:tasks.workunit.client.0.smithi032.stdout:7/764: write db/d12/d16/d21/d41/d78/f91 [1816429,27733] 0 2024-05-06T21:26:48.267 INFO:tasks.workunit.client.1.smithi154.stdout:6/277: sync 2024-05-06T21:26:48.267 INFO:tasks.workunit.client.1.smithi154.stdout:1/418: sync 2024-05-06T21:26:48.267 INFO:tasks.workunit.client.1.smithi154.stdout:1/419: chown d6/db/d5e/f73 0 1 2024-05-06T21:26:48.267 INFO:tasks.workunit.client.1.smithi154.stdout:1/420: chown d6/db/d74/l7a 103764 1 2024-05-06T21:26:48.267 INFO:tasks.workunit.client.1.smithi154.stdout:1/421: readlink d6/db/d10/d15/l2e 0 2024-05-06T21:26:48.270 INFO:tasks.workunit.client.0.smithi032.stdout:7/765: unlink db/d12/d49/l6b 0 2024-05-06T21:26:48.271 INFO:tasks.workunit.client.0.smithi032.stdout:7/766: stat db/d12/d49/d97/lcc 0 2024-05-06T21:26:48.274 INFO:tasks.workunit.client.1.smithi154.stdout:5/447: dwrite d2/d3/d19/d23/f33 [4194304,4194304] 0 2024-05-06T21:26:48.275 INFO:tasks.workunit.client.0.smithi032.stdout:9/734: dwrite d1/d13/d33/d8e/fe2 [0,4194304] 0 2024-05-06T21:26:48.275 INFO:tasks.workunit.client.0.smithi032.stdout:9/735: creat d1/d13/d33/da6/ff7 x:0 0 0 2024-05-06T21:26:48.277 INFO:tasks.workunit.client.1.smithi154.stdout:5/448: creat d2/d3/d21/d22/f8e x:0 0 0 2024-05-06T21:26:48.278 INFO:tasks.workunit.client.1.smithi154.stdout:2/377: dwrite db/d12/f21 [0,4194304] 0 2024-05-06T21:26:48.278 INFO:tasks.workunit.client.1.smithi154.stdout:2/378: write db/d12/d19/d4b/f75 [942395,94840] 0 2024-05-06T21:26:48.278 INFO:tasks.workunit.client.1.smithi154.stdout:2/379: chown db/d12/d1d/l6c 220248561 1 2024-05-06T21:26:48.278 INFO:tasks.workunit.client.1.smithi154.stdout:8/358: dwrite d3/d14/d1a/d29/f50 [0,4194304] 0 2024-05-06T21:26:48.279 INFO:tasks.workunit.client.0.smithi032.stdout:2/596: dwrite df/d19/d1e/d54/fb8 [0,4194304] 0 2024-05-06T21:26:48.280 INFO:tasks.workunit.client.1.smithi154.stdout:5/449: symlink d2/d3/l8f 0 2024-05-06T21:26:48.280 INFO:tasks.workunit.client.1.smithi154.stdout:5/450: chown d2/d6/dd/f2c 11087125 1 2024-05-06T21:26:48.280 INFO:tasks.workunit.client.1.smithi154.stdout:5/451: write d2/d6/dd/f64 [944694,44347] 0 2024-05-06T21:26:48.281 INFO:tasks.workunit.client.0.smithi032.stdout:7/767: read db/d12/f51 [984742,100216] 0 2024-05-06T21:26:48.286 INFO:tasks.workunit.client.1.smithi154.stdout:2/380: mkdir db/d12/d19/d4b/d78 0 2024-05-06T21:26:48.290 INFO:tasks.workunit.client.1.smithi154.stdout:8/359: dread d3/d14/d1a/d29/f50 [0,4194304] 0 2024-05-06T21:26:48.291 INFO:tasks.workunit.client.1.smithi154.stdout:1/422: dwrite d6/f8 [0,4194304] 0 2024-05-06T21:26:48.291 INFO:tasks.workunit.client.1.smithi154.stdout:1/423: readlink d6/db/d10/d26/l55 0 2024-05-06T21:26:48.291 INFO:tasks.workunit.client.1.smithi154.stdout:8/360: write d3/d14/d1a/d29/d3e/f66 [560855,118355] 0 2024-05-06T21:26:48.291 INFO:tasks.workunit.client.1.smithi154.stdout:5/452: symlink d2/d3/d21/l90 0 2024-05-06T21:26:48.291 INFO:tasks.workunit.client.1.smithi154.stdout:4/377: rename d0/d10/d11/d1a/d31 to d0/d82 0 2024-05-06T21:26:48.294 INFO:tasks.workunit.client.0.smithi032.stdout:7/768: mkdir db/d12/d16/d2a/d39/def 0 2024-05-06T21:26:48.294 INFO:tasks.workunit.client.0.smithi032.stdout:7/769: truncate db/d12/d49/f6f 4813337 0 2024-05-06T21:26:48.294 INFO:tasks.workunit.client.0.smithi032.stdout:7/770: chown db/d12/d16/d2a/d39/lb8 171266 1 2024-05-06T21:26:48.295 INFO:tasks.workunit.client.1.smithi154.stdout:2/381: creat db/de/d16/d33/f79 x:0 0 0 2024-05-06T21:26:48.295 INFO:tasks.workunit.client.0.smithi032.stdout:9/736: link d1/d13/d33/da6/ff7 d1/d2f/da1/dc2/ff8 0 2024-05-06T21:26:48.296 INFO:tasks.workunit.client.0.smithi032.stdout:7/771: chown db/d12/d16/c55 167131 1 2024-05-06T21:26:48.296 INFO:tasks.workunit.client.0.smithi032.stdout:7/772: fdatasync db/d12/d16/d21/dcb/fea 0 2024-05-06T21:26:48.296 INFO:tasks.workunit.client.0.smithi032.stdout:7/773: creat db/d12/d16/d2a/d39/d3b/d96/ff0 x:0 0 0 2024-05-06T21:26:48.296 INFO:tasks.workunit.client.0.smithi032.stdout:9/737: creat d1/ff9 x:0 0 0 2024-05-06T21:26:48.296 INFO:tasks.workunit.client.1.smithi154.stdout:5/453: creat d2/d6/dc/d68/d69/f91 x:0 0 0 2024-05-06T21:26:48.296 INFO:tasks.workunit.client.1.smithi154.stdout:5/454: chown d2/d3/d21/d22 132807273 1 2024-05-06T21:26:48.297 INFO:tasks.workunit.client.1.smithi154.stdout:5/455: chown d2/d6 454241853 1 2024-05-06T21:26:48.298 INFO:tasks.workunit.client.0.smithi032.stdout:7/774: creat db/ff1 x:0 0 0 2024-05-06T21:26:48.299 INFO:tasks.workunit.client.1.smithi154.stdout:2/382: dread db/d12/d1d/f48 [4194304,4194304] 0 2024-05-06T21:26:48.302 INFO:tasks.workunit.client.1.smithi154.stdout:4/378: mknod d0/d10/d11/d1a/d7e/c83 0 2024-05-06T21:26:48.303 INFO:tasks.workunit.client.0.smithi032.stdout:2/597: dwrite df/d19/d1e/d35/dc5/d2e/d33/f15 [0,4194304] 0 2024-05-06T21:26:48.303 INFO:tasks.workunit.client.0.smithi032.stdout:2/598: fdatasync df/d19/d1e/d35/dc5/d2e/d33/faa 0 2024-05-06T21:26:48.305 INFO:tasks.workunit.client.0.smithi032.stdout:0/677: sync 2024-05-06T21:26:48.305 INFO:tasks.workunit.client.0.smithi032.stdout:6/776: sync 2024-05-06T21:26:48.305 INFO:tasks.workunit.client.0.smithi032.stdout:3/796: sync 2024-05-06T21:26:48.305 INFO:tasks.workunit.client.0.smithi032.stdout:3/797: fsync d1/d4/d11/f4f 0 2024-05-06T21:26:48.305 INFO:tasks.workunit.client.0.smithi032.stdout:8/912: sync 2024-05-06T21:26:48.306 INFO:tasks.workunit.client.0.smithi032.stdout:5/739: sync 2024-05-06T21:26:48.308 INFO:tasks.workunit.client.0.smithi032.stdout:6/777: dread - d8/dd/d18/d13/fc6 zero size 2024-05-06T21:26:48.308 INFO:tasks.workunit.client.0.smithi032.stdout:1/691: sync 2024-05-06T21:26:48.308 INFO:tasks.workunit.client.0.smithi032.stdout:1/692: truncate db/d37/d52/f6b 63402 0 2024-05-06T21:26:48.309 INFO:tasks.workunit.client.0.smithi032.stdout:4/786: sync 2024-05-06T21:26:48.309 INFO:tasks.workunit.client.0.smithi032.stdout:5/740: creat d0/d24/fe6 x:0 0 0 2024-05-06T21:26:48.310 INFO:tasks.workunit.client.0.smithi032.stdout:6/778: symlink d8/dd/d1b/d35/db4/lea 0 2024-05-06T21:26:48.310 INFO:tasks.workunit.client.0.smithi032.stdout:6/779: stat d8/dd/d18/d13 0 2024-05-06T21:26:48.310 INFO:tasks.workunit.client.0.smithi032.stdout:6/780: dread - d8/dd/d18/d13/fa7 zero size 2024-05-06T21:26:48.311 INFO:tasks.workunit.client.0.smithi032.stdout:1/693: mkdir db/d16/d5d/ddf 0 2024-05-06T21:26:48.311 INFO:tasks.workunit.client.0.smithi032.stdout:1/694: fdatasync db/d16/f33 0 2024-05-06T21:26:48.311 INFO:tasks.workunit.client.0.smithi032.stdout:1/695: chown db/d16/c25 424348 1 2024-05-06T21:26:48.311 INFO:tasks.workunit.client.0.smithi032.stdout:1/696: fdatasync db/d16/d46/f7e 0 2024-05-06T21:26:48.311 INFO:tasks.workunit.client.0.smithi032.stdout:3/798: dread d1/d4/da/d4e/d41/d43/f70 [0,4194304] 0 2024-05-06T21:26:48.311 INFO:tasks.workunit.client.0.smithi032.stdout:3/799: readlink d1/d4/db7/d8b/l95 0 2024-05-06T21:26:48.311 INFO:tasks.workunit.client.0.smithi032.stdout:6/781: write d8/dd/f12 [34388,84280] 0 2024-05-06T21:26:48.314 INFO:tasks.workunit.client.1.smithi154.stdout:0/509: rename d6/dc/d40/d41 to d6/dc/d40/d4a/da7 0 2024-05-06T21:26:48.315 INFO:tasks.workunit.client.0.smithi032.stdout:4/787: rename d2/d2c/d31/ce5 to d2/d16/d44/d74/d79/de6/de8/dd8/cf9 0 2024-05-06T21:26:48.315 INFO:tasks.workunit.client.0.smithi032.stdout:5/741: symlink d0/d28/dad/le7 0 2024-05-06T21:26:48.315 INFO:tasks.workunit.client.0.smithi032.stdout:1/697: mknod db/d16/db8/ce0 0 2024-05-06T21:26:48.317 INFO:tasks.workunit.client.0.smithi032.stdout:3/800: creat d1/d4/da/d4e/d5e/d84/df2/d108/d74/db1/df6/f111 x:0 0 0 2024-05-06T21:26:48.317 INFO:tasks.workunit.client.0.smithi032.stdout:3/801: chown d1/d4/da/d4e/d5e/d84/df2/d108/fa1 984 1 2024-05-06T21:26:48.318 INFO:tasks.workunit.client.0.smithi032.stdout:3/802: readlink d1/d4/da/d4e/lc2 0 2024-05-06T21:26:48.319 INFO:tasks.workunit.client.1.smithi154.stdout:9/500: rename d5/d14/f1c to d5/d14/d87/d65/fb6 0 2024-05-06T21:26:48.319 INFO:tasks.workunit.client.1.smithi154.stdout:1/424: dwrite d6/db/d10/f33 [0,4194304] 0 2024-05-06T21:26:48.319 INFO:tasks.workunit.client.0.smithi032.stdout:4/788: mkdir d2/d2c/d31/d7c/dfa 0 2024-05-06T21:26:48.319 INFO:tasks.workunit.client.0.smithi032.stdout:4/789: creat d2/d16/d44/d45/ffb x:0 0 0 2024-05-06T21:26:48.320 INFO:tasks.workunit.client.0.smithi032.stdout:5/742: symlink d0/d24/d38/d37/d7b/le8 0 2024-05-06T21:26:48.320 INFO:tasks.workunit.client.0.smithi032.stdout:5/743: chown d0/d24/d38/d37/d7b/dc0/fc6 93654189 1 2024-05-06T21:26:48.320 INFO:tasks.workunit.client.0.smithi032.stdout:5/744: chown d0/d16/d2a/d5f/dca 3354 1 2024-05-06T21:26:48.320 INFO:tasks.workunit.client.0.smithi032.stdout:5/745: readlink d0/d16/d2a/d59/l74 0 2024-05-06T21:26:48.321 INFO:tasks.workunit.client.0.smithi032.stdout:3/803: mknod d1/c112 0 2024-05-06T21:26:48.321 INFO:tasks.workunit.client.1.smithi154.stdout:3/549: rename d0/da/d1a/d28/d2f to d0/da/d1a/d28/dbc 0 2024-05-06T21:26:48.321 INFO:tasks.workunit.client.1.smithi154.stdout:0/510: rmdir d6/dc/d40/d4a 39 2024-05-06T21:26:48.321 INFO:tasks.workunit.client.1.smithi154.stdout:0/511: write d6/dc/d44/f46 [1798904,37847] 0 2024-05-06T21:26:48.322 INFO:tasks.workunit.client.1.smithi154.stdout:0/512: write d6/dc/f33 [3671423,118509] 0 2024-05-06T21:26:48.323 INFO:tasks.workunit.client.1.smithi154.stdout:9/501: write d5/d14/d31/f5e [865301,94470] 0 2024-05-06T21:26:48.323 INFO:tasks.workunit.client.1.smithi154.stdout:9/502: getdents d5/d2e/d7f 0 2024-05-06T21:26:48.323 INFO:tasks.workunit.client.1.smithi154.stdout:9/503: readlink d5/d14/d87/d65/l7c 0 2024-05-06T21:26:48.323 INFO:tasks.workunit.client.1.smithi154.stdout:9/504: dread - d5/d20/d52/d59/f67 zero size 2024-05-06T21:26:48.323 INFO:tasks.workunit.client.0.smithi032.stdout:5/746: dread d0/d16/f85 [0,4194304] 0 2024-05-06T21:26:48.324 INFO:tasks.workunit.client.0.smithi032.stdout:1/698: dread db/d47/d4a/dcb/fd9 [0,4194304] 0 2024-05-06T21:26:48.325 INFO:tasks.workunit.client.1.smithi154.stdout:8/361: rename d3/d14/d1a/d29/d68/d26 to d3/d14/d1a/d29/d32/d40/d79 0 2024-05-06T21:26:48.326 INFO:tasks.workunit.client.0.smithi032.stdout:6/782: rename d8/dd/d18/d13/c27 to d8/dd/d18/ceb 0 2024-05-06T21:26:48.326 INFO:tasks.workunit.client.0.smithi032.stdout:3/804: dread d1/d4/da/d1d/f6e [0,4194304] 0 2024-05-06T21:26:48.328 INFO:tasks.workunit.client.0.smithi032.stdout:4/790: symlink d2/d16/d44/d74/def/lfc 0 2024-05-06T21:26:48.329 INFO:tasks.workunit.client.0.smithi032.stdout:4/791: stat d2/d16/d44/d74/d76/fed 0 2024-05-06T21:26:48.329 INFO:tasks.workunit.client.0.smithi032.stdout:4/792: chown d2/d16/d44/d74/d79/de6 442294 1 2024-05-06T21:26:48.329 INFO:tasks.workunit.client.0.smithi032.stdout:5/747: creat d0/d16/d2a/d5f/dca/fe9 x:0 0 0 2024-05-06T21:26:48.330 INFO:tasks.workunit.client.1.smithi154.stdout:1/425: dread d6/db/f34 [0,4194304] 0 2024-05-06T21:26:48.330 INFO:tasks.workunit.client.0.smithi032.stdout:1/699: dread db/d47/d4a/da4/da2/fb0 [0,4194304] 0 2024-05-06T21:26:48.331 INFO:tasks.workunit.client.0.smithi032.stdout:6/783: dread d8/dd/d18/d3b/db9/f9e [0,4194304] 0 2024-05-06T21:26:48.333 INFO:tasks.workunit.client.0.smithi032.stdout:4/793: mknod d2/d1e/d47/cfd 0 2024-05-06T21:26:48.333 INFO:tasks.workunit.client.0.smithi032.stdout:4/794: chown d2/d16/d44/d74/d79/de0 100143 1 2024-05-06T21:26:48.333 INFO:tasks.workunit.client.1.smithi154.stdout:0/513: creat d6/fa8 x:0 0 0 2024-05-06T21:26:48.333 INFO:tasks.workunit.client.1.smithi154.stdout:0/514: fdatasync d6/dc/f2f 0 2024-05-06T21:26:48.333 INFO:tasks.workunit.client.1.smithi154.stdout:0/515: write d6/dc/d39/fa1 [3997231,18770] 0 2024-05-06T21:26:48.333 INFO:tasks.workunit.client.1.smithi154.stdout:0/516: fdatasync d6/dc/d44/d36/f68 0 2024-05-06T21:26:48.334 INFO:tasks.workunit.client.0.smithi032.stdout:9/738: dwrite d1/d2f/fcf [0,4194304] 0 2024-05-06T21:26:48.334 INFO:tasks.workunit.client.0.smithi032.stdout:9/739: read - d1/d2f/da1/dc2/d64/d72/f88 zero size 2024-05-06T21:26:48.334 INFO:tasks.workunit.client.0.smithi032.stdout:9/740: chown d1 1 1 2024-05-06T21:26:48.335 INFO:tasks.workunit.client.1.smithi154.stdout:9/505: truncate d5/d20/d37/f5f 2568172 0 2024-05-06T21:26:48.335 INFO:tasks.workunit.client.1.smithi154.stdout:9/506: stat d5/f13 0 2024-05-06T21:26:48.340 INFO:tasks.workunit.client.0.smithi032.stdout:1/700: symlink db/d47/d4a/da4/le1 0 2024-05-06T21:26:48.340 INFO:tasks.workunit.client.0.smithi032.stdout:6/784: mkdir d8/d3d/d49/dec 0 2024-05-06T21:26:48.340 INFO:tasks.workunit.client.1.smithi154.stdout:8/362: creat d3/f7a x:0 0 0 2024-05-06T21:26:48.341 INFO:tasks.workunit.client.1.smithi154.stdout:8/363: readlink d3/l1d 0 2024-05-06T21:26:48.341 INFO:tasks.workunit.client.0.smithi032.stdout:4/795: mkdir d2/d16/d44/d74/dce/dfe 0 2024-05-06T21:26:48.341 INFO:tasks.workunit.client.0.smithi032.stdout:4/796: readlink d2/d1e/d47/l73 0 2024-05-06T21:26:48.342 INFO:tasks.workunit.client.1.smithi154.stdout:1/426: link d6/db/c4e d6/d3e/c7c 0 2024-05-06T21:26:48.342 INFO:tasks.workunit.client.1.smithi154.stdout:1/427: creat d6/db/d10/d26/f7d x:0 0 0 2024-05-06T21:26:48.343 INFO:tasks.workunit.client.1.smithi154.stdout:4/379: rmdir d0/d82 39 2024-05-06T21:26:48.344 INFO:tasks.workunit.client.0.smithi032.stdout:9/741: mkdir d1/d13/d34/d26/d39/dfa 0 2024-05-06T21:26:48.346 INFO:tasks.workunit.client.1.smithi154.stdout:2/383: dread db/d12/d19/f39 [0,4194304] 0 2024-05-06T21:26:48.347 INFO:tasks.workunit.client.1.smithi154.stdout:2/384: readlink db/lf 0 2024-05-06T21:26:48.350 INFO:tasks.workunit.client.0.smithi032.stdout:9/742: unlink d1/d13/d34/c30 0 2024-05-06T21:26:48.356 INFO:tasks.workunit.client.0.smithi032.stdout:9/743: dread d1/d13/d34/d26/d39/d45/f52 [0,4194304] 0 2024-05-06T21:26:48.356 INFO:tasks.workunit.client.0.smithi032.stdout:9/744: creat d1/d13/d33/d8e/ffb x:0 0 0 2024-05-06T21:26:48.357 INFO:tasks.workunit.client.0.smithi032.stdout:9/745: fsync d1/d2f/d4f/d97/fe5 0 2024-05-06T21:26:48.368 INFO:tasks.workunit.client.0.smithi032.stdout:8/913: dwrite d0/d1b/fa4 [0,4194304] 0 2024-05-06T21:26:48.369 INFO:tasks.workunit.client.1.smithi154.stdout:4/380: write d0/d2/d47/f6d [427948,60138] 0 2024-05-06T21:26:48.369 INFO:tasks.workunit.client.0.smithi032.stdout:9/746: stat d1/d2f/da1/dc2/d64/l93 0 2024-05-06T21:26:48.369 INFO:tasks.workunit.client.0.smithi032.stdout:9/747: stat d1/d13/d34/d26/d39/d45/c5d 0 2024-05-06T21:26:48.371 INFO:tasks.workunit.client.0.smithi032.stdout:8/914: getdents d0/d1c/d5e/d67/d9d 0 2024-05-06T21:26:48.372 INFO:tasks.workunit.client.0.smithi032.stdout:9/748: rename d1/d13/d34/d26/d49/ld3 to d1/d2f/da1/dc2/da0/lfc 0 2024-05-06T21:26:48.373 INFO:tasks.workunit.client.0.smithi032.stdout:9/749: chown d1/d13/d33/d8e/fd0 16686171 1 2024-05-06T21:26:48.377 INFO:tasks.workunit.client.0.smithi032.stdout:9/750: rename d1/d2f/da1/dc2/da0/fca to d1/d13/d33/d3f/ffd 0 2024-05-06T21:26:48.377 INFO:tasks.workunit.client.0.smithi032.stdout:9/751: fsync d1/d2f/da1/dc2/f74 0 2024-05-06T21:26:48.377 INFO:tasks.workunit.client.0.smithi032.stdout:9/752: fsync d1/d13/d34/fe4 0 2024-05-06T21:26:48.377 INFO:tasks.workunit.client.0.smithi032.stdout:9/753: creat d1/d13/d33/da6/ffe x:0 0 0 2024-05-06T21:26:48.377 INFO:tasks.workunit.client.0.smithi032.stdout:9/754: chown d1/d13/d34/dc6 164377966 1 2024-05-06T21:26:48.379 INFO:tasks.workunit.client.0.smithi032.stdout:2/599: dwrite df/d19/d1e/d35/dc5/d2e/d33/f1d [0,4194304] 0 2024-05-06T21:26:48.382 INFO:tasks.workunit.client.0.smithi032.stdout:9/755: mkdir d1/d13/d33/d3f/d60/dff 0 2024-05-06T21:26:48.382 INFO:tasks.workunit.client.0.smithi032.stdout:2/600: dread df/d19/d1e/d35/dc5/d2e/d33/f27 [0,4194304] 0 2024-05-06T21:26:48.386 INFO:tasks.workunit.client.1.smithi154.stdout:8/364: dread d3/f8 [4194304,4194304] 0 2024-05-06T21:26:48.386 INFO:tasks.workunit.client.1.smithi154.stdout:8/365: dread - d3/d14/d1a/d29/d3e/f52 zero size 2024-05-06T21:26:48.389 INFO:tasks.workunit.client.1.smithi154.stdout:8/366: symlink d3/d14/d1a/d29/l7b 0 2024-05-06T21:26:48.393 INFO:tasks.workunit.client.1.smithi154.stdout:4/381: dread d0/d10/d11/f17 [4194304,4194304] 0 2024-05-06T21:26:48.393 INFO:tasks.workunit.client.1.smithi154.stdout:8/367: link d3/c1f d3/d14/d1a/d29/d32/d40/d59/c7c 0 2024-05-06T21:26:48.393 INFO:tasks.workunit.client.1.smithi154.stdout:4/382: write d0/d2/dc/f18 [99855,14012] 0 2024-05-06T21:26:48.394 INFO:tasks.workunit.client.1.smithi154.stdout:8/368: truncate d3/d14/d1a/d29/d68/f23 3570632 0 2024-05-06T21:26:48.424 INFO:tasks.workunit.client.0.smithi032.stdout:0/678: dwrite d4/f3f [0,4194304] 0 2024-05-06T21:26:48.425 INFO:tasks.workunit.client.1.smithi154.stdout:4/383: write d0/d2/d29/f56 [2397357,110529] 0 2024-05-06T21:26:48.426 INFO:tasks.workunit.client.0.smithi032.stdout:0/679: mkdir d4/da/d14/d1a/dde 0 2024-05-06T21:26:48.434 INFO:tasks.workunit.client.1.smithi154.stdout:4/384: dread d0/d82/f77 [0,4194304] 0 2024-05-06T21:26:48.435 INFO:tasks.workunit.client.1.smithi154.stdout:4/385: symlink d0/d82/d44/d73/l84 0 2024-05-06T21:26:48.435 INFO:tasks.workunit.client.1.smithi154.stdout:4/386: chown d0/d2 6 1 2024-05-06T21:26:48.435 INFO:tasks.workunit.client.1.smithi154.stdout:4/387: stat d0/d82/d39/f4b 0 2024-05-06T21:26:48.435 INFO:tasks.workunit.client.1.smithi154.stdout:4/388: chown d0/d2/d47/l80 15 1 2024-05-06T21:26:48.441 INFO:tasks.workunit.client.1.smithi154.stdout:8/369: write d3/d14/d1a/d29/d43/f5d [152686,29849] 0 2024-05-06T21:26:48.441 INFO:tasks.workunit.client.1.smithi154.stdout:3/550: dwrite d0/da/db/dd/f3c [0,4194304] 0 2024-05-06T21:26:48.441 INFO:tasks.workunit.client.1.smithi154.stdout:8/370: write d3/d14/f19 [4285622,128739] 0 2024-05-06T21:26:48.441 INFO:tasks.workunit.client.1.smithi154.stdout:3/551: write d0/da/f70 [953992,64776] 0 2024-05-06T21:26:48.441 INFO:tasks.workunit.client.1.smithi154.stdout:3/552: readlink d0/l31 0 2024-05-06T21:26:48.441 INFO:tasks.workunit.client.1.smithi154.stdout:8/371: write d3/ff [4504042,99625] 0 2024-05-06T21:26:48.441 INFO:tasks.workunit.client.1.smithi154.stdout:8/372: creat d3/d14/d1a/d45/f7d x:0 0 0 2024-05-06T21:26:48.441 INFO:tasks.workunit.client.1.smithi154.stdout:8/373: creat d3/d14/d1a/d45/f7e x:0 0 0 2024-05-06T21:26:48.442 INFO:tasks.workunit.client.1.smithi154.stdout:2/385: dwrite db/de/f74 [0,4194304] 0 2024-05-06T21:26:48.442 INFO:tasks.workunit.client.1.smithi154.stdout:1/428: dwrite d6/f47 [0,4194304] 0 2024-05-06T21:26:48.443 INFO:tasks.workunit.client.0.smithi032.stdout:3/805: dwrite d1/d4/da/d1d/fb5 [0,4194304] 0 2024-05-06T21:26:48.443 INFO:tasks.workunit.client.1.smithi154.stdout:0/517: dwrite d6/dc/d40/d4a/d6c/f7b [0,4194304] 0 2024-05-06T21:26:48.444 INFO:tasks.workunit.client.0.smithi032.stdout:0/680: dread d4/da/d14/d1a/f1c [0,4194304] 0 2024-05-06T21:26:48.445 INFO:tasks.workunit.client.1.smithi154.stdout:4/389: dread d0/d2/dc/f20 [0,4194304] 0 2024-05-06T21:26:48.449 INFO:tasks.workunit.client.1.smithi154.stdout:3/553: mknod d0/da/db/d7c/d80/cbd 0 2024-05-06T21:26:48.449 INFO:tasks.workunit.client.1.smithi154.stdout:3/554: chown d0/da/d1a/c95 20724369 1 2024-05-06T21:26:48.451 INFO:tasks.workunit.client.0.smithi032.stdout:5/748: dwrite d0/d16/d2a/d5f/fcf [0,4194304] 0 2024-05-06T21:26:48.451 INFO:tasks.workunit.client.0.smithi032.stdout:3/806: rename d1/d4/db7 to d1/d4/da/d4e/d5e/d84/df2/d108/d74/db1/df1/d113 0 2024-05-06T21:26:48.451 INFO:tasks.workunit.client.0.smithi032.stdout:3/807: write d1/d2a/d71/d9d/ffa [708168,48962] 0 2024-05-06T21:26:48.451 INFO:tasks.workunit.client.0.smithi032.stdout:6/785: dwrite d8/dd/d1b/d35/f3f [0,4194304] 0 2024-05-06T21:26:48.452 INFO:tasks.workunit.client.1.smithi154.stdout:5/456: dwrite d2/d48/f7c [0,4194304] 0 2024-05-06T21:26:48.452 INFO:tasks.workunit.client.1.smithi154.stdout:5/457: creat d2/d6/dd/f92 x:0 0 0 2024-05-06T21:26:48.452 INFO:tasks.workunit.client.1.smithi154.stdout:2/386: link db/f71 db/d12/d4e/d55/f7a 0 2024-05-06T21:26:48.452 INFO:tasks.workunit.client.1.smithi154.stdout:2/387: chown db/de/d10/d18/l3b 111175 1 2024-05-06T21:26:48.452 INFO:tasks.workunit.client.1.smithi154.stdout:2/388: chown db/de/d16/d33/f79 19 1 2024-05-06T21:26:48.452 INFO:tasks.workunit.client.1.smithi154.stdout:2/389: truncate db/d12/f21 4987447 0 2024-05-06T21:26:48.453 INFO:tasks.workunit.client.0.smithi032.stdout:1/701: dwrite db/d16/f32 [0,4194304] 0 2024-05-06T21:26:48.453 INFO:tasks.workunit.client.0.smithi032.stdout:9/756: dwrite d1/ff6 [0,4194304] 0 2024-05-06T21:26:48.454 INFO:tasks.workunit.client.0.smithi032.stdout:3/808: rmdir d1/d2a 39 2024-05-06T21:26:48.454 INFO:tasks.workunit.client.0.smithi032.stdout:5/749: write d0/d16/d2a/d59/f5b [1203852,30261] 0 2024-05-06T21:26:48.454 INFO:tasks.workunit.client.0.smithi032.stdout:3/809: getdents d1/d4/da/d31/d9b 0 2024-05-06T21:26:48.454 INFO:tasks.workunit.client.0.smithi032.stdout:5/750: fsync d0/d24/d38/d37/da6/fd9 0 2024-05-06T21:26:48.454 INFO:tasks.workunit.client.0.smithi032.stdout:5/751: readlink d0/d28/lab 0 2024-05-06T21:26:48.455 INFO:tasks.workunit.client.0.smithi032.stdout:4/797: dwrite d2/d1e/f28 [4194304,4194304] 0 2024-05-06T21:26:48.455 INFO:tasks.workunit.client.0.smithi032.stdout:4/798: creat d2/d13/fff x:0 0 0 2024-05-06T21:26:48.455 INFO:tasks.workunit.client.0.smithi032.stdout:4/799: truncate d2/d1e/d47/ff5 153566 0 2024-05-06T21:26:48.455 INFO:tasks.workunit.client.1.smithi154.stdout:0/518: link d6/dc/d3c/l67 d6/dc/d40/d4a/d6c/d8a/la9 0 2024-05-06T21:26:48.456 INFO:tasks.workunit.client.1.smithi154.stdout:0/519: write d6/dc/d51/f55 [862350,56779] 0 2024-05-06T21:26:48.456 INFO:tasks.workunit.client.0.smithi032.stdout:6/786: mkdir d8/dd/d1b/ded 0 2024-05-06T21:26:48.456 INFO:tasks.workunit.client.0.smithi032.stdout:8/915: dwrite d0/f16 [0,4194304] 0 2024-05-06T21:26:48.457 INFO:tasks.workunit.client.1.smithi154.stdout:9/507: dwrite d5/d14/d87/f8f [0,4194304] 0 2024-05-06T21:26:48.457 INFO:tasks.workunit.client.1.smithi154.stdout:9/508: stat d5/d14/d3a/d71 0 2024-05-06T21:26:48.457 INFO:tasks.workunit.client.0.smithi032.stdout:2/601: dwrite df/d19/d1e/d71/d5f/d7d/d25/f50 [0,4194304] 0 2024-05-06T21:26:48.457 INFO:tasks.workunit.client.1.smithi154.stdout:4/390: rename d0/d82/d44/d73/f37 to d0/d82/d44/d73/d4a/d74/f85 0 2024-05-06T21:26:48.458 INFO:tasks.workunit.client.0.smithi032.stdout:1/702: symlink db/dc8/le2 0 2024-05-06T21:26:48.460 INFO:tasks.workunit.client.1.smithi154.stdout:3/555: link d0/da/db/d30/f98 d0/da/d1a/d28/d4d/fbe 0 2024-05-06T21:26:48.461 INFO:tasks.workunit.client.1.smithi154.stdout:3/556: chown d0/d2/d22/c33 207 1 2024-05-06T21:26:48.462 INFO:tasks.workunit.client.0.smithi032.stdout:9/757: mknod d1/d13/d34/d26/d39/d45/c100 0 2024-05-06T21:26:48.464 INFO:tasks.workunit.client.0.smithi032.stdout:3/810: rmdir d1/d4/da/d1d 39 2024-05-06T21:26:48.465 INFO:tasks.workunit.client.0.smithi032.stdout:9/758: write d1/d13/d34/d26/d39/d8b/f9d [218692,62122] 0 2024-05-06T21:26:48.466 INFO:tasks.workunit.client.1.smithi154.stdout:8/374: dread d3/d14/f19 [0,4194304] 0 2024-05-06T21:26:48.466 INFO:tasks.workunit.client.1.smithi154.stdout:9/509: dread d5/d14/d3a/fa1 [0,4194304] 0 2024-05-06T21:26:48.466 INFO:tasks.workunit.client.1.smithi154.stdout:8/375: write d3/d14/d1a/d45/f5f [5739,51451] 0 2024-05-06T21:26:48.466 INFO:tasks.workunit.client.0.smithi032.stdout:0/681: dread d4/fc [0,4194304] 0 2024-05-06T21:26:48.469 INFO:tasks.workunit.client.0.smithi032.stdout:6/787: creat d8/dd/d1b/fee x:0 0 0 2024-05-06T21:26:48.472 INFO:tasks.workunit.client.1.smithi154.stdout:2/390: symlink db/d12/l7b 0 2024-05-06T21:26:48.472 INFO:tasks.workunit.client.1.smithi154.stdout:2/391: write db/d12/d4e/d55/f7a [61357,87737] 0 2024-05-06T21:26:48.472 INFO:tasks.workunit.client.0.smithi032.stdout:8/916: unlink d0/d1b/d39/d93/fb3 0 2024-05-06T21:26:48.474 INFO:tasks.workunit.client.1.smithi154.stdout:0/520: rmdir d6/dc/d40/d5e 39 2024-05-06T21:26:48.478 INFO:tasks.workunit.client.0.smithi032.stdout:5/752: dread d0/d24/d26/d32/fb9 [0,4194304] 0 2024-05-06T21:26:48.478 INFO:tasks.workunit.client.0.smithi032.stdout:5/753: dread - d0/d24/d38/fd5 zero size 2024-05-06T21:26:48.478 INFO:tasks.workunit.client.0.smithi032.stdout:5/754: dread - d0/d28/dad/fbb zero size 2024-05-06T21:26:48.478 INFO:tasks.workunit.client.0.smithi032.stdout:5/755: readlink d0/d24/d38/d37/le2 0 2024-05-06T21:26:48.478 INFO:tasks.workunit.client.0.smithi032.stdout:5/756: write d0/fb [1985975,26664] 0 2024-05-06T21:26:48.483 INFO:tasks.workunit.client.0.smithi032.stdout:1/703: unlink db/cf 0 2024-05-06T21:26:48.486 INFO:tasks.workunit.client.1.smithi154.stdout:3/557: mkdir d0/da/d1a/dbf 0 2024-05-06T21:26:48.486 INFO:tasks.workunit.client.0.smithi032.stdout:3/811: rename d1/d4/da/d4e/d41/d45/f7e to d1/d2a/d71/f114 0 2024-05-06T21:26:48.489 INFO:tasks.workunit.client.1.smithi154.stdout:8/376: unlink d3/d14/c31 0 2024-05-06T21:26:48.489 INFO:tasks.workunit.client.1.smithi154.stdout:8/377: write d3/d14/f20 [1676920,38279] 0 2024-05-06T21:26:48.489 INFO:tasks.workunit.client.0.smithi032.stdout:0/682: link d4/d3e/d63/dca/l9f d4/da/d98/ldf 0 2024-05-06T21:26:48.491 INFO:tasks.workunit.client.0.smithi032.stdout:6/788: mknod d8/d3d/d49/cef 0 2024-05-06T21:26:48.494 INFO:tasks.workunit.client.0.smithi032.stdout:8/917: mknod d0/d1c/d5e/d67/dc3/d57/d5d/d63/c11e 0 2024-05-06T21:26:48.498 INFO:tasks.workunit.client.0.smithi032.stdout:1/704: creat db/d47/d4a/da4/d4f/dd0/fe3 x:0 0 0 2024-05-06T21:26:48.499 INFO:tasks.workunit.client.1.smithi154.stdout:2/392: symlink db/de/d6f/l7c 0 2024-05-06T21:26:48.499 INFO:tasks.workunit.client.0.smithi032.stdout:0/683: unlink d4/l9c 0 2024-05-06T21:26:48.499 INFO:tasks.workunit.client.0.smithi032.stdout:0/684: write d4/da/d16/fb3 [251796,46848] 0 2024-05-06T21:26:48.500 INFO:tasks.workunit.client.1.smithi154.stdout:0/521: rename d6/dc/d40/d4a/d6c/f7b to d6/dc/d44/d36/d89/faa 0 2024-05-06T21:26:48.501 INFO:tasks.workunit.client.0.smithi032.stdout:6/789: rename d8/c41 to d8/dd/d18/d3b/db9/cf0 0 2024-05-06T21:26:48.501 INFO:tasks.workunit.client.0.smithi032.stdout:6/790: readlink d8/d33/l7e 0 2024-05-06T21:26:48.501 INFO:tasks.workunit.client.0.smithi032.stdout:6/791: stat d8/d3d/d49/d6b/f9f 0 2024-05-06T21:26:48.501 INFO:tasks.workunit.client.1.smithi154.stdout:3/558: truncate d0/da/d1a/d28/f5b 4905515 0 2024-05-06T21:26:48.502 INFO:tasks.workunit.client.1.smithi154.stdout:3/559: dread - d0/da/d1a/d28/dbc/fa8 zero size 2024-05-06T21:26:48.502 INFO:tasks.workunit.client.0.smithi032.stdout:8/918: creat d0/d1c/d5e/d67/d9d/f11f x:0 0 0 2024-05-06T21:26:48.503 INFO:tasks.workunit.client.1.smithi154.stdout:3/560: write d0/da/d1a/d28/dbc/f9b [582288,52769] 0 2024-05-06T21:26:48.505 INFO:tasks.workunit.client.0.smithi032.stdout:0/685: rename d4/da/d16/fa0 to d4/d3e/fe0 0 2024-05-06T21:26:48.505 INFO:tasks.workunit.client.0.smithi032.stdout:0/686: creat d4/d3e/d63/d6c/d8f/fe1 x:0 0 0 2024-05-06T21:26:48.506 INFO:tasks.workunit.client.1.smithi154.stdout:2/393: truncate db/d12/d1d/f47 441359 0 2024-05-06T21:26:48.506 INFO:tasks.workunit.client.1.smithi154.stdout:3/561: link d0/da/d1a/d28/d17/db0/f77 d0/da/db/d52/fc0 0 2024-05-06T21:26:48.506 INFO:tasks.workunit.client.1.smithi154.stdout:3/562: creat d0/da/db/dd/d1c/d21/d37/fc1 x:0 0 0 2024-05-06T21:26:48.507 INFO:tasks.workunit.client.0.smithi032.stdout:1/705: read db/fb7 [4165581,102297] 0 2024-05-06T21:26:48.507 INFO:tasks.workunit.client.0.smithi032.stdout:1/706: fdatasync db/d37/f69 0 2024-05-06T21:26:48.507 INFO:tasks.workunit.client.1.smithi154.stdout:8/378: unlink d3/d14/d1a/d45/f7e 0 2024-05-06T21:26:48.507 INFO:tasks.workunit.client.1.smithi154.stdout:8/379: write d3/d38/f63 [969735,55295] 0 2024-05-06T21:26:48.508 INFO:tasks.workunit.client.0.smithi032.stdout:6/792: symlink d8/d3d/d73/lf1 0 2024-05-06T21:26:48.508 INFO:tasks.workunit.client.0.smithi032.stdout:6/793: dread - d8/dd/d18/d3b/d90/fc1 zero size 2024-05-06T21:26:48.508 INFO:tasks.workunit.client.0.smithi032.stdout:6/794: chown d8/dd/f12 86271031 1 2024-05-06T21:26:48.508 INFO:tasks.workunit.client.0.smithi032.stdout:6/795: dread - d8/d3d/d49/dad/fd7 zero size 2024-05-06T21:26:48.509 INFO:tasks.workunit.client.0.smithi032.stdout:6/796: fsync d8/dd/d1b/f9d 0 2024-05-06T21:26:48.509 INFO:tasks.workunit.client.0.smithi032.stdout:6/797: chown d8/le5 387560 1 2024-05-06T21:26:48.509 INFO:tasks.workunit.client.0.smithi032.stdout:6/798: readlink d8/dd/d18/d13/d7a/lca 0 2024-05-06T21:26:48.509 INFO:tasks.workunit.client.1.smithi154.stdout:2/394: dread db/d12/d1d/f48 [4194304,4194304] 0 2024-05-06T21:26:48.509 INFO:tasks.workunit.client.1.smithi154.stdout:2/395: dread - db/de/d16/f65 zero size 2024-05-06T21:26:48.511 INFO:tasks.workunit.client.0.smithi032.stdout:8/919: unlink d0/d1c/d5e/d67/f8d 0 2024-05-06T21:26:48.517 INFO:tasks.workunit.client.0.smithi032.stdout:1/707: rename db/d47/d4a/dcb/fd9 to db/d47/d4a/dcb/fe4 0 2024-05-06T21:26:48.518 INFO:tasks.workunit.client.0.smithi032.stdout:1/708: dread - db/d47/d4a/da4/d4f/dd0/fe3 zero size 2024-05-06T21:26:48.518 INFO:tasks.workunit.client.0.smithi032.stdout:1/709: chown db/d16/db8/ce0 26149 1 2024-05-06T21:26:48.521 INFO:tasks.workunit.client.0.smithi032.stdout:8/920: mknod d0/d1b/d47/d91/de5/c120 0 2024-05-06T21:26:48.523 INFO:tasks.workunit.client.0.smithi032.stdout:1/710: symlink db/d16/d5d/le5 0 2024-05-06T21:26:48.525 INFO:tasks.workunit.client.0.smithi032.stdout:8/921: symlink d0/d1c/d5e/d67/dfe/d104/l121 0 2024-05-06T21:26:48.526 INFO:tasks.workunit.client.0.smithi032.stdout:1/711: symlink db/d47/d4a/da4/d4f/dd0/le6 0 2024-05-06T21:26:48.527 INFO:tasks.workunit.client.0.smithi032.stdout:6/799: rename d8/dd/d18/d13/f28 to d8/dd/d18/d13/ff2 0 2024-05-06T21:26:48.528 INFO:tasks.workunit.client.0.smithi032.stdout:1/712: mkdir db/dc8/de7 0 2024-05-06T21:26:48.530 INFO:tasks.workunit.client.0.smithi032.stdout:1/713: creat db/d47/fe8 x:0 0 0 2024-05-06T21:26:48.532 INFO:tasks.workunit.client.0.smithi032.stdout:1/714: rename db/d47/d4a/da4/da2/fb9 to db/dc8/de7/fe9 0 2024-05-06T21:26:48.532 INFO:tasks.workunit.client.0.smithi032.stdout:1/715: truncate db/f27 5128309 0 2024-05-06T21:26:48.533 INFO:tasks.workunit.client.0.smithi032.stdout:1/716: rmdir db/d16/d5d/ddf 0 2024-05-06T21:26:48.534 INFO:tasks.workunit.client.0.smithi032.stdout:1/717: chown db/d37/d93 1293 1 2024-05-06T21:26:48.536 INFO:tasks.workunit.client.0.smithi032.stdout:1/718: getdents db/d16/d46/d57 0 2024-05-06T21:26:48.536 INFO:tasks.workunit.client.0.smithi032.stdout:1/719: readlink db/d47/d4a/da4/d4f/lbc 0 2024-05-06T21:26:48.556 INFO:tasks.workunit.client.1.smithi154.stdout:1/429: dwrite d6/db/d10/d15/f39 [0,4194304] 0 2024-05-06T21:26:48.559 INFO:tasks.workunit.client.1.smithi154.stdout:1/430: mkdir d6/d3e/d7e 0 2024-05-06T21:26:48.559 INFO:tasks.workunit.client.1.smithi154.stdout:1/431: truncate d6/db/d10/d15/f39 4768804 0 2024-05-06T21:26:48.561 INFO:tasks.workunit.client.0.smithi032.stdout:8/922: write d0/d1c/d5e/d67/dc3/d97/f98 [1021628,54747] 0 2024-05-06T21:26:48.562 INFO:tasks.workunit.client.0.smithi032.stdout:4/800: dwrite d2/d16/d44/d74/d79/fb9 [0,4194304] 0 2024-05-06T21:26:48.562 INFO:tasks.workunit.client.1.smithi154.stdout:1/432: link d6/db/d10/f35 d6/f7f 0 2024-05-06T21:26:48.563 INFO:tasks.workunit.client.0.smithi032.stdout:6/800: write d8/d3d/f89 [2234980,86688] 0 2024-05-06T21:26:48.564 INFO:tasks.workunit.client.1.smithi154.stdout:1/433: link d6/d3e/f75 d6/db/d74/f80 0 2024-05-06T21:26:48.565 INFO:tasks.workunit.client.1.smithi154.stdout:1/434: rename d6/db/d74 to d6/db/d74/d81 22 2024-05-06T21:26:48.565 INFO:tasks.workunit.client.1.smithi154.stdout:1/435: fdatasync d6/db/d10/d15/f39 0 2024-05-06T21:26:48.565 INFO:tasks.workunit.client.1.smithi154.stdout:1/436: creat d6/d3e/f82 x:0 0 0 2024-05-06T21:26:48.565 INFO:tasks.workunit.client.0.smithi032.stdout:8/923: getdents d0/d1b/d39/d93 0 2024-05-06T21:26:48.565 INFO:tasks.workunit.client.0.smithi032.stdout:8/924: chown d0/d1c/d5e/d67/dc3/d97/deb 12909218 1 2024-05-06T21:26:48.565 INFO:tasks.workunit.client.0.smithi032.stdout:8/925: fdatasync d0/d1c/f32 0 2024-05-06T21:26:48.565 INFO:tasks.workunit.client.0.smithi032.stdout:8/926: dread - d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/f8f zero size 2024-05-06T21:26:48.569 INFO:tasks.workunit.client.1.smithi154.stdout:1/437: link d6/d3e/l54 d6/db/d10/d15/d1d/d53/l83 0 2024-05-06T21:26:48.569 INFO:tasks.workunit.client.1.smithi154.stdout:1/438: readlink d6/db/d10/l70 0 2024-05-06T21:26:48.569 INFO:tasks.workunit.client.1.smithi154.stdout:1/439: chown d6/d3e/f72 1 1 2024-05-06T21:26:48.569 INFO:tasks.workunit.client.1.smithi154.stdout:1/440: dread - d6/db/f6f zero size 2024-05-06T21:26:48.569 INFO:tasks.workunit.client.1.smithi154.stdout:1/441: creat d6/db/d10/f84 x:0 0 0 2024-05-06T21:26:48.569 INFO:tasks.workunit.client.1.smithi154.stdout:4/391: dwrite d0/d2/f2b [4194304,4194304] 0 2024-05-06T21:26:48.570 INFO:tasks.workunit.client.1.smithi154.stdout:1/442: symlink d6/d3e/d7e/l85 0 2024-05-06T21:26:48.571 INFO:tasks.workunit.client.0.smithi032.stdout:9/759: dwrite d1/d13/d34/d26/d49/fea [0,4194304] 0 2024-05-06T21:26:48.572 INFO:tasks.workunit.client.0.smithi032.stdout:2/602: dwrite df/d19/d1e/d54/f59 [0,4194304] 0 2024-05-06T21:26:48.572 INFO:tasks.workunit.client.0.smithi032.stdout:9/760: dread d1/d2f/d4f/d97/fa4 [0,4194304] 0 2024-05-06T21:26:48.572 INFO:tasks.workunit.client.0.smithi032.stdout:5/757: dwrite d0/d16/d2a/d5f/dca/fa4 [0,4194304] 0 2024-05-06T21:26:48.573 INFO:tasks.workunit.client.1.smithi154.stdout:0/522: dwrite d6/dc/d42/f59 [0,4194304] 0 2024-05-06T21:26:48.574 INFO:tasks.workunit.client.1.smithi154.stdout:5/458: rmdir d2 39 2024-05-06T21:26:48.574 INFO:tasks.workunit.client.1.smithi154.stdout:2/396: dwrite db/de/d10/f30 [0,4194304] 0 2024-05-06T21:26:48.574 INFO:tasks.workunit.client.1.smithi154.stdout:2/397: chown db/de/d16/d33 0 1 2024-05-06T21:26:48.574 INFO:tasks.workunit.client.1.smithi154.stdout:2/398: fsync f0 0 2024-05-06T21:26:48.574 INFO:tasks.workunit.client.1.smithi154.stdout:8/380: dwrite d3/fb [0,4194304] 0 2024-05-06T21:26:48.574 INFO:tasks.workunit.client.1.smithi154.stdout:8/381: chown d3/d14/d1a/d29/d32/d40/d59/f41 110 1 2024-05-06T21:26:48.577 INFO:tasks.workunit.client.1.smithi154.stdout:4/392: creat d0/d2/d47/d81/f86 x:0 0 0 2024-05-06T21:26:48.577 INFO:tasks.workunit.client.1.smithi154.stdout:4/393: stat d0/f22 0 2024-05-06T21:26:48.577 INFO:tasks.workunit.client.0.smithi032.stdout:1/720: dwrite db/d16/f1e [0,4194304] 0 2024-05-06T21:26:48.581 INFO:tasks.workunit.client.1.smithi154.stdout:5/459: rename d2/d6/f61 to d2/d6/dd/d2a/d54/d43/f93 0 2024-05-06T21:26:48.582 INFO:tasks.workunit.client.0.smithi032.stdout:1/721: dread db/d47/d4a/f66 [0,4194304] 0 2024-05-06T21:26:48.583 INFO:tasks.workunit.client.1.smithi154.stdout:2/399: mkdir db/d12/d19/d7d 0 2024-05-06T21:26:48.585 INFO:tasks.workunit.client.1.smithi154.stdout:0/523: write d6/dc/d39/f3f [3959336,83674] 0 2024-05-06T21:26:48.586 INFO:tasks.workunit.client.1.smithi154.stdout:8/382: rename d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f51 to d3/d56/f7f 0 2024-05-06T21:26:48.587 INFO:tasks.workunit.client.0.smithi032.stdout:3/812: dwrite d1/d4/da/d31/d47/d4a/d68/fe6 [0,4194304] 0 2024-05-06T21:26:48.587 INFO:tasks.workunit.client.0.smithi032.stdout:4/801: write d2/d16/d44/d45/fb5 [2928838,61638] 0 2024-05-06T21:26:48.587 INFO:tasks.workunit.client.0.smithi032.stdout:3/813: readlink d1/d4/da/d1d/l51 0 2024-05-06T21:26:48.588 INFO:tasks.workunit.client.1.smithi154.stdout:7/303: sync 2024-05-06T21:26:48.589 INFO:tasks.workunit.client.1.smithi154.stdout:5/460: symlink d2/l94 0 2024-05-06T21:26:48.589 INFO:tasks.workunit.client.1.smithi154.stdout:5/461: chown d2/d3/d19/d23/c3f 164 1 2024-05-06T21:26:48.589 INFO:tasks.workunit.client.1.smithi154.stdout:5/462: stat d2/d6/dc/f30 0 2024-05-06T21:26:48.590 INFO:tasks.workunit.client.1.smithi154.stdout:2/400: mkdir db/de/d10/d7e 0 2024-05-06T21:26:48.593 INFO:tasks.workunit.client.1.smithi154.stdout:4/394: rename d0/d2/d29/l4f to d0/d2/d47/l87 0 2024-05-06T21:26:48.594 INFO:tasks.workunit.client.0.smithi032.stdout:8/927: dwrite d0/d1b/d47/f54 [0,4194304] 0 2024-05-06T21:26:48.595 INFO:tasks.workunit.client.1.smithi154.stdout:7/304: link d6/c1f d6/d42/c5f 0 2024-05-06T21:26:48.595 INFO:tasks.workunit.client.0.smithi032.stdout:9/761: mknod d1/d13/d34/d91/c101 0 2024-05-06T21:26:48.596 INFO:tasks.workunit.client.0.smithi032.stdout:9/762: read d1/d2f/da1/dc2/d59/fd4 [32539,69078] 0 2024-05-06T21:26:48.596 INFO:tasks.workunit.client.0.smithi032.stdout:2/603: getdents df/daf 0 2024-05-06T21:26:48.597 INFO:tasks.workunit.client.1.smithi154.stdout:4/395: mknod d0/d82/d3d/c88 0 2024-05-06T21:26:48.597 INFO:tasks.workunit.client.1.smithi154.stdout:4/396: truncate d0/d2/dc/f5c 4445139 0 2024-05-06T21:26:48.606 INFO:tasks.workunit.client.0.smithi032.stdout:8/928: write d0/d1c/fbb [3395880,81416] 0 2024-05-06T21:26:48.606 INFO:tasks.workunit.client.0.smithi032.stdout:3/814: rename d1/d4/lf to d1/d4/da/d4e/d41/d97/d67/l115 0 2024-05-06T21:26:48.607 INFO:tasks.workunit.client.1.smithi154.stdout:1/443: dwrite d6/d3e/f6d [0,4194304] 0 2024-05-06T21:26:48.608 INFO:tasks.workunit.client.0.smithi032.stdout:4/802: creat d2/d2c/d31/d7c/dfa/f100 x:0 0 0 2024-05-06T21:26:48.608 INFO:tasks.workunit.client.0.smithi032.stdout:4/803: dread - d2/d16/d44/d45/d4e/fdb zero size 2024-05-06T21:26:48.608 INFO:tasks.workunit.client.0.smithi032.stdout:4/804: write d2/d16/f5e [4506133,14200] 0 2024-05-06T21:26:48.608 INFO:tasks.workunit.client.0.smithi032.stdout:4/805: creat d2/d16/d44/d74/d79/d88/dd6/f101 x:0 0 0 2024-05-06T21:26:48.608 INFO:tasks.workunit.client.0.smithi032.stdout:4/806: write d2/d16/d44/d74/d79/de6/de8/d69/f8e [5179261,18100] 0 2024-05-06T21:26:48.608 INFO:tasks.workunit.client.0.smithi032.stdout:9/763: stat d1/d13/d34/d26/d39/lb0 0 2024-05-06T21:26:48.610 INFO:tasks.workunit.client.0.smithi032.stdout:2/604: creat df/d19/dbf/fd6 x:0 0 0 2024-05-06T21:26:48.610 INFO:tasks.workunit.client.1.smithi154.stdout:7/305: unlink d6/d20/f57 0 2024-05-06T21:26:48.610 INFO:tasks.workunit.client.1.smithi154.stdout:4/397: truncate d0/f23 1108559 0 2024-05-06T21:26:48.610 INFO:tasks.workunit.client.1.smithi154.stdout:4/398: write d0/d2/dc/f48 [145076,26753] 0 2024-05-06T21:26:48.610 INFO:tasks.workunit.client.1.smithi154.stdout:4/399: fsync d0/d2/dc/f16 0 2024-05-06T21:26:48.610 INFO:tasks.workunit.client.1.smithi154.stdout:4/400: chown d0/d10/d11/c5b 2 1 2024-05-06T21:26:48.611 INFO:tasks.workunit.client.0.smithi032.stdout:3/815: truncate d1/d4/da/d4e/d5e/f8a 563661 0 2024-05-06T21:26:48.611 INFO:tasks.workunit.client.0.smithi032.stdout:3/816: readlink d1/d4/da/d31/l3d 0 2024-05-06T21:26:48.616 INFO:tasks.workunit.client.0.smithi032.stdout:9/764: mkdir d1/d2f/da1/dc2/da0/d102 0 2024-05-06T21:26:48.789 INFO:tasks.workunit.client.0.smithi032.stdout:9/765: fdatasync d1/ff6 0 2024-05-06T21:26:48.789 INFO:tasks.workunit.client.0.smithi032.stdout:9/766: dread - d1/d2f/da1/dc2/da0/fb1 zero size 2024-05-06T21:26:48.790 INFO:tasks.workunit.client.0.smithi032.stdout:9/767: truncate d1/d2f/da1/dc2/d59/fd4 720591 0 2024-05-06T21:26:48.821 INFO:tasks.workunit.client.1.smithi154.stdout:4/401: rmdir d0/d10/d11 39 2024-05-06T21:26:48.821 INFO:tasks.workunit.client.1.smithi154.stdout:4/402: mknod d0/d10/c89 0 2024-05-06T21:26:48.821 INFO:tasks.workunit.client.1.smithi154.stdout:0/524: dwrite d6/dc/d51/d54/f74 [0,4194304] 0 2024-05-06T21:26:48.821 INFO:tasks.workunit.client.1.smithi154.stdout:7/306: dread d6/f10 [0,4194304] 0 2024-05-06T21:26:48.821 INFO:tasks.workunit.client.1.smithi154.stdout:4/403: link d0/f2e d0/d10/d11/d1a/f8a 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:4/404: truncate d0/f2e 679957 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:8/383: dwrite d3/d14/d1a/d29/d32/d40/d4b/f73 [0,4194304] 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:2/401: dwrite db/de/d10/f67 [0,4194304] 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:0/525: creat d6/dc/d40/d5e/fab x:0 0 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:0/526: write d6/dc/d40/d4a/da7/d70/f7e [3241771,100278] 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:7/307: mknod d6/d20/c60 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:4/405: unlink d0/d82/d44/l6c 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:6/278: sync 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:6/279: write d8/f31 [2271260,128022] 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:6/280: write d8/d11/f24 [9025803,127292] 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:0/527: mkdir d6/dc/d40/d4a/dac 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:7/308: symlink d6/d54/l61 0 2024-05-06T21:26:48.822 INFO:tasks.workunit.client.1.smithi154.stdout:2/402: write db/de/d16/f28 [1777691,91513] 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:2/403: creat db/f7f x:0 0 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:4/406: link d0/d10/f41 d0/d82/d39/d54/f8b 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:4/407: chown d0/d2/f8 1813 1 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:2/404: read db/d12/d19/d4b/f75 [941309,31069] 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:5/463: rename d2/d6 to d2/d3/d21/d95 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:6/281: rmdir d8/d11/d2d/d3d 39 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:7/309: truncate d6/de/f49 550241 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:5/464: mknod d2/d3/c96 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:4/408: rename d0/d10/d11/f17 to d0/d82/d44/d73/d4a/f8c 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:5/465: truncate d2/d3/d21/d22/d25/d37/f40 1168843 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:8/384: dwrite d3/d56/f71 [0,4194304] 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:2/405: rename db/de/d10/l15 to db/l80 0 2024-05-06T21:26:48.823 INFO:tasks.workunit.client.1.smithi154.stdout:4/409: mknod d0/d10/d11/d1a/d7e/c8d 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:5/466: link d2/d3/d19/d23/f86 d2/f97 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:5/467: rename d2/d3/d21/d22/f8e to d2/d3/d21/d95/dc/d71/f98 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:5/468: mknod d2/d3/d21/d95/dc/c99 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:5/469: fdatasync d2/d3/d21/d22/f6f 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:7/310: dwrite d6/de/f19 [0,4194304] 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:7/311: chown d6/de/d23/c3a 2 1 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:4/410: dwrite d0/d82/d39/f4b [0,4194304] 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:7/312: mknod d6/d20/d40/d52/c62 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:4/411: unlink d0/d10/l45 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:7/313: symlink d6/d46/l63 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:4/412: unlink d0/f2e 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:5/470: dwrite d2/d3/d21/d22/f36 [0,4194304] 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:7/314: rename d6/de/c4c to d6/de/d23/c64 0 2024-05-06T21:26:48.824 INFO:tasks.workunit.client.1.smithi154.stdout:7/315: write d6/de/d23/f28 [5050998,25404] 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:7/316: write d6/fd [293596,81319] 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:7/317: symlink d6/d20/d40/l65 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:7/318: chown d6/de 8968 1 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:8/385: write d3/d14/d1a/d29/d3e/f52 [4727568,129710] 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:8/386: link d3/f7a d3/d56/f80 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:5/471: dread d2/d3/d21/d95/f5f [0,4194304] 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:5/472: dread - d2/d3/d19/d23/f78 zero size 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:8/387: creat d3/d14/d1a/d29/d68/d61/f81 x:0 0 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:8/388: readlink d3/l6c 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:5/473: mkdir d2/d3/d21/d95/dc/d44/d9a 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:5/474: creat d2/d3/d19/d23/f9b x:0 0 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:5/475: creat d2/d3/d21/d95/dd/d2a/d8d/f9c x:0 0 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:4/413: dwrite d0/d2/f53 [0,4194304] 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:4/414: fdatasync d0/d82/f77 0 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:4/415: chown d0/f34 101075 1 2024-05-06T21:26:48.825 INFO:tasks.workunit.client.1.smithi154.stdout:5/476: getdents d2/d3 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:5/477: mknod d2/d3/d21/d95/dc/c9d 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:7/319: getdents d6/de/d23 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:8/389: write d3/f8 [3283507,129829] 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:4/416: dread d0/d10/f15 [4194304,4194304] 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:4/417: fsync d0/d10/d11/f21 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:4/418: chown d0/d82/d44/c7f 12 1 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:8/390: write d3/ff [3080226,11776] 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:7/320: read d6/de/f19 [1482977,31893] 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:5/478: dwrite d2/d3/d21/f26 [4194304,4194304] 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:5/479: creat d2/d3/d21/d95/dc/d68/f9e x:0 0 0 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:5/480: chown d2/d3/d21/d95/dc/d44 56 1 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:7/321: rmdir d6/de 39 2024-05-06T21:26:48.826 INFO:tasks.workunit.client.1.smithi154.stdout:7/322: write d6/d20/f1b [6175506,96360] 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:7/323: mknod d6/d46/d5c/c66 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:7/324: write d6/de/d23/f28 [6061892,33395] 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:7/325: rmdir d6/de/d21 39 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:5/481: dread d2/d3/d21/d22/d25/f32 [0,4194304] 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:4/419: dwrite d0/d82/f77 [0,4194304] 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:5/482: dwrite d2/d3/d21/d22/d25/d37/f6c [0,4194304] 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:7/326: dwrite d6/fd [4194304,4194304] 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:5/483: rename d2/d3/d21/d95/dd/d2a/d54/f7d to d2/d3/d21/d95/dd/d2a/d54/d43/f9f 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:7/327: symlink d6/de/d23/l67 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:5/484: symlink d2/d3/d19/d23/la0 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:5/485: write d2/d3/d21/d95/dd/d2a/d54/d43/f7b [403527,19423] 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:4/420: dwrite d0/d10/f38 [0,4194304] 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:5/486: symlink d2/d48/la1 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:7/328: dread d6/fd [0,4194304] 0 2024-05-06T21:26:48.827 INFO:tasks.workunit.client.1.smithi154.stdout:5/487: dwrite d2/d3/d19/d23/f84 [0,4194304] 0 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:2/605: rmdir df/d19/d1e/d71/d5f/d7d/d65/d78/da6 39 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:2/606: dread - df/f95 zero size 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:8/929: write d0/d1b/fa4 [3082454,73761] 0 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:8/930: chown d0/d1c/d5e/d67/dc3/d57/d5d/d63/laf 204629974 1 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:8/931: creat d0/d1c/d5e/f122 x:0 0 0 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:4/807: dread d2/d16/f41 [0,4194304] 0 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:7/775: sync 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:7/776: read db/d12/d16/f8a [3894064,118707] 0 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:4/808: mknod d2/d16/d44/d74/d76/d81/c102 0 2024-05-06T21:26:48.829 INFO:tasks.workunit.client.0.smithi032.stdout:8/932: dread d0/d1c/d5e/d67/dc3/f5b [0,4194304] 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:8/933: stat d0/d1b/d47/f54 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:7/777: dread db/d12/d49/d97/fcf [0,4194304] 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:7/778: chown db/d12/d16/d2a/d39/d3b/cc5 17 1 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:7/779: read - db/d89/daa/fad zero size 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:4/809: mknod d2/d16/d44/d74/d7e/c103 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:7/780: symlink db/d12/d87/db5/lf2 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:3/817: dread d1/d4/f52 [4194304,4194304] 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:1/722: dwrite db/d16/f33 [4194304,4194304] 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:8/934: rmdir d0/d1c/d5e/d67/dc3/de9 39 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:7/781: symlink db/d12/d87/lf3 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:2/607: write df/d19/d1e/d71/d5f/d7d/d25/f60 [4011312,42136] 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:5/758: dwrite d0/d24/d38/f30 [0,4194304] 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:5/759: fdatasync d0/d24/d38/d37/d7b/fc2 0 2024-05-06T21:26:48.830 INFO:tasks.workunit.client.0.smithi032.stdout:2/608: creat df/d19/dbf/fd7 x:0 0 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:3/818: dread d1/d4/da/d4e/d5e/d84/df2/fc7 [0,4194304] 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:2/609: rename df/c1b to df/d19/d1e/d35/dc5/d2e/dbe/cd8 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:3/819: dread d1/d4/da/d1d/f6e [0,4194304] 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:2/610: read df/d19/d1e/d35/dc5/d2e/d33/f24 [3151417,68104] 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:2/611: chown df/daf/fbd 35546 1 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:8/935: dread d0/d1c/f2d [0,4194304] 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:3/820: unlink d1/d4/d11/c60 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:3/821: chown d1/d4/da/d4e/d5e/d84/ce1 689 1 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:8/936: mknod d0/d1c/d5e/d67/dc3/d57/d5d/d63/d11a/c123 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:8/937: fsync d0/d1c/f22 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:8/938: mkdir d0/d1b/d47/d91/de5/d114/d124 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:8/939: truncate d0/d1c/fac 958503 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:4/810: dread d2/f6c [0,4194304] 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:4/811: stat d2/d16/d44/d45/d4e/fa9 0 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:4/812: dread - d2/d16/d44/d45/d4e/fbb zero size 2024-05-06T21:26:48.831 INFO:tasks.workunit.client.0.smithi032.stdout:8/940: fsync d0/d1c/d5e/f122 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:9/768: dwrite d1/d13/d33/d5e/d78/f83 [0,4194304] 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:8/941: creat d0/d1b/f125 x:0 0 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:1/723: dwrite db/d37/f69 [0,4194304] 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:5/760: dread d0/d16/d2f/d77/f7c [0,4194304] 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:5/761: chown d0/d16/d79/fa5 37956 1 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:5/762: readlink d0/d16/d2f/l4a 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:4/813: rename d2/d16/d44/d45/d4e/fa9 to d2/f104 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:9/769: unlink d1/d13/d33/d8e/fd0 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:4/814: read d2/d16/d44/d45/fbf [87210,111126] 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:1/724: rmdir db/d37/d93/ddc 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:5/763: mkdir d0/d16/d46/da9/dea 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:5/764: readlink d0/d16/d46/lc1 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:9/770: link d1/d2f/f37 d1/d2f/da1/dc2/d64/ddf/f103 0 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:9/771: read - d1/d2f/da1/dc2/d64/d72/f88 zero size 2024-05-06T21:26:48.832 INFO:tasks.workunit.client.0.smithi032.stdout:1/725: link db/d47/d4a/da4/fda db/dc8/de7/fea 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:7/782: dwrite db/fe3 [0,4194304] 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:5/765: rename d0/d28/dad/le7 to d0/d24/d38/d37/d7b/dc0/leb 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:5/766: write d0/d16/d46/da9/fc8 [912059,40352] 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:9/772: creat d1/d2f/d4f/d97/f104 x:0 0 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:9/773: dread - d1/d13/d33/d5e/ff2 zero size 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:4/815: truncate d2/f9 4659663 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:2/612: dwrite df/d19/d1e/d71/d5f/d7d/d25/f37 [4194304,4194304] 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:3/822: dwrite d1/d2a/f4c [0,4194304] 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:8/942: dwrite d0/d1c/d5e/d67/dc3/fe8 [0,4194304] 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:1/726: rmdir db/dc8 39 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:5/767: unlink d0/d28/cd1 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:9/774: symlink d1/d13/d33/d5e/d78/l105 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:2/613: mknod df/d19/d1e/d35/dc5/d2e/d33/cd9 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:3/823: creat d1/d4/d11/f116 x:0 0 0 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:3/824: chown d1/d4/da/d4e/d41/d97/d67/da6/c96 11142 1 2024-05-06T21:26:48.833 INFO:tasks.workunit.client.0.smithi032.stdout:3/825: chown d1/d4/da/d1d/dc0 16 1 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:8/943: link d0/d1b/d47/d91/da7/dc1/ce4 d0/d1c/d5e/d67/d7b/c126 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:8/944: dread d0/d1b/da8/fe7 [0,4194304] 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:1/727: creat db/d37/feb x:0 0 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:5/768: creat d0/d16/d2a/d52/fec x:0 0 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:9/775: mkdir d1/d2f/da1/dc2/da0/d102/d106 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:4/816: rename d2/d1e/c5d to d2/d16/c105 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:9/776: dread d1/d13/d33/d3f/f4e [4194304,4194304] 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:2/614: mknod df/d19/d1e/d71/d5f/d73/cda 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:8/945: write d0/d1c/fa2 [9600858,119283] 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:3/826: symlink d1/d4/da/d4e/d5e/d84/df2/df3/l117 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:3/827: fsync d1/d4/da/d1d/f6e 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:3/828: fdatasync d1/d4/da/d31/d47/d4a/d68/d7c/f90 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:3/829: readlink d1/d4/da/d4e/l28 0 2024-05-06T21:26:48.834 INFO:tasks.workunit.client.0.smithi032.stdout:1/728: truncate db/d16/f2c 3026803 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:1/729: fdatasync db/d37/feb 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:5/769: truncate d0/d16/f91 540924 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:9/777: creat d1/d13/d34/d26/d9f/f107 x:0 0 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:4/817: dread d2/d13/f56 [0,4194304] 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:8/946: creat d0/d1b/d47/d91/f127 x:0 0 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:3/830: rename d1/d4/da/d4e/d41/d97/d67/l115 to d1/d4/da/d4e/d5e/d84/df2/d108/d74/db1/l118 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:3/831: stat d1/d4/da/d4e/d5e/d84/df2/d108/d74/db1/df6/f111 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:1/730: mkdir db/d47/d4a/dcb/dec 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:1/731: stat db/d16/d46/d57/d58/d68/fb3 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:5/770: mkdir d0/d16/d2a/dc7/dd2/db1/ded 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:8/947: getdents d0/df1 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:3/832: symlink d1/d4/da/d31/l119 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:2/615: dwrite df/d19/d1e/d71/d5f/d7d/d25/f9d [0,4194304] 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:2/616: chown df/f8b 35614100 1 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:8/948: truncate d0/d1b/d47/f83 1966699 0 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:8/949: chown d0/d1c/d5e/la9 82471 1 2024-05-06T21:26:48.835 INFO:tasks.workunit.client.0.smithi032.stdout:8/950: truncate d0/d1b/d47/d91/f127 142830 0 2024-05-06T21:26:48.836 INFO:tasks.workunit.client.0.smithi032.stdout:8/951: symlink d0/d1b/da8/l128 0 2024-05-06T21:26:48.836 INFO:tasks.workunit.client.0.smithi032.stdout:5/771: dread d0/d24/d38/f3c [0,4194304] 0 2024-05-06T21:26:48.836 INFO:tasks.workunit.client.0.smithi032.stdout:5/772: creat d0/d28/dad/fee x:0 0 0 2024-05-06T21:26:48.836 INFO:tasks.workunit.client.0.smithi032.stdout:8/952: link d0/d1c/f24 d0/d1c/d5e/d67/f129 0 2024-05-06T21:26:48.837 INFO:tasks.workunit.client.0.smithi032.stdout:5/773: rename d0/d24/d26/d32/fd3 to d0/d24/d38/fef 0 2024-05-06T21:26:48.837 INFO:tasks.workunit.client.0.smithi032.stdout:8/953: rmdir d0 39 2024-05-06T21:26:48.837 INFO:tasks.workunit.client.0.smithi032.stdout:8/954: getdents d0/d1c/d5e/d67/d9d 0 2024-05-06T21:26:48.837 INFO:tasks.workunit.client.0.smithi032.stdout:8/955: write d0/d1b/d39/f81 [863562,39379] 0 2024-05-06T21:26:48.837 INFO:tasks.workunit.client.0.smithi032.stdout:8/956: mkdir d0/d1c/d5e/d67/d7b/d12a 0 2024-05-06T21:26:48.837 INFO:tasks.workunit.client.0.smithi032.stdout:8/957: mkdir d0/d1c/d5e/d67/dc3/db5/dd0/d12b 0 2024-05-06T21:26:48.847 INFO:tasks.workunit.client.1.smithi154.stdout:7/329: dwrite d6/f3b [4194304,4194304] 0 2024-05-06T21:26:48.847 INFO:tasks.workunit.client.1.smithi154.stdout:7/330: chown d6/de/d23/l27 925092540 1 2024-05-06T21:26:48.850 INFO:tasks.workunit.client.0.smithi032.stdout:5/774: read d0/d16/f1c [1746017,122368] 0 2024-05-06T21:26:48.850 INFO:tasks.workunit.client.1.smithi154.stdout:7/331: link d6/l16 d6/d20/l68 0 2024-05-06T21:26:48.850 INFO:tasks.workunit.client.1.smithi154.stdout:7/332: chown d6/d54/l61 41797 1 2024-05-06T21:26:48.850 INFO:tasks.workunit.client.1.smithi154.stdout:7/333: chown d6 428 1 2024-05-06T21:26:48.854 INFO:tasks.workunit.client.0.smithi032.stdout:5/775: rename d0/d24/d26/d3d to d0/d24/d38/d37/df0 0 2024-05-06T21:26:48.855 INFO:tasks.workunit.client.1.smithi154.stdout:5/488: dwrite d2/f1a [0,4194304] 0 2024-05-06T21:26:48.856 INFO:tasks.workunit.client.0.smithi032.stdout:4/818: dwrite d2/fa [0,4194304] 0 2024-05-06T21:26:48.858 INFO:tasks.workunit.client.0.smithi032.stdout:8/958: dwrite d0/d1c/d5e/fcb [0,4194304] 0 2024-05-06T21:26:48.858 INFO:tasks.workunit.client.0.smithi032.stdout:8/959: fdatasync d0/d1c/d5e/d67/dc3/f5b 0 2024-05-06T21:26:48.858 INFO:tasks.workunit.client.0.smithi032.stdout:3/833: dread d1/d4/da/d4e/d41/d43/fbb [0,4194304] 0 2024-05-06T21:26:48.858 INFO:tasks.workunit.client.0.smithi032.stdout:9/778: dwrite d1/d13/d33/d3f/d60/fb3 [0,4194304] 0 2024-05-06T21:26:48.861 INFO:tasks.workunit.client.0.smithi032.stdout:5/776: symlink d0/d24/d38/d37/d7b/dc0/lf1 0 2024-05-06T21:26:48.863 INFO:tasks.workunit.client.0.smithi032.stdout:4/819: rmdir d2/d13/daa/db8/de7 39 2024-05-06T21:26:48.868 INFO:tasks.workunit.client.1.smithi154.stdout:5/489: getdents d2/d3/d21/d95/dc 0 2024-05-06T21:26:48.869 INFO:tasks.workunit.client.0.smithi032.stdout:8/960: rmdir d0/d1c/d5e/d67/dfe 39 2024-05-06T21:26:48.875 INFO:tasks.workunit.client.0.smithi032.stdout:8/961: read d0/d1c/f2d [593988,9209] 0 2024-05-06T21:26:48.875 INFO:tasks.workunit.client.0.smithi032.stdout:4/820: getdents d2/d16/d44/d74 0 2024-05-06T21:26:48.877 INFO:tasks.workunit.client.0.smithi032.stdout:8/962: mknod d0/d1c/c12c 0 2024-05-06T21:26:48.880 INFO:tasks.workunit.client.0.smithi032.stdout:4/821: symlink d2/d16/d44/d74/l106 0 2024-05-06T21:26:48.882 INFO:tasks.workunit.client.0.smithi032.stdout:8/963: rmdir d0/d1b/d47/d91/da7/dc1/d112 0 2024-05-06T21:26:48.882 INFO:tasks.workunit.client.0.smithi032.stdout:8/964: dread - d0/d1c/f118 zero size 2024-05-06T21:26:48.882 INFO:tasks.workunit.client.0.smithi032.stdout:8/965: truncate d0/d1c/d5e/d67/dc3/db5/dd0/fd4 1017872 0 2024-05-06T21:26:48.884 INFO:tasks.workunit.client.0.smithi032.stdout:8/966: symlink d0/d1c/d5e/d67/l12d 0 2024-05-06T21:26:48.884 INFO:tasks.workunit.client.0.smithi032.stdout:8/967: chown d0/d1b/d39/f81 5201 1 2024-05-06T21:26:48.884 INFO:tasks.workunit.client.0.smithi032.stdout:8/968: stat d0/d1b 0 2024-05-06T21:26:48.886 INFO:tasks.workunit.client.0.smithi032.stdout:4/822: rename d2/d16/d44/d45/c83 to d2/d16/d44/d74/d76/c107 0 2024-05-06T21:26:48.887 INFO:tasks.workunit.client.0.smithi032.stdout:4/823: symlink d2/d16/d44/d45/l108 0 2024-05-06T21:26:48.888 INFO:tasks.workunit.client.0.smithi032.stdout:4/824: creat d2/d2c/d31/d7c/dfa/f109 x:0 0 0 2024-05-06T21:26:48.889 INFO:tasks.workunit.client.0.smithi032.stdout:4/825: write d2/d16/d44/d74/d79/fc6 [812202,51410] 0 2024-05-06T21:26:48.889 INFO:tasks.workunit.client.0.smithi032.stdout:4/826: chown d2/d16/d44/d74/d79/fb9 699650 1 2024-05-06T21:26:48.890 INFO:tasks.workunit.client.0.smithi032.stdout:4/827: creat d2/d16/d44/d74/d79/de6/de8/f10a x:0 0 0 2024-05-06T21:26:48.890 INFO:tasks.workunit.client.0.smithi032.stdout:4/828: chown d2/d13/daa/db8 0 1 2024-05-06T21:26:48.891 INFO:tasks.workunit.client.0.smithi032.stdout:4/829: symlink d2/d16/d44/d74/d79/de6/de8/dd8/l10b 0 2024-05-06T21:26:48.892 INFO:tasks.workunit.client.0.smithi032.stdout:8/969: dread d0/d1b/d47/d91/da7/fef [0,4194304] 0 2024-05-06T21:26:48.892 INFO:tasks.workunit.client.0.smithi032.stdout:4/830: write d2/d2c/d31/d7c/fa6 [593073,79547] 0 2024-05-06T21:26:48.896 INFO:tasks.workunit.client.0.smithi032.stdout:8/970: rmdir d0/d1c/d5e/d67/d7b 39 2024-05-06T21:26:48.898 INFO:tasks.workunit.client.1.smithi154.stdout:3/563: sync 2024-05-06T21:26:48.899 INFO:tasks.workunit.client.1.smithi154.stdout:3/564: getdents d0/da/db/d52/d75 0 2024-05-06T21:26:48.899 INFO:tasks.workunit.client.1.smithi154.stdout:3/565: creat d0/da/db/dd/d1c/fc2 x:0 0 0 2024-05-06T21:26:48.900 INFO:tasks.workunit.client.1.smithi154.stdout:3/566: mknod d0/da/db/d30/cc3 0 2024-05-06T21:26:48.906 INFO:tasks.workunit.client.1.smithi154.stdout:9/510: sync 2024-05-06T21:26:48.906 INFO:tasks.workunit.client.1.smithi154.stdout:1/444: sync 2024-05-06T21:26:48.906 INFO:tasks.workunit.client.1.smithi154.stdout:1/445: write d6/db/d10/f63 [2102710,96879] 0 2024-05-06T21:26:48.906 INFO:tasks.workunit.client.1.smithi154.stdout:1/446: write d6/d3e/f72 [2519664,108958] 0 2024-05-06T21:26:48.907 INFO:tasks.workunit.client.0.smithi032.stdout:9/779: dwrite d1/d2f/da1/dc2/f55 [0,4194304] 0 2024-05-06T21:26:48.908 INFO:tasks.workunit.client.1.smithi154.stdout:5/490: dwrite d2/d3/d21/d22/f2e [0,4194304] 0 2024-05-06T21:26:48.908 INFO:tasks.workunit.client.0.smithi032.stdout:5/777: dwrite d0/d16/d2a/d5f/dca/fa4 [0,4194304] 0 2024-05-06T21:26:48.909 INFO:tasks.workunit.client.1.smithi154.stdout:1/447: rmdir d6/db/d10/d26/d1b 39 2024-05-06T21:26:48.909 INFO:tasks.workunit.client.1.smithi154.stdout:7/334: dwrite d6/f10 [0,4194304] 0 2024-05-06T21:26:48.912 INFO:tasks.workunit.client.0.smithi032.stdout:9/780: mkdir d1/d13/d34/d26/d108 0 2024-05-06T21:26:48.912 INFO:tasks.workunit.client.0.smithi032.stdout:4/831: read d2/d1e/f80 [3543123,122268] 0 2024-05-06T21:26:48.913 INFO:tasks.workunit.client.1.smithi154.stdout:5/491: truncate d2/d3/f16 184787 0 2024-05-06T21:26:48.913 INFO:tasks.workunit.client.1.smithi154.stdout:5/492: truncate d2/d3/d21/d95/dc/d44/f5b 775761 0 2024-05-06T21:26:48.914 INFO:tasks.workunit.client.0.smithi032.stdout:8/971: read d0/d1c/d5e/d67/dc3/f62 [581442,23871] 0 2024-05-06T21:26:48.914 INFO:tasks.workunit.client.0.smithi032.stdout:5/778: truncate d0/f12 6015230 0 2024-05-06T21:26:48.918 INFO:tasks.workunit.client.1.smithi154.stdout:7/335: unlink d6/d54/l61 0 2024-05-06T21:26:48.918 INFO:tasks.workunit.client.1.smithi154.stdout:5/493: creat d2/d3/d21/fa2 x:0 0 0 2024-05-06T21:26:48.919 INFO:tasks.workunit.client.1.smithi154.stdout:5/494: write d2/d3/d21/fa2 [782751,18808] 0 2024-05-06T21:26:48.919 INFO:tasks.workunit.client.0.smithi032.stdout:9/781: symlink d1/d13/d33/d5e/l109 0 2024-05-06T21:26:48.919 INFO:tasks.workunit.client.1.smithi154.stdout:1/448: getdents d6/db/d10/d15 0 2024-05-06T21:26:48.920 INFO:tasks.workunit.client.1.smithi154.stdout:1/449: write d6/db/d10/d26/f7d [57704,81760] 0 2024-05-06T21:26:48.920 INFO:tasks.workunit.client.0.smithi032.stdout:4/832: chown d2/l1a 2490525 1 2024-05-06T21:26:48.922 INFO:tasks.workunit.client.1.smithi154.stdout:7/336: mkdir d6/de/d21/d69 0 2024-05-06T21:26:48.923 INFO:tasks.workunit.client.0.smithi032.stdout:8/972: mkdir d0/d12e 0 2024-05-06T21:26:48.924 INFO:tasks.workunit.client.1.smithi154.stdout:5/495: creat d2/d3/d21/d95/dc/d68/d69/fa3 x:0 0 0 2024-05-06T21:26:48.925 INFO:tasks.workunit.client.0.smithi032.stdout:4/833: dread d2/d16/d44/d74/d76/d81/f84 [0,4194304] 0 2024-05-06T21:26:48.925 INFO:tasks.workunit.client.1.smithi154.stdout:1/450: rmdir d6/db/d74 39 2024-05-06T21:26:48.927 INFO:tasks.workunit.client.1.smithi154.stdout:5/496: stat d2/d3/d21/d95/dd/c45 0 2024-05-06T21:26:48.927 INFO:tasks.workunit.client.0.smithi032.stdout:8/973: mkdir d0/d1c/d5e/d67/dc3/db5/dd0/d12f 0 2024-05-06T21:26:48.928 INFO:tasks.workunit.client.0.smithi032.stdout:8/974: dread - d0/d1c/d5e/d67/dc3/d57/d5d/d63/d7f/ff3 zero size 2024-05-06T21:26:48.928 INFO:tasks.workunit.client.1.smithi154.stdout:5/497: symlink d2/d3/d21/d95/dc/d44/la4 0 2024-05-06T21:26:48.929 INFO:tasks.workunit.client.0.smithi032.stdout:4/834: rename d2/d16/d44/d45/dc1/cc4 to d2/d16/d44/d74/d79/d88/dd6/c10c 0 2024-05-06T21:26:48.929 INFO:tasks.workunit.client.1.smithi154.stdout:3/567: dwrite d0/da/d1a/d28/dbc/d81/f6b [0,4194304] 0 2024-05-06T21:26:48.929 INFO:tasks.workunit.client.1.smithi154.stdout:3/568: dread - d0/da/db/dd/d1c/fc2 zero size 2024-05-06T21:26:48.931 INFO:tasks.workunit.client.1.smithi154.stdout:5/498: mkdir d2/da5 0 2024-05-06T21:26:48.931 INFO:tasks.workunit.client.1.smithi154.stdout:5/499: getdents d2/d3/d21/d95/dc 0 2024-05-06T21:26:48.932 INFO:tasks.workunit.client.0.smithi032.stdout:9/782: write d1/d13/d34/d26/f29 [432566,6163] 0 2024-05-06T21:26:48.934 INFO:tasks.workunit.client.0.smithi032.stdout:8/975: getdents d0/d1c 0 2024-05-06T21:26:48.934 INFO:tasks.workunit.client.0.smithi032.stdout:8/976: readlink d0/l2b 0 2024-05-06T21:26:48.935 INFO:tasks.workunit.client.1.smithi154.stdout:7/337: dread d6/d20/f1b [4194304,4194304] 0 2024-05-06T21:26:48.936 INFO:tasks.workunit.client.0.smithi032.stdout:4/835: mknod d2/d16/d44/d74/dce/dfe/c10d 0 2024-05-06T21:26:48.937 INFO:tasks.workunit.client.0.smithi032.stdout:4/836: creat d2/d16/d44/d74/d79/de6/de8/f10e x:0 0 0 2024-05-06T21:26:48.937 INFO:tasks.workunit.client.0.smithi032.stdout:4/837: stat d2/d13/daa/db8/de7/ca7 0 2024-05-06T21:26:48.937 INFO:tasks.workunit.client.0.smithi032.stdout:4/838: chown d2/d2c/d31/f91 891432 1 2024-05-06T21:26:48.940 INFO:tasks.workunit.client.1.smithi154.stdout:1/451: write d6/f47 [1313211,17136] 0 2024-05-06T21:26:48.942 INFO:tasks.workunit.client.0.smithi032.stdout:8/977: mknod d0/d1c/d5e/d67/dfe/c130 0 2024-05-06T21:26:48.944 INFO:tasks.workunit.client.1.smithi154.stdout:1/452: link d6/db/d74/l7a d6/db/d10/l86 0 2024-05-06T21:26:48.945 INFO:tasks.workunit.client.1.smithi154.stdout:3/569: write d0/da/db/dd/d1c/d21/f4e [6266070,31279] 0 2024-05-06T21:26:48.945 INFO:tasks.workunit.client.1.smithi154.stdout:5/500: dread d2/d3/d21/d95/dc/f15 [0,4194304] 0 2024-05-06T21:26:48.945 INFO:tasks.workunit.client.0.smithi032.stdout:4/839: truncate d2/f6c 3925426 0 2024-05-06T21:26:48.946 INFO:tasks.workunit.client.0.smithi032.stdout:5/779: dwrite d0/d4e/f68 [0,4194304] 0 2024-05-06T21:26:48.948 INFO:tasks.workunit.client.1.smithi154.stdout:7/338: write d6/f9 [1840590,130784] 0 2024-05-06T21:26:48.948 INFO:tasks.workunit.client.1.smithi154.stdout:3/570: creat d0/da/db/d52/d62/fc4 x:0 0 0 2024-05-06T21:26:48.948 INFO:tasks.workunit.client.1.smithi154.stdout:3/571: truncate d0/da/db/dd/d1c/d21/d37/fc1 354268 0 2024-05-06T21:26:48.948 INFO:tasks.workunit.client.1.smithi154.stdout:3/572: stat d0/da/d1a/d28/d17/db0/d76 0 2024-05-06T21:26:48.948 INFO:tasks.workunit.client.1.smithi154.stdout:3/573: truncate d0/da/d1a/d28/d17/f4f 925802 0 2024-05-06T21:26:48.948 INFO:tasks.workunit.client.1.smithi154.stdout:3/574: dread - d0/d2/fb6 zero size 2024-05-06T21:26:48.949 INFO:tasks.workunit.client.1.smithi154.stdout:5/501: mknod d2/d3/d21/d95/dd/d2a/d54/ca6 0 2024-05-06T21:26:48.950 INFO:tasks.workunit.client.1.smithi154.stdout:3/575: link d0/da/db/dd/d1c/d21/f4e d0/da/d1a/d28/dbc/d81/d48/da9/db3/fc5 0 2024-05-06T21:26:48.951 INFO:tasks.workunit.client.0.smithi032.stdout:5/780: symlink d0/d28/dad/lf2 0 2024-05-06T21:26:48.952 INFO:tasks.workunit.client.1.smithi154.stdout:5/502: link d2/d3/d21/d22/c89 d2/d3/d21/d95/dd/d2a/d54/ca7 0 2024-05-06T21:26:48.953 INFO:tasks.workunit.client.0.smithi032.stdout:8/978: getdents d0/d1c/d5e/d67/dc3/db5/dd0 0 2024-05-06T21:26:48.953 INFO:tasks.workunit.client.0.smithi032.stdout:8/979: creat d0/d1b/d47/d91/f131 x:0 0 0 2024-05-06T21:26:48.953 INFO:tasks.workunit.client.1.smithi154.stdout:9/511: dwrite d5/d20/d52/f78 [4194304,4194304] 0 2024-05-06T21:26:48.953 INFO:tasks.workunit.client.1.smithi154.stdout:9/512: write d5/f12 [1829679,1518] 0 2024-05-06T21:26:48.953 INFO:tasks.workunit.client.1.smithi154.stdout:9/513: write d5/d2e/d8b/fb2 [949618,52024] 0 2024-05-06T21:26:48.953 INFO:tasks.workunit.client.1.smithi154.stdout:9/514: chown d5/d20/d52/d6e/fae 16810 1 2024-05-06T21:26:48.954 INFO:tasks.workunit.client.0.smithi032.stdout:4/840: write d2/d16/d44/f5c [639376,23194] 0 2024-05-06T21:26:48.955 INFO:tasks.workunit.client.1.smithi154.stdout:3/576: symlink d0/da/db/dd/d1c/d21/d37/lc6 0 2024-05-06T21:26:48.955 INFO:tasks.workunit.client.1.smithi154.stdout:3/577: creat d0/d2/fc7 x:0 0 0 2024-05-06T21:26:48.955 INFO:tasks.workunit.client.1.smithi154.stdout:3/578: fsync d0/fe 0 2024-05-06T21:26:48.955 INFO:tasks.workunit.client.1.smithi154.stdout:3/579: stat d0 0 2024-05-06T21:26:48.955 INFO:tasks.workunit.client.1.smithi154.stdout:5/503: symlink d2/d3/la8 0 2024-05-06T21:26:48.955 INFO:tasks.workunit.client.0.smithi032.stdout:5/781: creat d0/d4e/ff3 x:0 0 0 2024-05-06T21:26:48.960 INFO:tasks.workunit.client.1.smithi154.stdout:1/453: write d6/d3e/f75 [1299156,84898] 0 2024-05-06T21:26:48.960 INFO:tasks.workunit.client.0.smithi032.stdout:8/980: mkdir d0/d1b/d47/d91/de5/d114/d132 0 2024-05-06T21:26:48.964 INFO:tasks.workunit.client.0.smithi032.stdout:4/841: mkdir d2/d13/daa/df4/d10f 0 2024-05-06T21:26:48.964 INFO:tasks.workunit.client.0.smithi032.stdout:9/783: dwrite d1/d13/d33/d5e/d78/fe3 [0,4194304] 0 2024-05-06T21:26:48.964 INFO:tasks.workunit.client.0.smithi032.stdout:9/784: write d1/f31 [5728260,43844] 0 2024-05-06T21:26:48.964 INFO:tasks.workunit.client.0.smithi032.stdout:9/785: chown d1/d13/d33/d3f/d60/fbd 130923 1 2024-05-06T21:26:48.969 INFO:tasks.workunit.client.0.smithi032.stdout:5/782: rename d0/d24/d38/d37/df0/d50/d5a/caf to d0/d16/d2a/dc7/dd2/de1/cf4 0 2024-05-06T21:26:48.969 INFO:tasks.workunit.client.1.smithi154.stdout:3/580: write d0/da/db/dd/d1c/d21/f4e [3575835,19445] 0 2024-05-06T21:26:48.972 INFO:tasks.workunit.client.1.smithi154.stdout:0/528: sync 2024-05-06T21:26:48.973 INFO:tasks.workunit.client.1.smithi154.stdout:5/504: write d2/d3/d21/d22/d25/d37/f6c [4065687,84371] 0 2024-05-06T21:26:48.975 INFO:tasks.workunit.client.1.smithi154.stdout:3/581: rename d0/d2/d22/f47 to d0/da/db/d52/fc8 0 2024-05-06T21:26:48.975 INFO:tasks.workunit.client.1.smithi154.stdout:3/582: write d0/d2/f45 [1576064,90306] 0 2024-05-06T21:26:48.975 INFO:tasks.workunit.client.1.smithi154.stdout:1/454: dread d6/f7f [0,4194304] 0 2024-05-06T21:26:48.977 INFO:tasks.workunit.client.1.smithi154.stdout:7/339: dwrite d6/de/f19 [0,4194304] 0 2024-05-06T21:26:48.977 INFO:tasks.workunit.client.1.smithi154.stdout:7/340: chown d6/de/d23/c64 11870 1 2024-05-06T21:26:48.977 INFO:tasks.workunit.client.0.smithi032.stdout:9/786: symlink d1/d2f/da1/dc2/d59/l10a 0 2024-05-06T21:26:48.978 INFO:tasks.workunit.client.1.smithi154.stdout:5/505: unlink d2/d48/c5e 0 2024-05-06T21:26:48.979 INFO:tasks.workunit.client.1.smithi154.stdout:9/515: dwrite d5/d20/f2c [0,4194304] 0 2024-05-06T21:26:48.980 INFO:tasks.workunit.client.1.smithi154.stdout:1/455: mkdir d6/db/d87 0 2024-05-06T21:26:48.981 INFO:tasks.workunit.client.1.smithi154.stdout:3/583: dread d0/da/f18 [0,4194304] 0 2024-05-06T21:26:48.983 INFO:tasks.workunit.client.1.smithi154.stdout:9/516: dread d5/d2e/f35 [0,4194304] 0 2024-05-06T21:26:48.984 INFO:tasks.workunit.client.1.smithi154.stdout:0/529: rename d6/dc/d39/f58 to d6/dc/d44/d9f/fad 0 2024-05-06T21:26:48.984 INFO:tasks.workunit.client.1.smithi154.stdout:0/530: creat d6/d27/fae x:0 0 0 2024-05-06T21:26:48.986 INFO:tasks.workunit.client.0.smithi032.stdout:9/787: mknod d1/d13/d34/d26/d39/d8b/c10b 0 2024-05-06T21:26:48.986 INFO:tasks.workunit.client.0.smithi032.stdout:5/783: rmdir d0/d16/d46/da9 39 2024-05-06T21:26:48.986 INFO:tasks.workunit.client.0.smithi032.stdout:5/784: chown d0/d16/fce 12441 1 2024-05-06T21:26:48.988 INFO:tasks.workunit.client.0.smithi032.stdout:5/785: truncate d0/d24/d38/d37/df0/d50/f65 4179881 0 2024-05-06T21:26:48.989 INFO:tasks.workunit.client.1.smithi154.stdout:7/341: dread d6/de/f19 [0,4194304] 0 2024-05-06T21:26:48.989 INFO:tasks.workunit.client.1.smithi154.stdout:7/342: chown d6/c2b 409900170 1 2024-05-06T21:26:48.989 INFO:tasks.workunit.client.0.smithi032.stdout:5/786: creat d0/d24/d38/d37/d7b/ff5 x:0 0 0 2024-05-06T21:26:48.990 INFO:tasks.workunit.client.1.smithi154.stdout:9/517: creat d5/d14/d3a/d71/db1/fb7 x:0 0 0 2024-05-06T21:26:48.990 INFO:tasks.workunit.client.1.smithi154.stdout:9/518: write d5/d14/d87/d65/fa6 [1986015,88804] 0 2024-05-06T21:26:48.991 INFO:tasks.workunit.client.0.smithi032.stdout:5/787: mknod d0/d28/cf6 0 2024-05-06T21:26:48.991 INFO:tasks.workunit.client.1.smithi154.stdout:3/584: dread d0/fe [4194304,4194304] 0 2024-05-06T21:26:48.992 INFO:tasks.workunit.client.1.smithi154.stdout:5/506: write d2/d3/d21/d95/f13 [795493,130565] 0 2024-05-06T21:26:48.994 INFO:tasks.workunit.client.0.smithi032.stdout:0/687: sync 2024-05-06T21:26:48.994 INFO:tasks.workunit.client.0.smithi032.stdout:6/801: sync 2024-05-06T21:26:48.994 INFO:tasks.workunit.client.0.smithi032.stdout:6/802: write d8/dd/d18/d3b/db9/f65 [5970252,112807] 0 2024-05-06T21:26:48.995 INFO:tasks.workunit.client.0.smithi032.stdout:4/842: dwrite d2/d13/fe4 [0,4194304] 0 2024-05-06T21:26:48.995 INFO:tasks.workunit.client.0.smithi032.stdout:4/843: write d2/d13/daa/db8/de7/f9b [4476681,83435] 0 2024-05-06T21:26:48.996 INFO:tasks.workunit.client.0.smithi032.stdout:0/688: creat d4/fe2 x:0 0 0 2024-05-06T21:26:48.996 INFO:tasks.workunit.client.0.smithi032.stdout:0/689: stat d4/d3e/d63/d6c/d8f/fba 0 2024-05-06T21:26:48.997 INFO:tasks.workunit.client.1.smithi154.stdout:0/531: rename d6/dc/f64 to d6/dc/d44/d36/d89/faf 0 2024-05-06T21:26:48.997 INFO:tasks.workunit.client.1.smithi154.stdout:0/532: dread d6/dc/d44/d36/d89/faf [0,4194304] 0 2024-05-06T21:26:48.998 INFO:tasks.workunit.client.1.smithi154.stdout:7/343: mkdir d6/d54/d6a 0 2024-05-06T21:26:48.998 INFO:tasks.workunit.client.0.smithi032.stdout:6/803: rmdir d8/dd/d1b/ded 0 2024-05-06T21:26:49.001 INFO:tasks.workunit.client.1.smithi154.stdout:5/507: mknod d2/d3/ca9 0 2024-05-06T21:26:49.001 INFO:tasks.workunit.client.1.smithi154.stdout:5/508: write d2/f6e [857582,117538] 0 2024-05-06T21:26:49.002 INFO:tasks.workunit.client.1.smithi154.stdout:4/421: sync 2024-05-06T21:26:49.002 INFO:tasks.workunit.client.1.smithi154.stdout:6/282: sync 2024-05-06T21:26:49.002 INFO:tasks.workunit.client.1.smithi154.stdout:3/585: rename d0/da/db/d30/db4 to d0/da/db/dd/d1c/d90/dc9 0 2024-05-06T21:26:49.002 INFO:tasks.workunit.client.1.smithi154.stdout:8/391: sync 2024-05-06T21:26:49.003 INFO:tasks.workunit.client.1.smithi154.stdout:9/519: dread d5/d14/f60 [0,4194304] 0 2024-05-06T21:26:49.004 INFO:tasks.workunit.client.0.smithi032.stdout:0/690: creat d4/fe3 x:0 0 0 2024-05-06T21:26:49.004 INFO:tasks.workunit.client.0.smithi032.stdout:0/691: fdatasync d4/d3e/d63/d6c/d8f/fe1 0 2024-05-06T21:26:49.005 INFO:tasks.workunit.client.1.smithi154.stdout:2/406: sync 2024-05-06T21:26:49.005 INFO:tasks.workunit.client.1.smithi154.stdout:2/407: dread - db/d12/d19/f56 zero size 2024-05-06T21:26:49.006 INFO:tasks.workunit.client.0.smithi032.stdout:6/804: symlink d8/d3d/d49/dad/lf3 0 2024-05-06T21:26:49.006 INFO:tasks.workunit.client.1.smithi154.stdout:5/509: symlink d2/laa 0 2024-05-06T21:26:49.008 INFO:tasks.workunit.client.0.smithi032.stdout:0/692: mkdir d4/d3e/d63/d6c/d8f/dc2/de4 0 2024-05-06T21:26:49.010 INFO:tasks.workunit.client.0.smithi032.stdout:9/788: dread d1/d2f/da1/dc2/d59/f82 [0,4194304] 0 2024-05-06T21:26:49.011 INFO:tasks.workunit.client.0.smithi032.stdout:6/805: rename d8/dd/d1b/d35/l8b to d8/d3d/lf4 0 2024-05-06T21:26:49.011 INFO:tasks.workunit.client.0.smithi032.stdout:6/806: truncate d8/d3d/d49/fa9 1423086 0 2024-05-06T21:26:49.012 INFO:tasks.workunit.client.1.smithi154.stdout:1/456: dwrite d6/db/f34 [0,4194304] 0 2024-05-06T21:26:49.012 INFO:tasks.workunit.client.1.smithi154.stdout:1/457: creat d6/d3e/f88 x:0 0 0 2024-05-06T21:26:49.012 INFO:tasks.workunit.client.1.smithi154.stdout:6/283: dread d8/f23 [0,4194304] 0 2024-05-06T21:26:49.012 INFO:tasks.workunit.client.1.smithi154.stdout:6/284: write d8/d13/f3f [4469043,68957] 0 2024-05-06T21:26:49.012 INFO:tasks.workunit.client.1.smithi154.stdout:6/285: chown d8/d11/f1d 226675442 1 2024-05-06T21:26:49.012 INFO:tasks.workunit.client.1.smithi154.stdout:6/286: chown d8/d13/l38 433 1 2024-05-06T21:26:49.013 INFO:tasks.workunit.client.0.smithi032.stdout:9/789: mknod d1/d2f/da1/dc2/d64/d72/c10c 0 2024-05-06T21:26:49.013 INFO:tasks.workunit.client.0.smithi032.stdout:9/790: write d1/d2f/da1/dc2/da0/fb1 [166165,127209] 0 2024-05-06T21:26:49.013 INFO:tasks.workunit.client.0.smithi032.stdout:9/791: creat d1/d2f/da1/dc2/d59/f10d x:0 0 0 2024-05-06T21:26:49.014 INFO:tasks.workunit.client.1.smithi154.stdout:3/586: creat d0/da/db/dd/d1c/d41/fca x:0 0 0 2024-05-06T21:26:49.014 INFO:tasks.workunit.client.1.smithi154.stdout:3/587: fsync d0/da/db/d52/fc8 0 2024-05-06T21:26:49.017 INFO:tasks.workunit.client.1.smithi154.stdout:9/520: mkdir d5/d14/daf/db8 0 2024-05-06T21:26:49.017 INFO:tasks.workunit.client.0.smithi032.stdout:0/693: rename d4/da/d14/d1a/f97 to d4/da/d14/fe5 0 2024-05-06T21:26:49.018 INFO:tasks.workunit.client.0.smithi032.stdout:5/788: write d0/d16/d2a/d5f/dca/fa4 [1450218,128544] 0 2024-05-06T21:26:49.018 INFO:tasks.workunit.client.0.smithi032.stdout:5/789: fdatasync d0/d16/d2a/d52/fec 0 2024-05-06T21:26:49.018 INFO:tasks.workunit.client.0.smithi032.stdout:5/790: truncate d0/f12 6557068 0 2024-05-06T21:26:49.023 INFO:tasks.workunit.client.0.smithi032.stdout:9/792: dread d1/d2f/da1/dc2/d59/f86 [0,4194304] 0 2024-05-06T21:26:49.023 INFO:tasks.workunit.client.0.smithi032.stdout:9/793: chown d1/d13/d34/d26/d39 39507 1 2024-05-06T21:26:49.023 INFO:tasks.workunit.client.0.smithi032.stdout:9/794: write d1/d2f/da1/dc2/da0/fb1 [913956,4007] 0 2024-05-06T21:26:49.023 INFO:tasks.workunit.client.0.smithi032.stdout:9/795: creat d1/d13/d33/da6/f10e x:0 0 0 2024-05-06T21:26:49.023 INFO:tasks.workunit.client.1.smithi154.stdout:7/344: dwrite d6/de/f19 [0,4194304] 0 2024-05-06T21:26:49.024 INFO:tasks.workunit.client.0.smithi032.stdout:9/796: rename d1/d13/d33/d8e/cd5 to d1/d13/d34/d91/c10f 0 2024-05-06T21:26:49.025 INFO:tasks.workunit.client.0.smithi032.stdout:9/797: creat d1/d13/d34/d26/d49/f110 x:0 0 0 2024-05-06T21:26:49.027 INFO:tasks.workunit.client.0.smithi032.stdout:4/844: write d2/d16/d44/d74/d79/fb9 [3691455,22873] 0 2024-05-06T21:26:49.027 INFO:tasks.workunit.client.0.smithi032.stdout:4/845: chown d2/d16/d44/d74/d79/d88/dd6/df2 2163 1 2024-05-06T21:26:49.028 INFO:tasks.workunit.client.1.smithi154.stdout:4/422: write d0/d10/d11/d1a/f28 [885139,95084] 0 2024-05-06T21:26:49.028 INFO:tasks.workunit.client.1.smithi154.stdout:4/423: chown d0/l5 481916 1 2024-05-06T21:26:49.035 INFO:tasks.workunit.client.1.smithi154.stdout:0/533: rmdir d6 39 2024-05-06T21:26:49.035 INFO:tasks.workunit.client.1.smithi154.stdout:5/510: rmdir d2/d3/d21/d95/dd/d2a/d54/d43 39 2024-05-06T21:26:49.036 INFO:tasks.workunit.client.0.smithi032.stdout:9/798: dread d1/d2f/da1/dc2/f4b [0,4194304] 0 2024-05-06T21:26:49.036 INFO:tasks.workunit.client.1.smithi154.stdout:4/424: dread d0/d2/dc/f20 [0,4194304] 0 2024-05-06T21:26:49.038 INFO:tasks.workunit.client.0.smithi032.stdout:9/799: dread d1/d2f/da1/dc2/d59/fd4 [0,4194304] 0 2024-05-06T21:26:49.039 INFO:tasks.workunit.client.1.smithi154.stdout:7/345: dread d6/de/f49 [0,4194304] 0 2024-05-06T21:26:49.039 INFO:tasks.workunit.client.1.smithi154.stdout:1/458: mkdir d6/db/d69/d89 0 2024-05-06T21:26:49.039 INFO:tasks.workunit.client.1.smithi154.stdout:1/459: stat d6/db/d10/d26/d1b/c36 0 2024-05-06T21:26:49.039 INFO:tasks.workunit.client.1.smithi154.stdout:1/460: chown d6/db/d10/l86 200691670 1 2024-05-06T21:26:49.039 INFO:tasks.workunit.client.1.smithi154.stdout:1/461: truncate d6/d3e/f88 929377 0 2024-05-06T21:26:49.039 INFO:tasks.workunit.client.0.smithi032.stdout:6/807: dwrite d8/dd/d1b/d35/db4/fcc [0,4194304] 0 2024-05-06T21:26:49.040 INFO:tasks.workunit.client.1.smithi154.stdout:6/287: unlink d8/f31 0 2024-05-06T21:26:49.040 INFO:tasks.workunit.client.1.smithi154.stdout:6/288: dread - d8/d11/d2d/d57/f5d zero size 2024-05-06T21:26:49.040 INFO:tasks.workunit.client.1.smithi154.stdout:6/289: write d8/f10 [1591448,121803] 0 2024-05-06T21:26:49.040 INFO:tasks.workunit.client.1.smithi154.stdout:3/588: creat d0/da/d1a/fcb x:0 0 0 2024-05-06T21:26:49.042 INFO:tasks.workunit.client.1.smithi154.stdout:9/521: readlink d5/d14/l46 0 2024-05-06T21:26:49.042 INFO:tasks.workunit.client.1.smithi154.stdout:9/522: truncate d5/d20/f4b 681200 0 2024-05-06T21:26:49.042 INFO:tasks.workunit.client.1.smithi154.stdout:9/523: fsync d5/d14/d31/f5e 0 2024-05-06T21:26:49.043 INFO:tasks.workunit.client.0.smithi032.stdout:9/800: rename d1/d2f/da1/dc2/d64/dd9 to d1/d2f/d4f/d97/d111 0 2024-05-06T21:26:49.043 INFO:tasks.workunit.client.1.smithi154.stdout:0/534: creat d6/dc/d39/fb0 x:0 0 0 2024-05-06T21:26:49.045 INFO:tasks.workunit.client.1.smithi154.stdout:4/425: creat d0/d82/d39/d63/f8e x:0 0 0 2024-05-06T21:26:49.045 INFO:tasks.workunit.client.1.smithi154.stdout:4/426: dread - d0/d2/f69 zero size 2024-05-06T21:26:49.045 INFO:tasks.workunit.client.1.smithi154.stdout:0/535: dread d6/dc/d44/d36/d89/faf [0,4194304] 0 2024-05-06T21:26:49.046 INFO:tasks.workunit.client.1.smithi154.stdout:1/462: truncate d6/d3e/f72 3404881 0 2024-05-06T21:26:49.046 INFO:tasks.workunit.client.1.smithi154.stdout:1/463: fsync d6/db/d10/d15/f4a 0 2024-05-06T21:26:49.047 INFO:tasks.workunit.client.1.smithi154.stdout:7/346: mknod d6/d20/c6b 0 2024-05-06T21:26:49.047 INFO:tasks.workunit.client.0.smithi032.stdout:6/808: rename d8/f2b to d8/dd/d18/d3b/ff5 0 2024-05-06T21:26:49.047 INFO:tasks.workunit.client.0.smithi032.stdout:6/809: stat d8/d3d/f4e 0 2024-05-06T21:26:49.048 INFO:tasks.workunit.client.1.smithi154.stdout:6/290: getdents d8/d11/d2d/d3d 0 2024-05-06T21:26:49.048 INFO:tasks.workunit.client.1.smithi154.stdout:6/291: chown d8/d11/d2d/d57/f5d 3217 1 2024-05-06T21:26:49.048 INFO:tasks.workunit.client.1.smithi154.stdout:6/292: write f1 [1758643,14587] 0 2024-05-06T21:26:49.048 INFO:tasks.workunit.client.0.smithi032.stdout:9/801: mkdir d1/d13/d33/d5e/d78/d112 0 2024-05-06T21:26:49.049 INFO:tasks.workunit.client.1.smithi154.stdout:3/589: creat d0/da/fcc x:0 0 0 2024-05-06T21:26:49.049 INFO:tasks.workunit.client.1.smithi154.stdout:3/590: chown d0/da/d1a/d28/dbc/d81/d48/da9/db3/fc5 3116531 1 2024-05-06T21:26:49.049 INFO:tasks.workunit.client.1.smithi154.stdout:3/591: dread - d0/da/db/d7c/d80/f9d zero size 2024-05-06T21:26:49.049 INFO:tasks.workunit.client.1.smithi154.stdout:3/592: chown d0/da/d1a/d28/f5a 836 1 2024-05-06T21:26:49.049 INFO:tasks.workunit.client.1.smithi154.stdout:3/593: truncate d0/da/fb1 720220 0 2024-05-06T21:26:49.049 INFO:tasks.workunit.client.1.smithi154.stdout:3/594: dread - d0/da/db/d7c/d80/f9d zero size 2024-05-06T21:26:49.049 INFO:tasks.workunit.client.1.smithi154.stdout:3/595: chown d0/d2/fb6 14826720 1 2024-05-06T21:26:49.049 INFO:tasks.workunit.client.1.smithi154.stdout:3/596: truncate d0/d2/f25 4519448 0 2024-05-06T21:26:49.050 INFO:tasks.workunit.client.1.smithi154.stdout:9/524: mknod d5/d20/d52/d59/cb9 0 2024-05-06T21:26:49.050 INFO:tasks.workunit.client.0.smithi032.stdout:6/810: mkdir d8/d3d/d49/df6 0 2024-05-06T21:26:49.050 INFO:tasks.workunit.client.0.smithi032.stdout:0/694: read d4/d3e/d63/d6c/f94 [2790674,46774] 0 2024-05-06T21:26:49.050 INFO:tasks.workunit.client.0.smithi032.stdout:0/695: chown d4 58158770 1 2024-05-06T21:26:49.051 INFO:tasks.workunit.client.1.smithi154.stdout:2/408: rmdir db/de/d16/d4f/d4c 0 2024-05-06T21:26:49.051 INFO:tasks.workunit.client.1.smithi154.stdout:2/409: readlink db/l3e 0 2024-05-06T21:26:49.052 INFO:tasks.workunit.client.1.smithi154.stdout:9/525: read d5/d14/d87/f9e [189682,53866] 0 2024-05-06T21:26:49.052 INFO:tasks.workunit.client.1.smithi154.stdout:4/427: mkdir d0/d2/d29/d8f 0 2024-05-06T21:26:49.055 INFO:tasks.workunit.client.1.smithi154.stdout:7/347: stat d6/d20/c18 0 2024-05-06T21:26:49.055 INFO:tasks.workunit.client.1.smithi154.stdout:1/464: creat d6/db/d87/f8a x:0 0 0 2024-05-06T21:26:49.056 INFO:tasks.workunit.client.1.smithi154.stdout:3/597: link d0/da/db/d52/d62/c6c d0/da/db/d52/ccd 0 2024-05-06T21:26:49.056 INFO:tasks.workunit.client.1.smithi154.stdout:3/598: dread - d0/da/fcc zero size 2024-05-06T21:26:49.056 INFO:tasks.workunit.client.1.smithi154.stdout:3/599: creat d0/da/db/dd/d1c/d21/d37/fce x:0 0 0 2024-05-06T21:26:49.057 INFO:tasks.workunit.client.1.smithi154.stdout:8/392: dwrite d3/d14/d1a/d45/f5a [0,4194304] 0 2024-05-06T21:26:49.057 INFO:tasks.workunit.client.1.smithi154.stdout:8/393: truncate d3/d14/d1a/d45/f7d 56044 0 2024-05-06T21:26:49.058 INFO:tasks.workunit.client.0.smithi032.stdout:0/696: symlink d4/da/d14/d1a/d66/dbc/le6 0 2024-05-06T21:26:49.062 INFO:tasks.workunit.client.1.smithi154.stdout:2/410: mkdir db/d12/d19/d81 0 2024-05-06T21:26:49.062 INFO:tasks.workunit.client.1.smithi154.stdout:9/526: mkdir d5/d14/d3a/d71/db1/dba 0 2024-05-06T21:26:49.064 INFO:tasks.workunit.client.0.smithi032.stdout:4/846: read d2/d1e/f25 [857669,56606] 0 2024-05-06T21:26:49.064 INFO:tasks.workunit.client.0.smithi032.stdout:4/847: fdatasync d2/d16/d44/d74/d79/f97 0 2024-05-06T21:26:49.064 INFO:tasks.workunit.client.0.smithi032.stdout:4/848: dread - d2/d16/d44/d45/ff0 zero size 2024-05-06T21:26:49.067 INFO:tasks.workunit.client.0.smithi032.stdout:4/849: unlink d2/d16/d44/d74/d79/de6/de8/d69/c7d 0 2024-05-06T21:26:49.068 INFO:tasks.workunit.client.0.smithi032.stdout:5/791: dwrite d0/d16/d2f/d77/f7c [0,4194304] 0 2024-05-06T21:26:49.068 INFO:tasks.workunit.client.0.smithi032.stdout:5/792: readlink d0/d24/d38/d37/le2 0 2024-05-06T21:26:49.068 INFO:tasks.workunit.client.0.smithi032.stdout:4/850: write d2/d1e/f28 [1248971,120397] 0 2024-05-06T21:26:49.068 INFO:tasks.workunit.client.0.smithi032.stdout:5/793: write d0/d16/d2a/d5f/dca/f45 [1237078,72921] 0 2024-05-06T21:26:49.069 INFO:tasks.workunit.client.1.smithi154.stdout:7/348: dread d6/de/f49 [0,4194304] 0 2024-05-06T21:26:49.069 INFO:tasks.workunit.client.1.smithi154.stdout:7/349: dread - d6/d20/d40/f50 zero size 2024-05-06T21:26:49.069 INFO:tasks.workunit.client.1.smithi154.stdout:8/394: rename d3/l1d to d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/l82 0 2024-05-06T21:26:49.069 INFO:tasks.workunit.client.1.smithi154.stdout:7/350: write d6/de/f49 [2912773,112486] 0 2024-05-06T21:26:49.069 INFO:tasks.workunit.client.1.smithi154.stdout:7/351: write d6/de/f19 [4617059,64490] 0 2024-05-06T21:26:49.069 INFO:tasks.workunit.client.1.smithi154.stdout:9/527: rmdir d5/d20/d52/d59 39 2024-05-06T21:26:49.071 INFO:tasks.workunit.client.1.smithi154.stdout:8/395: truncate d3/f9 4308422 0 2024-05-06T21:26:49.073 INFO:tasks.workunit.client.1.smithi154.stdout:6/293: fsync d8/f2c 0 2024-05-06T21:26:49.073 INFO:tasks.workunit.client.1.smithi154.stdout:6/294: chown d8/d11/d2d/d3d/d4c/f58 343 1 2024-05-06T21:26:49.074 INFO:tasks.workunit.client.1.smithi154.stdout:7/352: mkdir d6/d42/d6c 0 2024-05-06T21:26:49.074 INFO:tasks.workunit.client.1.smithi154.stdout:5/511: dwrite d2/d3/d21/d95/dc/f66 [0,4194304] 0 2024-05-06T21:26:49.074 INFO:tasks.workunit.client.1.smithi154.stdout:9/528: rmdir d5/d20/d37 39 2024-05-06T21:26:49.081 INFO:tasks.workunit.client.1.smithi154.stdout:0/536: dwrite d6/f53 [0,4194304] 0 2024-05-06T21:26:49.082 INFO:tasks.workunit.client.1.smithi154.stdout:0/537: write d6/fa8 [306885,59549] 0 2024-05-06T21:26:49.082 INFO:tasks.workunit.client.1.smithi154.stdout:0/538: chown d6/dc/f33 15419 1 2024-05-06T21:26:49.082 INFO:tasks.workunit.client.1.smithi154.stdout:6/295: rmdir d8/d11/d2d/d59 0 2024-05-06T21:26:49.084 INFO:tasks.workunit.client.1.smithi154.stdout:8/396: write d3/f8 [4903489,23747] 0 2024-05-06T21:26:49.086 INFO:tasks.workunit.client.0.smithi032.stdout:9/802: dwrite d1/d13/d33/d8e/ffb [0,4194304] 0 2024-05-06T21:26:49.087 INFO:tasks.workunit.client.0.smithi032.stdout:0/697: dwrite d4/d3e/d63/dca/f9b [0,4194304] 0 2024-05-06T21:26:49.087 INFO:tasks.workunit.client.0.smithi032.stdout:0/698: write d4/da/d14/d1a/d66/f70 [91180,73025] 0 2024-05-06T21:26:49.087 INFO:tasks.workunit.client.0.smithi032.stdout:0/699: write d4/d3e/d63/f5c [4635981,90944] 0 2024-05-06T21:26:49.090 INFO:tasks.workunit.client.0.smithi032.stdout:9/803: mkdir d1/d2f/d113 0 2024-05-06T21:26:49.090 INFO:tasks.workunit.client.0.smithi032.stdout:9/804: creat d1/d2f/da1/dc2/d59/f114 x:0 0 0 2024-05-06T21:26:49.092 INFO:tasks.workunit.client.0.smithi032.stdout:0/700: rmdir d4/da/d14/d1a/d66/dbc 39 2024-05-06T21:26:49.092 INFO:tasks.workunit.client.0.smithi032.stdout:0/701: chown d4/da/d16/d33/d9e/dc9/dcb 5976 1 2024-05-06T21:26:49.094 INFO:tasks.workunit.client.0.smithi032.stdout:9/805: symlink d1/d2f/d4f/d97/d111/l115 0 2024-05-06T21:26:49.095 INFO:tasks.workunit.client.1.smithi154.stdout:5/512: mkdir d2/d3/d21/d95/dc/d44/d9a/dab 0 2024-05-06T21:26:49.095 INFO:tasks.workunit.client.0.smithi032.stdout:5/794: dwrite d0/d24/d38/f9c [0,4194304] 0 2024-05-06T21:26:49.095 INFO:tasks.workunit.client.0.smithi032.stdout:5/795: read d0/d24/d38/f3c [1421624,39587] 0 2024-05-06T21:26:49.095 INFO:tasks.workunit.client.0.smithi032.stdout:9/806: symlink d1/d13/d34/d26/d39/d8b/df1/l116 0 2024-05-06T21:26:49.098 INFO:tasks.workunit.client.0.smithi032.stdout:5/796: mknod d0/d16/d46/da9/cf7 0 2024-05-06T21:26:49.098 INFO:tasks.workunit.client.0.smithi032.stdout:6/811: dwrite d8/dd/d1b/d35/f43 [4194304,4194304] 0 2024-05-06T21:26:49.100 INFO:tasks.workunit.client.1.smithi154.stdout:9/529: truncate d5/d20/d37/f5b 1570043 0 2024-05-06T21:26:49.101 INFO:tasks.workunit.client.0.smithi032.stdout:5/797: rename d0/d28/lab to d0/d16/d46/d78/d89/lf8 0 2024-05-06T21:26:49.104 INFO:tasks.workunit.client.1.smithi154.stdout:0/539: creat d6/fb1 x:0 0 0 2024-05-06T21:26:49.110 INFO:tasks.workunit.client.0.smithi032.stdout:4/851: dwrite d2/d13/f1b [0,4194304] 0 2024-05-06T21:26:49.110 INFO:tasks.workunit.client.0.smithi032.stdout:4/852: write d2/d16/d44/d45/fb5 [3549909,3353] 0 2024-05-06T21:26:49.111 INFO:tasks.workunit.client.1.smithi154.stdout:6/296: unlink d8/d11/d2d/d3d/f3c 0 2024-05-06T21:26:49.113 INFO:tasks.workunit.client.0.smithi032.stdout:6/812: creat d8/dd/d18/dda/ff7 x:0 0 0 2024-05-06T21:26:49.113 INFO:tasks.workunit.client.0.smithi032.stdout:6/813: fsync d8/d3d/d49/dad/fd7 0 2024-05-06T21:26:49.115 INFO:tasks.workunit.client.0.smithi032.stdout:5/798: mkdir d0/d24/d26/df9 0 2024-05-06T21:26:49.115 INFO:tasks.workunit.client.0.smithi032.stdout:9/807: write d1/d2f/f3c [2997262,548] 0 2024-05-06T21:26:49.115 INFO:tasks.workunit.client.0.smithi032.stdout:9/808: chown d1/d2f/da1/dc2/cae 1604 1 2024-05-06T21:26:49.116 INFO:tasks.workunit.client.0.smithi032.stdout:4/853: rmdir d2/d16/d44/d74/d76/d81 39 2024-05-06T21:26:49.116 INFO:tasks.workunit.client.0.smithi032.stdout:4/854: fsync d2/d16/d44/d74/d79/de6/de8/d69/faf 0 2024-05-06T21:26:49.117 INFO:tasks.workunit.client.1.smithi154.stdout:3/600: rmdir d0/da/db/d52 39 2024-05-06T21:26:49.117 INFO:tasks.workunit.client.1.smithi154.stdout:2/411: dwrite db/f3c [0,4194304] 0 2024-05-06T21:26:49.117 INFO:tasks.workunit.client.1.smithi154.stdout:7/353: dwrite d6/d54/f58 [0,4194304] 0 2024-05-06T21:26:49.117 INFO:tasks.workunit.client.1.smithi154.stdout:3/601: creat d0/da/d1a/fcf x:0 0 0 2024-05-06T21:26:49.117 INFO:tasks.workunit.client.1.smithi154.stdout:7/354: truncate d6/f9 4410420 0 2024-05-06T21:26:49.117 INFO:tasks.workunit.client.1.smithi154.stdout:3/602: fdatasync d0/d2/d22/f8b 0 2024-05-06T21:26:49.118 INFO:tasks.workunit.client.0.smithi032.stdout:6/814: creat d8/dd/d18/d3b/d90/ff8 x:0 0 0 2024-05-06T21:26:49.118 INFO:tasks.workunit.client.0.smithi032.stdout:5/799: mknod d0/d24/d38/d37/df0/d50/d5a/cfa 0 2024-05-06T21:26:49.121 INFO:tasks.workunit.client.0.smithi032.stdout:6/815: mknod d8/d3d/d49/d6b/cf9 0 2024-05-06T21:26:49.123 INFO:tasks.workunit.client.1.smithi154.stdout:8/397: unlink d3/d14/d1a/d29/d32/d40/d4b/f73 0 2024-05-06T21:26:49.123 INFO:tasks.workunit.client.1.smithi154.stdout:8/398: fsync d3/d38/f63 0 2024-05-06T21:26:49.123 INFO:tasks.workunit.client.1.smithi154.stdout:8/399: write d3/d38/f63 [1650239,23677] 0 2024-05-06T21:26:49.129 INFO:tasks.workunit.client.1.smithi154.stdout:2/412: dread db/f13 [0,4194304] 0 2024-05-06T21:26:49.134 INFO:tasks.workunit.client.1.smithi154.stdout:1/465: dwrite d6/db/d10/d26/f23 [0,4194304] 0 2024-05-06T21:26:49.146 INFO:tasks.workunit.client.1.smithi154.stdout:9/530: dwrite d5/d20/d52/f78 [4194304,4194304] 0 2024-05-06T21:26:49.147 INFO:tasks.workunit.client.0.smithi032.stdout:0/702: dwrite d4/da/f17 [4194304,4194304] 0 2024-05-06T21:26:49.147 INFO:tasks.workunit.client.0.smithi032.stdout:0/703: chown d4/da/d14/d1a/d66/f87 223 1 2024-05-06T21:26:49.147 INFO:tasks.workunit.client.0.smithi032.stdout:0/704: read d4/da/d16/fb3 [294845,52047] 0 2024-05-06T21:26:49.148 INFO:tasks.workunit.client.0.smithi032.stdout:1/732: sync 2024-05-06T21:26:49.148 INFO:tasks.workunit.client.0.smithi032.stdout:7/783: sync 2024-05-06T21:26:49.148 INFO:tasks.workunit.client.1.smithi154.stdout:0/540: mkdir d6/dc/d40/d85/db2 0 2024-05-06T21:26:49.150 INFO:tasks.workunit.client.0.smithi032.stdout:0/705: dread d4/da/d14/d1a/d66/f70 [0,4194304] 0 2024-05-06T21:26:49.150 INFO:tasks.workunit.client.0.smithi032.stdout:1/733: symlink db/d16/d46/da1/led 0 2024-05-06T21:26:49.152 INFO:tasks.workunit.client.0.smithi032.stdout:0/706: rename d4/da/f11 to d4/d3e/fe7 0 2024-05-06T21:26:49.152 INFO:tasks.workunit.client.0.smithi032.stdout:7/784: symlink db/d12/d16/lf4 0 2024-05-06T21:26:49.153 INFO:tasks.workunit.client.0.smithi032.stdout:0/707: symlink d4/da/d14/d1a/d66/dbc/le8 0 2024-05-06T21:26:49.153 INFO:tasks.workunit.client.1.smithi154.stdout:6/297: rename d8/c4f to d8/d11/d51/c5f 0 2024-05-06T21:26:49.154 INFO:tasks.workunit.client.0.smithi032.stdout:0/708: link d4/l10 d4/da/d14/d1a/dde/le9 0 2024-05-06T21:26:49.155 INFO:tasks.workunit.client.0.smithi032.stdout:9/809: dwrite d1/ff6 [0,4194304] 0 2024-05-06T21:26:49.156 INFO:tasks.workunit.client.0.smithi032.stdout:9/810: readlink d1/d2f/l6a 0 2024-05-06T21:26:49.156 INFO:tasks.workunit.client.0.smithi032.stdout:9/811: read d1/f23 [87885,113987] 0 2024-05-06T21:26:49.156 INFO:tasks.workunit.client.0.smithi032.stdout:4/855: dwrite d2/d16/d44/d45/ffb [0,4194304] 0 2024-05-06T21:26:49.158 INFO:tasks.workunit.client.0.smithi032.stdout:2/617: sync 2024-05-06T21:26:49.158 INFO:tasks.workunit.client.0.smithi032.stdout:8/981: sync 2024-05-06T21:26:49.158 INFO:tasks.workunit.client.0.smithi032.stdout:3/834: sync 2024-05-06T21:26:49.161 INFO:tasks.workunit.client.0.smithi032.stdout:9/812: link d1/d13/d34/d26/d39/d45/ld7 d1/d2f/da1/dc2/da0/dd1/l117 0 2024-05-06T21:26:49.161 INFO:tasks.workunit.client.0.smithi032.stdout:9/813: fdatasync d1/d13/d34/d26/d39/d8b/f9d 0 2024-05-06T21:26:49.161 INFO:tasks.workunit.client.0.smithi032.stdout:9/814: dread - d1/d13/d33/da6/fb2 zero size 2024-05-06T21:26:49.161 INFO:tasks.workunit.client.0.smithi032.stdout:9/815: readlink d1/d2f/d4f/d97/d111/l115 0 2024-05-06T21:26:49.161 INFO:tasks.workunit.client.1.smithi154.stdout:7/355: symlink d6/de/d21/l6d 0 2024-05-06T21:26:49.162 INFO:tasks.workunit.client.1.smithi154.stdout:7/356: chown d6/d42/d6c 0 1 2024-05-06T21:26:49.162 INFO:tasks.workunit.client.0.smithi032.stdout:0/709: rename d4/da/d14/d4a/fa6 to d4/fea 0 2024-05-06T21:26:49.162 INFO:tasks.workunit.client.0.smithi032.stdout:0/710: chown d4/d3e/d63/d6c/d8f/lda 10803656 1 2024-05-06T21:26:49.162 INFO:tasks.workunit.client.0.smithi032.stdout:0/711: chown d4/da/d14/d4a/cd7 3758107 1 2024-05-06T21:26:49.163 INFO:tasks.workunit.client.1.smithi154.stdout:3/603: symlink d0/da/d1a/d28/dbc/d81/ld0 0 2024-05-06T21:26:49.163 INFO:tasks.workunit.client.1.smithi154.stdout:3/604: readlink d0/da/d1a/d28/la5 0 2024-05-06T21:26:49.165 INFO:tasks.workunit.client.0.smithi032.stdout:6/816: dwrite d8/dd/d18/d3b/d90/fcd [0,4194304] 0 2024-05-06T21:26:49.165 INFO:tasks.workunit.client.1.smithi154.stdout:8/400: mkdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d83 0 2024-05-06T21:26:49.166 INFO:tasks.workunit.client.0.smithi032.stdout:8/982: link d0/d1c/d5e/d67/dc3/d57/l10b d0/d1b/d47/d91/l133 0 2024-05-06T21:26:49.166 INFO:tasks.workunit.client.0.smithi032.stdout:0/712: dread d4/da/d14/d1a/fb6 [0,4194304] 0 2024-05-06T21:26:49.167 INFO:tasks.workunit.client.0.smithi032.stdout:9/816: link d1/fbb d1/d13/d34/d26/d49/f118 0 2024-05-06T21:26:49.168 INFO:tasks.workunit.client.0.smithi032.stdout:4/856: getdents d2/d16/d44/d74/d79/de6/de8 0 2024-05-06T21:26:49.169 INFO:tasks.workunit.client.1.smithi154.stdout:5/513: mknod d2/d3/d21/d22/d25/d37/cac 0 2024-05-06T21:26:49.170 INFO:tasks.workunit.client.1.smithi154.stdout:5/514: chown d2/d3/d21/d95/dd/f92 4713 1 2024-05-06T21:26:49.173 INFO:tasks.workunit.client.1.smithi154.stdout:7/357: dread d6/de/f31 [0,4194304] 0 2024-05-06T21:26:49.174 INFO:tasks.workunit.client.1.smithi154.stdout:2/413: link db/de/d16/d33/c6e db/de/d16/d33/c82 0 2024-05-06T21:26:49.175 INFO:tasks.workunit.client.0.smithi032.stdout:9/817: rename d1/d13/d34/d26/d39/d8b/le7 to d1/d13/d33/d5e/l119 0 2024-05-06T21:26:49.175 INFO:tasks.workunit.client.0.smithi032.stdout:9/818: fdatasync d1/d13/d33/d5e/d78/fdb 0 2024-05-06T21:26:49.175 INFO:tasks.workunit.client.0.smithi032.stdout:9/819: write d1/f31 [5078419,19197] 0 2024-05-06T21:26:49.175 INFO:tasks.workunit.client.1.smithi154.stdout:0/541: dwrite d6/dc/d44/f6d [0,4194304] 0 2024-05-06T21:26:49.176 INFO:tasks.workunit.client.0.smithi032.stdout:2/618: dread df/d19/d1e/d35/dc5/d2e/d33/f18 [0,4194304] 0 2024-05-06T21:26:49.176 INFO:tasks.workunit.client.0.smithi032.stdout:2/619: dread - df/d19/d1e/f99 zero size 2024-05-06T21:26:49.178 INFO:tasks.workunit.client.0.smithi032.stdout:9/820: rename d1/d2f/da1/dc2/ff3 to d1/d13/d34/d26/d39/d8b/f11a 0 2024-05-06T21:26:49.179 INFO:tasks.workunit.client.0.smithi032.stdout:7/785: dread db/d12/d16/d21/d41/d78/fb0 [0,4194304] 0 2024-05-06T21:26:49.179 INFO:tasks.workunit.client.0.smithi032.stdout:7/786: chown ca 6049 1 2024-05-06T21:26:49.179 INFO:tasks.workunit.client.0.smithi032.stdout:7/787: stat db/d12/d16/d2a/f42 0 2024-05-06T21:26:49.179 INFO:tasks.workunit.client.0.smithi032.stdout:7/788: creat db/d89/daa/ff5 x:0 0 0 2024-05-06T21:26:49.179 INFO:tasks.workunit.client.1.smithi154.stdout:1/466: symlink d6/db/d69/l8b 0 2024-05-06T21:26:49.180 INFO:tasks.workunit.client.0.smithi032.stdout:8/983: dread d0/d1c/f2d [0,4194304] 0 2024-05-06T21:26:49.185 INFO:tasks.workunit.client.1.smithi154.stdout:6/298: unlink d8/f2c 0 2024-05-06T21:26:49.188 INFO:tasks.workunit.client.0.smithi032.stdout:7/789: mknod db/d12/d49/d97/cf6 0 2024-05-06T21:26:49.190 INFO:tasks.workunit.client.0.smithi032.stdout:7/790: dread db/d12/f61 [0,4194304] 0 2024-05-06T21:26:49.190 INFO:tasks.workunit.client.0.smithi032.stdout:7/791: creat db/ff7 x:0 0 0 2024-05-06T21:26:49.192 INFO:tasks.workunit.client.0.smithi032.stdout:1/734: dwrite db/d16/d5d/fd8 [0,4194304] 0 2024-05-06T21:26:49.193 INFO:tasks.workunit.client.0.smithi032.stdout:7/792: dread db/d12/d16/d21/d41/d78/fb3 [0,4194304] 0 2024-05-06T21:26:49.193 INFO:tasks.workunit.client.0.smithi032.stdout:7/793: creat db/d12/d16/d2a/d39/d3b/d96/dcd/ff8 x:0 0 0 2024-05-06T21:26:49.194 INFO:tasks.workunit.client.0.smithi032.stdout:2/620: dread df/d19/d1e/d71/d5f/d7d/d65/d78/fd1 [0,4194304] 0 2024-05-06T21:26:49.194 INFO:tasks.workunit.client.0.smithi032.stdout:2/621: readlink df/d19/d1e/d35/l83 0 2024-05-06T21:26:49.201 INFO:tasks.workunit.client.1.smithi154.stdout:3/605: link d0/l58 d0/da/db/dd/d1c/d90/dc9/ld1 0 2024-05-06T21:26:49.201 INFO:tasks.workunit.client.1.smithi154.stdout:3/606: fsync d0/da/d1a/d28/dbc/fa8 0 2024-05-06T21:26:49.202 INFO:tasks.workunit.client.1.smithi154.stdout:5/515: fsync d2/d3/d21/d95/dd/d2a/d54/d43/d73/f82 0 2024-05-06T21:26:49.204 INFO:tasks.workunit.client.1.smithi154.stdout:1/467: getdents d6/d3e/d7e 0 2024-05-06T21:26:49.204 INFO:tasks.workunit.client.1.smithi154.stdout:1/468: dread - d6/db/d10/d15/f6e zero size 2024-05-06T21:26:49.205 INFO:tasks.workunit.client.0.smithi032.stdout:1/735: write db/dc8/de7/fe9 [391135,91089] 0 2024-05-06T21:26:49.205 INFO:tasks.workunit.client.0.smithi032.stdout:1/736: dread - db/dc8/de7/fea zero size 2024-05-06T21:26:49.205 INFO:tasks.workunit.client.0.smithi032.stdout:1/737: write db/d47/d4a/da4/f49 [8572027,31268] 0 2024-05-06T21:26:49.205 INFO:tasks.workunit.client.0.smithi032.stdout:1/738: chown db/d16/d46/d55/c8d 32 1 2024-05-06T21:26:49.206 INFO:tasks.workunit.client.1.smithi154.stdout:9/531: getdents d5/d20 0 2024-05-06T21:26:49.206 INFO:tasks.workunit.client.1.smithi154.stdout:9/532: fsync d5/fab 0 2024-05-06T21:26:49.206 INFO:tasks.workunit.client.1.smithi154.stdout:9/533: truncate d5/d20/d52/d59/f67 994406 0 2024-05-06T21:26:49.206 INFO:tasks.workunit.client.1.smithi154.stdout:6/299: link d8/la d8/d11/d2d/l60 0 2024-05-06T21:26:49.207 INFO:tasks.workunit.client.0.smithi032.stdout:1/739: rename db/d16/d46/da1/led to db/d47/d4a/lee 0 2024-05-06T21:26:49.207 INFO:tasks.workunit.client.0.smithi032.stdout:1/740: fsync db/d47/d4a/f8e 0 2024-05-06T21:26:49.208 INFO:tasks.workunit.client.1.smithi154.stdout:8/401: mkdir d3/d14/d1a/d29/d32/d40/d79/d84 0 2024-05-06T21:26:49.211 INFO:tasks.workunit.client.1.smithi154.stdout:5/516: rename d2/d3/d21/d22/d25/d37/f40 to d2/d3/d21/d95/dd/fad 0 2024-05-06T21:26:49.213 INFO:tasks.workunit.client.1.smithi154.stdout:1/469: rename d6/db/d69/l7b to d6/db/d69/l8c 0 2024-05-06T21:26:49.213 INFO:tasks.workunit.client.1.smithi154.stdout:1/470: getdents d6/db/d10/d15 0 2024-05-06T21:26:49.213 INFO:tasks.workunit.client.1.smithi154.stdout:1/471: truncate d6/db/d10/d15/d1d/f57 1087439 0 2024-05-06T21:26:49.213 INFO:tasks.workunit.client.1.smithi154.stdout:1/472: chown d6/db/d69/l8c 60 1 2024-05-06T21:26:49.213 INFO:tasks.workunit.client.1.smithi154.stdout:1/473: truncate d6/d3e/f88 1949799 0 2024-05-06T21:26:49.213 INFO:tasks.workunit.client.1.smithi154.stdout:9/534: symlink d5/d20/d52/d59/lbb 0 2024-05-06T21:26:49.214 INFO:tasks.workunit.client.1.smithi154.stdout:3/607: mkdir d0/da/d1a/d28/d17/db0/dd2 0 2024-05-06T21:26:49.215 INFO:tasks.workunit.client.1.smithi154.stdout:6/300: rename d8/d11/d2d/l46 to d8/l61 0 2024-05-06T21:26:49.216 INFO:tasks.workunit.client.1.smithi154.stdout:5/517: creat d2/d3/d21/d95/dc/fae x:0 0 0 2024-05-06T21:26:49.218 INFO:tasks.workunit.client.1.smithi154.stdout:1/474: creat d6/db/d69/d89/f8d x:0 0 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/475: fdatasync d6/d3e/f6d 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/476: fsync d6/db/d10/d15/f60 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/477: fdatasync d6/f8 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/478: write d6/db/d74/f80 [3632267,4161] 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/479: stat d6/db/d10/d26/f6b 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/480: write d6/db/d10/d26/f6b [987302,124932] 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/481: write d6/db/d10/f77 [904222,54746] 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/482: creat d6/db/d69/d89/f8e x:0 0 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/483: chown d6/db/d10/d26/d1b/c3f 36938 1 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:8/402: dread d3/fb [0,4194304] 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:8/403: truncate d3/d14/d1a/d29/d3e/f66 1230419 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:3/608: creat d0/da/d1a/d28/d4d/fd3 x:0 0 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:3/609: fsync d0/fe 0 2024-05-06T21:26:49.219 INFO:tasks.workunit.client.1.smithi154.stdout:3/610: chown d0/da/db/d52/d62/c6c 102348 1 2024-05-06T21:26:49.220 INFO:tasks.workunit.client.1.smithi154.stdout:3/611: stat d0/da/d1a/d28/d17/db0/d76/c89 0 2024-05-06T21:26:49.220 INFO:tasks.workunit.client.1.smithi154.stdout:6/301: dread d8/f23 [0,4194304] 0 2024-05-06T21:26:49.221 INFO:tasks.workunit.client.1.smithi154.stdout:1/484: rename d6/db/d10/d15/f62 to d6/db/d10/d26/f8f 0 2024-05-06T21:26:49.227 INFO:tasks.workunit.client.1.smithi154.stdout:8/404: truncate d3/d14/f18 2746319 0 2024-05-06T21:26:49.227 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:48 smithi032 ceph-mon[27179]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 165 MiB/s rd, 208 MiB/s wr, 436 op/s 2024-05-06T21:26:49.228 INFO:tasks.workunit.client.1.smithi154.stdout:5/518: link d2/d3/d21/d95/dd/d2a/d54/f5c d2/d3/d19/d23/faf 0 2024-05-06T21:26:49.228 INFO:tasks.workunit.client.1.smithi154.stdout:1/485: read d6/db/d10/d15/d1d/d53/f5f [144169,4946] 0 2024-05-06T21:26:49.228 INFO:tasks.workunit.client.1.smithi154.stdout:1/486: truncate d6/db/d5e/f73 682689 0 2024-05-06T21:26:49.228 INFO:tasks.workunit.client.1.smithi154.stdout:5/519: mkdir d2/d3/d21/d22/d25/db0 0 2024-05-06T21:26:49.228 INFO:tasks.workunit.client.1.smithi154.stdout:5/520: write d2/f6e [1907702,125438] 0 2024-05-06T21:26:49.232 INFO:tasks.workunit.client.1.smithi154.stdout:1/487: rmdir d6/d3e/d7e 39 2024-05-06T21:26:49.232 INFO:tasks.workunit.client.1.smithi154.stdout:1/488: fdatasync d6/d3e/f72 0 2024-05-06T21:26:49.248 INFO:tasks.workunit.client.1.smithi154.stdout:1/489: dread d6/f24 [0,4194304] 0 2024-05-06T21:26:49.248 INFO:tasks.workunit.client.1.smithi154.stdout:1/490: symlink d6/db/d69/l90 0 2024-05-06T21:26:49.249 INFO:tasks.workunit.client.1.smithi154.stdout:1/491: write d6/db/d10/d26/f7d [173490,72949] 0 2024-05-06T21:26:49.252 INFO:tasks.workunit.client.1.smithi154.stdout:1/492: dread d6/db/d10/d15/d1d/f57 [0,4194304] 0 2024-05-06T21:26:49.252 INFO:tasks.workunit.client.1.smithi154.stdout:1/493: write d6/f7f [1201309,23519] 0 2024-05-06T21:26:49.256 INFO:tasks.workunit.client.0.smithi032.stdout:3/835: dwrite d1/d4/da/d31/d47/fc1 [0,4194304] 0 2024-05-06T21:26:49.256 INFO:tasks.workunit.client.0.smithi032.stdout:6/817: dwrite d8/dd/d18/d3b/db9/f9e [0,4194304] 0 2024-05-06T21:26:49.257 INFO:tasks.workunit.client.0.smithi032.stdout:4/857: dwrite d2/d13/f57 [0,4194304] 0 2024-05-06T21:26:49.258 INFO:tasks.workunit.client.1.smithi154.stdout:7/358: write d6/d54/f58 [5108267,36260] 0 2024-05-06T21:26:49.258 INFO:tasks.workunit.client.0.smithi032.stdout:8/984: dwrite d0/d1b/d39/f6b [0,4194304] 0 2024-05-06T21:26:49.262 INFO:tasks.workunit.client.0.smithi032.stdout:7/794: dwrite db/d12/d16/d21/dcb/fea [0,4194304] 0 2024-05-06T21:26:49.262 INFO:tasks.workunit.client.1.smithi154.stdout:7/359: rename d6/de to d6/d42/d6c/d6e 0 2024-05-06T21:26:49.263 INFO:tasks.workunit.client.0.smithi032.stdout:3/836: symlink d1/d4/da/d4e/d41/d97/d67/l11a 0 2024-05-06T21:26:49.265 INFO:tasks.workunit.client.0.smithi032.stdout:4/858: rename d2/d13/f57 to d2/d16/d44/d74/d79/d88/f110 0 2024-05-06T21:26:49.265 INFO:tasks.workunit.client.0.smithi032.stdout:4/859: dread - d2/d13/daa/db8/de7/f9f zero size 2024-05-06T21:26:49.267 INFO:tasks.workunit.client.0.smithi032.stdout:8/985: mkdir d0/d1c/d5e/d67/dc3/db5/d134 0 2024-05-06T21:26:49.268 INFO:tasks.workunit.client.1.smithi154.stdout:9/535: dwrite d5/d20/d37/f5f [0,4194304] 0 2024-05-06T21:26:49.268 INFO:tasks.workunit.client.1.smithi154.stdout:9/536: fdatasync d5/d20/d52/d6e/f9b 0 2024-05-06T21:26:49.268 INFO:tasks.workunit.client.1.smithi154.stdout:9/537: chown d5/d14/d3a 877506256 1 2024-05-06T21:26:49.269 INFO:tasks.workunit.client.0.smithi032.stdout:3/837: write d1/d4/da/f2f [1906869,75174] 0 2024-05-06T21:26:49.271 INFO:tasks.workunit.client.0.smithi032.stdout:7/795: unlink db/d12/d16/d2a/d39/d3b/d96/fe0 0 2024-05-06T21:26:49.271 INFO:tasks.workunit.client.0.smithi032.stdout:4/860: symlink d2/d13/daa/df4/d10f/l111 0 2024-05-06T21:26:49.271 INFO:tasks.workunit.client.0.smithi032.stdout:8/986: truncate d0/d1c/d5e/d67/dc3/db5/dd0/fde 950319 0 2024-05-06T21:26:49.274 INFO:tasks.workunit.client.0.smithi032.stdout:3/838: rmdir d1/d4/da/d31/d47/d4a/dc9 0 2024-05-06T21:26:49.274 INFO:tasks.workunit.client.0.smithi032.stdout:3/839: fsync d1/d4/da/d4e/d41/d97/d67/da6/f99 0 2024-05-06T21:26:49.274 INFO:tasks.workunit.client.0.smithi032.stdout:7/796: rmdir db/d12/d16/d21/d84 39 2024-05-06T21:26:49.274 INFO:tasks.workunit.client.0.smithi032.stdout:7/797: dread - db/d12/f6d zero size 2024-05-06T21:26:49.275 INFO:tasks.workunit.client.0.smithi032.stdout:4/861: getdents d2/d13/daa/db8/de7 0 2024-05-06T21:26:49.275 INFO:tasks.workunit.client.0.smithi032.stdout:4/862: chown d2/d16/d44/d74/d79/fb9 18991912 1 2024-05-06T21:26:49.275 INFO:tasks.workunit.client.0.smithi032.stdout:8/987: symlink d0/d12e/l135 0 2024-05-06T21:26:49.277 INFO:tasks.workunit.client.0.smithi032.stdout:8/988: dread d0/d1c/d5e/d67/dc3/d57/d5d/f90 [0,4194304] 0 2024-05-06T21:26:49.277 INFO:tasks.workunit.client.0.smithi032.stdout:8/989: chown d0/d1c/d5e/d67/d7b/d12a 27 1 2024-05-06T21:26:49.279 INFO:tasks.workunit.client.0.smithi032.stdout:2/622: dwrite df/d19/d1e/d35/fd4 [0,4194304] 0 2024-05-06T21:26:49.280 INFO:tasks.workunit.client.1.smithi154.stdout:7/360: creat d6/d42/d6c/d6e/d23/f6f x:0 0 0 2024-05-06T21:26:49.280 INFO:tasks.workunit.client.1.smithi154.stdout:0/542: dwrite d6/dc/d51/d54/f74 [0,4194304] 0 2024-05-06T21:26:49.284 INFO:tasks.workunit.client.1.smithi154.stdout:6/302: dwrite d8/d11/f24 [8388608,4194304] 0 2024-05-06T21:26:49.284 INFO:tasks.workunit.client.1.smithi154.stdout:3/612: dwrite d0/da/db/d52/fc8 [0,4194304] 0 2024-05-06T21:26:49.284 INFO:tasks.workunit.client.1.smithi154.stdout:9/538: mknod d5/d20/d52/d6e/d83/da2/cbc 0 2024-05-06T21:26:49.285 INFO:tasks.workunit.client.1.smithi154.stdout:1/494: dwrite d6/db/d10/d15/d1d/d53/f43 [4194304,4194304] 0 2024-05-06T21:26:49.287 INFO:tasks.workunit.client.0.smithi032.stdout:2/623: rename df/d19/d1e/d35/dc5/d2e/d33/f15 to df/d19/d1e/d42/dc6/dc1/fdb 0 2024-05-06T21:26:49.287 INFO:tasks.workunit.client.0.smithi032.stdout:2/624: dread - df/d19/d1e/d35/d3f/f68 zero size 2024-05-06T21:26:49.288 INFO:tasks.workunit.client.1.smithi154.stdout:7/361: dread d6/f10 [0,4194304] 0 2024-05-06T21:26:49.289 INFO:tasks.workunit.client.0.smithi032.stdout:3/840: write d1/d4/da/d31/d47/d4a/fd1 [939315,14176] 0 2024-05-06T21:26:49.290 INFO:tasks.workunit.client.0.smithi032.stdout:0/713: dwrite d4/da/d14/d4a/fc7 [0,4194304] 0 2024-05-06T21:26:49.295 INFO:tasks.workunit.client.0.smithi032.stdout:3/841: readlink d1/d4/da/l16 0 2024-05-06T21:26:49.295 INFO:tasks.workunit.client.0.smithi032.stdout:3/842: chown d1/d4/da/d4e/d5e/d84/df2 452 1 2024-05-06T21:26:49.299 INFO:tasks.workunit.client.0.smithi032.stdout:3/843: creat d1/d4/da/d4e/dd3/dd6/f11b x:0 0 0 2024-05-06T21:26:49.301 INFO:tasks.workunit.client.0.smithi032.stdout:0/714: getdents d4 0 2024-05-06T21:26:49.306 INFO:tasks.workunit.client.0.smithi032.stdout:4/863: dread d2/d13/fe4 [0,4194304] 0 2024-05-06T21:26:49.306 INFO:tasks.workunit.client.0.smithi032.stdout:4/864: fdatasync d2/d16/d44/d74/d76/fb2 0 2024-05-06T21:26:49.308 INFO:tasks.workunit.client.1.smithi154.stdout:0/543: mknod d6/dc/d40/d4a/d6c/cb3 0 2024-05-06T21:26:49.308 INFO:tasks.workunit.client.1.smithi154.stdout:0/544: chown d6/f83 1731 1 2024-05-06T21:26:49.310 INFO:tasks.workunit.client.0.smithi032.stdout:4/865: mkdir d2/d13/daa/db8/de7/d112 0 2024-05-06T21:26:49.311 INFO:tasks.workunit.client.1.smithi154.stdout:9/539: mkdir d5/d14/d3a/d71/db1/dbd 0 2024-05-06T21:26:49.311 INFO:tasks.workunit.client.1.smithi154.stdout:9/540: readlink d5/d20/d52/d6e/d83/da2/lad 0 2024-05-06T21:26:49.312 INFO:tasks.workunit.client.0.smithi032.stdout:7/798: dwrite db/d12/d16/d21/d41/d78/f88 [0,4194304] 0 2024-05-06T21:26:49.312 INFO:tasks.workunit.client.0.smithi032.stdout:2/625: dread df/f8b [0,4194304] 0 2024-05-06T21:26:49.312 INFO:tasks.workunit.client.0.smithi032.stdout:7/799: readlink db/l32 0 2024-05-06T21:26:49.313 INFO:tasks.workunit.client.1.smithi154.stdout:1/495: mknod d6/db/d87/c91 0 2024-05-06T21:26:49.313 INFO:tasks.workunit.client.1.smithi154.stdout:1/496: truncate d6/db/d10/d15/f60 57907 0 2024-05-06T21:26:49.313 INFO:tasks.workunit.client.1.smithi154.stdout:1/497: write d6/f17 [2010445,24991] 0 2024-05-06T21:26:49.313 INFO:tasks.workunit.client.1.smithi154.stdout:1/498: chown d6/db/d10/c14 0 1 2024-05-06T21:26:49.316 INFO:tasks.workunit.client.0.smithi032.stdout:2/626: rename df/d19/d1e/d71/d5f/d73/f87 to df/d19/d1e/d54/fdc 0 2024-05-06T21:26:49.317 INFO:tasks.workunit.client.1.smithi154.stdout:0/545: creat d6/dc/d40/d4a/d6c/fb4 x:0 0 0 2024-05-06T21:26:49.317 INFO:tasks.workunit.client.1.smithi154.stdout:0/546: getdents d6/dc/d40/d4a/dac 0 2024-05-06T21:26:49.318 INFO:tasks.workunit.client.0.smithi032.stdout:2/627: symlink df/d19/d1e/d35/dc5/ldd 0 2024-05-06T21:26:49.318 INFO:tasks.workunit.client.0.smithi032.stdout:2/628: chown f7 960376990 1 2024-05-06T21:26:49.318 INFO:tasks.workunit.client.1.smithi154.stdout:8/405: rmdir d3/d14/d1a/d29 39 2024-05-06T21:26:49.318 INFO:tasks.workunit.client.1.smithi154.stdout:8/406: write d3/d14/d1a/d29/f74 [912405,113156] 0 2024-05-06T21:26:49.319 INFO:tasks.workunit.client.1.smithi154.stdout:9/541: rmdir d5/d14/d31 39 2024-05-06T21:26:49.321 INFO:tasks.workunit.client.0.smithi032.stdout:7/800: dread db/d12/f17 [0,4194304] 0 2024-05-06T21:26:49.323 INFO:tasks.workunit.client.1.smithi154.stdout:6/303: dwrite f6 [0,4194304] 0 2024-05-06T21:26:49.323 INFO:tasks.workunit.client.1.smithi154.stdout:6/304: read d8/f10 [3817416,63724] 0 2024-05-06T21:26:49.324 INFO:tasks.workunit.client.0.smithi032.stdout:7/801: rmdir db/d12/d16/d21/d41/d78 39 2024-05-06T21:26:49.324 INFO:tasks.workunit.client.0.smithi032.stdout:7/802: write db/d12/d16/d21/fa7 [379157,97209] 0 2024-05-06T21:26:49.324 INFO:tasks.workunit.client.0.smithi032.stdout:7/803: chown db/d12/d49/cae 17118 1 2024-05-06T21:26:49.325 INFO:tasks.workunit.client.1.smithi154.stdout:1/499: mknod d6/db/d10/d15/d1d/d53/c92 0 2024-05-06T21:26:49.325 INFO:tasks.workunit.client.1.smithi154.stdout:1/500: chown d6/db/d69/d89/f8e 83394788 1 2024-05-06T21:26:49.326 INFO:tasks.workunit.client.0.smithi032.stdout:0/715: write d4/d3e/d63/dca/f50 [1599126,88441] 0 2024-05-06T21:26:49.326 INFO:tasks.workunit.client.0.smithi032.stdout:8/990: dwrite d0/d1c/d5e/fcb [0,4194304] 0 2024-05-06T21:26:49.326 INFO:tasks.workunit.client.0.smithi032.stdout:7/804: symlink db/d12/d16/d21/dcb/lf9 0 2024-05-06T21:26:49.328 INFO:tasks.workunit.client.1.smithi154.stdout:0/547: truncate d6/dc/d44/d36/f57 199538 0 2024-05-06T21:26:49.329 INFO:tasks.workunit.client.0.smithi032.stdout:8/991: rename d0/d1b/d39/f48 to d0/d1c/d5e/d67/d7b/dab/f136 0 2024-05-06T21:26:49.330 INFO:tasks.workunit.client.0.smithi032.stdout:3/844: dwrite d1/d4/d11/f5a [0,4194304] 0 2024-05-06T21:26:49.331 INFO:tasks.workunit.client.0.smithi032.stdout:0/716: mknod d4/da/d16/ceb 0 2024-05-06T21:26:49.331 INFO:tasks.workunit.client.0.smithi032.stdout:0/717: dread - d4/fea zero size 2024-05-06T21:26:49.333 INFO:tasks.workunit.client.0.smithi032.stdout:8/992: rename d0/d1b/f31 to d0/d1c/d5e/d67/dc3/d57/d5d/f137 0 2024-05-06T21:26:49.333 INFO:tasks.workunit.client.1.smithi154.stdout:6/305: rename d8/c4e to d8/d11/d2d/d3d/d4c/c62 0 2024-05-06T21:26:49.334 INFO:tasks.workunit.client.0.smithi032.stdout:2/629: getdents df/d19/d1e/d54 0 2024-05-06T21:26:49.336 INFO:tasks.workunit.client.0.smithi032.stdout:3/845: rmdir d1/d4/da/d31 39 2024-05-06T21:26:49.337 INFO:tasks.workunit.client.1.smithi154.stdout:1/501: rename d6/d3e/l54 to d6/db/d10/d15/d1d/l93 0 2024-05-06T21:26:49.337 INFO:tasks.workunit.client.1.smithi154.stdout:1/502: chown d6/db/c4e 1614 1 2024-05-06T21:26:49.338 INFO:tasks.workunit.client.0.smithi032.stdout:0/718: mknod d4/cec 0 2024-05-06T21:26:49.338 INFO:tasks.workunit.client.0.smithi032.stdout:0/719: write d4/da/f81 [458967,119986] 0 2024-05-06T21:26:49.339 INFO:tasks.workunit.client.0.smithi032.stdout:8/993: creat d0/d1c/d5e/d67/dc3/db5/dd0/d12f/f138 x:0 0 0 2024-05-06T21:26:49.339 INFO:tasks.workunit.client.0.smithi032.stdout:0/720: mknod d4/d3e/d42/ced 0 2024-05-06T21:26:49.339 INFO:tasks.workunit.client.0.smithi032.stdout:0/721: truncate d4/da/d14/f2d 2361905 0 2024-05-06T21:26:49.339 INFO:tasks.workunit.client.1.smithi154.stdout:6/306: dread f1 [0,4194304] 0 2024-05-06T21:26:49.339 INFO:tasks.workunit.client.1.smithi154.stdout:6/307: write d8/d11/d2d/d57/f5d [75835,63756] 0 2024-05-06T21:26:49.340 INFO:tasks.workunit.client.0.smithi032.stdout:8/994: getdents d0/d1b/d47/d91 0 2024-05-06T21:26:49.341 INFO:tasks.workunit.client.1.smithi154.stdout:1/503: dread d6/db/d10/d15/d1d/d53/f5f [0,4194304] 0 2024-05-06T21:26:49.345 INFO:tasks.workunit.client.1.smithi154.stdout:1/504: dread d6/db/d10/d15/f60 [0,4194304] 0 2024-05-06T21:26:49.345 INFO:tasks.workunit.client.1.smithi154.stdout:1/505: read d6/db/d10/f51 [3024541,69818] 0 2024-05-06T21:26:49.345 INFO:tasks.workunit.client.1.smithi154.stdout:1/506: write d6/f47 [1307192,123723] 0 2024-05-06T21:26:49.347 INFO:tasks.workunit.client.1.smithi154.stdout:3/613: dwrite d0/d2/f45 [0,4194304] 0 2024-05-06T21:26:49.347 INFO:tasks.workunit.client.1.smithi154.stdout:3/614: truncate d0/da/db/d30/d71/f88 445434 0 2024-05-06T21:26:49.351 INFO:tasks.workunit.client.1.smithi154.stdout:9/542: dwrite d5/d20/d52/f57 [0,4194304] 0 2024-05-06T21:26:49.352 INFO:tasks.workunit.client.1.smithi154.stdout:9/543: chown d5/d2e 79 1 2024-05-06T21:26:49.355 INFO:tasks.workunit.client.0.smithi032.stdout:8/995: dread d0/d1c/fae [0,4194304] 0 2024-05-06T21:26:49.355 INFO:tasks.workunit.client.0.smithi032.stdout:8/996: chown d0/d1b/d39/d93/led 12609 1 2024-05-06T21:26:49.356 INFO:tasks.workunit.client.0.smithi032.stdout:8/997: mknod d0/d1b/d47/d91/de5/d114/d132/c139 0 2024-05-06T21:26:49.357 INFO:tasks.workunit.client.0.smithi032.stdout:8/998: mknod d0/d1b/d47/d91/c13a 0 2024-05-06T21:26:49.358 INFO:tasks.workunit.client.1.smithi154.stdout:9/544: creat d5/d2e/d66/fbe x:0 0 0 2024-05-06T21:26:49.359 INFO:tasks.workunit.client.0.smithi032.stdout:3/846: dread d1/d2a/d71/d9d/da9/ff8 [0,4194304] 0 2024-05-06T21:26:49.359 INFO:tasks.workunit.client.0.smithi032.stdout:8/999: symlink d0/d1c/d5e/d67/d7b/dab/l13b 0 2024-05-06T21:26:49.360 INFO:tasks.workunit.client.1.smithi154.stdout:4/428: sync 2024-05-06T21:26:49.361 INFO:tasks.workunit.client.0.smithi032.stdout:3/847: dread d1/d4/da/d4e/d41/f66 [0,4194304] 0 2024-05-06T21:26:49.365 INFO:tasks.workunit.client.0.smithi032.stdout:3/848: link d1/d4/da/d31/f55 d1/d4/da/d31/d47/d4a/d68/d7c/da8/f11c 0 2024-05-06T21:26:49.365 INFO:tasks.workunit.client.0.smithi032.stdout:3/849: dread - d1/d4/da/d4e/d5e/fee zero size 2024-05-06T21:26:49.366 INFO:tasks.workunit.client.1.smithi154.stdout:1/507: getdents d6/db/d10/d15/d1d/d53 0 2024-05-06T21:26:49.368 INFO:tasks.workunit.client.1.smithi154.stdout:8/407: dwrite d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f60 [0,4194304] 0 2024-05-06T21:26:49.368 INFO:tasks.workunit.client.1.smithi154.stdout:1/508: mkdir d6/db/d10/d94 0 2024-05-06T21:26:49.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:48 smithi154 ceph-mon[32880]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 165 MiB/s rd, 208 MiB/s wr, 436 op/s 2024-05-06T21:26:49.372 INFO:tasks.workunit.client.1.smithi154.stdout:1/509: truncate d6/db/d10/d15/d1d/f57 15004 0 2024-05-06T21:26:49.372 INFO:tasks.workunit.client.1.smithi154.stdout:1/510: fsync d6/db/d74/f80 0 2024-05-06T21:26:49.374 INFO:tasks.workunit.client.1.smithi154.stdout:1/511: link d6/db/d10/d26/l5c d6/db/d69/d89/l95 0 2024-05-06T21:26:49.375 INFO:tasks.workunit.client.1.smithi154.stdout:1/512: mknod d6/db/d10/d15/d1d/c96 0 2024-05-06T21:26:49.375 INFO:tasks.workunit.client.1.smithi154.stdout:1/513: chown d6/f28 289 1 2024-05-06T21:26:49.381 INFO:tasks.workunit.client.0.smithi032.stdout:3/850: read d1/d4/d11/f5a [2809928,99394] 0 2024-05-06T21:26:49.382 INFO:tasks.workunit.client.1.smithi154.stdout:8/408: dread d3/d14/d1a/d29/d43/f5d [0,4194304] 0 2024-05-06T21:26:49.383 INFO:tasks.workunit.client.0.smithi032.stdout:2/630: dwrite df/d19/d1e/d35/dc5/d2e/f94 [0,4194304] 0 2024-05-06T21:26:49.383 INFO:tasks.workunit.client.0.smithi032.stdout:2/631: chown df/d19/d1e/d42/cbb 35861751 1 2024-05-06T21:26:49.383 INFO:tasks.workunit.client.0.smithi032.stdout:0/722: dwrite d4/da/d16/fc4 [0,4194304] 0 2024-05-06T21:26:49.384 INFO:tasks.workunit.client.0.smithi032.stdout:0/723: creat d4/d3e/d42/fee x:0 0 0 2024-05-06T21:26:49.384 INFO:tasks.workunit.client.0.smithi032.stdout:0/724: write d4/da/d16/d4f/f75 [472082,6584] 0 2024-05-06T21:26:49.384 INFO:tasks.workunit.client.0.smithi032.stdout:3/851: mknod d1/d4/da/d4e/d5e/d84/df2/d108/dfd/c11d 0 2024-05-06T21:26:49.384 INFO:tasks.workunit.client.0.smithi032.stdout:3/852: chown d1/d4/da/d4e/lcd 425 1 2024-05-06T21:26:49.384 INFO:tasks.workunit.client.1.smithi154.stdout:8/409: rename d3/d14/d1a/d29/d32/d40/d59/c7c to d3/d14/d1a/d29/d32/d40/d79/d2b/c85 0 2024-05-06T21:26:49.386 INFO:tasks.workunit.client.0.smithi032.stdout:2/632: unlink df/d19/d1e/d71/d5f/d7d/d65/f67 0 2024-05-06T21:26:49.389 INFO:tasks.workunit.client.0.smithi032.stdout:0/725: truncate d4/f7 1011563 0 2024-05-06T21:26:49.389 INFO:tasks.workunit.client.0.smithi032.stdout:0/726: truncate d4/d3e/d42/fce 675472 0 2024-05-06T21:26:49.389 INFO:tasks.workunit.client.0.smithi032.stdout:3/853: mkdir d1/d4/da/d4e/d5e/d84/df2/d108/db8/d11e 0 2024-05-06T21:26:49.389 INFO:tasks.workunit.client.0.smithi032.stdout:3/854: write d1/d4/da/d31/d47/d4a/fd1 [1149461,52568] 0 2024-05-06T21:26:49.391 INFO:tasks.workunit.client.0.smithi032.stdout:2/633: truncate df/d19/d1e/d71/d5f/d7d/d25/d2d/f45 3346451 0 2024-05-06T21:26:49.391 INFO:tasks.workunit.client.0.smithi032.stdout:2/634: stat df/d19/d1e/d35/dc5/d2e/d33/f17 0 2024-05-06T21:26:49.392 INFO:tasks.workunit.client.0.smithi032.stdout:2/635: symlink df/d19/d1e/d35/d3f/lde 0 2024-05-06T21:26:49.397 INFO:tasks.workunit.client.1.smithi154.stdout:6/308: dwrite f1 [0,4194304] 0 2024-05-06T21:26:49.398 INFO:tasks.workunit.client.1.smithi154.stdout:3/615: dwrite d0/da/d1a/d28/dbc/d81/d48/da9/fb7 [0,4194304] 0 2024-05-06T21:26:49.398 INFO:tasks.workunit.client.1.smithi154.stdout:3/616: dread - d0/da/db/d7c/d80/f9d zero size 2024-05-06T21:26:49.398 INFO:tasks.workunit.client.1.smithi154.stdout:3/617: truncate d0/da/d1a/d28/d17/f63 127572 0 2024-05-06T21:26:49.398 INFO:tasks.workunit.client.1.smithi154.stdout:3/618: truncate d0/da/db/dd/d1c/d21/d37/f99 1114888 0 2024-05-06T21:26:49.399 INFO:tasks.workunit.client.1.smithi154.stdout:3/619: chown d0/da/d1a/d28/d17/f1e 197668 1 2024-05-06T21:26:49.399 INFO:tasks.workunit.client.1.smithi154.stdout:3/620: dread d0/da/db/dd/d1c/d41/f79 [0,4194304] 0 2024-05-06T21:26:49.400 INFO:tasks.workunit.client.0.smithi032.stdout:0/727: write d4/d3e/fe0 [2852308,106327] 0 2024-05-06T21:26:49.400 INFO:tasks.workunit.client.0.smithi032.stdout:0/728: write d4/d3e/d63/d6c/d8f/fba [122979,773] 0 2024-05-06T21:26:49.401 INFO:tasks.workunit.client.1.smithi154.stdout:6/309: symlink d8/d11/d2d/d3d/d4c/l63 0 2024-05-06T21:26:49.402 INFO:tasks.workunit.client.1.smithi154.stdout:9/545: dwrite d5/f12 [0,4194304] 0 2024-05-06T21:26:49.402 INFO:tasks.workunit.client.1.smithi154.stdout:9/546: readlink d5/d20/l2b 0 2024-05-06T21:26:49.402 INFO:tasks.workunit.client.1.smithi154.stdout:9/547: truncate d5/f28 1603089 0 2024-05-06T21:26:49.403 INFO:tasks.workunit.client.1.smithi154.stdout:4/429: dwrite d0/d2/dc/f16 [0,4194304] 0 2024-05-06T21:26:49.403 INFO:tasks.workunit.client.1.smithi154.stdout:3/621: getdents d0/da/d1a/d28/d17/db0 0 2024-05-06T21:26:49.404 INFO:tasks.workunit.client.1.smithi154.stdout:6/310: creat d8/d13/f64 x:0 0 0 2024-05-06T21:26:49.406 INFO:tasks.workunit.client.1.smithi154.stdout:6/311: read d8/d11/f1a [213613,58254] 0 2024-05-06T21:26:49.407 INFO:tasks.workunit.client.0.smithi032.stdout:3/855: dwrite d1/d4/da/d4e/d5e/d84/df2/d108/d74/db1/df1/d113/fa0 [4194304,4194304] 0 2024-05-06T21:26:49.407 INFO:tasks.workunit.client.1.smithi154.stdout:1/514: dwrite d6/db/d10/f77 [0,4194304] 0 2024-05-06T21:26:49.407 INFO:tasks.workunit.client.1.smithi154.stdout:1/515: chown d6/db/d69/l90 8439 1 2024-05-06T21:26:49.411 INFO:tasks.workunit.client.1.smithi154.stdout:3/622: creat d0/da/db/d52/d62/fd4 x:0 0 0 2024-05-06T21:26:49.415 INFO:tasks.workunit.client.1.smithi154.stdout:6/312: creat d8/d13/d20/f65 x:0 0 0 2024-05-06T21:26:49.418 INFO:tasks.workunit.client.0.smithi032.stdout:2/636: link df/d19/d1e/d71/d5f/d7d/d25/d2d/f45 df/fdf 0 2024-05-06T21:26:49.418 INFO:tasks.workunit.client.0.smithi032.stdout:2/637: truncate df/d19/dbf/fd6 777446 0 2024-05-06T21:26:49.418 INFO:tasks.workunit.client.0.smithi032.stdout:2/638: chown df/d19/d1e/d35/dc5/ldd 25 1 2024-05-06T21:26:49.418 INFO:tasks.workunit.client.0.smithi032.stdout:2/639: truncate df/d19/d1e/d71/d5f/f80 1169094 0 2024-05-06T21:26:49.420 INFO:tasks.workunit.client.0.smithi032.stdout:0/729: write d4/d3e/fc1 [2986966,38260] 0 2024-05-06T21:26:49.420 INFO:tasks.workunit.client.0.smithi032.stdout:0/730: chown d4/l10 2754 1 2024-05-06T21:26:49.421 INFO:tasks.workunit.client.0.smithi032.stdout:2/640: rename df/d19/d1e/d71/d5f/d73/cda to df/d19/d1e/d35/ce0 0 2024-05-06T21:26:49.422 INFO:tasks.workunit.client.0.smithi032.stdout:2/641: symlink df/d19/d1e/d42/dc6/dc1/le1 0 2024-05-06T21:26:49.423 INFO:tasks.workunit.client.1.smithi154.stdout:1/516: mkdir d6/db/d97 0 2024-05-06T21:26:49.425 INFO:tasks.workunit.client.0.smithi032.stdout:2/642: mknod df/d19/d1e/d71/d5f/d7d/d65/d78/da6/ce2 0 2024-05-06T21:26:49.425 INFO:tasks.workunit.client.0.smithi032.stdout:2/643: write df/d19/d1e/d71/d5f/d7d/d65/f85 [484271,99283] 0 2024-05-06T21:26:49.425 INFO:tasks.workunit.client.0.smithi032.stdout:2/644: dread - df/f95 zero size 2024-05-06T21:26:49.426 INFO:tasks.workunit.client.1.smithi154.stdout:4/430: creat d0/d10/d11/d1a/d7e/f90 x:0 0 0 2024-05-06T21:26:49.426 INFO:tasks.workunit.client.1.smithi154.stdout:4/431: readlink d0/d82/l58 0 2024-05-06T21:26:49.426 INFO:tasks.workunit.client.1.smithi154.stdout:4/432: dread - d0/d2/f69 zero size 2024-05-06T21:26:49.427 INFO:tasks.workunit.client.1.smithi154.stdout:3/623: mkdir d0/dd5 0 2024-05-06T21:26:49.431 INFO:tasks.workunit.client.1.smithi154.stdout:6/313: getdents d8/d11/d2d/d57 0 2024-05-06T21:26:49.431 INFO:tasks.workunit.client.1.smithi154.stdout:6/314: chown d8/d11/d33/d4a/f54 28809 1 2024-05-06T21:26:49.432 INFO:tasks.workunit.client.0.smithi032.stdout:3/856: dwrite d1/d4/da/d31/d47/d4a/d68/fe6 [4194304,4194304] 0 2024-05-06T21:26:49.434 INFO:tasks.workunit.client.1.smithi154.stdout:3/624: getdents d0/da/db/d7c 0 2024-05-06T21:26:49.434 INFO:tasks.workunit.client.1.smithi154.stdout:3/625: write d0/d2/d22/f8b [767803,23753] 0 2024-05-06T21:26:49.434 INFO:tasks.workunit.client.1.smithi154.stdout:3/626: readlink d0/da/d1a/d28/dbc/d81/ld0 0 2024-05-06T21:26:49.436 INFO:tasks.workunit.client.1.smithi154.stdout:9/548: dwrite d5/d14/d87/d65/fa6 [0,4194304] 0 2024-05-06T21:26:49.436 INFO:tasks.workunit.client.1.smithi154.stdout:3/627: symlink d0/da/d1a/d28/dbc/d81/d9c/ld6 0 2024-05-06T21:26:49.436 INFO:tasks.workunit.client.0.smithi032.stdout:3/857: getdents d1/d4/da/d4e/d41/d97/d67/da6 0 2024-05-06T21:26:49.440 INFO:tasks.workunit.client.1.smithi154.stdout:9/549: unlink d5/d14/c9d 0 2024-05-06T21:26:49.441 INFO:tasks.workunit.client.1.smithi154.stdout:4/433: read d0/d2/dc/f48 [56005,62164] 0 2024-05-06T21:26:49.442 INFO:tasks.workunit.client.1.smithi154.stdout:3/628: mknod d0/da/db/dd/d1c/cd7 0 2024-05-06T21:26:49.444 INFO:tasks.workunit.client.0.smithi032.stdout:0/731: dwrite d4/da/d16/d4f/fa5 [0,4194304] 0 2024-05-06T21:26:49.445 INFO:tasks.workunit.client.0.smithi032.stdout:0/732: chown d4/da 21457 1 2024-05-06T21:26:49.445 INFO:tasks.workunit.client.0.smithi032.stdout:0/733: creat d4/da/d16/d33/da7/fef x:0 0 0 2024-05-06T21:26:49.445 INFO:tasks.workunit.client.0.smithi032.stdout:0/734: dread - d4/da/d16/d4f/f9d zero size 2024-05-06T21:26:49.445 INFO:tasks.workunit.client.0.smithi032.stdout:0/735: creat d4/da/d14/d1a/d66/ff0 x:0 0 0 2024-05-06T21:26:49.445 INFO:tasks.workunit.client.1.smithi154.stdout:9/550: rename l4 to d5/d14/d3a/d71/db1/dba/lbf 0 2024-05-06T21:26:49.445 INFO:tasks.workunit.client.1.smithi154.stdout:4/434: mknod d0/d2/d29/d8f/c91 0 2024-05-06T21:26:49.449 INFO:tasks.workunit.client.1.smithi154.stdout:3/629: symlink d0/da/d1a/d28/dbc/d81/d48/ld8 0 2024-05-06T21:26:49.450 INFO:tasks.workunit.client.0.smithi032.stdout:0/736: mkdir d4/d3e/d63/d6c/df1 0 2024-05-06T21:26:49.451 INFO:tasks.workunit.client.1.smithi154.stdout:9/551: mknod d5/d20/d52/d6e/d83/da2/cc0 0 2024-05-06T21:26:49.452 INFO:tasks.workunit.client.0.smithi032.stdout:0/737: symlink d4/da/d14/d1a/d66/dbc/lf2 0 2024-05-06T21:26:49.452 INFO:tasks.workunit.client.0.smithi032.stdout:0/738: truncate d4/da/f81 771938 0 2024-05-06T21:26:49.452 INFO:tasks.workunit.client.1.smithi154.stdout:4/435: rename d0/f3e to d0/d2/d47/d81/f92 0 2024-05-06T21:26:49.454 INFO:tasks.workunit.client.1.smithi154.stdout:3/630: unlink d0/da/d1a/d28/dbc/d81/d48/f8e 0 2024-05-06T21:26:49.454 INFO:tasks.workunit.client.1.smithi154.stdout:3/631: fdatasync d0/da/db/f10 0 2024-05-06T21:26:49.454 INFO:tasks.workunit.client.1.smithi154.stdout:3/632: truncate d0/da/d1a/d28/d17/f54 921495 0 2024-05-06T21:26:49.456 INFO:tasks.workunit.client.1.smithi154.stdout:3/633: creat d0/da/db/d7c/fd9 x:0 0 0 2024-05-06T21:26:49.456 INFO:tasks.workunit.client.1.smithi154.stdout:3/634: dread - d0/da/d1a/d28/d4d/fd3 zero size 2024-05-06T21:26:49.456 INFO:tasks.workunit.client.1.smithi154.stdout:3/635: write d0/da/db/dd/d1c/d21/d37/fce [418165,21126] 0 2024-05-06T21:26:49.459 INFO:tasks.workunit.client.1.smithi154.stdout:3/636: rename d0/da/d1a/d28/d17/db0/d76/d9a/lb5 to d0/da/d1a/lda 0 2024-05-06T21:26:49.459 INFO:tasks.workunit.client.1.smithi154.stdout:3/637: write d0/da/db/dd/d1c/d41/fca [537657,33268] 0 2024-05-06T21:26:49.460 INFO:tasks.workunit.client.1.smithi154.stdout:3/638: write d0/f50 [661048,66293] 0 2024-05-06T21:26:49.462 INFO:tasks.workunit.client.1.smithi154.stdout:2/414: sync 2024-05-06T21:26:49.462 INFO:tasks.workunit.client.1.smithi154.stdout:2/415: fdatasync db/d12/d19/f54 0 2024-05-06T21:26:49.462 INFO:tasks.workunit.client.1.smithi154.stdout:2/416: readlink db/de/d10/d18/l3b 0 2024-05-06T21:26:49.464 INFO:tasks.workunit.client.1.smithi154.stdout:2/417: mkdir db/d12/d1d/d83 0 2024-05-06T21:26:49.465 INFO:tasks.workunit.client.1.smithi154.stdout:2/418: mknod db/d12/d4e/c84 0 2024-05-06T21:26:49.476 INFO:tasks.workunit.client.1.smithi154.stdout:2/419: write db/d12/d1d/f64 [1150855,107287] 0 2024-05-06T21:26:49.477 INFO:tasks.workunit.client.1.smithi154.stdout:2/420: getdents db/d12/d1d/d60 0 2024-05-06T21:26:49.477 INFO:tasks.workunit.client.1.smithi154.stdout:2/421: stat db/de/d16/d33/f44 0 2024-05-06T21:26:49.501 INFO:tasks.workunit.client.1.smithi154.stdout:6/315: dwrite d8/d11/f1d [0,4194304] 0 2024-05-06T21:26:49.503 INFO:tasks.workunit.client.0.smithi032.stdout:2/645: dwrite df/d19/d1e/d35/f56 [0,4194304] 0 2024-05-06T21:26:49.505 INFO:tasks.workunit.client.1.smithi154.stdout:9/552: dwrite d5/d20/d52/d6e/fae [0,4194304] 0 2024-05-06T21:26:49.506 INFO:tasks.workunit.client.1.smithi154.stdout:2/422: dwrite db/de/d16/f28 [0,4194304] 0 2024-05-06T21:26:49.506 INFO:tasks.workunit.client.1.smithi154.stdout:2/423: fdatasync db/de/d10/f30 0 2024-05-06T21:26:49.506 INFO:tasks.workunit.client.0.smithi032.stdout:0/739: dwrite d4/da/d14/d4a/f65 [0,4194304] 0 2024-05-06T21:26:49.506 INFO:tasks.workunit.client.0.smithi032.stdout:3/858: dwrite d1/d4/da/d4e/d41/d43/f110 [0,4194304] 0 2024-05-06T21:26:49.506 INFO:tasks.workunit.client.0.smithi032.stdout:2/646: truncate df/fdf 888092 0 2024-05-06T21:26:49.508 INFO:tasks.workunit.client.1.smithi154.stdout:1/517: dwrite d6/db/d10/d26/f23 [4194304,4194304] 0 2024-05-06T21:26:49.509 INFO:tasks.workunit.client.0.smithi032.stdout:0/740: mknod d4/da/d16/d33/cf3 0 2024-05-06T21:26:49.509 INFO:tasks.workunit.client.1.smithi154.stdout:6/316: dread d8/f10 [0,4194304] 0 2024-05-06T21:26:49.510 INFO:tasks.workunit.client.1.smithi154.stdout:4/436: dwrite d0/d82/d39/d63/f8e [0,4194304] 0 2024-05-06T21:26:49.523 INFO:tasks.workunit.client.0.smithi032.stdout:0/741: symlink d4/da/d16/d33/d9e/dcf/lf4 0 2024-05-06T21:26:49.523 INFO:tasks.workunit.client.1.smithi154.stdout:6/317: mknod d8/d11/d2d/d3d/d4c/c66 0 2024-05-06T21:26:49.524 INFO:tasks.workunit.client.1.smithi154.stdout:4/437: mknod d0/d72/c93 0 2024-05-06T21:26:49.524 INFO:tasks.workunit.client.1.smithi154.stdout:6/318: chown d8/d11/f1b 25 1 2024-05-06T21:26:49.524 INFO:tasks.workunit.client.1.smithi154.stdout:6/319: truncate d8/d11/f1d 4684405 0 2024-05-06T21:26:49.525 INFO:tasks.workunit.client.1.smithi154.stdout:6/320: dread d8/d11/d2d/f47 [0,4194304] 0 2024-05-06T21:26:49.525 INFO:tasks.workunit.client.0.smithi032.stdout:0/742: rename d4/da/d14/d4a/ld4 to d4/d3e/d42/lf5 0 2024-05-06T21:26:49.526 INFO:tasks.workunit.client.1.smithi154.stdout:4/438: link d0/d2/dc/c2d d0/d82/d44/d73/d4a/c94 0 2024-05-06T21:26:49.529 INFO:tasks.workunit.client.0.smithi032.stdout:0/743: getdents d4/da 0 2024-05-06T21:26:49.529 INFO:tasks.workunit.client.0.smithi032.stdout:0/744: stat d4/da/d16/d33/d9e/faf 0 2024-05-06T21:26:49.529 INFO:tasks.workunit.client.0.smithi032.stdout:0/745: stat d4/d3e/d42/ldb 0 2024-05-06T21:26:49.533 INFO:tasks.workunit.client.1.smithi154.stdout:4/439: link d0/d82/d39/c52 d0/d82/c95 0 2024-05-06T21:26:49.533 INFO:tasks.workunit.client.0.smithi032.stdout:2/647: dwrite df/d19/d1e/d35/dc5/d2e/d33/fb0 [0,4194304] 0 2024-05-06T21:26:49.535 INFO:tasks.workunit.client.0.smithi032.stdout:3/859: dwrite d1/d4/da/d4e/d5e/d84/df2/d108/d74/db1/df1/d113/fa0 [4194304,4194304] 0 2024-05-06T21:26:49.537 INFO:tasks.workunit.client.1.smithi154.stdout:4/440: getdents d0/d2 0 2024-05-06T21:26:49.537 INFO:tasks.workunit.client.0.smithi032.stdout:2/648: mkdir df/d19/d1e/d35/dc5/d2e/dbc/de3 0 2024-05-06T21:26:49.540 INFO:tasks.workunit.client.1.smithi154.stdout:1/518: dwrite d6/db/d10/d15/f60 [0,4194304] 0 2024-05-06T21:26:49.541 INFO:tasks.workunit.client.0.smithi032.stdout:2/649: rename df/f95 to df/d19/d1e/d35/d3f/fe4 0 2024-05-06T21:26:49.541 INFO:tasks.workunit.client.0.smithi032.stdout:2/650: fsync df/d19/d1e/d35/dc5/d9f/fa1 0 2024-05-06T21:26:49.542 INFO:tasks.workunit.client.1.smithi154.stdout:4/441: rename d0/d10/c7a to d0/d82/c96 0 2024-05-06T21:26:49.542 INFO:tasks.workunit.client.1.smithi154.stdout:9/553: dwrite d5/d2e/d66/fb0 [0,4194304] 0 2024-05-06T21:26:49.543 INFO:tasks.workunit.client.1.smithi154.stdout:2/424: dwrite db/d12/d19/f39 [0,4194304] 0 2024-05-06T21:26:49.543 INFO:tasks.workunit.client.0.smithi032.stdout:2/651: symlink df/d19/d1e/d42/le5 0 2024-05-06T21:26:49.543 INFO:tasks.workunit.client.0.smithi032.stdout:2/652: getdents df/d19/d1e/d42/dc6/dc1/dc7 0 2024-05-06T21:26:49.543 INFO:tasks.workunit.client.0.smithi032.stdout:2/653: fsync df/d19/f5b 0 2024-05-06T21:26:49.546 INFO:tasks.workunit.client.0.smithi032.stdout:2/654: rename df/d19/d1e/d71/d5f/d73/f79 to df/d19/fe6 0 2024-05-06T21:26:49.548 INFO:tasks.workunit.client.0.smithi032.stdout:2/655: rename df/d19/d1e/d42/dc6/f5a to df/d19/d1e/fe7 0 2024-05-06T21:26:49.550 INFO:tasks.workunit.client.0.smithi032.stdout:2/656: mkdir df/d19/d1e/d42/dc6/de8 0 2024-05-06T21:26:49.550 INFO:tasks.workunit.client.0.smithi032.stdout:2/657: write df/d19/d1e/d54/f8e [704161,105871] 0 2024-05-06T21:26:49.551 INFO:tasks.workunit.client.1.smithi154.stdout:9/554: link d5/d14/l46 d5/d14/d31/d39/lc1 0 2024-05-06T21:26:49.551 INFO:tasks.workunit.client.0.smithi032.stdout:2/658: creat df/d19/d1e/d42/dc6/fe9 x:0 0 0 2024-05-06T21:26:49.552 INFO:tasks.workunit.client.1.smithi154.stdout:4/442: link d0/d82/d44/c71 d0/d82/d39/d54/c97 0 2024-05-06T21:26:49.553 INFO:tasks.workunit.client.0.smithi032.stdout:2/659: mknod df/d19/d1e/d35/dc5/d2e/dbe/cea 0 2024-05-06T21:26:49.554 INFO:tasks.workunit.client.1.smithi154.stdout:2/425: rmdir db/de/d6f 39 2024-05-06T21:26:49.554 INFO:tasks.workunit.client.1.smithi154.stdout:1/519: read d6/db/d10/d15/f4a [3572568,94643] 0 2024-05-06T21:26:49.554 INFO:tasks.workunit.client.1.smithi154.stdout:1/520: truncate d6/f8 5212772 0 2024-05-06T21:26:49.555 INFO:tasks.workunit.client.0.smithi032.stdout:2/660: unlink df/d19/d1e/d54/cad 0 2024-05-06T21:26:49.555 INFO:tasks.workunit.client.1.smithi154.stdout:4/443: symlink d0/d72/l98 0 2024-05-06T21:26:49.556 INFO:tasks.workunit.client.0.smithi032.stdout:2/661: mkdir df/d19/d1e/d35/dc5/d2e/dbc/deb 0 2024-05-06T21:26:49.557 INFO:tasks.workunit.client.0.smithi032.stdout:2/662: creat df/d19/d1e/d42/dc6/dc1/fec x:0 0 0 2024-05-06T21:26:49.558 INFO:tasks.workunit.client.1.smithi154.stdout:4/444: creat d0/d82/d44/d73/d4a/d74/d75/f99 x:0 0 0 2024-05-06T21:26:49.558 INFO:tasks.workunit.client.1.smithi154.stdout:6/321: dwrite d8/d13/f3f [0,4194304] 0 2024-05-06T21:26:49.560 INFO:tasks.workunit.client.1.smithi154.stdout:4/445: unlink d0/d2/dc/f16 0 2024-05-06T21:26:49.560 INFO:tasks.workunit.client.0.smithi032.stdout:3/860: dwrite d1/f14 [4194304,4194304] 0 2024-05-06T21:26:49.560 INFO:tasks.workunit.client.0.smithi032.stdout:3/861: fdatasync d1/d4/da/d4e/d5e/f8a 0 2024-05-06T21:26:49.561 INFO:tasks.workunit.client.0.smithi032.stdout:0/746: dwrite d4/d3e/fc1 [0,4194304] 0 2024-05-06T21:26:49.561 INFO:tasks.workunit.client.0.smithi032.stdout:0/747: dread - d4/da/d14/d1a/d66/f87 zero size 2024-05-06T21:26:49.563 INFO:tasks.workunit.client.1.smithi154.stdout:7/362: sync 2024-05-06T21:26:49.564 INFO:tasks.workunit.client.1.smithi154.stdout:5/521: sync 2024-05-06T21:26:49.566 INFO:tasks.workunit.client.0.smithi032.stdout:3/862: creat d1/d4/da/f11f x:0 0 0 2024-05-06T21:26:49.566 INFO:tasks.workunit.client.0.smithi032.stdout:3/863: chown d1/d4/da/d4e/d41/d43/fbb 252385555 1 2024-05-06T21:26:49.566 INFO:tasks.workunit.client.1.smithi154.stdout:6/322: creat d8/d11/f67 x:0 0 0 2024-05-06T21:26:49.566 INFO:tasks.workunit.client.1.smithi154.stdout:4/446: mkdir d0/d82/d44/d73/d9a 0 2024-05-06T21:26:49.567 INFO:tasks.workunit.client.1.smithi154.stdout:7/363: truncate d6/f9 2383195 0 2024-05-06T21:26:49.567 INFO:tasks.workunit.client.1.smithi154.stdout:7/364: stat d6/fb 0 2024-05-06T21:26:49.567 INFO:tasks.workunit.client.1.smithi154.stdout:7/365: write d6/d42/d6c/d6e/f31 [456825,100731] 0 2024-05-06T21:26:49.567 INFO:tasks.workunit.client.1.smithi154.stdout:4/447: symlink d0/d82/d3d/l9b 0 2024-05-06T21:26:49.568 INFO:tasks.workunit.client.1.smithi154.stdout:4/448: read d0/d2/f8 [1317303,79754] 0 2024-05-06T21:26:49.568 INFO:tasks.workunit.client.0.smithi032.stdout:3/864: getdents d1/d4/da/d31/d47/d4a/d68/d7c/da8/dbc 0 2024-05-06T21:26:49.569 INFO:tasks.workunit.client.1.smithi154.stdout:1/521: dread d6/f8 [0,4194304] 0 2024-05-06T21:26:49.569 INFO:tasks.workunit.client.1.smithi154.stdout:5/522: read d2/d3/d21/fa2 [75501,95912] 0 2024-05-06T21:26:49.572 INFO:tasks.workunit.client.1.smithi154.stdout:7/366: symlink d6/d42/d6c/d6e/d23/l70 0 2024-05-06T21:26:49.577 INFO:tasks.workunit.client.1.smithi154.stdout:4/449: fdatasync d0/d10/d11/d1a/f35 0 2024-05-06T21:26:49.577 INFO:tasks.workunit.client.1.smithi154.stdout:1/522: creat d6/db/d10/d15/d1d/d53/f98 x:0 0 0 2024-05-06T21:26:49.577 INFO:tasks.workunit.client.1.smithi154.stdout:4/450: write d0/d82/d44/d73/d4a/f8c [5649711,28191] 0 2024-05-06T21:26:49.578 INFO:tasks.workunit.client.1.smithi154.stdout:6/323: dread f1 [0,4194304] 0 2024-05-06T21:26:49.579 INFO:tasks.workunit.client.1.smithi154.stdout:4/451: mknod d0/d82/d44/d73/d4a/d74/d75/c9c 0 2024-05-06T21:26:49.579 INFO:tasks.workunit.client.1.smithi154.stdout:4/452: chown d0/c30 5144 1 2024-05-06T21:26:49.580 INFO:tasks.workunit.client.1.smithi154.stdout:4/453: chown d0/f23 1109 1 2024-05-06T21:26:49.582 INFO:tasks.workunit.client.1.smithi154.stdout:6/324: rmdir d8/d11/d2d/d3d/d4c 39 2024-05-06T21:26:49.584 INFO:tasks.workunit.client.1.smithi154.stdout:6/325: symlink d8/d11/d33/l68 0 2024-05-06T21:26:49.584 INFO:tasks.workunit.client.1.smithi154.stdout:6/326: creat d8/d11/f69 x:0 0 0 2024-05-06T21:26:49.588 INFO:tasks.workunit.client.1.smithi154.stdout:4/454: dread d0/d2/dc/f20 [0,4194304] 0 2024-05-06T21:26:49.588 INFO:tasks.workunit.client.1.smithi154.stdout:4/455: write d0/d82/d44/d73/d4a/d74/f85 [1877102,28432] 0 2024-05-06T21:26:49.589 INFO:tasks.workunit.client.1.smithi154.stdout:4/456: fdatasync d0/f23 0 2024-05-06T21:26:49.589 INFO:tasks.workunit.client.1.smithi154.stdout:4/457: fsync d0/d2/f69 0 2024-05-06T21:26:49.589 INFO:tasks.workunit.client.1.smithi154.stdout:2/426: dwrite db/de/d10/f5f [0,4194304] 0 2024-05-06T21:26:49.590 INFO:tasks.workunit.client.0.smithi032.stdout:5/800: sync 2024-05-06T21:26:49.590 INFO:tasks.workunit.client.0.smithi032.stdout:9/821: sync 2024-05-06T21:26:49.591 INFO:tasks.workunit.client.1.smithi154.stdout:4/458: symlink d0/d82/d39/d54/l9d 0 2024-05-06T21:26:49.591 INFO:tasks.workunit.client.1.smithi154.stdout:1/523: dread d6/db/d10/d15/f60 [0,4194304] 0 2024-05-06T21:26:49.592 INFO:tasks.workunit.client.0.smithi032.stdout:5/801: unlink d0/d24/d38/d37/c5c 0 2024-05-06T21:26:49.593 INFO:tasks.workunit.client.0.smithi032.stdout:2/663: dwrite df/d19/d1e/d35/d3f/f68 [0,4194304] 0 2024-05-06T21:26:49.593 INFO:tasks.workunit.client.0.smithi032.stdout:2/664: getdents df/d19/d1e/d35/dc5/d2e/dbc/de3 0 2024-05-06T21:26:49.595 INFO:tasks.workunit.client.1.smithi154.stdout:2/427: mknod db/de/c85 0 2024-05-06T21:26:49.595 INFO:tasks.workunit.client.1.smithi154.stdout:2/428: fdatasync db/de/d16/f1f 0 2024-05-06T21:26:49.595 INFO:tasks.workunit.client.0.smithi032.stdout:9/822: rename d1/d2f/da1/dc2/d59/fd4 to d1/d13/d34/d92/f11b 0 2024-05-06T21:26:49.596 INFO:tasks.workunit.client.0.smithi032.stdout:5/802: mkdir d0/d16/d46/d78/d89/dfb 0 2024-05-06T21:26:49.596 INFO:tasks.workunit.client.0.smithi032.stdout:5/803: fdatasync d0/d16/fce 0 2024-05-06T21:26:49.596 INFO:tasks.workunit.client.0.smithi032.stdout:5/804: read d0/d24/d38/d37/df0/d50/f6e [168321,47747] 0 2024-05-06T21:26:49.596 INFO:tasks.workunit.client.1.smithi154.stdout:1/524: link d6/f8 d6/db/f99 0 2024-05-06T21:26:49.597 INFO:tasks.workunit.client.1.smithi154.stdout:1/525: chown d6/db/d10/d26/l5c 850 1 2024-05-06T21:26:49.597 INFO:tasks.workunit.client.0.smithi032.stdout:0/748: dwrite d4/da/f55 [0,4194304] 0 2024-05-06T21:26:49.599 INFO:tasks.workunit.client.0.smithi032.stdout:9/823: creat d1/d13/d33/d3f/f11c x:0 0 0 2024-05-06T21:26:49.599 INFO:tasks.workunit.client.1.smithi154.stdout:5/523: dwrite d2/d3/d21/d95/dc/d71/f98 [0,4194304] 0 2024-05-06T21:26:49.602 INFO:tasks.workunit.client.0.smithi032.stdout:0/749: rename d4/d3e/d63/dca/lab to d4/da/d16/lf6 0 2024-05-06T21:26:49.602 INFO:tasks.workunit.client.0.smithi032.stdout:0/750: stat d4/da/d16/d33/d9e/dcf/lf4 0 2024-05-06T21:26:49.605 INFO:tasks.workunit.client.0.smithi032.stdout:9/824: link d1/d13/d33/d3f/d60/f7e d1/d13/d34/d26/d39/f11d 0 2024-05-06T21:26:49.605 INFO:tasks.workunit.client.1.smithi154.stdout:5/524: dread d2/d3/d21/d95/f83 [0,4194304] 0 2024-05-06T21:26:49.605 INFO:tasks.workunit.client.1.smithi154.stdout:5/525: stat d2/d3/d21/d95/dc/d68/d69/f91 0 2024-05-06T21:26:49.606 INFO:tasks.workunit.client.0.smithi032.stdout:0/751: creat d4/da/d16/d33/da7/dbd/ff7 x:0 0 0 2024-05-06T21:26:49.610 INFO:tasks.workunit.client.0.smithi032.stdout:0/752: rmdir d4/d3e/d63/d6c/d8f/dc2 39 2024-05-06T21:26:49.610 INFO:tasks.workunit.client.1.smithi154.stdout:1/526: write d6/db/d10/f77 [2212139,62064] 0 2024-05-06T21:26:49.613 INFO:tasks.workunit.client.0.smithi032.stdout:0/753: rename d4/da/l13 to d4/da/d14/d1a/d66/lf8 0 2024-05-06T21:26:49.613 INFO:tasks.workunit.client.1.smithi154.stdout:7/367: dwrite d6/d42/d6c/d6e/d23/f28 [0,4194304] 0 2024-05-06T21:26:49.614 INFO:tasks.workunit.client.1.smithi154.stdout:0/548: sync 2024-05-06T21:26:49.614 INFO:tasks.workunit.client.1.smithi154.stdout:8/410: sync 2024-05-06T21:26:49.615 INFO:tasks.workunit.client.0.smithi032.stdout:0/754: mkdir d4/da/d16/d4f/df9 0 2024-05-06T21:26:49.615 INFO:tasks.workunit.client.0.smithi032.stdout:0/755: write d4/da/d16/f53 [560110,86236] 0 2024-05-06T21:26:49.616 INFO:tasks.workunit.client.0.smithi032.stdout:0/756: chown d4/d3e/d63/dca/l9f 14 1 2024-05-06T21:26:49.617 INFO:tasks.workunit.client.1.smithi154.stdout:7/368: write d6/f10 [2462717,59067] 0 2024-05-06T21:26:49.618 INFO:tasks.workunit.client.1.smithi154.stdout:0/549: mkdir d6/dc/d40/d5e/db5 0 2024-05-06T21:26:49.618 INFO:tasks.workunit.client.0.smithi032.stdout:0/757: getdents d4/d3e/d63/d8d 0 2024-05-06T21:26:49.618 INFO:tasks.workunit.client.0.smithi032.stdout:0/758: write d4/d3e/d63/dca/f52 [2407551,1182] 0 2024-05-06T21:26:49.619 INFO:tasks.workunit.client.1.smithi154.stdout:7/369: truncate d6/f32 4053595 0 2024-05-06T21:26:49.619 INFO:tasks.workunit.client.1.smithi154.stdout:8/411: dread d3/d14/d1a/d29/f74 [0,4194304] 0 2024-05-06T21:26:49.620 INFO:tasks.workunit.client.0.smithi032.stdout:0/759: creat d4/da/d14/d1a/dde/ffa x:0 0 0 2024-05-06T21:26:49.621 INFO:tasks.workunit.client.1.smithi154.stdout:0/550: rename d6/dc/c2b to d6/d27/cb6 0 2024-05-06T21:26:49.621 INFO:tasks.workunit.client.1.smithi154.stdout:0/551: write d6/dc/d51/d54/f77 [2264421,99247] 0 2024-05-06T21:26:49.622 INFO:tasks.workunit.client.1.smithi154.stdout:8/412: rmdir d3/d14/d1a/d29/d32/d40/d79/d72 0 2024-05-06T21:26:49.625 INFO:tasks.workunit.client.1.smithi154.stdout:5/526: read d2/d3/d21/d95/dd/d2a/f3d [836768,106170] 0 2024-05-06T21:26:49.625 INFO:tasks.workunit.client.1.smithi154.stdout:8/413: link d3/d14/d1a/d29/d32/l37 d3/d14/d1a/d29/d68/d6b/l86 0 2024-05-06T21:26:49.625 INFO:tasks.workunit.client.1.smithi154.stdout:8/414: chown d3/d14/d1a/d29/d32/d40/d59/f41 24754211 1 2024-05-06T21:26:49.626 INFO:tasks.workunit.client.1.smithi154.stdout:7/370: dread d6/d54/f58 [4194304,4194304] 0 2024-05-06T21:26:49.629 INFO:tasks.workunit.client.1.smithi154.stdout:7/371: creat d6/d42/d6c/d6e/d5e/f71 x:0 0 0 2024-05-06T21:26:49.631 INFO:tasks.workunit.client.1.smithi154.stdout:1/527: write d6/db/d10/d15/f4a [6608018,95459] 0 2024-05-06T21:26:49.631 INFO:tasks.workunit.client.1.smithi154.stdout:1/528: truncate d6/f28 1434296 0 2024-05-06T21:26:49.631 INFO:tasks.workunit.client.1.smithi154.stdout:1/529: dread - d6/d3e/f82 zero size 2024-05-06T21:26:49.639 INFO:tasks.workunit.client.1.smithi154.stdout:7/372: dread d6/fb [0,4194304] 0 2024-05-06T21:26:49.639 INFO:tasks.workunit.client.1.smithi154.stdout:7/373: write d6/d42/d6c/d6e/d23/f6f [232341,95003] 0 2024-05-06T21:26:49.639 INFO:tasks.workunit.client.1.smithi154.stdout:7/374: fsync d6/d20/d40/f50 0 2024-05-06T21:26:49.640 INFO:tasks.workunit.client.1.smithi154.stdout:8/415: dread d3/ff [0,4194304] 0 2024-05-06T21:26:49.640 INFO:tasks.workunit.client.1.smithi154.stdout:2/429: dwrite db/de/f1c [0,4194304] 0 2024-05-06T21:26:49.640 INFO:tasks.workunit.client.1.smithi154.stdout:2/430: fsync db/f71 0 2024-05-06T21:26:49.640 INFO:tasks.workunit.client.1.smithi154.stdout:2/431: chown db/d12/d4e/d55/f7a 361443 1 2024-05-06T21:26:49.641 INFO:tasks.workunit.client.1.smithi154.stdout:7/375: rename d6/d20/c6b to d6/c72 0 2024-05-06T21:26:49.642 INFO:tasks.workunit.client.1.smithi154.stdout:8/416: unlink d3/d14/c2d 0 2024-05-06T21:26:49.643 INFO:tasks.workunit.client.1.smithi154.stdout:8/417: truncate d3/d38/f63 2460724 0 2024-05-06T21:26:49.643 INFO:tasks.workunit.client.1.smithi154.stdout:8/418: write d3/d14/f19 [2473801,124417] 0 2024-05-06T21:26:49.643 INFO:tasks.workunit.client.1.smithi154.stdout:1/530: dread d6/db/f5b [0,4194304] 0 2024-05-06T21:26:49.645 INFO:tasks.workunit.client.1.smithi154.stdout:2/432: unlink db/d12/f77 0 2024-05-06T21:26:49.645 INFO:tasks.workunit.client.1.smithi154.stdout:1/531: symlink d6/db/d69/d89/l9a 0 2024-05-06T21:26:49.645 INFO:tasks.workunit.client.1.smithi154.stdout:1/532: write d6/f24 [2350648,115509] 0 2024-05-06T21:26:49.645 INFO:tasks.workunit.client.1.smithi154.stdout:1/533: fdatasync d6/db/d10/d15/f20 0 2024-05-06T21:26:49.649 INFO:tasks.workunit.client.1.smithi154.stdout:2/433: write db/d12/d1d/f48 [5207786,57128] 0 2024-05-06T21:26:49.655 INFO:tasks.workunit.client.0.smithi032.stdout:2/665: dwrite df/d19/d1e/d71/d5f/d7d/f9c [0,4194304] 0 2024-05-06T21:26:49.655 INFO:tasks.workunit.client.0.smithi032.stdout:2/666: fsync df/d19/d1e/d35/dc5/d2e/f7e 0 2024-05-06T21:26:49.657 INFO:tasks.workunit.client.1.smithi154.stdout:4/459: dwrite d0/d82/d3d/f6b [0,4194304] 0 2024-05-06T21:26:49.657 INFO:tasks.workunit.client.1.smithi154.stdout:4/460: creat d0/d82/d39/d63/f9e x:0 0 0 2024-05-06T21:26:49.657 INFO:tasks.workunit.client.1.smithi154.stdout:4/461: truncate d0/d10/d11/f46 222578 0 2024-05-06T21:26:49.657 INFO:tasks.workunit.client.0.smithi032.stdout:2/667: rmdir df/d19/d1e/d35/dc5 39 2024-05-06T21:26:49.658 INFO:tasks.workunit.client.0.smithi032.stdout:2/668: write df/d19/d1e/d35/dc5/d2e/f7e [946111,79469] 0 2024-05-06T21:26:49.658 INFO:tasks.workunit.client.1.smithi154.stdout:0/552: dwrite d6/dc/d42/f59 [0,4194304] 0 2024-05-06T21:26:49.658 INFO:tasks.workunit.client.1.smithi154.stdout:0/553: write d6/dc/f61 [88437,29421] 0 2024-05-06T21:26:49.659 INFO:tasks.workunit.client.0.smithi032.stdout:5/805: dwrite d0/d24/d38/d37/d7b/dc0/fe0 [0,4194304] 0 2024-05-06T21:26:49.659 INFO:tasks.workunit.client.0.smithi032.stdout:5/806: stat d0/d16/d2a/d5f/dd6 0 2024-05-06T21:26:49.659 INFO:tasks.workunit.client.1.smithi154.stdout:6/327: dwrite d8/f10 [4194304,4194304] 0 2024-05-06T21:26:49.664 INFO:tasks.workunit.client.0.smithi032.stdout:9/825: dwrite d1/f1a [4194304,4194304] 0 2024-05-06T21:26:49.668 INFO:tasks.workunit.client.1.smithi154.stdout:4/462: rename d0/f22 to d0/d2/f9f 0 2024-05-06T21:26:49.668 INFO:tasks.workunit.client.1.smithi154.stdout:4/463: readlink d0/d82/d39/d54/l9d 0 2024-05-06T21:26:49.669 INFO:tasks.workunit.client.0.smithi032.stdout:0/760: rmdir d4/d3e/d63 39 2024-05-06T21:26:49.672 INFO:tasks.workunit.client.1.smithi154.stdout:1/534: dwrite d6/d3e/f88 [0,4194304] 0 2024-05-06T21:26:49.676 INFO:tasks.workunit.client.0.smithi032.stdout:2/669: write df/d19/d1e/d35/f6d [888969,60354] 0 2024-05-06T21:26:49.679 INFO:tasks.workunit.client.1.smithi154.stdout:4/464: rename d0/d82/d3d/l49 to d0/d2/d29/d8f/la0 0 2024-05-06T21:26:49.679 INFO:tasks.workunit.client.1.smithi154.stdout:4/465: readlink d0/d82/d3d/l9b 0 2024-05-06T21:26:49.679 INFO:tasks.workunit.client.1.smithi154.stdout:4/466: readlink d0/d82/l7b 0 2024-05-06T21:26:49.681 INFO:tasks.workunit.client.1.smithi154.stdout:1/535: truncate d6/db/f34 2691301 0 2024-05-06T21:26:49.683 INFO:tasks.workunit.client.1.smithi154.stdout:6/328: getdents d8 0 2024-05-06T21:26:49.684 INFO:tasks.workunit.client.1.smithi154.stdout:4/467: truncate d0/d82/d44/f68 551656 0 2024-05-06T21:26:49.684 INFO:tasks.workunit.client.1.smithi154.stdout:7/376: dwrite d6/d42/d6c/d6e/d23/f6f [0,4194304] 0 2024-05-06T21:26:49.685 INFO:tasks.workunit.client.1.smithi154.stdout:8/419: dwrite d3/d14/d1a/d29/d3e/f66 [0,4194304] 0 2024-05-06T21:26:49.685 INFO:tasks.workunit.client.1.smithi154.stdout:8/420: fdatasync d3/d14/d1a/f28 0 2024-05-06T21:26:49.686 INFO:tasks.workunit.client.1.smithi154.stdout:1/536: getdents d6/db/d10/d15 0 2024-05-06T21:26:49.686 INFO:tasks.workunit.client.1.smithi154.stdout:2/434: dwrite db/de/d16/d33/f44 [0,4194304] 0 2024-05-06T21:26:49.688 INFO:tasks.workunit.client.1.smithi154.stdout:7/377: link d6/c2b d6/d46/d5c/c73 0 2024-05-06T21:26:49.688 INFO:tasks.workunit.client.1.smithi154.stdout:7/378: fdatasync d6/f10 0 2024-05-06T21:26:49.688 INFO:tasks.workunit.client.1.smithi154.stdout:7/379: dread - d6/d42/d6c/d6e/d5e/f71 zero size 2024-05-06T21:26:49.692 INFO:tasks.workunit.client.0.smithi032.stdout:9/826: dread d1/d13/d34/d26/d49/fea [0,4194304] 0 2024-05-06T21:26:49.692 INFO:tasks.workunit.client.0.smithi032.stdout:9/827: fdatasync d1/d13/d33/d5e/d78/f83 0 2024-05-06T21:26:49.693 INFO:tasks.workunit.client.1.smithi154.stdout:8/421: rename d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/l82 to d3/d14/d1a/d45/l87 0 2024-05-06T21:26:49.693 INFO:tasks.workunit.client.0.smithi032.stdout:2/670: dread df/f8b [0,4194304] 0 2024-05-06T21:26:49.693 INFO:tasks.workunit.client.1.smithi154.stdout:6/329: dread d8/d11/f24 [0,4194304] 0 2024-05-06T21:26:49.695 INFO:tasks.workunit.client.1.smithi154.stdout:1/537: mknod d6/db/d10/d15/c9b 0 2024-05-06T21:26:49.695 INFO:tasks.workunit.client.1.smithi154.stdout:1/538: write d6/db/f6f [856982,112627] 0 2024-05-06T21:26:49.697 INFO:tasks.workunit.client.1.smithi154.stdout:6/330: dread d8/d11/f24 [0,4194304] 0 2024-05-06T21:26:49.698 INFO:tasks.workunit.client.0.smithi032.stdout:0/761: dwrite d4/da/d14/d1a/d66/f70 [0,4194304] 0 2024-05-06T21:26:49.698 INFO:tasks.workunit.client.0.smithi032.stdout:0/762: write d4/da/d14/fe5 [378716,5248] 0 2024-05-06T21:26:49.698 INFO:tasks.workunit.client.1.smithi154.stdout:6/331: read d8/d13/f28 [385648,70701] 0 2024-05-06T21:26:49.699 INFO:tasks.workunit.client.1.smithi154.stdout:2/435: rmdir db/d12/d19 39 2024-05-06T21:26:49.700 INFO:tasks.workunit.client.0.smithi032.stdout:0/763: rmdir d4/da/d14/d1a 39 2024-05-06T21:26:49.701 INFO:tasks.workunit.client.0.smithi032.stdout:0/764: rename d4/da/d16/d4f/df9 to d4/da/d16/d33/da7/dbd/dfb 0 2024-05-06T21:26:49.702 INFO:tasks.workunit.client.1.smithi154.stdout:7/380: symlink d6/d20/d40/d52/l74 0 2024-05-06T21:26:49.702 INFO:tasks.workunit.client.1.smithi154.stdout:8/422: dread d3/d14/d1a/d29/d43/f5d [0,4194304] 0 2024-05-06T21:26:49.703 INFO:tasks.workunit.client.0.smithi032.stdout:0/765: mknod d4/d3e/d63/cfc 0 2024-05-06T21:26:49.704 INFO:tasks.workunit.client.0.smithi032.stdout:0/766: link d4/da/d16/f3c d4/d96/ffd 0 2024-05-06T21:26:49.704 INFO:tasks.workunit.client.0.smithi032.stdout:2/671: write df/d19/d1e/d71/d5f/d7d/d25/f4b [423289,101674] 0 2024-05-06T21:26:49.705 INFO:tasks.workunit.client.0.smithi032.stdout:0/767: write d4/da/d14/d1a/fb6 [100512,21683] 0 2024-05-06T21:26:49.705 INFO:tasks.workunit.client.0.smithi032.stdout:9/828: dwrite d1/d13/d34/d26/d39/d45/fa9 [0,4194304] 0 2024-05-06T21:26:49.705 INFO:tasks.workunit.client.0.smithi032.stdout:9/829: stat d1/d13/d34/fe4 0 2024-05-06T21:26:49.706 INFO:tasks.workunit.client.1.smithi154.stdout:6/332: unlink d8/d13/l44 0 2024-05-06T21:26:49.708 INFO:tasks.workunit.client.0.smithi032.stdout:9/830: rename d1/d13/d34/d26/d39/d8b/f11a to d1/d2f/da1/dc2/d64/ddf/dec/f11e 0 2024-05-06T21:26:49.708 INFO:tasks.workunit.client.1.smithi154.stdout:7/381: mknod d6/d42/d6c/d6e/d21/d69/c75 0 2024-05-06T21:26:49.710 INFO:tasks.workunit.client.1.smithi154.stdout:8/423: creat d3/d14/d1a/d29/d32/d40/d79/f88 x:0 0 0 2024-05-06T21:26:49.716 INFO:tasks.workunit.client.1.smithi154.stdout:1/539: link d6/d3e/f75 d6/db/d10/d15/f9c 0 2024-05-06T21:26:49.718 INFO:tasks.workunit.client.0.smithi032.stdout:2/672: dread df/d19/d1e/d54/f58 [0,4194304] 0 2024-05-06T21:26:49.720 INFO:tasks.workunit.client.1.smithi154.stdout:6/333: link d8/c1e d8/d11/d2d/d3d/c6a 0 2024-05-06T21:26:49.722 INFO:tasks.workunit.client.1.smithi154.stdout:4/468: truncate d0/d82/d44/d73/d4a/f8c 3504560 0 2024-05-06T21:26:49.722 INFO:tasks.workunit.client.1.smithi154.stdout:2/436: rmdir db/d12/d1d/d60/d63 39 2024-05-06T21:26:49.723 INFO:tasks.workunit.client.1.smithi154.stdout:6/334: dread d8/d11/d2d/d57/f5d [0,4194304] 0 2024-05-06T21:26:49.723 INFO:tasks.workunit.client.1.smithi154.stdout:6/335: dread - d8/d11/f67 zero size 2024-05-06T21:26:49.724 INFO:tasks.workunit.client.1.smithi154.stdout:7/382: creat d6/d42/d6c/d6e/f76 x:0 0 0 2024-05-06T21:26:49.724 INFO:tasks.workunit.client.1.smithi154.stdout:1/540: dread d6/db/d10/d26/f8f [0,4194304] 0 2024-05-06T21:26:49.724 INFO:tasks.workunit.client.0.smithi032.stdout:0/768: dwrite d4/d3e/fe0 [0,4194304] 0 2024-05-06T21:26:49.726 INFO:tasks.workunit.client.1.smithi154.stdout:4/469: symlink d0/d2/d29/la1 0 2024-05-06T21:26:49.726 INFO:tasks.workunit.client.0.smithi032.stdout:9/831: dwrite d1/d13/d34/d92/fb7 [0,4194304] 0 2024-05-06T21:26:49.726 INFO:tasks.workunit.client.0.smithi032.stdout:0/769: symlink d4/da/d16/d33/d9e/dc9/dcb/lfe 0 2024-05-06T21:26:49.726 INFO:tasks.workunit.client.0.smithi032.stdout:9/832: readlink d1/d13/d34/d26/d39/d45/ld7 0 2024-05-06T21:26:49.727 INFO:tasks.workunit.client.1.smithi154.stdout:2/437: mkdir db/d86 0 2024-05-06T21:26:49.727 INFO:tasks.workunit.client.1.smithi154.stdout:1/541: dread d6/f7f [0,4194304] 0 2024-05-06T21:26:49.727 INFO:tasks.workunit.client.1.smithi154.stdout:1/542: readlink d6/db/l79 0 2024-05-06T21:26:49.728 INFO:tasks.workunit.client.0.smithi032.stdout:9/833: rmdir d1/d2f/d4f 39 2024-05-06T21:26:49.728 INFO:tasks.workunit.client.0.smithi032.stdout:2/673: dread df/d19/d1e/d42/dc6/dc1/fdb [0,4194304] 0 2024-05-06T21:26:49.728 INFO:tasks.workunit.client.1.smithi154.stdout:4/470: unlink d0/d2/dc/f5c 0 2024-05-06T21:26:49.729 INFO:tasks.workunit.client.0.smithi032.stdout:0/770: creat d4/d3e/d63/d6c/d8f/dc2/fff x:0 0 0 2024-05-06T21:26:49.729 INFO:tasks.workunit.client.0.smithi032.stdout:0/771: readlink d4/da/d14/d1a/d66/dbc/lf2 0 2024-05-06T21:26:49.729 INFO:tasks.workunit.client.0.smithi032.stdout:9/834: rmdir d1/d2f/da1/dc2/d64/ddf/dec 39 2024-05-06T21:26:49.730 INFO:tasks.workunit.client.0.smithi032.stdout:9/835: fsync d1/d2f/da1/dc2/ff8 0 2024-05-06T21:26:49.730 INFO:tasks.workunit.client.1.smithi154.stdout:2/438: creat db/de/d10/f87 x:0 0 0 2024-05-06T21:26:49.731 INFO:tasks.workunit.client.0.smithi032.stdout:0/772: rename d4/da/d16/d4f/f75 to d4/da/d14/d1a/d66/d8a/f100 0 2024-05-06T21:26:49.731 INFO:tasks.workunit.client.0.smithi032.stdout:0/773: chown d4/da/d14/f47 4 1 2024-05-06T21:26:49.732 INFO:tasks.workunit.client.1.smithi154.stdout:4/471: stat d0/d82/d39/d54/c97 0 2024-05-06T21:26:49.732 INFO:tasks.workunit.client.1.smithi154.stdout:4/472: fdatasync d0/d2/f4c 0 2024-05-06T21:26:49.732 INFO:tasks.workunit.client.1.smithi154.stdout:4/473: stat d0/d82/d44/d73/d4a/d74/d75/c9c 0 2024-05-06T21:26:49.733 INFO:tasks.workunit.client.1.smithi154.stdout:7/383: read d6/f3b [5339037,32266] 0 2024-05-06T21:26:49.733 INFO:tasks.workunit.client.0.smithi032.stdout:9/836: mknod d1/d2f/da1/dc2/da0/dd1/c11f 0 2024-05-06T21:26:49.733 INFO:tasks.workunit.client.0.smithi032.stdout:9/837: write d1/d13/d33/d3f/d60/fbd [260451,97490] 0 2024-05-06T21:26:49.734 INFO:tasks.workunit.client.1.smithi154.stdout:2/439: link db/de/d10/f30 db/d86/f88 0 2024-05-06T21:26:49.734 INFO:tasks.workunit.client.1.smithi154.stdout:2/440: fsync db/de/d16/f3f 0 2024-05-06T21:26:49.734 INFO:tasks.workunit.client.1.smithi154.stdout:3/639: sync 2024-05-06T21:26:49.735 INFO:tasks.workunit.client.0.smithi032.stdout:9/838: read d1/d13/d34/d26/d39/d45/f52 [91211,113329] 0 2024-05-06T21:26:49.735 INFO:tasks.workunit.client.0.smithi032.stdout:0/774: rmdir d4/da/d98 39 2024-05-06T21:26:49.736 INFO:tasks.workunit.client.1.smithi154.stdout:1/543: truncate d6/db/d10/d15/d1d/f61 3836298 0 2024-05-06T21:26:49.736 INFO:tasks.workunit.client.1.smithi154.stdout:1/544: chown d6/db/d10/d15 39535 1 2024-05-06T21:26:49.736 INFO:tasks.workunit.client.1.smithi154.stdout:1/545: truncate d6/db/d10/f35 1306806 0 2024-05-06T21:26:49.737 INFO:tasks.workunit.client.0.smithi032.stdout:2/674: write df/d19/d1e/d71/d5f/d7d/f92 [3620733,31265] 0 2024-05-06T21:26:49.737 INFO:tasks.workunit.client.0.smithi032.stdout:2/675: write df/f2c [4476311,93568] 0 2024-05-06T21:26:49.737 INFO:tasks.workunit.client.0.smithi032.stdout:2/676: chown df/d19/d1e/d54/f8e 15707 1 2024-05-06T21:26:49.739 INFO:tasks.workunit.client.1.smithi154.stdout:7/384: rmdir d6/d42/d6c 39 2024-05-06T21:26:49.742 INFO:tasks.workunit.client.1.smithi154.stdout:2/441: symlink db/de/d16/d4f/l89 0 2024-05-06T21:26:49.742 INFO:tasks.workunit.client.1.smithi154.stdout:2/442: dread - db/d12/d19/f56 zero size 2024-05-06T21:26:49.742 INFO:tasks.workunit.client.1.smithi154.stdout:2/443: write db/de/d16/f27 [2895386,34699] 0 2024-05-06T21:26:49.745 INFO:tasks.workunit.client.0.smithi032.stdout:2/677: rmdir df/d19/d1e/d42/dc6/dc1/dc7 0 2024-05-06T21:26:49.745 INFO:tasks.workunit.client.0.smithi032.stdout:0/775: dread d4/da/d16/f2c [0,4194304] 0 2024-05-06T21:26:49.747 INFO:tasks.workunit.client.1.smithi154.stdout:1/546: truncate d6/db/d10/d15/f39 560659 0 2024-05-06T21:26:49.748 INFO:tasks.workunit.client.1.smithi154.stdout:7/385: creat d6/d42/d6c/f77 x:0 0 0 2024-05-06T21:26:49.748 INFO:tasks.workunit.client.1.smithi154.stdout:1/547: readlink d6/db/d10/d15/d1d/l2a 0 2024-05-06T21:26:49.752 INFO:tasks.workunit.client.1.smithi154.stdout:2/444: write db/de/d16/d33/f4d [2860542,100923] 0 2024-05-06T21:26:49.752 INFO:tasks.workunit.client.1.smithi154.stdout:2/445: write db/d12/f37 [931974,20881] 0 2024-05-06T21:26:49.752 INFO:tasks.workunit.client.1.smithi154.stdout:2/446: fdatasync db/f3c 0 2024-05-06T21:26:49.752 INFO:tasks.workunit.client.1.smithi154.stdout:1/548: truncate d6/d3e/f72 8126417 0 2024-05-06T21:26:49.752 INFO:tasks.workunit.client.1.smithi154.stdout:1/549: getdents d6/d3e/d7e 0 2024-05-06T21:26:49.754 INFO:tasks.workunit.client.1.smithi154.stdout:7/386: creat d6/d42/d6c/d6e/d21/d69/f78 x:0 0 0 2024-05-06T21:26:49.754 INFO:tasks.workunit.client.1.smithi154.stdout:7/387: creat d6/d20/f79 x:0 0 0 2024-05-06T21:26:49.756 INFO:tasks.workunit.client.1.smithi154.stdout:2/447: creat db/d12/d1d/f8a x:0 0 0 2024-05-06T21:26:49.758 INFO:tasks.workunit.client.1.smithi154.stdout:3/640: dwrite d0/da/db/dd/f3c [0,4194304] 0 2024-05-06T21:26:49.761 INFO:tasks.workunit.client.1.smithi154.stdout:2/448: rmdir db/de/d10/d7e 0 2024-05-06T21:26:49.761 INFO:tasks.workunit.client.1.smithi154.stdout:2/449: write db/d12/d1d/d60/d63/f66 [379232,21130] 0 2024-05-06T21:26:49.762 INFO:tasks.workunit.client.1.smithi154.stdout:2/450: chown db/de 9063393 1 2024-05-06T21:26:49.763 INFO:tasks.workunit.client.1.smithi154.stdout:3/641: link d0/da/d1a/d28/l12 d0/da/db/ldb 0 2024-05-06T21:26:49.763 INFO:tasks.workunit.client.1.smithi154.stdout:3/642: write d0/da/db/dd/d1c/d21/d37/fc1 [1059622,12585] 0 2024-05-06T21:26:49.763 INFO:tasks.workunit.client.1.smithi154.stdout:3/643: fsync d0/da/db/d7c/fb9 0 2024-05-06T21:26:49.768 INFO:tasks.workunit.client.1.smithi154.stdout:3/644: rename d0/da/db/ldb to d0/da/db/d7c/ldc 0 2024-05-06T21:26:49.768 INFO:tasks.workunit.client.1.smithi154.stdout:3/645: fdatasync d0/da/db/f2a 0 2024-05-06T21:26:49.768 INFO:tasks.workunit.client.1.smithi154.stdout:3/646: dread - d0/da/d1a/d28/dbc/fba zero size 2024-05-06T21:26:49.770 INFO:tasks.workunit.client.1.smithi154.stdout:4/474: dwrite d0/f3b [0,4194304] 0 2024-05-06T21:26:49.771 INFO:tasks.workunit.client.0.smithi032.stdout:9/839: dwrite d1/d2f/da1/fe6 [0,4194304] 0 2024-05-06T21:26:49.772 INFO:tasks.workunit.client.0.smithi032.stdout:9/840: fdatasync d1/d13/d34/fe4 0 2024-05-06T21:26:49.772 INFO:tasks.workunit.client.0.smithi032.stdout:0/776: dwrite d4/fea [0,4194304] 0 2024-05-06T21:26:49.772 INFO:tasks.workunit.client.0.smithi032.stdout:0/777: stat d4/da/d16/f3b 0 2024-05-06T21:26:49.772 INFO:tasks.workunit.client.0.smithi032.stdout:0/778: read - d4/da/d16/d33/da7/dbd/ff7 zero size 2024-05-06T21:26:49.773 INFO:tasks.workunit.client.0.smithi032.stdout:0/779: write d4/f1f [9202817,4826] 0 2024-05-06T21:26:49.773 INFO:tasks.workunit.client.0.smithi032.stdout:9/841: dread d1/d2f/da1/dc2/d59/f86 [0,4194304] 0 2024-05-06T21:26:49.773 INFO:tasks.workunit.client.0.smithi032.stdout:2/678: dwrite df/d19/d1e/d35/dc5/d2e/d33/f29 [4194304,4194304] 0 2024-05-06T21:26:49.775 INFO:tasks.workunit.client.1.smithi154.stdout:9/555: sync 2024-05-06T21:26:49.775 INFO:tasks.workunit.client.1.smithi154.stdout:9/556: truncate d5/d2e/d8b/fa4 567677 0 2024-05-06T21:26:49.776 INFO:tasks.workunit.client.0.smithi032.stdout:0/780: creat d4/da/d16/d33/d9e/dcf/f101 x:0 0 0 2024-05-06T21:26:49.778 INFO:tasks.workunit.client.0.smithi032.stdout:2/679: dread df/d19/d1e/d35/dc5/f2b [0,4194304] 0 2024-05-06T21:26:49.778 INFO:tasks.workunit.client.0.smithi032.stdout:9/842: mknod d1/d13/d34/d26/d9f/ddc/c120 0 2024-05-06T21:26:49.781 INFO:tasks.workunit.client.1.smithi154.stdout:7/388: dwrite d6/d54/f58 [0,4194304] 0 2024-05-06T21:26:49.781 INFO:tasks.workunit.client.1.smithi154.stdout:9/557: dread d5/f1a [0,4194304] 0 2024-05-06T21:26:49.781 INFO:tasks.workunit.client.1.smithi154.stdout:9/558: dread - d5/d20/d52/d6e/fb3 zero size 2024-05-06T21:26:49.782 INFO:tasks.workunit.client.1.smithi154.stdout:9/559: stat d5/d20/d52/cb5 0 2024-05-06T21:26:49.782 INFO:tasks.workunit.client.1.smithi154.stdout:2/451: fsync db/de/d10/f87 0 2024-05-06T21:26:49.784 INFO:tasks.workunit.client.0.smithi032.stdout:9/843: symlink d1/d13/l121 0 2024-05-06T21:26:49.784 INFO:tasks.workunit.client.0.smithi032.stdout:9/844: write d1/d13/d34/d26/d39/f11d [840343,73063] 0 2024-05-06T21:26:49.785 INFO:tasks.workunit.client.0.smithi032.stdout:0/781: dread d4/d96/fdd [0,4194304] 0 2024-05-06T21:26:49.785 INFO:tasks.workunit.client.0.smithi032.stdout:0/782: truncate d4/d3e/d63/f6d 2488286 0 2024-05-06T21:26:49.786 INFO:tasks.workunit.client.1.smithi154.stdout:4/475: creat d0/fa2 x:0 0 0 2024-05-06T21:26:49.786 INFO:tasks.workunit.client.1.smithi154.stdout:4/476: truncate d0/d2/fa 125943 0 2024-05-06T21:26:49.787 INFO:tasks.workunit.client.1.smithi154.stdout:3/647: dread d0/da/db/dd/d1c/d21/f4e [4194304,4194304] 0 2024-05-06T21:26:49.787 INFO:tasks.workunit.client.1.smithi154.stdout:3/648: stat d0/da/d1a/c95 0 2024-05-06T21:26:49.789 INFO:tasks.workunit.client.1.smithi154.stdout:7/389: link d6/l13 d6/d20/d40/d52/l7a 0 2024-05-06T21:26:49.790 INFO:tasks.workunit.client.1.smithi154.stdout:9/560: mknod d5/d14/d31/d39/cc2 0 2024-05-06T21:26:49.791 INFO:tasks.workunit.client.1.smithi154.stdout:3/649: truncate d0/d2/f25 3479085 0 2024-05-06T21:26:49.791 INFO:tasks.workunit.client.1.smithi154.stdout:3/650: chown d0/da/d1a/d28/dbc/d81/d48/f65 1229 1 2024-05-06T21:26:49.791 INFO:tasks.workunit.client.1.smithi154.stdout:7/390: fsync d6/d42/d6c/f77 0 2024-05-06T21:26:49.794 INFO:tasks.workunit.client.0.smithi032.stdout:9/845: unlink d1/d13/d34/d26/d39/d8b/la8 0 2024-05-06T21:26:49.796 INFO:tasks.workunit.client.0.smithi032.stdout:0/783: unlink d4/d3e/d63/f6d 0 2024-05-06T21:26:49.796 INFO:tasks.workunit.client.1.smithi154.stdout:9/561: creat d5/d14/d31/d39/fc3 x:0 0 0 2024-05-06T21:26:49.797 INFO:tasks.workunit.client.1.smithi154.stdout:3/651: mknod d0/da/d1a/dbf/cdd 0 2024-05-06T21:26:49.797 INFO:tasks.workunit.client.1.smithi154.stdout:3/652: creat d0/da/db/d52/d62/fde x:0 0 0 2024-05-06T21:26:49.797 INFO:tasks.workunit.client.1.smithi154.stdout:3/653: read - d0/d2/fc7 zero size 2024-05-06T21:26:49.798 INFO:tasks.workunit.client.0.smithi032.stdout:9/846: link d1/d13/d33/d5e/le8 d1/d2f/da1/l122 0 2024-05-06T21:26:49.799 INFO:tasks.workunit.client.1.smithi154.stdout:7/391: mkdir d6/d42/d6c/d6e/d21/d69/d7b 0 2024-05-06T21:26:49.799 INFO:tasks.workunit.client.1.smithi154.stdout:7/392: write d6/d42/d6c/f77 [674749,8117] 0 2024-05-06T21:26:49.799 INFO:tasks.workunit.client.1.smithi154.stdout:7/393: chown d6/d20/d40 91752 1 2024-05-06T21:26:49.799 INFO:tasks.workunit.client.1.smithi154.stdout:7/394: read d6/f10 [382816,15310] 0 2024-05-06T21:26:49.800 INFO:tasks.workunit.client.1.smithi154.stdout:4/477: dread d0/d2/f1b [0,4194304] 0 2024-05-06T21:26:49.800 INFO:tasks.workunit.client.1.smithi154.stdout:4/478: chown d0/d2/f53 5335992 1 2024-05-06T21:26:49.800 INFO:tasks.workunit.client.0.smithi032.stdout:0/784: unlink d4/da/d16/f3c 0 2024-05-06T21:26:49.802 INFO:tasks.workunit.client.0.smithi032.stdout:9/847: rmdir d1/d13/d34/dc6 0 2024-05-06T21:26:49.803 INFO:tasks.workunit.client.1.smithi154.stdout:3/654: symlink d0/da/db/d30/ldf 0 2024-05-06T21:26:49.803 INFO:tasks.workunit.client.1.smithi154.stdout:3/655: creat d0/da/db/d52/d62/fe0 x:0 0 0 2024-05-06T21:26:49.806 INFO:tasks.workunit.client.1.smithi154.stdout:4/479: creat d0/d10/d11/fa3 x:0 0 0 2024-05-06T21:26:49.812 INFO:tasks.workunit.client.1.smithi154.stdout:3/656: mkdir d0/da/db/dd/d1c/d90/de1 0 2024-05-06T21:26:49.815 INFO:tasks.workunit.client.1.smithi154.stdout:5/527: sync 2024-05-06T21:26:49.815 INFO:tasks.workunit.client.1.smithi154.stdout:5/528: chown d2/d3/d21/l90 782475077 1 2024-05-06T21:26:49.817 INFO:tasks.workunit.client.1.smithi154.stdout:5/529: mkdir d2/d3/d21/d95/dd/d2a/d54/d43/db1 0 2024-05-06T21:26:49.821 INFO:tasks.workunit.client.1.smithi154.stdout:5/530: link d2/d3/d21/d22/d25/d37/f46 d2/d3/fb2 0 2024-05-06T21:26:49.823 INFO:tasks.workunit.client.0.smithi032.stdout:2/680: dwrite df/d19/d1e/d35/dc5/d2e/d33/f29 [0,4194304] 0 2024-05-06T21:26:49.823 INFO:tasks.workunit.client.0.smithi032.stdout:2/681: readlink df/d19/d1e/d42/dc6/l81 0 2024-05-06T21:26:49.826 INFO:tasks.workunit.client.1.smithi154.stdout:5/531: creat d2/d3/d21/d95/dd/d2a/d54/d43/d73/fb3 x:0 0 0 2024-05-06T21:26:49.827 INFO:tasks.workunit.client.0.smithi032.stdout:4/866: sync 2024-05-06T21:26:49.827 INFO:tasks.workunit.client.0.smithi032.stdout:6/818: sync 2024-05-06T21:26:49.827 INFO:tasks.workunit.client.0.smithi032.stdout:7/805: sync 2024-05-06T21:26:49.827 INFO:tasks.workunit.client.0.smithi032.stdout:4/867: chown d2/d2c/d31/l3c 0 1 2024-05-06T21:26:49.827 INFO:tasks.workunit.client.0.smithi032.stdout:6/819: fsync d8/f8c 0 2024-05-06T21:26:49.827 INFO:tasks.workunit.client.0.smithi032.stdout:6/820: chown d8/d33/l80 31495876 1 2024-05-06T21:26:49.827 INFO:tasks.workunit.client.0.smithi032.stdout:6/821: chown d8/d3d/d49/d6b/f8a 20 1 2024-05-06T21:26:49.831 INFO:tasks.workunit.client.0.smithi032.stdout:4/868: truncate d2/d2c/d31/f91 2965207 0 2024-05-06T21:26:49.831 INFO:tasks.workunit.client.0.smithi032.stdout:4/869: write d2/d2c/d31/d7c/dfa/f109 [71691,96962] 0 2024-05-06T21:26:49.831 INFO:tasks.workunit.client.0.smithi032.stdout:4/870: fsync d2/fcb 0 2024-05-06T21:26:49.832 INFO:tasks.workunit.client.0.smithi032.stdout:7/806: symlink db/d12/d16/d2a/d39/d3b/d96/dcd/lfa 0 2024-05-06T21:26:49.835 INFO:tasks.workunit.client.0.smithi032.stdout:4/871: symlink d2/d16/d44/d74/d79/de6/de8/dd8/l113 0 2024-05-06T21:26:49.835 INFO:tasks.workunit.client.1.smithi154.stdout:4/480: read d0/d2/dc/f20 [3753502,83307] 0 2024-05-06T21:26:49.835 INFO:tasks.workunit.client.1.smithi154.stdout:4/481: fsync d0/d82/d39/d63/f9e 0 2024-05-06T21:26:49.836 INFO:tasks.workunit.client.0.smithi032.stdout:7/807: symlink db/d12/d16/d2a/d39/d3b/lfb 0 2024-05-06T21:26:49.836 INFO:tasks.workunit.client.0.smithi032.stdout:4/872: dread - d2/d16/d44/d74/d7e/fd2 zero size 2024-05-06T21:26:49.837 INFO:tasks.workunit.client.0.smithi032.stdout:1/741: sync 2024-05-06T21:26:49.838 INFO:tasks.workunit.client.0.smithi032.stdout:4/873: mknod d2/d16/d44/d74/d79/d88/dd6/df2/c114 0 2024-05-06T21:26:49.840 INFO:tasks.workunit.client.1.smithi154.stdout:7/395: dread d6/d42/d6c/d6e/f19 [0,4194304] 0 2024-05-06T21:26:49.840 INFO:tasks.workunit.client.1.smithi154.stdout:1/550: dwrite d6/db/d10/d15/f39 [0,4194304] 0 2024-05-06T21:26:49.843 INFO:tasks.workunit.client.0.smithi032.stdout:9/848: dwrite d1/d13/d33/da6/ff7 [0,4194304] 0 2024-05-06T21:26:49.843 INFO:tasks.workunit.client.0.smithi032.stdout:9/849: truncate d1/d2f/d4f/d97/fa4 1376109 0 2024-05-06T21:26:49.843 INFO:tasks.workunit.client.0.smithi032.stdout:4/874: link d2/d16/d44/d74/d79/de6/de8/d69/fd3 d2/d16/d44/d74/d79/f115 0 2024-05-06T21:26:49.843 INFO:tasks.workunit.client.0.smithi032.stdout:4/875: truncate d2/d2c/d31/d7c/fd0 639263 0 2024-05-06T21:26:49.847 INFO:tasks.workunit.client.0.smithi032.stdout:7/808: dread db/d12/d16/d2a/f5a [4194304,4194304] 0 2024-05-06T21:26:49.848 INFO:tasks.workunit.client.1.smithi154.stdout:7/396: unlink d6/d42/d6c/d6e/f49 0 2024-05-06T21:26:49.848 INFO:tasks.workunit.client.1.smithi154.stdout:1/551: mknod d6/d3e/c9d 0 2024-05-06T21:26:49.848 INFO:tasks.workunit.client.1.smithi154.stdout:4/482: creat d0/d82/d44/d73/d4a/d74/fa4 x:0 0 0 2024-05-06T21:26:49.849 INFO:tasks.workunit.client.0.smithi032.stdout:4/876: mkdir d2/d16/d44/d74/d79/d116 0 2024-05-06T21:26:49.851 INFO:tasks.workunit.client.0.smithi032.stdout:9/850: rename d1/cf to d1/d13/d33/d5e/c123 0 2024-05-06T21:26:49.851 INFO:tasks.workunit.client.0.smithi032.stdout:1/742: read db/d47/d4a/dcb/fd3 [2925819,65915] 0 2024-05-06T21:26:49.851 INFO:tasks.workunit.client.0.smithi032.stdout:9/851: creat d1/d13/d33/d3f/f124 x:0 0 0 2024-05-06T21:26:49.851 INFO:tasks.workunit.client.0.smithi032.stdout:4/877: symlink d2/d2c/l117 0 2024-05-06T21:26:49.852 INFO:tasks.workunit.client.1.smithi154.stdout:4/483: creat d0/d2/d29/fa5 x:0 0 0 2024-05-06T21:26:49.852 INFO:tasks.workunit.client.1.smithi154.stdout:4/484: read d0/d2/dc/fe [1123743,130567] 0 2024-05-06T21:26:49.852 INFO:tasks.workunit.client.1.smithi154.stdout:7/397: dread d6/d42/d6c/d6e/d23/f28 [4194304,4194304] 0 2024-05-06T21:26:49.853 INFO:tasks.workunit.client.0.smithi032.stdout:9/852: truncate d1/d13/d34/d92/f11b 664059 0 2024-05-06T21:26:49.853 INFO:tasks.workunit.client.1.smithi154.stdout:1/552: mkdir d6/db/d9e 0 2024-05-06T21:26:49.854 INFO:tasks.workunit.client.0.smithi032.stdout:4/878: symlink d2/d16/d44/d74/d79/de6/de8/dd8/l118 0 2024-05-06T21:26:49.854 INFO:tasks.workunit.client.1.smithi154.stdout:9/562: dwrite d5/d14/f43 [0,4194304] 0 2024-05-06T21:26:49.855 INFO:tasks.workunit.client.1.smithi154.stdout:9/563: dread - d5/d20/d37/f64 zero size 2024-05-06T21:26:49.855 INFO:tasks.workunit.client.1.smithi154.stdout:9/564: chown d5/d20/d84/c93 1015 1 2024-05-06T21:26:49.855 INFO:tasks.workunit.client.1.smithi154.stdout:9/565: fdatasync d5/d2e/f35 0 2024-05-06T21:26:49.857 INFO:tasks.workunit.client.1.smithi154.stdout:1/553: mknod d6/db/d10/d94/c9f 0 2024-05-06T21:26:49.857 INFO:tasks.workunit.client.1.smithi154.stdout:7/398: dread d6/f1a [0,4194304] 0 2024-05-06T21:26:49.857 INFO:tasks.workunit.client.1.smithi154.stdout:7/399: fdatasync d6/d42/d6c/d6e/f31 0 2024-05-06T21:26:49.858 INFO:tasks.workunit.client.0.smithi032.stdout:4/879: truncate d2/d13/f56 2423965 0 2024-05-06T21:26:49.858 INFO:tasks.workunit.client.1.smithi154.stdout:3/657: dwrite d0/da/db/dd/d1c/d21/f42 [0,4194304] 0 2024-05-06T21:26:49.859 INFO:tasks.workunit.client.1.smithi154.stdout:3/658: write d0/da/db/dd/d1c/f86 [5052993,18119] 0 2024-05-06T21:26:49.859 INFO:tasks.workunit.client.1.smithi154.stdout:9/566: truncate d5/d2e/d66/f7d 1434969 0 2024-05-06T21:26:49.862 INFO:tasks.workunit.client.1.smithi154.stdout:5/532: dwrite d2/d3/d21/d95/fe [0,4194304] 0 2024-05-06T21:26:49.862 INFO:tasks.workunit.client.1.smithi154.stdout:5/533: dread - d2/d3/d21/d95/dc/d68/f9e zero size 2024-05-06T21:26:49.862 INFO:tasks.workunit.client.1.smithi154.stdout:5/534: readlink d2/d3/d21/l90 0 2024-05-06T21:26:49.862 INFO:tasks.workunit.client.1.smithi154.stdout:4/485: rmdir d0/d82/d44/d73/d4a/d74 39 2024-05-06T21:26:49.864 INFO:tasks.workunit.client.1.smithi154.stdout:5/535: dread d2/d3/d21/fa2 [0,4194304] 0 2024-05-06T21:26:49.864 INFO:tasks.workunit.client.0.smithi032.stdout:1/743: write db/d47/d4a/da4/f4d [3420262,108863] 0 2024-05-06T21:26:49.865 INFO:tasks.workunit.client.0.smithi032.stdout:7/809: dread f3 [4194304,4194304] 0 2024-05-06T21:26:49.866 INFO:tasks.workunit.client.0.smithi032.stdout:9/853: dread d1/d13/d34/d26/d39/d45/f7b [0,4194304] 0 2024-05-06T21:26:49.866 INFO:tasks.workunit.client.0.smithi032.stdout:9/854: stat d1/d13/d33/d3f/d60/f7e 0 2024-05-06T21:26:49.866 INFO:tasks.workunit.client.0.smithi032.stdout:2/682: dwrite df/d19/d1e/d35/d3f/fd2 [0,4194304] 0 2024-05-06T21:26:49.867 INFO:tasks.workunit.client.0.smithi032.stdout:1/744: symlink db/d47/d4a/da4/d4f/lef 0 2024-05-06T21:26:49.867 INFO:tasks.workunit.client.0.smithi032.stdout:1/745: chown db/d16/d46/d57/caa 31282445 1 2024-05-06T21:26:49.868 INFO:tasks.workunit.client.0.smithi032.stdout:4/880: dread d2/d13/f1b [0,4194304] 0 2024-05-06T21:26:49.868 INFO:tasks.workunit.client.1.smithi154.stdout:1/554: write d6/db/d10/d26/f23 [6962722,83327] 0 2024-05-06T21:26:49.869 INFO:tasks.workunit.client.1.smithi154.stdout:3/659: creat d0/da/db/dd/d1c/d21/fe2 x:0 0 0 2024-05-06T21:26:49.869 INFO:tasks.workunit.client.1.smithi154.stdout:3/660: chown d0/da/db/dd/fc 340 1 2024-05-06T21:26:49.869 INFO:tasks.workunit.client.1.smithi154.stdout:1/555: creat d6/d3e/fa0 x:0 0 0 2024-05-06T21:26:49.869 INFO:tasks.workunit.client.1.smithi154.stdout:3/661: dread - d0/da/d1a/d28/d17/f49 zero size 2024-05-06T21:26:49.869 INFO:tasks.workunit.client.1.smithi154.stdout:1/556: creat d6/db/d10/fa1 x:0 0 0 2024-05-06T21:26:49.870 INFO:tasks.workunit.client.0.smithi032.stdout:7/810: mknod db/d12/d49/d97/cfc 0 2024-05-06T21:26:49.870 INFO:tasks.workunit.client.1.smithi154.stdout:9/567: creat d5/d2e/fc4 x:0 0 0 2024-05-06T21:26:49.870 INFO:tasks.workunit.client.1.smithi154.stdout:9/568: fdatasync d5/d14/d87/d65/fa6 0 2024-05-06T21:26:49.870 INFO:tasks.workunit.client.1.smithi154.stdout:7/400: getdents d6/d20 0 2024-05-06T21:26:49.871 INFO:tasks.workunit.client.1.smithi154.stdout:7/401: dread - d6/d42/d6c/d6e/d5e/f71 zero size 2024-05-06T21:26:49.873 INFO:tasks.workunit.client.1.smithi154.stdout:0/554: sync 2024-05-06T21:26:49.873 INFO:tasks.workunit.client.1.smithi154.stdout:8/424: sync 2024-05-06T21:26:49.874 INFO:tasks.workunit.client.0.smithi032.stdout:1/746: mknod db/d47/d70/cf0 0 2024-05-06T21:26:49.874 INFO:tasks.workunit.client.1.smithi154.stdout:4/486: mkdir d0/d82/d39/da6 0 2024-05-06T21:26:49.874 INFO:tasks.workunit.client.1.smithi154.stdout:4/487: fsync d0/d2/dc/f20 0 2024-05-06T21:26:49.875 INFO:tasks.workunit.client.0.smithi032.stdout:4/881: mknod d2/d16/d44/d74/d79/d88/dd6/df2/c119 0 2024-05-06T21:26:49.876 INFO:tasks.workunit.client.0.smithi032.stdout:7/811: mknod db/d12/d16/d2a/d39/d3b/d9c/cfd 0 2024-05-06T21:26:49.878 INFO:tasks.workunit.client.0.smithi032.stdout:1/747: chown db/d16/c3c 31093665 1 2024-05-06T21:26:49.878 INFO:tasks.workunit.client.0.smithi032.stdout:1/748: chown db/d47/l5c 567 1 2024-05-06T21:26:49.878 INFO:tasks.workunit.client.0.smithi032.stdout:1/749: stat db/d37/l67 0 2024-05-06T21:26:49.878 INFO:tasks.workunit.client.1.smithi154.stdout:1/557: mknod d6/d3e/d7e/ca2 0 2024-05-06T21:26:49.879 INFO:tasks.workunit.client.1.smithi154.stdout:3/662: rename d0/d2/f6f to d0/da/d1a/fe3 0 2024-05-06T21:26:49.880 INFO:tasks.workunit.client.0.smithi032.stdout:4/882: rename d2/d2c/d31/l55 to d2/d2c/d31/l11a 0 2024-05-06T21:26:49.880 INFO:tasks.workunit.client.0.smithi032.stdout:7/812: rmdir db/d12 39 2024-05-06T21:26:49.880 INFO:tasks.workunit.client.0.smithi032.stdout:9/855: dread d1/f12 [0,4194304] 0 2024-05-06T21:26:49.880 INFO:tasks.workunit.client.0.smithi032.stdout:9/856: fsync d1/d13/d34/d26/d39/d45/f7b 0 2024-05-06T21:26:49.881 INFO:tasks.workunit.client.1.smithi154.stdout:9/569: creat d5/d14/daf/db8/fc5 x:0 0 0 2024-05-06T21:26:49.881 INFO:tasks.workunit.client.1.smithi154.stdout:1/558: dread d6/f7f [0,4194304] 0 2024-05-06T21:26:49.882 INFO:tasks.workunit.client.1.smithi154.stdout:1/559: write d6/db/d87/f8a [255659,67451] 0 2024-05-06T21:26:49.882 INFO:tasks.workunit.client.0.smithi032.stdout:7/813: write db/d12/d87/fb1 [178090,69630] 0 2024-05-06T21:26:49.882 INFO:tasks.workunit.client.0.smithi032.stdout:7/814: write db/d12/d87/fc2 [207743,98233] 0 2024-05-06T21:26:49.882 INFO:tasks.workunit.client.0.smithi032.stdout:1/750: mkdir db/d47/d4a/dcb/df1 0 2024-05-06T21:26:49.882 INFO:tasks.workunit.client.1.smithi154.stdout:5/536: dwrite d2/d3/d19/f3c [0,4194304] 0 2024-05-06T21:26:49.882 INFO:tasks.workunit.client.1.smithi154.stdout:5/537: fdatasync d2/d3/d21/d95/f83 0 2024-05-06T21:26:49.883 INFO:tasks.workunit.client.1.smithi154.stdout:7/402: creat d6/d46/d5c/f7c x:0 0 0 2024-05-06T21:26:49.883 INFO:tasks.workunit.client.0.smithi032.stdout:9/857: symlink d1/d2f/d4f/l125 0 2024-05-06T21:26:49.884 INFO:tasks.workunit.client.1.smithi154.stdout:0/555: mknod d6/dc/d44/d36/cb7 0 2024-05-06T21:26:49.884 INFO:tasks.workunit.client.1.smithi154.stdout:0/556: fsync d6/fb1 0 2024-05-06T21:26:49.884 INFO:tasks.workunit.client.1.smithi154.stdout:0/557: chown d6/dc/d40 1164830722 1 2024-05-06T21:26:49.884 INFO:tasks.workunit.client.0.smithi032.stdout:7/815: creat db/d12/d49/d97/ffe x:0 0 0 2024-05-06T21:26:49.886 INFO:tasks.workunit.client.0.smithi032.stdout:1/751: mknod db/dc8/cf2 0 2024-05-06T21:26:49.887 INFO:tasks.workunit.client.1.smithi154.stdout:6/336: sync 2024-05-06T21:26:49.887 INFO:tasks.workunit.client.1.smithi154.stdout:4/488: truncate d0/d82/d44/d73/d4a/d74/f85 906504 0 2024-05-06T21:26:49.887 INFO:tasks.workunit.client.1.smithi154.stdout:4/489: readlink d0/d2/dc/l42 0 2024-05-06T21:26:49.888 INFO:tasks.workunit.client.1.smithi154.stdout:3/663: creat d0/da/d1a/d28/dbc/d81/d48/da9/fe4 x:0 0 0 2024-05-06T21:26:49.888 INFO:tasks.workunit.client.1.smithi154.stdout:2/452: sync 2024-05-06T21:26:49.889 INFO:tasks.workunit.client.0.smithi032.stdout:7/816: rename db/ff1 to db/d12/d16/da1/fff 0 2024-05-06T21:26:49.890 INFO:tasks.workunit.client.0.smithi032.stdout:4/883: dread d2/d16/d44/d74/f92 [0,4194304] 0 2024-05-06T21:26:49.891 INFO:tasks.workunit.client.1.smithi154.stdout:9/570: mkdir d5/d2e/d8b/dc6 0 2024-05-06T21:26:49.891 INFO:tasks.workunit.client.1.smithi154.stdout:1/560: write d6/db/d69/f71 [3218239,124481] 0 2024-05-06T21:26:49.891 INFO:tasks.workunit.client.1.smithi154.stdout:6/337: dread d8/d11/d2d/f47 [0,4194304] 0 2024-05-06T21:26:49.892 INFO:tasks.workunit.client.1.smithi154.stdout:5/538: rename d2/l94 to d2/d3/d21/d95/lb4 0 2024-05-06T21:26:49.894 INFO:tasks.workunit.client.1.smithi154.stdout:7/403: creat d6/f7d x:0 0 0 2024-05-06T21:26:49.894 INFO:tasks.workunit.client.1.smithi154.stdout:2/453: dread db/f71 [0,4194304] 0 2024-05-06T21:26:49.894 INFO:tasks.workunit.client.1.smithi154.stdout:0/558: creat d6/dc/d40/fb8 x:0 0 0 2024-05-06T21:26:49.895 INFO:tasks.workunit.client.1.smithi154.stdout:0/559: creat d6/dc/d39/fb9 x:0 0 0 2024-05-06T21:26:49.895 INFO:tasks.workunit.client.0.smithi032.stdout:1/752: creat db/ff3 x:0 0 0 2024-05-06T21:26:49.895 INFO:tasks.workunit.client.0.smithi032.stdout:1/753: chown db/d16/d46/d57/f71 765 1 2024-05-06T21:26:49.895 INFO:tasks.workunit.client.0.smithi032.stdout:7/817: write f3 [6481885,56163] 0 2024-05-06T21:26:49.895 INFO:tasks.workunit.client.1.smithi154.stdout:8/425: symlink d3/d14/d1a/d29/d32/d40/d79/d2b/l89 0 2024-05-06T21:26:49.897 INFO:tasks.workunit.client.1.smithi154.stdout:4/490: unlink d0/d82/d44/d73/d4a/f8c 0 2024-05-06T21:26:49.897 INFO:tasks.workunit.client.1.smithi154.stdout:4/491: chown d0/d10/d11/d1a/d7e 0 1 2024-05-06T21:26:49.897 INFO:tasks.workunit.client.1.smithi154.stdout:4/492: write d0/d10/d11/d1a/f28 [8652644,24458] 0 2024-05-06T21:26:49.897 INFO:tasks.workunit.client.0.smithi032.stdout:4/884: mkdir d2/d16/d44/d74/d79/d88/dd6/df2/d11b 0 2024-05-06T21:26:49.900 INFO:tasks.workunit.client.1.smithi154.stdout:9/571: unlink d5/d20/fa3 0 2024-05-06T21:26:49.900 INFO:tasks.workunit.client.0.smithi032.stdout:1/754: mkdir db/d37/d93/dce/df4 0 2024-05-06T21:26:49.900 INFO:tasks.workunit.client.1.smithi154.stdout:1/561: mkdir d6/db/d10/d15/d1d/d53/da3 0 2024-05-06T21:26:49.904 INFO:tasks.workunit.client.1.smithi154.stdout:3/664: rename d0/da/d1a/d28/d17/f1e to d0/da/d1a/d28/fe5 0 2024-05-06T21:26:49.907 INFO:tasks.workunit.client.1.smithi154.stdout:7/404: creat d6/d42/d6c/d6e/d21/d69/d7b/f7e x:0 0 0 2024-05-06T21:26:49.909 INFO:tasks.workunit.client.0.smithi032.stdout:1/755: symlink db/d16/d46/d55/lf5 0 2024-05-06T21:26:49.909 INFO:tasks.workunit.client.1.smithi154.stdout:2/454: creat db/d12/d19/d81/f8b x:0 0 0 2024-05-06T21:26:49.912 INFO:tasks.workunit.client.1.smithi154.stdout:0/560: creat d6/dc/d42/fba x:0 0 0 2024-05-06T21:26:49.915 INFO:tasks.workunit.client.1.smithi154.stdout:1/562: symlink d6/db/d10/d94/la4 0 2024-05-06T21:26:49.916 INFO:tasks.workunit.client.1.smithi154.stdout:6/338: getdents d8/d11/d2d 0 2024-05-06T21:26:49.918 INFO:tasks.workunit.client.1.smithi154.stdout:3/665: symlink d0/da/d1a/le6 0 2024-05-06T21:26:49.918 INFO:tasks.workunit.client.1.smithi154.stdout:7/405: mknod d6/d46/c7f 0 2024-05-06T21:26:49.918 INFO:tasks.workunit.client.1.smithi154.stdout:7/406: creat d6/d42/d6c/d6e/d21/d69/f80 x:0 0 0 2024-05-06T21:26:49.919 INFO:tasks.workunit.client.1.smithi154.stdout:5/539: dread d2/d3/d21/d22/f2e [0,4194304] 0 2024-05-06T21:26:49.919 INFO:tasks.workunit.client.1.smithi154.stdout:2/455: truncate f0 6770908 0 2024-05-06T21:26:49.920 INFO:tasks.workunit.client.1.smithi154.stdout:0/561: mkdir d6/dc/d40/d85/db2/dbb 0 2024-05-06T21:26:49.920 INFO:tasks.workunit.client.1.smithi154.stdout:0/562: chown d6/dc/d3c/fa5 106918 1 2024-05-06T21:26:49.923 INFO:tasks.workunit.client.1.smithi154.stdout:7/407: mkdir d6/d20/d40/d52/d81 0 2024-05-06T21:26:49.924 INFO:tasks.workunit.client.1.smithi154.stdout:0/563: creat d6/dc/d40/d85/db2/dbb/fbc x:0 0 0 2024-05-06T21:26:49.924 INFO:tasks.workunit.client.1.smithi154.stdout:0/564: stat d6/dc/d40/d4a/da7/d70/l7c 0 2024-05-06T21:26:49.924 INFO:tasks.workunit.client.1.smithi154.stdout:0/565: chown d6/dc/d40/d85/db2/dbb/fbc 0 1 2024-05-06T21:26:49.925 INFO:tasks.workunit.client.1.smithi154.stdout:7/408: mkdir d6/d54/d5b/d82 0 2024-05-06T21:26:49.926 INFO:tasks.workunit.client.1.smithi154.stdout:1/563: rename d6/db/d87 to d6/d3e/d7e/da5 0 2024-05-06T21:26:49.928 INFO:tasks.workunit.client.0.smithi032.stdout:4/885: read d2/f9 [3787721,13964] 0 2024-05-06T21:26:49.928 INFO:tasks.workunit.client.0.smithi032.stdout:4/886: creat d2/d16/d44/d45/f11c x:0 0 0 2024-05-06T21:26:49.930 INFO:tasks.workunit.client.1.smithi154.stdout:1/564: link d6/db/d10/d15/l2e d6/d3e/d7e/da5/la6 0 2024-05-06T21:26:49.931 INFO:tasks.workunit.client.0.smithi032.stdout:4/887: mkdir d2/d2c/d31/d7c/d11d 0 2024-05-06T21:26:49.932 INFO:tasks.workunit.client.0.smithi032.stdout:4/888: stat d2/d2c/d31/d7c/cea 0 2024-05-06T21:26:49.932 INFO:tasks.workunit.client.1.smithi154.stdout:1/565: mknod d6/db/d10/d26/ca7 0 2024-05-06T21:26:49.933 INFO:tasks.workunit.client.1.smithi154.stdout:2/456: dread db/de/d10/f25 [0,4194304] 0 2024-05-06T21:26:49.934 INFO:tasks.workunit.client.1.smithi154.stdout:1/566: mkdir d6/d3e/d7e/da5/da8 0 2024-05-06T21:26:49.936 INFO:tasks.workunit.client.1.smithi154.stdout:5/540: dread d2/d3/d21/d95/f8c [0,4194304] 0 2024-05-06T21:26:49.936 INFO:tasks.workunit.client.1.smithi154.stdout:1/567: read d6/db/d10/f35 [840709,100279] 0 2024-05-06T21:26:49.939 INFO:tasks.workunit.client.1.smithi154.stdout:1/568: unlink d6/db/d10/d26/d1b/c37 0 2024-05-06T21:26:49.941 INFO:tasks.workunit.client.1.smithi154.stdout:0/566: write d6/dc/f95 [1893961,6903] 0 2024-05-06T21:26:49.944 INFO:tasks.workunit.client.1.smithi154.stdout:6/339: read d8/fc [159094,518] 0 2024-05-06T21:26:49.944 INFO:tasks.workunit.client.1.smithi154.stdout:6/340: chown d8/d11/d2d/d3d/d4c/l63 2033360793 1 2024-05-06T21:26:49.945 INFO:tasks.workunit.client.0.smithi032.stdout:9/858: dwrite d1/d13/d33/d5e/ff2 [0,4194304] 0 2024-05-06T21:26:49.945 INFO:tasks.workunit.client.1.smithi154.stdout:6/341: creat d8/d11/d2d/d3d/f6b x:0 0 0 2024-05-06T21:26:49.946 INFO:tasks.workunit.client.1.smithi154.stdout:1/569: dread d6/db/d10/d26/f7d [0,4194304] 0 2024-05-06T21:26:49.946 INFO:tasks.workunit.client.1.smithi154.stdout:6/342: dread d8/d11/d2d/d57/f5d [0,4194304] 0 2024-05-06T21:26:49.951 INFO:tasks.workunit.client.1.smithi154.stdout:0/567: dread d6/fa8 [0,4194304] 0 2024-05-06T21:26:49.952 INFO:tasks.workunit.client.1.smithi154.stdout:0/568: rmdir d6/dc/d44 39 2024-05-06T21:26:49.953 INFO:tasks.workunit.client.1.smithi154.stdout:5/541: write d2/d3/d19/f3c [6220885,69791] 0 2024-05-06T21:26:49.954 INFO:tasks.workunit.client.1.smithi154.stdout:0/569: truncate d6/dc/d40/d4a/da7/d70/f7e 1962348 0 2024-05-06T21:26:49.956 INFO:tasks.workunit.client.1.smithi154.stdout:0/570: mkdir d6/dc/d51/d54/dbd 0 2024-05-06T21:26:49.957 INFO:tasks.workunit.client.1.smithi154.stdout:5/542: rename d2/d3/d21/d95/dd/d2a/d54/ca6 to d2/d3/d21/d22/d25/cb5 0 2024-05-06T21:26:49.958 INFO:tasks.workunit.client.1.smithi154.stdout:0/571: rmdir d6/dc/d44 39 2024-05-06T21:26:49.959 INFO:tasks.workunit.client.1.smithi154.stdout:0/572: symlink d6/dc/d44/lbe 0 2024-05-06T21:26:49.961 INFO:tasks.workunit.client.1.smithi154.stdout:0/573: mknod d6/dc/d40/d85/cbf 0 2024-05-06T21:26:49.961 INFO:tasks.workunit.client.1.smithi154.stdout:2/457: dread db/de/d16/f28 [0,4194304] 0 2024-05-06T21:26:49.961 INFO:tasks.workunit.client.1.smithi154.stdout:2/458: readlink db/d12/d19/l4a 0 2024-05-06T21:26:49.961 INFO:tasks.workunit.client.1.smithi154.stdout:2/459: chown db/d12/d1d/d83 15388 1 2024-05-06T21:26:49.961 INFO:tasks.workunit.client.1.smithi154.stdout:5/543: dread d2/d3/d21/d95/dd/f64 [0,4194304] 0 2024-05-06T21:26:49.962 INFO:tasks.workunit.client.1.smithi154.stdout:0/574: symlink d6/dc/d40/d5e/lc0 0 2024-05-06T21:26:49.964 INFO:tasks.workunit.client.1.smithi154.stdout:2/460: rename db/de/d10/d18/l3b to db/de/d16/d33/l8c 0 2024-05-06T21:26:49.965 INFO:tasks.workunit.client.1.smithi154.stdout:4/493: dwrite d0/d82/d44/d73/d4a/d74/fa4 [0,4194304] 0 2024-05-06T21:26:49.965 INFO:tasks.workunit.client.1.smithi154.stdout:4/494: fsync d0/d10/d11/f46 0 2024-05-06T21:26:49.965 INFO:tasks.workunit.client.1.smithi154.stdout:4/495: chown d0/d10/f15 6410 1 2024-05-06T21:26:49.965 INFO:tasks.workunit.client.1.smithi154.stdout:5/544: mkdir d2/d3/d19/d23/db6 0 2024-05-06T21:26:49.965 INFO:tasks.workunit.client.1.smithi154.stdout:2/461: symlink db/d12/d1d/d60/l8d 0 2024-05-06T21:26:49.968 INFO:tasks.workunit.client.0.smithi032.stdout:9/859: dread d1/d13/d33/d3f/ffd [0,4194304] 0 2024-05-06T21:26:49.968 INFO:tasks.workunit.client.0.smithi032.stdout:7/818: dwrite db/d12/d49/d97/fd0 [0,4194304] 0 2024-05-06T21:26:49.968 INFO:tasks.workunit.client.0.smithi032.stdout:7/819: dread - db/d12/d16/d2a/d39/d3b/fe1 zero size 2024-05-06T21:26:49.968 INFO:tasks.workunit.client.1.smithi154.stdout:4/496: symlink d0/d2/dc/la7 0 2024-05-06T21:26:49.969 INFO:tasks.workunit.client.1.smithi154.stdout:5/545: mknod d2/da5/cb7 0 2024-05-06T21:26:49.969 INFO:tasks.workunit.client.1.smithi154.stdout:5/546: chown d2/d3/l5d 21178795 1 2024-05-06T21:26:49.970 INFO:tasks.workunit.client.1.smithi154.stdout:2/462: mknod db/de/d16/c8e 0 2024-05-06T21:26:49.971 INFO:tasks.workunit.client.0.smithi032.stdout:9/860: rename d1/d13/d33/da6/fbf to d1/d13/d33/d5e/f126 0 2024-05-06T21:26:49.971 INFO:tasks.workunit.client.1.smithi154.stdout:4/497: mknod d0/d82/d44/d73/ca8 0 2024-05-06T21:26:49.972 INFO:tasks.workunit.client.1.smithi154.stdout:0/575: dread f4 [0,4194304] 0 2024-05-06T21:26:49.973 INFO:tasks.workunit.client.0.smithi032.stdout:7/820: rename db/d12/d16/d21/l6e to db/d12/d16/da1/l100 0 2024-05-06T21:26:49.973 INFO:tasks.workunit.client.1.smithi154.stdout:5/547: creat d2/d3/d21/d95/dc/d44/d9a/fb8 x:0 0 0 2024-05-06T21:26:49.973 INFO:tasks.workunit.client.1.smithi154.stdout:5/548: readlink d2/d3/d21/d95/dd/l11 0 2024-05-06T21:26:49.973 INFO:tasks.workunit.client.1.smithi154.stdout:5/549: stat d2/d3/d21/d22/d25/l2f 0 2024-05-06T21:26:49.974 INFO:tasks.workunit.client.1.smithi154.stdout:6/343: dwrite d8/d11/d33/d4a/f49 [0,4194304] 0 2024-05-06T21:26:49.974 INFO:tasks.workunit.client.0.smithi032.stdout:4/889: dwrite d2/d13/f8d [0,4194304] 0 2024-05-06T21:26:49.975 INFO:tasks.workunit.client.0.smithi032.stdout:9/861: mkdir d1/d13/d33/d3f/d60/dff/d127 0 2024-05-06T21:26:49.975 INFO:tasks.workunit.client.0.smithi032.stdout:9/862: fsync d1/f12 0 2024-05-06T21:26:49.975 INFO:tasks.workunit.client.1.smithi154.stdout:8/426: dwrite d3/d14/f20 [0,4194304] 0 2024-05-06T21:26:49.976 INFO:tasks.workunit.client.1.smithi154.stdout:9/572: dwrite d5/d14/f94 [0,4194304] 0 2024-05-06T21:26:49.976 INFO:tasks.workunit.client.1.smithi154.stdout:3/666: dwrite d0/da/db/dd/d1c/d41/f79 [0,4194304] 0 2024-05-06T21:26:49.976 INFO:tasks.workunit.client.1.smithi154.stdout:3/667: truncate d0/da/d1a/d28/d4d/f96 407871 0 2024-05-06T21:26:49.976 INFO:tasks.workunit.client.1.smithi154.stdout:7/409: dwrite d6/f32 [0,4194304] 0 2024-05-06T21:26:49.976 INFO:tasks.workunit.client.0.smithi032.stdout:7/821: rmdir db/d12/d16/d21/dcb/dd7 39 2024-05-06T21:26:49.977 INFO:tasks.workunit.client.1.smithi154.stdout:2/463: creat db/de/d16/d4f/f8f x:0 0 0 2024-05-06T21:26:49.977 INFO:tasks.workunit.client.1.smithi154.stdout:2/464: creat db/de/d16/d33/f90 x:0 0 0 2024-05-06T21:26:49.977 INFO:tasks.workunit.client.1.smithi154.stdout:5/550: creat d2/d3/d21/d95/dd/fb9 x:0 0 0 2024-05-06T21:26:49.979 INFO:tasks.workunit.client.0.smithi032.stdout:4/890: link d2/d13/c82 d2/d16/df6/c11e 0 2024-05-06T21:26:49.979 INFO:tasks.workunit.client.0.smithi032.stdout:4/891: stat d2/d16/d44/d74/d79/d88/dd6/df2 0 2024-05-06T21:26:49.979 INFO:tasks.workunit.client.0.smithi032.stdout:4/892: dread - d2/d16/d44/d74/d79/de6/de8/f10e zero size 2024-05-06T21:26:49.980 INFO:tasks.workunit.client.1.smithi154.stdout:0/576: dread d6/dc/f66 [0,4194304] 0 2024-05-06T21:26:49.980 INFO:tasks.workunit.client.1.smithi154.stdout:0/577: stat d6/l1f 0 2024-05-06T21:26:49.982 INFO:tasks.workunit.client.1.smithi154.stdout:6/344: mkdir d8/d11/d33/d4a/d6c 0 2024-05-06T21:26:49.982 INFO:tasks.workunit.client.1.smithi154.stdout:0/578: dread d6/dc/d44/d36/f62 [0,4194304] 0 2024-05-06T21:26:49.983 INFO:tasks.workunit.client.1.smithi154.stdout:0/579: write d6/dc/d40/fb8 [43655,74259] 0 2024-05-06T21:26:49.985 INFO:tasks.workunit.client.1.smithi154.stdout:3/668: dread d0/da/d1a/d28/dbc/f34 [0,4194304] 0 2024-05-06T21:26:49.986 INFO:tasks.workunit.client.0.smithi032.stdout:7/822: mknod db/d12/c101 0 2024-05-06T21:26:49.988 INFO:tasks.workunit.client.1.smithi154.stdout:4/498: write d0/d82/d44/d73/d4a/d74/fa4 [3890213,63780] 0 2024-05-06T21:26:49.990 INFO:tasks.workunit.client.0.smithi032.stdout:4/893: mkdir d2/d16/d44/d74/d76/d81/d11f 0 2024-05-06T21:26:49.991 INFO:tasks.workunit.client.0.smithi032.stdout:7/823: mknod db/d12/d87/db5/c102 0 2024-05-06T21:26:49.993 INFO:tasks.workunit.client.1.smithi154.stdout:7/410: dread d6/d20/f1b [4194304,4194304] 0 2024-05-06T21:26:49.993 INFO:tasks.workunit.client.1.smithi154.stdout:0/580: dread d6/dc/d44/f29 [0,4194304] 0 2024-05-06T21:26:49.993 INFO:tasks.workunit.client.1.smithi154.stdout:5/551: write d2/d3/d21/d95/dd/d2a/f3d [3122968,126541] 0 2024-05-06T21:26:49.995 INFO:tasks.workunit.client.1.smithi154.stdout:2/465: write db/f3c [2380400,56553] 0 2024-05-06T21:26:49.999 INFO:tasks.workunit.client.1.smithi154.stdout:3/669: dread d0/da/d1a/d28/dbc/d81/d48/f65 [0,4194304] 0 2024-05-06T21:26:50.002 INFO:tasks.workunit.client.1.smithi154.stdout:8/427: rmdir d3/d14 39 2024-05-06T21:26:50.005 INFO:tasks.workunit.client.1.smithi154.stdout:4/499: symlink d0/d82/d44/d73/d4a/d74/la9 0 2024-05-06T21:26:50.005 INFO:tasks.workunit.client.1.smithi154.stdout:4/500: write d0/d82/d39/d63/f9e [375547,123168] 0 2024-05-06T21:26:50.006 INFO:tasks.workunit.client.1.smithi154.stdout:9/573: symlink d5/lc7 0 2024-05-06T21:26:50.008 INFO:tasks.workunit.client.1.smithi154.stdout:0/581: mkdir d6/dc1 0 2024-05-06T21:26:50.008 INFO:tasks.workunit.client.1.smithi154.stdout:0/582: readlink d6/l87 0 2024-05-06T21:26:50.008 INFO:tasks.workunit.client.1.smithi154.stdout:0/583: write d6/d27/f69 [922761,83436] 0 2024-05-06T21:26:50.008 INFO:tasks.workunit.client.1.smithi154.stdout:0/584: write d6/dc/d40/d4a/d6c/f9e [445871,81226] 0 2024-05-06T21:26:50.008 INFO:tasks.workunit.client.0.smithi032.stdout:7/824: write f3 [2714599,57827] 0 2024-05-06T21:26:50.009 INFO:tasks.workunit.client.1.smithi154.stdout:5/552: unlink d2/f34 0 2024-05-06T21:26:50.010 INFO:tasks.workunit.client.1.smithi154.stdout:5/553: read d2/d3/d21/d95/dc/d71/f81 [1661048,44110] 0 2024-05-06T21:26:50.011 INFO:tasks.workunit.client.0.smithi032.stdout:4/894: write d2/d16/d44/d45/dc1/fe9 [3395771,36364] 0 2024-05-06T21:26:50.012 INFO:tasks.workunit.client.0.smithi032.stdout:7/825: mkdir db/d12/d16/d21/d103 0 2024-05-06T21:26:50.014 INFO:tasks.workunit.client.0.smithi032.stdout:7/826: read db/d12/d49/f67 [1084102,93344] 0 2024-05-06T21:26:50.014 INFO:tasks.workunit.client.0.smithi032.stdout:7/827: creat db/d12/d16/d2a/d39/d3b/f104 x:0 0 0 2024-05-06T21:26:50.014 INFO:tasks.workunit.client.0.smithi032.stdout:7/828: dread - db/d89/daa/ff5 zero size 2024-05-06T21:26:50.016 INFO:tasks.workunit.client.0.smithi032.stdout:4/895: creat d2/f120 x:0 0 0 2024-05-06T21:26:50.016 INFO:tasks.workunit.client.1.smithi154.stdout:0/585: creat d6/dc/d44/d36/fc2 x:0 0 0 2024-05-06T21:26:50.018 INFO:tasks.workunit.client.1.smithi154.stdout:5/554: symlink d2/d3/d21/d95/dd/d2a/d54/d43/lba 0 2024-05-06T21:26:50.018 INFO:tasks.workunit.client.1.smithi154.stdout:5/555: write d2/d3/d19/f3c [5060642,119658] 0 2024-05-06T21:26:50.021 INFO:tasks.workunit.client.1.smithi154.stdout:7/411: dwrite d6/d42/d6c/d6e/f31 [0,4194304] 0 2024-05-06T21:26:50.026 INFO:tasks.workunit.client.0.smithi032.stdout:7/829: dread db/d12/d16/f57 [4194304,4194304] 0 2024-05-06T21:26:50.026 INFO:tasks.workunit.client.0.smithi032.stdout:7/830: fdatasync db/d12/d49/f67 0 2024-05-06T21:26:50.028 INFO:tasks.workunit.client.0.smithi032.stdout:7/831: creat db/d12/d16/d21/dcb/dd7/f105 x:0 0 0 2024-05-06T21:26:50.029 INFO:tasks.workunit.client.0.smithi032.stdout:7/832: fdatasync db/d12/d16/d21/d41/d78/f88 0 2024-05-06T21:26:50.031 INFO:tasks.workunit.client.0.smithi032.stdout:7/833: creat db/d12/d16/f106 x:0 0 0 2024-05-06T21:26:50.032 INFO:tasks.workunit.client.0.smithi032.stdout:7/834: mkdir db/d89/d107 0 2024-05-06T21:26:50.034 INFO:tasks.workunit.client.1.smithi154.stdout:8/428: getdents d3/d38 0 2024-05-06T21:26:50.034 INFO:tasks.workunit.client.1.smithi154.stdout:8/429: fdatasync d3/d14/d1a/d29/d43/f5d 0 2024-05-06T21:26:50.035 INFO:tasks.workunit.client.1.smithi154.stdout:6/345: dwrite d8/d11/f1a [0,4194304] 0 2024-05-06T21:26:50.038 INFO:tasks.workunit.client.1.smithi154.stdout:7/412: creat d6/d46/f83 x:0 0 0 2024-05-06T21:26:50.056 INFO:tasks.workunit.client.1.smithi154.stdout:6/346: read d8/d11/f1d [3904150,107748] 0 2024-05-06T21:26:50.056 INFO:tasks.workunit.client.1.smithi154.stdout:6/347: chown d8/d13/l38 127903464 1 2024-05-06T21:26:50.057 INFO:tasks.workunit.client.1.smithi154.stdout:6/348: getdents d8/d11 0 2024-05-06T21:26:50.058 INFO:tasks.workunit.client.1.smithi154.stdout:6/349: rename d8/d11/f1a to d8/d11/f6d 0 2024-05-06T21:26:50.059 INFO:tasks.workunit.client.1.smithi154.stdout:6/350: write d8/d11/f69 [827766,61489] 0 2024-05-06T21:26:50.060 INFO:tasks.workunit.client.1.smithi154.stdout:3/670: dwrite d0/da/db/dd/d1c/fc2 [0,4194304] 0 2024-05-06T21:26:50.062 INFO:tasks.workunit.client.1.smithi154.stdout:9/574: dwrite d5/d14/d31/f5e [0,4194304] 0 2024-05-06T21:26:50.062 INFO:tasks.workunit.client.1.smithi154.stdout:9/575: chown d5/d2e 51781 1 2024-05-06T21:26:50.063 INFO:tasks.workunit.client.1.smithi154.stdout:9/576: write d5/d20/f81 [45693,127406] 0 2024-05-06T21:26:50.066 INFO:tasks.workunit.client.1.smithi154.stdout:9/577: rename d5/d14/d3a/c79 to d5/d20/d37/cc8 0 2024-05-06T21:26:50.067 INFO:tasks.workunit.client.1.smithi154.stdout:9/578: symlink d5/d20/lc9 0 2024-05-06T21:26:50.070 INFO:tasks.workunit.client.1.smithi154.stdout:9/579: mkdir d5/dca 0 2024-05-06T21:26:50.070 INFO:tasks.workunit.client.1.smithi154.stdout:9/580: readlink d5/l1b 0 2024-05-06T21:26:50.070 INFO:tasks.workunit.client.1.smithi154.stdout:9/581: fdatasync d5/f13 0 2024-05-06T21:26:50.070 INFO:tasks.workunit.client.1.smithi154.stdout:9/582: stat d5/d2e/c48 0 2024-05-06T21:26:50.085 INFO:tasks.workunit.client.0.smithi032.stdout:4/896: dwrite d2/f96 [0,4194304] 0 2024-05-06T21:26:50.086 INFO:tasks.workunit.client.0.smithi032.stdout:4/897: truncate d2/d16/d44/d74/d7e/fd2 320142 0 2024-05-06T21:26:50.087 INFO:tasks.workunit.client.1.smithi154.stdout:5/556: dwrite d2/d3/d21/d22/d25/f32 [0,4194304] 0 2024-05-06T21:26:50.087 INFO:tasks.workunit.client.1.smithi154.stdout:4/501: dwrite d0/d10/d11/d1a/f28 [4194304,4194304] 0 2024-05-06T21:26:50.087 INFO:tasks.workunit.client.1.smithi154.stdout:2/466: rmdir db 39 2024-05-06T21:26:50.088 INFO:tasks.workunit.client.0.smithi032.stdout:4/898: truncate d2/d13/f1b 1415389 0 2024-05-06T21:26:50.091 INFO:tasks.workunit.client.1.smithi154.stdout:5/557: mkdir d2/d3/d21/d95/dd/d2a/dbb 0 2024-05-06T21:26:50.093 INFO:tasks.workunit.client.1.smithi154.stdout:5/558: symlink d2/d3/d21/d95/dc/d71/lbc 0 2024-05-06T21:26:50.094 INFO:tasks.workunit.client.1.smithi154.stdout:5/559: chown d2/d3/d21/d22/d25/d37/cac 32105 1 2024-05-06T21:26:50.095 INFO:tasks.workunit.client.0.smithi032.stdout:7/835: dwrite db/d12/f6d [0,4194304] 0 2024-05-06T21:26:50.095 INFO:tasks.workunit.client.0.smithi032.stdout:7/836: dread - db/d12/d16/d2a/fd3 zero size 2024-05-06T21:26:50.095 INFO:tasks.workunit.client.1.smithi154.stdout:7/413: dwrite d6/d42/d6c/d6e/d21/d69/f80 [0,4194304] 0 2024-05-06T21:26:50.095 INFO:tasks.workunit.client.1.smithi154.stdout:7/414: chown d6/fd 889 1 2024-05-06T21:26:50.096 INFO:tasks.workunit.client.1.smithi154.stdout:7/415: creat d6/d54/f84 x:0 0 0 2024-05-06T21:26:50.098 INFO:tasks.workunit.client.0.smithi032.stdout:7/837: symlink db/d12/d16/d2a/d39/d3b/dac/l108 0 2024-05-06T21:26:50.100 INFO:tasks.workunit.client.0.smithi032.stdout:7/838: rmdir db/d12/d16/da1 39 2024-05-06T21:26:50.102 INFO:tasks.workunit.client.0.smithi032.stdout:7/839: mkdir db/d12/d16/d2a/d39/d3b/d96/d109 0 2024-05-06T21:26:50.108 INFO:tasks.workunit.client.0.smithi032.stdout:4/899: write d2/d1e/f22 [383573,72306] 0 2024-05-06T21:26:50.113 INFO:tasks.workunit.client.1.smithi154.stdout:0/586: dwrite d6/dc/d44/f29 [0,4194304] 0 2024-05-06T21:26:50.113 INFO:tasks.workunit.client.1.smithi154.stdout:8/430: dwrite d3/fd [0,4194304] 0 2024-05-06T21:26:50.116 INFO:tasks.workunit.client.0.smithi032.stdout:3/865: sync 2024-05-06T21:26:50.116 INFO:tasks.workunit.client.0.smithi032.stdout:3/866: read - d1/d4/da/d4e/d5e/d84/df2/d108/d74/f102 zero size 2024-05-06T21:26:50.117 INFO:tasks.workunit.client.1.smithi154.stdout:8/431: dread d3/d56/f7f [0,4194304] 0 2024-05-06T21:26:50.117 INFO:tasks.workunit.client.1.smithi154.stdout:8/432: read d3/f8 [3576044,7843] 0 2024-05-06T21:26:50.117 INFO:tasks.workunit.client.0.smithi032.stdout:5/807: sync 2024-05-06T21:26:50.118 INFO:tasks.workunit.client.1.smithi154.stdout:6/351: dwrite d8/d11/f1d [0,4194304] 0 2024-05-06T21:26:50.118 INFO:tasks.workunit.client.1.smithi154.stdout:3/671: dwrite d0/da/d1a/d28/d17/f49 [0,4194304] 0 2024-05-06T21:26:50.118 INFO:tasks.workunit.client.1.smithi154.stdout:3/672: write d0/da/d1a/d28/d17/f63 [749430,7839] 0 2024-05-06T21:26:50.124 INFO:tasks.workunit.client.0.smithi032.stdout:4/900: dread d2/d13/daa/db8/de7/f9b [0,4194304] 0 2024-05-06T21:26:50.126 INFO:tasks.workunit.client.1.smithi154.stdout:8/433: mkdir d3/d64/d6d/d8a 0 2024-05-06T21:26:50.126 INFO:tasks.workunit.client.1.smithi154.stdout:4/502: dwrite d0/d82/d44/d73/f2c [0,4194304] 0 2024-05-06T21:26:50.127 INFO:tasks.workunit.client.1.smithi154.stdout:9/583: dwrite d5/d20/d52/d6e/fae [0,4194304] 0 2024-05-06T21:26:50.127 INFO:tasks.workunit.client.1.smithi154.stdout:9/584: chown d5/d14/d87/d65 27 1 2024-05-06T21:26:50.128 INFO:tasks.workunit.client.1.smithi154.stdout:7/416: dwrite d6/f25 [0,4194304] 0 2024-05-06T21:26:50.128 INFO:tasks.workunit.client.0.smithi032.stdout:3/867: dread d1/f5d [0,4194304] 0 2024-05-06T21:26:50.128 INFO:tasks.workunit.client.0.smithi032.stdout:3/868: write d1/d4/da/d4e/d41/d43/fbb [4942333,22641] 0 2024-05-06T21:26:50.128 INFO:tasks.workunit.client.0.smithi032.stdout:3/869: fdatasync d1/d4/da/d1d/fe5 0 2024-05-06T21:26:50.133 INFO:tasks.workunit.client.1.smithi154.stdout:2/467: dwrite db/de/d16/d33/f61 [0,4194304] 0 2024-05-06T21:26:50.135 INFO:tasks.workunit.client.1.smithi154.stdout:3/673: dread d0/da/db/dd/d1c/d21/f42 [0,4194304] 0 2024-05-06T21:26:50.135 INFO:tasks.workunit.client.1.smithi154.stdout:3/674: chown d0/da/d1a/lda 403 1 2024-05-06T21:26:50.135 INFO:tasks.workunit.client.1.smithi154.stdout:8/434: rmdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d83 0 2024-05-06T21:26:50.135 INFO:tasks.workunit.client.1.smithi154.stdout:6/352: dread d8/d11/d2d/d57/f5d [0,4194304] 0 2024-05-06T21:26:50.135 INFO:tasks.workunit.client.1.smithi154.stdout:8/435: readlink d3/l77 0 2024-05-06T21:26:50.135 INFO:tasks.workunit.client.1.smithi154.stdout:4/503: symlink d0/d82/d44/d73/d4a/d74/laa 0 2024-05-06T21:26:50.135 INFO:tasks.workunit.client.1.smithi154.stdout:6/353: write d8/d13/d20/f65 [121853,128427] 0 2024-05-06T21:26:50.136 INFO:tasks.workunit.client.0.smithi032.stdout:7/840: getdents db/d12/d16/d2a/d39/d3b/dac 0 2024-05-06T21:26:50.136 INFO:tasks.workunit.client.1.smithi154.stdout:5/560: dwrite d2/d3/d21/d95/dc/f15 [0,4194304] 0 2024-05-06T21:26:50.136 INFO:tasks.workunit.client.1.smithi154.stdout:9/585: truncate d5/d14/d87/d65/fa6 2216676 0 2024-05-06T21:26:50.136 INFO:tasks.workunit.client.1.smithi154.stdout:9/586: fsync d5/d14/d87/f9e 0 2024-05-06T21:26:50.139 INFO:tasks.workunit.client.0.smithi032.stdout:0/785: sync 2024-05-06T21:26:50.139 INFO:tasks.workunit.client.0.smithi032.stdout:7/841: creat db/d12/d16/d2a/d39/d8b/f10a x:0 0 0 2024-05-06T21:26:50.139 INFO:tasks.workunit.client.0.smithi032.stdout:4/901: write d2/f9 [575673,54671] 0 2024-05-06T21:26:50.141 INFO:tasks.workunit.client.1.smithi154.stdout:3/675: creat d0/da/d1a/d28/dbc/d81/d9c/fe7 x:0 0 0 2024-05-06T21:26:50.142 INFO:tasks.workunit.client.1.smithi154.stdout:8/436: rename d3/fc to d3/d56/f8b 0 2024-05-06T21:26:50.143 INFO:tasks.workunit.client.0.smithi032.stdout:0/786: rename d4/da/d14/d1a/d66/f95 to d4/da/d16/d33/d9e/dc9/dd8/f102 0 2024-05-06T21:26:50.144 INFO:tasks.workunit.client.1.smithi154.stdout:4/504: mkdir d0/d82/d3d/dab 0 2024-05-06T21:26:50.144 INFO:tasks.workunit.client.1.smithi154.stdout:6/354: stat d8/d11/d33/l52 0 2024-05-06T21:26:50.146 INFO:tasks.workunit.client.1.smithi154.stdout:2/468: write db/de/d16/d33/f44 [440594,85504] 0 2024-05-06T21:26:50.146 INFO:tasks.workunit.client.1.smithi154.stdout:2/469: chown db/d12/d19/l3d 363 1 2024-05-06T21:26:50.146 INFO:tasks.workunit.client.1.smithi154.stdout:2/470: readlink db/d12/d1d/l6c 0 2024-05-06T21:26:50.147 INFO:tasks.workunit.client.0.smithi032.stdout:0/787: creat d4/da/d16/d33/d9e/dc9/dd8/f103 x:0 0 0 2024-05-06T21:26:50.147 INFO:tasks.workunit.client.1.smithi154.stdout:3/676: link d0/da/d1a/d28/d17/f49 d0/da/db/d30/fe8 0 2024-05-06T21:26:50.147 INFO:tasks.workunit.client.1.smithi154.stdout:2/471: dread db/d12/f43 [0,4194304] 0 2024-05-06T21:26:50.148 INFO:tasks.workunit.client.0.smithi032.stdout:0/788: truncate d4/da/d16/d33/d9e/dc9/dd8/f102 3810978 0 2024-05-06T21:26:50.148 INFO:tasks.workunit.client.0.smithi032.stdout:0/789: stat d4/d3e/d63/d6c/f94 0 2024-05-06T21:26:50.148 INFO:tasks.workunit.client.0.smithi032.stdout:0/790: read - d4/da/d14/d4a/fa8 zero size 2024-05-06T21:26:50.148 INFO:tasks.workunit.client.1.smithi154.stdout:8/437: creat d3/d64/d6d/d8a/f8c x:0 0 0 2024-05-06T21:26:50.151 INFO:tasks.workunit.client.1.smithi154.stdout:5/561: rename d2/d3/d21/d95/dd/d2a/d54/d43/f9f to d2/d3/d8b/fbd 0 2024-05-06T21:26:50.153 INFO:tasks.workunit.client.1.smithi154.stdout:3/677: symlink d0/da/d1a/d28/d17/db0/dd2/le9 0 2024-05-06T21:26:50.155 INFO:tasks.workunit.client.1.smithi154.stdout:3/678: getdents d0/da/d1a/d28/d17 0 2024-05-06T21:26:50.157 INFO:tasks.workunit.client.0.smithi032.stdout:4/902: dread d2/d13/f1b [0,4194304] 0 2024-05-06T21:26:50.158 INFO:tasks.workunit.client.1.smithi154.stdout:3/679: creat d0/fea x:0 0 0 2024-05-06T21:26:50.158 INFO:tasks.workunit.client.1.smithi154.stdout:3/680: readlink d0/da/d1a/d28/dbc/d81/l91 0 2024-05-06T21:26:50.158 INFO:tasks.workunit.client.1.smithi154.stdout:4/505: write d0/d82/d44/d73/f2c [2433712,92402] 0 2024-05-06T21:26:50.159 INFO:tasks.workunit.client.1.smithi154.stdout:3/681: mknod d0/da/db/d52/d75/ceb 0 2024-05-06T21:26:50.160 INFO:tasks.workunit.client.0.smithi032.stdout:4/903: dread d2/d2c/f89 [0,4194304] 0 2024-05-06T21:26:50.160 INFO:tasks.workunit.client.0.smithi032.stdout:4/904: truncate d2/d2c/d31/d7c/f32 12772745 0 2024-05-06T21:26:50.161 INFO:tasks.workunit.client.1.smithi154.stdout:2/472: dread db/d86/f88 [0,4194304] 0 2024-05-06T21:26:50.161 INFO:tasks.workunit.client.1.smithi154.stdout:2/473: readlink db/lf 0 2024-05-06T21:26:50.161 INFO:tasks.workunit.client.1.smithi154.stdout:6/355: dread d8/d11/d33/d4a/f49 [0,4194304] 0 2024-05-06T21:26:50.162 INFO:tasks.workunit.client.0.smithi032.stdout:4/905: getdents d2/d16/df6 0 2024-05-06T21:26:50.163 INFO:tasks.workunit.client.1.smithi154.stdout:4/506: creat d0/d82/d44/d73/d9a/fac x:0 0 0 2024-05-06T21:26:50.163 INFO:tasks.workunit.client.1.smithi154.stdout:4/507: readlink d0/d2/dc/la7 0 2024-05-06T21:26:50.163 INFO:tasks.workunit.client.1.smithi154.stdout:1/570: sync 2024-05-06T21:26:50.163 INFO:tasks.workunit.client.1.smithi154.stdout:1/571: chown d6/db/d10/d26/l50 353 1 2024-05-06T21:26:50.163 INFO:tasks.workunit.client.1.smithi154.stdout:1/572: creat d6/db/d10/fa9 x:0 0 0 2024-05-06T21:26:50.164 INFO:tasks.workunit.client.1.smithi154.stdout:3/682: link d0/da/db/dd/d1c/cd7 d0/da/db/d30/cec 0 2024-05-06T21:26:50.164 INFO:tasks.workunit.client.1.smithi154.stdout:3/683: write d0/d2/fb6 [134220,4086] 0 2024-05-06T21:26:50.165 INFO:tasks.workunit.client.1.smithi154.stdout:6/356: symlink d8/d13/d20/l6e 0 2024-05-06T21:26:50.167 INFO:tasks.workunit.client.1.smithi154.stdout:4/508: rename d0/f3b to d0/d2/d47/fad 0 2024-05-06T21:26:50.168 INFO:tasks.workunit.client.1.smithi154.stdout:0/587: dwrite d6/f3a [0,4194304] 0 2024-05-06T21:26:50.169 INFO:tasks.workunit.client.1.smithi154.stdout:3/684: truncate d0/d2/f25 2647567 0 2024-05-06T21:26:50.170 INFO:tasks.workunit.client.0.smithi032.stdout:4/906: read d2/d16/f5e [10851319,16302] 0 2024-05-06T21:26:50.170 INFO:tasks.workunit.client.0.smithi032.stdout:4/907: fsync d2/d16/d44/d45/f11c 0 2024-05-06T21:26:50.174 INFO:tasks.workunit.client.0.smithi032.stdout:4/908: creat d2/d16/d44/d74/d79/d88/dd6/df2/f121 x:0 0 0 2024-05-06T21:26:50.174 INFO:tasks.workunit.client.0.smithi032.stdout:4/909: chown d2/d16/d44/d74/d7e 6 1 2024-05-06T21:26:50.174 INFO:tasks.workunit.client.1.smithi154.stdout:1/573: write d6/db/f34 [393759,13693] 0 2024-05-06T21:26:50.174 INFO:tasks.workunit.client.1.smithi154.stdout:4/509: symlink d0/d82/d44/d73/d9a/lae 0 2024-05-06T21:26:50.174 INFO:tasks.workunit.client.1.smithi154.stdout:0/588: dread d6/d27/f69 [0,4194304] 0 2024-05-06T21:26:50.174 INFO:tasks.workunit.client.1.smithi154.stdout:0/589: creat d6/dc/d42/fc3 x:0 0 0 2024-05-06T21:26:50.175 INFO:tasks.workunit.client.1.smithi154.stdout:3/685: rmdir d0/d2/d22 39 2024-05-06T21:26:50.176 INFO:tasks.workunit.client.1.smithi154.stdout:4/510: creat d0/d82/faf x:0 0 0 2024-05-06T21:26:50.177 INFO:tasks.workunit.client.1.smithi154.stdout:0/590: rmdir d6/dc/d40/d5e 39 2024-05-06T21:26:50.178 INFO:tasks.workunit.client.1.smithi154.stdout:0/591: creat d6/dc/d39/fc4 x:0 0 0 2024-05-06T21:26:50.179 INFO:tasks.workunit.client.1.smithi154.stdout:0/592: creat d6/dc/d51/d54/dbd/fc5 x:0 0 0 2024-05-06T21:26:50.179 INFO:tasks.workunit.client.1.smithi154.stdout:0/593: chown d6/dc/d42/fc3 117971 1 2024-05-06T21:26:50.179 INFO:tasks.workunit.client.1.smithi154.stdout:0/594: chown d6/dc/d51/f80 116810394 1 2024-05-06T21:26:50.179 INFO:tasks.workunit.client.1.smithi154.stdout:0/595: read - d6/dc/d39/fb9 zero size 2024-05-06T21:26:50.180 INFO:tasks.workunit.client.1.smithi154.stdout:0/596: read d6/fa8 [233477,67856] 0 2024-05-06T21:26:50.182 INFO:tasks.workunit.client.0.smithi032.stdout:3/870: dwrite d1/d4/fd5 [0,4194304] 0 2024-05-06T21:26:50.182 INFO:tasks.workunit.client.0.smithi032.stdout:7/842: dwrite db/d12/d16/d21/d41/d4b/fa5 [0,4194304] 0 2024-05-06T21:26:50.184 INFO:tasks.workunit.client.0.smithi032.stdout:3/871: dread d1/d4/da/d4e/d41/d97/d67/da6/f99 [0,4194304] 0 2024-05-06T21:26:50.184 INFO:tasks.workunit.client.0.smithi032.stdout:3/872: chown d1/d4/da/d4e 12115 1 2024-05-06T21:26:50.185 INFO:tasks.workunit.client.1.smithi154.stdout:3/686: dread d0/da/db/f73 [0,4194304] 0 2024-05-06T21:26:50.186 INFO:tasks.workunit.client.1.smithi154.stdout:1/574: dread d6/db/d74/f80 [0,4194304] 0 2024-05-06T21:26:50.186 INFO:tasks.workunit.client.1.smithi154.stdout:1/575: chown d6/db/d10/d26/c2d 509395708 1 2024-05-06T21:26:50.188 INFO:tasks.workunit.client.1.smithi154.stdout:3/687: unlink d0/da/db/d7c/ldc 0 2024-05-06T21:26:50.188 INFO:tasks.workunit.client.1.smithi154.stdout:3/688: write d0/da/d1a/d28/dbc/d81/d48/da9/fb7 [5184983,48249] 0 2024-05-06T21:26:50.189 INFO:tasks.workunit.client.0.smithi032.stdout:7/843: mkdir db/d12/d10b 0 2024-05-06T21:26:50.190 INFO:tasks.workunit.client.0.smithi032.stdout:7/844: dread - db/d12/d16/d21/d41/d78/fbc zero size 2024-05-06T21:26:50.191 INFO:tasks.workunit.client.0.smithi032.stdout:3/873: unlink d1/d4/da/f32 0 2024-05-06T21:26:50.193 INFO:tasks.workunit.client.0.smithi032.stdout:7/845: creat db/d12/d16/d2a/d39/f10c x:0 0 0 2024-05-06T21:26:50.194 INFO:tasks.workunit.client.1.smithi154.stdout:3/689: mknod d0/da/db/dd/ced 0 2024-05-06T21:26:50.195 INFO:tasks.workunit.client.1.smithi154.stdout:2/474: dwrite db/de/d16/f65 [0,4194304] 0 2024-05-06T21:26:50.196 INFO:tasks.workunit.client.1.smithi154.stdout:8/438: dwrite d3/d14/d1a/d29/f74 [0,4194304] 0 2024-05-06T21:26:50.201 INFO:tasks.workunit.client.1.smithi154.stdout:1/576: write d6/d3e/f6d [66974,63945] 0 2024-05-06T21:26:50.204 INFO:tasks.workunit.client.1.smithi154.stdout:6/357: dwrite d8/f23 [0,4194304] 0 2024-05-06T21:26:50.207 INFO:tasks.workunit.client.1.smithi154.stdout:1/577: unlink d6/db/d10/d94/c9f 0 2024-05-06T21:26:50.207 INFO:tasks.workunit.client.1.smithi154.stdout:1/578: chown d6/db/d10/d15/d1d/d53/da3 0 1 2024-05-06T21:26:50.207 INFO:tasks.workunit.client.1.smithi154.stdout:1/579: write d6/f47 [1501364,93304] 0 2024-05-06T21:26:50.207 INFO:tasks.workunit.client.1.smithi154.stdout:1/580: creat d6/d3e/faa x:0 0 0 2024-05-06T21:26:50.211 INFO:tasks.workunit.client.1.smithi154.stdout:3/690: write d0/da/d1a/d28/f8c [618225,128216] 0 2024-05-06T21:26:50.214 INFO:tasks.workunit.client.1.smithi154.stdout:8/439: dread d3/fd [0,4194304] 0 2024-05-06T21:26:50.214 INFO:tasks.workunit.client.1.smithi154.stdout:4/511: dwrite d0/d2/dc/f20 [0,4194304] 0 2024-05-06T21:26:50.214 INFO:tasks.workunit.client.1.smithi154.stdout:2/475: write db/de/d10/f25 [3457286,117103] 0 2024-05-06T21:26:50.214 INFO:tasks.workunit.client.1.smithi154.stdout:2/476: chown db/d12/d1d/d60/l8d 6756205 1 2024-05-06T21:26:50.214 INFO:tasks.workunit.client.1.smithi154.stdout:1/581: creat d6/db/d74/fab x:0 0 0 2024-05-06T21:26:50.216 INFO:tasks.workunit.client.1.smithi154.stdout:6/358: dread d8/d11/d2d/f3a [0,4194304] 0 2024-05-06T21:26:50.216 INFO:tasks.workunit.client.0.smithi032.stdout:7/846: dread db/d12/d49/d97/fd0 [0,4194304] 0 2024-05-06T21:26:50.217 INFO:tasks.workunit.client.0.smithi032.stdout:7/847: truncate db/d12/d16/d21/d41/d78/f4f 1156985 0 2024-05-06T21:26:50.217 INFO:tasks.workunit.client.0.smithi032.stdout:7/848: chown db/d12/d16/d2a/d39/d3b/f104 11761 1 2024-05-06T21:26:50.217 INFO:tasks.workunit.client.1.smithi154.stdout:0/597: dwrite d6/d27/f28 [0,4194304] 0 2024-05-06T21:26:50.218 INFO:tasks.workunit.client.1.smithi154.stdout:4/512: getdents d0/d82/d44/d73/d4a/d74/d75 0 2024-05-06T21:26:50.218 INFO:tasks.workunit.client.1.smithi154.stdout:4/513: chown d0/d72/d76/f7d 163878 1 2024-05-06T21:26:50.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/582: mkdir d6/db/d69/d89/dac 0 2024-05-06T21:26:50.221 INFO:tasks.workunit.client.0.smithi032.stdout:3/874: dwrite d1/d4/da/f11f [0,4194304] 0 2024-05-06T21:26:50.221 INFO:tasks.workunit.client.0.smithi032.stdout:3/875: chown d1/d2a/c105 1048575 1 2024-05-06T21:26:50.222 INFO:tasks.workunit.client.1.smithi154.stdout:1/583: write d6/db/d10/d26/f6b [22678,9524] 0 2024-05-06T21:26:50.222 INFO:tasks.workunit.client.1.smithi154.stdout:1/584: stat d6/d3e/d7e/da5/c91 0 2024-05-06T21:26:50.223 INFO:tasks.workunit.client.0.smithi032.stdout:3/876: write d1/d4/da/d1d/f6e [413947,95053] 0 2024-05-06T21:26:50.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:49 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:26:50.224 INFO:tasks.workunit.client.1.smithi154.stdout:3/691: dread d0/da/db/f2a [0,4194304] 0 2024-05-06T21:26:50.224 INFO:tasks.workunit.client.1.smithi154.stdout:8/440: dread d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f60 [0,4194304] 0 2024-05-06T21:26:50.225 INFO:tasks.workunit.client.1.smithi154.stdout:0/598: rename d6/dc/f24 to d6/fc6 0 2024-05-06T21:26:50.226 INFO:tasks.workunit.client.0.smithi032.stdout:3/877: creat d1/d4/da/d31/d47/d4a/d68/f120 x:0 0 0 2024-05-06T21:26:50.226 INFO:tasks.workunit.client.1.smithi154.stdout:2/477: dread db/de/d10/f67 [0,4194304] 0 2024-05-06T21:26:50.227 INFO:tasks.workunit.client.0.smithi032.stdout:3/878: mkdir d1/d4/da/d31/d9b/d121 0 2024-05-06T21:26:50.227 INFO:tasks.workunit.client.1.smithi154.stdout:4/514: mknod d0/d82/d39/cb0 0 2024-05-06T21:26:50.227 INFO:tasks.workunit.client.1.smithi154.stdout:4/515: write d0/d2/f9f [439396,76189] 0 2024-05-06T21:26:50.228 INFO:tasks.workunit.client.1.smithi154.stdout:6/359: getdents d8/d13/d20 0 2024-05-06T21:26:50.230 INFO:tasks.workunit.client.1.smithi154.stdout:1/585: creat d6/d3e/d7e/da5/da8/fad x:0 0 0 2024-05-06T21:26:50.231 INFO:tasks.workunit.client.1.smithi154.stdout:3/692: creat d0/da/db/d52/d75/fee x:0 0 0 2024-05-06T21:26:50.232 INFO:tasks.workunit.client.1.smithi154.stdout:8/441: mkdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d 0 2024-05-06T21:26:50.233 INFO:tasks.workunit.client.1.smithi154.stdout:0/599: getdents d6/dc/d40/d4a/da7/d70 0 2024-05-06T21:26:50.234 INFO:tasks.workunit.client.1.smithi154.stdout:2/478: fdatasync f5 0 2024-05-06T21:26:50.235 INFO:tasks.workunit.client.1.smithi154.stdout:4/516: symlink d0/d82/d39/lb1 0 2024-05-06T21:26:50.236 INFO:tasks.workunit.client.1.smithi154.stdout:4/517: fsync d0/d82/d44/d73/d4a/d74/d75/f99 0 2024-05-06T21:26:50.238 INFO:tasks.workunit.client.1.smithi154.stdout:1/586: creat d6/db/d69/d89/dac/fae x:0 0 0 2024-05-06T21:26:50.238 INFO:tasks.workunit.client.1.smithi154.stdout:1/587: creat d6/d3e/d7e/da5/da8/faf x:0 0 0 2024-05-06T21:26:50.239 INFO:tasks.workunit.client.1.smithi154.stdout:3/693: symlink d0/dd5/lef 0 2024-05-06T21:26:50.241 INFO:tasks.workunit.client.1.smithi154.stdout:8/442: creat d3/d14/d1a/d29/d68/d6b/f8e x:0 0 0 2024-05-06T21:26:50.242 INFO:tasks.workunit.client.1.smithi154.stdout:6/360: rmdir d8/d13 39 2024-05-06T21:26:50.244 INFO:tasks.workunit.client.1.smithi154.stdout:4/518: dread d0/d82/d39/d63/f9e [0,4194304] 0 2024-05-06T21:26:50.244 INFO:tasks.workunit.client.1.smithi154.stdout:4/519: dread - d0/d82/d44/d73/d9a/fac zero size 2024-05-06T21:26:50.244 INFO:tasks.workunit.client.1.smithi154.stdout:4/520: fsync d0/d10/d11/d1a/d7e/f90 0 2024-05-06T21:26:50.244 INFO:tasks.workunit.client.1.smithi154.stdout:4/521: read - d0/d82/faf zero size 2024-05-06T21:26:50.244 INFO:tasks.workunit.client.1.smithi154.stdout:1/588: symlink d6/db/d10/d15/d1d/lb0 0 2024-05-06T21:26:50.246 INFO:tasks.workunit.client.1.smithi154.stdout:3/694: link d0/dd5/lef d0/d2/lf0 0 2024-05-06T21:26:50.246 INFO:tasks.workunit.client.1.smithi154.stdout:3/695: write d0/da/d1a/d28/d4d/f96 [1282125,94186] 0 2024-05-06T21:26:50.250 INFO:tasks.workunit.client.1.smithi154.stdout:1/589: symlink d6/db/d10/d94/lb1 0 2024-05-06T21:26:50.253 INFO:tasks.workunit.client.1.smithi154.stdout:3/696: creat d0/da/db/d7c/d80/ff1 x:0 0 0 2024-05-06T21:26:50.253 INFO:tasks.workunit.client.1.smithi154.stdout:3/697: read - d0/da/db/dd/f53 zero size 2024-05-06T21:26:50.255 INFO:tasks.workunit.client.1.smithi154.stdout:6/361: creat d8/d11/d51/f6f x:0 0 0 2024-05-06T21:26:50.258 INFO:tasks.workunit.client.1.smithi154.stdout:1/590: creat d6/db/d5e/fb2 x:0 0 0 2024-05-06T21:26:50.258 INFO:tasks.workunit.client.1.smithi154.stdout:1/591: fdatasync d6/db/d10/fa1 0 2024-05-06T21:26:50.262 INFO:tasks.workunit.client.1.smithi154.stdout:3/698: symlink d0/da/d1a/d28/lf2 0 2024-05-06T21:26:50.263 INFO:tasks.workunit.client.1.smithi154.stdout:2/479: dwrite db/de/d16/d33/f4d [4194304,4194304] 0 2024-05-06T21:26:50.264 INFO:tasks.workunit.client.0.smithi032.stdout:3/879: dwrite d1/d4/da/d4e/d41/f66 [0,4194304] 0 2024-05-06T21:26:50.264 INFO:tasks.workunit.client.0.smithi032.stdout:3/880: truncate d1/d4/da/d1d/fcf 584508 0 2024-05-06T21:26:50.265 INFO:tasks.workunit.client.1.smithi154.stdout:6/362: rename d8/d11/d2d/d57 to d8/d11/d2d/d3d/d70 0 2024-05-06T21:26:50.267 INFO:tasks.workunit.client.1.smithi154.stdout:1/592: symlink d6/db/lb3 0 2024-05-06T21:26:50.268 INFO:tasks.workunit.client.1.smithi154.stdout:0/600: dwrite d6/fa8 [0,4194304] 0 2024-05-06T21:26:50.270 INFO:tasks.workunit.client.1.smithi154.stdout:0/601: write d6/dc/d40/f47 [616059,88830] 0 2024-05-06T21:26:50.270 INFO:tasks.workunit.client.1.smithi154.stdout:0/602: readlink d6/dc/d40/d4a/l56 0 2024-05-06T21:26:50.270 INFO:tasks.workunit.client.1.smithi154.stdout:2/480: mkdir db/d12/d19/d91 0 2024-05-06T21:26:50.271 INFO:tasks.workunit.client.1.smithi154.stdout:6/363: creat d8/d13/f71 x:0 0 0 2024-05-06T21:26:50.281 INFO:tasks.workunit.client.1.smithi154.stdout:6/364: read f1 [2902381,99798] 0 2024-05-06T21:26:50.282 INFO:tasks.workunit.client.1.smithi154.stdout:2/481: symlink db/de/d16/l92 0 2024-05-06T21:26:50.284 INFO:tasks.workunit.client.1.smithi154.stdout:8/443: dwrite d3/d14/d1a/d45/f5a [0,4194304] 0 2024-05-06T21:26:50.284 INFO:tasks.workunit.client.1.smithi154.stdout:3/699: dwrite d0/da/db/dd/f3c [4194304,4194304] 0 2024-05-06T21:26:50.285 INFO:tasks.workunit.client.1.smithi154.stdout:2/482: creat db/de/d6f/f93 x:0 0 0 2024-05-06T21:26:50.287 INFO:tasks.workunit.client.1.smithi154.stdout:3/700: dread d0/da/db/d30/f3d [0,4194304] 0 2024-05-06T21:26:50.287 INFO:tasks.workunit.client.1.smithi154.stdout:3/701: fsync d0/da/d1a/fcb 0 2024-05-06T21:26:50.288 INFO:tasks.workunit.client.1.smithi154.stdout:8/444: symlink d3/d14/d1a/d29/d32/d40/d4b/l8f 0 2024-05-06T21:26:50.288 INFO:tasks.workunit.client.1.smithi154.stdout:8/445: write d3/d14/d1a/d29/d32/d40/d79/f88 [667249,108041] 0 2024-05-06T21:26:50.288 INFO:tasks.workunit.client.1.smithi154.stdout:8/446: fsync d3/d14/d1a/d29/d68/d61/f81 0 2024-05-06T21:26:50.291 INFO:tasks.workunit.client.1.smithi154.stdout:1/593: dread d6/db/d10/d15/f4a [4194304,4194304] 0 2024-05-06T21:26:50.291 INFO:tasks.workunit.client.1.smithi154.stdout:1/594: fsync d6/d3e/fa0 0 2024-05-06T21:26:50.291 INFO:tasks.workunit.client.1.smithi154.stdout:1/595: dread - d6/db/d10/fa1 zero size 2024-05-06T21:26:50.291 INFO:tasks.workunit.client.1.smithi154.stdout:1/596: creat d6/db/d69/d89/fb4 x:0 0 0 2024-05-06T21:26:50.291 INFO:tasks.workunit.client.1.smithi154.stdout:2/483: symlink db/d12/d1d/d60/d63/l94 0 2024-05-06T21:26:50.292 INFO:tasks.workunit.client.1.smithi154.stdout:2/484: stat db/d86 0 2024-05-06T21:26:50.292 INFO:tasks.workunit.client.1.smithi154.stdout:2/485: truncate db/de/d10/f69 542806 0 2024-05-06T21:26:50.293 INFO:tasks.workunit.client.1.smithi154.stdout:3/702: rename d0/da/db/dd/d1c/d21/l7f to d0/da/db/d52/lf3 0 2024-05-06T21:26:50.293 INFO:tasks.workunit.client.1.smithi154.stdout:3/703: write d0/da/db/f73 [1758079,61516] 0 2024-05-06T21:26:50.293 INFO:tasks.workunit.client.1.smithi154.stdout:0/603: dwrite d6/dc/f34 [0,4194304] 0 2024-05-06T21:26:50.294 INFO:tasks.workunit.client.1.smithi154.stdout:0/604: write d6/dc/d40/d4a/d6c/fb4 [668712,45345] 0 2024-05-06T21:26:50.295 INFO:tasks.workunit.client.1.smithi154.stdout:2/486: mkdir db/d12/d1d/d60/d95 0 2024-05-06T21:26:50.298 INFO:tasks.workunit.client.1.smithi154.stdout:1/597: rename d6/f7f to d6/d3e/d7e/fb5 0 2024-05-06T21:26:50.299 INFO:tasks.workunit.client.1.smithi154.stdout:3/704: unlink d0/da/d1a/c24 0 2024-05-06T21:26:50.300 INFO:tasks.workunit.client.1.smithi154.stdout:8/447: write d3/d14/f20 [2996000,107431] 0 2024-05-06T21:26:50.302 INFO:tasks.workunit.client.1.smithi154.stdout:2/487: link db/de/d10/d18/c1e db/d12/d1d/d83/c96 0 2024-05-06T21:26:50.304 INFO:tasks.workunit.client.1.smithi154.stdout:1/598: mknod d6/d3e/d7e/da5/cb6 0 2024-05-06T21:26:50.306 INFO:tasks.workunit.client.1.smithi154.stdout:3/705: rename d0/da/db/d52/c5e to d0/da/d1a/d28/cf4 0 2024-05-06T21:26:50.307 INFO:tasks.workunit.client.1.smithi154.stdout:8/448: chown d3/d14/d1a/d29/d32/c5b 107 1 2024-05-06T21:26:50.307 INFO:tasks.workunit.client.1.smithi154.stdout:8/449: write d3/d14/f18 [3012934,106538] 0 2024-05-06T21:26:50.308 INFO:tasks.workunit.client.1.smithi154.stdout:8/450: dread d3/d14/d1a/d45/f7d [0,4194304] 0 2024-05-06T21:26:50.311 INFO:tasks.workunit.client.1.smithi154.stdout:1/599: rmdir d6/db/d9e 0 2024-05-06T21:26:50.311 INFO:tasks.workunit.client.1.smithi154.stdout:8/451: dread d3/d14/d1a/d45/f5f [0,4194304] 0 2024-05-06T21:26:50.311 INFO:tasks.workunit.client.1.smithi154.stdout:8/452: readlink d3/d14/d1a/l1b 0 2024-05-06T21:26:50.312 INFO:tasks.workunit.client.1.smithi154.stdout:2/488: write db/de/d16/d33/f61 [116707,15898] 0 2024-05-06T21:26:50.314 INFO:tasks.workunit.client.1.smithi154.stdout:7/417: sync 2024-05-06T21:26:50.314 INFO:tasks.workunit.client.1.smithi154.stdout:9/587: sync 2024-05-06T21:26:50.314 INFO:tasks.workunit.client.1.smithi154.stdout:5/562: sync 2024-05-06T21:26:50.314 INFO:tasks.workunit.client.1.smithi154.stdout:5/563: write d2/d3/d19/d23/f78 [403957,27851] 0 2024-05-06T21:26:50.316 INFO:tasks.workunit.client.1.smithi154.stdout:2/489: symlink db/de/d10/d18/l97 0 2024-05-06T21:26:50.319 INFO:tasks.workunit.client.1.smithi154.stdout:2/490: write db/d12/f2a [250041,114576] 0 2024-05-06T21:26:50.319 INFO:tasks.workunit.client.1.smithi154.stdout:2/491: fdatasync db/d12/f43 0 2024-05-06T21:26:50.319 INFO:tasks.workunit.client.1.smithi154.stdout:2/492: truncate db/de/d16/f1f 2657195 0 2024-05-06T21:26:50.319 INFO:tasks.workunit.client.1.smithi154.stdout:7/418: mkdir d6/d20/d85 0 2024-05-06T21:26:50.320 INFO:tasks.workunit.client.1.smithi154.stdout:3/706: dread d0/da/d1a/d28/dbc/d81/f6b [0,4194304] 0 2024-05-06T21:26:50.320 INFO:tasks.workunit.client.1.smithi154.stdout:9/588: write d5/d20/f4b [150906,90461] 0 2024-05-06T21:26:50.321 INFO:tasks.workunit.client.1.smithi154.stdout:5/564: mkdir d2/d3/d19/dbe 0 2024-05-06T21:26:50.322 INFO:tasks.workunit.client.1.smithi154.stdout:2/493: truncate db/de/f1c 3668933 0 2024-05-06T21:26:50.323 INFO:tasks.workunit.client.1.smithi154.stdout:0/605: dwrite d6/dc/d44/d36/d89/faf [0,4194304] 0 2024-05-06T21:26:50.323 INFO:tasks.workunit.client.1.smithi154.stdout:8/453: dread d3/d14/d1a/d29/f74 [0,4194304] 0 2024-05-06T21:26:50.323 INFO:tasks.workunit.client.1.smithi154.stdout:8/454: chown d3/l25 2044720 1 2024-05-06T21:26:50.323 INFO:tasks.workunit.client.1.smithi154.stdout:8/455: stat d3/l16 0 2024-05-06T21:26:50.323 INFO:tasks.workunit.client.1.smithi154.stdout:9/589: dread d5/d20/f81 [0,4194304] 0 2024-05-06T21:26:50.324 INFO:tasks.workunit.client.1.smithi154.stdout:7/419: truncate d6/d42/d6c/d6e/d23/f28 3355733 0 2024-05-06T21:26:50.324 INFO:tasks.workunit.client.1.smithi154.stdout:3/707: creat d0/da/d1a/dbf/ff5 x:0 0 0 2024-05-06T21:26:50.324 INFO:tasks.workunit.client.1.smithi154.stdout:3/708: chown d0/da/db/d7c/d80/ff1 445807 1 2024-05-06T21:26:50.324 INFO:tasks.workunit.client.1.smithi154.stdout:3/709: readlink d0/da/db/d52/lf3 0 2024-05-06T21:26:50.324 INFO:tasks.workunit.client.1.smithi154.stdout:3/710: read - d0/da/fcc zero size 2024-05-06T21:26:50.324 INFO:tasks.workunit.client.1.smithi154.stdout:3/711: dread - d0/da/d1a/d28/dbc/d81/d48/da9/fe4 zero size 2024-05-06T21:26:50.325 INFO:tasks.workunit.client.1.smithi154.stdout:5/565: symlink d2/d3/d21/d22/d25/db0/lbf 0 2024-05-06T21:26:50.326 INFO:tasks.workunit.client.1.smithi154.stdout:2/494: creat db/de/d16/f98 x:0 0 0 2024-05-06T21:26:50.326 INFO:tasks.workunit.client.1.smithi154.stdout:2/495: chown db/d12/d1d/f64 189 1 2024-05-06T21:26:50.327 INFO:tasks.workunit.client.1.smithi154.stdout:2/496: chown db/d12/d1d/f47 3641 1 2024-05-06T21:26:50.327 INFO:tasks.workunit.client.1.smithi154.stdout:2/497: stat db/de/d16/d4f 0 2024-05-06T21:26:50.327 INFO:tasks.workunit.client.1.smithi154.stdout:2/498: write db/d12/d1d/f47 [1362201,68998] 0 2024-05-06T21:26:50.327 INFO:tasks.workunit.client.1.smithi154.stdout:2/499: write db/d12/f37 [1540409,40302] 0 2024-05-06T21:26:50.327 INFO:tasks.workunit.client.1.smithi154.stdout:0/606: dread d6/dc/d3c/fa5 [0,4194304] 0 2024-05-06T21:26:50.327 INFO:tasks.workunit.client.1.smithi154.stdout:0/607: write d6/dc/d40/f47 [516790,121812] 0 2024-05-06T21:26:50.328 INFO:tasks.workunit.client.1.smithi154.stdout:1/600: rmdir d6/db/d69/d89 39 2024-05-06T21:26:50.331 INFO:tasks.workunit.client.1.smithi154.stdout:9/590: symlink d5/d89/lcb 0 2024-05-06T21:26:50.333 INFO:tasks.workunit.client.1.smithi154.stdout:3/712: symlink d0/da/d1a/dbf/lf6 0 2024-05-06T21:26:50.333 INFO:tasks.workunit.client.1.smithi154.stdout:5/566: write d2/d48/f7c [3134529,94160] 0 2024-05-06T21:26:50.335 INFO:tasks.workunit.client.1.smithi154.stdout:2/500: link db/de/d16/f65 db/de/f99 0 2024-05-06T21:26:50.335 INFO:tasks.workunit.client.1.smithi154.stdout:2/501: truncate db/d12/d1d/d60/d63/f70 395230 0 2024-05-06T21:26:50.336 INFO:tasks.workunit.client.1.smithi154.stdout:1/601: link d6/db/d10/c14 d6/db/d74/cb7 0 2024-05-06T21:26:50.340 INFO:tasks.workunit.client.1.smithi154.stdout:9/591: symlink d5/d2e/d66/lcc 0 2024-05-06T21:26:50.341 INFO:tasks.workunit.client.1.smithi154.stdout:3/713: creat d0/d2/d22/ff7 x:0 0 0 2024-05-06T21:26:50.341 INFO:tasks.workunit.client.1.smithi154.stdout:5/567: dread d2/d3/d21/d95/dd/fad [0,4194304] 0 2024-05-06T21:26:50.341 INFO:tasks.workunit.client.1.smithi154.stdout:3/714: fsync d0/f50 0 2024-05-06T21:26:50.341 INFO:tasks.workunit.client.1.smithi154.stdout:3/715: fsync d0/da/db/d7c/fb9 0 2024-05-06T21:26:50.347 INFO:tasks.workunit.client.1.smithi154.stdout:5/568: truncate d2/d3/d21/d22/d25/d37/f6c 2983698 0 2024-05-06T21:26:50.347 INFO:tasks.workunit.client.1.smithi154.stdout:5/569: chown d2/d3/d21/c3e 698664 1 2024-05-06T21:26:50.347 INFO:tasks.workunit.client.1.smithi154.stdout:9/592: dread d5/d14/f94 [0,4194304] 0 2024-05-06T21:26:50.349 INFO:tasks.workunit.client.1.smithi154.stdout:3/716: mknod d0/da/d1a/d28/dbc/d81/cf8 0 2024-05-06T21:26:50.349 INFO:tasks.workunit.client.1.smithi154.stdout:3/717: truncate d0/da/db/f2a 4575380 0 2024-05-06T21:26:50.349 INFO:tasks.workunit.client.1.smithi154.stdout:3/718: stat d0/da/db/d30/f3d 0 2024-05-06T21:26:50.353 INFO:tasks.workunit.client.1.smithi154.stdout:8/456: rename d3/d64/d6d/d8a to d3/d14/d1a/d29/d32/d40/d79/d90 0 2024-05-06T21:26:50.354 INFO:tasks.workunit.client.1.smithi154.stdout:0/608: rename d6/dc/d40/d5e/db5 to d6/dc/d40/d5e/db5/dc7 22 2024-05-06T21:26:50.354 INFO:tasks.workunit.client.1.smithi154.stdout:8/457: readlink d3/d14/d1a/d29/l7b 0 2024-05-06T21:26:50.354 INFO:tasks.workunit.client.1.smithi154.stdout:1/602: dwrite d6/db/f5b [0,4194304] 0 2024-05-06T21:26:50.356 INFO:tasks.workunit.client.1.smithi154.stdout:5/570: unlink d2/d3/d21/d95/dc/c9d 0 2024-05-06T21:26:50.357 INFO:tasks.workunit.client.1.smithi154.stdout:9/593: creat d5/d2e/d7f/fcd x:0 0 0 2024-05-06T21:26:50.358 INFO:tasks.workunit.client.1.smithi154.stdout:3/719: getdents d0/da/d1a/d28/d17/db0/d76 0 2024-05-06T21:26:50.360 INFO:tasks.workunit.client.1.smithi154.stdout:0/609: rename d6/dc/d44/f29 to d6/dc/d44/d36/d89/fc8 0 2024-05-06T21:26:50.360 INFO:tasks.workunit.client.1.smithi154.stdout:0/610: write d6/dc/d39/fc4 [766091,108038] 0 2024-05-06T21:26:50.360 INFO:tasks.workunit.client.1.smithi154.stdout:0/611: write d6/dc/d40/d5e/f8c [4107415,69119] 0 2024-05-06T21:26:50.360 INFO:tasks.workunit.client.1.smithi154.stdout:7/420: dread d6/d42/d6c/d6e/d23/f28 [0,4194304] 0 2024-05-06T21:26:50.362 INFO:tasks.workunit.client.1.smithi154.stdout:5/571: dread d2/d3/d21/d95/dd/f18 [0,4194304] 0 2024-05-06T21:26:50.362 INFO:tasks.workunit.client.1.smithi154.stdout:5/572: chown d2/d3/l8f 273 1 2024-05-06T21:26:50.362 INFO:tasks.workunit.client.1.smithi154.stdout:5/573: stat d2/d3/d21/d22/d25/d37 0 2024-05-06T21:26:50.367 INFO:tasks.workunit.client.1.smithi154.stdout:8/458: dwrite d3/ff [4194304,4194304] 0 2024-05-06T21:26:50.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:49 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:26:50.414 INFO:tasks.workunit.client.0.smithi032.stdout:6/822: sync 2024-05-06T21:26:50.415 INFO:tasks.workunit.client.0.smithi032.stdout:6/823: stat d8/d33/lde 0 2024-05-06T21:26:50.416 INFO:tasks.workunit.client.0.smithi032.stdout:6/824: link d8/d3d/d49/l53 d8/dd/d1b/d35/lfa 0 2024-05-06T21:26:50.416 INFO:tasks.workunit.client.0.smithi032.stdout:6/825: chown d8/dd/d18/d3b/db9/l92 47226 1 2024-05-06T21:26:50.416 INFO:tasks.workunit.client.0.smithi032.stdout:6/826: dread - d8/dd/d18/dda/ff7 zero size 2024-05-06T21:26:50.417 INFO:tasks.workunit.client.0.smithi032.stdout:2/683: sync 2024-05-06T21:26:50.417 INFO:tasks.workunit.client.0.smithi032.stdout:6/827: truncate d8/d3d/d73/d87/f64 193586 0 2024-05-06T21:26:50.418 INFO:tasks.workunit.client.0.smithi032.stdout:6/828: symlink d8/lfb 0 2024-05-06T21:26:50.418 INFO:tasks.workunit.client.0.smithi032.stdout:6/829: chown d8/dd/d18/d13/fa7 797390 1 2024-05-06T21:26:50.419 INFO:tasks.workunit.client.0.smithi032.stdout:6/830: symlink d8/db6/lfc 0 2024-05-06T21:26:50.420 INFO:tasks.workunit.client.0.smithi032.stdout:6/831: mknod d8/dd/d18/d13/d1d/cfd 0 2024-05-06T21:26:50.420 INFO:tasks.workunit.client.0.smithi032.stdout:6/832: creat d8/dd/d1b/d67/ffe x:0 0 0 2024-05-06T21:26:50.426 INFO:tasks.workunit.client.0.smithi032.stdout:2/684: dread df/d19/d1e/d71/d5f/d7d/f9c [0,4194304] 0 2024-05-06T21:26:50.426 INFO:tasks.workunit.client.0.smithi032.stdout:2/685: write f7 [423019,70333] 0 2024-05-06T21:26:50.445 INFO:tasks.workunit.client.0.smithi032.stdout:2/686: dwrite df/f12 [0,4194304] 0 2024-05-06T21:26:50.446 INFO:tasks.workunit.client.0.smithi032.stdout:2/687: mknod df/d19/d1e/d35/dc5/d2e/dbc/ced 0 2024-05-06T21:26:50.447 INFO:tasks.workunit.client.0.smithi032.stdout:2/688: mknod df/d19/d1e/d35/dc5/cee 0 2024-05-06T21:26:50.455 INFO:tasks.workunit.client.0.smithi032.stdout:2/689: dread df/dae/fb7 [0,4194304] 0 2024-05-06T21:26:50.456 INFO:tasks.workunit.client.0.smithi032.stdout:2/690: symlink df/lef 0 2024-05-06T21:26:50.456 INFO:tasks.workunit.client.0.smithi032.stdout:2/691: symlink df/d19/d1e/d71/d5f/d7d/d65/lf0 0 2024-05-06T21:26:50.471 INFO:tasks.workunit.client.0.smithi032.stdout:2/692: dwrite df/d19/d1e/d71/d5f/d7d/d65/d78/da6/fb3 [0,4194304] 0 2024-05-06T21:26:50.471 INFO:tasks.workunit.client.0.smithi032.stdout:2/693: chown df/d19/d1e/d71/d5f/d7d/d65/d78/f8d 33207917 1 2024-05-06T21:26:50.488 INFO:tasks.workunit.client.0.smithi032.stdout:2/694: dwrite df/f1c [0,4194304] 0 2024-05-06T21:26:50.489 INFO:tasks.workunit.client.0.smithi032.stdout:2/695: mkdir df/d19/d1e/d71/d5f/d73/df1 0 2024-05-06T21:26:50.506 INFO:tasks.workunit.client.0.smithi032.stdout:2/696: dwrite df/d19/d1e/d35/dc5/d9f/dc0/fcc [0,4194304] 0 2024-05-06T21:26:50.514 INFO:tasks.workunit.client.0.smithi032.stdout:2/697: write df/d19/d1e/d35/dc5/d2e/f9e [1775753,54118] 0 2024-05-06T21:26:50.516 INFO:tasks.workunit.client.0.smithi032.stdout:2/698: mkdir df/daf/df2 0 2024-05-06T21:26:50.517 INFO:tasks.workunit.client.0.smithi032.stdout:2/699: rmdir df/d19/d1e/d35/dc5/d2e/dbc/deb 0 2024-05-06T21:26:50.519 INFO:tasks.workunit.client.0.smithi032.stdout:2/700: link df/d19/d1e/d71/d5f/d7d/d65/f74 df/d19/d1e/d35/ff3 0 2024-05-06T21:26:50.519 INFO:tasks.workunit.client.1.smithi154.stdout:2/502: truncate db/de/d16/f1f 493850 0 2024-05-06T21:26:50.520 INFO:tasks.workunit.client.0.smithi032.stdout:2/701: mkdir df/d19/d1e/d42/dc6/dc1/df4 0 2024-05-06T21:26:50.521 INFO:tasks.workunit.client.0.smithi032.stdout:2/702: dread - df/daf/fbd zero size 2024-05-06T21:26:50.521 INFO:tasks.workunit.client.0.smithi032.stdout:2/703: chown df/d19/d1e/d71/d5f/d7d/d25/d2d/f45 767712 1 2024-05-06T21:26:50.521 INFO:tasks.workunit.client.1.smithi154.stdout:1/603: rmdir d6 39 2024-05-06T21:26:50.521 INFO:tasks.workunit.client.1.smithi154.stdout:1/604: write d6/db/f99 [6188604,13264] 0 2024-05-06T21:26:50.522 INFO:tasks.workunit.client.0.smithi032.stdout:2/704: creat df/d19/d1e/d35/dc5/d2e/d33/ff5 x:0 0 0 2024-05-06T21:26:50.522 INFO:tasks.workunit.client.0.smithi032.stdout:2/705: readlink df/l32 0 2024-05-06T21:26:50.523 INFO:tasks.workunit.client.1.smithi154.stdout:9/594: symlink d5/d14/d31/lce 0 2024-05-06T21:26:50.525 INFO:tasks.workunit.client.1.smithi154.stdout:0/612: symlink d6/dc/lc9 0 2024-05-06T21:26:50.525 INFO:tasks.workunit.client.1.smithi154.stdout:0/613: fdatasync d6/dc/f2e 0 2024-05-06T21:26:50.525 INFO:tasks.workunit.client.1.smithi154.stdout:0/614: fdatasync d6/dc/d42/fba 0 2024-05-06T21:26:50.525 INFO:tasks.workunit.client.1.smithi154.stdout:0/615: creat d6/fca x:0 0 0 2024-05-06T21:26:50.525 INFO:tasks.workunit.client.1.smithi154.stdout:0/616: stat d6/f53 0 2024-05-06T21:26:50.525 INFO:tasks.workunit.client.1.smithi154.stdout:0/617: creat d6/dc/d40/fcb x:0 0 0 2024-05-06T21:26:50.525 INFO:tasks.workunit.client.1.smithi154.stdout:0/618: fdatasync d6/dc/d40/d4a/da7/f86 0 2024-05-06T21:26:50.526 INFO:tasks.workunit.client.1.smithi154.stdout:7/421: creat d6/d54/d5b/d82/f86 x:0 0 0 2024-05-06T21:26:50.527 INFO:tasks.workunit.client.1.smithi154.stdout:1/605: dread d6/d3e/f75 [0,4194304] 0 2024-05-06T21:26:50.527 INFO:tasks.workunit.client.1.smithi154.stdout:1/606: fsync d6/db/d5e/f73 0 2024-05-06T21:26:50.527 INFO:tasks.workunit.client.1.smithi154.stdout:1/607: write d6/db/d74/f80 [1090084,5558] 0 2024-05-06T21:26:50.527 INFO:tasks.workunit.client.1.smithi154.stdout:5/574: mkdir d2/d3/d21/d95/dc/d44/dc0 0 2024-05-06T21:26:50.528 INFO:tasks.workunit.client.1.smithi154.stdout:0/619: dread d6/dc/d44/d36/f4e [0,4194304] 0 2024-05-06T21:26:50.530 INFO:tasks.workunit.client.1.smithi154.stdout:5/575: dread d2/d3/d21/d95/dd/f18 [0,4194304] 0 2024-05-06T21:26:50.532 INFO:tasks.workunit.client.0.smithi032.stdout:2/706: read df/f2c [2391648,91325] 0 2024-05-06T21:26:50.534 INFO:tasks.workunit.client.0.smithi032.stdout:2/707: creat df/d19/d1e/d42/dc6/dc1/df4/ff6 x:0 0 0 2024-05-06T21:26:50.536 INFO:tasks.workunit.client.1.smithi154.stdout:8/459: link d3/f9 d3/f91 0 2024-05-06T21:26:50.536 INFO:tasks.workunit.client.1.smithi154.stdout:8/460: stat d3/d14/d1a/d29/f74 0 2024-05-06T21:26:50.536 INFO:tasks.workunit.client.0.smithi032.stdout:2/708: dread df/d19/d1e/d71/d5f/d7d/d25/d2d/f47 [0,4194304] 0 2024-05-06T21:26:50.537 INFO:tasks.workunit.client.1.smithi154.stdout:2/503: link db/d12/d1d/l6c db/d12/d19/d4b/l9a 0 2024-05-06T21:26:50.540 INFO:tasks.workunit.client.1.smithi154.stdout:3/720: rmdir d0/d2 39 2024-05-06T21:26:50.542 INFO:tasks.workunit.client.1.smithi154.stdout:5/576: read d2/d3/d21/d95/dc/f66 [212275,58442] 0 2024-05-06T21:26:50.542 INFO:tasks.workunit.client.1.smithi154.stdout:5/577: chown d2/d3/d21/d95/dd/d2a/d54 26108 1 2024-05-06T21:26:50.543 INFO:tasks.workunit.client.1.smithi154.stdout:1/608: unlink d6/db/l79 0 2024-05-06T21:26:50.543 INFO:tasks.workunit.client.1.smithi154.stdout:0/620: rmdir d6/dc/d44/d36/d89 39 2024-05-06T21:26:50.544 INFO:tasks.workunit.client.1.smithi154.stdout:7/422: dwrite d6/d20/d40/f50 [0,4194304] 0 2024-05-06T21:26:50.545 INFO:tasks.workunit.client.1.smithi154.stdout:8/461: symlink d3/d38/l92 0 2024-05-06T21:26:50.547 INFO:tasks.workunit.client.1.smithi154.stdout:2/504: rename db/c3a to db/d12/d19/d81/c9b 0 2024-05-06T21:26:50.549 INFO:tasks.workunit.client.1.smithi154.stdout:0/621: link d6/dc/d40/l9d d6/dc/d40/d4a/da3/lcc 0 2024-05-06T21:26:50.553 INFO:tasks.workunit.client.1.smithi154.stdout:7/423: getdents d6/d20/d40/d52 0 2024-05-06T21:26:50.553 INFO:tasks.workunit.client.1.smithi154.stdout:4/522: sync 2024-05-06T21:26:50.554 INFO:tasks.workunit.client.1.smithi154.stdout:4/523: write d0/d82/d44/f68 [1169737,36304] 0 2024-05-06T21:26:50.554 INFO:tasks.workunit.client.1.smithi154.stdout:8/462: creat d3/d14/d1a/d45/f93 x:0 0 0 2024-05-06T21:26:50.556 INFO:tasks.workunit.client.1.smithi154.stdout:2/505: mknod db/c9c 0 2024-05-06T21:26:50.556 INFO:tasks.workunit.client.1.smithi154.stdout:2/506: chown db/de/l62 20134308 1 2024-05-06T21:26:50.556 INFO:tasks.workunit.client.1.smithi154.stdout:9/595: dwrite d5/d20/d37/f5f [0,4194304] 0 2024-05-06T21:26:50.556 INFO:tasks.workunit.client.1.smithi154.stdout:5/578: write d2/d3/d21/d95/dc/f15 [1710778,42645] 0 2024-05-06T21:26:50.557 INFO:tasks.workunit.client.1.smithi154.stdout:1/609: getdents d6/db/d10 0 2024-05-06T21:26:50.561 INFO:tasks.workunit.client.1.smithi154.stdout:0/622: creat d6/dc/d40/d5e/db5/fcd x:0 0 0 2024-05-06T21:26:50.561 INFO:tasks.workunit.client.1.smithi154.stdout:0/623: truncate d6/dc/f4f 2076798 0 2024-05-06T21:26:50.561 INFO:tasks.workunit.client.1.smithi154.stdout:0/624: fdatasync d6/dc/d44/f72 0 2024-05-06T21:26:50.561 INFO:tasks.workunit.client.1.smithi154.stdout:0/625: readlink d6/dc/d44/l1e 0 2024-05-06T21:26:50.561 INFO:tasks.workunit.client.1.smithi154.stdout:0/626: write d6/dc/d39/fb9 [1038038,21195] 0 2024-05-06T21:26:50.561 INFO:tasks.workunit.client.1.smithi154.stdout:0/627: readlink d6/l18 0 2024-05-06T21:26:50.561 INFO:tasks.workunit.client.1.smithi154.stdout:0/628: truncate d6/dc/d40/d4a/d6c/f9e 1284799 0 2024-05-06T21:26:50.562 INFO:tasks.workunit.client.1.smithi154.stdout:4/524: symlink d0/d82/d44/d73/d9a/lb2 0 2024-05-06T21:26:50.562 INFO:tasks.workunit.client.1.smithi154.stdout:6/365: sync 2024-05-06T21:26:50.563 INFO:tasks.workunit.client.1.smithi154.stdout:8/463: mkdir d3/d14/d1a/d29/d32/d40/d59/d67/d94 0 2024-05-06T21:26:50.565 INFO:tasks.workunit.client.1.smithi154.stdout:2/507: creat db/de/f9d x:0 0 0 2024-05-06T21:26:50.565 INFO:tasks.workunit.client.1.smithi154.stdout:2/508: getdents db/d12/d1d/d60/d95 0 2024-05-06T21:26:50.565 INFO:tasks.workunit.client.1.smithi154.stdout:2/509: chown db/de/d16/f27 8667391 1 2024-05-06T21:26:50.565 INFO:tasks.workunit.client.1.smithi154.stdout:9/596: dread d5/d2e/f55 [0,4194304] 0 2024-05-06T21:26:50.568 INFO:tasks.workunit.client.1.smithi154.stdout:5/579: creat d2/da5/fc1 x:0 0 0 2024-05-06T21:26:50.569 INFO:tasks.workunit.client.1.smithi154.stdout:5/580: creat d2/d3/d21/d95/dc/d68/d69/fc2 x:0 0 0 2024-05-06T21:26:50.569 INFO:tasks.workunit.client.1.smithi154.stdout:1/610: stat d6/db/d69/d89/l95 0 2024-05-06T21:26:50.571 INFO:tasks.workunit.client.1.smithi154.stdout:7/424: getdents d6/d42/d6c/d6e/d21/d69 0 2024-05-06T21:26:50.572 INFO:tasks.workunit.client.1.smithi154.stdout:2/510: dread db/de/d10/f25 [0,4194304] 0 2024-05-06T21:26:50.573 INFO:tasks.workunit.client.1.smithi154.stdout:4/525: rename d0/d82/c96 to d0/d2/cb3 0 2024-05-06T21:26:50.575 INFO:tasks.workunit.client.1.smithi154.stdout:6/366: mknod d8/d11/d2d/c72 0 2024-05-06T21:26:50.575 INFO:tasks.workunit.client.1.smithi154.stdout:6/367: chown d8/d11/d51 610 1 2024-05-06T21:26:50.578 INFO:tasks.workunit.client.1.smithi154.stdout:9/597: creat d5/d20/d52/d6e/d83/da2/fcf x:0 0 0 2024-05-06T21:26:50.579 INFO:tasks.workunit.client.0.smithi032.stdout:2/709: dwrite df/d19/d1e/d35/dc5/d9f/fa1 [0,4194304] 0 2024-05-06T21:26:50.584 INFO:tasks.workunit.client.1.smithi154.stdout:2/511: rename db/d12/d4e/l50 to db/de/d16/d4f/l9e 0 2024-05-06T21:26:50.586 INFO:tasks.workunit.client.1.smithi154.stdout:6/368: write d8/d11/f1d [923527,80285] 0 2024-05-06T21:26:50.586 INFO:tasks.workunit.client.1.smithi154.stdout:6/369: fsync d8/d13/d20/f65 0 2024-05-06T21:26:50.587 INFO:tasks.workunit.client.1.smithi154.stdout:4/526: creat d0/d72/d76/fb4 x:0 0 0 2024-05-06T21:26:50.587 INFO:tasks.workunit.client.1.smithi154.stdout:4/527: fdatasync d0/d2/dc/f26 0 2024-05-06T21:26:50.587 INFO:tasks.workunit.client.1.smithi154.stdout:7/425: dread d6/f10 [0,4194304] 0 2024-05-06T21:26:50.588 INFO:tasks.workunit.client.1.smithi154.stdout:9/598: mknod d5/d14/d3a/cd0 0 2024-05-06T21:26:50.589 INFO:tasks.workunit.client.1.smithi154.stdout:0/629: getdents d6/dc/d40/d5e/db5 0 2024-05-06T21:26:50.590 INFO:tasks.workunit.client.1.smithi154.stdout:2/512: truncate db/d12/f37 644040 0 2024-05-06T21:26:50.592 INFO:tasks.workunit.client.1.smithi154.stdout:9/599: mknod d5/d14/d3a/d71/db1/cd1 0 2024-05-06T21:26:50.594 INFO:tasks.workunit.client.1.smithi154.stdout:2/513: creat db/d12/d19/d4b/d78/f9f x:0 0 0 2024-05-06T21:26:50.597 INFO:tasks.workunit.client.1.smithi154.stdout:9/600: link d5/d20/d37/f64 d5/d2e/d8b/fd2 0 2024-05-06T21:26:50.600 INFO:tasks.workunit.client.1.smithi154.stdout:2/514: rename db/de/d10/d18/f5a to db/d12/d4e/d55/fa0 0 2024-05-06T21:26:50.600 INFO:tasks.workunit.client.1.smithi154.stdout:2/515: write db/d12/d19/f54 [345968,23931] 0 2024-05-06T21:26:50.600 INFO:tasks.workunit.client.1.smithi154.stdout:2/516: write db/de/d16/d33/f61 [2325564,114141] 0 2024-05-06T21:26:50.601 INFO:tasks.workunit.client.1.smithi154.stdout:4/528: write d0/d2/d47/fad [1476534,85528] 0 2024-05-06T21:26:50.603 INFO:tasks.workunit.client.1.smithi154.stdout:2/517: creat db/d12/d1d/d60/fa1 x:0 0 0 2024-05-06T21:26:50.605 INFO:tasks.workunit.client.1.smithi154.stdout:9/601: rename d5/f12 to d5/d14/d31/fd3 0 2024-05-06T21:26:50.606 INFO:tasks.workunit.client.1.smithi154.stdout:6/370: write d8/d13/f5e [3081710,45850] 0 2024-05-06T21:26:50.606 INFO:tasks.workunit.client.1.smithi154.stdout:5/581: dwrite d2/d3/d21/d95/dd/fad [0,4194304] 0 2024-05-06T21:26:50.607 INFO:tasks.workunit.client.0.smithi032.stdout:2/710: dread df/d19/d1e/d35/dc5/d2e/f94 [0,4194304] 0 2024-05-06T21:26:50.607 INFO:tasks.workunit.client.1.smithi154.stdout:2/518: creat db/de/d10/d18/fa2 x:0 0 0 2024-05-06T21:26:50.612 INFO:tasks.workunit.client.1.smithi154.stdout:5/582: rename d2/d3/d19/c6b to d2/d3/d8b/cc3 0 2024-05-06T21:26:50.613 INFO:tasks.workunit.client.1.smithi154.stdout:2/519: symlink db/d12/d1d/d60/la3 0 2024-05-06T21:26:50.616 INFO:tasks.workunit.client.1.smithi154.stdout:9/602: mknod d5/d14/cd4 0 2024-05-06T21:26:50.616 INFO:tasks.workunit.client.1.smithi154.stdout:6/371: rmdir d8/d11/d33 39 2024-05-06T21:26:50.618 INFO:tasks.workunit.client.1.smithi154.stdout:5/583: mknod d2/d3/d21/d95/dd/d2a/dbb/cc4 0 2024-05-06T21:26:50.619 INFO:tasks.workunit.client.1.smithi154.stdout:2/520: mknod db/d12/d1d/d60/d95/ca4 0 2024-05-06T21:26:50.621 INFO:tasks.workunit.client.1.smithi154.stdout:5/584: symlink d2/d3/d21/d95/dc/d68/lc5 0 2024-05-06T21:26:50.622 INFO:tasks.workunit.client.1.smithi154.stdout:5/585: fdatasync d2/d3/d21/d95/dc/f30 0 2024-05-06T21:26:50.622 INFO:tasks.workunit.client.1.smithi154.stdout:5/586: write d2/d3/fb2 [393900,12266] 0 2024-05-06T21:26:50.622 INFO:tasks.workunit.client.1.smithi154.stdout:2/521: truncate db/d12/d4e/d55/f5e 849849 0 2024-05-06T21:26:50.625 INFO:tasks.workunit.client.1.smithi154.stdout:6/372: link d8/d11/c35 d8/c73 0 2024-05-06T21:26:50.626 INFO:tasks.workunit.client.0.smithi032.stdout:2/711: dread df/d19/d1e/d42/dc6/dc1/fdb [0,4194304] 0 2024-05-06T21:26:50.626 INFO:tasks.workunit.client.1.smithi154.stdout:5/587: symlink d2/d3/d21/d95/dc/d44/d9a/dab/lc6 0 2024-05-06T21:26:50.626 INFO:tasks.workunit.client.1.smithi154.stdout:2/522: truncate db/de/f74 211495 0 2024-05-06T21:26:50.627 INFO:tasks.workunit.client.1.smithi154.stdout:2/523: dread - db/d12/d19/f56 zero size 2024-05-06T21:26:50.628 INFO:tasks.workunit.client.1.smithi154.stdout:6/373: creat d8/d13/d20/f74 x:0 0 0 2024-05-06T21:26:50.628 INFO:tasks.workunit.client.1.smithi154.stdout:6/374: write d8/d11/d2d/d3d/f6b [313385,123769] 0 2024-05-06T21:26:50.628 INFO:tasks.workunit.client.1.smithi154.stdout:6/375: chown d8/f23 120545617 1 2024-05-06T21:26:50.628 INFO:tasks.workunit.client.1.smithi154.stdout:6/376: write d8/d11/d2d/d3d/f6b [1378778,15383] 0 2024-05-06T21:26:50.628 INFO:tasks.workunit.client.1.smithi154.stdout:5/588: creat d2/d3/d8b/fc7 x:0 0 0 2024-05-06T21:26:50.629 INFO:tasks.workunit.client.1.smithi154.stdout:5/589: getdents d2/d3/d21/d95/dd/d2a/d54/d43/db1 0 2024-05-06T21:26:50.629 INFO:tasks.workunit.client.1.smithi154.stdout:5/590: dread - d2/d3/d21/d95/dd/f2c zero size 2024-05-06T21:26:50.629 INFO:tasks.workunit.client.1.smithi154.stdout:1/611: dwrite d6/db/d10/fa9 [0,4194304] 0 2024-05-06T21:26:50.629 INFO:tasks.workunit.client.1.smithi154.stdout:5/591: read d2/d3/d21/d95/dd/d2a/d54/d43/f7b [25805,80920] 0 2024-05-06T21:26:50.629 INFO:tasks.workunit.client.1.smithi154.stdout:2/524: rename db/d12/d4e/c73 to db/d12/d1d/d60/ca5 0 2024-05-06T21:26:50.631 INFO:tasks.workunit.client.1.smithi154.stdout:1/612: mkdir d6/db/d5e/db8 0 2024-05-06T21:26:50.632 INFO:tasks.workunit.client.1.smithi154.stdout:8/464: dwrite d3/d14/d1a/d29/d32/d40/d79/f88 [0,4194304] 0 2024-05-06T21:26:50.632 INFO:tasks.workunit.client.1.smithi154.stdout:5/592: truncate d2/f1d 3960435 0 2024-05-06T21:26:50.632 INFO:tasks.workunit.client.1.smithi154.stdout:5/593: fsync d2/d3/d19/d23/faf 0 2024-05-06T21:26:50.632 INFO:tasks.workunit.client.1.smithi154.stdout:1/613: mknod d6/d3e/d7e/cb9 0 2024-05-06T21:26:50.633 INFO:tasks.workunit.client.1.smithi154.stdout:9/603: write d5/d20/f2c [4060732,14238] 0 2024-05-06T21:26:50.633 INFO:tasks.workunit.client.1.smithi154.stdout:3/721: dwrite d0/da/d1a/d28/d17/db0/f7a [0,4194304] 0 2024-05-06T21:26:50.633 INFO:tasks.workunit.client.1.smithi154.stdout:0/630: dwrite d6/dc/f66 [0,4194304] 0 2024-05-06T21:26:50.636 INFO:tasks.workunit.client.1.smithi154.stdout:5/594: rename d2/d3/d21/d95/dc/d44/d9a/fb8 to d2/d3/d21/d95/dc/d68/fc8 0 2024-05-06T21:26:50.642 INFO:tasks.workunit.client.0.smithi032.stdout:1/756: sync 2024-05-06T21:26:50.642 INFO:tasks.workunit.client.0.smithi032.stdout:0/791: sync 2024-05-06T21:26:50.642 INFO:tasks.workunit.client.0.smithi032.stdout:3/881: sync 2024-05-06T21:26:50.642 INFO:tasks.workunit.client.0.smithi032.stdout:6/833: sync 2024-05-06T21:26:50.642 INFO:tasks.workunit.client.0.smithi032.stdout:7/849: sync 2024-05-06T21:26:50.642 INFO:tasks.workunit.client.0.smithi032.stdout:5/808: sync 2024-05-06T21:26:50.643 INFO:tasks.workunit.client.0.smithi032.stdout:6/834: readlink d8/dd/d1b/d35/lfa 0 2024-05-06T21:26:50.643 INFO:tasks.workunit.client.0.smithi032.stdout:9/863: sync 2024-05-06T21:26:50.643 INFO:tasks.workunit.client.0.smithi032.stdout:5/809: truncate d0/d24/d38/f25 5222538 0 2024-05-06T21:26:50.643 INFO:tasks.workunit.client.0.smithi032.stdout:4/910: sync 2024-05-06T21:26:50.643 INFO:tasks.workunit.client.0.smithi032.stdout:1/757: creat db/d16/d46/d57/d58/d68/ff6 x:0 0 0 2024-05-06T21:26:50.643 INFO:tasks.workunit.client.0.smithi032.stdout:5/810: write d0/d24/d38/d37/df0/d50/f6e [2823371,102335] 0 2024-05-06T21:26:50.643 INFO:tasks.workunit.client.0.smithi032.stdout:9/864: creat d1/d2f/da1/dc2/f128 x:0 0 0 2024-05-06T21:26:50.643 INFO:tasks.workunit.client.0.smithi032.stdout:5/811: readlink d0/l58 0 2024-05-06T21:26:50.643 INFO:tasks.workunit.client.0.smithi032.stdout:5/812: getdents d0/d24/d38/dc4 0 2024-05-06T21:26:50.645 INFO:tasks.workunit.client.1.smithi154.stdout:9/604: mkdir d5/d20/d37/dd5 0 2024-05-06T21:26:50.645 INFO:tasks.workunit.client.1.smithi154.stdout:8/465: mkdir d3/d14/d1a/d29/d32/d40/d59/d67/d95 0 2024-05-06T21:26:50.645 INFO:tasks.workunit.client.1.smithi154.stdout:8/466: symlink d3/d14/d1a/d29/d68/d6b/l96 0 2024-05-06T21:26:50.645 INFO:tasks.workunit.client.1.smithi154.stdout:8/467: rename d3/d14/d1a/d45/l87 to d3/d14/d1a/d29/d68/l97 0 2024-05-06T21:26:50.645 INFO:tasks.workunit.client.1.smithi154.stdout:2/525: write f0 [1430722,15738] 0 2024-05-06T21:26:50.645 INFO:tasks.workunit.client.1.smithi154.stdout:7/426: dwrite d6/f32 [0,4194304] 0 2024-05-06T21:26:50.646 INFO:tasks.workunit.client.1.smithi154.stdout:8/468: truncate d3/d14/d1a/d29/d3e/f66 2248930 0 2024-05-06T21:26:50.646 INFO:tasks.workunit.client.1.smithi154.stdout:2/526: rmdir db/de/d16/d33 39 2024-05-06T21:26:50.646 INFO:tasks.workunit.client.1.smithi154.stdout:4/529: dwrite d0/d2/d47/d81/f86 [0,4194304] 0 2024-05-06T21:26:50.646 INFO:tasks.workunit.client.0.smithi032.stdout:2/712: dread df/d19/d1e/d71/d5f/d7d/f9c [0,4194304] 0 2024-05-06T21:26:50.646 INFO:tasks.workunit.client.0.smithi032.stdout:2/713: dread - df/d19/d1e/d35/d3f/f44 zero size 2024-05-06T21:26:50.646 INFO:tasks.workunit.client.0.smithi032.stdout:2/714: write df/d19/d1e/d71/d5f/d7d/d25/f37 [12640,109969] 0 2024-05-06T21:26:50.646 INFO:tasks.workunit.client.0.smithi032.stdout:0/792: getdents d4/da/d16/d33/d9e/dc9 0 2024-05-06T21:26:50.646 INFO:tasks.workunit.client.0.smithi032.stdout:0/793: write d4/da/d14/d1a/d66/d8a/f100 [1226531,105298] 0 2024-05-06T21:26:50.646 INFO:tasks.workunit.client.0.smithi032.stdout:0/794: readlink d4/d3e/d63/d6c/d8f/lda 0 2024-05-06T21:26:50.647 INFO:tasks.workunit.client.0.smithi032.stdout:3/882: symlink d1/d2a/d71/d9d/l122 0 2024-05-06T21:26:50.647 INFO:tasks.workunit.client.1.smithi154.stdout:8/469: symlink d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/l98 0 2024-05-06T21:26:50.647 INFO:tasks.workunit.client.1.smithi154.stdout:8/470: creat d3/d14/d1a/d45/f99 x:0 0 0 2024-05-06T21:26:50.648 INFO:tasks.workunit.client.1.smithi154.stdout:1/614: read d6/db/d10/d26/f23 [2293513,76546] 0 2024-05-06T21:26:50.649 INFO:tasks.workunit.client.0.smithi032.stdout:1/758: dread db/dc8/de7/fe9 [0,4194304] 0 2024-05-06T21:26:50.649 INFO:tasks.workunit.client.0.smithi032.stdout:1/759: creat db/d16/da3/ff7 x:0 0 0 2024-05-06T21:26:50.649 INFO:tasks.workunit.client.0.smithi032.stdout:0/795: dread d4/da/d16/fb3 [0,4194304] 0 2024-05-06T21:26:50.652 INFO:tasks.workunit.client.0.smithi032.stdout:7/850: rename db/d12/d16/d21/d41/d78/f88 to db/d89/d107/f10d 0 2024-05-06T21:26:50.652 INFO:tasks.workunit.client.0.smithi032.stdout:7/851: stat db/d12/d87/db5 0 2024-05-06T21:26:50.653 INFO:tasks.workunit.client.1.smithi154.stdout:7/427: rmdir d6/d42/d6c/d6e 39 2024-05-06T21:26:50.653 INFO:tasks.workunit.client.1.smithi154.stdout:7/428: chown d6/d20/f79 1000 0 2024-05-06T21:26:50.655 INFO:tasks.workunit.client.0.smithi032.stdout:4/911: creat d2/d16/d44/d74/d79/de6/de8/dd8/f122 x:0 0 0 2024-05-06T21:26:50.658 INFO:tasks.workunit.client.1.smithi154.stdout:1/615: dread d6/db/d10/d15/d1d/f61 [0,4194304] 0 2024-05-06T21:26:50.658 INFO:tasks.workunit.client.1.smithi154.stdout:1/616: write d6/db/d10/d26/f7d [733167,97539] 0 2024-05-06T21:26:50.658 INFO:tasks.workunit.client.1.smithi154.stdout:1/617: chown d6/c22 6 1 2024-05-06T21:26:50.658 INFO:tasks.workunit.client.1.smithi154.stdout:1/618: write d6/d3e/faa [25977,67914] 0 2024-05-06T21:26:50.659 INFO:tasks.workunit.client.0.smithi032.stdout:9/865: unlink d1/d13/d33/da6/fb2 0 2024-05-06T21:26:50.659 INFO:tasks.workunit.client.0.smithi032.stdout:5/813: truncate d0/d16/d2f/f41 2490464 0 2024-05-06T21:26:50.661 INFO:tasks.workunit.client.1.smithi154.stdout:4/530: mkdir d0/d72/d76/db5 0 2024-05-06T21:26:50.661 INFO:tasks.workunit.client.1.smithi154.stdout:1/619: dread d6/db/d10/d15/d1d/f57 [0,4194304] 0 2024-05-06T21:26:50.661 INFO:tasks.workunit.client.1.smithi154.stdout:4/531: dread - d0/d82/d3d/f7c zero size 2024-05-06T21:26:50.663 INFO:tasks.workunit.client.0.smithi032.stdout:2/715: link df/d19/d1e/d71/d5f/d7d/d65/c7a df/daf/cf7 0 2024-05-06T21:26:50.665 INFO:tasks.workunit.client.1.smithi154.stdout:9/605: dread d5/d20/d52/f78 [4194304,4194304] 0 2024-05-06T21:26:50.668 INFO:tasks.workunit.client.0.smithi032.stdout:1/760: mkdir db/d16/db8/df8 0 2024-05-06T21:26:50.668 INFO:tasks.workunit.client.1.smithi154.stdout:4/532: dread d0/d10/f65 [0,4194304] 0 2024-05-06T21:26:50.669 INFO:tasks.workunit.client.1.smithi154.stdout:1/620: link d6/db/d69/l90 d6/db/d10/d15/d1d/d53/lba 0 2024-05-06T21:26:50.672 INFO:tasks.workunit.client.1.smithi154.stdout:6/377: dwrite d8/d13/f3f [4194304,4194304] 0 2024-05-06T21:26:50.673 INFO:tasks.workunit.client.0.smithi032.stdout:3/883: rename d1/d4/da/d4e/d41/d97/ldf to d1/d2a/d71/d9d/l123 0 2024-05-06T21:26:50.673 INFO:tasks.workunit.client.0.smithi032.stdout:3/884: write d1/d4/da/d31/d47/d4a/fd1 [2589968,83133] 0 2024-05-06T21:26:50.673 INFO:tasks.workunit.client.0.smithi032.stdout:3/885: creat d1/d4/da/d4e/dd3/dd6/f124 x:0 0 0 2024-05-06T21:26:50.673 INFO:tasks.workunit.client.0.smithi032.stdout:3/886: write d1/d4/da/d4e/d41/d97/d67/da6/f92 [1479122,24981] 0 2024-05-06T21:26:50.673 INFO:tasks.workunit.client.0.smithi032.stdout:3/887: fsync d1/d4/da/d31/d9b/daa/fd4 0 2024-05-06T21:26:50.673 INFO:tasks.workunit.client.0.smithi032.stdout:7/852: write db/d12/d49/f6f [4187191,125540] 0 2024-05-06T21:26:50.673 INFO:tasks.workunit.client.0.smithi032.stdout:7/853: creat db/d12/d16/d2a/d39/d8b/f10e x:0 0 0 2024-05-06T21:26:50.674 INFO:tasks.workunit.client.1.smithi154.stdout:8/471: rename d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/c69 to d3/d14/d1a/d29/d32/c9a 0 2024-05-06T21:26:50.676 INFO:tasks.workunit.client.0.smithi032.stdout:5/814: link d0/d87/ld8 d0/d24/d38/d37/df0/d50/d5a/lfc 0 2024-05-06T21:26:50.678 INFO:tasks.workunit.client.0.smithi032.stdout:4/912: dread d2/f35 [0,4194304] 0 2024-05-06T21:26:50.678 INFO:tasks.workunit.client.1.smithi154.stdout:6/378: mknod d8/d13/c75 0 2024-05-06T21:26:50.679 INFO:tasks.workunit.client.0.smithi032.stdout:4/913: dread d2/d16/d44/d74/d79/de6/de8/d69/fd3 [0,4194304] 0 2024-05-06T21:26:50.680 INFO:tasks.workunit.client.0.smithi032.stdout:3/888: getdents d1/d2a/d71 0 2024-05-06T21:26:50.680 INFO:tasks.workunit.client.0.smithi032.stdout:3/889: truncate d1/d4/da/d4e/d5e/d84/df2/d108/db8/fc5 434868 0 2024-05-06T21:26:50.681 INFO:tasks.workunit.client.1.smithi154.stdout:9/606: rename d5/d14/d31/c86 to d5/d14/d3a/d71/cd6 0 2024-05-06T21:26:50.682 INFO:tasks.workunit.client.0.smithi032.stdout:7/854: truncate db/d12/f6d 2979052 0 2024-05-06T21:26:50.682 INFO:tasks.workunit.client.1.smithi154.stdout:8/472: mknod d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/c9b 0 2024-05-06T21:26:50.683 INFO:tasks.workunit.client.0.smithi032.stdout:9/866: rmdir d1/d2f/da1/dc2/d64 39 2024-05-06T21:26:50.684 INFO:tasks.workunit.client.0.smithi032.stdout:5/815: link d0/d16/d46/d78/c8f d0/d16/d2a/d59/d67/d73/da3/cfd 0 2024-05-06T21:26:50.684 INFO:tasks.workunit.client.0.smithi032.stdout:5/816: chown d0/d16/d2a/d5f/dca/fe9 784 1 2024-05-06T21:26:50.685 INFO:tasks.workunit.client.1.smithi154.stdout:8/473: symlink d3/d14/d1a/d29/d3e/l9c 0 2024-05-06T21:26:50.685 INFO:tasks.workunit.client.1.smithi154.stdout:8/474: stat d3/d14/d1a/d29/d3e/f52 0 2024-05-06T21:26:50.685 INFO:tasks.workunit.client.0.smithi032.stdout:4/914: mkdir d2/d16/d44/d74/d76/d123 0 2024-05-06T21:26:50.685 INFO:tasks.workunit.client.0.smithi032.stdout:4/915: chown d2/d13/fff 23809 1 2024-05-06T21:26:50.687 INFO:tasks.workunit.client.0.smithi032.stdout:5/817: creat d0/d16/d2a/d59/d67/ffe x:0 0 0 2024-05-06T21:26:50.688 INFO:tasks.workunit.client.0.smithi032.stdout:4/916: symlink d2/d2c/l124 0 2024-05-06T21:26:50.688 INFO:tasks.workunit.client.0.smithi032.stdout:2/716: dread df/d19/d1e/d54/fb8 [0,4194304] 0 2024-05-06T21:26:50.689 INFO:tasks.workunit.client.1.smithi154.stdout:3/722: dwrite d0/da/db/d7c/fa6 [0,4194304] 0 2024-05-06T21:26:50.689 INFO:tasks.workunit.client.1.smithi154.stdout:3/723: chown d0/da/d1a/d28/dbc/d81/d48 1922015 1 2024-05-06T21:26:50.689 INFO:tasks.workunit.client.1.smithi154.stdout:6/379: symlink d8/d11/l76 0 2024-05-06T21:26:50.690 INFO:tasks.workunit.client.0.smithi032.stdout:3/890: rename d1/d4/da/d4e/d5e/d84/df2/d108 to d1/d4/da/d31/d9b/d125 0 2024-05-06T21:26:50.690 INFO:tasks.workunit.client.0.smithi032.stdout:3/891: dread - d1/d4/ffc zero size 2024-05-06T21:26:50.690 INFO:tasks.workunit.client.1.smithi154.stdout:0/631: dwrite d6/d27/f28 [0,4194304] 0 2024-05-06T21:26:50.690 INFO:tasks.workunit.client.1.smithi154.stdout:5/595: dwrite d2/d3/d21/d95/dc/d68/fc8 [0,4194304] 0 2024-05-06T21:26:50.691 INFO:tasks.workunit.client.1.smithi154.stdout:5/596: write d2/d3/d21/d95/dc/f30 [4315228,53129] 0 2024-05-06T21:26:50.691 INFO:tasks.workunit.client.1.smithi154.stdout:6/380: dread d8/d13/f28 [0,4194304] 0 2024-05-06T21:26:50.691 INFO:tasks.workunit.client.1.smithi154.stdout:6/381: write d8/d11/d2d/d3d/d70/f5d [285621,74327] 0 2024-05-06T21:26:50.693 INFO:tasks.workunit.client.0.smithi032.stdout:5/818: symlink d0/d16/d2a/d5f/lff 0 2024-05-06T21:26:50.694 INFO:tasks.workunit.client.0.smithi032.stdout:4/917: creat d2/d16/d44/d74/d79/de0/f125 x:0 0 0 2024-05-06T21:26:50.694 INFO:tasks.workunit.client.1.smithi154.stdout:8/475: truncate d3/d14/d1a/d29/d32/d40/d59/f55 1823966 0 2024-05-06T21:26:50.696 INFO:tasks.workunit.client.0.smithi032.stdout:1/761: dread db/f30 [4194304,4194304] 0 2024-05-06T21:26:50.696 INFO:tasks.workunit.client.0.smithi032.stdout:7/855: rename db/d12/d16/da1/cc8 to db/d12/d10b/c10f 0 2024-05-06T21:26:50.701 INFO:tasks.workunit.client.0.smithi032.stdout:4/918: unlink d2/d16/d44/d74/d79/de6/de8/dd8/f122 0 2024-05-06T21:26:50.701 INFO:tasks.workunit.client.0.smithi032.stdout:4/919: dread - d2/d16/d44/d74/d76/d81/fbc zero size 2024-05-06T21:26:50.702 INFO:tasks.workunit.client.1.smithi154.stdout:3/724: unlink d0/da/d1a/d28/f8c 0 2024-05-06T21:26:50.702 INFO:tasks.workunit.client.1.smithi154.stdout:3/725: truncate d0/da/d1a/d28/d17/f63 1413300 0 2024-05-06T21:26:50.702 INFO:tasks.workunit.client.1.smithi154.stdout:3/726: write d0/da/db/d30/f98 [515223,2848] 0 2024-05-06T21:26:50.705 INFO:tasks.workunit.client.1.smithi154.stdout:2/527: truncate db/de/f74 795507 0 2024-05-06T21:26:50.707 INFO:tasks.workunit.client.1.smithi154.stdout:0/632: mkdir d6/dc/d40/d4a/d6c/dce 0 2024-05-06T21:26:50.707 INFO:tasks.workunit.client.1.smithi154.stdout:7/429: dwrite d6/d20/d40/f50 [0,4194304] 0 2024-05-06T21:26:50.708 INFO:tasks.workunit.client.0.smithi032.stdout:7/856: truncate db/d12/d16/d21/d41/d4b/fa5 1607821 0 2024-05-06T21:26:50.710 INFO:tasks.workunit.client.0.smithi032.stdout:4/920: creat d2/d2c/f126 x:0 0 0 2024-05-06T21:26:50.710 INFO:tasks.workunit.client.1.smithi154.stdout:4/533: dwrite d0/d2/f53 [0,4194304] 0 2024-05-06T21:26:50.711 INFO:tasks.workunit.client.1.smithi154.stdout:8/476: write d3/f9 [1301965,69459] 0 2024-05-06T21:26:50.711 INFO:tasks.workunit.client.1.smithi154.stdout:8/477: chown d3/l4f 8374 1 2024-05-06T21:26:50.712 INFO:tasks.workunit.client.1.smithi154.stdout:8/478: chown d3/d14/d1a/d29/d68/d61 112 1 2024-05-06T21:26:50.714 INFO:tasks.workunit.client.1.smithi154.stdout:5/597: mknod d2/d3/d21/d95/dc/d44/d9a/dab/cc9 0 2024-05-06T21:26:50.714 INFO:tasks.workunit.client.1.smithi154.stdout:5/598: dread - d2/da5/fc1 zero size 2024-05-06T21:26:50.714 INFO:tasks.workunit.client.1.smithi154.stdout:5/599: chown d2/d3/d19/f3c 5785 1 2024-05-06T21:26:50.714 INFO:tasks.workunit.client.1.smithi154.stdout:5/600: chown d2/d3/d21/d95/dc/d44/dc0 1313411752 1 2024-05-06T21:26:50.715 INFO:tasks.workunit.client.0.smithi032.stdout:5/819: dread d0/f10 [0,4194304] 0 2024-05-06T21:26:50.715 INFO:tasks.workunit.client.0.smithi032.stdout:5/820: dread - d0/d24/d38/d37/d70/fb2 zero size 2024-05-06T21:26:50.715 INFO:tasks.workunit.client.0.smithi032.stdout:1/762: mknod db/cf9 0 2024-05-06T21:26:50.715 INFO:tasks.workunit.client.0.smithi032.stdout:1/763: write db/d16/d46/f94 [1142042,110687] 0 2024-05-06T21:26:50.716 INFO:tasks.workunit.client.1.smithi154.stdout:6/382: truncate d8/d11/d2d/f3a 1125482 0 2024-05-06T21:26:50.717 INFO:tasks.workunit.client.1.smithi154.stdout:6/383: creat d8/d13/f77 x:0 0 0 2024-05-06T21:26:50.717 INFO:tasks.workunit.client.1.smithi154.stdout:6/384: stat d8/d11/d2d/d3d/f6b 0 2024-05-06T21:26:50.717 INFO:tasks.workunit.client.1.smithi154.stdout:6/385: dread - d8/d11/d2d/d3d/d4c/f58 zero size 2024-05-06T21:26:50.717 INFO:tasks.workunit.client.1.smithi154.stdout:6/386: write d8/d11/d33/f55 [590987,5005] 0 2024-05-06T21:26:50.717 INFO:tasks.workunit.client.1.smithi154.stdout:6/387: chown d8/la 1 1 2024-05-06T21:26:50.717 INFO:tasks.workunit.client.1.smithi154.stdout:6/388: stat d8/c16 0 2024-05-06T21:26:50.718 INFO:tasks.workunit.client.0.smithi032.stdout:4/921: link d2/d16/d44/d45/l5b d2/d16/d44/d45/d4e/l127 0 2024-05-06T21:26:50.718 INFO:tasks.workunit.client.0.smithi032.stdout:4/922: chown d2/d16/fe3 59317 1 2024-05-06T21:26:50.719 INFO:tasks.workunit.client.1.smithi154.stdout:3/727: link d0/da/d1a/d28/d17/f63 d0/da/db/d52/d75/ff9 0 2024-05-06T21:26:50.719 INFO:tasks.workunit.client.0.smithi032.stdout:5/821: dread d0/d16/f85 [0,4194304] 0 2024-05-06T21:26:50.720 INFO:tasks.workunit.client.1.smithi154.stdout:1/621: getdents d6/d3e/d7e 0 2024-05-06T21:26:50.720 INFO:tasks.workunit.client.1.smithi154.stdout:1/622: truncate d6/f24 4229935 0 2024-05-06T21:26:50.721 INFO:tasks.workunit.client.0.smithi032.stdout:4/923: truncate f1 1665541 0 2024-05-06T21:26:50.721 INFO:tasks.workunit.client.0.smithi032.stdout:4/924: chown d2/d16/d44/d45/l50 504038 1 2024-05-06T21:26:50.721 INFO:tasks.workunit.client.0.smithi032.stdout:4/925: stat d2/d16/d44/d74/d76/d81/d11f 0 2024-05-06T21:26:50.722 INFO:tasks.workunit.client.1.smithi154.stdout:9/607: dwrite d5/d14/f43 [0,4194304] 0 2024-05-06T21:26:50.722 INFO:tasks.workunit.client.1.smithi154.stdout:9/608: stat d5/d20/d52/d6e/d83 0 2024-05-06T21:26:50.722 INFO:tasks.workunit.client.1.smithi154.stdout:9/609: fsync d5/d20/d52/d59/f67 0 2024-05-06T21:26:50.722 INFO:tasks.workunit.client.0.smithi032.stdout:9/867: dwrite d1/d13/f16 [0,4194304] 0 2024-05-06T21:26:50.723 INFO:tasks.workunit.client.0.smithi032.stdout:9/868: dread - d1/ff9 zero size 2024-05-06T21:26:50.723 INFO:tasks.workunit.client.1.smithi154.stdout:2/528: mknod db/de/d10/d18/ca6 0 2024-05-06T21:26:50.724 INFO:tasks.workunit.client.1.smithi154.stdout:4/534: mknod d0/d82/d3d/dab/cb6 0 2024-05-06T21:26:50.726 INFO:tasks.workunit.client.1.smithi154.stdout:7/430: write d6/d20/d40/f50 [600315,36622] 0 2024-05-06T21:26:50.726 INFO:tasks.workunit.client.0.smithi032.stdout:6/835: dwrite d8/d3d/d49/fa9 [0,4194304] 0 2024-05-06T21:26:50.726 INFO:tasks.workunit.client.0.smithi032.stdout:6/836: write d8/d3d/d49/dad/fd7 [669116,122838] 0 2024-05-06T21:26:50.727 INFO:tasks.workunit.client.1.smithi154.stdout:0/633: read d6/dc/d3c/f7d [169538,30490] 0 2024-05-06T21:26:50.727 INFO:tasks.workunit.client.1.smithi154.stdout:0/634: fsync d6/dc/d51/d54/f77 0 2024-05-06T21:26:50.729 INFO:tasks.workunit.client.0.smithi032.stdout:1/764: dread db/d47/d4a/fa7 [0,4194304] 0 2024-05-06T21:26:50.729 INFO:tasks.workunit.client.0.smithi032.stdout:1/765: write db/d16/f83 [953449,126072] 0 2024-05-06T21:26:50.729 INFO:tasks.workunit.client.0.smithi032.stdout:1/766: chown db/d16/da3/cba 24406 1 2024-05-06T21:26:50.729 INFO:tasks.workunit.client.0.smithi032.stdout:7/857: write db/d12/d49/d97/fd0 [954999,84595] 0 2024-05-06T21:26:50.729 INFO:tasks.workunit.client.0.smithi032.stdout:2/717: dwrite df/d19/d1e/d42/dc6/f4f [0,4194304] 0 2024-05-06T21:26:50.730 INFO:tasks.workunit.client.0.smithi032.stdout:4/926: getdents d2/d2c/d31/d7c 0 2024-05-06T21:26:50.730 INFO:tasks.workunit.client.0.smithi032.stdout:4/927: truncate d2/d1e/d47/ff5 1086067 0 2024-05-06T21:26:50.732 INFO:tasks.workunit.client.1.smithi154.stdout:8/479: creat d3/d14/d1a/d29/d32/d40/d79/f9d x:0 0 0 2024-05-06T21:26:50.736 INFO:tasks.workunit.client.1.smithi154.stdout:5/601: mknod d2/d3/cca 0 2024-05-06T21:26:50.737 INFO:tasks.workunit.client.0.smithi032.stdout:6/837: symlink d8/db6/lff 0 2024-05-06T21:26:50.739 INFO:tasks.workunit.client.1.smithi154.stdout:6/389: rename d8/la to d8/d11/d2d/d3d/d4c/l78 0 2024-05-06T21:26:50.739 INFO:tasks.workunit.client.1.smithi154.stdout:6/390: fsync d8/d13/d20/f5a 0 2024-05-06T21:26:50.740 INFO:tasks.workunit.client.1.smithi154.stdout:3/728: mkdir d0/dfa 0 2024-05-06T21:26:50.742 INFO:tasks.workunit.client.0.smithi032.stdout:5/822: dwrite d0/d24/d38/fd5 [0,4194304] 0 2024-05-06T21:26:50.742 INFO:tasks.workunit.client.0.smithi032.stdout:5/823: chown d0/d24/d38/d37/df0/d50/d5a/l6d 2927 1 2024-05-06T21:26:50.742 INFO:tasks.workunit.client.0.smithi032.stdout:5/824: dread - d0/d16/d2a/d5f/dca/fe9 zero size 2024-05-06T21:26:50.742 INFO:tasks.workunit.client.0.smithi032.stdout:5/825: fsync d0/d16/d2a/d5f/d9a/fe4 0 2024-05-06T21:26:50.743 INFO:tasks.workunit.client.0.smithi032.stdout:7/858: rename db/d12/d16/d2a/d39/d3b/l5c to db/d12/d16/d2a/d39/def/l110 0 2024-05-06T21:26:50.745 INFO:tasks.workunit.client.1.smithi154.stdout:9/610: mkdir d5/d14/d3a/dd7 0 2024-05-06T21:26:50.746 INFO:tasks.workunit.client.1.smithi154.stdout:2/529: creat db/d12/d1d/fa7 x:0 0 0 2024-05-06T21:26:50.748 INFO:tasks.workunit.client.0.smithi032.stdout:9/869: write d1/d13/d34/f43 [2174482,48399] 0 2024-05-06T21:26:50.749 INFO:tasks.workunit.client.0.smithi032.stdout:6/838: mkdir d8/db6/d100 0 2024-05-06T21:26:50.749 INFO:tasks.workunit.client.0.smithi032.stdout:5/826: write d0/d16/d46/f7a [6334576,128838] 0 2024-05-06T21:26:50.749 INFO:tasks.workunit.client.0.smithi032.stdout:6/839: truncate d8/dd/d1b/f9d 283650 0 2024-05-06T21:26:50.749 INFO:tasks.workunit.client.0.smithi032.stdout:6/840: chown d8/d3d/d49 5525 1 2024-05-06T21:26:50.751 INFO:tasks.workunit.client.1.smithi154.stdout:7/431: symlink d6/d42/l87 0 2024-05-06T21:26:50.755 INFO:tasks.workunit.client.1.smithi154.stdout:8/480: rename d3/d56/f71 to d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f9e 0 2024-05-06T21:26:50.755 INFO:tasks.workunit.client.1.smithi154.stdout:8/481: readlink d3/d14/d1a/d29/d3e/l78 0 2024-05-06T21:26:50.757 INFO:tasks.workunit.client.1.smithi154.stdout:6/391: creat d8/d11/f79 x:0 0 0 2024-05-06T21:26:50.757 INFO:tasks.workunit.client.1.smithi154.stdout:6/392: truncate d8/d13/f5e 4256301 0 2024-05-06T21:26:50.758 INFO:tasks.workunit.client.0.smithi032.stdout:2/718: rename df/d19/d1e/d71/d5f/d7d/d25/c98 to df/d19/d1e/d35/dc5/d2e/d33/cf8 0 2024-05-06T21:26:50.759 INFO:tasks.workunit.client.1.smithi154.stdout:3/729: mknod d0/da/d1a/d28/dbc/d81/d48/da9/db3/cfb 0 2024-05-06T21:26:50.760 INFO:tasks.workunit.client.1.smithi154.stdout:1/623: getdents d6/d3e 0 2024-05-06T21:26:50.760 INFO:tasks.workunit.client.1.smithi154.stdout:9/611: read d5/f8 [3242226,69023] 0 2024-05-06T21:26:50.762 INFO:tasks.workunit.client.1.smithi154.stdout:7/432: dread d6/f25 [0,4194304] 0 2024-05-06T21:26:50.766 INFO:tasks.workunit.client.1.smithi154.stdout:2/530: rename db/de/f11 to db/de/d10/d18/fa8 0 2024-05-06T21:26:50.770 INFO:tasks.workunit.client.1.smithi154.stdout:6/393: symlink d8/d11/d33/d4a/d6c/l7a 0 2024-05-06T21:26:50.770 INFO:tasks.workunit.client.1.smithi154.stdout:8/482: mkdir d3/d9f 0 2024-05-06T21:26:50.770 INFO:tasks.workunit.client.1.smithi154.stdout:6/394: write d8/d13/f28 [1435946,64419] 0 2024-05-06T21:26:50.770 INFO:tasks.workunit.client.0.smithi032.stdout:6/841: unlink d8/dd/d18/d3b/db9/c70 0 2024-05-06T21:26:50.771 INFO:tasks.workunit.client.1.smithi154.stdout:0/635: dwrite d6/dc/d44/d36/fc2 [0,4194304] 0 2024-05-06T21:26:50.771 INFO:tasks.workunit.client.1.smithi154.stdout:3/730: creat d0/da/db/dd/d1c/d90/ffc x:0 0 0 2024-05-06T21:26:50.771 INFO:tasks.workunit.client.1.smithi154.stdout:3/731: creat d0/da/db/d7c/d80/ffd x:0 0 0 2024-05-06T21:26:50.772 INFO:tasks.workunit.client.0.smithi032.stdout:2/719: symlink df/d19/d1e/d35/dc5/d2e/dbc/lf9 0 2024-05-06T21:26:50.772 INFO:tasks.workunit.client.0.smithi032.stdout:1/767: dwrite db/d47/d4a/da4/f5b [0,4194304] 0 2024-05-06T21:26:50.775 INFO:tasks.workunit.client.0.smithi032.stdout:2/720: rmdir df 39 2024-05-06T21:26:50.777 INFO:tasks.workunit.client.1.smithi154.stdout:1/624: link d6/db/d10/d26/d1b/c36 d6/d3e/d7e/da5/da8/cbb 0 2024-05-06T21:26:50.780 INFO:tasks.workunit.client.1.smithi154.stdout:9/612: unlink d5/d14/d3a/d71/db1/fb7 0 2024-05-06T21:26:50.782 INFO:tasks.workunit.client.1.smithi154.stdout:2/531: mknod db/d12/d4e/d55/ca9 0 2024-05-06T21:26:50.783 INFO:tasks.workunit.client.0.smithi032.stdout:4/928: dwrite d2/d16/d44/d74/d76/d81/fbc [0,4194304] 0 2024-05-06T21:26:50.784 INFO:tasks.workunit.client.1.smithi154.stdout:8/483: creat d3/d14/d1a/d29/d43/fa0 x:0 0 0 2024-05-06T21:26:50.785 INFO:tasks.workunit.client.0.smithi032.stdout:1/768: read db/d47/d4a/da4/f5b [3629656,83817] 0 2024-05-06T21:26:50.787 INFO:tasks.workunit.client.0.smithi032.stdout:2/721: rename df/d19/f5b to df/d19/d1e/d35/ffa 0 2024-05-06T21:26:50.789 INFO:tasks.workunit.client.0.smithi032.stdout:7/859: dwrite db/d12/d16/d2a/f2d [4194304,4194304] 0 2024-05-06T21:26:50.789 INFO:tasks.workunit.client.0.smithi032.stdout:7/860: getdents db/d12/d16/d21/d84 0 2024-05-06T21:26:50.789 INFO:tasks.workunit.client.0.smithi032.stdout:7/861: chown db/d12/d16/da1/l100 4216496 1 2024-05-06T21:26:50.792 INFO:tasks.workunit.client.1.smithi154.stdout:6/395: write d8/f23 [3365337,61726] 0 2024-05-06T21:26:50.793 INFO:tasks.workunit.client.0.smithi032.stdout:4/929: truncate d2/d1e/f28 3970068 0 2024-05-06T21:26:50.793 INFO:tasks.workunit.client.0.smithi032.stdout:4/930: fdatasync d2/d1e/f22 0 2024-05-06T21:26:50.795 INFO:tasks.workunit.client.1.smithi154.stdout:9/613: symlink d5/d14/d87/ld8 0 2024-05-06T21:26:50.795 INFO:tasks.workunit.client.0.smithi032.stdout:2/722: unlink df/lef 0 2024-05-06T21:26:50.795 INFO:tasks.workunit.client.0.smithi032.stdout:1/769: dread db/d16/d46/f4e [0,4194304] 0 2024-05-06T21:26:50.797 INFO:tasks.workunit.client.1.smithi154.stdout:0/636: write d6/dc/f34 [510574,78744] 0 2024-05-06T21:26:50.798 INFO:tasks.workunit.client.0.smithi032.stdout:4/931: creat d2/d16/d44/d74/d79/de6/de8/d69/f128 x:0 0 0 2024-05-06T21:26:50.799 INFO:tasks.workunit.client.0.smithi032.stdout:4/932: write d2/d2c/f126 [371728,83544] 0 2024-05-06T21:26:50.799 INFO:tasks.workunit.client.0.smithi032.stdout:4/933: creat d2/d16/d44/d74/d79/de0/f129 x:0 0 0 2024-05-06T21:26:50.800 INFO:tasks.workunit.client.0.smithi032.stdout:2/723: creat df/d19/d1e/d71/d5f/ffb x:0 0 0 2024-05-06T21:26:50.800 INFO:tasks.workunit.client.0.smithi032.stdout:2/724: chown df/d19/d1e/d54/l5d 7 1 2024-05-06T21:26:50.800 INFO:tasks.workunit.client.0.smithi032.stdout:2/725: fdatasync df/d19/d1e/d71/d5f/d7d/f9c 0 2024-05-06T21:26:50.800 INFO:tasks.workunit.client.0.smithi032.stdout:2/726: fsync df/d19/d1e/f51 0 2024-05-06T21:26:50.803 INFO:tasks.workunit.client.1.smithi154.stdout:9/614: dread d5/f28 [0,4194304] 0 2024-05-06T21:26:50.803 INFO:tasks.workunit.client.1.smithi154.stdout:9/615: write d5/d2e/d66/f88 [13348,49212] 0 2024-05-06T21:26:50.804 INFO:tasks.workunit.client.1.smithi154.stdout:9/616: chown d5/c11 4518 1 2024-05-06T21:26:50.804 INFO:tasks.workunit.client.1.smithi154.stdout:9/617: write d5/d20/d52/d6e/fae [4622772,108861] 0 2024-05-06T21:26:50.804 INFO:tasks.workunit.client.1.smithi154.stdout:9/618: chown d5 10 1 2024-05-06T21:26:50.804 INFO:tasks.workunit.client.1.smithi154.stdout:9/619: dread - d5/fab zero size 2024-05-06T21:26:50.804 INFO:tasks.workunit.client.1.smithi154.stdout:2/532: dread db/d12/d1d/f64 [0,4194304] 0 2024-05-06T21:26:50.810 INFO:tasks.workunit.client.1.smithi154.stdout:9/620: read d5/d2e/d66/f7d [723724,123691] 0 2024-05-06T21:26:50.814 INFO:tasks.workunit.client.0.smithi032.stdout:4/934: rename d2/d16/d44/d74/d79/de6/de8/cc5 to d2/d16/d44/d45/d4e/c12a 0 2024-05-06T21:26:50.814 INFO:tasks.workunit.client.0.smithi032.stdout:4/935: fdatasync d2/d16/d44/d74/d76/fab 0 2024-05-06T21:26:50.814 INFO:tasks.workunit.client.0.smithi032.stdout:2/727: rmdir df/d19/d1e/d35/dc5/d2e/dbe 39 2024-05-06T21:26:50.816 INFO:tasks.workunit.client.1.smithi154.stdout:2/533: creat db/d12/d1d/d83/faa x:0 0 0 2024-05-06T21:26:50.816 INFO:tasks.workunit.client.1.smithi154.stdout:2/534: chown f0 9992043 1 2024-05-06T21:26:50.816 INFO:tasks.workunit.client.0.smithi032.stdout:4/936: mknod d2/d16/d44/d45/c12b 0 2024-05-06T21:26:50.818 INFO:tasks.workunit.client.0.smithi032.stdout:4/937: symlink d2/d16/d44/d74/d79/de6/de8/dd8/l12c 0 2024-05-06T21:26:50.820 INFO:tasks.workunit.client.0.smithi032.stdout:2/728: rmdir df/d19/d1e/d35/dc5/d9f/dc0 39 2024-05-06T21:26:50.820 INFO:tasks.workunit.client.1.smithi154.stdout:6/396: rmdir d8/d11/d2d/d3d 39 2024-05-06T21:26:50.820 INFO:tasks.workunit.client.1.smithi154.stdout:6/397: readlink d8/d11/d2d/d3d/d4c/l5c 0 2024-05-06T21:26:50.822 INFO:tasks.workunit.client.0.smithi032.stdout:2/729: mkdir df/d19/d1e/d71/d5f/d7d/d65/dfc 0 2024-05-06T21:26:50.822 INFO:tasks.workunit.client.0.smithi032.stdout:2/730: chown df/d19/d1e/d71/d5f/d7d/d25/d2d/c62 12 1 2024-05-06T21:26:50.822 INFO:tasks.workunit.client.0.smithi032.stdout:2/731: truncate df/d19/d1e/d54/f8e 959582 0 2024-05-06T21:26:50.822 INFO:tasks.workunit.client.1.smithi154.stdout:0/637: rmdir d6/dc/d39 39 2024-05-06T21:26:50.823 INFO:tasks.workunit.client.0.smithi032.stdout:6/842: dwrite d8/dd/d18/d3b/d90/ff8 [0,4194304] 0 2024-05-06T21:26:50.824 INFO:tasks.workunit.client.0.smithi032.stdout:2/732: creat df/d19/d1e/d71/d5f/d7d/d65/d78/ffd x:0 0 0 2024-05-06T21:26:50.824 INFO:tasks.workunit.client.0.smithi032.stdout:2/733: creat df/d19/d1e/d71/d5f/d7d/ffe x:0 0 0 2024-05-06T21:26:50.824 INFO:tasks.workunit.client.0.smithi032.stdout:2/734: creat df/d19/dbf/fff x:0 0 0 2024-05-06T21:26:50.830 INFO:tasks.workunit.client.1.smithi154.stdout:9/621: mknod d5/d89/cd9 0 2024-05-06T21:26:50.830 INFO:tasks.workunit.client.1.smithi154.stdout:9/622: stat d5/d14/d87/f8f 0 2024-05-06T21:26:50.831 INFO:tasks.workunit.client.1.smithi154.stdout:9/623: chown d5/d2e/d66 25920 1 2024-05-06T21:26:50.832 INFO:tasks.workunit.client.1.smithi154.stdout:2/535: creat db/fab x:0 0 0 2024-05-06T21:26:50.833 INFO:tasks.workunit.client.1.smithi154.stdout:6/398: mkdir d8/d11/d2d/d3d/d70/d7b 0 2024-05-06T21:26:50.833 INFO:tasks.workunit.client.1.smithi154.stdout:6/399: fsync d8/d13/d20/f5a 0 2024-05-06T21:26:50.834 INFO:tasks.workunit.client.1.smithi154.stdout:6/400: fdatasync d8/d11/d51/f6f 0 2024-05-06T21:26:50.835 INFO:tasks.workunit.client.1.smithi154.stdout:4/535: truncate d0/d82/d44/f68 422574 0 2024-05-06T21:26:50.835 INFO:tasks.workunit.client.1.smithi154.stdout:4/536: chown d0/f23 432340 1 2024-05-06T21:26:50.835 INFO:tasks.workunit.client.1.smithi154.stdout:0/638: dread d6/dc/d44/d36/f4d [0,4194304] 0 2024-05-06T21:26:50.835 INFO:tasks.workunit.client.1.smithi154.stdout:0/639: write d6/dc/f2e [412917,10413] 0 2024-05-06T21:26:50.836 INFO:tasks.workunit.client.1.smithi154.stdout:5/602: truncate d2/d3/fa 3847220 0 2024-05-06T21:26:50.838 INFO:tasks.workunit.client.1.smithi154.stdout:7/433: dwrite d6/f9 [0,4194304] 0 2024-05-06T21:26:50.840 INFO:tasks.workunit.client.1.smithi154.stdout:4/537: dread d0/d10/d11/f46 [0,4194304] 0 2024-05-06T21:26:50.840 INFO:tasks.workunit.client.1.smithi154.stdout:4/538: chown d0/d2/d29/c64 31463 1 2024-05-06T21:26:50.840 INFO:tasks.workunit.client.1.smithi154.stdout:4/539: stat d0/d2/f66 0 2024-05-06T21:26:50.840 INFO:tasks.workunit.client.1.smithi154.stdout:9/624: truncate d5/d14/d87/d65/fb6 636553 0 2024-05-06T21:26:50.842 INFO:tasks.workunit.client.1.smithi154.stdout:5/603: mknod d2/da5/ccb 0 2024-05-06T21:26:50.843 INFO:tasks.workunit.client.1.smithi154.stdout:2/536: dread db/f3c [0,4194304] 0 2024-05-06T21:26:50.843 INFO:tasks.workunit.client.1.smithi154.stdout:7/434: creat d6/d20/d40/d52/f88 x:0 0 0 2024-05-06T21:26:50.844 INFO:tasks.workunit.client.1.smithi154.stdout:4/540: stat d0/l7 0 2024-05-06T21:26:50.844 INFO:tasks.workunit.client.1.smithi154.stdout:4/541: truncate d0/d10/d11/d1a/f28 8702613 0 2024-05-06T21:26:50.846 INFO:tasks.workunit.client.0.smithi032.stdout:6/843: write d8/dd/d18/d3b/d90/fcd [874778,27408] 0 2024-05-06T21:26:50.846 INFO:tasks.workunit.client.0.smithi032.stdout:5/827: dwrite d0/d24/d38/f25 [0,4194304] 0 2024-05-06T21:26:50.846 INFO:tasks.workunit.client.0.smithi032.stdout:5/828: write d0/d16/d2a/d5f/d9a/f97 [931937,99959] 0 2024-05-06T21:26:50.847 INFO:tasks.workunit.client.0.smithi032.stdout:2/735: getdents df/d19/d1e/d71/d5f/d7d/d65 0 2024-05-06T21:26:50.847 INFO:tasks.workunit.client.1.smithi154.stdout:9/625: link d5/d20/d52/d6e/fae d5/dca/fda 0 2024-05-06T21:26:50.847 INFO:tasks.workunit.client.1.smithi154.stdout:9/626: fsync d5/d2e/d8b/fa4 0 2024-05-06T21:26:50.847 INFO:tasks.workunit.client.1.smithi154.stdout:9/627: chown d5/d20/d52/d6e/d83/da2/fcf 26 1 2024-05-06T21:26:50.849 INFO:tasks.workunit.client.1.smithi154.stdout:2/537: creat db/d12/d19/d91/fac x:0 0 0 2024-05-06T21:26:50.849 INFO:tasks.workunit.client.0.smithi032.stdout:7/862: dwrite db/d12/f61 [0,4194304] 0 2024-05-06T21:26:50.849 INFO:tasks.workunit.client.0.smithi032.stdout:7/863: stat db/d12/d16/d2a/d39/lb9 0 2024-05-06T21:26:50.849 INFO:tasks.workunit.client.0.smithi032.stdout:6/844: creat d8/f101 x:0 0 0 2024-05-06T21:26:50.850 INFO:tasks.workunit.client.0.smithi032.stdout:1/770: dwrite db/d16/d46/d57/d58/d68/fc4 [0,4194304] 0 2024-05-06T21:26:50.850 INFO:tasks.workunit.client.0.smithi032.stdout:1/771: write db/d47/d4a/da4/f50 [1377358,121938] 0 2024-05-06T21:26:50.850 INFO:tasks.workunit.client.0.smithi032.stdout:1/772: stat db/d16/f75 0 2024-05-06T21:26:50.850 INFO:tasks.workunit.client.1.smithi154.stdout:1/625: getdents d6/d3e/d7e/da5/da8 0 2024-05-06T21:26:50.851 INFO:tasks.workunit.client.0.smithi032.stdout:5/829: creat d0/d24/d26/f100 x:0 0 0 2024-05-06T21:26:50.851 INFO:tasks.workunit.client.0.smithi032.stdout:5/830: fdatasync d0/d24/d38/f9c 0 2024-05-06T21:26:50.853 INFO:tasks.workunit.client.0.smithi032.stdout:2/736: creat df/d19/d1e/d71/d5f/d73/df1/f100 x:0 0 0 2024-05-06T21:26:50.853 INFO:tasks.workunit.client.0.smithi032.stdout:2/737: creat df/d19/d1e/d42/dc6/f101 x:0 0 0 2024-05-06T21:26:50.853 INFO:tasks.workunit.client.1.smithi154.stdout:7/435: stat d6/l16 0 2024-05-06T21:26:50.854 INFO:tasks.workunit.client.0.smithi032.stdout:7/864: unlink db/d12/d87/ld5 0 2024-05-06T21:26:50.856 INFO:tasks.workunit.client.1.smithi154.stdout:4/542: mkdir d0/d72/d76/db5/db7 0 2024-05-06T21:26:50.856 INFO:tasks.workunit.client.1.smithi154.stdout:4/543: write d0/d10/d11/d1a/d7e/f90 [306416,72513] 0 2024-05-06T21:26:50.858 INFO:tasks.workunit.client.0.smithi032.stdout:5/831: rmdir d0/d24/d26/df9 0 2024-05-06T21:26:50.858 INFO:tasks.workunit.client.0.smithi032.stdout:5/832: chown d0/d87 0 1 2024-05-06T21:26:50.859 INFO:tasks.workunit.client.1.smithi154.stdout:9/628: creat d5/d20/d52/d6e/d83/fdb x:0 0 0 2024-05-06T21:26:50.860 INFO:tasks.workunit.client.0.smithi032.stdout:2/738: creat df/d19/d1e/d35/dc5/d2e/dbc/f102 x:0 0 0 2024-05-06T21:26:50.860 INFO:tasks.workunit.client.0.smithi032.stdout:2/739: write df/f2c [4113521,56286] 0 2024-05-06T21:26:50.861 INFO:tasks.workunit.client.1.smithi154.stdout:5/604: symlink d2/d3/d21/d22/lcc 0 2024-05-06T21:26:50.863 INFO:tasks.workunit.client.0.smithi032.stdout:7/865: getdents db/d12/d16/d2a/d39 0 2024-05-06T21:26:50.864 INFO:tasks.workunit.client.1.smithi154.stdout:2/538: unlink db/d12/d19/d91/fac 0 2024-05-06T21:26:50.864 INFO:tasks.workunit.client.0.smithi032.stdout:5/833: symlink d0/l101 0 2024-05-06T21:26:50.864 INFO:tasks.workunit.client.0.smithi032.stdout:5/834: fsync d0/fe 0 2024-05-06T21:26:50.866 INFO:tasks.workunit.client.0.smithi032.stdout:7/866: rename db/dc6 to db/d12/d16/d2a/d39/d3b/d111 0 2024-05-06T21:26:50.867 INFO:tasks.workunit.client.0.smithi032.stdout:7/867: truncate db/d12/d87/fb1 1198332 0 2024-05-06T21:26:50.867 INFO:tasks.workunit.client.1.smithi154.stdout:7/436: unlink d6/d20/d40/l4b 0 2024-05-06T21:26:50.868 INFO:tasks.workunit.client.1.smithi154.stdout:7/437: read d6/fb [2490043,99245] 0 2024-05-06T21:26:50.868 INFO:tasks.workunit.client.0.smithi032.stdout:4/938: dwrite d2/fa [0,4194304] 0 2024-05-06T21:26:50.868 INFO:tasks.workunit.client.0.smithi032.stdout:4/939: dread - d2/d16/d44/d74/d79/de6/de8/d69/f128 zero size 2024-05-06T21:26:50.869 INFO:tasks.workunit.client.0.smithi032.stdout:4/940: write d2/d2c/d31/d7c/fa6 [606605,73796] 0 2024-05-06T21:26:50.869 INFO:tasks.workunit.client.0.smithi032.stdout:5/835: creat d0/d16/d46/d78/d89/dfb/f102 x:0 0 0 2024-05-06T21:26:50.869 INFO:tasks.workunit.client.1.smithi154.stdout:4/544: mkdir d0/d82/d44/d73/d4a/d74/db8 0 2024-05-06T21:26:50.870 INFO:tasks.workunit.client.1.smithi154.stdout:9/629: mknod d5/d14/d31/cdc 0 2024-05-06T21:26:50.871 INFO:tasks.workunit.client.0.smithi032.stdout:7/868: getdents db/d12/d87/db5 0 2024-05-06T21:26:50.871 INFO:tasks.workunit.client.1.smithi154.stdout:5/605: mknod d2/d3/d21/d95/dc/d44/dc0/ccd 0 2024-05-06T21:26:50.873 INFO:tasks.workunit.client.1.smithi154.stdout:7/438: link d6/f10 d6/d20/f89 0 2024-05-06T21:26:50.875 INFO:tasks.workunit.client.1.smithi154.stdout:0/640: dwrite d6/dc/d44/d36/d89/faa [0,4194304] 0 2024-05-06T21:26:50.878 INFO:tasks.workunit.client.1.smithi154.stdout:2/539: write db/de/d10/f5f [2916315,26540] 0 2024-05-06T21:26:50.878 INFO:tasks.workunit.client.0.smithi032.stdout:2/740: dread df/d19/d1e/d71/d5f/d7d/d25/f50 [0,4194304] 0 2024-05-06T21:26:50.881 INFO:tasks.workunit.client.0.smithi032.stdout:1/773: dwrite db/d16/d46/f7e [0,4194304] 0 2024-05-06T21:26:50.881 INFO:tasks.workunit.client.0.smithi032.stdout:1/774: write db/dc8/de7/fe9 [8741505,57402] 0 2024-05-06T21:26:50.882 INFO:tasks.workunit.client.0.smithi032.stdout:4/941: mknod d2/d16/d44/d74/d76/d81/d11f/c12d 0 2024-05-06T21:26:50.884 INFO:tasks.workunit.client.0.smithi032.stdout:5/836: symlink d0/d16/d2a/dc7/dd2/l103 0 2024-05-06T21:26:50.884 INFO:tasks.workunit.client.0.smithi032.stdout:5/837: dread - d0/d16/d2a/d52/f93 zero size 2024-05-06T21:26:50.885 INFO:tasks.workunit.client.1.smithi154.stdout:9/630: rmdir d5/d2e 39 2024-05-06T21:26:50.885 INFO:tasks.workunit.client.0.smithi032.stdout:7/869: symlink db/d12/d16/d21/d103/l112 0 2024-05-06T21:26:50.887 INFO:tasks.workunit.client.1.smithi154.stdout:7/439: write d6/d54/f58 [3412112,53939] 0 2024-05-06T21:26:50.888 INFO:tasks.workunit.client.1.smithi154.stdout:2/540: stat db/d12/d1d/d60/ca5 0 2024-05-06T21:26:50.890 INFO:tasks.workunit.client.0.smithi032.stdout:2/741: mkdir df/d19/d1e/d35/dc5/d2e/d103 0 2024-05-06T21:26:50.890 INFO:tasks.workunit.client.0.smithi032.stdout:2/742: creat df/d19/d1e/d35/dc5/d2e/d33/f104 x:0 0 0 2024-05-06T21:26:50.891 INFO:tasks.workunit.client.0.smithi032.stdout:1/775: symlink db/d37/lfa 0 2024-05-06T21:26:50.893 INFO:tasks.workunit.client.0.smithi032.stdout:4/942: link d2/d2c/d31/d7c/fd0 d2/d2c/d31/d7c/d11d/f12e 0 2024-05-06T21:26:50.895 INFO:tasks.workunit.client.0.smithi032.stdout:5/838: creat d0/d16/d46/d78/d89/f104 x:0 0 0 2024-05-06T21:26:50.896 INFO:tasks.workunit.client.1.smithi154.stdout:7/440: dread d6/d42/d6c/d6e/f19 [0,4194304] 0 2024-05-06T21:26:50.897 INFO:tasks.workunit.client.1.smithi154.stdout:7/441: chown d6/d20/d40/d52/d81 86264199 1 2024-05-06T21:26:50.897 INFO:tasks.workunit.client.0.smithi032.stdout:7/870: link db/d12/d49/f4d db/d12/d16/d21/dcb/f113 0 2024-05-06T21:26:50.897 INFO:tasks.workunit.client.0.smithi032.stdout:7/871: chown db/d12/d16/f3f 240166483 1 2024-05-06T21:26:50.897 INFO:tasks.workunit.client.0.smithi032.stdout:7/872: fdatasync db/d12/d16/d2a/d39/f10c 0 2024-05-06T21:26:50.898 INFO:tasks.workunit.client.1.smithi154.stdout:6/401: dwrite d8/f10 [0,4194304] 0 2024-05-06T21:26:50.898 INFO:tasks.workunit.client.1.smithi154.stdout:6/402: dread - d8/d13/d20/f5a zero size 2024-05-06T21:26:50.902 INFO:tasks.workunit.client.1.smithi154.stdout:8/484: truncate d3/d14/d1a/d29/d32/d40/d59/f55 144887 0 2024-05-06T21:26:50.903 INFO:tasks.workunit.client.0.smithi032.stdout:2/743: link df/d19/d1e/d71/d5f/d7d/d25/d2d/f47 df/d19/d1e/d71/d5f/f105 0 2024-05-06T21:26:50.903 INFO:tasks.workunit.client.0.smithi032.stdout:4/943: write d2/d1e/f78 [136370,114589] 0 2024-05-06T21:26:50.904 INFO:tasks.workunit.client.0.smithi032.stdout:5/839: mkdir d0/d16/d79/d105 0 2024-05-06T21:26:50.905 INFO:tasks.workunit.client.1.smithi154.stdout:9/631: write d5/dca/fda [337682,130571] 0 2024-05-06T21:26:50.905 INFO:tasks.workunit.client.1.smithi154.stdout:9/632: dread - d5/d20/d37/f64 zero size 2024-05-06T21:26:50.906 INFO:tasks.workunit.client.0.smithi032.stdout:5/840: mkdir d0/d16/d2a/d5f/dd6/d106 0 2024-05-06T21:26:50.906 INFO:tasks.workunit.client.1.smithi154.stdout:6/403: symlink d8/d11/d2d/d3d/d70/l7c 0 2024-05-06T21:26:50.907 INFO:tasks.workunit.client.1.smithi154.stdout:6/404: write d8/d13/d20/f74 [459237,110720] 0 2024-05-06T21:26:50.907 INFO:tasks.workunit.client.1.smithi154.stdout:6/405: truncate d8/f2b 8554172 0 2024-05-06T21:26:50.907 INFO:tasks.workunit.client.1.smithi154.stdout:6/406: truncate d8/d11/d2d/d3d/d4c/f58 719236 0 2024-05-06T21:26:50.907 INFO:tasks.workunit.client.1.smithi154.stdout:1/626: dwrite d6/db/d10/d26/f23 [4194304,4194304] 0 2024-05-06T21:26:50.907 INFO:tasks.workunit.client.1.smithi154.stdout:0/641: dwrite d6/dc/d44/d36/d89/f8b [0,4194304] 0 2024-05-06T21:26:50.907 INFO:tasks.workunit.client.1.smithi154.stdout:0/642: write d6/dc/d42/f7f [123659,86643] 0 2024-05-06T21:26:50.909 INFO:tasks.workunit.client.0.smithi032.stdout:5/841: link d0/d24/d38/d37/d70/fb2 d0/d16/d2a/d5f/f107 0 2024-05-06T21:26:50.909 INFO:tasks.workunit.client.0.smithi032.stdout:5/842: read - d0/d16/d2a/dc7/dd2/db1/fb8 zero size 2024-05-06T21:26:50.911 INFO:tasks.workunit.client.1.smithi154.stdout:4/545: dwrite d0/f34 [0,4194304] 0 2024-05-06T21:26:50.913 INFO:tasks.workunit.client.0.smithi032.stdout:5/843: symlink d0/d16/d46/l108 0 2024-05-06T21:26:50.913 INFO:tasks.workunit.client.0.smithi032.stdout:5/844: chown d0/d24/d38/d37/f55 308800 1 2024-05-06T21:26:50.913 INFO:tasks.workunit.client.0.smithi032.stdout:5/845: stat d0/d16/d2a/d5f/dd6 0 2024-05-06T21:26:50.913 INFO:tasks.workunit.client.0.smithi032.stdout:5/846: chown d0/d16/d2a/d5f/dca/cbe 102 1 2024-05-06T21:26:50.913 INFO:tasks.workunit.client.0.smithi032.stdout:5/847: write d0/d4e/ff3 [1046338,65078] 0 2024-05-06T21:26:50.913 INFO:tasks.workunit.client.0.smithi032.stdout:5/848: write d0/d24/d38/fef [5152329,130822] 0 2024-05-06T21:26:50.914 INFO:tasks.workunit.client.0.smithi032.stdout:5/849: write d0/d16/d2a/dc7/dd2/db1/fb8 [24811,128387] 0 2024-05-06T21:26:50.915 INFO:tasks.workunit.client.1.smithi154.stdout:6/407: dread - d8/d11/f67 zero size 2024-05-06T21:26:50.915 INFO:tasks.workunit.client.1.smithi154.stdout:6/408: chown d8/d11/d2d/d3d/f6b 12833858 1 2024-05-06T21:26:50.916 INFO:tasks.workunit.client.0.smithi032.stdout:5/850: dread d0/d16/d46/da9/fc8 [0,4194304] 0 2024-05-06T21:26:50.918 INFO:tasks.workunit.client.1.smithi154.stdout:1/627: mknod d6/db/d5e/db8/cbc 0 2024-05-06T21:26:50.920 INFO:tasks.workunit.client.0.smithi032.stdout:9/870: sync 2024-05-06T21:26:50.920 INFO:tasks.workunit.client.0.smithi032.stdout:0/796: sync 2024-05-06T21:26:50.920 INFO:tasks.workunit.client.0.smithi032.stdout:3/892: sync 2024-05-06T21:26:50.920 INFO:tasks.workunit.client.0.smithi032.stdout:0/797: dread - d4/da/d16/d33/da7/dbd/ff7 zero size 2024-05-06T21:26:50.924 INFO:tasks.workunit.client.1.smithi154.stdout:6/409: getdents d8/d11/d33 0 2024-05-06T21:26:50.924 INFO:tasks.workunit.client.1.smithi154.stdout:1/628: rename d6/d3e/d7e/da5/c91 to d6/d3e/d7e/cbd 0 2024-05-06T21:26:50.924 INFO:tasks.workunit.client.1.smithi154.stdout:1/629: truncate d6/db/d10/fa1 714272 0 2024-05-06T21:26:50.924 INFO:tasks.workunit.client.1.smithi154.stdout:1/630: truncate d6/db/d10/f51 4287569 0 2024-05-06T21:26:50.925 INFO:tasks.workunit.client.0.smithi032.stdout:9/871: rename d1/d13/d34/d26/d39/d8b/c10b to d1/d2f/da1/c129 0 2024-05-06T21:26:50.926 INFO:tasks.workunit.client.0.smithi032.stdout:9/872: read d1/d13/d33/d3f/f4e [1492421,110999] 0 2024-05-06T21:26:50.928 INFO:tasks.workunit.client.0.smithi032.stdout:5/851: write d0/d24/d38/fd5 [4028394,69381] 0 2024-05-06T21:26:50.928 INFO:tasks.workunit.client.0.smithi032.stdout:5/852: truncate d0/d16/f85 1315320 0 2024-05-06T21:26:50.928 INFO:tasks.workunit.client.0.smithi032.stdout:9/873: mkdir d1/d2f/da1/dc2/d64/d72/d12a 0 2024-05-06T21:26:50.929 INFO:tasks.workunit.client.0.smithi032.stdout:9/874: readlink d1/d13/d34/d26/d39/d45/le9 0 2024-05-06T21:26:50.929 INFO:tasks.workunit.client.1.smithi154.stdout:1/631: mkdir d6/db/dbe 0 2024-05-06T21:26:50.929 INFO:tasks.workunit.client.1.smithi154.stdout:1/632: truncate d6/db/d10/fa9 4664606 0 2024-05-06T21:26:50.929 INFO:tasks.workunit.client.1.smithi154.stdout:8/485: write d3/d14/d1a/f3c [1839798,59205] 0 2024-05-06T21:26:50.929 INFO:tasks.workunit.client.0.smithi032.stdout:4/944: write d2/f6c [1543961,54360] 0 2024-05-06T21:26:50.932 INFO:tasks.workunit.client.0.smithi032.stdout:5/853: mkdir d0/d16/d109 0 2024-05-06T21:26:50.933 INFO:tasks.workunit.client.1.smithi154.stdout:5/606: write d2/d3/fa [2876946,71408] 0 2024-05-06T21:26:50.934 INFO:tasks.workunit.client.0.smithi032.stdout:4/945: mknod d2/d13/daa/db8/de7/d112/c12f 0 2024-05-06T21:26:50.936 INFO:tasks.workunit.client.0.smithi032.stdout:4/946: stat d2/d16/d44/d74/d76/l85 0 2024-05-06T21:26:50.938 INFO:tasks.workunit.client.0.smithi032.stdout:4/947: symlink d2/d16/d44/d74/d76/d81/d11f/l130 0 2024-05-06T21:26:50.938 INFO:tasks.workunit.client.0.smithi032.stdout:4/948: chown d2/d16/d44/d74/d79/d88/dd6/df2/c114 14 1 2024-05-06T21:26:50.941 INFO:tasks.workunit.client.1.smithi154.stdout:6/410: dread d8/d13/d20/f65 [0,4194304] 0 2024-05-06T21:26:50.941 INFO:tasks.workunit.client.1.smithi154.stdout:6/411: chown d8/d11/d2d/l41 4031 1 2024-05-06T21:26:50.949 INFO:tasks.workunit.client.1.smithi154.stdout:6/412: rename d8/d13/f5e to d8/d11/d2d/d3d/d70/f7d 0 2024-05-06T21:26:50.952 INFO:tasks.workunit.client.1.smithi154.stdout:6/413: getdents d8/d11/d2d 0 2024-05-06T21:26:50.959 INFO:tasks.workunit.client.0.smithi032.stdout:3/893: write d1/d4/da/f11f [1167919,56598] 0 2024-05-06T21:26:50.961 INFO:tasks.workunit.client.0.smithi032.stdout:3/894: creat d1/d4/da/d31/d9b/d125/d74/db1/f126 x:0 0 0 2024-05-06T21:26:50.961 INFO:tasks.workunit.client.0.smithi032.stdout:3/895: chown d1/d4/da/d4e/d41/d43/lb4 39241036 1 2024-05-06T21:26:50.962 INFO:tasks.workunit.client.0.smithi032.stdout:3/896: rmdir d1/d4/da/d31/d47/d4a/d68/d7c/da8 39 2024-05-06T21:26:50.963 INFO:tasks.workunit.client.0.smithi032.stdout:2/744: dwrite df/d19/d1e/d35/d3f/fe4 [0,4194304] 0 2024-05-06T21:26:50.968 INFO:tasks.workunit.client.0.smithi032.stdout:2/745: getdents df/d19/d1e/d35 0 2024-05-06T21:26:50.968 INFO:tasks.workunit.client.0.smithi032.stdout:2/746: stat df/d19/d1e/d35/d3f/fd0 0 2024-05-06T21:26:50.968 INFO:tasks.workunit.client.0.smithi032.stdout:2/747: write df/d19/d1e/d71/d5f/f105 [297994,80727] 0 2024-05-06T21:26:50.970 INFO:tasks.workunit.client.0.smithi032.stdout:1/776: dwrite db/d37/f4b [0,4194304] 0 2024-05-06T21:26:50.973 INFO:tasks.workunit.client.0.smithi032.stdout:1/777: mkdir db/dc8/de7/dfb 0 2024-05-06T21:26:50.974 INFO:tasks.workunit.client.0.smithi032.stdout:1/778: dread db/d47/d4a/f8e [0,4194304] 0 2024-05-06T21:26:50.976 INFO:tasks.workunit.client.0.smithi032.stdout:1/779: mkdir db/dc8/dfc 0 2024-05-06T21:26:50.976 INFO:tasks.workunit.client.0.smithi032.stdout:1/780: truncate db/d16/da3/fd5 352465 0 2024-05-06T21:26:50.980 INFO:tasks.workunit.client.0.smithi032.stdout:1/781: dread db/d16/d46/f4e [0,4194304] 0 2024-05-06T21:26:50.981 INFO:tasks.workunit.client.0.smithi032.stdout:1/782: mknod db/d37/d93/dce/cfd 0 2024-05-06T21:26:50.982 INFO:tasks.workunit.client.0.smithi032.stdout:1/783: truncate db/d47/d4a/f95 1295879 0 2024-05-06T21:26:50.982 INFO:tasks.workunit.client.0.smithi032.stdout:1/784: chown db/d37 1738 1 2024-05-06T21:26:50.983 INFO:tasks.workunit.client.0.smithi032.stdout:1/785: fdatasync db/d47/d4a/da4/d4f/dd0/fe3 0 2024-05-06T21:26:50.984 INFO:tasks.workunit.client.1.smithi154.stdout:6/414: dread d8/d13/d20/f65 [0,4194304] 0 2024-05-06T21:26:50.985 INFO:tasks.workunit.client.1.smithi154.stdout:6/415: mkdir d8/d7e 0 2024-05-06T21:26:50.985 INFO:tasks.workunit.client.1.smithi154.stdout:6/416: stat d8/f10 0 2024-05-06T21:26:50.986 INFO:tasks.workunit.client.0.smithi032.stdout:1/786: unlink db/d16/d46/d55/cb4 0 2024-05-06T21:26:50.986 INFO:tasks.workunit.client.0.smithi032.stdout:1/787: chown db/d16/f32 41782090 1 2024-05-06T21:26:50.987 INFO:tasks.workunit.client.0.smithi032.stdout:4/949: dread d2/fc [4194304,4194304] 0 2024-05-06T21:26:50.987 INFO:tasks.workunit.client.0.smithi032.stdout:1/788: creat db/d47/d4a/da4/d4f/ffe x:0 0 0 2024-05-06T21:26:50.988 INFO:tasks.workunit.client.1.smithi154.stdout:6/417: rename d8/f23 to d8/d13/d20/f7f 0 2024-05-06T21:26:50.988 INFO:tasks.workunit.client.0.smithi032.stdout:4/950: truncate d2/f9 2349982 0 2024-05-06T21:26:50.989 INFO:tasks.workunit.client.0.smithi032.stdout:4/951: getdents d2/d13/daa/db8 0 2024-05-06T21:26:50.989 INFO:tasks.workunit.client.1.smithi154.stdout:6/418: rmdir d8/d11/d2d 39 2024-05-06T21:26:50.989 INFO:tasks.workunit.client.1.smithi154.stdout:6/419: chown d8/d11/d33/d4a/d6c/l7a 38544288 1 2024-05-06T21:26:50.990 INFO:tasks.workunit.client.1.smithi154.stdout:6/420: creat d8/d11/d2d/d3d/d70/f80 x:0 0 0 2024-05-06T21:26:50.990 INFO:tasks.workunit.client.1.smithi154.stdout:6/421: readlink d8/l61 0 2024-05-06T21:26:50.991 INFO:tasks.workunit.client.1.smithi154.stdout:6/422: creat d8/d11/d2d/d3d/d70/d7b/f81 x:0 0 0 2024-05-06T21:26:50.991 INFO:tasks.workunit.client.1.smithi154.stdout:6/423: fsync d8/d11/d51/f6f 0 2024-05-06T21:26:50.991 INFO:tasks.workunit.client.0.smithi032.stdout:4/952: rename d2/d16/d44/d74/d7e to d2/d1e/d47/d131 0 2024-05-06T21:26:50.993 INFO:tasks.workunit.client.1.smithi154.stdout:6/424: dread d8/d11/d33/f55 [0,4194304] 0 2024-05-06T21:26:50.993 INFO:tasks.workunit.client.1.smithi154.stdout:6/425: chown d8/d11/c35 16634 1 2024-05-06T21:26:50.994 INFO:tasks.workunit.client.0.smithi032.stdout:1/789: dread db/d47/d4a/dcb/fd3 [0,4194304] 0 2024-05-06T21:26:50.994 INFO:tasks.workunit.client.0.smithi032.stdout:1/790: readlink db/d47/d4a/da4/d4f/lef 0 2024-05-06T21:26:50.995 INFO:tasks.workunit.client.1.smithi154.stdout:6/426: mknod d8/d11/d2d/d3d/d70/c82 0 2024-05-06T21:26:50.995 INFO:tasks.workunit.client.0.smithi032.stdout:1/791: link db/d47/c9b db/d16/d5d/db2/cff 0 2024-05-06T21:26:50.996 INFO:tasks.workunit.client.0.smithi032.stdout:1/792: write db/d47/d4a/dcb/fe4 [4319252,128682] 0 2024-05-06T21:26:50.996 INFO:tasks.workunit.client.1.smithi154.stdout:6/427: creat d8/d7e/f83 x:0 0 0 2024-05-06T21:26:50.997 INFO:tasks.workunit.client.1.smithi154.stdout:6/428: creat d8/d11/d2d/d3d/d4c/f84 x:0 0 0 2024-05-06T21:26:50.997 INFO:tasks.workunit.client.1.smithi154.stdout:6/429: read - d8/d13/f77 zero size 2024-05-06T21:26:50.999 INFO:tasks.workunit.client.1.smithi154.stdout:6/430: dread d8/d11/d33/f55 [0,4194304] 0 2024-05-06T21:26:50.999 INFO:tasks.workunit.client.1.smithi154.stdout:6/431: stat d8/d11/c4b 0 2024-05-06T21:26:50.999 INFO:tasks.workunit.client.1.smithi154.stdout:6/432: creat d8/d13/d20/f85 x:0 0 0 2024-05-06T21:26:51.000 INFO:tasks.workunit.client.1.smithi154.stdout:7/442: dwrite d6/f1a [0,4194304] 0 2024-05-06T21:26:51.008 INFO:tasks.workunit.client.1.smithi154.stdout:4/546: dwrite d0/d2/f2b [0,4194304] 0 2024-05-06T21:26:51.008 INFO:tasks.workunit.client.1.smithi154.stdout:4/547: chown d0/d82/d44/d73/f5f 2153 1 2024-05-06T21:26:51.008 INFO:tasks.workunit.client.1.smithi154.stdout:9/633: dwrite d5/d20/f90 [0,4194304] 0 2024-05-06T21:26:51.008 INFO:tasks.workunit.client.1.smithi154.stdout:9/634: creat d5/d20/d52/d6e/d83/da2/fdd x:0 0 0 2024-05-06T21:26:51.015 INFO:tasks.workunit.client.0.smithi032.stdout:4/953: dread d2/d13/daa/fe1 [0,4194304] 0 2024-05-06T21:26:51.017 INFO:tasks.workunit.client.1.smithi154.stdout:0/643: dwrite d6/dc/d40/f47 [0,4194304] 0 2024-05-06T21:26:51.018 INFO:tasks.workunit.client.1.smithi154.stdout:0/644: fsync f4 0 2024-05-06T21:26:51.018 INFO:tasks.workunit.client.1.smithi154.stdout:0/645: chown d6/dc/d40/d5e 1659 1 2024-05-06T21:26:51.018 INFO:tasks.workunit.client.1.smithi154.stdout:2/541: dwrite db/de/d10/f67 [4194304,4194304] 0 2024-05-06T21:26:51.026 INFO:tasks.workunit.client.1.smithi154.stdout:4/548: dwrite d0/d2/d47/f6d [0,4194304] 0 2024-05-06T21:26:51.026 INFO:tasks.workunit.client.1.smithi154.stdout:4/549: readlink d0/d82/d39/d54/l61 0 2024-05-06T21:26:51.026 INFO:tasks.workunit.client.1.smithi154.stdout:4/550: chown d0/d10/d11/f46 312098 1 2024-05-06T21:26:51.027 INFO:tasks.workunit.client.1.smithi154.stdout:1/633: dwrite d6/d3e/faa [0,4194304] 0 2024-05-06T21:26:51.027 INFO:tasks.workunit.client.1.smithi154.stdout:1/634: chown d6/db/d10/f63 1587 1 2024-05-06T21:26:51.027 INFO:tasks.workunit.client.1.smithi154.stdout:1/635: dread - d6/db/d69/d89/fb4 zero size 2024-05-06T21:26:51.028 INFO:tasks.workunit.client.1.smithi154.stdout:1/636: chown d6/db/d10/d26/l55 26698042 1 2024-05-06T21:26:51.028 INFO:tasks.workunit.client.0.smithi032.stdout:7/873: dwrite db/d89/daa/ff5 [0,4194304] 0 2024-05-06T21:26:51.031 INFO:tasks.workunit.client.0.smithi032.stdout:7/874: unlink db/d12/d16/fc1 0 2024-05-06T21:26:51.032 INFO:tasks.workunit.client.1.smithi154.stdout:5/607: dwrite d2/d3/d21/d95/dd/f64 [0,4194304] 0 2024-05-06T21:26:51.032 INFO:tasks.workunit.client.1.smithi154.stdout:5/608: write d2/d3/d19/d23/f33 [2909679,58209] 0 2024-05-06T21:26:51.033 INFO:tasks.workunit.client.0.smithi032.stdout:9/875: dwrite d1/d2f/fc4 [0,4194304] 0 2024-05-06T21:26:51.033 INFO:tasks.workunit.client.0.smithi032.stdout:0/798: dwrite d4/f3f [0,4194304] 0 2024-05-06T21:26:51.036 INFO:tasks.workunit.client.0.smithi032.stdout:5/854: dwrite d0/d16/d2a/d59/d67/d73/f76 [0,4194304] 0 2024-05-06T21:26:51.036 INFO:tasks.workunit.client.0.smithi032.stdout:9/876: symlink d1/d2f/da1/dc2/da0/l12b 0 2024-05-06T21:26:51.041 INFO:tasks.workunit.client.0.smithi032.stdout:7/875: write db/d12/d16/f57 [2764539,49371] 0 2024-05-06T21:26:51.043 INFO:tasks.workunit.client.0.smithi032.stdout:7/876: creat db/d12/d16/d2a/d39/f114 x:0 0 0 2024-05-06T21:26:51.048 INFO:tasks.workunit.client.1.smithi154.stdout:8/486: dwrite d3/d14/d1a/d29/d3e/f66 [0,4194304] 0 2024-05-06T21:26:51.048 INFO:tasks.workunit.client.1.smithi154.stdout:8/487: write d3/d14/f18 [2236175,55590] 0 2024-05-06T21:26:51.048 INFO:tasks.workunit.client.1.smithi154.stdout:1/637: dwrite d6/db/f99 [4194304,4194304] 0 2024-05-06T21:26:51.052 INFO:tasks.workunit.client.0.smithi032.stdout:4/954: dwrite d2/d16/d44/d74/d79/d88/dd6/f101 [0,4194304] 0 2024-05-06T21:26:51.052 INFO:tasks.workunit.client.0.smithi032.stdout:4/955: write d2/d16/d44/d45/d4e/fbb [551492,33069] 0 2024-05-06T21:26:51.054 INFO:tasks.workunit.client.0.smithi032.stdout:3/897: dwrite d1/d4/da/d31/d9b/f9e [4194304,4194304] 0 2024-05-06T21:26:51.054 INFO:tasks.workunit.client.0.smithi032.stdout:2/748: dwrite df/d19/d1e/d35/d3f/f44 [0,4194304] 0 2024-05-06T21:26:51.066 INFO:tasks.workunit.client.0.smithi032.stdout:9/877: dwrite d1/d2f/da1/dc2/d59/f84 [0,4194304] 0 2024-05-06T21:26:51.067 INFO:tasks.workunit.client.1.smithi154.stdout:4/551: dwrite d0/d2/f66 [0,4194304] 0 2024-05-06T21:26:51.069 INFO:tasks.workunit.client.0.smithi032.stdout:2/749: getdents df/d19/d1e/d35/dc5 0 2024-05-06T21:26:51.069 INFO:tasks.workunit.client.0.smithi032.stdout:2/750: write df/d19/d1e/d42/dc6/f4f [4634135,2996] 0 2024-05-06T21:26:51.069 INFO:tasks.workunit.client.0.smithi032.stdout:2/751: stat df/d19/d1e/d71/d5f/d7d/d25/f9d 0 2024-05-06T21:26:51.070 INFO:tasks.workunit.client.0.smithi032.stdout:4/956: getdents d2/d16/d44/d74/d76 0 2024-05-06T21:26:51.070 INFO:tasks.workunit.client.0.smithi032.stdout:2/752: dread df/d19/d1e/d71/d5f/d7d/d25/d2d/f47 [0,4194304] 0 2024-05-06T21:26:51.070 INFO:tasks.workunit.client.0.smithi032.stdout:2/753: chown df/d19/d1e/d35/d3f/f68 378233165 1 2024-05-06T21:26:51.070 INFO:tasks.workunit.client.1.smithi154.stdout:0/646: rename d6/dc/lc9 to d6/dc/d51/lcf 0 2024-05-06T21:26:51.071 INFO:tasks.workunit.client.0.smithi032.stdout:9/878: mknod d1/d13/d34/d26/d9f/ddc/c12c 0 2024-05-06T21:26:51.072 INFO:tasks.workunit.client.0.smithi032.stdout:7/877: dwrite db/d12/d16/d2a/d39/d8b/f10e [0,4194304] 0 2024-05-06T21:26:51.073 INFO:tasks.workunit.client.1.smithi154.stdout:2/542: unlink db/d12/f2a 0 2024-05-06T21:26:51.074 INFO:tasks.workunit.client.0.smithi032.stdout:3/898: dwrite d1/d2a/d71/d9d/ffa [0,4194304] 0 2024-05-06T21:26:51.075 INFO:tasks.workunit.client.0.smithi032.stdout:4/957: mkdir d2/d16/d44/d45/d4e/d132 0 2024-05-06T21:26:51.075 INFO:tasks.workunit.client.0.smithi032.stdout:4/958: fsync d2/d16/d44/d45/f11c 0 2024-05-06T21:26:51.075 INFO:tasks.workunit.client.0.smithi032.stdout:4/959: readlink d2/d16/d44/d45/lbe 0 2024-05-06T21:26:51.077 INFO:tasks.workunit.client.0.smithi032.stdout:2/754: unlink df/d19/d1e/d71/d5f/d7d/d25/f50 0 2024-05-06T21:26:51.077 INFO:tasks.workunit.client.0.smithi032.stdout:4/960: dread d2/d13/f9e [0,4194304] 0 2024-05-06T21:26:51.079 INFO:tasks.workunit.client.1.smithi154.stdout:4/552: write d0/f34 [1302794,56895] 0 2024-05-06T21:26:51.080 INFO:tasks.workunit.client.0.smithi032.stdout:9/879: dread d1/d13/d34/f32 [0,4194304] 0 2024-05-06T21:26:51.080 INFO:tasks.workunit.client.0.smithi032.stdout:9/880: write d1/d2f/da1/dc2/d59/f65 [739354,18351] 0 2024-05-06T21:26:51.085 INFO:tasks.workunit.client.0.smithi032.stdout:2/755: link df/d19/d1e/d35/dc5/d2e/d33/f1d df/d19/d1e/d71/d5f/d7d/f106 0 2024-05-06T21:26:51.085 INFO:tasks.workunit.client.0.smithi032.stdout:2/756: truncate df/d19/d1e/d35/dc5/d2e/d33/f9a 4240248 0 2024-05-06T21:26:51.085 INFO:tasks.workunit.client.0.smithi032.stdout:2/757: creat df/d19/d1e/f107 x:0 0 0 2024-05-06T21:26:51.086 INFO:tasks.workunit.client.1.smithi154.stdout:8/488: link d3/d14/d1a/d29/d32/c5b d3/d14/d1a/d29/d68/d61/ca1 0 2024-05-06T21:26:51.086 INFO:tasks.workunit.client.1.smithi154.stdout:8/489: truncate d3/d14/d1a/d29/d32/d40/d79/f4e 340264 0 2024-05-06T21:26:51.086 INFO:tasks.workunit.client.1.smithi154.stdout:8/490: readlink d3/d14/l3b 0 2024-05-06T21:26:51.086 INFO:tasks.workunit.client.1.smithi154.stdout:8/491: chown d3/f54 15420997 1 2024-05-06T21:26:51.089 INFO:tasks.workunit.client.1.smithi154.stdout:1/638: symlink d6/db/d69/d89/dac/lbf 0 2024-05-06T21:26:51.092 INFO:tasks.workunit.client.1.smithi154.stdout:9/635: rmdir d5/d14/daf/db8 39 2024-05-06T21:26:51.092 INFO:tasks.workunit.client.1.smithi154.stdout:9/636: truncate d5/d14/daf/db8/fc5 720246 0 2024-05-06T21:26:51.092 INFO:tasks.workunit.client.1.smithi154.stdout:7/443: truncate d6/d20/f89 3908765 0 2024-05-06T21:26:51.093 INFO:tasks.workunit.client.1.smithi154.stdout:0/647: mkdir d6/dc1/dd0 0 2024-05-06T21:26:51.095 INFO:tasks.workunit.client.1.smithi154.stdout:2/543: symlink db/d12/d1d/d60/d63/lad 0 2024-05-06T21:26:51.097 INFO:tasks.workunit.client.1.smithi154.stdout:4/553: mkdir d0/d82/d39/db9 0 2024-05-06T21:26:51.101 INFO:tasks.workunit.client.1.smithi154.stdout:5/609: mkdir d2/d3/d21/d95/dd/d2a/d54/dce 0 2024-05-06T21:26:51.102 INFO:tasks.workunit.client.1.smithi154.stdout:9/637: mknod d5/d2e/d8b/cde 0 2024-05-06T21:26:51.103 INFO:tasks.workunit.client.0.smithi032.stdout:3/899: dwrite d1/d4/da/d31/d47/d4a/d68/d7c/f90 [0,4194304] 0 2024-05-06T21:26:51.104 INFO:tasks.workunit.client.1.smithi154.stdout:7/444: creat d6/d54/d6a/f8a x:0 0 0 2024-05-06T21:26:51.104 INFO:tasks.workunit.client.1.smithi154.stdout:7/445: fdatasync d6/f32 0 2024-05-06T21:26:51.104 INFO:tasks.workunit.client.1.smithi154.stdout:2/544: dread db/f3c [0,4194304] 0 2024-05-06T21:26:51.106 INFO:tasks.workunit.client.0.smithi032.stdout:3/900: creat d1/d4/da/d31/d9b/d121/f127 x:0 0 0 2024-05-06T21:26:51.106 INFO:tasks.workunit.client.0.smithi032.stdout:3/901: dread - d1/d4/da/d31/d9b/d125/d74/fe4 zero size 2024-05-06T21:26:51.107 INFO:tasks.workunit.client.1.smithi154.stdout:9/638: symlink d5/d14/d31/d39/ldf 0 2024-05-06T21:26:51.107 INFO:tasks.workunit.client.1.smithi154.stdout:7/446: mkdir d6/d20/d40/d52/d8b 0 2024-05-06T21:26:51.108 INFO:tasks.workunit.client.1.smithi154.stdout:0/648: rmdir d6/dc/d51/d54/dbd 39 2024-05-06T21:26:51.108 INFO:tasks.workunit.client.1.smithi154.stdout:0/649: readlink d6/la 0 2024-05-06T21:26:51.111 INFO:tasks.workunit.client.0.smithi032.stdout:9/881: dwrite d1/d13/f16 [0,4194304] 0 2024-05-06T21:26:51.112 INFO:tasks.workunit.client.1.smithi154.stdout:9/639: mknod d5/d14/d3a/d71/db1/dba/ce0 0 2024-05-06T21:26:51.112 INFO:tasks.workunit.client.1.smithi154.stdout:9/640: getdents d5/d14/d3a/d71/db1/dbd 0 2024-05-06T21:26:51.112 INFO:tasks.workunit.client.1.smithi154.stdout:9/641: readlink d5/lc7 0 2024-05-06T21:26:51.112 INFO:tasks.workunit.client.1.smithi154.stdout:2/545: dread db/f71 [0,4194304] 0 2024-05-06T21:26:51.112 INFO:tasks.workunit.client.1.smithi154.stdout:9/642: read d5/d14/d87/f9e [160990,48943] 0 2024-05-06T21:26:51.113 INFO:tasks.workunit.client.1.smithi154.stdout:0/650: rmdir d6/dc/d51 39 2024-05-06T21:26:51.117 INFO:tasks.workunit.client.1.smithi154.stdout:9/643: mkdir d5/d20/d37/dd5/de1 0 2024-05-06T21:26:51.117 INFO:tasks.workunit.client.1.smithi154.stdout:0/651: getdents d6/dc/d44/d36/d89 0 2024-05-06T21:26:51.119 INFO:tasks.workunit.client.1.smithi154.stdout:0/652: symlink d6/dc/d40/d85/db2/dbb/ld1 0 2024-05-06T21:26:51.120 INFO:tasks.workunit.client.1.smithi154.stdout:6/433: getdents d8/d13/d20 0 2024-05-06T21:26:51.121 INFO:tasks.workunit.client.1.smithi154.stdout:6/434: write d8/d11/f1d [2707379,117553] 0 2024-05-06T21:26:51.131 INFO:tasks.workunit.client.0.smithi032.stdout:9/882: read d1/d2f/fc4 [107559,86703] 0 2024-05-06T21:26:51.133 INFO:tasks.workunit.client.1.smithi154.stdout:0/653: write f4 [2560357,129079] 0 2024-05-06T21:26:51.137 INFO:tasks.workunit.client.1.smithi154.stdout:0/654: unlink d6/dc/d44/d36/fc2 0 2024-05-06T21:26:51.138 INFO:tasks.workunit.client.0.smithi032.stdout:2/758: dwrite df/d19/d1e/d71/d5f/d7d/f9c [0,4194304] 0 2024-05-06T21:26:51.139 INFO:tasks.workunit.client.1.smithi154.stdout:9/644: read d5/f2a [1300907,97635] 0 2024-05-06T21:26:51.139 INFO:tasks.workunit.client.0.smithi032.stdout:9/883: write d1/d2f/fcf [3430116,97447] 0 2024-05-06T21:26:51.139 INFO:tasks.workunit.client.1.smithi154.stdout:0/655: symlink d6/dc/d51/d54/ld2 0 2024-05-06T21:26:51.140 INFO:tasks.workunit.client.1.smithi154.stdout:0/656: read d6/dc/d40/d4a/da7/d70/f7e [313147,83414] 0 2024-05-06T21:26:51.142 INFO:tasks.workunit.client.0.smithi032.stdout:9/884: mknod d1/d2f/da1/dc2/d59/c12d 0 2024-05-06T21:26:51.142 INFO:tasks.workunit.client.1.smithi154.stdout:3/732: sync 2024-05-06T21:26:51.143 INFO:tasks.workunit.client.1.smithi154.stdout:7/447: dwrite d6/d42/d6c/d6e/f31 [0,4194304] 0 2024-05-06T21:26:51.143 INFO:tasks.workunit.client.1.smithi154.stdout:7/448: truncate d6/d46/f83 135174 0 2024-05-06T21:26:51.143 INFO:tasks.workunit.client.1.smithi154.stdout:8/492: dwrite d3/fb [0,4194304] 0 2024-05-06T21:26:51.144 INFO:tasks.workunit.client.1.smithi154.stdout:9/645: creat d5/d14/d3a/d71/fe2 x:0 0 0 2024-05-06T21:26:51.145 INFO:tasks.workunit.client.0.smithi032.stdout:3/902: dwrite d1/d4/da/d31/d47/d4a/d68/fe6 [4194304,4194304] 0 2024-05-06T21:26:51.146 INFO:tasks.workunit.client.1.smithi154.stdout:0/657: symlink d6/dc/d44/d9f/ld3 0 2024-05-06T21:26:51.147 INFO:tasks.workunit.client.0.smithi032.stdout:3/903: rmdir d1/d4/da/d31/d9b/d125/dfd 39 2024-05-06T21:26:51.147 INFO:tasks.workunit.client.1.smithi154.stdout:3/733: mkdir d0/da/d1a/d28/d17/dfe 0 2024-05-06T21:26:51.149 INFO:tasks.workunit.client.0.smithi032.stdout:3/904: creat d1/d4/da/d4e/dd3/f128 x:0 0 0 2024-05-06T21:26:51.150 INFO:tasks.workunit.client.0.smithi032.stdout:3/905: fdatasync d1/d4/da/d31/d9b/d125/d74/db1/df1/d113/d8b/fda 0 2024-05-06T21:26:51.153 INFO:tasks.workunit.client.0.smithi032.stdout:3/906: symlink d1/d4/da/d31/l129 0 2024-05-06T21:26:51.156 INFO:tasks.workunit.client.1.smithi154.stdout:9/646: rename d5/dca/fda to d5/d14/d3a/fe3 0 2024-05-06T21:26:51.156 INFO:tasks.workunit.client.1.smithi154.stdout:9/647: chown d5/d20/d52/c2f 5064669 1 2024-05-06T21:26:51.156 INFO:tasks.workunit.client.1.smithi154.stdout:9/648: readlink d5/d14/d31/d39/ldf 0 2024-05-06T21:26:51.157 INFO:tasks.workunit.client.1.smithi154.stdout:3/734: link d0/da/d1a/lb2 d0/da/db/dd/lff 0 2024-05-06T21:26:51.157 INFO:tasks.workunit.client.1.smithi154.stdout:8/493: symlink d3/d14/d1a/d29/d32/la2 0 2024-05-06T21:26:51.157 INFO:tasks.workunit.client.1.smithi154.stdout:8/494: truncate d3/f7a 402201 0 2024-05-06T21:26:51.158 INFO:tasks.workunit.client.1.smithi154.stdout:0/658: dread d6/dc/d44/f6d [0,4194304] 0 2024-05-06T21:26:51.158 INFO:tasks.workunit.client.1.smithi154.stdout:9/649: creat d5/d89/fe4 x:0 0 0 2024-05-06T21:26:51.161 INFO:tasks.workunit.client.1.smithi154.stdout:3/735: link d0/da/db/d7c/d80/la0 d0/da/d1a/d28/l100 0 2024-05-06T21:26:51.161 INFO:tasks.workunit.client.1.smithi154.stdout:9/650: mkdir d5/d20/d52/d6e/d83/de5 0 2024-05-06T21:26:51.161 INFO:tasks.workunit.client.1.smithi154.stdout:9/651: write d5/d14/d87/f9e [1040555,51178] 0 2024-05-06T21:26:51.164 INFO:tasks.workunit.client.1.smithi154.stdout:3/736: unlink d0/da/d82/laf 0 2024-05-06T21:26:51.167 INFO:tasks.workunit.client.1.smithi154.stdout:3/737: symlink d0/da/d1a/d28/d17/l101 0 2024-05-06T21:26:51.167 INFO:tasks.workunit.client.0.smithi032.stdout:9/885: write d1/f12 [636660,95598] 0 2024-05-06T21:26:51.170 INFO:tasks.workunit.client.1.smithi154.stdout:3/738: rename d0/da/d1a/d28/d17/c8f to d0/da/d82/c102 0 2024-05-06T21:26:51.172 INFO:tasks.workunit.client.0.smithi032.stdout:3/907: read d1/d4/da/d4e/d41/d43/f110 [1847470,47923] 0 2024-05-06T21:26:51.172 INFO:tasks.workunit.client.1.smithi154.stdout:3/739: symlink d0/da/db/dd/d1c/d21/l103 0 2024-05-06T21:26:51.174 INFO:tasks.workunit.client.1.smithi154.stdout:3/740: link d0/da/d1a/d28/d17/f63 d0/da/db/d30/d71/f104 0 2024-05-06T21:26:51.176 INFO:tasks.workunit.client.1.smithi154.stdout:3/741: mknod d0/da/d1a/d28/d17/dfe/c105 0 2024-05-06T21:26:51.180 INFO:tasks.workunit.client.1.smithi154.stdout:0/659: read d6/f83 [882043,44021] 0 2024-05-06T21:26:51.181 INFO:tasks.workunit.client.1.smithi154.stdout:0/660: mkdir d6/dc/d40/d4a/d6c/dce/dd4 0 2024-05-06T21:26:51.183 INFO:tasks.workunit.client.1.smithi154.stdout:0/661: unlink d6/dc/d3c/f92 0 2024-05-06T21:26:51.185 INFO:tasks.workunit.client.1.smithi154.stdout:0/662: mkdir d6/dc/d40/d4a/da7/d70/d96/dd5 0 2024-05-06T21:26:51.187 INFO:tasks.workunit.client.1.smithi154.stdout:0/663: symlink d6/dc/d40/d85/ld6 0 2024-05-06T21:26:51.187 INFO:tasks.workunit.client.1.smithi154.stdout:0/664: chown d6/f83 0 1 2024-05-06T21:26:51.188 INFO:tasks.workunit.client.1.smithi154.stdout:0/665: mkdir d6/dc/d40/d4a/d6c/dce/dd7 0 2024-05-06T21:26:51.189 INFO:tasks.workunit.client.1.smithi154.stdout:0/666: truncate d6/fb1 355839 0 2024-05-06T21:26:51.189 INFO:tasks.workunit.client.1.smithi154.stdout:2/546: dwrite db/d12/f43 [0,4194304] 0 2024-05-06T21:26:51.190 INFO:tasks.workunit.client.0.smithi032.stdout:9/886: dread d1/d2f/da1/dc2/fba [0,4194304] 0 2024-05-06T21:26:51.191 INFO:tasks.workunit.client.0.smithi032.stdout:9/887: chown d1/f18 0 1 2024-05-06T21:26:51.191 INFO:tasks.workunit.client.0.smithi032.stdout:9/888: truncate d1/d2f/da1/dc2/fda 1064143 0 2024-05-06T21:26:51.191 INFO:tasks.workunit.client.1.smithi154.stdout:0/667: link d6/dc/d40/d5e/fab d6/dc/d40/d4a/d6c/dce/dd7/fd8 0 2024-05-06T21:26:51.191 INFO:tasks.workunit.client.0.smithi032.stdout:9/889: creat d1/d13/d34/d26/d39/d8b/f12e x:0 0 0 2024-05-06T21:26:51.195 INFO:tasks.workunit.client.1.smithi154.stdout:2/547: unlink db/de/l62 0 2024-05-06T21:26:51.195 INFO:tasks.workunit.client.1.smithi154.stdout:2/548: chown db/de/d16/d33/f44 104822 1 2024-05-06T21:26:51.202 INFO:tasks.workunit.client.1.smithi154.stdout:0/668: dread d6/f3a [0,4194304] 0 2024-05-06T21:26:51.202 INFO:tasks.workunit.client.1.smithi154.stdout:6/435: dwrite d8/d13/f64 [0,4194304] 0 2024-05-06T21:26:51.205 INFO:tasks.workunit.client.0.smithi032.stdout:4/961: dwrite d2/d2c/d31/d7c/d11d/f12e [0,4194304] 0 2024-05-06T21:26:51.205 INFO:tasks.workunit.client.1.smithi154.stdout:6/436: mkdir d8/d11/d2d/d3d/d4c/d86 0 2024-05-06T21:26:51.205 INFO:tasks.workunit.client.1.smithi154.stdout:6/437: chown d8/d11/d2d/c45 0 1 2024-05-06T21:26:51.205 INFO:tasks.workunit.client.1.smithi154.stdout:0/669: dread d6/dc/d44/d9f/fad [0,4194304] 0 2024-05-06T21:26:51.205 INFO:tasks.workunit.client.1.smithi154.stdout:0/670: creat d6/dc/d40/d85/db2/dbb/fd9 x:0 0 0 2024-05-06T21:26:51.207 INFO:tasks.workunit.client.1.smithi154.stdout:0/671: creat d6/dc1/fda x:0 0 0 2024-05-06T21:26:51.207 INFO:tasks.workunit.client.1.smithi154.stdout:0/672: truncate d6/dc/f61 512054 0 2024-05-06T21:26:51.209 INFO:tasks.workunit.client.1.smithi154.stdout:2/549: write db/de/f1c [2521019,20370] 0 2024-05-06T21:26:51.210 INFO:tasks.workunit.client.1.smithi154.stdout:0/673: rename d6/dc/d44/d36/d89/f8b to d6/dc/d40/d4a/d6c/dce/dd7/fdb 0 2024-05-06T21:26:51.210 INFO:tasks.workunit.client.1.smithi154.stdout:0/674: truncate d6/dc/d40/fb8 803944 0 2024-05-06T21:26:51.210 INFO:tasks.workunit.client.1.smithi154.stdout:0/675: write d6/dc/d40/fcb [15575,93469] 0 2024-05-06T21:26:51.210 INFO:tasks.workunit.client.1.smithi154.stdout:0/676: chown d6/dc/d44/d36/f4e 2423 1 2024-05-06T21:26:51.212 INFO:tasks.workunit.client.1.smithi154.stdout:2/550: mkdir db/de/d16/dae 0 2024-05-06T21:26:51.213 INFO:tasks.workunit.client.1.smithi154.stdout:2/551: truncate db/de/d16/f52 3583175 0 2024-05-06T21:26:51.213 INFO:tasks.workunit.client.0.smithi032.stdout:2/759: dwrite df/d19/d1e/d35/fa0 [0,4194304] 0 2024-05-06T21:26:51.213 INFO:tasks.workunit.client.0.smithi032.stdout:2/760: write df/d19/d1e/d35/dc5/d2e/d33/f9a [4992679,89929] 0 2024-05-06T21:26:51.214 INFO:tasks.workunit.client.1.smithi154.stdout:7/449: dwrite d6/fb [0,4194304] 0 2024-05-06T21:26:51.214 INFO:tasks.workunit.client.1.smithi154.stdout:0/677: dread d6/dc/f2e [0,4194304] 0 2024-05-06T21:26:51.215 INFO:tasks.workunit.client.1.smithi154.stdout:2/552: creat db/d12/d19/d4b/faf x:0 0 0 2024-05-06T21:26:51.217 INFO:tasks.workunit.client.1.smithi154.stdout:7/450: symlink d6/d42/d6c/d6e/d23/l8c 0 2024-05-06T21:26:51.217 INFO:tasks.workunit.client.1.smithi154.stdout:7/451: creat d6/d46/d5c/f8d x:0 0 0 2024-05-06T21:26:51.218 INFO:tasks.workunit.client.0.smithi032.stdout:2/761: getdents df/d19 0 2024-05-06T21:26:51.218 INFO:tasks.workunit.client.0.smithi032.stdout:2/762: chown df/d19/d1e/d71/d5f/d7d/f7f 304016045 1 2024-05-06T21:26:51.218 INFO:tasks.workunit.client.1.smithi154.stdout:0/678: rmdir d6/dc/d40/d4a/da7 39 2024-05-06T21:26:51.218 INFO:tasks.workunit.client.1.smithi154.stdout:0/679: stat d6/dc/d44/d36/d89 0 2024-05-06T21:26:51.219 INFO:tasks.workunit.client.0.smithi032.stdout:2/763: link df/d19/d1e/d71/d5f/d7d/d25/f60 df/d19/d1e/d71/f108 0 2024-05-06T21:26:51.219 INFO:tasks.workunit.client.1.smithi154.stdout:7/452: symlink d6/d42/d6c/d6e/l8e 0 2024-05-06T21:26:51.220 INFO:tasks.workunit.client.1.smithi154.stdout:0/680: symlink d6/dc/d40/d4a/da3/ldc 0 2024-05-06T21:26:51.220 INFO:tasks.workunit.client.1.smithi154.stdout:0/681: fdatasync d6/dc/f66 0 2024-05-06T21:26:51.221 INFO:tasks.workunit.client.0.smithi032.stdout:2/764: symlink df/d19/d1e/d35/dc5/d2e/dbc/l109 0 2024-05-06T21:26:51.221 INFO:tasks.workunit.client.0.smithi032.stdout:2/765: stat df/f12 0 2024-05-06T21:26:51.222 INFO:tasks.workunit.client.1.smithi154.stdout:0/682: unlink d6/dc/d40/d4a/d6c/d8a/la9 0 2024-05-06T21:26:51.223 INFO:tasks.workunit.client.1.smithi154.stdout:0/683: creat d6/dc/d40/d4a/fdd x:0 0 0 2024-05-06T21:26:51.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:50 smithi032 ceph-mon[27179]: pgmap v26: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 165 MiB/s rd, 208 MiB/s wr, 436 op/s 2024-05-06T21:26:51.225 INFO:tasks.workunit.client.1.smithi154.stdout:0/684: rename d6/dc/d40/fb8 to d6/dc/d44/d36/fde 0 2024-05-06T21:26:51.228 INFO:tasks.workunit.client.1.smithi154.stdout:0/685: symlink d6/dc/d44/d36/d89/ldf 0 2024-05-06T21:26:51.229 INFO:tasks.workunit.client.1.smithi154.stdout:0/686: mkdir d6/dc/d39/de0 0 2024-05-06T21:26:51.230 INFO:tasks.workunit.client.1.smithi154.stdout:2/553: write db/de/d10/f30 [3002372,26576] 0 2024-05-06T21:26:51.237 INFO:tasks.workunit.client.1.smithi154.stdout:0/687: dread d6/dc/f16 [0,4194304] 0 2024-05-06T21:26:51.237 INFO:tasks.workunit.client.1.smithi154.stdout:9/652: dwrite d5/d20/d52/d6e/f9b [0,4194304] 0 2024-05-06T21:26:51.237 INFO:tasks.workunit.client.1.smithi154.stdout:9/653: dread - d5/d20/d37/f64 zero size 2024-05-06T21:26:51.237 INFO:tasks.workunit.client.1.smithi154.stdout:3/742: dwrite d0/da/db/d52/d75/fee [0,4194304] 0 2024-05-06T21:26:51.239 INFO:tasks.workunit.client.1.smithi154.stdout:0/688: write d6/dc/d44/d36/fde [655086,102799] 0 2024-05-06T21:26:51.241 INFO:tasks.workunit.client.1.smithi154.stdout:9/654: mkdir d5/d20/d37/dd5/de1/de6 0 2024-05-06T21:26:51.241 INFO:tasks.workunit.client.1.smithi154.stdout:9/655: write d5/d2e/da0/fb4 [120585,119494] 0 2024-05-06T21:26:51.242 INFO:tasks.workunit.client.1.smithi154.stdout:8/495: dwrite d3/fd [0,4194304] 0 2024-05-06T21:26:51.242 INFO:tasks.workunit.client.1.smithi154.stdout:8/496: chown d3/d14/c2f 4 1 2024-05-06T21:26:51.242 INFO:tasks.workunit.client.1.smithi154.stdout:8/497: chown d3/f9 25 1 2024-05-06T21:26:51.245 INFO:tasks.workunit.client.1.smithi154.stdout:0/689: creat d6/dc/d40/d5e/fe1 x:0 0 0 2024-05-06T21:26:51.245 INFO:tasks.workunit.client.1.smithi154.stdout:0/690: stat d6/dc/d42/l98 0 2024-05-06T21:26:51.245 INFO:tasks.workunit.client.1.smithi154.stdout:0/691: chown d6/dc/d44/d36/d89/ldf 0 1 2024-05-06T21:26:51.246 INFO:tasks.workunit.client.1.smithi154.stdout:9/656: mknod d5/d20/d37/dd5/de1/ce7 0 2024-05-06T21:26:51.247 INFO:tasks.workunit.client.1.smithi154.stdout:9/657: write d5/d20/d52/f99 [191122,130007] 0 2024-05-06T21:26:51.247 INFO:tasks.workunit.client.1.smithi154.stdout:9/658: write d5/d20/f90 [4612178,19637] 0 2024-05-06T21:26:51.247 INFO:tasks.workunit.client.1.smithi154.stdout:9/659: truncate d5/d2e/d8b/fb2 1551488 0 2024-05-06T21:26:51.247 INFO:tasks.workunit.client.1.smithi154.stdout:3/743: dread d0/da/d1a/d28/d17/f54 [0,4194304] 0 2024-05-06T21:26:51.250 INFO:tasks.workunit.client.1.smithi154.stdout:9/660: symlink d5/d20/le8 0 2024-05-06T21:26:51.251 INFO:tasks.workunit.client.0.smithi032.stdout:4/962: dwrite d2/d16/d44/d74/d79/de6/de8/d69/fd3 [0,4194304] 0 2024-05-06T21:26:51.251 INFO:tasks.workunit.client.0.smithi032.stdout:4/963: write d2/d16/d44/d74/d79/f97 [87103,104575] 0 2024-05-06T21:26:51.252 INFO:tasks.workunit.client.1.smithi154.stdout:9/661: dread d5/d20/d52/d59/f67 [0,4194304] 0 2024-05-06T21:26:51.252 INFO:tasks.workunit.client.1.smithi154.stdout:6/438: dwrite d8/d11/d2d/d3d/d70/d7b/f81 [0,4194304] 0 2024-05-06T21:26:51.252 INFO:tasks.workunit.client.1.smithi154.stdout:6/439: creat d8/d7e/f87 x:0 0 0 2024-05-06T21:26:51.252 INFO:tasks.workunit.client.1.smithi154.stdout:3/744: mkdir d0/da/db/d7c/d80/d106 0 2024-05-06T21:26:51.253 INFO:tasks.workunit.client.1.smithi154.stdout:8/498: getdents d3 0 2024-05-06T21:26:51.253 INFO:tasks.workunit.client.1.smithi154.stdout:8/499: chown d3/d14/d1a/d6e 108 1 2024-05-06T21:26:51.258 INFO:tasks.workunit.client.1.smithi154.stdout:9/662: unlink d5/d14/d31/d39/lc1 0 2024-05-06T21:26:51.258 INFO:tasks.workunit.client.1.smithi154.stdout:9/663: chown d5/d20/d84 30415 1 2024-05-06T21:26:51.259 INFO:tasks.workunit.client.1.smithi154.stdout:6/440: unlink d8/l2a 0 2024-05-06T21:26:51.260 INFO:tasks.workunit.client.1.smithi154.stdout:9/664: rename d5/d20/d52/d6e/d83/da2/fdd to d5/d2e/d8b/fe9 0 2024-05-06T21:26:51.261 INFO:tasks.workunit.client.1.smithi154.stdout:6/441: symlink d8/l88 0 2024-05-06T21:26:51.261 INFO:tasks.workunit.client.1.smithi154.stdout:6/442: truncate d8/d11/d2d/f3a 763883 0 2024-05-06T21:26:51.262 INFO:tasks.workunit.client.1.smithi154.stdout:6/443: symlink d8/d11/d33/d4a/l89 0 2024-05-06T21:26:51.267 INFO:tasks.workunit.client.0.smithi032.stdout:9/890: dwrite d1/d13/d34/d26/d49/fea [0,4194304] 0 2024-05-06T21:26:51.268 INFO:tasks.workunit.client.1.smithi154.stdout:7/453: dwrite d6/d42/d6c/d6e/d21/d69/d7b/f7e [0,4194304] 0 2024-05-06T21:26:51.268 INFO:tasks.workunit.client.0.smithi032.stdout:2/766: dwrite df/d19/d1e/d71/d5f/d7d/d65/f85 [0,4194304] 0 2024-05-06T21:26:51.269 INFO:tasks.workunit.client.1.smithi154.stdout:2/554: dwrite db/fab [0,4194304] 0 2024-05-06T21:26:51.270 INFO:tasks.workunit.client.0.smithi032.stdout:2/767: read df/d19/d1e/d42/dc6/dc1/fc8 [340906,113594] 0 2024-05-06T21:26:51.271 INFO:tasks.workunit.client.1.smithi154.stdout:0/692: dwrite d6/dc/d40/d4a/fdd [0,4194304] 0 2024-05-06T21:26:51.273 INFO:tasks.workunit.client.0.smithi032.stdout:2/768: rename ca to df/d19/d1e/d42/dc6/dc1/c10a 0 2024-05-06T21:26:51.275 INFO:tasks.workunit.client.1.smithi154.stdout:3/745: write d0/da/d1a/d28/d17/db0/f7a [3477646,83296] 0 2024-05-06T21:26:51.275 INFO:tasks.workunit.client.0.smithi032.stdout:4/964: dread d2/d2c/d31/d7c/f32 [0,4194304] 0 2024-05-06T21:26:51.275 INFO:tasks.workunit.client.0.smithi032.stdout:3/908: dwrite d1/d4/da/d31/d9b/d125/d74/db1/df6/f111 [0,4194304] 0 2024-05-06T21:26:51.275 INFO:tasks.workunit.client.0.smithi032.stdout:4/965: dread - d2/d13/daa/db8/de7/f9f zero size 2024-05-06T21:26:51.277 INFO:tasks.workunit.client.1.smithi154.stdout:8/500: write d3/d14/d1a/d29/d32/d40/d79/f88 [3440402,31811] 0 2024-05-06T21:26:51.277 INFO:tasks.workunit.client.1.smithi154.stdout:8/501: dread - d3/d14/d1a/d45/f99 zero size 2024-05-06T21:26:51.282 INFO:tasks.workunit.client.0.smithi032.stdout:4/966: unlink d2/d16/d44/f5c 0 2024-05-06T21:26:51.284 INFO:tasks.workunit.client.0.smithi032.stdout:4/967: mkdir d2/d13/daa/dc2/d133 0 2024-05-06T21:26:51.286 INFO:tasks.workunit.client.0.smithi032.stdout:4/968: mkdir d2/d13/daa/df4/d134 0 2024-05-06T21:26:51.288 INFO:tasks.workunit.client.0.smithi032.stdout:4/969: mknod d2/d16/d44/d45/dc1/c135 0 2024-05-06T21:26:51.289 INFO:tasks.workunit.client.0.smithi032.stdout:4/970: rename d2/d16/d44/d74 to d2/d16/d44/d74/d79/de6/de8/dd8/d136 22 2024-05-06T21:26:51.293 INFO:tasks.workunit.client.0.smithi032.stdout:4/971: rename d2/d16/d44/d74/d76/d81/d11f/l130 to d2/d16/d44/d74/def/l137 0 2024-05-06T21:26:51.294 INFO:tasks.workunit.client.1.smithi154.stdout:7/454: link d6/c2b d6/d20/d40/d52/d81/c8f 0 2024-05-06T21:26:51.294 INFO:tasks.workunit.client.0.smithi032.stdout:4/972: stat d2/d2c/d31/l11a 0 2024-05-06T21:26:51.294 INFO:tasks.workunit.client.1.smithi154.stdout:9/665: dwrite d5/d2e/d66/fbe [0,4194304] 0 2024-05-06T21:26:51.297 INFO:tasks.workunit.client.0.smithi032.stdout:4/973: link d2/d16/d44/d74/d76/c107 d2/d16/d44/d45/d4e/c138 0 2024-05-06T21:26:51.297 INFO:tasks.workunit.client.1.smithi154.stdout:2/555: rmdir db/d86 39 2024-05-06T21:26:51.299 INFO:tasks.workunit.client.0.smithi032.stdout:4/974: creat d2/d16/d44/d74/def/f139 x:0 0 0 2024-05-06T21:26:51.305 INFO:tasks.workunit.client.1.smithi154.stdout:8/502: mkdir d3/d14/d1a/d29/da3 0 2024-05-06T21:26:51.305 INFO:tasks.workunit.client.1.smithi154.stdout:8/503: truncate d3/d14/d1a/d45/f7d 100032 0 2024-05-06T21:26:51.308 INFO:tasks.workunit.client.1.smithi154.stdout:6/444: dwrite d8/d11/d2d/d3d/f6b [0,4194304] 0 2024-05-06T21:26:51.311 INFO:tasks.workunit.client.1.smithi154.stdout:2/556: chown c3 77 1 2024-05-06T21:26:51.312 INFO:tasks.workunit.client.1.smithi154.stdout:8/504: mkdir d3/d14/d1a/d29/d32/d40/d79/d84/da4 0 2024-05-06T21:26:51.312 INFO:tasks.workunit.client.1.smithi154.stdout:8/505: dread - d3/d14/d1a/d29/d32/d40/d79/d90/f8c zero size 2024-05-06T21:26:51.312 INFO:tasks.workunit.client.1.smithi154.stdout:8/506: stat d3/d14/d1a/d29/d32/d40/d59/c3f 0 2024-05-06T21:26:51.312 INFO:tasks.workunit.client.1.smithi154.stdout:8/507: truncate d3/d14/f18 3937954 0 2024-05-06T21:26:51.312 INFO:tasks.workunit.client.1.smithi154.stdout:2/557: read db/d12/f37 [510880,115416] 0 2024-05-06T21:26:51.316 INFO:tasks.workunit.client.1.smithi154.stdout:6/445: mknod d8/d11/d2d/d3d/d70/c8a 0 2024-05-06T21:26:51.316 INFO:tasks.workunit.client.1.smithi154.stdout:6/446: read d8/d11/d2d/f47 [108629,14325] 0 2024-05-06T21:26:51.318 INFO:tasks.workunit.client.1.smithi154.stdout:6/447: truncate d8/d13/f3f 7654160 0 2024-05-06T21:26:51.320 INFO:tasks.workunit.client.1.smithi154.stdout:8/508: write d3/fb [1036508,73684] 0 2024-05-06T21:26:51.323 INFO:tasks.workunit.client.1.smithi154.stdout:8/509: creat d3/d14/d1a/d29/d32/d40/d59/d67/d95/fa5 x:0 0 0 2024-05-06T21:26:51.323 INFO:tasks.workunit.client.0.smithi032.stdout:9/891: dwrite d1/ff6 [0,4194304] 0 2024-05-06T21:26:51.326 INFO:tasks.workunit.client.1.smithi154.stdout:6/448: dread f1 [0,4194304] 0 2024-05-06T21:26:51.326 INFO:tasks.workunit.client.1.smithi154.stdout:6/449: fdatasync d8/d11/d2d/f47 0 2024-05-06T21:26:51.329 INFO:tasks.workunit.client.0.smithi032.stdout:9/892: write d1/d2f/da1/dc2/fba [2882460,127137] 0 2024-05-06T21:26:51.329 INFO:tasks.workunit.client.0.smithi032.stdout:9/893: write d1/d13/d34/d26/d39/d45/f6d [1582689,35247] 0 2024-05-06T21:26:51.332 INFO:tasks.workunit.client.0.smithi032.stdout:9/894: unlink d1/d13/d33/d8e/ffb 0 2024-05-06T21:26:51.332 INFO:tasks.workunit.client.0.smithi032.stdout:9/895: write d1/d13/d33/d3f/f11c [471073,74682] 0 2024-05-06T21:26:51.332 INFO:tasks.workunit.client.1.smithi154.stdout:8/510: dread d3/d14/d1a/f3c [0,4194304] 0 2024-05-06T21:26:51.337 INFO:tasks.workunit.client.1.smithi154.stdout:3/746: dwrite d0/da/d1a/dbf/ff5 [0,4194304] 0 2024-05-06T21:26:51.337 INFO:tasks.workunit.client.1.smithi154.stdout:0/693: dwrite d6/dc/d44/f46 [0,4194304] 0 2024-05-06T21:26:51.340 INFO:tasks.workunit.client.1.smithi154.stdout:3/747: mknod d0/da/db/dd/d1c/d21/d37/c107 0 2024-05-06T21:26:51.340 INFO:tasks.workunit.client.1.smithi154.stdout:3/748: dread - d0/da/d1a/d28/dbc/d81/d48/da9/fac zero size 2024-05-06T21:26:51.342 INFO:tasks.workunit.client.0.smithi032.stdout:2/769: dwrite df/f8b [0,4194304] 0 2024-05-06T21:26:51.342 INFO:tasks.workunit.client.1.smithi154.stdout:7/455: dwrite d6/d42/d6c/f77 [0,4194304] 0 2024-05-06T21:26:51.342 INFO:tasks.workunit.client.1.smithi154.stdout:7/456: chown d6/d42/d6c/d6e/d23/f28 786932 1 2024-05-06T21:26:51.342 INFO:tasks.workunit.client.1.smithi154.stdout:0/694: mknod d6/dc/d40/d4a/d6c/dce/ce2 0 2024-05-06T21:26:51.343 INFO:tasks.workunit.client.0.smithi032.stdout:3/909: dwrite d1/fc4 [0,4194304] 0 2024-05-06T21:26:51.350 INFO:tasks.workunit.client.1.smithi154.stdout:7/457: symlink d6/d46/d5c/l90 0 2024-05-06T21:26:51.350 INFO:tasks.workunit.client.1.smithi154.stdout:7/458: creat d6/d20/d40/d52/f91 x:0 0 0 2024-05-06T21:26:51.350 INFO:tasks.workunit.client.1.smithi154.stdout:7/459: fdatasync d6/d42/d6c/d6e/d21/d69/f78 0 2024-05-06T21:26:51.350 INFO:tasks.workunit.client.0.smithi032.stdout:6/845: sync 2024-05-06T21:26:51.351 INFO:tasks.workunit.client.1.smithi154.stdout:2/558: dwrite db/d12/d1d/f8a [0,4194304] 0 2024-05-06T21:26:51.352 INFO:tasks.workunit.client.1.smithi154.stdout:0/695: creat d6/dc/d40/d4a/da7/d70/d96/dd5/fe3 x:0 0 0 2024-05-06T21:26:51.352 INFO:tasks.workunit.client.1.smithi154.stdout:0/696: dread - d6/dc/d40/d5e/db5/fcd zero size 2024-05-06T21:26:51.352 INFO:tasks.workunit.client.0.smithi032.stdout:6/846: read d8/dd/d1b/d67/fa6 [470749,116263] 0 2024-05-06T21:26:51.353 INFO:tasks.workunit.client.1.smithi154.stdout:9/666: dwrite d5/d14/d87/f8f [0,4194304] 0 2024-05-06T21:26:51.353 INFO:tasks.workunit.client.1.smithi154.stdout:9/667: write d5/d20/d52/d6e/f9c [4842492,32126] 0 2024-05-06T21:26:51.353 INFO:tasks.workunit.client.1.smithi154.stdout:9/668: fsync d5/f76 0 2024-05-06T21:26:51.353 INFO:tasks.workunit.client.0.smithi032.stdout:2/770: getdents df/d19/d1e/d71/d5f/d7d 0 2024-05-06T21:26:51.353 INFO:tasks.workunit.client.0.smithi032.stdout:2/771: write df/d19/d1e/d35/dc5/d2e/f7e [1121477,45774] 0 2024-05-06T21:26:51.353 INFO:tasks.workunit.client.0.smithi032.stdout:2/772: truncate df/d19/d1e/d71/d5f/ffb 171232 0 2024-05-06T21:26:51.353 INFO:tasks.workunit.client.0.smithi032.stdout:2/773: read - df/d19/d1e/d42/dc6/fe9 zero size 2024-05-06T21:26:51.353 INFO:tasks.workunit.client.0.smithi032.stdout:2/774: chown df/daf 1266490 1 2024-05-06T21:26:51.354 INFO:tasks.workunit.client.0.smithi032.stdout:2/775: chown df/d19/d1e/d54/f58 642674 1 2024-05-06T21:26:51.355 INFO:tasks.workunit.client.0.smithi032.stdout:2/776: rmdir df/d19/d1e/d71 39 2024-05-06T21:26:51.355 INFO:tasks.workunit.client.0.smithi032.stdout:2/777: chown df/d19/d1e/d71/d5f/d7d/d65/c90 89211257 1 2024-05-06T21:26:51.357 INFO:tasks.workunit.client.0.smithi032.stdout:2/778: rename df/d19/d1e/d71/d5f/d7d/f5c to df/d19/d1e/d35/dc5/d2e/d103/f10b 0 2024-05-06T21:26:51.357 INFO:tasks.workunit.client.0.smithi032.stdout:2/779: creat df/d19/d1e/d71/d5f/d73/df1/f10c x:0 0 0 2024-05-06T21:26:51.358 INFO:tasks.workunit.client.1.smithi154.stdout:3/749: rmdir d0/da/d1a 39 2024-05-06T21:26:51.361 INFO:tasks.workunit.client.1.smithi154.stdout:7/460: mknod d6/d42/d6c/d6e/d5e/c92 0 2024-05-06T21:26:51.361 INFO:tasks.workunit.client.1.smithi154.stdout:7/461: stat d6/d42/d6c/d6e/c12 0 2024-05-06T21:26:51.363 INFO:tasks.workunit.client.0.smithi032.stdout:2/780: mknod df/d19/d1e/d54/c10d 0 2024-05-06T21:26:51.363 INFO:tasks.workunit.client.0.smithi032.stdout:2/781: write df/f2c [2951937,112929] 0 2024-05-06T21:26:51.364 INFO:tasks.workunit.client.1.smithi154.stdout:6/450: dwrite d8/d11/f24 [12582912,4194304] 0 2024-05-06T21:26:51.365 INFO:tasks.workunit.client.1.smithi154.stdout:2/559: truncate db/d12/d19/d4b/f75 443214 0 2024-05-06T21:26:51.366 INFO:tasks.workunit.client.0.smithi032.stdout:4/975: getdents d2/d16/d44/d74/def 0 2024-05-06T21:26:51.367 INFO:tasks.workunit.client.1.smithi154.stdout:0/697: rename d6/dc/d40/d85/cbf to d6/dc/d40/d4a/dac/ce4 0 2024-05-06T21:26:51.367 INFO:tasks.workunit.client.1.smithi154.stdout:0/698: chown d6/dc/d44/d36/d89/fc8 6414326 1 2024-05-06T21:26:51.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:51 smithi154 ceph-mon[32880]: pgmap v26: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 165 MiB/s rd, 208 MiB/s wr, 436 op/s 2024-05-06T21:26:51.369 INFO:tasks.workunit.client.1.smithi154.stdout:9/669: dread d5/d2e/d66/fb0 [0,4194304] 0 2024-05-06T21:26:51.369 INFO:tasks.workunit.client.1.smithi154.stdout:9/670: fdatasync d5/f73 0 2024-05-06T21:26:51.377 INFO:tasks.workunit.client.1.smithi154.stdout:8/511: dwrite d3/d14/d1a/d29/d43/f5d [0,4194304] 0 2024-05-06T21:26:51.377 INFO:tasks.workunit.client.1.smithi154.stdout:8/512: write d3/d14/d1a/d29/d32/d40/d79/d90/f8c [385783,99495] 0 2024-05-06T21:26:51.377 INFO:tasks.workunit.client.1.smithi154.stdout:8/513: creat d3/d14/d1a/d29/d68/d6b/fa6 x:0 0 0 2024-05-06T21:26:51.381 INFO:tasks.workunit.client.0.smithi032.stdout:3/910: dwrite d1/d4/da/d4e/d5e/fee [0,4194304] 0 2024-05-06T21:26:51.386 INFO:tasks.workunit.client.0.smithi032.stdout:3/911: rename d1/d4/da/d4e/d5e/d84/df2/fc7 to d1/d4/da/d31/d9b/d125/d74/db1/f12a 0 2024-05-06T21:26:51.396 INFO:tasks.workunit.client.0.smithi032.stdout:3/912: write d1/d4/da/d4e/d41/d45/f6a [3514866,32106] 0 2024-05-06T21:26:51.401 INFO:tasks.workunit.client.1.smithi154.stdout:7/462: symlink d6/d42/d6c/d6e/d21/d2e/l93 0 2024-05-06T21:26:51.406 INFO:tasks.workunit.client.0.smithi032.stdout:9/896: dwrite d1/d13/d34/d26/d39/d45/f52 [0,4194304] 0 2024-05-06T21:26:51.406 INFO:tasks.workunit.client.0.smithi032.stdout:4/976: write d2/fc [4176995,73762] 0 2024-05-06T21:26:51.407 INFO:tasks.workunit.client.1.smithi154.stdout:2/560: truncate db/de/d16/f27 2228421 0 2024-05-06T21:26:51.409 INFO:tasks.workunit.client.0.smithi032.stdout:6/847: dwrite d8/d3d/d49/dad/fd7 [0,4194304] 0 2024-05-06T21:26:51.409 INFO:tasks.workunit.client.0.smithi032.stdout:6/848: chown d8/dd/l75 86394 1 2024-05-06T21:26:51.410 INFO:tasks.workunit.client.1.smithi154.stdout:0/699: link d6/dc/d42/f7f d6/dc/d40/d4a/da7/d70/d96/dd5/fe5 0 2024-05-06T21:26:51.412 INFO:tasks.workunit.client.1.smithi154.stdout:6/451: read f6 [420961,45796] 0 2024-05-06T21:26:51.412 INFO:tasks.workunit.client.1.smithi154.stdout:6/452: write d8/d11/d2d/d3d/d70/f5d [805900,125706] 0 2024-05-06T21:26:51.412 INFO:tasks.workunit.client.0.smithi032.stdout:3/913: write d1/d4/da/d4e/d41/d97/d67/f78 [889096,101660] 0 2024-05-06T21:26:51.413 INFO:tasks.workunit.client.0.smithi032.stdout:6/849: mkdir d8/dd/d18/d3b/db9/d102 0 2024-05-06T21:26:51.413 INFO:tasks.workunit.client.0.smithi032.stdout:4/977: read d2/d13/f1b [100058,52143] 0 2024-05-06T21:26:51.416 INFO:tasks.workunit.client.1.smithi154.stdout:8/514: mkdir d3/d14/d1a/d29/d32/d40/d59/d67/da7 0 2024-05-06T21:26:51.416 INFO:tasks.workunit.client.1.smithi154.stdout:8/515: readlink d3/d14/d1a/d29/d3e/l78 0 2024-05-06T21:26:51.416 INFO:tasks.workunit.client.0.smithi032.stdout:4/978: mkdir d2/d2c/d31/d7c/dfa/d13a 0 2024-05-06T21:26:51.416 INFO:tasks.workunit.client.0.smithi032.stdout:4/979: write d2/d16/d44/d45/dc1/fe9 [4194585,71353] 0 2024-05-06T21:26:51.416 INFO:tasks.workunit.client.0.smithi032.stdout:3/914: dread d1/d4/da/d31/d9b/d125/d74/db1/df1/d113/fa2 [0,4194304] 0 2024-05-06T21:26:51.417 INFO:tasks.workunit.client.0.smithi032.stdout:3/915: fdatasync d1/d4/da/d4e/d41/d43/f110 0 2024-05-06T21:26:51.417 INFO:tasks.workunit.client.0.smithi032.stdout:3/916: write d1/d4/da/d31/d47/d4a/d68/d7c/da8/dea/f10f [274302,128882] 0 2024-05-06T21:26:51.417 INFO:tasks.workunit.client.0.smithi032.stdout:0/799: sync 2024-05-06T21:26:51.418 INFO:tasks.workunit.client.0.smithi032.stdout:3/917: mknod d1/d4/da/d31/d47/c12b 0 2024-05-06T21:26:51.419 INFO:tasks.workunit.client.1.smithi154.stdout:7/463: symlink d6/d20/d40/d52/d81/l94 0 2024-05-06T21:26:51.420 INFO:tasks.workunit.client.1.smithi154.stdout:2/561: creat db/d12/d4e/d55/fb0 x:0 0 0 2024-05-06T21:26:51.422 INFO:tasks.workunit.client.1.smithi154.stdout:9/671: getdents d5/d14/d87 0 2024-05-06T21:26:51.423 INFO:tasks.workunit.client.1.smithi154.stdout:8/516: symlink d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/la8 0 2024-05-06T21:26:51.424 INFO:tasks.workunit.client.1.smithi154.stdout:8/517: stat d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/l98 0 2024-05-06T21:26:51.424 INFO:tasks.workunit.client.1.smithi154.stdout:8/518: stat d3/d14/d1a/d45/f99 0 2024-05-06T21:26:51.424 INFO:tasks.workunit.client.1.smithi154.stdout:8/519: chown d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f60 1050 1 2024-05-06T21:26:51.424 INFO:tasks.workunit.client.1.smithi154.stdout:7/464: truncate d6/f32 558161 0 2024-05-06T21:26:51.425 INFO:tasks.workunit.client.0.smithi032.stdout:1/793: sync 2024-05-06T21:26:51.426 INFO:tasks.workunit.client.1.smithi154.stdout:6/453: getdents d8 0 2024-05-06T21:26:51.428 INFO:tasks.workunit.client.0.smithi032.stdout:1/794: link db/f2e db/d47/d4a/f100 0 2024-05-06T21:26:51.429 INFO:tasks.workunit.client.1.smithi154.stdout:8/520: rename d3/d14/d1a/d29/d68/d6b/f8e to d3/d14/d1a/d29/d32/d40/d59/d67/d94/fa9 0 2024-05-06T21:26:51.430 INFO:tasks.workunit.client.1.smithi154.stdout:6/454: creat d8/d11/d2d/d3d/d4c/d86/f8b x:0 0 0 2024-05-06T21:26:51.432 INFO:tasks.workunit.client.1.smithi154.stdout:0/700: dread d6/dc/d3c/fa5 [0,4194304] 0 2024-05-06T21:26:51.432 INFO:tasks.workunit.client.1.smithi154.stdout:6/455: creat d8/d11/d33/f8c x:0 0 0 2024-05-06T21:26:51.434 INFO:tasks.workunit.client.1.smithi154.stdout:0/701: mknod d6/dc/d40/d85/ce6 0 2024-05-06T21:26:51.436 INFO:tasks.workunit.client.1.smithi154.stdout:0/702: mkdir d6/dc/d40/d4a/d6c/dce/dd7/de7 0 2024-05-06T21:26:51.437 INFO:tasks.workunit.client.1.smithi154.stdout:2/562: dread db/de/f99 [0,4194304] 0 2024-05-06T21:26:51.439 INFO:tasks.workunit.client.1.smithi154.stdout:6/456: mkdir d8/d11/d8d 0 2024-05-06T21:26:51.440 INFO:tasks.workunit.client.0.smithi032.stdout:3/918: dread d1/f58 [0,4194304] 0 2024-05-06T21:26:51.440 INFO:tasks.workunit.client.1.smithi154.stdout:0/703: symlink d6/dc/le8 0 2024-05-06T21:26:51.441 INFO:tasks.workunit.client.0.smithi032.stdout:3/919: rename d1/d4/da/d31/d47/d4a/d68/fe6 to d1/d4/da/d4e/dd3/dd6/f12c 0 2024-05-06T21:26:51.442 INFO:tasks.workunit.client.1.smithi154.stdout:2/563: mkdir db/d12/d19/d7d/db1 0 2024-05-06T21:26:51.442 INFO:tasks.workunit.client.1.smithi154.stdout:2/564: chown db/de/d16/d33/l58 0 1 2024-05-06T21:26:51.442 INFO:tasks.workunit.client.0.smithi032.stdout:4/980: dread f1 [0,4194304] 0 2024-05-06T21:26:51.443 INFO:tasks.workunit.client.0.smithi032.stdout:3/920: mkdir d1/d4/da/d31/d9b/d125/d12d 0 2024-05-06T21:26:51.443 INFO:tasks.workunit.client.0.smithi032.stdout:3/921: chown d1/d4/da/d4e/d41/d97/d67/da6 3 1 2024-05-06T21:26:51.444 INFO:tasks.workunit.client.0.smithi032.stdout:4/981: stat d2/d13/daa/db8/cd1 0 2024-05-06T21:26:51.445 INFO:tasks.workunit.client.1.smithi154.stdout:6/457: mkdir d8/d11/d33/d4a/d6c/d8e 0 2024-05-06T21:26:51.445 INFO:tasks.workunit.client.0.smithi032.stdout:3/922: symlink d1/d4/da/d1d/dc0/l12e 0 2024-05-06T21:26:51.445 INFO:tasks.workunit.client.0.smithi032.stdout:3/923: stat d1/d4/da/d31/d9b/d125/d74/db1/df1/d113/d8b/c98 0 2024-05-06T21:26:51.445 INFO:tasks.workunit.client.0.smithi032.stdout:3/924: chown d1/d4/da/d4e/d41/d43/f70 0 1 2024-05-06T21:26:51.447 INFO:tasks.workunit.client.0.smithi032.stdout:3/925: link d1/d4/da/d4e/d41/d45/cf5 d1/d4/c12f 0 2024-05-06T21:26:51.447 INFO:tasks.workunit.client.0.smithi032.stdout:3/926: read - d1/d4/da/d4e/dd3/dd6/f124 zero size 2024-05-06T21:26:51.447 INFO:tasks.workunit.client.1.smithi154.stdout:6/458: truncate d8/d11/d2d/d3d/f6b 1346924 0 2024-05-06T21:26:51.447 INFO:tasks.workunit.client.1.smithi154.stdout:6/459: dread - d8/d7e/f83 zero size 2024-05-06T21:26:51.448 INFO:tasks.workunit.client.0.smithi032.stdout:1/795: dread db/f2e [0,4194304] 0 2024-05-06T21:26:51.448 INFO:tasks.workunit.client.0.smithi032.stdout:3/927: link d1/d4/cd d1/d4/da/d31/d9b/d125/db8/c130 0 2024-05-06T21:26:51.451 INFO:tasks.workunit.client.0.smithi032.stdout:3/928: rename d1/d4/d11/f2b to d1/d4/da/d4e/d41/d97/f131 0 2024-05-06T21:26:51.453 INFO:tasks.workunit.client.0.smithi032.stdout:1/796: getdents db/d47/d4a/dcb 0 2024-05-06T21:26:51.455 INFO:tasks.workunit.client.1.smithi154.stdout:0/704: write d6/dc/d44/d36/d89/faf [555817,130573] 0 2024-05-06T21:26:51.455 INFO:tasks.workunit.client.1.smithi154.stdout:0/705: chown d6/dc/d44/c93 95913198 1 2024-05-06T21:26:51.455 INFO:tasks.workunit.client.0.smithi032.stdout:3/929: rename d1/d4/da/d31/d47/d4a/f5f to d1/d4/da/d4e/d5e/d84/df2/df3/f132 0 2024-05-06T21:26:51.458 INFO:tasks.workunit.client.0.smithi032.stdout:3/930: creat d1/d4/d11/dfb/f133 x:0 0 0 2024-05-06T21:26:51.458 INFO:tasks.workunit.client.0.smithi032.stdout:3/931: stat d1/c53 0 2024-05-06T21:26:51.459 INFO:tasks.workunit.client.1.smithi154.stdout:0/706: link d6/d27/f69 d6/dc/d40/d4a/d6c/dce/dd7/de7/fe9 0 2024-05-06T21:26:51.460 INFO:tasks.workunit.client.1.smithi154.stdout:0/707: dread - d6/dc/d42/fba zero size 2024-05-06T21:26:51.460 INFO:tasks.workunit.client.1.smithi154.stdout:0/708: write d6/dc/d51/f55 [1722332,55376] 0 2024-05-06T21:26:51.460 INFO:tasks.workunit.client.1.smithi154.stdout:3/750: dwrite d0/da/d1a/d28/dbc/d81/d9c/fa3 [0,4194304] 0 2024-05-06T21:26:51.460 INFO:tasks.workunit.client.1.smithi154.stdout:3/751: truncate d0/da/db/d30/f98 1343948 0 2024-05-06T21:26:51.460 INFO:tasks.workunit.client.0.smithi032.stdout:3/932: truncate d1/d2a/f8d 380174 0 2024-05-06T21:26:51.460 INFO:tasks.workunit.client.0.smithi032.stdout:3/933: dread - d1/d4/da/d4e/d5e/f6d zero size 2024-05-06T21:26:51.463 INFO:tasks.workunit.client.0.smithi032.stdout:4/982: dread d2/d16/d44/d74/d79/de6/de8/d69/fd3 [0,4194304] 0 2024-05-06T21:26:51.465 INFO:tasks.workunit.client.0.smithi032.stdout:4/983: creat d2/d16/d44/f13b x:0 0 0 2024-05-06T21:26:51.465 INFO:tasks.workunit.client.0.smithi032.stdout:4/984: chown d2/d2c/f49 7624070 1 2024-05-06T21:26:51.465 INFO:tasks.workunit.client.1.smithi154.stdout:9/672: dwrite d5/d14/d31/d39/fc3 [0,4194304] 0 2024-05-06T21:26:51.466 INFO:tasks.workunit.client.0.smithi032.stdout:6/850: dwrite d8/d33/f77 [0,4194304] 0 2024-05-06T21:26:51.466 INFO:tasks.workunit.client.0.smithi032.stdout:9/897: dwrite d1/d13/d33/d3f/d60/fb3 [0,4194304] 0 2024-05-06T21:26:51.470 INFO:tasks.workunit.client.0.smithi032.stdout:6/851: rmdir d8/dd/d18/d3b 39 2024-05-06T21:26:51.474 INFO:tasks.workunit.client.1.smithi154.stdout:9/673: rename d5/d14/d31/l6a to d5/d14/d3a/lea 0 2024-05-06T21:26:51.483 INFO:tasks.workunit.client.0.smithi032.stdout:9/898: mknod d1/d2f/c12f 0 2024-05-06T21:26:51.483 INFO:tasks.workunit.client.1.smithi154.stdout:9/674: write d5/d20/d52/f78 [6326005,96742] 0 2024-05-06T21:26:51.485 INFO:tasks.workunit.client.0.smithi032.stdout:9/899: symlink d1/d13/d33/da6/l130 0 2024-05-06T21:26:51.485 INFO:tasks.workunit.client.1.smithi154.stdout:9/675: unlink d5/l7 0 2024-05-06T21:26:51.486 INFO:tasks.workunit.client.1.smithi154.stdout:9/676: creat d5/d14/d3a/d71/feb x:0 0 0 2024-05-06T21:26:51.486 INFO:tasks.workunit.client.1.smithi154.stdout:9/677: creat d5/d14/d31/d39/fec x:0 0 0 2024-05-06T21:26:51.486 INFO:tasks.workunit.client.0.smithi032.stdout:6/852: getdents d8/dd/d18/d3b/d90 0 2024-05-06T21:26:51.487 INFO:tasks.workunit.client.0.smithi032.stdout:9/900: dread d1/d13/d33/d3f/d60/f66 [0,4194304] 0 2024-05-06T21:26:51.487 INFO:tasks.workunit.client.0.smithi032.stdout:9/901: chown d1/d13/d33/d5e/d78/c9e 34 1 2024-05-06T21:26:51.489 INFO:tasks.workunit.client.0.smithi032.stdout:9/902: mknod d1/d13/d33/d8e/c131 0 2024-05-06T21:26:51.490 INFO:tasks.workunit.client.0.smithi032.stdout:9/903: mkdir d1/d2f/d4f/d132 0 2024-05-06T21:26:51.493 INFO:tasks.workunit.client.0.smithi032.stdout:9/904: rmdir d1/d13/d34/d26/d49 39 2024-05-06T21:26:51.493 INFO:tasks.workunit.client.0.smithi032.stdout:9/905: readlink d1/d2f/da1/dc2/da0/dd1/l117 0 2024-05-06T21:26:51.497 INFO:tasks.workunit.client.1.smithi154.stdout:6/460: dwrite d8/d11/f1d [0,4194304] 0 2024-05-06T21:26:51.499 INFO:tasks.workunit.client.1.smithi154.stdout:8/521: dwrite d3/d14/d1a/d29/d3e/f66 [0,4194304] 0 2024-05-06T21:26:51.501 INFO:tasks.workunit.client.0.smithi032.stdout:6/853: dread d8/dd/d1b/d35/f3a [0,4194304] 0 2024-05-06T21:26:51.501 INFO:tasks.workunit.client.0.smithi032.stdout:6/854: write d8/d3d/d49/f76 [334545,96244] 0 2024-05-06T21:26:51.502 INFO:tasks.workunit.client.0.smithi032.stdout:6/855: symlink d8/dd/d18/d3b/d90/l103 0 2024-05-06T21:26:51.502 INFO:tasks.workunit.client.0.smithi032.stdout:6/856: fdatasync d8/dd/d1b/f62 0 2024-05-06T21:26:51.503 INFO:tasks.workunit.client.1.smithi154.stdout:8/522: creat d3/d14/d1a/d29/d3e/faa x:0 0 0 2024-05-06T21:26:51.512 INFO:tasks.workunit.client.1.smithi154.stdout:6/461: write d8/d11/f6d [1951872,4057] 0 2024-05-06T21:26:51.518 INFO:tasks.workunit.client.1.smithi154.stdout:0/709: dwrite d6/fca [0,4194304] 0 2024-05-06T21:26:51.518 INFO:tasks.workunit.client.1.smithi154.stdout:8/523: dread d3/d14/d1a/d29/d68/f3a [0,4194304] 0 2024-05-06T21:26:51.518 INFO:tasks.workunit.client.0.smithi032.stdout:1/797: dwrite db/d16/d5d/db2/fb6 [0,4194304] 0 2024-05-06T21:26:51.519 INFO:tasks.workunit.client.0.smithi032.stdout:3/934: rename d1/d4/da/d4e/d41 to d1/d4/da/d31/d9b/d121/d134 0 2024-05-06T21:26:51.520 INFO:tasks.workunit.client.0.smithi032.stdout:3/935: stat d1/d4/da/d31/d47/d4a/fd1 0 2024-05-06T21:26:51.520 INFO:tasks.workunit.client.0.smithi032.stdout:3/936: chown d1/d4/da/d4e/d5e/d84/df2/df3/l117 1324618 1 2024-05-06T21:26:51.522 INFO:tasks.workunit.client.1.smithi154.stdout:0/710: creat d6/dc/fea x:0 0 0 2024-05-06T21:26:51.522 INFO:tasks.workunit.client.1.smithi154.stdout:0/711: chown d6/dc/c60 261 1 2024-05-06T21:26:51.527 INFO:tasks.workunit.client.0.smithi032.stdout:4/985: rename d2/d2c/d31/l11a to d2/d13/daa/dc2/d133/l13c 0 2024-05-06T21:26:51.528 INFO:tasks.workunit.client.0.smithi032.stdout:0/800: dwrite d4/da/d16/d33/d9e/dc9/dd8/f102 [0,4194304] 0 2024-05-06T21:26:51.528 INFO:tasks.workunit.client.0.smithi032.stdout:3/937: symlink d1/d4/da/d31/d9b/d121/d134/d45/l135 0 2024-05-06T21:26:51.530 INFO:tasks.workunit.client.1.smithi154.stdout:7/465: dwrite d6/f32 [0,4194304] 0 2024-05-06T21:26:51.531 INFO:tasks.workunit.client.1.smithi154.stdout:5/610: sync 2024-05-06T21:26:51.531 INFO:tasks.workunit.client.1.smithi154.stdout:5/611: write d2/d3/fb2 [922648,126027] 0 2024-05-06T21:26:51.531 INFO:tasks.workunit.client.1.smithi154.stdout:4/554: sync 2024-05-06T21:26:51.531 INFO:tasks.workunit.client.1.smithi154.stdout:1/639: sync 2024-05-06T21:26:51.532 INFO:tasks.workunit.client.0.smithi032.stdout:6/857: dwrite d8/d3d/f89 [4194304,4194304] 0 2024-05-06T21:26:51.532 INFO:tasks.workunit.client.0.smithi032.stdout:6/858: creat d8/dd/d1b/f104 x:0 0 0 2024-05-06T21:26:51.532 INFO:tasks.workunit.client.0.smithi032.stdout:6/859: write d8/dd/d1b/f62 [141346,102161] 0 2024-05-06T21:26:51.532 INFO:tasks.workunit.client.1.smithi154.stdout:7/466: rmdir d6/d42 39 2024-05-06T21:26:51.533 INFO:tasks.workunit.client.1.smithi154.stdout:7/467: write d6/d54/d5b/d82/f86 [377257,125865] 0 2024-05-06T21:26:51.533 INFO:tasks.workunit.client.0.smithi032.stdout:4/986: rename d2/d1e/f28 to d2/d2c/d31/f13d 0 2024-05-06T21:26:51.533 INFO:tasks.workunit.client.0.smithi032.stdout:4/987: dread - d2/d13/fc8 zero size 2024-05-06T21:26:51.536 INFO:tasks.workunit.client.1.smithi154.stdout:9/678: dwrite d5/d20/f2c [0,4194304] 0 2024-05-06T21:26:51.536 INFO:tasks.workunit.client.1.smithi154.stdout:9/679: read d5/d20/f81 [431456,57822] 0 2024-05-06T21:26:51.537 INFO:tasks.workunit.client.1.smithi154.stdout:5/612: link d2/f1a d2/d3/d21/d95/dd/d2a/d8d/fcf 0 2024-05-06T21:26:51.537 INFO:tasks.workunit.client.1.smithi154.stdout:5/613: creat d2/d3/d21/d95/dc/d44/d9a/fd0 x:0 0 0 2024-05-06T21:26:51.537 INFO:tasks.workunit.client.1.smithi154.stdout:5/614: truncate d2/d3/d19/d23/f33 4512126 0 2024-05-06T21:26:51.538 INFO:tasks.workunit.client.0.smithi032.stdout:0/801: rename d4/da/d14/d1a/f4d to d4/d3e/d63/d6c/df1/f104 0 2024-05-06T21:26:51.539 INFO:tasks.workunit.client.1.smithi154.stdout:1/640: mkdir d6/db/d74/dc0 0 2024-05-06T21:26:51.539 INFO:tasks.workunit.client.0.smithi032.stdout:1/798: dread db/d16/d5d/fd8 [0,4194304] 0 2024-05-06T21:26:51.540 INFO:tasks.workunit.client.0.smithi032.stdout:9/906: rmdir d1/d13/d33/d8e 39 2024-05-06T21:26:51.543 INFO:tasks.workunit.client.0.smithi032.stdout:1/799: rmdir db/d16/db8/df8 0 2024-05-06T21:26:51.543 INFO:tasks.workunit.client.0.smithi032.stdout:3/938: dread d1/d4/da/d31/d9b/d121/d134/d45/f4d [0,4194304] 0 2024-05-06T21:26:51.543 INFO:tasks.workunit.client.0.smithi032.stdout:3/939: fsync d1/d4/da/d31/d9b/f9e 0 2024-05-06T21:26:51.543 INFO:tasks.workunit.client.0.smithi032.stdout:3/940: fdatasync d1/d4/da/d4e/f91 0 2024-05-06T21:26:51.544 INFO:tasks.workunit.client.0.smithi032.stdout:3/941: getdents d1/d4/da/d31/d9b/d121/d134/d97/d67/da6/df9 0 2024-05-06T21:26:51.544 INFO:tasks.workunit.client.0.smithi032.stdout:3/942: chown d1/d4/d11/dfb 0 1 2024-05-06T21:26:51.545 INFO:tasks.workunit.client.0.smithi032.stdout:1/800: chown db/d16/c2b 10188581 1 2024-05-06T21:26:51.546 INFO:tasks.workunit.client.0.smithi032.stdout:1/801: fsync db/f23 0 2024-05-06T21:26:51.546 INFO:tasks.workunit.client.0.smithi032.stdout:7/878: sync 2024-05-06T21:26:51.546 INFO:tasks.workunit.client.0.smithi032.stdout:1/802: chown db/d16/da3/cba 3413 1 2024-05-06T21:26:51.547 INFO:tasks.workunit.client.0.smithi032.stdout:5/855: sync 2024-05-06T21:26:51.547 INFO:tasks.workunit.client.0.smithi032.stdout:5/856: fdatasync d0/d16/d2a/d59/d67/ffe 0 2024-05-06T21:26:51.548 INFO:tasks.workunit.client.0.smithi032.stdout:5/857: stat d0/d16/d46/da9 0 2024-05-06T21:26:51.549 INFO:tasks.workunit.client.0.smithi032.stdout:3/943: mknod d1/d4/da/d31/d47/d4a/d68/d7c/c136 0 2024-05-06T21:26:51.549 INFO:tasks.workunit.client.0.smithi032.stdout:3/944: fsync d1/d2a/f4c 0 2024-05-06T21:26:51.553 INFO:tasks.workunit.client.1.smithi154.stdout:9/680: symlink d5/d14/d3a/d71/led 0 2024-05-06T21:26:51.553 INFO:tasks.workunit.client.1.smithi154.stdout:9/681: dread - d5/d14/f82 zero size 2024-05-06T21:26:51.557 INFO:tasks.workunit.client.0.smithi032.stdout:5/858: creat d0/d24/d38/d37/d7b/dc0/f10a x:0 0 0 2024-05-06T21:26:51.558 INFO:tasks.workunit.client.1.smithi154.stdout:5/615: mknod d2/d48/cd1 0 2024-05-06T21:26:51.560 INFO:tasks.workunit.client.1.smithi154.stdout:1/641: mkdir d6/db/d69/dc1 0 2024-05-06T21:26:51.560 INFO:tasks.workunit.client.1.smithi154.stdout:1/642: dread - d6/db/d10/f84 zero size 2024-05-06T21:26:51.561 INFO:tasks.workunit.client.1.smithi154.stdout:0/712: dwrite d6/dc/f50 [0,4194304] 0 2024-05-06T21:26:51.562 INFO:tasks.workunit.client.1.smithi154.stdout:5/616: symlink d2/d48/ld2 0 2024-05-06T21:26:51.563 INFO:tasks.workunit.client.1.smithi154.stdout:7/468: dread d6/d46/f83 [0,4194304] 0 2024-05-06T21:26:51.565 INFO:tasks.workunit.client.0.smithi032.stdout:7/879: dread db/d12/d16/d21/d41/d4b/fa5 [0,4194304] 0 2024-05-06T21:26:51.565 INFO:tasks.workunit.client.1.smithi154.stdout:1/643: creat d6/d3e/d7e/da5/da8/fc2 x:0 0 0 2024-05-06T21:26:51.566 INFO:tasks.workunit.client.1.smithi154.stdout:7/469: dread d6/d46/f83 [0,4194304] 0 2024-05-06T21:26:51.569 INFO:tasks.workunit.client.1.smithi154.stdout:0/713: mknod d6/dc/d40/d85/db2/ceb 0 2024-05-06T21:26:51.569 INFO:tasks.workunit.client.1.smithi154.stdout:0/714: write d6/dc/d3c/f7d [4741869,60739] 0 2024-05-06T21:26:51.569 INFO:tasks.workunit.client.1.smithi154.stdout:0/715: stat d6/fc6 0 2024-05-06T21:26:51.570 INFO:tasks.workunit.client.1.smithi154.stdout:0/716: fdatasync d6/dc/f66 0 2024-05-06T21:26:51.570 INFO:tasks.workunit.client.1.smithi154.stdout:5/617: rmdir d2/d3/d19 39 2024-05-06T21:26:51.571 INFO:tasks.workunit.client.1.smithi154.stdout:5/618: dread - d2/d3/d21/d95/dc/d68/d69/fc2 zero size 2024-05-06T21:26:51.571 INFO:tasks.workunit.client.1.smithi154.stdout:5/619: write d2/d3/d21/d95/dc/d71/f75 [3941373,94457] 0 2024-05-06T21:26:51.571 INFO:tasks.workunit.client.0.smithi032.stdout:3/945: write d1/d4/da/d1d/fb5 [3192642,65618] 0 2024-05-06T21:26:51.573 INFO:tasks.workunit.client.1.smithi154.stdout:7/470: rename d6/d42/d6c/d6e/d21/c43 to d6/d42/d6c/d6e/c95 0 2024-05-06T21:26:51.575 INFO:tasks.workunit.client.0.smithi032.stdout:3/946: rename d1/f14 to d1/d4/da/d31/d9b/d121/d134/d45/f137 0 2024-05-06T21:26:51.575 INFO:tasks.workunit.client.0.smithi032.stdout:7/880: write db/d12/d16/d2a/f5a [7889874,6758] 0 2024-05-06T21:26:51.576 INFO:tasks.workunit.client.1.smithi154.stdout:0/717: creat d6/dc/d40/d85/fec x:0 0 0 2024-05-06T21:26:51.576 INFO:tasks.workunit.client.1.smithi154.stdout:0/718: chown d6/dc/d40/d85/db2 1754 1 2024-05-06T21:26:51.577 INFO:tasks.workunit.client.0.smithi032.stdout:3/947: mknod d1/d4/da/d31/d9b/d121/d134/d43/c138 0 2024-05-06T21:26:51.579 INFO:tasks.workunit.client.0.smithi032.stdout:7/881: creat db/d12/d16/d21/d41/f115 x:0 0 0 2024-05-06T21:26:51.580 INFO:tasks.workunit.client.1.smithi154.stdout:5/620: link d2/d3/d21/d95/dd/l87 d2/d3/d19/dbe/ld3 0 2024-05-06T21:26:51.580 INFO:tasks.workunit.client.1.smithi154.stdout:1/644: dread d6/db/d10/fa9 [0,4194304] 0 2024-05-06T21:26:51.580 INFO:tasks.workunit.client.1.smithi154.stdout:5/621: creat d2/d3/d21/d95/dd/d2a/d54/d43/d73/fd4 x:0 0 0 2024-05-06T21:26:51.581 INFO:tasks.workunit.client.1.smithi154.stdout:0/719: creat d6/dc/d40/d4a/d6c/dce/fed x:0 0 0 2024-05-06T21:26:51.581 INFO:tasks.workunit.client.1.smithi154.stdout:0/720: write d6/fca [4726140,122450] 0 2024-05-06T21:26:51.581 INFO:tasks.workunit.client.0.smithi032.stdout:7/882: getdents db/d12/d16/d2a/d39/d3b/d96/dcd 0 2024-05-06T21:26:51.581 INFO:tasks.workunit.client.1.smithi154.stdout:7/471: dread d6/d54/f58 [0,4194304] 0 2024-05-06T21:26:51.582 INFO:tasks.workunit.client.0.smithi032.stdout:7/883: dread db/d12/d16/d21/d41/d4b/f68 [0,4194304] 0 2024-05-06T21:26:51.583 INFO:tasks.workunit.client.1.smithi154.stdout:1/645: symlink d6/db/d69/d89/dac/lc3 0 2024-05-06T21:26:51.584 INFO:tasks.workunit.client.1.smithi154.stdout:5/622: creat d2/d3/d21/d22/fd5 x:0 0 0 2024-05-06T21:26:51.584 INFO:tasks.workunit.client.1.smithi154.stdout:5/623: write d2/d3/d21/d95/dc/d71/f81 [3662275,92366] 0 2024-05-06T21:26:51.584 INFO:tasks.workunit.client.1.smithi154.stdout:5/624: chown d2/d3/d21/d95/dd/d2a/dbb 46951 1 2024-05-06T21:26:51.585 INFO:tasks.workunit.client.0.smithi032.stdout:7/884: creat db/d12/d16/d2a/d39/d3b/d111/f116 x:0 0 0 2024-05-06T21:26:51.585 INFO:tasks.workunit.client.0.smithi032.stdout:7/885: write db/d12/d16/d21/d41/d78/fb3 [1764778,12368] 0 2024-05-06T21:26:51.585 INFO:tasks.workunit.client.1.smithi154.stdout:7/472: mknod d6/d20/d85/c96 0 2024-05-06T21:26:51.587 INFO:tasks.workunit.client.0.smithi032.stdout:7/886: dread db/d12/d87/fc2 [0,4194304] 0 2024-05-06T21:26:51.587 INFO:tasks.workunit.client.1.smithi154.stdout:8/524: dwrite d3/d14/d1a/d29/d68/f3a [0,4194304] 0 2024-05-06T21:26:51.588 INFO:tasks.workunit.client.0.smithi032.stdout:7/887: rmdir db/d12/d87/db5 39 2024-05-06T21:26:51.589 INFO:tasks.workunit.client.1.smithi154.stdout:7/473: symlink d6/d42/d6c/d6e/d21/d69/l97 0 2024-05-06T21:26:51.589 INFO:tasks.workunit.client.1.smithi154.stdout:8/525: rmdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d 39 2024-05-06T21:26:51.590 INFO:tasks.workunit.client.0.smithi032.stdout:7/888: getdents db/d12/d16/d21/d103 0 2024-05-06T21:26:51.591 INFO:tasks.workunit.client.1.smithi154.stdout:8/526: mknod d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/cab 0 2024-05-06T21:26:51.591 INFO:tasks.workunit.client.1.smithi154.stdout:8/527: chown d3/d14/c35 10 1 2024-05-06T21:26:51.592 INFO:tasks.workunit.client.0.smithi032.stdout:7/889: mkdir db/d12/de9/d117 0 2024-05-06T21:26:51.593 INFO:tasks.workunit.client.1.smithi154.stdout:8/528: unlink d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f60 0 2024-05-06T21:26:51.593 INFO:tasks.workunit.client.1.smithi154.stdout:8/529: chown d3/d14/d1a/d29/d32/d40/d79/f4e 12058 1 2024-05-06T21:26:51.593 INFO:tasks.workunit.client.0.smithi032.stdout:5/859: dread d0/d28/f33 [0,4194304] 0 2024-05-06T21:26:51.593 INFO:tasks.workunit.client.0.smithi032.stdout:7/890: write db/d12/d16/d21/dcb/dd7/f105 [444813,88502] 0 2024-05-06T21:26:51.594 INFO:tasks.workunit.client.1.smithi154.stdout:8/530: truncate d3/fd 1002785 0 2024-05-06T21:26:51.595 INFO:tasks.workunit.client.0.smithi032.stdout:7/891: mkdir db/d12/d16/d2a/d39/d3b/d96/d118 0 2024-05-06T21:26:51.595 INFO:tasks.workunit.client.0.smithi032.stdout:7/892: read db/d12/d16/f3f [1579951,17658] 0 2024-05-06T21:26:51.595 INFO:tasks.workunit.client.0.smithi032.stdout:7/893: fdatasync db/d12/d49/f4d 0 2024-05-06T21:26:51.595 INFO:tasks.workunit.client.0.smithi032.stdout:7/894: readlink l4 0 2024-05-06T21:26:51.595 INFO:tasks.workunit.client.0.smithi032.stdout:7/895: chown db/d89/d107 182 1 2024-05-06T21:26:51.597 INFO:tasks.workunit.client.0.smithi032.stdout:7/896: rename db/d12/d16/d21/d103/l112 to db/d12/d16/da1/l119 0 2024-05-06T21:26:51.597 INFO:tasks.workunit.client.0.smithi032.stdout:7/897: fsync db/d12/d16/d21/dcb/dd7/fe4 0 2024-05-06T21:26:51.598 INFO:tasks.workunit.client.1.smithi154.stdout:8/531: creat d3/d14/d1a/d29/da3/fac x:0 0 0 2024-05-06T21:26:51.598 INFO:tasks.workunit.client.1.smithi154.stdout:8/532: getdents d3/d14/d1a/d6e 0 2024-05-06T21:26:51.598 INFO:tasks.workunit.client.1.smithi154.stdout:8/533: write d3/d14/f19 [6876044,2648] 0 2024-05-06T21:26:51.599 INFO:tasks.workunit.client.0.smithi032.stdout:9/907: dwrite d1/d2f/fcf [0,4194304] 0 2024-05-06T21:26:51.599 INFO:tasks.workunit.client.0.smithi032.stdout:9/908: read d1/d13/d34/f43 [1862549,66316] 0 2024-05-06T21:26:51.601 INFO:tasks.workunit.client.0.smithi032.stdout:9/909: truncate d1/d13/d34/d26/f29 5270394 0 2024-05-06T21:26:51.601 INFO:tasks.workunit.client.1.smithi154.stdout:8/534: creat d3/d14/d1a/d29/d32/d40/d59/d67/da7/fad x:0 0 0 2024-05-06T21:26:51.601 INFO:tasks.workunit.client.1.smithi154.stdout:8/535: fdatasync d3/d14/d1a/d45/f93 0 2024-05-06T21:26:51.614 INFO:tasks.workunit.client.0.smithi032.stdout:4/988: dwrite d2/d16/d44/d74/d79/d88/dd6/f101 [0,4194304] 0 2024-05-06T21:26:51.614 INFO:tasks.workunit.client.0.smithi032.stdout:0/802: dwrite d4/da/d16/f2c [4194304,4194304] 0 2024-05-06T21:26:51.614 INFO:tasks.workunit.client.0.smithi032.stdout:0/803: chown d4/d3e/d63 143 1 2024-05-06T21:26:51.614 INFO:tasks.workunit.client.0.smithi032.stdout:0/804: write d4/d3e/d42/fee [734073,118570] 0 2024-05-06T21:26:51.616 INFO:tasks.workunit.client.0.smithi032.stdout:0/805: symlink d4/d3e/l105 0 2024-05-06T21:26:51.617 INFO:tasks.workunit.client.0.smithi032.stdout:0/806: truncate d4/da/d16/d33/d9e/fb7 961899 0 2024-05-06T21:26:51.617 INFO:tasks.workunit.client.0.smithi032.stdout:0/807: write d4/fe2 [647065,112455] 0 2024-05-06T21:26:51.618 INFO:tasks.workunit.client.0.smithi032.stdout:0/808: mknod d4/d3e/d63/c106 0 2024-05-06T21:26:51.618 INFO:tasks.workunit.client.0.smithi032.stdout:0/809: creat d4/da/d14/d1a/d66/f107 x:0 0 0 2024-05-06T21:26:51.619 INFO:tasks.workunit.client.0.smithi032.stdout:0/810: mkdir d4/da/d16/d33/d108 0 2024-05-06T21:26:51.619 INFO:tasks.workunit.client.0.smithi032.stdout:0/811: creat d4/da/d16/d33/d9e/dcf/f109 x:0 0 0 2024-05-06T21:26:51.619 INFO:tasks.workunit.client.0.smithi032.stdout:0/812: write d4/fe2 [1532354,78437] 0 2024-05-06T21:26:51.621 INFO:tasks.workunit.client.0.smithi032.stdout:0/813: rename d4/d3e/d42/fee to d4/da/d16/d33/d9e/dc9/dcb/f10a 0 2024-05-06T21:26:51.622 INFO:tasks.workunit.client.0.smithi032.stdout:0/814: creat d4/d3e/f10b x:0 0 0 2024-05-06T21:26:51.623 INFO:tasks.workunit.client.0.smithi032.stdout:0/815: rmdir d4/da/d16/d33/da7/dbd/dfb 0 2024-05-06T21:26:51.624 INFO:tasks.workunit.client.0.smithi032.stdout:0/816: link d4/da/d16/d33/f57 d4/d3e/d63/d6c/df1/f10c 0 2024-05-06T21:26:51.625 INFO:tasks.workunit.client.0.smithi032.stdout:0/817: read d4/da/d16/fb3 [161256,10848] 0 2024-05-06T21:26:51.626 INFO:tasks.workunit.client.0.smithi032.stdout:4/989: dwrite d2/d2c/f126 [0,4194304] 0 2024-05-06T21:26:51.627 INFO:tasks.workunit.client.0.smithi032.stdout:0/818: dread d4/d3e/d63/d6c/f86 [0,4194304] 0 2024-05-06T21:26:51.627 INFO:tasks.workunit.client.0.smithi032.stdout:0/819: creat d4/da/d14/d4a/f10d x:0 0 0 2024-05-06T21:26:51.627 INFO:tasks.workunit.client.0.smithi032.stdout:1/803: dwrite db/d47/d4a/da4/f50 [0,4194304] 0 2024-05-06T21:26:51.631 INFO:tasks.workunit.client.0.smithi032.stdout:0/820: link d4/da/d14/f47 d4/da/d16/d4f/f10e 0 2024-05-06T21:26:51.635 INFO:tasks.workunit.client.0.smithi032.stdout:1/804: rename db/d47/d4a/da4/f79 to db/d47/d4a/dcb/df1/f101 0 2024-05-06T21:26:51.637 INFO:tasks.workunit.client.1.smithi154.stdout:4/555: dwrite d0/d10/d11/d1a/d7e/f90 [0,4194304] 0 2024-05-06T21:26:51.637 INFO:tasks.workunit.client.1.smithi154.stdout:9/682: dwrite d5/d14/d3a/fa1 [0,4194304] 0 2024-05-06T21:26:51.638 INFO:tasks.workunit.client.1.smithi154.stdout:0/721: dwrite d6/dc/d40/d85/fec [0,4194304] 0 2024-05-06T21:26:51.638 INFO:tasks.workunit.client.1.smithi154.stdout:0/722: fsync d6/d27/f69 0 2024-05-06T21:26:51.638 INFO:tasks.workunit.client.0.smithi032.stdout:0/821: creat d4/da/d16/d33/d9e/dc9/f10f x:0 0 0 2024-05-06T21:26:51.639 INFO:tasks.workunit.client.1.smithi154.stdout:7/474: dwrite d6/d46/d5c/f8d [0,4194304] 0 2024-05-06T21:26:51.639 INFO:tasks.workunit.client.1.smithi154.stdout:7/475: chown d6/d20/d85 15426880 1 2024-05-06T21:26:51.639 INFO:tasks.workunit.client.0.smithi032.stdout:5/860: dwrite d0/d16/d2a/d5f/d9a/f97 [0,4194304] 0 2024-05-06T21:26:51.639 INFO:tasks.workunit.client.0.smithi032.stdout:5/861: read d0/d24/d38/fd5 [4022200,17180] 0 2024-05-06T21:26:51.640 INFO:tasks.workunit.client.0.smithi032.stdout:9/910: dwrite d1/d13/d33/d3f/d60/fbd [0,4194304] 0 2024-05-06T21:26:51.640 INFO:tasks.workunit.client.0.smithi032.stdout:9/911: write d1/d2f/da1/dc2/d64/ddf/fe0 [67060,61034] 0 2024-05-06T21:26:51.641 INFO:tasks.workunit.client.0.smithi032.stdout:4/990: write d2/d16/d44/d74/d79/d88/dd6/f101 [3647405,60570] 0 2024-05-06T21:26:51.642 INFO:tasks.workunit.client.0.smithi032.stdout:0/822: mkdir d4/d110 0 2024-05-06T21:26:51.643 INFO:tasks.workunit.client.0.smithi032.stdout:0/823: fdatasync d4/d3e/d63/dca/f52 0 2024-05-06T21:26:51.643 INFO:tasks.workunit.client.0.smithi032.stdout:0/824: truncate d4/d3e/d63/d6c/d8f/dc2/fff 481250 0 2024-05-06T21:26:51.646 INFO:tasks.workunit.client.1.smithi154.stdout:4/556: link d0/d82/d44/f68 d0/d82/d39/da6/fba 0 2024-05-06T21:26:51.646 INFO:tasks.workunit.client.1.smithi154.stdout:4/557: fsync d0/d10/d11/d1a/d7e/f90 0 2024-05-06T21:26:51.646 INFO:tasks.workunit.client.0.smithi032.stdout:5/862: symlink d0/d16/d2a/d52/l10b 0 2024-05-06T21:26:51.647 INFO:tasks.workunit.client.1.smithi154.stdout:9/683: mkdir d5/d2e/dee 0 2024-05-06T21:26:51.649 INFO:tasks.workunit.client.0.smithi032.stdout:9/912: symlink d1/d13/d33/da6/l133 0 2024-05-06T21:26:51.651 INFO:tasks.workunit.client.1.smithi154.stdout:7/476: write d6/f1a [2595292,58581] 0 2024-05-06T21:26:51.654 INFO:tasks.workunit.client.0.smithi032.stdout:0/825: symlink d4/da/d14/d4a/l111 0 2024-05-06T21:26:51.654 INFO:tasks.workunit.client.0.smithi032.stdout:0/826: write d4/da/d14/d1a/fa4 [338318,109618] 0 2024-05-06T21:26:51.654 INFO:tasks.workunit.client.0.smithi032.stdout:0/827: chown d4/da 41277072 1 2024-05-06T21:26:51.654 INFO:tasks.workunit.client.0.smithi032.stdout:0/828: write d4/da/d16/f53 [1493496,83872] 0 2024-05-06T21:26:51.654 INFO:tasks.workunit.client.1.smithi154.stdout:4/558: getdents d0/d82/d44/d73/d4a 0 2024-05-06T21:26:51.655 INFO:tasks.workunit.client.0.smithi032.stdout:5/863: creat d0/d16/d2f/d77/d99/f10c x:0 0 0 2024-05-06T21:26:51.655 INFO:tasks.workunit.client.1.smithi154.stdout:4/559: read d0/d2/fa [15901,38375] 0 2024-05-06T21:26:51.658 INFO:tasks.workunit.client.0.smithi032.stdout:1/805: dwrite db/d37/f69 [4194304,4194304] 0 2024-05-06T21:26:51.658 INFO:tasks.workunit.client.0.smithi032.stdout:1/806: chown db/d16/d46/d57/d58/c77 61 1 2024-05-06T21:26:51.658 INFO:tasks.workunit.client.0.smithi032.stdout:4/991: rmdir d2/d16/d44/d45/d4e 39 2024-05-06T21:26:51.658 INFO:tasks.workunit.client.0.smithi032.stdout:4/992: dread - d2/d16/d44/d45/f11c zero size 2024-05-06T21:26:51.659 INFO:tasks.workunit.client.1.smithi154.stdout:7/477: mknod d6/d54/c98 0 2024-05-06T21:26:51.659 INFO:tasks.workunit.client.1.smithi154.stdout:7/478: fsync d6/d42/d6c/d6e/d21/d69/f78 0 2024-05-06T21:26:51.659 INFO:tasks.workunit.client.1.smithi154.stdout:4/560: dread d0/f23 [0,4194304] 0 2024-05-06T21:26:51.659 INFO:tasks.workunit.client.1.smithi154.stdout:4/561: stat d0/d10/l33 0 2024-05-06T21:26:51.659 INFO:tasks.workunit.client.1.smithi154.stdout:4/562: stat d0 0 2024-05-06T21:26:51.662 INFO:tasks.workunit.client.1.smithi154.stdout:4/563: mkdir d0/d72/d76/dbb 0 2024-05-06T21:26:51.662 INFO:tasks.workunit.client.1.smithi154.stdout:4/564: stat d0/fa2 0 2024-05-06T21:26:51.665 INFO:tasks.workunit.client.0.smithi032.stdout:4/993: mknod d2/d2c/c13e 0 2024-05-06T21:26:51.665 INFO:tasks.workunit.client.0.smithi032.stdout:4/994: write d2/d16/d44/d45/f6d [4012442,50768] 0 2024-05-06T21:26:51.668 INFO:tasks.workunit.client.1.smithi154.stdout:8/536: write d3/fb [1465404,5642] 0 2024-05-06T21:26:51.671 INFO:tasks.workunit.client.1.smithi154.stdout:8/537: symlink d3/d14/d1a/d29/d32/d40/d59/d67/da7/lae 0 2024-05-06T21:26:51.672 INFO:tasks.workunit.client.0.smithi032.stdout:5/864: write d0/d24/d38/f9c [850583,121563] 0 2024-05-06T21:26:51.679 INFO:tasks.workunit.client.0.smithi032.stdout:9/913: dwrite d1/d13/d33/d5e/f126 [0,4194304] 0 2024-05-06T21:26:51.679 INFO:tasks.workunit.client.0.smithi032.stdout:9/914: write d1/d13/f16 [8194596,633] 0 2024-05-06T21:26:51.680 INFO:tasks.workunit.client.1.smithi154.stdout:7/479: dwrite d6/d42/d6c/d6e/f76 [0,4194304] 0 2024-05-06T21:26:51.682 INFO:tasks.workunit.client.0.smithi032.stdout:9/915: dread d1/d2f/da1/dc2/d59/f86 [0,4194304] 0 2024-05-06T21:26:51.682 INFO:tasks.workunit.client.1.smithi154.stdout:4/565: getdents d0/d72/d76 0 2024-05-06T21:26:51.683 INFO:tasks.workunit.client.1.smithi154.stdout:4/566: chown d0/c1f 1078688600 1 2024-05-06T21:26:51.683 INFO:tasks.workunit.client.0.smithi032.stdout:7/898: rmdir db/d12/d16/d21/d103 0 2024-05-06T21:26:51.684 INFO:tasks.workunit.client.0.smithi032.stdout:1/807: rmdir db 39 2024-05-06T21:26:51.684 INFO:tasks.workunit.client.0.smithi032.stdout:1/808: fdatasync db/d37/f69 0 2024-05-06T21:26:51.686 INFO:tasks.workunit.client.1.smithi154.stdout:4/567: truncate d0/d82/d44/d73/f2c 3653098 0 2024-05-06T21:26:51.686 INFO:tasks.workunit.client.1.smithi154.stdout:4/568: chown d0/d10/d11/d1a/f28 126935159 1 2024-05-06T21:26:51.687 INFO:tasks.workunit.client.1.smithi154.stdout:4/569: write d0/d2/dc/f26 [867651,92719] 0 2024-05-06T21:26:51.689 INFO:tasks.workunit.client.1.smithi154.stdout:4/570: chown d0/d10/d11/d1a/d50/c59 16452 1 2024-05-06T21:26:51.690 INFO:tasks.workunit.client.1.smithi154.stdout:4/571: mkdir d0/d72/d76/db5/db7/dbc 0 2024-05-06T21:26:51.692 INFO:tasks.workunit.client.1.smithi154.stdout:4/572: mkdir d0/d2/dbd 0 2024-05-06T21:26:51.692 INFO:tasks.workunit.client.1.smithi154.stdout:4/573: write d0/d2/d29/fa5 [97383,128847] 0 2024-05-06T21:26:51.694 INFO:tasks.workunit.client.0.smithi032.stdout:5/865: mkdir d0/d16/d2a/d5f/d10d 0 2024-05-06T21:26:51.694 INFO:tasks.workunit.client.0.smithi032.stdout:5/866: fsync d0/d24/d38/d37/d7b/fc2 0 2024-05-06T21:26:51.699 INFO:tasks.workunit.client.0.smithi032.stdout:0/829: truncate d4/da/d16/d33/d9e/fb7 93420 0 2024-05-06T21:26:51.700 INFO:tasks.workunit.client.0.smithi032.stdout:0/830: dread d4/d3e/d63/d6c/f86 [0,4194304] 0 2024-05-06T21:26:51.702 INFO:tasks.workunit.client.0.smithi032.stdout:9/916: mkdir d1/d13/d34/d26/d39/d8b/df1/d134 0 2024-05-06T21:26:51.702 INFO:tasks.workunit.client.0.smithi032.stdout:9/917: creat d1/d13/d33/d3f/f135 x:0 0 0 2024-05-06T21:26:51.702 INFO:tasks.workunit.client.0.smithi032.stdout:9/918: creat d1/d13/d33/d5e/d78/f136 x:0 0 0 2024-05-06T21:26:51.702 INFO:tasks.workunit.client.0.smithi032.stdout:9/919: write d1/d13/d33/d3f/f53 [27412,125486] 0 2024-05-06T21:26:51.704 INFO:tasks.workunit.client.0.smithi032.stdout:1/809: unlink db/d16/d46/d57/l60 0 2024-05-06T21:26:51.704 INFO:tasks.workunit.client.0.smithi032.stdout:1/810: read db/f1f [1662958,109118] 0 2024-05-06T21:26:51.705 INFO:tasks.workunit.client.1.smithi154.stdout:8/538: dwrite d3/f7a [0,4194304] 0 2024-05-06T21:26:51.705 INFO:tasks.workunit.client.1.smithi154.stdout:7/480: dwrite d6/d42/d6c/d6e/d23/f28 [0,4194304] 0 2024-05-06T21:26:51.706 INFO:tasks.workunit.client.0.smithi032.stdout:5/867: rename d0/d16/d2a/d5f/fd4 to d0/d16/d79/d105/f10e 0 2024-05-06T21:26:51.706 INFO:tasks.workunit.client.0.smithi032.stdout:5/868: write d0/d24/d38/d37/d70/fb2 [502203,78693] 0 2024-05-06T21:26:51.707 INFO:tasks.workunit.client.0.smithi032.stdout:0/831: symlink d4/da/d14/d1a/d66/d8a/dd0/l112 0 2024-05-06T21:26:51.708 INFO:tasks.workunit.client.1.smithi154.stdout:4/574: read d0/d2/f2b [8341787,114705] 0 2024-05-06T21:26:51.708 INFO:tasks.workunit.client.0.smithi032.stdout:7/899: write db/f1e [1671930,97266] 0 2024-05-06T21:26:51.708 INFO:tasks.workunit.client.0.smithi032.stdout:7/900: write db/d12/d16/d2a/d39/f114 [396652,102973] 0 2024-05-06T21:26:51.710 INFO:tasks.workunit.client.1.smithi154.stdout:8/539: symlink d3/d14/d1a/d6e/laf 0 2024-05-06T21:26:51.710 INFO:tasks.workunit.client.1.smithi154.stdout:7/481: truncate d6/d42/d6c/d6e/f31 1442700 0 2024-05-06T21:26:51.710 INFO:tasks.workunit.client.1.smithi154.stdout:7/482: stat d6/d42/d6c/d6e/d23/c3a 0 2024-05-06T21:26:51.712 INFO:tasks.workunit.client.1.smithi154.stdout:4/575: creat d0/d2/d47/fbe x:0 0 0 2024-05-06T21:26:51.714 INFO:tasks.workunit.client.1.smithi154.stdout:7/483: truncate d6/fb 4144087 0 2024-05-06T21:26:51.718 INFO:tasks.workunit.client.0.smithi032.stdout:1/811: rename db/d47/d4a/dcb/fe4 to db/d16/d5d/db2/f102 0 2024-05-06T21:26:51.720 INFO:tasks.workunit.client.0.smithi032.stdout:5/869: symlink d0/d16/d46/da9/dea/l10f 0 2024-05-06T21:26:51.724 INFO:tasks.workunit.client.0.smithi032.stdout:7/901: readlink db/d12/d16/d21/d84/l95 0 2024-05-06T21:26:51.726 INFO:tasks.workunit.client.0.smithi032.stdout:1/812: rename db/d16/d5d/fd4 to db/d37/d93/dce/f103 0 2024-05-06T21:26:51.726 INFO:tasks.workunit.client.0.smithi032.stdout:1/813: fsync db/d16/d46/f96 0 2024-05-06T21:26:51.727 INFO:tasks.workunit.client.1.smithi154.stdout:7/484: dread d6/d20/f1b [4194304,4194304] 0 2024-05-06T21:26:51.728 INFO:tasks.workunit.client.0.smithi032.stdout:1/814: symlink db/d37/d52/l104 0 2024-05-06T21:26:51.729 INFO:tasks.workunit.client.0.smithi032.stdout:1/815: chown db/d16/d46/d57/d58/d68/c9a 147487 1 2024-05-06T21:26:51.729 INFO:tasks.workunit.client.0.smithi032.stdout:1/816: write db/d16/d46/d57/f71 [448342,57732] 0 2024-05-06T21:26:51.731 INFO:tasks.workunit.client.0.smithi032.stdout:1/817: creat db/d16/d46/f105 x:0 0 0 2024-05-06T21:26:51.731 INFO:tasks.workunit.client.0.smithi032.stdout:1/818: stat db/d16/d5d 0 2024-05-06T21:26:51.731 INFO:tasks.workunit.client.0.smithi032.stdout:7/902: dread db/d12/d16/d21/dcb/f113 [0,4194304] 0 2024-05-06T21:26:51.733 INFO:tasks.workunit.client.0.smithi032.stdout:5/870: rename d0/d4e to d0/d16/d2a/d5f/dd6/d106/d110 0 2024-05-06T21:26:51.734 INFO:tasks.workunit.client.0.smithi032.stdout:7/903: creat db/d12/d16/f11a x:0 0 0 2024-05-06T21:26:51.736 INFO:tasks.workunit.client.0.smithi032.stdout:1/819: rename db/d16/d5d/db2/cff to db/d47/d4a/c106 0 2024-05-06T21:26:51.736 INFO:tasks.workunit.client.0.smithi032.stdout:5/871: chown d0/c7 3030727 1 2024-05-06T21:26:51.737 INFO:tasks.workunit.client.0.smithi032.stdout:1/820: mknod db/d16/d5d/c107 0 2024-05-06T21:26:51.738 INFO:tasks.workunit.client.0.smithi032.stdout:1/821: write db/d47/fc7 [475768,97545] 0 2024-05-06T21:26:51.738 INFO:tasks.workunit.client.0.smithi032.stdout:1/822: chown db/d16/d46/d55/f6a 5048287 1 2024-05-06T21:26:51.738 INFO:tasks.workunit.client.0.smithi032.stdout:5/872: mkdir d0/d16/d2a/d59/d111 0 2024-05-06T21:26:51.740 INFO:tasks.workunit.client.1.smithi154.stdout:7/485: dread d6/d46/d5c/f8d [0,4194304] 0 2024-05-06T21:26:51.741 INFO:tasks.workunit.client.1.smithi154.stdout:7/486: symlink d6/d42/d6c/d6e/d23/l99 0 2024-05-06T21:26:51.742 INFO:tasks.workunit.client.0.smithi032.stdout:9/920: dwrite d1/f23 [0,4194304] 0 2024-05-06T21:26:51.742 INFO:tasks.workunit.client.0.smithi032.stdout:5/873: rename d0/d28 to d0/d16/d2a/d5f/d10d/d112 0 2024-05-06T21:26:51.744 INFO:tasks.workunit.client.0.smithi032.stdout:9/921: getdents d1/d2f/da1/dc2/da0 0 2024-05-06T21:26:51.744 INFO:tasks.workunit.client.1.smithi154.stdout:7/487: rename d6/d20/c18 to d6/c9a 0 2024-05-06T21:26:51.744 INFO:tasks.workunit.client.1.smithi154.stdout:7/488: stat d6/d42/d6c/d6e/c3f 0 2024-05-06T21:26:51.745 INFO:tasks.workunit.client.0.smithi032.stdout:5/874: creat d0/d16/d2a/dc7/dd2/db1/ded/f113 x:0 0 0 2024-05-06T21:26:51.746 INFO:tasks.workunit.client.0.smithi032.stdout:0/832: dwrite d4/f24 [0,4194304] 0 2024-05-06T21:26:51.746 INFO:tasks.workunit.client.0.smithi032.stdout:0/833: write d4/da/d14/d1a/d66/f107 [23613,38809] 0 2024-05-06T21:26:51.747 INFO:tasks.workunit.client.0.smithi032.stdout:5/875: truncate d0/d16/d46/da9/fc8 707809 0 2024-05-06T21:26:51.747 INFO:tasks.workunit.client.0.smithi032.stdout:5/876: write d0/d16/d2a/dc7/dd2/db1/fdc [566360,24761] 0 2024-05-06T21:26:51.747 INFO:tasks.workunit.client.0.smithi032.stdout:5/877: readlink d0/d16/d2a/d5f/lff 0 2024-05-06T21:26:51.748 INFO:tasks.workunit.client.1.smithi154.stdout:4/576: dwrite d0/d82/d39/d63/f9e [0,4194304] 0 2024-05-06T21:26:51.748 INFO:tasks.workunit.client.1.smithi154.stdout:4/577: write d0/d2/f4c [628417,29300] 0 2024-05-06T21:26:51.752 INFO:tasks.workunit.client.0.smithi032.stdout:0/834: creat d4/da/d16/d33/f113 x:0 0 0 2024-05-06T21:26:51.753 INFO:tasks.workunit.client.0.smithi032.stdout:5/878: mkdir d0/d16/d114 0 2024-05-06T21:26:51.753 INFO:tasks.workunit.client.0.smithi032.stdout:0/835: dread d4/f24 [4194304,4194304] 0 2024-05-06T21:26:51.753 INFO:tasks.workunit.client.1.smithi154.stdout:4/578: link d0/d82/d44/d73/d4a/d74/f85 d0/d2/d47/fbf 0 2024-05-06T21:26:51.753 INFO:tasks.workunit.client.1.smithi154.stdout:4/579: creat d0/d10/fc0 x:0 0 0 2024-05-06T21:26:51.753 INFO:tasks.workunit.client.1.smithi154.stdout:4/580: stat d0/d82/d39/f4b 0 2024-05-06T21:26:51.754 INFO:tasks.workunit.client.1.smithi154.stdout:4/581: dread d0/d2/fa [0,4194304] 0 2024-05-06T21:26:51.754 INFO:tasks.workunit.client.0.smithi032.stdout:5/879: mkdir d0/d16/d2a/dc7/dd2/de1/d115 0 2024-05-06T21:26:51.755 INFO:tasks.workunit.client.1.smithi154.stdout:2/565: sync 2024-05-06T21:26:51.755 INFO:tasks.workunit.client.1.smithi154.stdout:3/752: sync 2024-05-06T21:26:51.755 INFO:tasks.workunit.client.1.smithi154.stdout:6/462: sync 2024-05-06T21:26:51.757 INFO:tasks.workunit.client.1.smithi154.stdout:2/566: mkdir db/d12/d19/d4b/db2 0 2024-05-06T21:26:51.757 INFO:tasks.workunit.client.0.smithi032.stdout:0/836: link d4/da/d16/d33/cf3 d4/da/d14/d1a/d66/c114 0 2024-05-06T21:26:51.760 INFO:tasks.workunit.client.0.smithi032.stdout:5/880: link d0/d16/d2a/d5f/dca/f92 d0/d24/d38/f116 0 2024-05-06T21:26:51.761 INFO:tasks.workunit.client.0.smithi032.stdout:5/881: dread - d0/d16/d79/d105/f10e zero size 2024-05-06T21:26:51.761 INFO:tasks.workunit.client.0.smithi032.stdout:5/882: fdatasync d0/f27 0 2024-05-06T21:26:51.761 INFO:tasks.workunit.client.0.smithi032.stdout:5/883: truncate d0/fb 2167522 0 2024-05-06T21:26:51.761 INFO:tasks.workunit.client.0.smithi032.stdout:5/884: truncate d0/d24/d26/f100 374561 0 2024-05-06T21:26:51.761 INFO:tasks.workunit.client.0.smithi032.stdout:0/837: mknod d4/d3e/d63/d6c/d8f/dc2/de4/c115 0 2024-05-06T21:26:51.764 INFO:tasks.workunit.client.0.smithi032.stdout:9/922: write d1/d13/d33/d8e/fe2 [4168558,73606] 0 2024-05-06T21:26:51.764 INFO:tasks.workunit.client.0.smithi032.stdout:9/923: readlink d1/d13/d33/l79 0 2024-05-06T21:26:51.764 INFO:tasks.workunit.client.0.smithi032.stdout:9/924: readlink d1/d2f/d4f/l6f 0 2024-05-06T21:26:51.765 INFO:tasks.workunit.client.0.smithi032.stdout:0/838: read d4/d3e/fbe [102738,110773] 0 2024-05-06T21:26:51.765 INFO:tasks.workunit.client.0.smithi032.stdout:0/839: fdatasync d4/f3f 0 2024-05-06T21:26:51.768 INFO:tasks.workunit.client.1.smithi154.stdout:4/582: dread d0/d10/d11/d1a/f28 [4194304,4194304] 0 2024-05-06T21:26:51.771 INFO:tasks.workunit.client.1.smithi154.stdout:3/753: write d0/da/d1a/dbf/ff5 [1879085,68436] 0 2024-05-06T21:26:51.771 INFO:tasks.workunit.client.1.smithi154.stdout:3/754: write d0/da/d1a/d28/dbc/d81/f74 [953811,2902] 0 2024-05-06T21:26:51.777 INFO:tasks.workunit.client.0.smithi032.stdout:5/885: dread d0/d16/d46/da9/fbd [0,4194304] 0 2024-05-06T21:26:51.779 INFO:tasks.workunit.client.0.smithi032.stdout:5/886: creat d0/d16/d114/f117 x:0 0 0 2024-05-06T21:26:51.779 INFO:tasks.workunit.client.0.smithi032.stdout:5/887: write d0/d16/fce [712860,61007] 0 2024-05-06T21:26:51.783 INFO:tasks.workunit.client.0.smithi032.stdout:5/888: dread d0/d16/f91 [0,4194304] 0 2024-05-06T21:26:51.784 INFO:tasks.workunit.client.0.smithi032.stdout:5/889: creat d0/d16/d2a/d59/d67/d73/da3/f118 x:0 0 0 2024-05-06T21:26:51.784 INFO:tasks.workunit.client.0.smithi032.stdout:5/890: fsync d0/d16/d2a/d5f/d9a/f97 0 2024-05-06T21:26:51.784 INFO:tasks.workunit.client.0.smithi032.stdout:5/891: chown d0/d16/d2a/d59/ca1 103872 1 2024-05-06T21:26:51.784 INFO:tasks.workunit.client.0.smithi032.stdout:5/892: dread - d0/d16/d2a/dc7/dd2/db1/ded/f113 zero size 2024-05-06T21:26:51.784 INFO:tasks.workunit.client.0.smithi032.stdout:5/893: truncate d0/d24/d38/f3c 2486258 0 2024-05-06T21:26:51.784 INFO:tasks.workunit.client.0.smithi032.stdout:5/894: fsync d0/d16/d2a/d5f/dca/fa4 0 2024-05-06T21:26:51.785 INFO:tasks.workunit.client.0.smithi032.stdout:9/925: dread d1/d13/d33/d5e/ff2 [0,4194304] 0 2024-05-06T21:26:51.785 INFO:tasks.workunit.client.1.smithi154.stdout:4/583: dread d0/d2/f2b [0,4194304] 0 2024-05-06T21:26:51.785 INFO:tasks.workunit.client.1.smithi154.stdout:4/584: readlink d0/d82/d39/lb1 0 2024-05-06T21:26:51.786 INFO:tasks.workunit.client.0.smithi032.stdout:5/895: rename d0/d16/d2a/d5f/dca/f45 to d0/d24/d38/d37/d7b/dc0/f119 0 2024-05-06T21:26:51.787 INFO:tasks.workunit.client.1.smithi154.stdout:4/585: symlink d0/d82/d44/d73/d4a/d74/d75/lc1 0 2024-05-06T21:26:51.787 INFO:tasks.workunit.client.0.smithi032.stdout:5/896: mkdir d0/d16/d2a/dc7/dd2/d11a 0 2024-05-06T21:26:51.788 INFO:tasks.workunit.client.1.smithi154.stdout:4/586: getdents d0/d2/dc 0 2024-05-06T21:26:51.788 INFO:tasks.workunit.client.1.smithi154.stdout:3/755: write d0/da/db/dd/fc [3056124,83601] 0 2024-05-06T21:26:51.789 INFO:tasks.workunit.client.1.smithi154.stdout:3/756: truncate d0/da/db/d7c/fb9 800226 0 2024-05-06T21:26:51.789 INFO:tasks.workunit.client.1.smithi154.stdout:3/757: chown d0/da/db/d52/d75/f7b 455857827 1 2024-05-06T21:26:51.789 INFO:tasks.workunit.client.1.smithi154.stdout:3/758: creat d0/da/db/d52/d62/f108 x:0 0 0 2024-05-06T21:26:51.789 INFO:tasks.workunit.client.1.smithi154.stdout:3/759: chown d0/da/db/d52/d75/ceb 60613351 1 2024-05-06T21:26:51.789 INFO:tasks.workunit.client.1.smithi154.stdout:3/760: getdents d0/da/d1a/d28/dbc/d81/d9c 0 2024-05-06T21:26:51.790 INFO:tasks.workunit.client.1.smithi154.stdout:3/761: mknod d0/da/db/d30/c109 0 2024-05-06T21:26:51.792 INFO:tasks.workunit.client.0.smithi032.stdout:5/897: rename d0/d16/d46/d78/d89 to d0/d87/d11b 0 2024-05-06T21:26:51.792 INFO:tasks.workunit.client.1.smithi154.stdout:3/762: unlink d0/da/d1a/d28/la1 0 2024-05-06T21:26:51.793 INFO:tasks.workunit.client.0.smithi032.stdout:7/904: dwrite db/d12/d16/d2a/d39/f10c [0,4194304] 0 2024-05-06T21:26:51.794 INFO:tasks.workunit.client.0.smithi032.stdout:1/823: dwrite db/d16/d46/d57/d58/d68/fcd [0,4194304] 0 2024-05-06T21:26:51.794 INFO:tasks.workunit.client.0.smithi032.stdout:1/824: write db/f1f [7825567,74993] 0 2024-05-06T21:26:51.794 INFO:tasks.workunit.client.0.smithi032.stdout:1/825: write db/d37/feb [794950,16920] 0 2024-05-06T21:26:51.794 INFO:tasks.workunit.client.0.smithi032.stdout:1/826: chown db/d16/d46/f94 51352 1 2024-05-06T21:26:51.794 INFO:tasks.workunit.client.0.smithi032.stdout:1/827: fsync db/d47/d4a/fd1 0 2024-05-06T21:26:51.794 INFO:tasks.workunit.client.0.smithi032.stdout:1/828: chown db/d16/f1b 14679119 1 2024-05-06T21:26:51.794 INFO:tasks.workunit.client.0.smithi032.stdout:1/829: write db/d16/d46/d57/d58/d68/ff6 [925318,33079] 0 2024-05-06T21:26:51.795 INFO:tasks.workunit.client.0.smithi032.stdout:9/926: fdatasync d1/d13/d33/d3f/f53 0 2024-05-06T21:26:51.798 INFO:tasks.workunit.client.1.smithi154.stdout:6/463: dwrite f1 [0,4194304] 0 2024-05-06T21:26:51.798 INFO:tasks.workunit.client.1.smithi154.stdout:2/567: dwrite db/de/d16/d33/f4d [4194304,4194304] 0 2024-05-06T21:26:51.798 INFO:tasks.workunit.client.1.smithi154.stdout:6/464: write d8/d11/f79 [398746,16632] 0 2024-05-06T21:26:51.798 INFO:tasks.workunit.client.0.smithi032.stdout:1/830: getdents db/d47/d4a/da4/da2 0 2024-05-06T21:26:51.798 INFO:tasks.workunit.client.0.smithi032.stdout:1/831: write db/f23 [599543,88482] 0 2024-05-06T21:26:51.799 INFO:tasks.workunit.client.0.smithi032.stdout:9/927: rmdir d1/d2f/da1 39 2024-05-06T21:26:51.801 INFO:tasks.workunit.client.0.smithi032.stdout:9/928: dread d1/d2f/da1/dc2/d64/fc5 [0,4194304] 0 2024-05-06T21:26:51.801 INFO:tasks.workunit.client.0.smithi032.stdout:1/832: write db/d16/f83 [178296,42034] 0 2024-05-06T21:26:51.801 INFO:tasks.workunit.client.0.smithi032.stdout:1/833: stat db/d16/f2c 0 2024-05-06T21:26:51.802 INFO:tasks.workunit.client.0.smithi032.stdout:5/898: write d0/d16/d2a/d5f/d9a/f97 [1234136,18796] 0 2024-05-06T21:26:51.803 INFO:tasks.workunit.client.0.smithi032.stdout:9/929: symlink d1/d2f/l137 0 2024-05-06T21:26:51.804 INFO:tasks.workunit.client.0.smithi032.stdout:1/834: creat db/d47/d4a/da4/d4f/dd0/f108 x:0 0 0 2024-05-06T21:26:51.806 INFO:tasks.workunit.client.1.smithi154.stdout:7/489: dwrite d6/d46/f83 [0,4194304] 0 2024-05-06T21:26:51.806 INFO:tasks.workunit.client.1.smithi154.stdout:7/490: readlink d6/d46/d5c/l90 0 2024-05-06T21:26:51.808 INFO:tasks.workunit.client.0.smithi032.stdout:5/899: creat d0/d16/d46/da9/f11c x:0 0 0 2024-05-06T21:26:51.808 INFO:tasks.workunit.client.0.smithi032.stdout:5/900: chown d0/d16/d2f/l69 6657544 1 2024-05-06T21:26:51.808 INFO:tasks.workunit.client.1.smithi154.stdout:2/568: symlink db/d12/d1d/d60/d95/lb3 0 2024-05-06T21:26:51.808 INFO:tasks.workunit.client.1.smithi154.stdout:2/569: readlink db/d12/d1d/d60/la3 0 2024-05-06T21:26:51.809 INFO:tasks.workunit.client.0.smithi032.stdout:9/930: truncate d1/d13/d34/d26/d39/d45/fa9 2221734 0 2024-05-06T21:26:51.810 INFO:tasks.workunit.client.1.smithi154.stdout:6/465: mkdir d8/d13/d8f 0 2024-05-06T21:26:51.810 INFO:tasks.workunit.client.1.smithi154.stdout:6/466: chown d8/d11/d2d/d3d/d70/c8a 21762 1 2024-05-06T21:26:51.814 INFO:tasks.workunit.client.1.smithi154.stdout:7/491: mknod d6/d46/c9b 0 2024-05-06T21:26:51.814 INFO:tasks.workunit.client.1.smithi154.stdout:7/492: write d6/d42/d6c/f77 [4860386,5814] 0 2024-05-06T21:26:51.814 INFO:tasks.workunit.client.1.smithi154.stdout:2/570: dread db/de/d16/f65 [0,4194304] 0 2024-05-06T21:26:51.814 INFO:tasks.workunit.client.0.smithi032.stdout:1/835: unlink db/d16/c3c 0 2024-05-06T21:26:51.814 INFO:tasks.workunit.client.0.smithi032.stdout:1/836: chown db/d16/f33 172523 1 2024-05-06T21:26:51.815 INFO:tasks.workunit.client.0.smithi032.stdout:7/905: dwrite db/d12/d16/d2a/f42 [0,4194304] 0 2024-05-06T21:26:51.816 INFO:tasks.workunit.client.1.smithi154.stdout:2/571: creat db/d12/d19/d7d/db1/fb4 x:0 0 0 2024-05-06T21:26:51.817 INFO:tasks.workunit.client.1.smithi154.stdout:2/572: write db/de/d16/d4f/f8f [618823,63315] 0 2024-05-06T21:26:51.817 INFO:tasks.workunit.client.1.smithi154.stdout:2/573: fdatasync db/d12/d1d/f64 0 2024-05-06T21:26:51.819 INFO:tasks.workunit.client.1.smithi154.stdout:4/587: dwrite d0/d2/dc/f18 [0,4194304] 0 2024-05-06T21:26:51.819 INFO:tasks.workunit.client.1.smithi154.stdout:4/588: creat d0/d10/d11/d1a/d7e/fc2 x:0 0 0 2024-05-06T21:26:51.819 INFO:tasks.workunit.client.1.smithi154.stdout:3/763: dwrite d0/da/d1a/d28/d17/f49 [0,4194304] 0 2024-05-06T21:26:51.824 INFO:tasks.workunit.client.1.smithi154.stdout:7/493: write d6/f10 [3565154,80326] 0 2024-05-06T21:26:51.824 INFO:tasks.workunit.client.1.smithi154.stdout:4/589: mknod d0/d82/d44/d73/d4a/d74/d75/cc3 0 2024-05-06T21:26:51.824 INFO:tasks.workunit.client.1.smithi154.stdout:4/590: write d0/d82/d44/d73/f5f [856083,59195] 0 2024-05-06T21:26:51.824 INFO:tasks.workunit.client.0.smithi032.stdout:1/837: write db/d16/f32 [1743607,2135] 0 2024-05-06T21:26:51.824 INFO:tasks.workunit.client.0.smithi032.stdout:1/838: chown db/d16/d46/d57/d58/c77 9949 1 2024-05-06T21:26:51.826 INFO:tasks.workunit.client.1.smithi154.stdout:3/764: mkdir d0/da/d1a/d28/dbc/d10a 0 2024-05-06T21:26:51.828 INFO:tasks.workunit.client.1.smithi154.stdout:4/591: creat d0/d2/dc/fc4 x:0 0 0 2024-05-06T21:26:51.828 INFO:tasks.workunit.client.1.smithi154.stdout:4/592: write d0/d2/fb [4881850,25243] 0 2024-05-06T21:26:51.829 INFO:tasks.workunit.client.1.smithi154.stdout:6/467: dwrite d8/d11/d33/d4a/f49 [0,4194304] 0 2024-05-06T21:26:51.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/765: symlink d0/dfa/l10b 0 2024-05-06T21:26:51.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/766: fdatasync d0/da/d1a/d28/d17/db0/f7a 0 2024-05-06T21:26:51.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/767: dread - d0/da/db/d52/d62/fc4 zero size 2024-05-06T21:26:51.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/768: dread - d0/da/db/d52/d62/fde zero size 2024-05-06T21:26:51.831 INFO:tasks.workunit.client.1.smithi154.stdout:3/769: fdatasync d0/da/db/d7c/fa6 0 2024-05-06T21:26:51.832 INFO:tasks.workunit.client.0.smithi032.stdout:5/901: mkdir d0/d16/d2a/dc7/dd2/d11a/d11d 0 2024-05-06T21:26:51.832 INFO:tasks.workunit.client.1.smithi154.stdout:6/468: mknod d8/d13/d20/c90 0 2024-05-06T21:26:51.833 INFO:tasks.workunit.client.1.smithi154.stdout:3/770: mkdir d0/da/d1a/d28/dbc/d81/d9c/d10c 0 2024-05-06T21:26:51.833 INFO:tasks.workunit.client.1.smithi154.stdout:3/771: truncate d0/fea 732027 0 2024-05-06T21:26:51.833 INFO:tasks.workunit.client.1.smithi154.stdout:4/593: dread d0/d2/f4c [0,4194304] 0 2024-05-06T21:26:51.834 INFO:tasks.workunit.client.0.smithi032.stdout:9/931: unlink d1/d13/d34/d26/d39/d45/c100 0 2024-05-06T21:26:51.835 INFO:tasks.workunit.client.0.smithi032.stdout:9/932: chown d1/f12 0 1 2024-05-06T21:26:51.836 INFO:tasks.workunit.client.1.smithi154.stdout:3/772: unlink d0/da/l3f 0 2024-05-06T21:26:51.836 INFO:tasks.workunit.client.1.smithi154.stdout:3/773: readlink d0/da/db/d52/lf3 0 2024-05-06T21:26:51.837 INFO:tasks.workunit.client.1.smithi154.stdout:3/774: chown d0/f2b 83 1 2024-05-06T21:26:51.837 INFO:tasks.workunit.client.1.smithi154.stdout:4/594: write d0/d82/d39/da6/fba [318850,54540] 0 2024-05-06T21:26:51.837 INFO:tasks.workunit.client.1.smithi154.stdout:3/775: creat d0/da/f10d x:0 0 0 2024-05-06T21:26:51.837 INFO:tasks.workunit.client.1.smithi154.stdout:2/574: dwrite db/de/d16/f27 [0,4194304] 0 2024-05-06T21:26:51.838 INFO:tasks.workunit.client.0.smithi032.stdout:7/906: mkdir db/d12/d16/d2a/d39/d3b/d11b 0 2024-05-06T21:26:51.839 INFO:tasks.workunit.client.1.smithi154.stdout:3/776: read d0/da/d1a/d28/d4d/fbe [232305,92300] 0 2024-05-06T21:26:51.840 INFO:tasks.workunit.client.1.smithi154.stdout:7/494: dread d6/f3b [4194304,4194304] 0 2024-05-06T21:26:51.843 INFO:tasks.workunit.client.0.smithi032.stdout:1/839: mknod db/d47/d4a/dcb/c109 0 2024-05-06T21:26:51.843 INFO:tasks.workunit.client.0.smithi032.stdout:1/840: write db/d16/f6d [66339,26772] 0 2024-05-06T21:26:51.845 INFO:tasks.workunit.client.0.smithi032.stdout:5/902: mknod d0/d16/d2a/dc7/c11e 0 2024-05-06T21:26:51.845 INFO:tasks.workunit.client.0.smithi032.stdout:5/903: write d0/d16/d2a/d5f/dca/fe9 [289798,99811] 0 2024-05-06T21:26:51.846 INFO:tasks.workunit.client.0.smithi032.stdout:9/933: truncate d1/d2f/f37 531806 0 2024-05-06T21:26:51.847 INFO:tasks.workunit.client.0.smithi032.stdout:7/907: chown db/d12/d16/d21/cec 7704038 1 2024-05-06T21:26:51.847 INFO:tasks.workunit.client.0.smithi032.stdout:7/908: creat db/d12/d16/d21/dcb/f11c x:0 0 0 2024-05-06T21:26:51.849 INFO:tasks.workunit.client.0.smithi032.stdout:1/841: unlink db/d37/f54 0 2024-05-06T21:26:51.851 INFO:tasks.workunit.client.0.smithi032.stdout:5/904: mkdir d0/d24/d38/d37/df0/d50/d5a/d11f 0 2024-05-06T21:26:51.853 INFO:tasks.workunit.client.1.smithi154.stdout:4/595: write d0/d10/d11/d1a/d7e/f90 [3315317,21168] 0 2024-05-06T21:26:51.854 INFO:tasks.workunit.client.1.smithi154.stdout:6/469: dwrite d8/d13/f28 [0,4194304] 0 2024-05-06T21:26:51.855 INFO:tasks.workunit.client.0.smithi032.stdout:1/842: mkdir db/d16/d46/d10a 0 2024-05-06T21:26:51.856 INFO:tasks.workunit.client.1.smithi154.stdout:7/495: dread d6/d42/d6c/d6e/d23/f6f [0,4194304] 0 2024-05-06T21:26:51.856 INFO:tasks.workunit.client.1.smithi154.stdout:7/496: creat d6/d20/d40/d52/f9c x:0 0 0 2024-05-06T21:26:51.856 INFO:tasks.workunit.client.1.smithi154.stdout:7/497: write d6/f25 [4409054,125042] 0 2024-05-06T21:26:51.856 INFO:tasks.workunit.client.1.smithi154.stdout:7/498: truncate d6/d20/d40/d52/f88 935554 0 2024-05-06T21:26:51.857 INFO:tasks.workunit.client.1.smithi154.stdout:4/596: rmdir d0/d82/d39/d54 39 2024-05-06T21:26:51.857 INFO:tasks.workunit.client.0.smithi032.stdout:5/905: creat d0/d16/d2a/d5f/dd6/d106/f120 x:0 0 0 2024-05-06T21:26:51.859 INFO:tasks.workunit.client.0.smithi032.stdout:5/906: link d0/d16/d2a/d5f/d10d/d112/cf6 d0/d16/d2a/dc7/dd2/de1/d115/c121 0 2024-05-06T21:26:51.860 INFO:tasks.workunit.client.0.smithi032.stdout:9/934: dread d1/d13/d34/d26/d39/d45/f7b [0,4194304] 0 2024-05-06T21:26:51.860 INFO:tasks.workunit.client.0.smithi032.stdout:5/907: dread - d0/d16/d46/da9/f11c zero size 2024-05-06T21:26:51.860 INFO:tasks.workunit.client.0.smithi032.stdout:5/908: write d0/d24/d38/d37/d7b/dc0/fc6 [845930,53612] 0 2024-05-06T21:26:51.860 INFO:tasks.workunit.client.0.smithi032.stdout:5/909: truncate d0/d16/d79/d105/f10e 621206 0 2024-05-06T21:26:51.860 INFO:tasks.workunit.client.1.smithi154.stdout:6/470: rename f1 to d8/d11/d8d/f91 0 2024-05-06T21:26:51.860 INFO:tasks.workunit.client.1.smithi154.stdout:6/471: chown d8/d11/d33/d4a/d6c 27983 1 2024-05-06T21:26:51.862 INFO:tasks.workunit.client.0.smithi032.stdout:9/935: rename d1/d13/d34/d26/d9f/dbe/cde to d1/d13/c138 0 2024-05-06T21:26:51.862 INFO:tasks.workunit.client.0.smithi032.stdout:9/936: write d1/d2f/d4f/d97/f104 [169695,130498] 0 2024-05-06T21:26:51.865 INFO:tasks.workunit.client.1.smithi154.stdout:7/499: mkdir d6/d42/d6c/d6e/d21/d2e/d9d 0 2024-05-06T21:26:51.867 INFO:tasks.workunit.client.1.smithi154.stdout:4/597: truncate d0/d2/dc/fe 5643148 0 2024-05-06T21:26:51.867 INFO:tasks.workunit.client.1.smithi154.stdout:4/598: chown d0/d82/d44/d73/d4a/d74/fa4 197318 1 2024-05-06T21:26:51.868 INFO:tasks.workunit.client.1.smithi154.stdout:6/472: dread f6 [0,4194304] 0 2024-05-06T21:26:51.872 INFO:tasks.workunit.client.1.smithi154.stdout:7/500: getdents d6/d42/d6c/d6e/d21/d69 0 2024-05-06T21:26:51.875 INFO:tasks.workunit.client.1.smithi154.stdout:4/599: unlink d0/c30 0 2024-05-06T21:26:51.876 INFO:tasks.workunit.client.1.smithi154.stdout:6/473: mkdir d8/d11/d33/d92 0 2024-05-06T21:26:51.876 INFO:tasks.workunit.client.0.smithi032.stdout:6/860: sync 2024-05-06T21:26:51.877 INFO:tasks.workunit.client.0.smithi032.stdout:2/782: sync 2024-05-06T21:26:51.877 INFO:tasks.workunit.client.0.smithi032.stdout:3/948: sync 2024-05-06T21:26:51.877 INFO:tasks.workunit.client.0.smithi032.stdout:6/861: readlink d8/dd/d18/lf 0 2024-05-06T21:26:51.878 INFO:tasks.workunit.client.0.smithi032.stdout:4/995: sync 2024-05-06T21:26:51.878 INFO:tasks.workunit.client.0.smithi032.stdout:6/862: stat d8/dd/d18/d13/fa5 0 2024-05-06T21:26:51.878 INFO:tasks.workunit.client.0.smithi032.stdout:6/863: truncate d8/dd/d18/d13/fc6 317326 0 2024-05-06T21:26:51.878 INFO:tasks.workunit.client.0.smithi032.stdout:6/864: read d8/d3d/d73/d87/fb3 [97517,89273] 0 2024-05-06T21:26:51.878 INFO:tasks.workunit.client.0.smithi032.stdout:9/937: dread d1/d13/d33/d5e/f126 [0,4194304] 0 2024-05-06T21:26:51.878 INFO:tasks.workunit.client.0.smithi032.stdout:9/938: dread - d1/d2f/da1/dc2/f74 zero size 2024-05-06T21:26:51.879 INFO:tasks.workunit.client.0.smithi032.stdout:9/939: chown d1/d13/d34/d91/c10f 45439 1 2024-05-06T21:26:51.879 INFO:tasks.workunit.client.0.smithi032.stdout:9/940: chown d1/d13/d33/d3f/d60 434 1 2024-05-06T21:26:51.879 INFO:tasks.workunit.client.0.smithi032.stdout:9/941: chown d1/d2f/da1/dc2/d64/ddf/f103 4232 1 2024-05-06T21:26:51.880 INFO:tasks.workunit.client.1.smithi154.stdout:7/501: truncate d6/d54/f58 4020271 0 2024-05-06T21:26:51.880 INFO:tasks.workunit.client.1.smithi154.stdout:7/502: creat d6/f9e x:0 0 0 2024-05-06T21:26:51.880 INFO:tasks.workunit.client.1.smithi154.stdout:4/600: symlink d0/d72/d76/db5/lc5 0 2024-05-06T21:26:51.880 INFO:tasks.workunit.client.0.smithi032.stdout:2/783: mkdir df/d19/d1e/d42/dc6/dc1/d10e 0 2024-05-06T21:26:51.880 INFO:tasks.workunit.client.0.smithi032.stdout:2/784: creat df/d19/d1e/d71/d5f/d73/f10f x:0 0 0 2024-05-06T21:26:51.881 INFO:tasks.workunit.client.0.smithi032.stdout:2/785: readlink df/d19/d1e/d42/dc6/lb6 0 2024-05-06T21:26:51.881 INFO:tasks.workunit.client.0.smithi032.stdout:2/786: dread - df/d19/d1e/d35/dc5/d2e/d33/faa zero size 2024-05-06T21:26:51.881 INFO:tasks.workunit.client.0.smithi032.stdout:4/996: mkdir d2/d13/daa/db8/de7/d13f 0 2024-05-06T21:26:51.881 INFO:tasks.workunit.client.0.smithi032.stdout:9/942: dread d1/d13/d33/d3f/d60/f7e [0,4194304] 0 2024-05-06T21:26:51.881 INFO:tasks.workunit.client.1.smithi154.stdout:6/474: getdents d8/d11/d33/d4a 0 2024-05-06T21:26:51.882 INFO:tasks.workunit.client.0.smithi032.stdout:2/787: rmdir df/d19/d1e/d71/d5f/d7d/d65 39 2024-05-06T21:26:51.882 INFO:tasks.workunit.client.0.smithi032.stdout:2/788: stat df/d19/d1e/d71/d5f/d7d/d65/lf0 0 2024-05-06T21:26:51.882 INFO:tasks.workunit.client.0.smithi032.stdout:2/789: write df/d19/dbf/fd7 [448936,115506] 0 2024-05-06T21:26:51.882 INFO:tasks.workunit.client.0.smithi032.stdout:2/790: truncate df/d19/d1e/d42/dc6/f101 882607 0 2024-05-06T21:26:51.882 INFO:tasks.workunit.client.0.smithi032.stdout:4/997: creat d2/d2c/d31/d7c/d11d/f140 x:0 0 0 2024-05-06T21:26:51.882 INFO:tasks.workunit.client.0.smithi032.stdout:4/998: read - d2/d16/d44/d74/d79/ff3 zero size 2024-05-06T21:26:51.882 INFO:tasks.workunit.client.0.smithi032.stdout:4/999: chown d2/fa 1368 1 2024-05-06T21:26:51.883 INFO:tasks.workunit.client.0.smithi032.stdout:6/865: mkdir d8/dd/d18/d13/d105 0 2024-05-06T21:26:51.883 INFO:tasks.workunit.client.0.smithi032.stdout:6/866: dread - d8/d3d/d49/d6b/f6f zero size 2024-05-06T21:26:51.883 INFO:tasks.workunit.client.0.smithi032.stdout:9/943: truncate d1/fe 214362 0 2024-05-06T21:26:51.888 INFO:tasks.workunit.client.1.smithi154.stdout:6/475: symlink d8/d11/d2d/d3d/d70/d7b/l93 0 2024-05-06T21:26:51.888 INFO:tasks.workunit.client.1.smithi154.stdout:6/476: truncate d8/d7e/f83 846801 0 2024-05-06T21:26:51.889 INFO:tasks.workunit.client.0.smithi032.stdout:7/909: dwrite db/d12/f19 [0,4194304] 0 2024-05-06T21:26:51.889 INFO:tasks.workunit.client.0.smithi032.stdout:7/910: creat db/d12/d16/d2a/d39/d3b/f11d x:0 0 0 2024-05-06T21:26:51.889 INFO:tasks.workunit.client.0.smithi032.stdout:7/911: stat db/c90 0 2024-05-06T21:26:51.890 INFO:tasks.workunit.client.1.smithi154.stdout:3/777: dwrite d0/da/d1a/d28/d17/db0/f77 [0,4194304] 0 2024-05-06T21:26:51.891 INFO:tasks.workunit.client.0.smithi032.stdout:9/944: symlink d1/d13/d34/d26/d9f/l139 0 2024-05-06T21:26:51.891 INFO:tasks.workunit.client.0.smithi032.stdout:3/949: dread d1/d2a/d71/d9d/da9/ff8 [0,4194304] 0 2024-05-06T21:26:51.895 INFO:tasks.workunit.client.0.smithi032.stdout:5/910: dwrite d0/d16/d2a/d5f/dca/f92 [0,4194304] 0 2024-05-06T21:26:51.895 INFO:tasks.workunit.client.0.smithi032.stdout:5/911: chown d0/d24/d26/d32/fb9 575328362 1 2024-05-06T21:26:51.895 INFO:tasks.workunit.client.0.smithi032.stdout:5/912: fdatasync d0/d24/d38/d37/df0/d50/f6e 0 2024-05-06T21:26:51.902 INFO:tasks.workunit.client.1.smithi154.stdout:4/601: write d0/d2/f53 [302665,120096] 0 2024-05-06T21:26:51.903 INFO:tasks.workunit.client.0.smithi032.stdout:9/945: rename d1/d13/d34/f43 to d1/d13/d34/d26/d39/d8b/f13a 0 2024-05-06T21:26:51.903 INFO:tasks.workunit.client.0.smithi032.stdout:9/946: getdents d1/d2f/d4f/d132 0 2024-05-06T21:26:51.903 INFO:tasks.workunit.client.0.smithi032.stdout:9/947: dread - d1/d2f/de1/ff4 zero size 2024-05-06T21:26:51.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/913: symlink d0/d87/d11b/dfb/l122 0 2024-05-06T21:26:51.903 INFO:tasks.workunit.client.0.smithi032.stdout:5/914: write d0/d16/d2a/d59/d67/d73/da3/fdb [855584,84600] 0 2024-05-06T21:26:51.907 INFO:tasks.workunit.client.1.smithi154.stdout:6/477: dread d8/fc [0,4194304] 0 2024-05-06T21:26:51.907 INFO:tasks.workunit.client.0.smithi032.stdout:1/843: dwrite db/d16/f18 [0,4194304] 0 2024-05-06T21:26:51.907 INFO:tasks.workunit.client.0.smithi032.stdout:1/844: write db/d47/d4a/da4/d4f/ffe [216344,18815] 0 2024-05-06T21:26:51.909 INFO:tasks.workunit.client.0.smithi032.stdout:2/791: dwrite df/d19/d1e/f107 [0,4194304] 0 2024-05-06T21:26:51.910 INFO:tasks.workunit.client.0.smithi032.stdout:2/792: stat df/d19/d1e/d35/fd4 0 2024-05-06T21:26:51.910 INFO:tasks.workunit.client.1.smithi154.stdout:6/478: truncate d8/f10 5638123 0 2024-05-06T21:26:51.911 INFO:tasks.workunit.client.1.smithi154.stdout:6/479: mknod d8/c94 0 2024-05-06T21:26:51.913 INFO:tasks.workunit.client.1.smithi154.stdout:6/480: mkdir d8/d11/d2d/d3d/d70/d7b/d95 0 2024-05-06T21:26:51.914 INFO:tasks.workunit.client.0.smithi032.stdout:3/950: rename d1/d4/da/d31/d9b/d125/d74/db1/df1/d113/d8b/c98 to d1/d4/da/d31/d9b/d125/d74/db1/df1/c139 0 2024-05-06T21:26:51.916 INFO:tasks.workunit.client.1.smithi154.stdout:6/481: rename d8/d7e/f87 to d8/d11/d33/d4a/d6c/d8e/f96 0 2024-05-06T21:26:51.918 INFO:tasks.workunit.client.1.smithi154.stdout:6/482: symlink d8/d13/d20/l97 0 2024-05-06T21:26:51.921 INFO:tasks.workunit.client.1.smithi154.stdout:6/483: creat d8/d11/d33/d4a/d6c/f98 x:0 0 0 2024-05-06T21:26:51.921 INFO:tasks.workunit.client.1.smithi154.stdout:6/484: fsync d8/d11/f6d 0 2024-05-06T21:26:51.923 INFO:tasks.workunit.client.1.smithi154.stdout:6/485: getdents d8/d13 0 2024-05-06T21:26:51.923 INFO:tasks.workunit.client.1.smithi154.stdout:6/486: readlink d8/d13/l38 0 2024-05-06T21:26:51.923 INFO:tasks.workunit.client.1.smithi154.stdout:6/487: stat d8/d11/l76 0 2024-05-06T21:26:51.928 INFO:tasks.workunit.client.1.smithi154.stdout:1/646: sync 2024-05-06T21:26:51.928 INFO:tasks.workunit.client.1.smithi154.stdout:1/647: readlink d6/db/d10/d15/l2e 0 2024-05-06T21:26:51.929 INFO:tasks.workunit.client.1.smithi154.stdout:7/503: dwrite d6/f10 [0,4194304] 0 2024-05-06T21:26:51.929 INFO:tasks.workunit.client.0.smithi032.stdout:6/867: dwrite d8/dd/d18/d13/f2c [0,4194304] 0 2024-05-06T21:26:51.929 INFO:tasks.workunit.client.0.smithi032.stdout:6/868: chown d8/dd/d18/d3b/c84 24380126 1 2024-05-06T21:26:51.929 INFO:tasks.workunit.client.1.smithi154.stdout:1/648: symlink d6/db/d74/lc4 0 2024-05-06T21:26:51.929 INFO:tasks.workunit.client.1.smithi154.stdout:1/649: chown d6/db/d10/d94/lb1 1828 1 2024-05-06T21:26:51.932 INFO:tasks.workunit.client.1.smithi154.stdout:1/650: rename d6/db/d69/d89/fb4 to d6/db/d10/d94/fc5 0 2024-05-06T21:26:51.932 INFO:tasks.workunit.client.0.smithi032.stdout:9/948: rename d1/d13/d33/d3f/f4e to d1/d2f/da1/dc2/d64/ddf/f13b 0 2024-05-06T21:26:51.939 INFO:tasks.workunit.client.0.smithi032.stdout:9/949: mkdir d1/d2f/da1/dc2/d64/d72/d12a/d13c 0 2024-05-06T21:26:51.940 INFO:tasks.workunit.client.1.smithi154.stdout:5/625: sync 2024-05-06T21:26:51.940 INFO:tasks.workunit.client.1.smithi154.stdout:5/626: chown d2/d3/d21/c3e 1732077104 1 2024-05-06T21:26:51.940 INFO:tasks.workunit.client.1.smithi154.stdout:5/627: rename d2/d3/d21/d95/dd to d2/d3/d21/d95/dd/d2a/d54/d43/d73/dd6 22 2024-05-06T21:26:51.940 INFO:tasks.workunit.client.1.smithi154.stdout:0/723: sync 2024-05-06T21:26:51.940 INFO:tasks.workunit.client.1.smithi154.stdout:8/540: sync 2024-05-06T21:26:51.940 INFO:tasks.workunit.client.1.smithi154.stdout:9/684: sync 2024-05-06T21:26:51.943 INFO:tasks.workunit.client.0.smithi032.stdout:5/915: rename d0/d16/d114 to d0/d16/d46/da9/dea/d123 0 2024-05-06T21:26:51.943 INFO:tasks.workunit.client.1.smithi154.stdout:8/541: dread d3/d56/f7f [0,4194304] 0 2024-05-06T21:26:51.945 INFO:tasks.workunit.client.0.smithi032.stdout:9/950: getdents d1/d13/d33 0 2024-05-06T21:26:51.945 INFO:tasks.workunit.client.0.smithi032.stdout:9/951: stat d1/d2f/da1/dc2/da0 0 2024-05-06T21:26:51.945 INFO:tasks.workunit.client.1.smithi154.stdout:9/685: unlink d5/d2e/d66/f7d 0 2024-05-06T21:26:51.946 INFO:tasks.workunit.client.1.smithi154.stdout:9/686: truncate d5/d20/d52/d6e/d83/da2/fcf 204874 0 2024-05-06T21:26:51.946 INFO:tasks.workunit.client.1.smithi154.stdout:9/687: fsync d5/d20/f90 0 2024-05-06T21:26:51.946 INFO:tasks.workunit.client.0.smithi032.stdout:1/845: rename db/d47/d70/lca to db/dc8/de7/l10b 0 2024-05-06T21:26:51.947 INFO:tasks.workunit.client.1.smithi154.stdout:5/628: symlink d2/d3/d21/d95/dc/d71/ld7 0 2024-05-06T21:26:51.947 INFO:tasks.workunit.client.1.smithi154.stdout:5/629: truncate d2/f14 4660823 0 2024-05-06T21:26:51.947 INFO:tasks.workunit.client.0.smithi032.stdout:9/952: mknod d1/d2f/da1/dc2/da0/dd1/c13d 0 2024-05-06T21:26:51.948 INFO:tasks.workunit.client.1.smithi154.stdout:0/724: rmdir d6/dc/d40/d5e 39 2024-05-06T21:26:51.948 INFO:tasks.workunit.client.1.smithi154.stdout:0/725: readlink d6/dc/d40/d5e/lc0 0 2024-05-06T21:26:51.949 INFO:tasks.workunit.client.0.smithi032.stdout:6/869: write d8/dd/d1b/d35/f43 [2392784,23963] 0 2024-05-06T21:26:51.950 INFO:tasks.workunit.client.1.smithi154.stdout:5/630: unlink d2/d3/d21/d95/f13 0 2024-05-06T21:26:51.952 INFO:tasks.workunit.client.1.smithi154.stdout:0/726: mkdir d6/dc/d51/d54/dee 0 2024-05-06T21:26:51.952 INFO:tasks.workunit.client.1.smithi154.stdout:0/727: read - d6/dc/d40/d85/db2/dbb/fd9 zero size 2024-05-06T21:26:51.954 INFO:tasks.workunit.client.1.smithi154.stdout:5/631: creat d2/d3/d21/d95/dd/d2a/d54/dce/fd8 x:0 0 0 2024-05-06T21:26:51.954 INFO:tasks.workunit.client.1.smithi154.stdout:5/632: write d2/d3/d21/d95/dd/f18 [4007537,37157] 0 2024-05-06T21:26:51.954 INFO:tasks.workunit.client.0.smithi032.stdout:9/953: mkdir d1/d2f/da1/dc2/d64/d13e 0 2024-05-06T21:26:51.955 INFO:tasks.workunit.client.0.smithi032.stdout:1/846: symlink db/d16/d46/d57/d58/d68/l10c 0 2024-05-06T21:26:51.958 INFO:tasks.workunit.client.0.smithi032.stdout:1/847: link db/d16/d5d/fd8 db/d16/d46/d57/d58/d68/f10d 0 2024-05-06T21:26:51.959 INFO:tasks.workunit.client.1.smithi154.stdout:9/688: dread d5/d20/d52/f78 [0,4194304] 0 2024-05-06T21:26:51.959 INFO:tasks.workunit.client.1.smithi154.stdout:9/689: fsync d5/d20/d37/f5f 0 2024-05-06T21:26:51.960 INFO:tasks.workunit.client.1.smithi154.stdout:0/728: dread d6/dc/f4f [0,4194304] 0 2024-05-06T21:26:51.960 INFO:tasks.workunit.client.0.smithi032.stdout:6/870: write d8/d3d/f4e [4060890,112241] 0 2024-05-06T21:26:51.960 INFO:tasks.workunit.client.0.smithi032.stdout:1/848: mknod db/d47/d4a/da4/d4f/c10e 0 2024-05-06T21:26:51.974 INFO:tasks.workunit.client.0.smithi032.stdout:3/951: dwrite d1/d4/da/d31/d9b/d121/d134/d97/d67/da6/f99 [0,4194304] 0 2024-05-06T21:26:51.978 INFO:tasks.workunit.client.0.smithi032.stdout:3/952: link d1/d4/da/d4e/d5e/d84/df2/ceb d1/d4/da/d4e/dd3/dd6/c13a 0 2024-05-06T21:26:51.978 INFO:tasks.workunit.client.0.smithi032.stdout:3/953: stat d1/d4/da/d31/d9b/d125/fa1 0 2024-05-06T21:26:51.979 INFO:tasks.workunit.client.1.smithi154.stdout:3/778: dwrite d0/da/db/d30/d71/f104 [0,4194304] 0 2024-05-06T21:26:51.979 INFO:tasks.workunit.client.1.smithi154.stdout:4/602: dwrite d0/d10/d11/d1a/f8a [0,4194304] 0 2024-05-06T21:26:51.980 INFO:tasks.workunit.client.0.smithi032.stdout:2/793: dwrite df/d19/d1e/d42/dc6/fe9 [0,4194304] 0 2024-05-06T21:26:51.980 INFO:tasks.workunit.client.0.smithi032.stdout:2/794: creat df/d19/d1e/d42/dc6/dc1/df4/f110 x:0 0 0 2024-05-06T21:26:51.981 INFO:tasks.workunit.client.0.smithi032.stdout:9/954: dread d1/d2f/da1/dc2/fba [0,4194304] 0 2024-05-06T21:26:51.981 INFO:tasks.workunit.client.1.smithi154.stdout:5/633: creat d2/d3/d21/d95/dc/d44/dc0/fd9 x:0 0 0 2024-05-06T21:26:51.981 INFO:tasks.workunit.client.1.smithi154.stdout:5/634: stat d2/d3/d21/d95/dc/f30 0 2024-05-06T21:26:51.981 INFO:tasks.workunit.client.1.smithi154.stdout:5/635: chown d2/d3/d21/d95/dc/d71/ld7 1524 1 2024-05-06T21:26:51.984 INFO:tasks.workunit.client.1.smithi154.stdout:9/690: dread d5/d14/d31/d39/f68 [0,4194304] 0 2024-05-06T21:26:51.984 INFO:tasks.workunit.client.0.smithi032.stdout:3/954: write d1/d4/da/d31/d9b/d121/d134/d97/d67/da6/f92 [889268,4871] 0 2024-05-06T21:26:51.984 INFO:tasks.workunit.client.0.smithi032.stdout:3/955: fdatasync d1/d4/da/d31/d9b/f9e 0 2024-05-06T21:26:51.985 INFO:tasks.workunit.client.0.smithi032.stdout:3/956: write d1/d4/da/d31/d9b/d121/d134/d45/f6a [3128113,13365] 0 2024-05-06T21:26:51.987 INFO:tasks.workunit.client.0.smithi032.stdout:9/955: mknod d1/d2f/de1/c13f 0 2024-05-06T21:26:51.987 INFO:tasks.workunit.client.0.smithi032.stdout:9/956: write d1/d13/d34/d26/f29 [5766992,92166] 0 2024-05-06T21:26:51.989 INFO:tasks.workunit.client.0.smithi032.stdout:3/957: mkdir d1/d4/da/d31/d47/d4a/d68/d7c/da8/dea/d13b 0 2024-05-06T21:26:51.992 INFO:tasks.workunit.client.0.smithi032.stdout:3/958: creat d1/d4/da/d31/d9b/d125/d74/db1/df6/f13c x:0 0 0 2024-05-06T21:26:51.995 INFO:tasks.workunit.client.0.smithi032.stdout:3/959: link d1/c53 d1/d4/da/d31/d9b/d125/db8/dd0/dd9/c13d 0 2024-05-06T21:26:51.997 INFO:tasks.workunit.client.0.smithi032.stdout:2/795: write df/d19/d1e/d35/dc5/d2e/d33/f29 [2685771,6141] 0 2024-05-06T21:26:51.998 INFO:tasks.workunit.client.1.smithi154.stdout:6/488: dwrite d8/d11/d2d/d3d/d70/f7d [0,4194304] 0 2024-05-06T21:26:52.000 INFO:tasks.workunit.client.1.smithi154.stdout:1/651: dwrite d6/d3e/f72 [0,4194304] 0 2024-05-06T21:26:52.002 INFO:tasks.workunit.client.1.smithi154.stdout:8/542: dwrite d3/d14/d1a/d29/d32/d40/d59/f41 [0,4194304] 0 2024-05-06T21:26:52.004 INFO:tasks.workunit.client.0.smithi032.stdout:5/916: dwrite d0/d24/f7e [0,4194304] 0 2024-05-06T21:26:52.004 INFO:tasks.workunit.client.1.smithi154.stdout:0/729: dwrite d6/dc/d3c/fa5 [4194304,4194304] 0 2024-05-06T21:26:52.005 INFO:tasks.workunit.client.1.smithi154.stdout:1/652: write d6/db/f6f [146645,46203] 0 2024-05-06T21:26:52.005 INFO:tasks.workunit.client.1.smithi154.stdout:1/653: read - d6/db/d69/d89/f8e zero size 2024-05-06T21:26:52.009 INFO:tasks.workunit.client.0.smithi032.stdout:9/957: write d1/d2f/da1/dc2/f55 [3438485,67281] 0 2024-05-06T21:26:52.009 INFO:tasks.workunit.client.0.smithi032.stdout:6/871: dread d8/dd/d18/d13/f91 [0,4194304] 0 2024-05-06T21:26:52.009 INFO:tasks.workunit.client.0.smithi032.stdout:0/840: sync 2024-05-06T21:26:52.011 INFO:tasks.workunit.client.0.smithi032.stdout:6/872: dread d8/dd/f12 [0,4194304] 0 2024-05-06T21:26:52.014 INFO:tasks.workunit.client.1.smithi154.stdout:5/636: dwrite d2/d3/f35 [0,4194304] 0 2024-05-06T21:26:52.017 INFO:tasks.workunit.client.0.smithi032.stdout:2/796: dwrite df/d19/d1e/d71/d5f/d73/fba [0,4194304] 0 2024-05-06T21:26:52.020 INFO:tasks.workunit.client.0.smithi032.stdout:9/958: mknod d1/d2f/da1/c140 0 2024-05-06T21:26:52.020 INFO:tasks.workunit.client.0.smithi032.stdout:9/959: chown d1/d13/d34/d26/d49/f110 147184273 1 2024-05-06T21:26:52.020 INFO:tasks.workunit.client.0.smithi032.stdout:9/960: stat d1/d13/d33/da6/ffe 0 2024-05-06T21:26:52.022 INFO:tasks.workunit.client.0.smithi032.stdout:1/849: rmdir db/d16 39 2024-05-06T21:26:52.026 INFO:tasks.workunit.client.0.smithi032.stdout:9/961: rename d1/d2f/c12f to d1/d13/d34/d91/c141 0 2024-05-06T21:26:52.030 INFO:tasks.workunit.client.0.smithi032.stdout:2/797: dread df/d19/d1e/d35/dc5/d2e/d33/f1d [4194304,4194304] 0 2024-05-06T21:26:52.030 INFO:tasks.workunit.client.0.smithi032.stdout:2/798: write df/d19/d1e/d71/d5f/d73/f10f [260107,37310] 0 2024-05-06T21:26:52.043 INFO:tasks.workunit.client.0.smithi032.stdout:6/873: dread d8/dd/d18/f69 [0,4194304] 0 2024-05-06T21:26:52.049 INFO:tasks.workunit.client.1.smithi154.stdout:3/779: mknod d0/d2/d22/c10e 0 2024-05-06T21:26:52.050 INFO:tasks.workunit.client.0.smithi032.stdout:6/874: dread d8/dd/d18/f19 [4194304,4194304] 0 2024-05-06T21:26:52.051 INFO:tasks.workunit.client.0.smithi032.stdout:6/875: chown d8/dd/f26 5 1 2024-05-06T21:26:52.051 INFO:tasks.workunit.client.0.smithi032.stdout:6/876: creat d8/dd/d18/dda/f106 x:0 0 0 2024-05-06T21:26:52.052 INFO:tasks.workunit.client.1.smithi154.stdout:4/603: creat d0/d10/d11/d1a/d50/fc6 x:0 0 0 2024-05-06T21:26:52.059 INFO:tasks.workunit.client.1.smithi154.stdout:1/654: rmdir d6/db/d69/d89 39 2024-05-06T21:26:52.063 INFO:tasks.workunit.client.1.smithi154.stdout:5/637: unlink d2/d3/d21/d95/dc/d68/lc5 0 2024-05-06T21:26:52.063 INFO:tasks.workunit.client.0.smithi032.stdout:5/917: dwrite d0/d16/d2f/d77/f7d [0,4194304] 0 2024-05-06T21:26:52.073 INFO:tasks.workunit.client.1.smithi154.stdout:4/604: mkdir d0/d72/d76/dc7 0 2024-05-06T21:26:52.074 INFO:tasks.workunit.client.1.smithi154.stdout:6/489: getdents d8/d11/d2d/d3d/d70 0 2024-05-06T21:26:52.076 INFO:tasks.workunit.client.0.smithi032.stdout:0/841: dwrite d4/d3e/fbf [0,4194304] 0 2024-05-06T21:26:52.077 INFO:tasks.workunit.client.1.smithi154.stdout:1/655: symlink d6/db/d10/d15/d1d/d53/lc6 0 2024-05-06T21:26:52.077 INFO:tasks.workunit.client.0.smithi032.stdout:0/842: getdents d4/da/d14/d1a/d66/d8a/dd0 0 2024-05-06T21:26:52.078 INFO:tasks.workunit.client.1.smithi154.stdout:8/543: dwrite d3/d14/f20 [0,4194304] 0 2024-05-06T21:26:52.080 INFO:tasks.workunit.client.0.smithi032.stdout:6/877: dwrite d8/dd/d18/d13/fa5 [0,4194304] 0 2024-05-06T21:26:52.080 INFO:tasks.workunit.client.0.smithi032.stdout:0/843: dread d4/d3e/d63/d6c/d8f/fba [0,4194304] 0 2024-05-06T21:26:52.081 INFO:tasks.workunit.client.0.smithi032.stdout:0/844: readlink d4/da/d16/d33/d9e/dc9/dcb/lfe 0 2024-05-06T21:26:52.081 INFO:tasks.workunit.client.0.smithi032.stdout:5/918: write d0/d24/d38/f25 [3390169,86649] 0 2024-05-06T21:26:52.081 INFO:tasks.workunit.client.0.smithi032.stdout:5/919: getdents d0/d16/d109 0 2024-05-06T21:26:52.081 INFO:tasks.workunit.client.0.smithi032.stdout:3/960: dwrite d1/d4/da/d31/d9b/d121/d134/d97/d67/da6/f92 [0,4194304] 0 2024-05-06T21:26:52.081 INFO:tasks.workunit.client.0.smithi032.stdout:5/920: creat d0/d24/f124 x:0 0 0 2024-05-06T21:26:52.081 INFO:tasks.workunit.client.0.smithi032.stdout:9/962: dwrite d1/d13/d34/d26/d39/d8b/f13a [0,4194304] 0 2024-05-06T21:26:52.082 INFO:tasks.workunit.client.0.smithi032.stdout:1/850: dwrite db/d47/fe8 [0,4194304] 0 2024-05-06T21:26:52.082 INFO:tasks.workunit.client.0.smithi032.stdout:9/963: chown d1/d2f/da1/dc2/fda 0 1 2024-05-06T21:26:52.082 INFO:tasks.workunit.client.1.smithi154.stdout:4/605: truncate d0/d2/f53 995082 0 2024-05-06T21:26:52.083 INFO:tasks.workunit.client.0.smithi032.stdout:6/878: symlink d8/dd/d1b/l107 0 2024-05-06T21:26:52.086 INFO:tasks.workunit.client.1.smithi154.stdout:1/656: mknod d6/db/d74/cc7 0 2024-05-06T21:26:52.086 INFO:tasks.workunit.client.1.smithi154.stdout:8/544: rmdir d3/d14 39 2024-05-06T21:26:52.087 INFO:tasks.workunit.client.1.smithi154.stdout:8/545: write d3/d14/d1a/d29/d32/d40/d79/d90/f8c [1321041,50289] 0 2024-05-06T21:26:52.088 INFO:tasks.workunit.client.0.smithi032.stdout:0/845: read d4/d3e/d63/f5c [2598848,94787] 0 2024-05-06T21:26:52.088 INFO:tasks.workunit.client.0.smithi032.stdout:1/851: dread db/d47/d4a/da4/fb5 [0,4194304] 0 2024-05-06T21:26:52.088 INFO:tasks.workunit.client.0.smithi032.stdout:1/852: write db/d47/d4a/da4/d4f/dd0/f108 [657846,53539] 0 2024-05-06T21:26:52.089 INFO:tasks.workunit.client.0.smithi032.stdout:0/846: dread d4/d3e/d63/d6c/d8f/dc2/fff [0,4194304] 0 2024-05-06T21:26:52.089 INFO:tasks.workunit.client.0.smithi032.stdout:0/847: chown d4/d3e/l74 1 1 2024-05-06T21:26:52.095 INFO:tasks.workunit.client.0.smithi032.stdout:3/961: mknod d1/d4/da/d1d/c13e 0 2024-05-06T21:26:52.096 INFO:tasks.workunit.client.0.smithi032.stdout:3/962: creat d1/d4/da/d31/d47/d4a/d68/d7c/da8/dea/f13f x:0 0 0 2024-05-06T21:26:52.096 INFO:tasks.workunit.client.0.smithi032.stdout:3/963: readlink d1/d4/da/d4e/d5e/d84/df2/df3/l117 0 2024-05-06T21:26:52.100 INFO:tasks.workunit.client.0.smithi032.stdout:5/921: rename d0/d16/d2a/d5f/dd6/d106/d110/ff3 to d0/d16/d109/f125 0 2024-05-06T21:26:52.105 INFO:tasks.workunit.client.1.smithi154.stdout:8/546: write d3/d14/d1a/d29/d68/f23 [2808676,92467] 0 2024-05-06T21:26:52.107 INFO:tasks.workunit.client.0.smithi032.stdout:0/848: mknod d4/da/d16/dcc/c116 0 2024-05-06T21:26:52.107 INFO:tasks.workunit.client.0.smithi032.stdout:0/849: chown d4/da/d14/d1a/c5d 1 1 2024-05-06T21:26:52.108 INFO:tasks.workunit.client.1.smithi154.stdout:8/547: mknod d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/cb0 0 2024-05-06T21:26:52.110 INFO:tasks.workunit.client.0.smithi032.stdout:9/964: rename d1/d2f/da1/cb4 to d1/d13/d34/d26/d9f/c142 0 2024-05-06T21:26:52.111 INFO:tasks.workunit.client.0.smithi032.stdout:5/922: symlink d0/d16/d2a/l126 0 2024-05-06T21:26:52.111 INFO:tasks.workunit.client.0.smithi032.stdout:5/923: chown d0/d87/d11b/lf8 3 1 2024-05-06T21:26:52.111 INFO:tasks.workunit.client.0.smithi032.stdout:5/924: truncate d0/d24/d38/d37/d7b/dc0/fe0 4925363 0 2024-05-06T21:26:52.113 INFO:tasks.workunit.client.0.smithi032.stdout:5/925: creat d0/d24/d38/dc4/f127 x:0 0 0 2024-05-06T21:26:52.114 INFO:tasks.workunit.client.0.smithi032.stdout:9/965: getdents d1/d13/d34/d92 0 2024-05-06T21:26:52.114 INFO:tasks.workunit.client.0.smithi032.stdout:9/966: chown d1/f23 1295 1 2024-05-06T21:26:52.114 INFO:tasks.workunit.client.0.smithi032.stdout:9/967: write d1/d2f/da1/dc2/d59/f86 [694430,89324] 0 2024-05-06T21:26:52.116 INFO:tasks.workunit.client.0.smithi032.stdout:6/879: dwrite d8/dd/d18/d13/fa5 [0,4194304] 0 2024-05-06T21:26:52.116 INFO:tasks.workunit.client.0.smithi032.stdout:1/853: dread db/d16/d46/f7e [0,4194304] 0 2024-05-06T21:26:52.116 INFO:tasks.workunit.client.0.smithi032.stdout:9/968: stat d1/d13/d33/d5e/le8 0 2024-05-06T21:26:52.120 INFO:tasks.workunit.client.1.smithi154.stdout:4/606: dwrite d0/d10/d11/d1a/f35 [0,4194304] 0 2024-05-06T21:26:52.122 INFO:tasks.workunit.client.1.smithi154.stdout:1/657: dwrite d6/db/d10/d15/f9c [0,4194304] 0 2024-05-06T21:26:52.128 INFO:tasks.workunit.client.1.smithi154.stdout:1/658: dread d6/db/d10/fa1 [0,4194304] 0 2024-05-06T21:26:52.129 INFO:tasks.workunit.client.1.smithi154.stdout:3/780: rmdir d0/da/d1a/d28/dbc/d81 39 2024-05-06T21:26:52.131 INFO:tasks.workunit.client.1.smithi154.stdout:3/781: mkdir d0/da/db/d7c/d80/d10f 0 2024-05-06T21:26:52.131 INFO:tasks.workunit.client.1.smithi154.stdout:3/782: stat d0/da/f18 0 2024-05-06T21:26:52.131 INFO:tasks.workunit.client.1.smithi154.stdout:3/783: truncate d0/da/db/d7c/fb9 1361605 0 2024-05-06T21:26:52.131 INFO:tasks.workunit.client.1.smithi154.stdout:3/784: fsync d0/da/d1a/f44 0 2024-05-06T21:26:52.132 INFO:tasks.workunit.client.0.smithi032.stdout:5/926: dread d0/d24/f7e [0,4194304] 0 2024-05-06T21:26:52.133 INFO:tasks.workunit.client.1.smithi154.stdout:3/785: creat d0/da/db/d7c/d80/d106/f110 x:0 0 0 2024-05-06T21:26:52.133 INFO:tasks.workunit.client.1.smithi154.stdout:3/786: dread - d0/da/db/d52/d62/fe0 zero size 2024-05-06T21:26:52.133 INFO:tasks.workunit.client.0.smithi032.stdout:5/927: creat d0/d16/f128 x:0 0 0 2024-05-06T21:26:52.133 INFO:tasks.workunit.client.0.smithi032.stdout:5/928: readlink d0/d87/ld8 0 2024-05-06T21:26:52.135 INFO:tasks.workunit.client.0.smithi032.stdout:5/929: unlink d0/l101 0 2024-05-06T21:26:52.135 INFO:tasks.workunit.client.0.smithi032.stdout:6/880: dread d8/dd/d1b/d35/f3a [0,4194304] 0 2024-05-06T21:26:52.136 INFO:tasks.workunit.client.0.smithi032.stdout:6/881: read d8/dd/d1b/f62 [127208,80453] 0 2024-05-06T21:26:52.137 INFO:tasks.workunit.client.0.smithi032.stdout:5/930: symlink d0/d16/d79/l129 0 2024-05-06T21:26:52.137 INFO:tasks.workunit.client.1.smithi154.stdout:3/787: dread d0/da/f70 [0,4194304] 0 2024-05-06T21:26:52.139 INFO:tasks.workunit.client.0.smithi032.stdout:9/969: write d1/f9 [2264315,53634] 0 2024-05-06T21:26:52.139 INFO:tasks.workunit.client.0.smithi032.stdout:0/850: dwrite d4/fe2 [0,4194304] 0 2024-05-06T21:26:52.139 INFO:tasks.workunit.client.0.smithi032.stdout:9/970: creat d1/d13/d33/d3f/f143 x:0 0 0 2024-05-06T21:26:52.139 INFO:tasks.workunit.client.0.smithi032.stdout:9/971: write d1/d13/d34/d26/f71 [2602317,51301] 0 2024-05-06T21:26:52.140 INFO:tasks.workunit.client.0.smithi032.stdout:6/882: unlink d8/dd/d18/d3b/db9/cf0 0 2024-05-06T21:26:52.141 INFO:tasks.workunit.client.1.smithi154.stdout:0/730: rename d6/f15 to d6/dc/d51/d54/fef 0 2024-05-06T21:26:52.141 INFO:tasks.workunit.client.1.smithi154.stdout:8/548: rename d3/d14/d1a/d29 to d3/d14/d1a/d29/d3e/db1 22 2024-05-06T21:26:52.141 INFO:tasks.workunit.client.1.smithi154.stdout:8/549: readlink d3/d38/l92 0 2024-05-06T21:26:52.141 INFO:tasks.workunit.client.1.smithi154.stdout:8/550: chown d3/d14/d1a/d29/d32/c9a 17 1 2024-05-06T21:26:52.142 INFO:tasks.workunit.client.0.smithi032.stdout:1/854: dwrite db/d47/d4a/f95 [0,4194304] 0 2024-05-06T21:26:52.143 INFO:tasks.workunit.client.0.smithi032.stdout:1/855: chown db/d47/d4a/dcb/dec 12 1 2024-05-06T21:26:52.146 INFO:tasks.workunit.client.0.smithi032.stdout:9/972: mknod d1/d13/d34/d92/c144 0 2024-05-06T21:26:52.146 INFO:tasks.workunit.client.0.smithi032.stdout:9/973: creat d1/d2f/f145 x:0 0 0 2024-05-06T21:26:52.146 INFO:tasks.workunit.client.1.smithi154.stdout:0/731: link d6/dc/d3c/fa5 d6/dc/d40/d4a/dac/ff0 0 2024-05-06T21:26:52.146 INFO:tasks.workunit.client.1.smithi154.stdout:0/732: readlink d6/l18 0 2024-05-06T21:26:52.147 INFO:tasks.workunit.client.0.smithi032.stdout:7/912: sync 2024-05-06T21:26:52.148 INFO:tasks.workunit.client.1.smithi154.stdout:3/788: rename d0/da/d1a/fcf to d0/da/d1a/d28/f111 0 2024-05-06T21:26:52.149 INFO:tasks.workunit.client.1.smithi154.stdout:0/733: symlink d6/dc/d40/d4a/dac/lf1 0 2024-05-06T21:26:52.153 INFO:tasks.workunit.client.1.smithi154.stdout:9/691: creat d5/d14/fef x:0 0 0 2024-05-06T21:26:52.153 INFO:tasks.workunit.client.1.smithi154.stdout:9/692: stat d5/dca 0 2024-05-06T21:26:52.154 INFO:tasks.workunit.client.1.smithi154.stdout:8/551: mknod d3/d14/d1a/d29/d32/cb2 0 2024-05-06T21:26:52.155 INFO:tasks.workunit.client.0.smithi032.stdout:7/913: symlink db/d12/d16/d2a/d39/d3b/d96/d118/l11e 0 2024-05-06T21:26:52.155 INFO:tasks.workunit.client.0.smithi032.stdout:7/914: readlink db/d12/d16/d2a/d39/d3b/d96/d118/l11e 0 2024-05-06T21:26:52.158 INFO:tasks.workunit.client.0.smithi032.stdout:7/915: creat db/d12/d16/d2a/d39/def/f11f x:0 0 0 2024-05-06T21:26:52.158 INFO:tasks.workunit.client.1.smithi154.stdout:3/789: rename d0/da/db/d52/d75 to d0/da/db/dd/d1c/d90/d112 0 2024-05-06T21:26:52.160 INFO:tasks.workunit.client.0.smithi032.stdout:1/856: write db/d16/d5d/fd8 [3393872,75475] 0 2024-05-06T21:26:52.161 INFO:tasks.workunit.client.1.smithi154.stdout:5/638: mkdir d2/d3/d21/d95/dd/dda 0 2024-05-06T21:26:52.161 INFO:tasks.workunit.client.1.smithi154.stdout:6/490: creat d8/d11/f99 x:0 0 0 2024-05-06T21:26:52.162 INFO:tasks.workunit.client.0.smithi032.stdout:7/916: rename db/d12/d16/d2a/d39/cca to db/d12/d10b/c120 0 2024-05-06T21:26:52.168 INFO:tasks.workunit.client.1.smithi154.stdout:0/734: dread d6/dc/d44/d36/f68 [0,4194304] 0 2024-05-06T21:26:52.168 INFO:tasks.workunit.client.1.smithi154.stdout:4/607: mknod d0/d82/cc8 0 2024-05-06T21:26:52.168 INFO:tasks.workunit.client.1.smithi154.stdout:5/639: mknod d2/d3/d21/d95/dd/d2a/d8d/cdb 0 2024-05-06T21:26:52.169 INFO:tasks.workunit.client.1.smithi154.stdout:4/608: readlink d0/d82/d44/d73/l84 0 2024-05-06T21:26:52.169 INFO:tasks.workunit.client.1.smithi154.stdout:5/640: stat d2/d3/d21/d95/dc/d71/lbc 0 2024-05-06T21:26:52.169 INFO:tasks.workunit.client.1.smithi154.stdout:5/641: chown d2/d3/d21/d95/dd/d2a/d54 11517372 1 2024-05-06T21:26:52.169 INFO:tasks.workunit.client.1.smithi154.stdout:6/491: unlink d8/d13/c48 0 2024-05-06T21:26:52.170 INFO:tasks.workunit.client.1.smithi154.stdout:1/659: creat d6/db/d10/fc8 x:0 0 0 2024-05-06T21:26:52.170 INFO:tasks.workunit.client.1.smithi154.stdout:4/609: symlink d0/d10/lc9 0 2024-05-06T21:26:52.172 INFO:tasks.workunit.client.1.smithi154.stdout:6/492: truncate d8/d11/f1d 1662752 0 2024-05-06T21:26:52.172 INFO:tasks.workunit.client.0.smithi032.stdout:1/857: creat db/d16/f10f x:0 0 0 2024-05-06T21:26:52.175 INFO:tasks.workunit.client.1.smithi154.stdout:1/660: creat d6/db/d97/fc9 x:0 0 0 2024-05-06T21:26:52.176 INFO:tasks.workunit.client.1.smithi154.stdout:8/552: dread d3/d14/d1a/d29/d43/f5d [0,4194304] 0 2024-05-06T21:26:52.176 INFO:tasks.workunit.client.0.smithi032.stdout:1/858: link db/ff3 db/dc8/f110 0 2024-05-06T21:26:52.179 INFO:tasks.workunit.client.0.smithi032.stdout:1/859: symlink db/d16/d46/d57/d58/l111 0 2024-05-06T21:26:52.179 INFO:tasks.workunit.client.1.smithi154.stdout:4/610: creat d0/d82/d39/fca x:0 0 0 2024-05-06T21:26:52.179 INFO:tasks.workunit.client.1.smithi154.stdout:4/611: truncate d0/d82/f5e 146085 0 2024-05-06T21:26:52.179 INFO:tasks.workunit.client.1.smithi154.stdout:4/612: write d0/d2/dc/fc4 [940424,116909] 0 2024-05-06T21:26:52.179 INFO:tasks.workunit.client.1.smithi154.stdout:4/613: write d0/d10/f38 [4279788,19910] 0 2024-05-06T21:26:52.181 INFO:tasks.workunit.client.1.smithi154.stdout:4/614: creat d0/d2/fcb x:0 0 0 2024-05-06T21:26:52.184 INFO:tasks.workunit.client.1.smithi154.stdout:4/615: link d0/d10/lc9 d0/d82/d39/da6/lcc 0 2024-05-06T21:26:52.186 INFO:tasks.workunit.client.1.smithi154.stdout:8/553: dread d3/fd [0,4194304] 0 2024-05-06T21:26:52.186 INFO:tasks.workunit.client.1.smithi154.stdout:4/616: mkdir d0/d10/d11/dcd 0 2024-05-06T21:26:52.188 INFO:tasks.workunit.client.1.smithi154.stdout:8/554: rmdir d3/d14/d1a/d29/d32 39 2024-05-06T21:26:52.193 INFO:tasks.workunit.client.1.smithi154.stdout:4/617: mkdir d0/d82/d44/d73/d4a/d74/dce 0 2024-05-06T21:26:52.195 INFO:tasks.workunit.client.0.smithi032.stdout:0/851: dwrite d4/da/d16/d33/da7/faa [0,4194304] 0 2024-05-06T21:26:52.198 INFO:tasks.workunit.client.0.smithi032.stdout:0/852: rmdir d4/da/d14/d4a 39 2024-05-06T21:26:52.199 INFO:tasks.workunit.client.1.smithi154.stdout:8/555: dread d3/d14/d1a/d45/f5a [0,4194304] 0 2024-05-06T21:26:52.199 INFO:tasks.workunit.client.0.smithi032.stdout:0/853: symlink d4/da/d16/d33/d9e/dc9/dcb/l117 0 2024-05-06T21:26:52.200 INFO:tasks.workunit.client.0.smithi032.stdout:0/854: mknod d4/d3e/d63/d6c/c118 0 2024-05-06T21:26:52.201 INFO:tasks.workunit.client.0.smithi032.stdout:0/855: symlink d4/da/d16/d33/d9e/dc9/dcb/l119 0 2024-05-06T21:26:52.207 INFO:tasks.workunit.client.1.smithi154.stdout:4/618: dread d0/d82/d3d/f6b [0,4194304] 0 2024-05-06T21:26:52.209 INFO:tasks.workunit.client.1.smithi154.stdout:4/619: rename d0/d10/d11/d1a/d50/fc6 to d0/d82/d3d/dab/fcf 0 2024-05-06T21:26:52.213 INFO:tasks.workunit.client.0.smithi032.stdout:0/856: write d4/da/d16/f3b [99695,79694] 0 2024-05-06T21:26:52.214 INFO:tasks.workunit.client.0.smithi032.stdout:0/857: mknod d4/d3e/c11a 0 2024-05-06T21:26:52.214 INFO:tasks.workunit.client.0.smithi032.stdout:0/858: readlink d4/da/d14/ld2 0 2024-05-06T21:26:52.217 INFO:tasks.workunit.client.0.smithi032.stdout:0/859: rename d4/da/d16/d33/da7/dbd to d4/da/d16/d33/da7/d11b 0 2024-05-06T21:26:52.218 INFO:tasks.workunit.client.1.smithi154.stdout:4/620: dread d0/d82/d39/f4b [0,4194304] 0 2024-05-06T21:26:52.221 INFO:tasks.workunit.client.0.smithi032.stdout:9/974: dwrite d1/f23 [0,4194304] 0 2024-05-06T21:26:52.221 INFO:tasks.workunit.client.0.smithi032.stdout:0/860: dread d4/d3e/d63/dca/f6e [4194304,4194304] 0 2024-05-06T21:26:52.221 INFO:tasks.workunit.client.0.smithi032.stdout:0/861: write d4/fe3 [110945,7022] 0 2024-05-06T21:26:52.222 INFO:tasks.workunit.client.0.smithi032.stdout:9/975: link d1/d2f/da1/dc2/f4b d1/d2f/d4f/d97/f146 0 2024-05-06T21:26:52.222 INFO:tasks.workunit.client.0.smithi032.stdout:9/976: fsync d1/d13/d33/d5e/d78/f83 0 2024-05-06T21:26:52.223 INFO:tasks.workunit.client.0.smithi032.stdout:9/977: mknod d1/d2f/da1/dc2/da0/d102/c147 0 2024-05-06T21:26:52.227 INFO:tasks.workunit.client.0.smithi032.stdout:5/931: dwrite d0/d24/d38/d37/d70/fb2 [0,4194304] 0 2024-05-06T21:26:52.228 INFO:tasks.workunit.client.1.smithi154.stdout:5/642: dwrite d2/d3/d21/d95/dd/d2a/d54/d43/d73/f82 [0,4194304] 0 2024-05-06T21:26:52.230 INFO:tasks.workunit.client.1.smithi154.stdout:5/643: mknod d2/d3/d21/d22/d25/d37/cdc 0 2024-05-06T21:26:52.230 INFO:tasks.workunit.client.1.smithi154.stdout:5/644: fsync d2/d3/d21/d95/fe 0 2024-05-06T21:26:52.231 INFO:tasks.workunit.client.1.smithi154.stdout:5/645: symlink d2/d3/d21/d95/dd/d2a/d54/d43/ldd 0 2024-05-06T21:26:52.232 INFO:tasks.workunit.client.0.smithi032.stdout:5/932: symlink d0/d87/l12a 0 2024-05-06T21:26:52.233 INFO:tasks.workunit.client.1.smithi154.stdout:5/646: truncate d2/d3/d21/d95/dc/f15 1618040 0 2024-05-06T21:26:52.233 INFO:tasks.workunit.client.1.smithi154.stdout:5/647: truncate d2/d3/d19/d23/f9b 958672 0 2024-05-06T21:26:52.233 INFO:tasks.workunit.client.1.smithi154.stdout:5/648: readlink d2/d3/d21/d95/dc/d68/d69/l58 0 2024-05-06T21:26:52.235 INFO:tasks.workunit.client.0.smithi032.stdout:1/860: dread db/d16/d5d/fd8 [0,4194304] 0 2024-05-06T21:26:52.235 INFO:tasks.workunit.client.1.smithi154.stdout:5/649: creat d2/d3/d21/d95/fde x:0 0 0 2024-05-06T21:26:52.236 INFO:tasks.workunit.client.0.smithi032.stdout:6/883: dwrite d8/dd/d18/d13/f5a [0,4194304] 0 2024-05-06T21:26:52.236 INFO:tasks.workunit.client.0.smithi032.stdout:6/884: chown d8/d3d/d49/d6b/f8d 260819 1 2024-05-06T21:26:52.236 INFO:tasks.workunit.client.0.smithi032.stdout:5/933: mkdir d0/d16/d2a/d5f/dd6/d106/d12b 0 2024-05-06T21:26:52.237 INFO:tasks.workunit.client.1.smithi154.stdout:9/693: dwrite d5/d2e/d7f/fcd [0,4194304] 0 2024-05-06T21:26:52.237 INFO:tasks.workunit.client.1.smithi154.stdout:9/694: chown d5/d20/d52/d6e/d83/da2/lad 113928385 1 2024-05-06T21:26:52.237 INFO:tasks.workunit.client.0.smithi032.stdout:1/861: mkdir db/d47/d70/d112 0 2024-05-06T21:26:52.238 INFO:tasks.workunit.client.1.smithi154.stdout:5/650: rename d2/d3/d21/c3e to d2/d3/d21/d95/dc/d68/d69/cdf 0 2024-05-06T21:26:52.238 INFO:tasks.workunit.client.1.smithi154.stdout:5/651: stat d2/d3/d21/d95/dc/d44/f5b 0 2024-05-06T21:26:52.239 INFO:tasks.workunit.client.0.smithi032.stdout:0/862: dread d4/da/d14/d4a/fc7 [0,4194304] 0 2024-05-06T21:26:52.239 INFO:tasks.workunit.client.0.smithi032.stdout:7/917: dwrite db/d12/fc9 [0,4194304] 0 2024-05-06T21:26:52.239 INFO:tasks.workunit.client.0.smithi032.stdout:7/918: write db/d12/d49/d97/f98 [152235,124246] 0 2024-05-06T21:26:52.239 INFO:tasks.workunit.client.0.smithi032.stdout:5/934: write d0/d16/f91 [191226,85872] 0 2024-05-06T21:26:52.239 INFO:tasks.workunit.client.0.smithi032.stdout:6/885: mknod d8/dd/d18/d3b/c108 0 2024-05-06T21:26:52.239 INFO:tasks.workunit.client.0.smithi032.stdout:6/886: fsync d8/d3d/f4e 0 2024-05-06T21:26:52.240 INFO:tasks.workunit.client.0.smithi032.stdout:6/887: fdatasync d8/d3d/d49/f60 0 2024-05-06T21:26:52.240 INFO:tasks.workunit.client.1.smithi154.stdout:3/790: dwrite d0/da/db/f73 [0,4194304] 0 2024-05-06T21:26:52.241 INFO:tasks.workunit.client.1.smithi154.stdout:8/556: dwrite d3/d14/d1a/d29/f3d [0,4194304] 0 2024-05-06T21:26:52.241 INFO:tasks.workunit.client.1.smithi154.stdout:9/695: dread d5/d2e/da0/fb4 [0,4194304] 0 2024-05-06T21:26:52.241 INFO:tasks.workunit.client.1.smithi154.stdout:9/696: dread - d5/fab zero size 2024-05-06T21:26:52.241 INFO:tasks.workunit.client.0.smithi032.stdout:1/862: link db/dc8/le2 db/dc8/de7/dfb/l113 0 2024-05-06T21:26:52.242 INFO:tasks.workunit.client.1.smithi154.stdout:2/575: sync 2024-05-06T21:26:52.242 INFO:tasks.workunit.client.1.smithi154.stdout:7/504: sync 2024-05-06T21:26:52.242 INFO:tasks.workunit.client.1.smithi154.stdout:5/652: mknod d2/d3/d21/d95/dd/d2a/d54/d43/db1/ce0 0 2024-05-06T21:26:52.242 INFO:tasks.workunit.client.1.smithi154.stdout:7/505: dread - d6/d20/d40/d52/f9c zero size 2024-05-06T21:26:52.242 INFO:tasks.workunit.client.1.smithi154.stdout:5/653: dread - d2/d3/d21/d95/dc/d44/dc0/fd9 zero size 2024-05-06T21:26:52.243 INFO:tasks.workunit.client.0.smithi032.stdout:9/978: dwrite d1/d13/d33/d3f/f135 [0,4194304] 0 2024-05-06T21:26:52.243 INFO:tasks.workunit.client.0.smithi032.stdout:9/979: chown d1/d2f/da1/dc2/d64/d13e 932 1 2024-05-06T21:26:52.245 INFO:tasks.workunit.client.0.smithi032.stdout:7/919: dread db/d12/d16/d21/d41/d4b/f54 [0,4194304] 0 2024-05-06T21:26:52.245 INFO:tasks.workunit.client.0.smithi032.stdout:7/920: chown db/d12/d16/d2a/d39/def/l110 274305841 1 2024-05-06T21:26:52.246 INFO:tasks.workunit.client.1.smithi154.stdout:9/697: mknod d5/d14/d31/cf0 0 2024-05-06T21:26:52.248 INFO:tasks.workunit.client.1.smithi154.stdout:7/506: mkdir d6/d42/d6c/d6e/d21/d69/d7b/d9f 0 2024-05-06T21:26:52.250 INFO:tasks.workunit.client.1.smithi154.stdout:5/654: symlink d2/d3/d21/d95/dd/d2a/d54/d43/le1 0 2024-05-06T21:26:52.252 INFO:tasks.workunit.client.1.smithi154.stdout:7/507: truncate d6/d42/d6c/f77 917236 0 2024-05-06T21:26:52.253 INFO:tasks.workunit.client.1.smithi154.stdout:7/508: readlink d6/d46/l55 0 2024-05-06T21:26:52.256 INFO:tasks.workunit.client.1.smithi154.stdout:7/509: rename d6/d46/c9b to d6/d20/d40/d52/d81/ca0 0 2024-05-06T21:26:52.256 INFO:tasks.workunit.client.1.smithi154.stdout:7/510: fdatasync d6/d20/f1b 0 2024-05-06T21:26:52.257 INFO:tasks.workunit.client.0.smithi032.stdout:0/863: mkdir d4/da/d16/d33/d9e/dc9/dd8/d11c 0 2024-05-06T21:26:52.258 INFO:tasks.workunit.client.1.smithi154.stdout:7/511: mknod d6/d42/d6c/d6e/d21/d2e/ca1 0 2024-05-06T21:26:52.259 INFO:tasks.workunit.client.1.smithi154.stdout:7/512: stat d6/d54/d6a/f8a 0 2024-05-06T21:26:52.260 INFO:tasks.workunit.client.0.smithi032.stdout:5/935: unlink d0/d16/d2a/dc7/dd2/de1/d115/c121 0 2024-05-06T21:26:52.260 INFO:tasks.workunit.client.1.smithi154.stdout:9/698: write d5/d14/f30 [1323898,74688] 0 2024-05-06T21:26:52.260 INFO:tasks.workunit.client.1.smithi154.stdout:9/699: fsync d5/d2e/d8b/fb2 0 2024-05-06T21:26:52.260 INFO:tasks.workunit.client.1.smithi154.stdout:9/700: truncate d5/d2e/d8b/fd2 182752 0 2024-05-06T21:26:52.260 INFO:tasks.workunit.client.1.smithi154.stdout:9/701: chown d5/d2e/dee 160 1 2024-05-06T21:26:52.261 INFO:tasks.workunit.client.0.smithi032.stdout:6/888: creat d8/db6/d100/f109 x:0 0 0 2024-05-06T21:26:52.261 INFO:tasks.workunit.client.0.smithi032.stdout:1/863: mknod db/dc8/de7/dfb/c114 0 2024-05-06T21:26:52.262 INFO:tasks.workunit.client.1.smithi154.stdout:9/702: creat d5/d14/d3a/d71/db1/dba/ff1 x:0 0 0 2024-05-06T21:26:52.263 INFO:tasks.workunit.client.0.smithi032.stdout:9/980: unlink d1/d13/d33/d5e/d78/l105 0 2024-05-06T21:26:52.264 INFO:tasks.workunit.client.0.smithi032.stdout:9/981: fsync d1/fbb 0 2024-05-06T21:26:52.264 INFO:tasks.workunit.client.0.smithi032.stdout:9/982: fdatasync d1/d13/d33/d5e/d78/f136 0 2024-05-06T21:26:52.264 INFO:tasks.workunit.client.1.smithi154.stdout:9/703: symlink d5/d20/d37/lf2 0 2024-05-06T21:26:52.264 INFO:tasks.workunit.client.0.smithi032.stdout:7/921: mkdir db/d12/d16/d2a/d39/d8b/d121 0 2024-05-06T21:26:52.266 INFO:tasks.workunit.client.0.smithi032.stdout:5/936: creat d0/d16/d2a/dc7/dd2/d11a/f12c x:0 0 0 2024-05-06T21:26:52.266 INFO:tasks.workunit.client.0.smithi032.stdout:5/937: write d0/d16/d2a/d52/fec [218799,72404] 0 2024-05-06T21:26:52.268 INFO:tasks.workunit.client.0.smithi032.stdout:9/983: link d1/d13/d33/d8e/fb9 d1/d13/d33/d8e/f148 0 2024-05-06T21:26:52.268 INFO:tasks.workunit.client.0.smithi032.stdout:9/984: fdatasync d1/d2f/da1/dc2/d59/f65 0 2024-05-06T21:26:52.268 INFO:tasks.workunit.client.0.smithi032.stdout:7/922: getdents db/d12/d16/d2a 0 2024-05-06T21:26:52.269 INFO:tasks.workunit.client.0.smithi032.stdout:0/864: symlink d4/d96/l11d 0 2024-05-06T21:26:52.269 INFO:tasks.workunit.client.0.smithi032.stdout:0/865: dread - d4/da/d14/d1a/d66/f87 zero size 2024-05-06T21:26:52.270 INFO:tasks.workunit.client.0.smithi032.stdout:5/938: mknod d0/d16/d2a/d5f/dd6/c12d 0 2024-05-06T21:26:52.271 INFO:tasks.workunit.client.0.smithi032.stdout:6/889: rename d8/dd/d1b/d35 to d8/d3d/d49/d6b/d10a 0 2024-05-06T21:26:52.272 INFO:tasks.workunit.client.0.smithi032.stdout:9/985: mknod d1/d2f/da1/c149 0 2024-05-06T21:26:52.273 INFO:tasks.workunit.client.1.smithi154.stdout:7/513: dread d6/d46/d5c/f8d [0,4194304] 0 2024-05-06T21:26:52.274 INFO:tasks.workunit.client.0.smithi032.stdout:0/866: creat d4/da/d14/d1a/f11e x:0 0 0 2024-05-06T21:26:52.274 INFO:tasks.workunit.client.0.smithi032.stdout:0/867: creat d4/d3e/f11f x:0 0 0 2024-05-06T21:26:52.274 INFO:tasks.workunit.client.1.smithi154.stdout:7/514: mkdir d6/d20/d85/da2 0 2024-05-06T21:26:52.274 INFO:tasks.workunit.client.1.smithi154.stdout:7/515: readlink d6/d42/d6c/d6e/d21/l6d 0 2024-05-06T21:26:52.275 INFO:tasks.workunit.client.0.smithi032.stdout:1/864: rename db/d47/d4a/da4/fda to db/dc8/dfc/f115 0 2024-05-06T21:26:52.275 INFO:tasks.workunit.client.0.smithi032.stdout:1/865: readlink db/l35 0 2024-05-06T21:26:52.276 INFO:tasks.workunit.client.1.smithi154.stdout:7/516: mknod d6/d42/d6c/d6e/d21/d69/d7b/ca3 0 2024-05-06T21:26:52.276 INFO:tasks.workunit.client.1.smithi154.stdout:9/704: write d5/d20/d52/d6e/f9b [1943900,93787] 0 2024-05-06T21:26:52.277 INFO:tasks.workunit.client.1.smithi154.stdout:7/517: write d6/f9e [306861,57791] 0 2024-05-06T21:26:52.277 INFO:tasks.workunit.client.1.smithi154.stdout:7/518: chown d6/d46/d5c/f8d 2917397 1 2024-05-06T21:26:52.277 INFO:tasks.workunit.client.1.smithi154.stdout:7/519: fdatasync d6/d20/f89 0 2024-05-06T21:26:52.277 INFO:tasks.workunit.client.1.smithi154.stdout:9/705: creat d5/d14/daf/db8/ff3 x:0 0 0 2024-05-06T21:26:52.277 INFO:tasks.workunit.client.1.smithi154.stdout:9/706: truncate d5/d14/d31/d39/f68 4837355 0 2024-05-06T21:26:52.278 INFO:tasks.workunit.client.0.smithi032.stdout:0/868: mkdir d4/d3e/d63/d6c/d120 0 2024-05-06T21:26:52.278 INFO:tasks.workunit.client.1.smithi154.stdout:7/520: mkdir d6/d42/d6c/d6e/da4 0 2024-05-06T21:26:52.278 INFO:tasks.workunit.client.1.smithi154.stdout:8/557: dwrite d3/d14/f18 [0,4194304] 0 2024-05-06T21:26:52.279 INFO:tasks.workunit.client.1.smithi154.stdout:5/655: dwrite d2/d3/d21/fa2 [0,4194304] 0 2024-05-06T21:26:52.280 INFO:tasks.workunit.client.1.smithi154.stdout:8/558: mkdir d3/d14/d1a/d29/d32/d40/d59/d67/da7/db3 0 2024-05-06T21:26:52.280 INFO:tasks.workunit.client.1.smithi154.stdout:8/559: write d3/d14/d1a/d29/d3e/f66 [4223024,26955] 0 2024-05-06T21:26:52.281 INFO:tasks.workunit.client.1.smithi154.stdout:9/707: rmdir d5/d14/d31/d39 39 2024-05-06T21:26:52.283 INFO:tasks.workunit.client.0.smithi032.stdout:7/923: rename db/d12/d16/fb4 to db/d12/d16/d2a/d39/d3b/dac/f122 0 2024-05-06T21:26:52.284 INFO:tasks.workunit.client.0.smithi032.stdout:1/866: mknod db/d47/d4a/da4/da2/c116 0 2024-05-06T21:26:52.284 INFO:tasks.workunit.client.0.smithi032.stdout:1/867: dread - db/d16/da3/ff7 zero size 2024-05-06T21:26:52.285 INFO:tasks.workunit.client.1.smithi154.stdout:5/656: creat d2/d3/fe2 x:0 0 0 2024-05-06T21:26:52.285 INFO:tasks.workunit.client.0.smithi032.stdout:1/868: read db/d47/d4a/f8e [12974,108972] 0 2024-05-06T21:26:52.286 INFO:tasks.workunit.client.1.smithi154.stdout:8/560: mkdir d3/d14/d1a/d29/d32/d40/d59/d67/da7/db3/db4 0 2024-05-06T21:26:52.287 INFO:tasks.workunit.client.0.smithi032.stdout:7/924: symlink db/d12/d87/l123 0 2024-05-06T21:26:52.287 INFO:tasks.workunit.client.0.smithi032.stdout:7/925: creat db/d89/daa/f124 x:0 0 0 2024-05-06T21:26:52.289 INFO:tasks.workunit.client.1.smithi154.stdout:2/576: dwrite db/f3c [0,4194304] 0 2024-05-06T21:26:52.290 INFO:tasks.workunit.client.1.smithi154.stdout:9/708: rename d5/d14/d31/d39/f68 to d5/d20/d37/dd5/de1/de6/ff4 0 2024-05-06T21:26:52.292 INFO:tasks.workunit.client.0.smithi032.stdout:7/926: mkdir db/d12/d49/d125 0 2024-05-06T21:26:52.293 INFO:tasks.workunit.client.1.smithi154.stdout:2/577: dread db/de/d16/d4f/f8f [0,4194304] 0 2024-05-06T21:26:52.293 INFO:tasks.workunit.client.1.smithi154.stdout:2/578: fsync db/d12/d19/f54 0 2024-05-06T21:26:52.294 INFO:tasks.workunit.client.0.smithi032.stdout:7/927: write db/d12/d16/d21/f44 [5979188,73132] 0 2024-05-06T21:26:52.294 INFO:tasks.workunit.client.0.smithi032.stdout:7/928: write db/d12/d16/f3f [1515935,92267] 0 2024-05-06T21:26:52.294 INFO:tasks.workunit.client.0.smithi032.stdout:6/890: write d8/dd/d18/d13/f5a [2088339,125894] 0 2024-05-06T21:26:52.297 INFO:tasks.workunit.client.0.smithi032.stdout:7/929: creat db/d12/d16/d2a/d39/d3b/d111/f126 x:0 0 0 2024-05-06T21:26:52.299 INFO:tasks.workunit.client.0.smithi032.stdout:2/799: sync 2024-05-06T21:26:52.299 INFO:tasks.workunit.client.0.smithi032.stdout:2/800: chown df/d19/d1e/d71/f108 144 1 2024-05-06T21:26:52.299 INFO:tasks.workunit.client.0.smithi032.stdout:3/964: sync 2024-05-06T21:26:52.300 INFO:tasks.workunit.client.0.smithi032.stdout:7/930: unlink db/d12/d16/d21/d84/l95 0 2024-05-06T21:26:52.301 INFO:tasks.workunit.client.0.smithi032.stdout:3/965: dread d1/d4/da/d31/d9b/d125/db8/dd0/dd9/d101/f103 [0,4194304] 0 2024-05-06T21:26:52.303 INFO:tasks.workunit.client.0.smithi032.stdout:1/869: dread db/d47/d4a/f95 [0,4194304] 0 2024-05-06T21:26:52.303 INFO:tasks.workunit.client.1.smithi154.stdout:5/657: getdents d2/d3/d21/d22 0 2024-05-06T21:26:52.309 INFO:tasks.workunit.client.1.smithi154.stdout:8/561: rename d3/d14/c35 to d3/d14/d1a/d29/d32/d40/d79/d2b/cb5 0 2024-05-06T21:26:52.310 INFO:tasks.workunit.client.1.smithi154.stdout:2/579: symlink db/d12/d1d/d83/lb5 0 2024-05-06T21:26:52.311 INFO:tasks.workunit.client.1.smithi154.stdout:2/580: read db/d12/d19/f54 [173971,96709] 0 2024-05-06T21:26:52.311 INFO:tasks.workunit.client.1.smithi154.stdout:5/658: mknod d2/d3/d21/d95/dd/dda/ce3 0 2024-05-06T21:26:52.313 INFO:tasks.workunit.client.1.smithi154.stdout:8/562: mknod d3/d14/d1a/d29/d68/cb6 0 2024-05-06T21:26:52.313 INFO:tasks.workunit.client.1.smithi154.stdout:2/581: symlink db/d12/d4e/d55/lb6 0 2024-05-06T21:26:52.315 INFO:tasks.workunit.client.1.smithi154.stdout:2/582: rename db/d12/d19/l20 to db/d12/d1d/lb7 0 2024-05-06T21:26:52.315 INFO:tasks.workunit.client.1.smithi154.stdout:2/583: chown f5 529 1 2024-05-06T21:26:52.316 INFO:tasks.workunit.client.1.smithi154.stdout:5/659: getdents d2/d3/d21/d95/dd/d2a/d54/dce 0 2024-05-06T21:26:52.316 INFO:tasks.workunit.client.1.smithi154.stdout:5/660: getdents d2/d3/d21/d22 0 2024-05-06T21:26:52.317 INFO:tasks.workunit.client.0.smithi032.stdout:9/986: dwrite d1/d2f/f3c [0,4194304] 0 2024-05-06T21:26:52.317 INFO:tasks.workunit.client.1.smithi154.stdout:2/584: getdents db/d12/d19/d81 0 2024-05-06T21:26:52.318 INFO:tasks.workunit.client.0.smithi032.stdout:0/869: dwrite d4/da/d16/d33/f57 [0,4194304] 0 2024-05-06T21:26:52.318 INFO:tasks.workunit.client.0.smithi032.stdout:0/870: write d4/da/d14/d1a/f1c [3798387,108258] 0 2024-05-06T21:26:52.319 INFO:tasks.workunit.client.0.smithi032.stdout:6/891: dwrite d8/dd/d18/d3b/db9/f9e [0,4194304] 0 2024-05-06T21:26:52.320 INFO:tasks.workunit.client.0.smithi032.stdout:6/892: getdents d8/d3d/d49/dec 0 2024-05-06T21:26:52.320 INFO:tasks.workunit.client.0.smithi032.stdout:6/893: read d8/d3d/d49/d6b/f8a [3191218,53869] 0 2024-05-06T21:26:52.320 INFO:tasks.workunit.client.1.smithi154.stdout:5/661: symlink d2/d3/d21/d95/dc/d68/le4 0 2024-05-06T21:26:52.323 INFO:tasks.workunit.client.1.smithi154.stdout:2/585: mknod db/de/d16/dae/cb8 0 2024-05-06T21:26:52.323 INFO:tasks.workunit.client.1.smithi154.stdout:8/563: dread d3/f8 [0,4194304] 0 2024-05-06T21:26:52.324 INFO:tasks.workunit.client.1.smithi154.stdout:8/564: truncate d3/d14/d1a/d29/d68/f23 4559513 0 2024-05-06T21:26:52.324 INFO:tasks.workunit.client.1.smithi154.stdout:8/565: write d3/d14/d1a/d29/d68/d6b/fa6 [279132,112516] 0 2024-05-06T21:26:52.326 INFO:tasks.workunit.client.1.smithi154.stdout:2/586: rename db/de/d16/d4f/c40 to db/de/d16/d33/cb9 0 2024-05-06T21:26:52.326 INFO:tasks.workunit.client.1.smithi154.stdout:8/566: dread d3/d14/d1a/d29/d32/d40/d59/f55 [0,4194304] 0 2024-05-06T21:26:52.326 INFO:tasks.workunit.client.0.smithi032.stdout:1/870: dwrite db/d47/d4a/da4/f2f [0,4194304] 0 2024-05-06T21:26:52.329 INFO:tasks.workunit.client.1.smithi154.stdout:8/567: mkdir d3/d64/d6d/db7 0 2024-05-06T21:26:52.330 INFO:tasks.workunit.client.1.smithi154.stdout:8/568: write d3/d14/d1a/d29/d32/d40/d79/f4e [1192988,109805] 0 2024-05-06T21:26:52.330 INFO:tasks.workunit.client.1.smithi154.stdout:8/569: stat d3/d14/d1a/d29/d32/cb2 0 2024-05-06T21:26:52.332 INFO:tasks.workunit.client.1.smithi154.stdout:8/570: symlink d3/d14/d1a/d29/lb8 0 2024-05-06T21:26:52.333 INFO:tasks.workunit.client.1.smithi154.stdout:8/571: chown d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/la8 0 1 2024-05-06T21:26:52.333 INFO:tasks.workunit.client.1.smithi154.stdout:8/572: fsync d3/fd 0 2024-05-06T21:26:52.333 INFO:tasks.workunit.client.1.smithi154.stdout:8/573: truncate d3/d14/d1a/d29/d32/d40/d79/d90/f8c 2240558 0 2024-05-06T21:26:52.333 INFO:tasks.workunit.client.1.smithi154.stdout:8/574: fsync d3/d14/d1a/d29/d68/d61/f81 0 2024-05-06T21:26:52.333 INFO:tasks.workunit.client.1.smithi154.stdout:5/662: write d2/d3/f6d [742042,84438] 0 2024-05-06T21:26:52.334 INFO:tasks.workunit.client.1.smithi154.stdout:8/575: mknod d3/d14/d1a/d29/d32/d40/d79/d90/cb9 0 2024-05-06T21:26:52.334 INFO:tasks.workunit.client.1.smithi154.stdout:8/576: dread - d3/d14/d1a/d29/d3e/faa zero size 2024-05-06T21:26:52.335 INFO:tasks.workunit.client.1.smithi154.stdout:8/577: readlink d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/l98 0 2024-05-06T21:26:52.336 INFO:tasks.workunit.client.1.smithi154.stdout:8/578: write d3/d14/d1a/d29/d32/d40/d59/f55 [34229,100706] 0 2024-05-06T21:26:52.336 INFO:tasks.workunit.client.0.smithi032.stdout:2/801: symlink df/l111 0 2024-05-06T21:26:52.336 INFO:tasks.workunit.client.0.smithi032.stdout:2/802: write df/d19/d1e/d35/dc5/f2b [1187833,126808] 0 2024-05-06T21:26:52.336 INFO:tasks.workunit.client.0.smithi032.stdout:2/803: chown df/d19/d1e/d42/l53 454429 1 2024-05-06T21:26:52.338 INFO:tasks.workunit.client.0.smithi032.stdout:9/987: dwrite d1/fbb [0,4194304] 0 2024-05-06T21:26:52.338 INFO:tasks.workunit.client.0.smithi032.stdout:9/988: truncate d1/d2f/da1/dc2/d64/d72/f88 131346 0 2024-05-06T21:26:52.338 INFO:tasks.workunit.client.0.smithi032.stdout:3/966: mknod d1/d4/da/d1d/dc0/c140 0 2024-05-06T21:26:52.338 INFO:tasks.workunit.client.0.smithi032.stdout:3/967: stat d1/d4/da/d31/d47/cf7 0 2024-05-06T21:26:52.339 INFO:tasks.workunit.client.1.smithi154.stdout:5/663: link d2/d3/d21/d95/dc/f30 d2/da5/fe5 0 2024-05-06T21:26:52.339 INFO:tasks.workunit.client.1.smithi154.stdout:5/664: fsync d2/d3/f16 0 2024-05-06T21:26:52.341 INFO:tasks.workunit.client.1.smithi154.stdout:5/665: truncate d2/d3/d21/d95/f7 1094505 0 2024-05-06T21:26:52.342 INFO:tasks.workunit.client.1.smithi154.stdout:5/666: mkdir d2/d3/d21/d95/dc/d44/dc0/de6 0 2024-05-06T21:26:52.345 INFO:tasks.workunit.client.0.smithi032.stdout:9/989: write d1/d13/d33/d3f/f135 [2083370,2325] 0 2024-05-06T21:26:52.349 INFO:tasks.workunit.client.0.smithi032.stdout:5/939: rename d0/d16/d2a/d5f/dd6 to d0/d16/d2a/dc7/dd2/db1/d12e 0 2024-05-06T21:26:52.358 INFO:tasks.workunit.client.1.smithi154.stdout:5/667: read d2/d3/d21/d95/f5f [185452,55289] 0 2024-05-06T21:26:52.361 INFO:tasks.workunit.client.1.smithi154.stdout:5/668: symlink d2/d3/le7 0 2024-05-06T21:26:52.361 INFO:tasks.workunit.client.1.smithi154.stdout:5/669: dread - d2/d3/d21/d95/dc/d68/d69/f91 zero size 2024-05-06T21:26:52.374 INFO:tasks.workunit.client.1.smithi154.stdout:2/587: dwrite db/de/d16/f65 [4194304,4194304] 0 2024-05-06T21:26:52.375 INFO:tasks.workunit.client.1.smithi154.stdout:8/579: dwrite d3/d14/d1a/f3c [0,4194304] 0 2024-05-06T21:26:52.376 INFO:tasks.workunit.client.0.smithi032.stdout:0/871: mkdir d4/da/d16/d33/d121 0 2024-05-06T21:26:52.376 INFO:tasks.workunit.client.0.smithi032.stdout:0/872: write d4/da/d14/d4a/f93 [1011482,11470] 0 2024-05-06T21:26:52.376 INFO:tasks.workunit.client.0.smithi032.stdout:0/873: write d4/da/d14/d1a/d66/f87 [92612,21289] 0 2024-05-06T21:26:52.376 INFO:tasks.workunit.client.0.smithi032.stdout:5/940: dwrite d0/d16/d2a/d5f/dca/f4f [0,4194304] 0 2024-05-06T21:26:52.378 INFO:tasks.workunit.client.1.smithi154.stdout:8/580: mknod d3/d64/cba 0 2024-05-06T21:26:52.378 INFO:tasks.workunit.client.1.smithi154.stdout:8/581: chown d3/d14/d1a/d29/d32/d40/d79/d2b/l89 0 1 2024-05-06T21:26:52.378 INFO:tasks.workunit.client.1.smithi154.stdout:8/582: read - d3/d14/d1a/d29/d32/d40/d59/d67/d95/fa5 zero size 2024-05-06T21:26:52.382 INFO:tasks.workunit.client.0.smithi032.stdout:5/941: dread d0/d16/d2f/f41 [0,4194304] 0 2024-05-06T21:26:52.382 INFO:tasks.workunit.client.0.smithi032.stdout:6/894: stat d8/dd/d18/d13/lb1 0 2024-05-06T21:26:52.382 INFO:tasks.workunit.client.1.smithi154.stdout:8/583: mknod d3/d14/d1a/d29/d32/d40/d4b/cbb 0 2024-05-06T21:26:52.384 INFO:tasks.workunit.client.1.smithi154.stdout:8/584: creat d3/d14/d1a/d29/d68/fbc x:0 0 0 2024-05-06T21:26:52.384 INFO:tasks.workunit.client.1.smithi154.stdout:2/588: dread db/de/f99 [4194304,4194304] 0 2024-05-06T21:26:52.384 INFO:tasks.workunit.client.1.smithi154.stdout:8/585: write d3/d14/d1a/d45/f7d [592272,71233] 0 2024-05-06T21:26:52.385 INFO:tasks.workunit.client.1.smithi154.stdout:2/589: truncate db/d12/f43 3497540 0 2024-05-06T21:26:52.386 INFO:tasks.workunit.client.1.smithi154.stdout:8/586: rmdir d3/d14/d1a/d29/d32/d40 39 2024-05-06T21:26:52.389 INFO:tasks.workunit.client.1.smithi154.stdout:2/590: link db/de/d16/f1f db/d12/d19/d7d/fba 0 2024-05-06T21:26:52.390 INFO:tasks.workunit.client.1.smithi154.stdout:2/591: creat db/d12/d1d/d60/fbb x:0 0 0 2024-05-06T21:26:52.404 INFO:tasks.workunit.client.1.smithi154.stdout:8/587: dwrite d3/d14/d1a/d45/f5f [0,4194304] 0 2024-05-06T21:26:52.406 INFO:tasks.workunit.client.0.smithi032.stdout:1/871: getdents db/d16/da3 0 2024-05-06T21:26:52.406 INFO:tasks.workunit.client.0.smithi032.stdout:1/872: chown db/d47/d4a/dcb/df1 8647769 1 2024-05-06T21:26:52.411 INFO:tasks.workunit.client.1.smithi154.stdout:2/592: dwrite db/d12/d1d/f64 [0,4194304] 0 2024-05-06T21:26:52.411 INFO:tasks.workunit.client.1.smithi154.stdout:2/593: write db/de/d16/d33/f4d [8625378,92156] 0 2024-05-06T21:26:52.412 INFO:tasks.workunit.client.0.smithi032.stdout:1/873: dread db/d47/d4a/f66 [0,4194304] 0 2024-05-06T21:26:52.417 INFO:tasks.workunit.client.1.smithi154.stdout:8/588: dread d3/d14/d1a/d29/d3e/f66 [0,4194304] 0 2024-05-06T21:26:52.420 INFO:tasks.workunit.client.1.smithi154.stdout:8/589: rename d3/d14/d1a/d29/d68 to d3/d64/d6d/dbd 0 2024-05-06T21:26:52.423 INFO:tasks.workunit.client.1.smithi154.stdout:8/590: mkdir d3/d14/d1a/d29/d32/d40/d79/d84/dbe 0 2024-05-06T21:26:52.424 INFO:tasks.workunit.client.0.smithi032.stdout:1/874: dread db/d16/d46/d57/d58/d68/fcd [0,4194304] 0 2024-05-06T21:26:52.424 INFO:tasks.workunit.client.1.smithi154.stdout:8/591: creat d3/d14/fbf x:0 0 0 2024-05-06T21:26:52.425 INFO:tasks.workunit.client.1.smithi154.stdout:8/592: creat d3/d14/d1a/d29/d32/d40/d79/d84/da4/fc0 x:0 0 0 2024-05-06T21:26:52.427 INFO:tasks.workunit.client.1.smithi154.stdout:8/593: mkdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/dc1 0 2024-05-06T21:26:52.427 INFO:tasks.workunit.client.1.smithi154.stdout:8/594: truncate d3/d14/d1a/d45/f93 40452 0 2024-05-06T21:26:52.427 INFO:tasks.workunit.client.1.smithi154.stdout:8/595: read - d3/d14/d1a/d29/d32/d40/d59/d67/d94/fa9 zero size 2024-05-06T21:26:52.427 INFO:tasks.workunit.client.1.smithi154.stdout:8/596: write d3/d14/d1a/d29/d32/d40/d79/f9d [616578,115264] 0 2024-05-06T21:26:52.429 INFO:tasks.workunit.client.1.smithi154.stdout:8/597: rename d3/d14/d1a/d29/d32/d40/d59/d67/da7/fad to d3/d14/d1a/d29/d32/d40/d59/d67/fc2 0 2024-05-06T21:26:52.429 INFO:tasks.workunit.client.1.smithi154.stdout:8/598: write d3/d56/f8b [8959676,95435] 0 2024-05-06T21:26:52.429 INFO:tasks.workunit.client.1.smithi154.stdout:8/599: truncate d3/d64/d6d/dbd/d61/f81 703387 0 2024-05-06T21:26:52.429 INFO:tasks.workunit.client.1.smithi154.stdout:2/594: dwrite db/d12/d1d/d60/fa1 [0,4194304] 0 2024-05-06T21:26:52.430 INFO:tasks.workunit.client.1.smithi154.stdout:2/595: truncate db/d12/f37 1009768 0 2024-05-06T21:26:52.430 INFO:tasks.workunit.client.1.smithi154.stdout:2/596: dread - db/de/d16/d33/f79 zero size 2024-05-06T21:26:52.431 INFO:tasks.workunit.client.0.smithi032.stdout:3/968: mknod d1/d4/da/d31/d9b/d125/db8/dd0/dd9/c141 0 2024-05-06T21:26:52.433 INFO:tasks.workunit.client.1.smithi154.stdout:8/600: rename d3/fd to d3/d64/fc3 0 2024-05-06T21:26:52.433 INFO:tasks.workunit.client.0.smithi032.stdout:0/874: link d4/d3e/d42/c83 d4/d3e/d63/dca/c122 0 2024-05-06T21:26:52.434 INFO:tasks.workunit.client.0.smithi032.stdout:5/942: truncate d0/fb 1487786 0 2024-05-06T21:26:52.435 INFO:tasks.workunit.client.0.smithi032.stdout:6/895: mkdir d8/d3d/d49/dad/d10b 0 2024-05-06T21:26:52.435 INFO:tasks.workunit.client.1.smithi154.stdout:2/597: mkdir db/de/d10/dbc 0 2024-05-06T21:26:52.436 INFO:tasks.workunit.client.0.smithi032.stdout:1/875: creat db/dc8/f117 x:0 0 0 2024-05-06T21:26:52.439 INFO:tasks.workunit.client.0.smithi032.stdout:6/896: unlink d8/d3d/d49/d6b/d10a/f3a 0 2024-05-06T21:26:52.443 INFO:tasks.workunit.client.1.smithi154.stdout:2/598: mkdir db/d86/dbd 0 2024-05-06T21:26:52.443 INFO:tasks.workunit.client.1.smithi154.stdout:2/599: truncate db/d12/d19/d4b/d78/f9f 164061 0 2024-05-06T21:26:52.444 INFO:tasks.workunit.client.1.smithi154.stdout:2/600: truncate db/de/d16/d4f/f8f 1661618 0 2024-05-06T21:26:52.445 INFO:tasks.workunit.client.1.smithi154.stdout:8/601: write d3/d14/d1a/d29/d32/d40/d59/f41 [226698,48568] 0 2024-05-06T21:26:52.445 INFO:tasks.workunit.client.1.smithi154.stdout:8/602: fsync d3/d14/d1a/d29/d43/fa0 0 2024-05-06T21:26:52.446 INFO:tasks.workunit.client.0.smithi032.stdout:6/897: creat d8/d3d/d49/dad/d10b/f10c x:0 0 0 2024-05-06T21:26:52.446 INFO:tasks.workunit.client.0.smithi032.stdout:6/898: chown d8/d3d/d49/d6b/d10a/cbf 1 1 2024-05-06T21:26:52.447 INFO:tasks.workunit.client.1.smithi154.stdout:2/601: unlink db/d12/d19/c24 0 2024-05-06T21:26:52.449 INFO:tasks.workunit.client.1.smithi154.stdout:8/603: mknod d3/d14/d1a/d29/d32/d40/d59/d67/da7/db3/db4/cc4 0 2024-05-06T21:26:52.449 INFO:tasks.workunit.client.0.smithi032.stdout:6/899: truncate d8/dd/d1b/d67/fc9 1835687 0 2024-05-06T21:26:52.451 INFO:tasks.workunit.client.1.smithi154.stdout:8/604: creat d3/d14/d1a/fc5 x:0 0 0 2024-05-06T21:26:52.451 INFO:tasks.workunit.client.1.smithi154.stdout:8/605: readlink d3/d14/l57 0 2024-05-06T21:26:52.453 INFO:tasks.workunit.client.0.smithi032.stdout:6/900: dread d8/d3d/d49/f76 [0,4194304] 0 2024-05-06T21:26:52.453 INFO:tasks.workunit.client.0.smithi032.stdout:6/901: stat d8/dd/d18/dda 0 2024-05-06T21:26:52.454 INFO:tasks.workunit.client.0.smithi032.stdout:6/902: chown d8/dd/d18/d13/ce9 0 1 2024-05-06T21:26:52.454 INFO:tasks.workunit.client.0.smithi032.stdout:6/903: stat d8/dd/d1b/f9d 0 2024-05-06T21:26:52.454 INFO:tasks.workunit.client.0.smithi032.stdout:6/904: chown d8/dd/d18/d3b/db9/c6e 1826539 1 2024-05-06T21:26:52.454 INFO:tasks.workunit.client.0.smithi032.stdout:6/905: truncate d8/dd/d1b/d67/f85 941664 0 2024-05-06T21:26:52.454 INFO:tasks.workunit.client.0.smithi032.stdout:6/906: write d8/d3d/d49/d6b/d10a/db4/fcb [960770,13164] 0 2024-05-06T21:26:52.455 INFO:tasks.workunit.client.1.smithi154.stdout:8/606: mknod d3/d14/d1a/d29/d32/cc6 0 2024-05-06T21:26:52.455 INFO:tasks.workunit.client.1.smithi154.stdout:8/607: write d3/d14/d1a/d29/da3/fac [133628,126270] 0 2024-05-06T21:26:52.455 INFO:tasks.workunit.client.1.smithi154.stdout:8/608: creat d3/d14/d1a/d29/d32/d40/d4b/fc7 x:0 0 0 2024-05-06T21:26:52.455 INFO:tasks.workunit.client.0.smithi032.stdout:6/907: rmdir d8/d3d/d49/d6b/d10a/db4 39 2024-05-06T21:26:52.465 INFO:tasks.workunit.client.0.smithi032.stdout:3/969: dwrite d1/d4/da/d4e/dd3/dd6/f124 [0,4194304] 0 2024-05-06T21:26:52.465 INFO:tasks.workunit.client.0.smithi032.stdout:3/970: write d1/d4/d11/f116 [103685,77890] 0 2024-05-06T21:26:52.465 INFO:tasks.workunit.client.0.smithi032.stdout:3/971: chown d1/d4/da/d31/d47/d4a/d68/lec 15004 1 2024-05-06T21:26:52.469 INFO:tasks.workunit.client.0.smithi032.stdout:6/908: symlink d8/d3d/l10d 0 2024-05-06T21:26:52.472 INFO:tasks.workunit.client.0.smithi032.stdout:5/943: dwrite d0/d16/d2a/d5f/d9a/f97 [0,4194304] 0 2024-05-06T21:26:52.472 INFO:tasks.workunit.client.0.smithi032.stdout:5/944: read - d0/d16/d46/da9/f11c zero size 2024-05-06T21:26:52.473 INFO:tasks.workunit.client.0.smithi032.stdout:6/909: symlink d8/dd/d18/d13/d1d/l10e 0 2024-05-06T21:26:52.473 INFO:tasks.workunit.client.0.smithi032.stdout:6/910: chown d8/db6/ce1 53508285 1 2024-05-06T21:26:52.473 INFO:tasks.workunit.client.0.smithi032.stdout:0/875: dwrite d4/da/d16/d33/d9e/dc9/f10f [0,4194304] 0 2024-05-06T21:26:52.478 INFO:tasks.workunit.client.0.smithi032.stdout:6/911: dread d8/dd/f12 [0,4194304] 0 2024-05-06T21:26:52.478 INFO:tasks.workunit.client.0.smithi032.stdout:6/912: dread - d8/fc8 zero size 2024-05-06T21:26:52.478 INFO:tasks.workunit.client.0.smithi032.stdout:0/876: creat d4/f123 x:0 0 0 2024-05-06T21:26:52.485 INFO:tasks.workunit.client.1.smithi154.stdout:8/609: dwrite d3/d64/d6d/dbd/f3a [0,4194304] 0 2024-05-06T21:26:52.485 INFO:tasks.workunit.client.1.smithi154.stdout:8/610: readlink d3/d14/d1a/d29/l7b 0 2024-05-06T21:26:52.485 INFO:tasks.workunit.client.1.smithi154.stdout:8/611: creat d3/d14/d1a/d29/d32/d40/d79/d84/da4/fc8 x:0 0 0 2024-05-06T21:26:52.485 INFO:tasks.workunit.client.1.smithi154.stdout:8/612: read - d3/d14/d1a/d29/d32/d40/d4b/fc7 zero size 2024-05-06T21:26:52.485 INFO:tasks.workunit.client.1.smithi154.stdout:8/613: fsync d3/d14/d1a/d29/d32/d40/d59/d67/fc2 0 2024-05-06T21:26:52.485 INFO:tasks.workunit.client.1.smithi154.stdout:8/614: fdatasync d3/d64/d6d/dbd/fbc 0 2024-05-06T21:26:52.486 INFO:tasks.workunit.client.0.smithi032.stdout:6/913: dread d8/dd/d1b/d67/fa6 [0,4194304] 0 2024-05-06T21:26:52.486 INFO:tasks.workunit.client.0.smithi032.stdout:6/914: chown d8/db6/cc4 85532 1 2024-05-06T21:26:52.487 INFO:tasks.workunit.client.0.smithi032.stdout:3/972: dwrite d1/d4/da/d4e/d5e/f6d [0,4194304] 0 2024-05-06T21:26:52.487 INFO:tasks.workunit.client.0.smithi032.stdout:3/973: write d1/d4/ffc [702639,84129] 0 2024-05-06T21:26:52.488 INFO:tasks.workunit.client.1.smithi154.stdout:8/615: chown d3/d14/d1a/d29/d32/l37 55966979 1 2024-05-06T21:26:52.488 INFO:tasks.workunit.client.1.smithi154.stdout:8/616: stat d3/d14/d1a/d29/d32/d40/d59/d67/d95/fa5 0 2024-05-06T21:26:52.491 INFO:tasks.workunit.client.1.smithi154.stdout:8/617: write d3/d38/f63 [54795,29747] 0 2024-05-06T21:26:52.491 INFO:tasks.workunit.client.0.smithi032.stdout:7/931: rename db/d12/d16/d2a/d39/d3b/d9c/la9 to db/d12/d16/d21/dcb/l127 0 2024-05-06T21:26:52.492 INFO:tasks.workunit.client.0.smithi032.stdout:5/945: dwrite d0/d24/d38/d37/da6/fd9 [0,4194304] 0 2024-05-06T21:26:52.495 INFO:tasks.workunit.client.0.smithi032.stdout:2/804: rename df/d19/d1e/d42/dc6/c6b to df/d19/d1e/d71/d5f/d7d/d25/d2d/c112 0 2024-05-06T21:26:52.495 INFO:tasks.workunit.client.0.smithi032.stdout:2/805: write df/d19/d1e/d35/d3f/f68 [4407555,23456] 0 2024-05-06T21:26:52.496 INFO:tasks.workunit.client.0.smithi032.stdout:7/932: creat db/d12/d16/da1/f128 x:0 0 0 2024-05-06T21:26:52.496 INFO:tasks.workunit.client.0.smithi032.stdout:7/933: dread - db/d12/d16/d2a/d39/d3b/fe1 zero size 2024-05-06T21:26:52.496 INFO:tasks.workunit.client.0.smithi032.stdout:7/934: dread - db/d12/d16/d2a/fe6 zero size 2024-05-06T21:26:52.496 INFO:tasks.workunit.client.0.smithi032.stdout:7/935: truncate db/d12/d49/d97/f98 759571 0 2024-05-06T21:26:52.500 INFO:tasks.workunit.client.0.smithi032.stdout:1/876: rename db/d47/fe8 to db/d16/d46/d57/d58/d68/f118 0 2024-05-06T21:26:52.500 INFO:tasks.workunit.client.0.smithi032.stdout:1/877: write db/d47/d4a/f95 [5026223,22800] 0 2024-05-06T21:26:52.505 INFO:tasks.workunit.client.0.smithi032.stdout:7/936: unlink db/d12/f51 0 2024-05-06T21:26:52.506 INFO:tasks.workunit.client.0.smithi032.stdout:0/877: rename d4/cc6 to d4/da/d14/d1a/d66/c124 0 2024-05-06T21:26:52.507 INFO:tasks.workunit.client.0.smithi032.stdout:3/974: dwrite d1/d4/da/d31/d9b/d125/d74/f102 [0,4194304] 0 2024-05-06T21:26:52.507 INFO:tasks.workunit.client.0.smithi032.stdout:3/975: getdents d1/d4/da/d31/d9b/d121/d134/de7/dff 0 2024-05-06T21:26:52.510 INFO:tasks.workunit.client.0.smithi032.stdout:1/878: symlink db/d47/d4a/dcb/df1/l119 0 2024-05-06T21:26:52.510 INFO:tasks.workunit.client.0.smithi032.stdout:1/879: fsync db/d16/d5d/fd8 0 2024-05-06T21:26:52.515 INFO:tasks.workunit.client.1.smithi154.stdout:0/735: sync 2024-05-06T21:26:52.515 INFO:tasks.workunit.client.0.smithi032.stdout:7/937: dread db/d12/d16/f57 [0,4194304] 0 2024-05-06T21:26:52.515 INFO:tasks.workunit.client.0.smithi032.stdout:7/938: stat db/f77 0 2024-05-06T21:26:52.515 INFO:tasks.workunit.client.0.smithi032.stdout:0/878: rename d4/l19 to d4/da/d14/d1a/d66/d8a/l125 0 2024-05-06T21:26:52.515 INFO:tasks.workunit.client.0.smithi032.stdout:0/879: readlink d4/da/d14/l7c 0 2024-05-06T21:26:52.521 INFO:tasks.workunit.client.0.smithi032.stdout:3/976: creat d1/d2a/d71/d9d/da9/f142 x:0 0 0 2024-05-06T21:26:52.526 INFO:tasks.workunit.client.1.smithi154.stdout:8/618: dwrite d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f9e [4194304,4194304] 0 2024-05-06T21:26:52.527 INFO:tasks.workunit.client.0.smithi032.stdout:1/880: creat db/d47/d4a/dcb/f11a x:0 0 0 2024-05-06T21:26:52.527 INFO:tasks.workunit.client.0.smithi032.stdout:1/881: stat db/d16/d46/d57/d58/d68/c91 0 2024-05-06T21:26:52.531 INFO:tasks.workunit.client.0.smithi032.stdout:3/977: getdents d1/d4/da/d31/d9b/d125/d74/db1/df1 0 2024-05-06T21:26:52.533 INFO:tasks.workunit.client.0.smithi032.stdout:2/806: dwrite df/d19/d1e/d71/d5f/d73/df1/f10c [0,4194304] 0 2024-05-06T21:26:52.533 INFO:tasks.workunit.client.0.smithi032.stdout:2/807: write df/d19/d1e/d71/d5f/d7d/d65/d78/f8d [1428603,4387] 0 2024-05-06T21:26:52.533 INFO:tasks.workunit.client.0.smithi032.stdout:2/808: read df/d19/d1e/d35/dc5/fab [175125,8975] 0 2024-05-06T21:26:52.533 INFO:tasks.workunit.client.0.smithi032.stdout:1/882: getdents db/d47/d70 0 2024-05-06T21:26:52.534 INFO:tasks.workunit.client.0.smithi032.stdout:7/939: unlink db/d12/d16/d21/ca8 0 2024-05-06T21:26:52.534 INFO:tasks.workunit.client.0.smithi032.stdout:7/940: fdatasync db/d12/d16/d21/d41/f99 0 2024-05-06T21:26:52.536 INFO:tasks.workunit.client.0.smithi032.stdout:7/941: dread db/d12/d16/d2a/d39/d3b/fce [0,4194304] 0 2024-05-06T21:26:52.537 INFO:tasks.workunit.client.0.smithi032.stdout:1/883: rmdir db/d47 39 2024-05-06T21:26:52.540 INFO:tasks.workunit.client.0.smithi032.stdout:7/942: unlink ca 0 2024-05-06T21:26:52.540 INFO:tasks.workunit.client.0.smithi032.stdout:7/943: dread - db/d12/d16/d21/d41/fa6 zero size 2024-05-06T21:26:52.540 INFO:tasks.workunit.client.0.smithi032.stdout:7/944: fsync db/d12/d87/fb1 0 2024-05-06T21:26:52.540 INFO:tasks.workunit.client.0.smithi032.stdout:7/945: fdatasync db/d12/d16/d21/d41/f115 0 2024-05-06T21:26:52.541 INFO:tasks.workunit.client.0.smithi032.stdout:2/809: getdents df/d19/d1e/d71/d5f 0 2024-05-06T21:26:52.542 INFO:tasks.workunit.client.0.smithi032.stdout:2/810: stat df/d19/d1e/d71/d5f/d7d/d25/f9d 0 2024-05-06T21:26:52.542 INFO:tasks.workunit.client.0.smithi032.stdout:7/946: dread db/d12/d87/fb1 [0,4194304] 0 2024-05-06T21:26:52.542 INFO:tasks.workunit.client.0.smithi032.stdout:7/947: write db/d12/d49/f6f [1792137,99195] 0 2024-05-06T21:26:52.548 INFO:tasks.workunit.client.0.smithi032.stdout:9/990: dwrite d1/d2f/f37 [0,4194304] 0 2024-05-06T21:26:52.549 INFO:tasks.workunit.client.0.smithi032.stdout:3/978: dread d1/d4/da/d31/d9b/d121/d134/d43/fbb [0,4194304] 0 2024-05-06T21:26:52.549 INFO:tasks.workunit.client.0.smithi032.stdout:3/979: truncate d1/d4/da/d31/d9b/daa/fd4 1259720 0 2024-05-06T21:26:52.550 INFO:tasks.workunit.client.0.smithi032.stdout:3/980: write d1/d4/da/d31/d9b/d121/d134/d43/f110 [4453788,76764] 0 2024-05-06T21:26:52.550 INFO:tasks.workunit.client.0.smithi032.stdout:3/981: chown d1/d4/da/d31/d9b/d121/d134/d43/f110 84754 1 2024-05-06T21:26:52.555 INFO:tasks.workunit.client.0.smithi032.stdout:9/991: mkdir d1/d2f/da1/dc2/da0/d102/d106/d14a 0 2024-05-06T21:26:52.555 INFO:tasks.workunit.client.0.smithi032.stdout:9/992: write d1/d13/d33/d3f/f124 [588693,68465] 0 2024-05-06T21:26:52.556 INFO:tasks.workunit.client.1.smithi154.stdout:0/736: dwrite d6/dc/d40/d5e/fab [0,4194304] 0 2024-05-06T21:26:52.557 INFO:tasks.workunit.client.0.smithi032.stdout:3/982: rename d1/d4/da/d31/d9b/d125/db8/dd0/cdc to d1/d4/da/d31/d9b/d121/d134/d45/c143 0 2024-05-06T21:26:52.558 INFO:tasks.workunit.client.0.smithi032.stdout:2/811: write df/d19/d1e/d42/dc6/dc1/fdb [310296,53535] 0 2024-05-06T21:26:52.559 INFO:tasks.workunit.client.0.smithi032.stdout:3/983: getdents d1/d4/da/d4e 0 2024-05-06T21:26:52.559 INFO:tasks.workunit.client.0.smithi032.stdout:6/915: dread d8/dd/d1b/d67/fc9 [0,4194304] 0 2024-05-06T21:26:52.559 INFO:tasks.workunit.client.0.smithi032.stdout:0/880: dwrite d4/d3e/d63/fd5 [0,4194304] 0 2024-05-06T21:26:52.559 INFO:tasks.workunit.client.0.smithi032.stdout:0/881: write d4/d3e/d63/d8d/f99 [179782,11845] 0 2024-05-06T21:26:52.559 INFO:tasks.workunit.client.0.smithi032.stdout:2/812: mkdir df/d19/d1e/d42/d113 0 2024-05-06T21:26:52.562 INFO:tasks.workunit.client.0.smithi032.stdout:0/882: rename d4/da/d16/d33/d108 to d4/da/d14/d1a/d66/d126 0 2024-05-06T21:26:52.563 INFO:tasks.workunit.client.0.smithi032.stdout:0/883: truncate d4/d3e/d63/d6c/d8f/dc2/fff 414004 0 2024-05-06T21:26:52.565 INFO:tasks.workunit.client.0.smithi032.stdout:9/993: write d1/d2f/fcf [2813216,123470] 0 2024-05-06T21:26:52.565 INFO:tasks.workunit.client.0.smithi032.stdout:3/984: dread d1/d2a/f8d [0,4194304] 0 2024-05-06T21:26:52.565 INFO:tasks.workunit.client.0.smithi032.stdout:0/884: creat d4/da/d98/f127 x:0 0 0 2024-05-06T21:26:52.567 INFO:tasks.workunit.client.0.smithi032.stdout:0/885: creat d4/d3e/d63/dca/f128 x:0 0 0 2024-05-06T21:26:52.570 INFO:tasks.workunit.client.1.smithi154.stdout:0/737: dread d6/dc/d51/d54/f84 [0,4194304] 0 2024-05-06T21:26:52.570 INFO:tasks.workunit.client.1.smithi154.stdout:8/619: dwrite d3/d14/d1a/d29/d43/fa0 [0,4194304] 0 2024-05-06T21:26:52.571 INFO:tasks.workunit.client.0.smithi032.stdout:7/948: dwrite db/d12/d16/d21/f44 [4194304,4194304] 0 2024-05-06T21:26:52.571 INFO:tasks.workunit.client.0.smithi032.stdout:3/985: write d1/d4/da/d1d/f42 [1265347,78612] 0 2024-05-06T21:26:52.571 INFO:tasks.workunit.client.0.smithi032.stdout:3/986: write d1/d4/da/d31/d9b/d125/d74/db1/df1/d113/fa2 [791064,113986] 0 2024-05-06T21:26:52.571 INFO:tasks.workunit.client.0.smithi032.stdout:3/987: fsync d1/d4/da/d4e/d5e/d84/ff0 0 2024-05-06T21:26:52.571 INFO:tasks.workunit.client.0.smithi032.stdout:1/884: dwrite db/d16/d46/d57/d58/d68/fc4 [0,4194304] 0 2024-05-06T21:26:52.572 INFO:tasks.workunit.client.1.smithi154.stdout:0/738: mkdir d6/dc/d40/d4a/d6c/dce/df2 0 2024-05-06T21:26:52.572 INFO:tasks.workunit.client.0.smithi032.stdout:7/949: stat db/d12/d16/d21/ld8 0 2024-05-06T21:26:52.574 INFO:tasks.workunit.client.0.smithi032.stdout:9/994: read d1/d13/d33/da6/ff7 [1049024,8586] 0 2024-05-06T21:26:52.575 INFO:tasks.workunit.client.0.smithi032.stdout:3/988: symlink d1/d4/da/d31/d9b/l144 0 2024-05-06T21:26:52.576 INFO:tasks.workunit.client.0.smithi032.stdout:9/995: truncate d1/d13/d33/d3f/d60/fbd 1508940 0 2024-05-06T21:26:52.577 INFO:tasks.workunit.client.0.smithi032.stdout:3/989: dread d1/d2a/f8d [0,4194304] 0 2024-05-06T21:26:52.577 INFO:tasks.workunit.client.0.smithi032.stdout:3/990: stat d1/d4/da/d4e/dd3 0 2024-05-06T21:26:52.577 INFO:tasks.workunit.client.0.smithi032.stdout:3/991: write d1/d4/da/d31/d9b/d121/d134/d45/f4d [1799326,107537] 0 2024-05-06T21:26:52.577 INFO:tasks.workunit.client.0.smithi032.stdout:3/992: fdatasync d1/f5d 0 2024-05-06T21:26:52.577 INFO:tasks.workunit.client.1.smithi154.stdout:8/620: unlink d3/d64/fc3 0 2024-05-06T21:26:52.578 INFO:tasks.workunit.client.1.smithi154.stdout:0/739: mknod d6/dc/d39/de0/cf3 0 2024-05-06T21:26:52.578 INFO:tasks.workunit.client.1.smithi154.stdout:0/740: read - d6/dc/d39/f9a zero size 2024-05-06T21:26:52.578 INFO:tasks.workunit.client.1.smithi154.stdout:0/741: fdatasync d6/d27/fae 0 2024-05-06T21:26:52.580 INFO:tasks.workunit.client.1.smithi154.stdout:8/621: creat d3/d14/d1a/d29/d32/d40/d4b/d4d/fc9 x:0 0 0 2024-05-06T21:26:52.580 INFO:tasks.workunit.client.0.smithi032.stdout:3/993: mkdir d1/d4/da/d31/d47/d4a/d68/d7c/d145 0 2024-05-06T21:26:52.582 INFO:tasks.workunit.client.1.smithi154.stdout:8/622: mknod d3/d14/d1a/d29/da3/cca 0 2024-05-06T21:26:52.583 INFO:tasks.workunit.client.1.smithi154.stdout:8/623: truncate d3/d14/d1a/d29/d32/d40/d79/f4e 413399 0 2024-05-06T21:26:52.583 INFO:tasks.workunit.client.0.smithi032.stdout:3/994: rmdir d1/d4/da/d31 39 2024-05-06T21:26:52.583 INFO:tasks.workunit.client.0.smithi032.stdout:3/995: creat d1/d4/da/d31/d9b/d125/d74/db1/f146 x:0 0 0 2024-05-06T21:26:52.585 INFO:tasks.workunit.client.0.smithi032.stdout:7/950: dread db/d12/f19 [0,4194304] 0 2024-05-06T21:26:52.585 INFO:tasks.workunit.client.0.smithi032.stdout:6/916: dwrite d8/d3d/d73/d87/f4d [0,4194304] 0 2024-05-06T21:26:52.585 INFO:tasks.workunit.client.1.smithi154.stdout:8/624: symlink d3/d64/d6d/lcb 0 2024-05-06T21:26:52.587 INFO:tasks.workunit.client.0.smithi032.stdout:9/996: rmdir d1/d2f/d4f/d132 0 2024-05-06T21:26:52.587 INFO:tasks.workunit.client.0.smithi032.stdout:9/997: chown d1/d13/d33/d3f/d60 46 1 2024-05-06T21:26:52.587 INFO:tasks.workunit.client.0.smithi032.stdout:9/998: truncate d1/d2f/da1/dc2/d59/f65 936740 0 2024-05-06T21:26:52.590 INFO:tasks.workunit.client.0.smithi032.stdout:1/885: write db/f29 [645785,98389] 0 2024-05-06T21:26:52.590 INFO:tasks.workunit.client.0.smithi032.stdout:1/886: truncate db/faf 184976 0 2024-05-06T21:26:52.591 INFO:tasks.workunit.client.0.smithi032.stdout:2/813: dwrite df/d19/d1e/d35/dc5/d2e/d33/fb0 [0,4194304] 0 2024-05-06T21:26:52.591 INFO:tasks.workunit.client.0.smithi032.stdout:7/951: symlink db/d12/l129 0 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:1/661: sync 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:3/791: sync 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:4/621: sync 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:6/493: sync 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:7/521: sync 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:9/709: sync 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:4/622: chown d0/d82/d44/d73/d9a/lb2 3957170 1 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:1/662: chown d6/db/d10/f77 627925 1 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:7/522: write d6/d20/d40/d52/f88 [1370992,31787] 0 2024-05-06T21:26:52.592 INFO:tasks.workunit.client.1.smithi154.stdout:7/523: readlink d6/d42/d6c/d6e/d21/d2e/l3d 0 2024-05-06T21:26:52.593 INFO:tasks.workunit.client.0.smithi032.stdout:7/952: write db/d12/d16/d21/d41/d78/fbc [91930,99717] 0 2024-05-06T21:26:52.593 INFO:tasks.workunit.client.0.smithi032.stdout:9/999: dread d1/d2f/da1/dc2/da0/fb1 [0,4194304] 0 2024-05-06T21:26:52.595 INFO:tasks.workunit.client.0.smithi032.stdout:6/917: mknod d8/d3d/d49/dd9/c10f 0 2024-05-06T21:26:52.595 INFO:tasks.workunit.client.0.smithi032.stdout:2/814: write f7 [902482,127332] 0 2024-05-06T21:26:52.595 INFO:tasks.workunit.client.0.smithi032.stdout:6/918: write d8/dd/d18/dda/ff7 [344814,127235] 0 2024-05-06T21:26:52.595 INFO:tasks.workunit.client.0.smithi032.stdout:6/919: fdatasync d8/dd/d18/d3b/fcf 0 2024-05-06T21:26:52.595 INFO:tasks.workunit.client.0.smithi032.stdout:2/815: stat df/d19/d1e/d54/l55 0 2024-05-06T21:26:52.596 INFO:tasks.workunit.client.1.smithi154.stdout:3/792: dread d0/da/d1a/d28/d17/f4f [0,4194304] 0 2024-05-06T21:26:52.596 INFO:tasks.workunit.client.1.smithi154.stdout:6/494: creat d8/d11/d2d/d3d/d70/d7b/d95/f9a x:0 0 0 2024-05-06T21:26:52.596 INFO:tasks.workunit.client.0.smithi032.stdout:2/816: read df/d19/d1e/d71/d5f/d73/f10f [237455,100973] 0 2024-05-06T21:26:52.596 INFO:tasks.workunit.client.0.smithi032.stdout:2/817: dread - df/d19/d1e/d35/dc5/d2e/d33/fa5 zero size 2024-05-06T21:26:52.597 INFO:tasks.workunit.client.1.smithi154.stdout:4/623: dread d0/d10/d11/f21 [0,4194304] 0 2024-05-06T21:26:52.597 INFO:tasks.workunit.client.1.smithi154.stdout:4/624: creat d0/d2/d29/fd0 x:0 0 0 2024-05-06T21:26:52.597 INFO:tasks.workunit.client.1.smithi154.stdout:4/625: chown d0/d10/f38 3514979 1 2024-05-06T21:26:52.597 INFO:tasks.workunit.client.1.smithi154.stdout:1/663: rename d6/d3e/f6d to d6/db/d97/fca 0 2024-05-06T21:26:52.599 INFO:tasks.workunit.client.1.smithi154.stdout:9/710: mknod d5/d14/daf/cf5 0 2024-05-06T21:26:52.599 INFO:tasks.workunit.client.1.smithi154.stdout:9/711: read d5/d2e/d8b/fd2 [169512,81613] 0 2024-05-06T21:26:52.601 INFO:tasks.workunit.client.1.smithi154.stdout:7/524: creat d6/fa5 x:0 0 0 2024-05-06T21:26:52.601 INFO:tasks.workunit.client.1.smithi154.stdout:7/525: write d6/d20/d40/d52/f91 [544713,37652] 0 2024-05-06T21:26:52.602 INFO:tasks.workunit.client.1.smithi154.stdout:6/495: mknod d8/d11/d2d/d3d/d70/d7b/c9b 0 2024-05-06T21:26:52.603 INFO:tasks.workunit.client.0.smithi032.stdout:1/887: symlink db/d37/d93/l11b 0 2024-05-06T21:26:52.604 INFO:tasks.workunit.client.1.smithi154.stdout:3/793: dread d0/da/db/dd/d1c/d21/d37/fc1 [0,4194304] 0 2024-05-06T21:26:52.605 INFO:tasks.workunit.client.1.smithi154.stdout:4/626: creat d0/d82/d39/d54/fd1 x:0 0 0 2024-05-06T21:26:52.605 INFO:tasks.workunit.client.1.smithi154.stdout:4/627: getdents d0/d2/dbd 0 2024-05-06T21:26:52.605 INFO:tasks.workunit.client.1.smithi154.stdout:9/712: dread d5/d20/f81 [0,4194304] 0 2024-05-06T21:26:52.605 INFO:tasks.workunit.client.1.smithi154.stdout:9/713: write d5/d20/f4b [1368696,34475] 0 2024-05-06T21:26:52.606 INFO:tasks.workunit.client.0.smithi032.stdout:7/953: getdents db/d12/d16/d2a/d39/d3b/d111 0 2024-05-06T21:26:52.606 INFO:tasks.workunit.client.0.smithi032.stdout:7/954: creat db/d12/d16/da1/f12a x:0 0 0 2024-05-06T21:26:52.606 INFO:tasks.workunit.client.0.smithi032.stdout:7/955: read db/d12/d16/d2a/f5a [3333478,46692] 0 2024-05-06T21:26:52.607 INFO:tasks.workunit.client.1.smithi154.stdout:1/664: rename d6/db/d10/d15/d1d/d53/c92 to d6/db/d10/d26/ccb 0 2024-05-06T21:26:52.607 INFO:tasks.workunit.client.1.smithi154.stdout:1/665: getdents d6/db/d69/dc1 0 2024-05-06T21:26:52.607 INFO:tasks.workunit.client.0.smithi032.stdout:2/818: write df/d19/d1e/d54/f58 [1543171,10129] 0 2024-05-06T21:26:52.608 INFO:tasks.workunit.client.1.smithi154.stdout:3/794: mknod d0/da/c113 0 2024-05-06T21:26:52.609 INFO:tasks.workunit.client.0.smithi032.stdout:6/920: truncate d8/dd/d18/d13/fa7 850962 0 2024-05-06T21:26:52.610 INFO:tasks.workunit.client.1.smithi154.stdout:9/714: mkdir d5/d20/d37/dd5/de1/df6 0 2024-05-06T21:26:52.614 INFO:tasks.workunit.client.1.smithi154.stdout:7/526: rename d6/d42/d6c/d6e/d23/l67 to d6/d20/la6 0 2024-05-06T21:26:52.615 INFO:tasks.workunit.client.1.smithi154.stdout:0/742: dwrite d6/dc/d51/d54/f77 [4194304,4194304] 0 2024-05-06T21:26:52.615 INFO:tasks.workunit.client.0.smithi032.stdout:3/996: dwrite d1/d2a/d71/d9d/fdb [0,4194304] 0 2024-05-06T21:26:52.615 INFO:tasks.workunit.client.0.smithi032.stdout:3/997: chown d1/d4/da/d31/d9b/d121/d134/d45/f137 13891 1 2024-05-06T21:26:52.616 INFO:tasks.workunit.client.1.smithi154.stdout:8/625: dwrite d3/d38/f63 [0,4194304] 0 2024-05-06T21:26:52.616 INFO:tasks.workunit.client.1.smithi154.stdout:8/626: dread - d3/d64/d6d/dbd/fbc zero size 2024-05-06T21:26:52.617 INFO:tasks.workunit.client.1.smithi154.stdout:4/628: mkdir d0/d10/d11/d1a/dd2 0 2024-05-06T21:26:52.620 INFO:tasks.workunit.client.1.smithi154.stdout:9/715: mknod d5/dca/cf7 0 2024-05-06T21:26:52.622 INFO:tasks.workunit.client.1.smithi154.stdout:3/795: rename d0/c5f to d0/da/db/dd/d1c/d21/c114 0 2024-05-06T21:26:52.630 INFO:tasks.workunit.client.1.smithi154.stdout:7/527: dread d6/fb [0,4194304] 0 2024-05-06T21:26:52.631 INFO:tasks.workunit.client.0.smithi032.stdout:1/888: mknod db/d37/d93/c11c 0 2024-05-06T21:26:52.632 INFO:tasks.workunit.client.1.smithi154.stdout:8/627: getdents d3/d14/d1a/d29/d32/d40 0 2024-05-06T21:26:52.633 INFO:tasks.workunit.client.1.smithi154.stdout:1/666: dwrite d6/db/d10/d15/d1d/d53/f43 [0,4194304] 0 2024-05-06T21:26:52.635 INFO:tasks.workunit.client.0.smithi032.stdout:7/956: rmdir db/d12/d16/d2a/d39/d3b/d9c 39 2024-05-06T21:26:52.635 INFO:tasks.workunit.client.0.smithi032.stdout:7/957: creat db/d12/d16/d21/dcb/dd7/f12b x:0 0 0 2024-05-06T21:26:52.636 INFO:tasks.workunit.client.0.smithi032.stdout:2/819: symlink df/d19/d1e/d35/dc5/d2e/d33/l114 0 2024-05-06T21:26:52.637 INFO:tasks.workunit.client.1.smithi154.stdout:0/743: rename d6/dc/d39/f3e to d6/dc/ff4 0 2024-05-06T21:26:52.639 INFO:tasks.workunit.client.1.smithi154.stdout:8/628: mknod d3/d14/d1a/d29/d32/d40/d59/d67/d95/ccc 0 2024-05-06T21:26:52.641 INFO:tasks.workunit.client.1.smithi154.stdout:0/744: write d6/dc/d3c/f7d [4369310,113093] 0 2024-05-06T21:26:52.642 INFO:tasks.workunit.client.1.smithi154.stdout:0/745: truncate d6/dc/f38 1243363 0 2024-05-06T21:26:52.643 INFO:tasks.workunit.client.1.smithi154.stdout:1/667: rmdir d6/db/d5e 39 2024-05-06T21:26:52.643 INFO:tasks.workunit.client.1.smithi154.stdout:1/668: readlink d6/db/d10/d26/l55 0 2024-05-06T21:26:52.643 INFO:tasks.workunit.client.1.smithi154.stdout:1/669: write d6/db/d10/d26/f8f [3307309,107725] 0 2024-05-06T21:26:52.645 INFO:tasks.workunit.client.0.smithi032.stdout:1/889: rename db/d47/d4a/f100 to db/d16/d46/f11d 0 2024-05-06T21:26:52.645 INFO:tasks.workunit.client.0.smithi032.stdout:1/890: chown db/d16/f75 9293649 1 2024-05-06T21:26:52.645 INFO:tasks.workunit.client.1.smithi154.stdout:8/629: rmdir d3/d14/d1a/d6e 39 2024-05-06T21:26:52.646 INFO:tasks.workunit.client.1.smithi154.stdout:8/630: truncate d3/d14/d1a/d29/d32/d40/d59/d67/d94/fa9 514184 0 2024-05-06T21:26:52.647 INFO:tasks.workunit.client.0.smithi032.stdout:1/891: rename db/d16/d5d/le5 to db/d16/d5d/db2/l11e 0 2024-05-06T21:26:52.651 INFO:tasks.workunit.client.1.smithi154.stdout:1/670: link d6/db/d10/d26/l5c d6/d3e/d7e/lcc 0 2024-05-06T21:26:52.651 INFO:tasks.workunit.client.1.smithi154.stdout:8/631: symlink d3/d64/d6d/dbd/d61/lcd 0 2024-05-06T21:26:52.655 INFO:tasks.workunit.client.1.smithi154.stdout:8/632: unlink d3/l30 0 2024-05-06T21:26:52.655 INFO:tasks.workunit.client.1.smithi154.stdout:8/633: write d3/d14/f19 [3540000,11148] 0 2024-05-06T21:26:52.657 INFO:tasks.workunit.client.1.smithi154.stdout:0/746: dread d6/d27/f28 [0,4194304] 0 2024-05-06T21:26:52.658 INFO:tasks.workunit.client.1.smithi154.stdout:8/634: truncate d3/d14/d1a/d29/d32/d40/d79/f88 1837806 0 2024-05-06T21:26:52.658 INFO:tasks.workunit.client.1.smithi154.stdout:1/671: dread d6/d3e/d7e/fb5 [0,4194304] 0 2024-05-06T21:26:52.661 INFO:tasks.workunit.client.1.smithi154.stdout:0/747: symlink d6/dc/d40/d4a/da7/d70/lf5 0 2024-05-06T21:26:52.661 INFO:tasks.workunit.client.1.smithi154.stdout:0/748: chown d6/dc/d40/d4a/da7/d70/d96/dd5 50457769 1 2024-05-06T21:26:52.662 INFO:tasks.workunit.client.0.smithi032.stdout:2/820: dread df/d19/d1e/d35/f3d [0,4194304] 0 2024-05-06T21:26:52.662 INFO:tasks.workunit.client.1.smithi154.stdout:8/635: mkdir d3/d64/d6d/dbd/dce 0 2024-05-06T21:26:52.662 INFO:tasks.workunit.client.1.smithi154.stdout:8/636: stat d3/d14/c2f 0 2024-05-06T21:26:52.663 INFO:tasks.workunit.client.1.smithi154.stdout:1/672: mknod d6/db/d10/d26/d1b/ccd 0 2024-05-06T21:26:52.664 INFO:tasks.workunit.client.0.smithi032.stdout:6/921: dwrite d8/dd/d18/d3b/db9/f83 [0,4194304] 0 2024-05-06T21:26:52.666 INFO:tasks.workunit.client.1.smithi154.stdout:0/749: unlink d6/dc/d39/fc4 0 2024-05-06T21:26:52.668 INFO:tasks.workunit.client.1.smithi154.stdout:8/637: rename d3/d14/d1a/d29/d32/d40/d59/d67/da7/db3 to d3/d14/d1a/d45/dcf 0 2024-05-06T21:26:52.668 INFO:tasks.workunit.client.1.smithi154.stdout:8/638: truncate d3/d14/f19 9278262 0 2024-05-06T21:26:52.668 INFO:tasks.workunit.client.1.smithi154.stdout:8/639: fsync d3/d64/d6d/dbd/f3a 0 2024-05-06T21:26:52.668 INFO:tasks.workunit.client.1.smithi154.stdout:6/496: dwrite d8/d11/f67 [0,4194304] 0 2024-05-06T21:26:52.669 INFO:tasks.workunit.client.1.smithi154.stdout:1/673: creat d6/db/d10/d15/fce x:0 0 0 2024-05-06T21:26:52.671 INFO:tasks.workunit.client.1.smithi154.stdout:8/640: creat d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/fd0 x:0 0 0 2024-05-06T21:26:52.671 INFO:tasks.workunit.client.0.smithi032.stdout:1/892: dwrite db/d47/fc7 [0,4194304] 0 2024-05-06T21:26:52.671 INFO:tasks.workunit.client.0.smithi032.stdout:1/893: truncate db/d16/d46/d57/d58/d68/fb3 914510 0 2024-05-06T21:26:52.671 INFO:tasks.workunit.client.0.smithi032.stdout:1/894: creat db/d47/d4a/da4/d4f/dd0/f11f x:0 0 0 2024-05-06T21:26:52.673 INFO:tasks.workunit.client.1.smithi154.stdout:6/497: truncate d8/d11/f24 15110722 0 2024-05-06T21:26:52.674 INFO:tasks.workunit.client.0.smithi032.stdout:2/821: dread df/d19/d1e/d35/dc5/d2e/d103/f10b [0,4194304] 0 2024-05-06T21:26:52.674 INFO:tasks.workunit.client.0.smithi032.stdout:2/822: chown df/d19/d1e/d71/d5f/d7d/f106 1866 1 2024-05-06T21:26:52.674 INFO:tasks.workunit.client.1.smithi154.stdout:1/674: getdents d6 0 2024-05-06T21:26:52.675 INFO:tasks.workunit.client.0.smithi032.stdout:1/895: creat db/d37/d52/f120 x:0 0 0 2024-05-06T21:26:52.677 INFO:tasks.workunit.client.0.smithi032.stdout:2/823: creat df/d19/d1e/d42/dc6/de8/f115 x:0 0 0 2024-05-06T21:26:52.677 INFO:tasks.workunit.client.0.smithi032.stdout:2/824: write df/d19/d1e/d35/dc5/d2e/d33/ff5 [974852,5162] 0 2024-05-06T21:26:52.678 INFO:tasks.workunit.client.0.smithi032.stdout:1/896: symlink db/d47/l121 0 2024-05-06T21:26:52.679 INFO:tasks.workunit.client.0.smithi032.stdout:1/897: mknod db/d16/db8/c122 0 2024-05-06T21:26:52.680 INFO:tasks.workunit.client.1.smithi154.stdout:6/498: creat d8/d11/f9c x:0 0 0 2024-05-06T21:26:52.683 INFO:tasks.workunit.client.1.smithi154.stdout:8/641: write d3/d14/f20 [2924935,89908] 0 2024-05-06T21:26:52.684 INFO:tasks.workunit.client.0.smithi032.stdout:1/898: rename db/d47/d4a/fa7 to db/d37/f123 0 2024-05-06T21:26:52.684 INFO:tasks.workunit.client.0.smithi032.stdout:1/899: chown db/l7f 4921782 1 2024-05-06T21:26:52.686 INFO:tasks.workunit.client.1.smithi154.stdout:8/642: mkdir d3/d14/d1a/d45/dcf/db4/dd1 0 2024-05-06T21:26:52.686 INFO:tasks.workunit.client.1.smithi154.stdout:8/643: fdatasync d3/d14/d1a/d29/d32/d40/d79/f9d 0 2024-05-06T21:26:52.686 INFO:tasks.workunit.client.1.smithi154.stdout:8/644: write d3/d14/d1a/d29/d32/d40/d59/f55 [296073,86311] 0 2024-05-06T21:26:52.689 INFO:tasks.workunit.client.1.smithi154.stdout:4/629: dwrite d0/d82/faf [0,4194304] 0 2024-05-06T21:26:52.689 INFO:tasks.workunit.client.1.smithi154.stdout:4/630: chown d0/d2/f69 468 1 2024-05-06T21:26:52.689 INFO:tasks.workunit.client.1.smithi154.stdout:4/631: truncate d0/d2/d29/fa5 582971 0 2024-05-06T21:26:52.689 INFO:tasks.workunit.client.1.smithi154.stdout:4/632: readlink d0/d2/d29/l5a 0 2024-05-06T21:26:52.690 INFO:tasks.workunit.client.0.smithi032.stdout:3/998: dwrite d1/d4/d11/dfb/f133 [0,4194304] 0 2024-05-06T21:26:52.690 INFO:tasks.workunit.client.1.smithi154.stdout:8/645: link d3/d64/d6d/dbd/d61/ca1 d3/d14/d1a/d29/d32/d40/d79/d84/da4/cd2 0 2024-05-06T21:26:52.693 INFO:tasks.workunit.client.1.smithi154.stdout:4/633: symlink d0/d72/d76/ld3 0 2024-05-06T21:26:52.693 INFO:tasks.workunit.client.1.smithi154.stdout:4/634: chown d0/d82/f5e 6215601 1 2024-05-06T21:26:52.693 INFO:tasks.workunit.client.1.smithi154.stdout:8/646: creat d3/d14/d1a/d6e/fd3 x:0 0 0 2024-05-06T21:26:52.693 INFO:tasks.workunit.client.1.smithi154.stdout:8/647: dread - d3/d14/d1a/d29/d32/d40/d59/d67/d95/fa5 zero size 2024-05-06T21:26:52.697 INFO:tasks.workunit.client.1.smithi154.stdout:9/716: dwrite d5/d2e/da0/fb4 [0,4194304] 0 2024-05-06T21:26:52.697 INFO:tasks.workunit.client.1.smithi154.stdout:6/499: write d8/d11/f67 [517622,88767] 0 2024-05-06T21:26:52.697 INFO:tasks.workunit.client.1.smithi154.stdout:3/796: dwrite d0/da/db/d30/fe8 [0,4194304] 0 2024-05-06T21:26:52.697 INFO:tasks.workunit.client.1.smithi154.stdout:1/675: dwrite d6/db/d10/f84 [0,4194304] 0 2024-05-06T21:26:52.701 INFO:tasks.workunit.client.0.smithi032.stdout:7/958: dwrite db/d12/d87/fb1 [0,4194304] 0 2024-05-06T21:26:52.702 INFO:tasks.workunit.client.1.smithi154.stdout:9/717: link d5/d20/d37/f64 d5/d2e/da0/ff8 0 2024-05-06T21:26:52.702 INFO:tasks.workunit.client.1.smithi154.stdout:7/528: dwrite d6/d42/d6c/d6e/d23/f28 [0,4194304] 0 2024-05-06T21:26:52.702 INFO:tasks.workunit.client.1.smithi154.stdout:4/635: rename d0/d10/d11 to d0/d82/d44/d73/d4a/dd4 0 2024-05-06T21:26:52.704 INFO:tasks.workunit.client.0.smithi032.stdout:6/922: dwrite d8/dd/d18/f19 [4194304,4194304] 0 2024-05-06T21:26:52.704 INFO:tasks.workunit.client.0.smithi032.stdout:6/923: readlink d8/db6/le3 0 2024-05-06T21:26:52.705 INFO:tasks.workunit.client.1.smithi154.stdout:1/676: stat d6/d3e/d7e/lcc 0 2024-05-06T21:26:52.705 INFO:tasks.workunit.client.1.smithi154.stdout:1/677: fsync d6/db/d5e/fb2 0 2024-05-06T21:26:52.710 INFO:tasks.workunit.client.0.smithi032.stdout:6/924: creat d8/d3d/d49/f110 x:0 0 0 2024-05-06T21:26:52.710 INFO:tasks.workunit.client.0.smithi032.stdout:6/925: write d8/dd/d1b/fee [473124,39265] 0 2024-05-06T21:26:52.711 INFO:tasks.workunit.client.1.smithi154.stdout:7/529: creat d6/d20/fa7 x:0 0 0 2024-05-06T21:26:52.713 INFO:tasks.workunit.client.1.smithi154.stdout:4/636: link d0/d82/d39/cb0 d0/d82/d44/d73/d4a/d74/cd5 0 2024-05-06T21:26:52.714 INFO:tasks.workunit.client.1.smithi154.stdout:7/530: symlink d6/d46/d5c/la8 0 2024-05-06T21:26:52.714 INFO:tasks.workunit.client.1.smithi154.stdout:7/531: truncate d6/d42/d6c/d6e/d5e/f71 294598 0 2024-05-06T21:26:52.717 INFO:tasks.workunit.client.0.smithi032.stdout:3/999: dread d1/d4/da/d31/d9b/d125/fa1 [0,4194304] 0 2024-05-06T21:26:52.718 INFO:tasks.workunit.client.1.smithi154.stdout:4/637: creat d0/d10/fd6 x:0 0 0 2024-05-06T21:26:52.718 INFO:tasks.workunit.client.1.smithi154.stdout:4/638: read d0/d2/f2b [4331107,23705] 0 2024-05-06T21:26:52.719 INFO:tasks.workunit.client.1.smithi154.stdout:5/670: sync 2024-05-06T21:26:52.719 INFO:tasks.workunit.client.1.smithi154.stdout:6/500: dread d8/fc [0,4194304] 0 2024-05-06T21:26:52.719 INFO:tasks.workunit.client.1.smithi154.stdout:5/671: creat d2/d3/d21/d95/dc/d68/fe8 x:0 0 0 2024-05-06T21:26:52.719 INFO:tasks.workunit.client.1.smithi154.stdout:2/602: sync 2024-05-06T21:26:52.719 INFO:tasks.workunit.client.1.smithi154.stdout:6/501: write d8/d13/d20/f5a [421173,45372] 0 2024-05-06T21:26:52.719 INFO:tasks.workunit.client.1.smithi154.stdout:2/603: creat db/d12/d19/d4b/fbe x:0 0 0 2024-05-06T21:26:52.720 INFO:tasks.workunit.client.1.smithi154.stdout:7/532: symlink d6/d42/d6c/d6e/d21/d2e/d9d/la9 0 2024-05-06T21:26:52.723 INFO:tasks.workunit.client.0.smithi032.stdout:0/886: dwrite d4/da/d14/f2d [0,4194304] 0 2024-05-06T21:26:52.723 INFO:tasks.workunit.client.1.smithi154.stdout:4/639: rmdir d0/d72 39 2024-05-06T21:26:52.723 INFO:tasks.workunit.client.1.smithi154.stdout:4/640: creat d0/d2/fd7 x:0 0 0 2024-05-06T21:26:52.723 INFO:tasks.workunit.client.1.smithi154.stdout:4/641: chown d0/d2/d29/d8f/la0 1298 1 2024-05-06T21:26:52.723 INFO:tasks.workunit.client.1.smithi154.stdout:4/642: fdatasync d0/d2/dc/f26 0 2024-05-06T21:26:52.725 INFO:tasks.workunit.client.0.smithi032.stdout:0/887: rename d4/da/d16/d4f/f9d to d4/da/d98/f129 0 2024-05-06T21:26:52.725 INFO:tasks.workunit.client.0.smithi032.stdout:0/888: chown d4/da/d16/c2e 150646 1 2024-05-06T21:26:52.726 INFO:tasks.workunit.client.1.smithi154.stdout:5/672: creat d2/d3/d19/d23/db6/fe9 x:0 0 0 2024-05-06T21:26:52.730 INFO:tasks.workunit.client.0.smithi032.stdout:6/926: dread d8/dd/d18/d3b/ff5 [0,4194304] 0 2024-05-06T21:26:52.731 INFO:tasks.workunit.client.1.smithi154.stdout:2/604: mkdir db/d12/dbf 0 2024-05-06T21:26:52.732 INFO:tasks.workunit.client.0.smithi032.stdout:6/927: rename d8/dd/d18/d3b/c108 to d8/d3d/d49/df6/c111 0 2024-05-06T21:26:52.732 INFO:tasks.workunit.client.1.smithi154.stdout:7/533: getdents d6/d42 0 2024-05-06T21:26:52.740 INFO:tasks.workunit.client.1.smithi154.stdout:5/673: unlink d2/d3/d21/d95/dd/c45 0 2024-05-06T21:26:52.740 INFO:tasks.workunit.client.1.smithi154.stdout:5/674: write d2/d3/d21/d22/d25/d37/f46 [1159113,6660] 0 2024-05-06T21:26:52.740 INFO:tasks.workunit.client.1.smithi154.stdout:5/675: chown d2/d48/ld2 543615096 1 2024-05-06T21:26:52.745 INFO:tasks.workunit.client.1.smithi154.stdout:0/750: getdents d6/dc/d39 0 2024-05-06T21:26:52.749 INFO:tasks.workunit.client.1.smithi154.stdout:7/534: dread d6/d42/d6c/d6e/d21/d69/f80 [0,4194304] 0 2024-05-06T21:26:52.750 INFO:tasks.workunit.client.1.smithi154.stdout:7/535: mknod d6/d42/d6c/d6e/caa 0 2024-05-06T21:26:52.757 INFO:tasks.workunit.client.0.smithi032.stdout:2/825: dwrite df/d19/d1e/d42/dc6/fe9 [0,4194304] 0 2024-05-06T21:26:52.763 INFO:tasks.workunit.client.0.smithi032.stdout:0/889: write d4/da/d16/d33/d9e/faf [2022205,121273] 0 2024-05-06T21:26:52.763 INFO:tasks.workunit.client.0.smithi032.stdout:0/890: creat d4/da/d16/d33/f12a x:0 0 0 2024-05-06T21:26:52.764 INFO:tasks.workunit.client.0.smithi032.stdout:1/900: dwrite db/d47/d4a/da4/fb5 [0,4194304] 0 2024-05-06T21:26:52.766 INFO:tasks.workunit.client.0.smithi032.stdout:6/928: dread d8/d3d/d49/d6b/d10a/f44 [0,4194304] 0 2024-05-06T21:26:52.766 INFO:tasks.workunit.client.0.smithi032.stdout:6/929: write d8/dd/d18/d3b/f50 [149795,78922] 0 2024-05-06T21:26:52.767 INFO:tasks.workunit.client.1.smithi154.stdout:4/643: dwrite d0/d2/d29/fd0 [0,4194304] 0 2024-05-06T21:26:52.770 INFO:tasks.workunit.client.0.smithi032.stdout:1/901: creat db/d16/d46/f124 x:0 0 0 2024-05-06T21:26:52.773 INFO:tasks.workunit.client.0.smithi032.stdout:1/902: rename db/d47/l5c to db/d16/d46/d57/d58/l125 0 2024-05-06T21:26:52.774 INFO:tasks.workunit.client.0.smithi032.stdout:0/891: dread d4/fea [0,4194304] 0 2024-05-06T21:26:52.774 INFO:tasks.workunit.client.0.smithi032.stdout:0/892: stat d4/da/d98/f127 0 2024-05-06T21:26:52.775 INFO:tasks.workunit.client.0.smithi032.stdout:0/893: creat d4/da/d14/d1a/d66/dbc/f12b x:0 0 0 2024-05-06T21:26:52.776 INFO:tasks.workunit.client.1.smithi154.stdout:9/718: dwrite d5/d20/d52/d6e/fae [0,4194304] 0 2024-05-06T21:26:52.776 INFO:tasks.workunit.client.1.smithi154.stdout:8/648: dwrite d3/d14/d1a/d29/f74 [0,4194304] 0 2024-05-06T21:26:52.776 INFO:tasks.workunit.client.1.smithi154.stdout:8/649: readlink d3/d64/d6d/dbd/d6b/l86 0 2024-05-06T21:26:52.776 INFO:tasks.workunit.client.1.smithi154.stdout:8/650: fdatasync d3/d14/d1a/d29/da3/fac 0 2024-05-06T21:26:52.776 INFO:tasks.workunit.client.1.smithi154.stdout:8/651: fdatasync d3/d14/d1a/d29/d32/d40/d4b/d4d/fc9 0 2024-05-06T21:26:52.776 INFO:tasks.workunit.client.1.smithi154.stdout:8/652: chown d3/d64/d6d/dbd/dce 62 1 2024-05-06T21:26:52.777 INFO:tasks.workunit.client.0.smithi032.stdout:1/903: creat db/d16/d46/d55/f126 x:0 0 0 2024-05-06T21:26:52.777 INFO:tasks.workunit.client.1.smithi154.stdout:3/797: dwrite d0/da/db/dd/ff [0,4194304] 0 2024-05-06T21:26:52.777 INFO:tasks.workunit.client.1.smithi154.stdout:3/798: dread - d0/da/db/d52/d62/fe0 zero size 2024-05-06T21:26:52.778 INFO:tasks.workunit.client.0.smithi032.stdout:1/904: getdents db/d16/d46/d57/d58/d68 0 2024-05-06T21:26:52.780 INFO:tasks.workunit.client.1.smithi154.stdout:9/719: creat d5/d20/d52/d59/ff9 x:0 0 0 2024-05-06T21:26:52.780 INFO:tasks.workunit.client.1.smithi154.stdout:9/720: write d5/f2a [1325146,89128] 0 2024-05-06T21:26:52.780 INFO:tasks.workunit.client.1.smithi154.stdout:9/721: write d5/d2e/f35 [863119,113763] 0 2024-05-06T21:26:52.783 INFO:tasks.workunit.client.1.smithi154.stdout:8/653: mknod d3/d38/cd4 0 2024-05-06T21:26:52.783 INFO:tasks.workunit.client.1.smithi154.stdout:8/654: truncate d3/d64/d6d/dbd/fbc 59976 0 2024-05-06T21:26:52.784 INFO:tasks.workunit.client.0.smithi032.stdout:1/905: dread db/d47/d4a/da4/d4f/dd0/f108 [0,4194304] 0 2024-05-06T21:26:52.788 INFO:tasks.workunit.client.1.smithi154.stdout:3/799: creat d0/da/d1a/d28/dbc/d81/d48/da9/db3/f115 x:0 0 0 2024-05-06T21:26:52.788 INFO:tasks.workunit.client.1.smithi154.stdout:3/800: creat d0/da/db/d7c/d80/d106/f116 x:0 0 0 2024-05-06T21:26:52.788 INFO:tasks.workunit.client.0.smithi032.stdout:1/906: rename db/d16/da3 to db/d37/d93/dce/df4/d127 0 2024-05-06T21:26:52.790 INFO:tasks.workunit.client.1.smithi154.stdout:8/655: symlink d3/d14/ld5 0 2024-05-06T21:26:52.790 INFO:tasks.workunit.client.1.smithi154.stdout:8/656: write d3/d14/d1a/d29/d32/d40/d4b/d4d/fc9 [1038989,107669] 0 2024-05-06T21:26:52.790 INFO:tasks.workunit.client.1.smithi154.stdout:8/657: creat d3/d14/d1a/d6e/fd6 x:0 0 0 2024-05-06T21:26:52.792 INFO:tasks.workunit.client.1.smithi154.stdout:8/658: getdents d3/d64/d6d/dbd 0 2024-05-06T21:26:52.793 INFO:tasks.workunit.client.1.smithi154.stdout:8/659: truncate d3/d14/d1a/d29/d32/d40/d79/d84/da4/fc0 64575 0 2024-05-06T21:26:52.793 INFO:tasks.workunit.client.1.smithi154.stdout:8/660: getdents d3/d64/d6d/dbd/dce 0 2024-05-06T21:26:52.796 INFO:tasks.workunit.client.1.smithi154.stdout:8/661: dread d3/fb [0,4194304] 0 2024-05-06T21:26:52.798 INFO:tasks.workunit.client.1.smithi154.stdout:8/662: link d3/d14/d1a/d29/d32/d40/d79/d84/da4/fc0 d3/d14/d1a/d29/d32/d40/d79/d2b/fd7 0 2024-05-06T21:26:52.798 INFO:tasks.workunit.client.1.smithi154.stdout:8/663: write d3/d64/d6d/dbd/fbc [463549,61711] 0 2024-05-06T21:26:52.801 INFO:tasks.workunit.client.1.smithi154.stdout:8/664: creat d3/d14/d1a/d29/d32/d40/d79/d90/fd8 x:0 0 0 2024-05-06T21:26:52.801 INFO:tasks.workunit.client.1.smithi154.stdout:8/665: readlink d3/l17 0 2024-05-06T21:26:52.807 INFO:tasks.workunit.client.0.smithi032.stdout:7/959: dwrite f3 [0,4194304] 0 2024-05-06T21:26:52.807 INFO:tasks.workunit.client.0.smithi032.stdout:1/907: dread db/d16/f1b [0,4194304] 0 2024-05-06T21:26:52.808 INFO:tasks.workunit.client.1.smithi154.stdout:0/751: dwrite d6/dc/f95 [4194304,4194304] 0 2024-05-06T21:26:52.808 INFO:tasks.workunit.client.1.smithi154.stdout:6/502: dwrite d8/d11/d2d/d3d/d4c/d86/f8b [0,4194304] 0 2024-05-06T21:26:52.818 INFO:tasks.workunit.client.1.smithi154.stdout:8/666: dread d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f9e [4194304,4194304] 0 2024-05-06T21:26:52.819 INFO:tasks.workunit.client.0.smithi032.stdout:7/960: rmdir db/d12/d87/db5 39 2024-05-06T21:26:52.823 INFO:tasks.workunit.client.0.smithi032.stdout:7/961: rename db/d12/d16/d21/d41/d4b/c5f to db/d12/de9/d117/c12c 0 2024-05-06T21:26:52.825 INFO:tasks.workunit.client.0.smithi032.stdout:7/962: link db/d12/d87/db5/c102 db/d12/d16/d2a/d39/d3b/d96/d118/c12d 0 2024-05-06T21:26:52.825 INFO:tasks.workunit.client.0.smithi032.stdout:7/963: write db/f1e [4612774,14026] 0 2024-05-06T21:26:52.826 INFO:tasks.workunit.client.0.smithi032.stdout:7/964: creat db/d12/f12e x:0 0 0 2024-05-06T21:26:52.829 INFO:tasks.workunit.client.0.smithi032.stdout:7/965: creat db/d12/d16/d2a/d39/d3b/dac/f12f x:0 0 0 2024-05-06T21:26:52.830 INFO:tasks.workunit.client.0.smithi032.stdout:7/966: creat db/d12/d16/d2a/d39/d3b/d11b/f130 x:0 0 0 2024-05-06T21:26:52.830 INFO:tasks.workunit.client.0.smithi032.stdout:7/967: readlink db/d12/d16/d2a/d39/d3b/d96/dcd/lfa 0 2024-05-06T21:26:52.833 INFO:tasks.workunit.client.0.smithi032.stdout:6/930: dwrite d8/d3d/d49/dad/d10b/f10c [0,4194304] 0 2024-05-06T21:26:52.837 INFO:tasks.workunit.client.0.smithi032.stdout:2/826: dwrite df/d19/d1e/d35/dc5/f43 [0,4194304] 0 2024-05-06T21:26:52.838 INFO:tasks.workunit.client.0.smithi032.stdout:2/827: chown df/d19/d1e/d54/c5e 101191351 1 2024-05-06T21:26:52.838 INFO:tasks.workunit.client.0.smithi032.stdout:2/828: dread - df/d19/d1e/d35/dc5/d2e/dbc/f102 zero size 2024-05-06T21:26:52.838 INFO:tasks.workunit.client.1.smithi154.stdout:7/536: dwrite d6/d20/d40/d52/f9c [0,4194304] 0 2024-05-06T21:26:52.840 INFO:tasks.workunit.client.0.smithi032.stdout:2/829: mkdir df/d19/d1e/d42/dc6/dc1/d10e/d116 0 2024-05-06T21:26:52.840 INFO:tasks.workunit.client.0.smithi032.stdout:2/830: readlink df/d19/d1e/d42/l53 0 2024-05-06T21:26:52.843 INFO:tasks.workunit.client.1.smithi154.stdout:7/537: symlink d6/d42/d6c/d6e/d23/lab 0 2024-05-06T21:26:52.844 INFO:tasks.workunit.client.1.smithi154.stdout:7/538: dread d6/d42/d6c/d6e/d5e/f71 [0,4194304] 0 2024-05-06T21:26:52.847 INFO:tasks.workunit.client.1.smithi154.stdout:7/539: mknod d6/cac 0 2024-05-06T21:26:52.847 INFO:tasks.workunit.client.1.smithi154.stdout:7/540: chown d6/d42/d6c/d6e/d23/c64 12111784 1 2024-05-06T21:26:52.849 INFO:tasks.workunit.client.0.smithi032.stdout:6/931: dwrite d8/d3d/d49/fa9 [0,4194304] 0 2024-05-06T21:26:52.850 INFO:tasks.workunit.client.1.smithi154.stdout:7/541: link d6/fb d6/d42/d6c/d6e/d21/d69/d7b/fad 0 2024-05-06T21:26:52.850 INFO:tasks.workunit.client.1.smithi154.stdout:7/542: readlink d6/d20/l68 0 2024-05-06T21:26:52.850 INFO:tasks.workunit.client.1.smithi154.stdout:7/543: fsync d6/d42/d6c/f77 0 2024-05-06T21:26:52.852 INFO:tasks.workunit.client.1.smithi154.stdout:7/544: creat d6/d42/d6c/d6e/d23/fae x:0 0 0 2024-05-06T21:26:52.852 INFO:tasks.workunit.client.0.smithi032.stdout:2/831: dread df/d19/d1e/d71/d5f/d7d/f92 [0,4194304] 0 2024-05-06T21:26:52.854 INFO:tasks.workunit.client.0.smithi032.stdout:2/832: mknod df/d19/d1e/d71/d5f/d7d/d65/dfc/c117 0 2024-05-06T21:26:52.854 INFO:tasks.workunit.client.0.smithi032.stdout:2/833: chown df/d19/d1e/d35/d3f/f44 18 1 2024-05-06T21:26:52.856 INFO:tasks.workunit.client.1.smithi154.stdout:0/752: dwrite d6/fa8 [0,4194304] 0 2024-05-06T21:26:52.857 INFO:tasks.workunit.client.0.smithi032.stdout:6/932: dread d8/f10 [4194304,4194304] 0 2024-05-06T21:26:52.857 INFO:tasks.workunit.client.0.smithi032.stdout:7/968: dread db/d12/fc9 [0,4194304] 0 2024-05-06T21:26:52.857 INFO:tasks.workunit.client.0.smithi032.stdout:6/933: stat d8/dd/fd4 0 2024-05-06T21:26:52.857 INFO:tasks.workunit.client.0.smithi032.stdout:6/934: chown d8/dd/la0 7777 1 2024-05-06T21:26:52.859 INFO:tasks.workunit.client.0.smithi032.stdout:0/894: dwrite d4/da/d16/d33/f113 [0,4194304] 0 2024-05-06T21:26:52.860 INFO:tasks.workunit.client.1.smithi154.stdout:1/678: dwrite d6/f17 [0,4194304] 0 2024-05-06T21:26:52.860 INFO:tasks.workunit.client.0.smithi032.stdout:7/969: unlink db/d12/d87/lf3 0 2024-05-06T21:26:52.860 INFO:tasks.workunit.client.0.smithi032.stdout:6/935: mknod d8/dd/d18/d13/d7a/c112 0 2024-05-06T21:26:52.861 INFO:tasks.workunit.client.1.smithi154.stdout:1/679: creat d6/db/d5e/fcf x:0 0 0 2024-05-06T21:26:52.862 INFO:tasks.workunit.client.1.smithi154.stdout:1/680: dread - d6/db/d74/fab zero size 2024-05-06T21:26:52.862 INFO:tasks.workunit.client.1.smithi154.stdout:1/681: write d6/db/d10/d15/d1d/d53/f98 [799470,20584] 0 2024-05-06T21:26:52.862 INFO:tasks.workunit.client.1.smithi154.stdout:1/682: chown d6/db/d69/l8b 1028386 1 2024-05-06T21:26:52.863 INFO:tasks.workunit.client.0.smithi032.stdout:7/970: truncate db/d12/d16/d21/d41/d4b/f54 2133550 0 2024-05-06T21:26:52.863 INFO:tasks.workunit.client.1.smithi154.stdout:4/644: dwrite d0/d72/d76/f7d [4194304,4194304] 0 2024-05-06T21:26:52.863 INFO:tasks.workunit.client.1.smithi154.stdout:4/645: chown d0/d2/f2b 36789111 1 2024-05-06T21:26:52.863 INFO:tasks.workunit.client.1.smithi154.stdout:4/646: creat d0/d2/fd8 x:0 0 0 2024-05-06T21:26:52.864 INFO:tasks.workunit.client.0.smithi032.stdout:6/936: creat d8/dd/d18/d3b/db9/d102/f113 x:0 0 0 2024-05-06T21:26:52.864 INFO:tasks.workunit.client.1.smithi154.stdout:9/722: dwrite d5/f8 [0,4194304] 0 2024-05-06T21:26:52.865 INFO:tasks.workunit.client.1.smithi154.stdout:1/683: symlink d6/db/dbe/ld0 0 2024-05-06T21:26:52.865 INFO:tasks.workunit.client.1.smithi154.stdout:1/684: readlink d6/db/d10/d15/d1d/lb0 0 2024-05-06T21:26:52.865 INFO:tasks.workunit.client.1.smithi154.stdout:1/685: creat d6/db/d5e/fd1 x:0 0 0 2024-05-06T21:26:52.865 INFO:tasks.workunit.client.0.smithi032.stdout:7/971: mknod db/d12/d16/d2a/c131 0 2024-05-06T21:26:52.866 INFO:tasks.workunit.client.1.smithi154.stdout:6/503: dwrite d8/d11/f79 [0,4194304] 0 2024-05-06T21:26:52.866 INFO:tasks.workunit.client.1.smithi154.stdout:8/667: dwrite d3/d14/d1a/d29/f50 [0,4194304] 0 2024-05-06T21:26:52.866 INFO:tasks.workunit.client.0.smithi032.stdout:2/834: write df/d19/d1e/d35/dc5/d2e/d33/fb0 [12745,128139] 0 2024-05-06T21:26:52.867 INFO:tasks.workunit.client.1.smithi154.stdout:3/801: dwrite d0/da/db/dd/d1c/d21/fe2 [0,4194304] 0 2024-05-06T21:26:52.869 INFO:tasks.workunit.client.1.smithi154.stdout:4/647: truncate d0/d2/f66 1849363 0 2024-05-06T21:26:52.869 INFO:tasks.workunit.client.0.smithi032.stdout:6/937: rename d8/d3d/d49/f110 to d8/d3d/d73/d87/f114 0 2024-05-06T21:26:52.871 INFO:tasks.workunit.client.0.smithi032.stdout:0/895: dread d4/d3e/d63/d6c/d8f/f92 [0,4194304] 0 2024-05-06T21:26:52.871 INFO:tasks.workunit.client.0.smithi032.stdout:2/835: mkdir df/d19/d1e/d71/d5f/d7d/d65/d78/da6/d118 0 2024-05-06T21:26:52.871 INFO:tasks.workunit.client.0.smithi032.stdout:2/836: write df/d19/d1e/d42/dc6/dc1/fec [282040,97411] 0 2024-05-06T21:26:52.872 INFO:tasks.workunit.client.1.smithi154.stdout:9/723: link d5/d14/f43 d5/d20/ffa 0 2024-05-06T21:26:52.874 INFO:tasks.workunit.client.1.smithi154.stdout:1/686: dread d6/db/f34 [0,4194304] 0 2024-05-06T21:26:52.875 INFO:tasks.workunit.client.0.smithi032.stdout:2/837: link df/l111 df/d19/dbf/l119 0 2024-05-06T21:26:52.879 INFO:tasks.workunit.client.0.smithi032.stdout:2/838: rename df/d19/d1e/d71/d5f/d7d/d25/d2d to df/d19/d1e/d42/dc6/dc1/df4/d11a 0 2024-05-06T21:26:52.880 INFO:tasks.workunit.client.0.smithi032.stdout:7/972: dread db/d12/d16/d21/d41/d78/f91 [0,4194304] 0 2024-05-06T21:26:52.882 INFO:tasks.workunit.client.0.smithi032.stdout:2/839: dread df/d19/d1e/d71/d5f/d7d/d25/f4b [0,4194304] 0 2024-05-06T21:26:52.882 INFO:tasks.workunit.client.0.smithi032.stdout:2/840: write df/d19/d1e/d42/dc6/f91 [606644,95056] 0 2024-05-06T21:26:52.883 INFO:tasks.workunit.client.0.smithi032.stdout:7/973: mknod db/d12/d49/c132 0 2024-05-06T21:26:52.886 INFO:tasks.workunit.client.1.smithi154.stdout:3/802: truncate d0/da/db/d30/f3d 169920 0 2024-05-06T21:26:52.887 INFO:tasks.workunit.client.1.smithi154.stdout:3/803: write d0/da/fb1 [422746,60946] 0 2024-05-06T21:26:52.888 INFO:tasks.workunit.client.0.smithi032.stdout:5/946: sync 2024-05-06T21:26:52.889 INFO:tasks.workunit.client.0.smithi032.stdout:5/947: stat d0/d24/d38/f9c 0 2024-05-06T21:26:52.889 INFO:tasks.workunit.client.0.smithi032.stdout:5/948: creat d0/d16/d2a/dc7/dd2/db1/f12f x:0 0 0 2024-05-06T21:26:52.893 INFO:tasks.workunit.client.1.smithi154.stdout:8/668: dread d3/d14/d1a/d29/f74 [0,4194304] 0 2024-05-06T21:26:52.893 INFO:tasks.workunit.client.1.smithi154.stdout:7/545: dwrite d6/d20/d40/f50 [4194304,4194304] 0 2024-05-06T21:26:52.893 INFO:tasks.workunit.client.1.smithi154.stdout:7/546: chown d6/f1a 5 1 2024-05-06T21:26:52.893 INFO:tasks.workunit.client.1.smithi154.stdout:7/547: chown d6/d54/d5b/d82 129122 1 2024-05-06T21:26:52.893 INFO:tasks.workunit.client.1.smithi154.stdout:9/724: dread d5/d14/f43 [0,4194304] 0 2024-05-06T21:26:52.894 INFO:tasks.workunit.client.0.smithi032.stdout:6/938: write d8/dd/d18/f69 [2160042,44993] 0 2024-05-06T21:26:52.894 INFO:tasks.workunit.client.0.smithi032.stdout:5/949: mkdir d0/d16/d79/d105/d130 0 2024-05-06T21:26:52.898 INFO:tasks.workunit.client.0.smithi032.stdout:6/939: getdents d8/dd/d18/d13 0 2024-05-06T21:26:52.898 INFO:tasks.workunit.client.0.smithi032.stdout:6/940: dread - d8/db6/d100/f109 zero size 2024-05-06T21:26:52.900 INFO:tasks.workunit.client.1.smithi154.stdout:4/648: mkdir d0/d82/d44/d73/d4a/dd9 0 2024-05-06T21:26:52.901 INFO:tasks.workunit.client.1.smithi154.stdout:6/504: dwrite d8/d13/f28 [0,4194304] 0 2024-05-06T21:26:52.901 INFO:tasks.workunit.client.1.smithi154.stdout:6/505: readlink d8/d11/d2d/d3d/d4c/l78 0 2024-05-06T21:26:52.901 INFO:tasks.workunit.client.1.smithi154.stdout:1/687: creat d6/db/dbe/fd2 x:0 0 0 2024-05-06T21:26:52.901 INFO:tasks.workunit.client.1.smithi154.stdout:1/688: chown d6/f52 2 1 2024-05-06T21:26:52.904 INFO:tasks.workunit.client.0.smithi032.stdout:7/974: dread db/d12/f79 [0,4194304] 0 2024-05-06T21:26:52.904 INFO:tasks.workunit.client.0.smithi032.stdout:7/975: chown db/d12/d16/d2a/d39/d3b/d96/c93 2 1 2024-05-06T21:26:52.906 INFO:tasks.workunit.client.1.smithi154.stdout:9/725: symlink d5/d2e/d8b/lfb 0 2024-05-06T21:26:52.906 INFO:tasks.workunit.client.0.smithi032.stdout:7/976: getdents db/d12 0 2024-05-06T21:26:52.907 INFO:tasks.workunit.client.0.smithi032.stdout:7/977: creat db/d12/d16/d2a/d39/f133 x:0 0 0 2024-05-06T21:26:52.908 INFO:tasks.workunit.client.1.smithi154.stdout:9/726: write d5/f28 [162860,30990] 0 2024-05-06T21:26:52.909 INFO:tasks.workunit.client.1.smithi154.stdout:6/506: symlink d8/d11/d33/d4a/d6c/l9d 0 2024-05-06T21:26:52.909 INFO:tasks.workunit.client.0.smithi032.stdout:7/978: symlink db/d12/d16/d2a/d39/l134 0 2024-05-06T21:26:52.910 INFO:tasks.workunit.client.1.smithi154.stdout:1/689: creat d6/db/d69/dc1/fd3 x:0 0 0 2024-05-06T21:26:52.910 INFO:tasks.workunit.client.1.smithi154.stdout:1/690: getdents d6/db/d10/d15/d1d/d53/da3 0 2024-05-06T21:26:52.916 INFO:tasks.workunit.client.1.smithi154.stdout:4/649: write d0/d82/faf [1232617,94830] 0 2024-05-06T21:26:52.918 INFO:tasks.workunit.client.1.smithi154.stdout:9/727: write d5/d20/d52/f4d [2189070,7912] 0 2024-05-06T21:26:52.918 INFO:tasks.workunit.client.1.smithi154.stdout:6/507: mknod d8/d11/c9e 0 2024-05-06T21:26:52.920 INFO:tasks.workunit.client.1.smithi154.stdout:4/650: symlink d0/d82/d44/d73/d4a/d74/d75/lda 0 2024-05-06T21:26:52.921 INFO:tasks.workunit.client.1.smithi154.stdout:9/728: rmdir d5 39 2024-05-06T21:26:52.921 INFO:tasks.workunit.client.1.smithi154.stdout:9/729: chown d5/d14/d3a/d71 14347042 1 2024-05-06T21:26:52.921 INFO:tasks.workunit.client.1.smithi154.stdout:9/730: readlink d5/d14/d87/l69 0 2024-05-06T21:26:52.922 INFO:tasks.workunit.client.1.smithi154.stdout:4/651: mkdir d0/d82/ddb 0 2024-05-06T21:26:52.922 INFO:tasks.workunit.client.1.smithi154.stdout:0/753: dwrite d6/dc/d44/d36/f68 [0,4194304] 0 2024-05-06T21:26:52.922 INFO:tasks.workunit.client.0.smithi032.stdout:6/941: read d8/dd/d18/d13/fa5 [3424715,113247] 0 2024-05-06T21:26:52.923 INFO:tasks.workunit.client.1.smithi154.stdout:9/731: link d5/d14/d3a/fa1 d5/d2e/d8b/ffc 0 2024-05-06T21:26:52.925 INFO:tasks.workunit.client.1.smithi154.stdout:0/754: mknod d6/dc/d40/d4a/da7/d70/d96/dd5/cf6 0 2024-05-06T21:26:52.926 INFO:tasks.workunit.client.1.smithi154.stdout:0/755: link d6/dc/d40/d4a/da7/d70/d96/dd5/cf6 d6/dc/d40/d4a/d6c/d8a/cf7 0 2024-05-06T21:26:52.931 INFO:tasks.workunit.client.1.smithi154.stdout:6/508: write d8/d11/f79 [1413913,6553] 0 2024-05-06T21:26:52.932 INFO:tasks.workunit.client.1.smithi154.stdout:6/509: link d8/l88 d8/d11/d2d/d3d/d4c/d86/l9f 0 2024-05-06T21:26:52.938 INFO:tasks.workunit.client.1.smithi154.stdout:4/652: dread d0/d2/d29/f56 [0,4194304] 0 2024-05-06T21:26:52.938 INFO:tasks.workunit.client.1.smithi154.stdout:4/653: readlink d0/d10/l33 0 2024-05-06T21:26:52.940 INFO:tasks.workunit.client.1.smithi154.stdout:9/732: write d5/d2e/da0/fb4 [3469049,106460] 0 2024-05-06T21:26:52.940 INFO:tasks.workunit.client.1.smithi154.stdout:9/733: write d5/d20/d52/d6e/d83/da2/fcf [1138744,117359] 0 2024-05-06T21:26:52.940 INFO:tasks.workunit.client.1.smithi154.stdout:9/734: truncate d5/d14/daf/db8/fc5 1315414 0 2024-05-06T21:26:52.942 INFO:tasks.workunit.client.1.smithi154.stdout:0/756: write d6/dc/d42/f59 [1166527,32494] 0 2024-05-06T21:26:52.944 INFO:tasks.workunit.client.1.smithi154.stdout:6/510: dread d8/d13/f3f [0,4194304] 0 2024-05-06T21:26:52.951 INFO:tasks.workunit.client.1.smithi154.stdout:9/735: read d5/d20/d37/f5b [82249,29623] 0 2024-05-06T21:26:52.951 INFO:tasks.workunit.client.1.smithi154.stdout:9/736: chown d5/d20/d52/c21 631414 1 2024-05-06T21:26:52.951 INFO:tasks.workunit.client.1.smithi154.stdout:4/654: write d0/d82/d44/d73/d4a/dd4/d1a/f8a [4086395,6193] 0 2024-05-06T21:26:52.951 INFO:tasks.workunit.client.1.smithi154.stdout:0/757: dread d6/dc/d40/f47 [0,4194304] 0 2024-05-06T21:26:52.951 INFO:tasks.workunit.client.1.smithi154.stdout:4/655: fdatasync d0/d82/d44/d73/d4a/dd4/fa3 0 2024-05-06T21:26:52.952 INFO:tasks.workunit.client.1.smithi154.stdout:9/737: mkdir d5/dca/dfd 0 2024-05-06T21:26:52.953 INFO:tasks.workunit.client.1.smithi154.stdout:0/758: getdents d6/dc/d51/d54/dbd 0 2024-05-06T21:26:52.953 INFO:tasks.workunit.client.1.smithi154.stdout:0/759: write d6/dc/d51/d54/f74 [8932936,107094] 0 2024-05-06T21:26:52.953 INFO:tasks.workunit.client.1.smithi154.stdout:0/760: stat d6/dc/d51 0 2024-05-06T21:26:52.954 INFO:tasks.workunit.client.1.smithi154.stdout:4/656: symlink d0/d82/ddb/ldc 0 2024-05-06T21:26:52.954 INFO:tasks.workunit.client.1.smithi154.stdout:9/738: creat d5/d20/d37/dd5/ffe x:0 0 0 2024-05-06T21:26:52.955 INFO:tasks.workunit.client.0.smithi032.stdout:0/896: dwrite d4/da/d14/d1a/d66/f70 [0,4194304] 0 2024-05-06T21:26:52.955 INFO:tasks.workunit.client.0.smithi032.stdout:5/950: dwrite d0/d16/d2a/d59/f5b [0,4194304] 0 2024-05-06T21:26:52.955 INFO:tasks.workunit.client.1.smithi154.stdout:0/761: mknod d6/dc1/dd0/cf8 0 2024-05-06T21:26:52.956 INFO:tasks.workunit.client.1.smithi154.stdout:6/511: dread d8/d11/d2d/d3d/d70/f7d [0,4194304] 0 2024-05-06T21:26:52.956 INFO:tasks.workunit.client.1.smithi154.stdout:9/739: dread d5/d2e/da0/ff8 [0,4194304] 0 2024-05-06T21:26:52.956 INFO:tasks.workunit.client.1.smithi154.stdout:1/691: dwrite d6/db/dbe/fd2 [0,4194304] 0 2024-05-06T21:26:52.957 INFO:tasks.workunit.client.1.smithi154.stdout:1/692: chown d6/db/d69/d89/f8e 96580468 1 2024-05-06T21:26:52.957 INFO:tasks.workunit.client.1.smithi154.stdout:6/512: truncate d8/d11/d2d/d3d/d70/d7b/f81 2071565 0 2024-05-06T21:26:52.957 INFO:tasks.workunit.client.0.smithi032.stdout:0/897: rmdir d4/da/d16/d33/d9e/dc9/dd8/d11c 0 2024-05-06T21:26:52.958 INFO:tasks.workunit.client.0.smithi032.stdout:0/898: stat d4/c7a 0 2024-05-06T21:26:52.959 INFO:tasks.workunit.client.1.smithi154.stdout:9/740: dread d5/d20/d37/f5b [0,4194304] 0 2024-05-06T21:26:52.959 INFO:tasks.workunit.client.1.smithi154.stdout:9/741: dread - d5/d20/d52/d6e/fb3 zero size 2024-05-06T21:26:52.959 INFO:tasks.workunit.client.1.smithi154.stdout:9/742: truncate d5/d14/d3a/d71/db1/dba/ff1 3756 0 2024-05-06T21:26:52.959 INFO:tasks.workunit.client.1.smithi154.stdout:9/743: chown d5/d14/d3a/d71/db1/dba/ff1 18583405 1 2024-05-06T21:26:52.959 INFO:tasks.workunit.client.0.smithi032.stdout:6/942: getdents d8/dd/d18/d3b/db9/d102 0 2024-05-06T21:26:52.961 INFO:tasks.workunit.client.1.smithi154.stdout:1/693: symlink d6/db/d5e/ld4 0 2024-05-06T21:26:52.963 INFO:tasks.workunit.client.1.smithi154.stdout:3/804: rename d0/da/db to d0/da/d1a/d28/dbc/d117 0 2024-05-06T21:26:52.963 INFO:tasks.workunit.client.1.smithi154.stdout:3/805: fdatasync d0/da/d1a/d28/dbc/fba 0 2024-05-06T21:26:52.964 INFO:tasks.workunit.client.0.smithi032.stdout:5/951: mkdir d0/d24/d38/d37/d70/d131 0 2024-05-06T21:26:52.966 INFO:tasks.workunit.client.0.smithi032.stdout:0/899: truncate d4/da/f17 337159 0 2024-05-06T21:26:52.966 INFO:tasks.workunit.client.0.smithi032.stdout:0/900: write d4/fe3 [1107952,90786] 0 2024-05-06T21:26:52.966 INFO:tasks.workunit.client.0.smithi032.stdout:0/901: creat d4/da/d16/dcc/f12c x:0 0 0 2024-05-06T21:26:52.969 INFO:tasks.workunit.client.0.smithi032.stdout:6/943: getdents d8/dd/d18 0 2024-05-06T21:26:52.972 INFO:tasks.workunit.client.1.smithi154.stdout:9/744: creat d5/d2e/d8b/dc6/fff x:0 0 0 2024-05-06T21:26:52.972 INFO:tasks.workunit.client.0.smithi032.stdout:5/952: mkdir d0/d16/d2a/d52/d132 0 2024-05-06T21:26:52.972 INFO:tasks.workunit.client.0.smithi032.stdout:5/953: chown d0/d24/d38/d37/df0/d50/d5a/ld0 2365 1 2024-05-06T21:26:52.973 INFO:tasks.workunit.client.1.smithi154.stdout:3/806: mkdir d0/da/d1a/d28/dbc/d117/dd/d1c/d90/d112/d118 0 2024-05-06T21:26:52.973 INFO:tasks.workunit.client.0.smithi032.stdout:0/902: rmdir d4/da/d14/d1a/d66/d8a 39 2024-05-06T21:26:52.974 INFO:tasks.workunit.client.0.smithi032.stdout:0/903: chown d4/da/f39 3373 1 2024-05-06T21:26:52.975 INFO:tasks.workunit.client.0.smithi032.stdout:6/944: mkdir d8/db6/d100/d115 0 2024-05-06T21:26:52.976 INFO:tasks.workunit.client.1.smithi154.stdout:8/669: rename d3/d14/d1a/d29/d32/d40/d79/d90/cb9 to d3/d14/d1a/d29/d32/d40/d79/d84/dbe/cd9 0 2024-05-06T21:26:52.978 INFO:tasks.workunit.client.1.smithi154.stdout:9/745: truncate d5/d20/d52/d59/f80 284507 0 2024-05-06T21:26:52.979 INFO:tasks.workunit.client.0.smithi032.stdout:2/841: rename df/d19/d1e/d42/dc6/dc1/df4 to df/d19/d1e/d42/dc6/d11b 0 2024-05-06T21:26:52.979 INFO:tasks.workunit.client.0.smithi032.stdout:2/842: fdatasync df/d19/d1e/d35/dc5/d2e/f9e 0 2024-05-06T21:26:52.979 INFO:tasks.workunit.client.0.smithi032.stdout:5/954: mknod d0/d16/d79/c133 0 2024-05-06T21:26:52.979 INFO:tasks.workunit.client.0.smithi032.stdout:5/955: read d0/d16/d2a/d5f/d10d/d112/f33 [3683002,5814] 0 2024-05-06T21:26:52.979 INFO:tasks.workunit.client.0.smithi032.stdout:5/956: write d0/d24/d38/d37/df0/d50/f65 [4224307,95061] 0 2024-05-06T21:26:52.979 INFO:tasks.workunit.client.0.smithi032.stdout:0/904: mknod d4/da/c12d 0 2024-05-06T21:26:52.980 INFO:tasks.workunit.client.1.smithi154.stdout:3/807: link d0/da/d1a/d28/dbc/d117/dd/d1c/d90/d112/fee d0/da/d1a/d28/d17/db0/f119 0 2024-05-06T21:26:52.981 INFO:tasks.workunit.client.0.smithi032.stdout:6/945: creat d8/d3d/d49/d6b/d10a/f116 x:0 0 0 2024-05-06T21:26:52.984 INFO:tasks.workunit.client.0.smithi032.stdout:7/979: rename db/d89/ld1 to db/d12/d16/d2a/d39/d8b/l135 0 2024-05-06T21:26:52.984 INFO:tasks.workunit.client.0.smithi032.stdout:7/980: stat db/d12/d16/d2a/d39/f10c 0 2024-05-06T21:26:52.985 INFO:tasks.workunit.client.1.smithi154.stdout:4/657: rename d0/d82/d44/d73/d4a/dd4/d1a/d7e/fc2 to d0/d2/d47/d81/fdd 0 2024-05-06T21:26:52.985 INFO:tasks.workunit.client.1.smithi154.stdout:4/658: chown d0/d2/f66 157 1 2024-05-06T21:26:52.985 INFO:tasks.workunit.client.1.smithi154.stdout:4/659: getdents d0/d2/dbd 0 2024-05-06T21:26:52.986 INFO:tasks.workunit.client.0.smithi032.stdout:2/843: unlink df/d19/d1e/d35/d3f/f68 0 2024-05-06T21:26:52.986 INFO:tasks.workunit.client.0.smithi032.stdout:2/844: truncate df/d19/d1e/d35/ff3 1442882 0 2024-05-06T21:26:52.986 INFO:tasks.workunit.client.0.smithi032.stdout:2/845: write df/d19/d1e/d35/dc5/fb9 [4224714,122604] 0 2024-05-06T21:26:52.987 INFO:tasks.workunit.client.1.smithi154.stdout:8/670: dread d3/d56/f8b [0,4194304] 0 2024-05-06T21:26:52.988 INFO:tasks.workunit.client.1.smithi154.stdout:9/746: truncate d5/f1a 1576059 0 2024-05-06T21:26:52.989 INFO:tasks.workunit.client.0.smithi032.stdout:6/946: rename d8/d3d/fe7 to d8/dd/d18/d13/f117 0 2024-05-06T21:26:52.991 INFO:tasks.workunit.client.0.smithi032.stdout:2/846: rename df/d19/d1e/d71/d5f/d7d/d65/d78/ffd to df/d19/d1e/d71/d5f/f11c 0 2024-05-06T21:26:52.992 INFO:tasks.workunit.client.1.smithi154.stdout:0/762: rename d6/dc/d51/d54/f74 to d6/dc/d40/d4a/da7/d70/d96/ff9 0 2024-05-06T21:26:52.992 INFO:tasks.workunit.client.0.smithi032.stdout:6/947: creat d8/dd/d18/d22/f118 x:0 0 0 2024-05-06T21:26:52.993 INFO:tasks.workunit.client.1.smithi154.stdout:3/808: write d0/da/d1a/d28/dbc/d117/f73 [3572722,67431] 0 2024-05-06T21:26:52.993 INFO:tasks.workunit.client.1.smithi154.stdout:3/809: readlink d0/da/d1a/d28/lf2 0 2024-05-06T21:26:52.993 INFO:tasks.workunit.client.1.smithi154.stdout:4/660: truncate d0/d2/d29/fd0 3050181 0 2024-05-06T21:26:52.994 INFO:tasks.workunit.client.0.smithi032.stdout:2/847: creat df/d19/d1e/d71/d5f/d7d/d65/dfc/f11d x:0 0 0 2024-05-06T21:26:52.994 INFO:tasks.workunit.client.0.smithi032.stdout:7/981: dread db/d12/d16/d2a/f42 [0,4194304] 0 2024-05-06T21:26:52.996 INFO:tasks.workunit.client.0.smithi032.stdout:2/848: rename df/d19/d1e/d54/c10d to df/d19/d1e/d42/c11e 0 2024-05-06T21:26:52.996 INFO:tasks.workunit.client.0.smithi032.stdout:2/849: stat df/d19/d1e/d71/d5f/d7d/d65/c7b 0 2024-05-06T21:26:52.996 INFO:tasks.workunit.client.0.smithi032.stdout:2/850: dread - df/d19/d1e/d35/fa2 zero size 2024-05-06T21:26:52.996 INFO:tasks.workunit.client.0.smithi032.stdout:2/851: dread - df/d19/d1e/d54/fdc zero size 2024-05-06T21:26:52.997 INFO:tasks.workunit.client.0.smithi032.stdout:2/852: write df/d19/d1e/d71/d5f/d73/fba [4981207,67744] 0 2024-05-06T21:26:52.997 INFO:tasks.workunit.client.1.smithi154.stdout:8/671: dread d3/d14/d1a/d29/d32/d40/d59/f41 [0,4194304] 0 2024-05-06T21:26:52.997 INFO:tasks.workunit.client.1.smithi154.stdout:8/672: chown d3/d14/d1a/d29/lb8 51789335 1 2024-05-06T21:26:52.997 INFO:tasks.workunit.client.1.smithi154.stdout:8/673: write d3/d64/d6d/dbd/fbc [1062737,58696] 0 2024-05-06T21:26:52.997 INFO:tasks.workunit.client.1.smithi154.stdout:8/674: write d3/fb [8745,60559] 0 2024-05-06T21:26:52.998 INFO:tasks.workunit.client.0.smithi032.stdout:7/982: unlink db/d12/d16/d2a/fd3 0 2024-05-06T21:26:52.998 INFO:tasks.workunit.client.1.smithi154.stdout:9/747: unlink d5/d14/d3a/fe3 0 2024-05-06T21:26:52.998 INFO:tasks.workunit.client.0.smithi032.stdout:5/957: write d0/fe [1622205,1668] 0 2024-05-06T21:26:52.999 INFO:tasks.workunit.client.1.smithi154.stdout:0/763: mkdir d6/dc/d40/d4a/dfa 0 2024-05-06T21:26:53.001 INFO:tasks.workunit.client.1.smithi154.stdout:3/810: mknod d0/da/d1a/d28/d17/db0/c11a 0 2024-05-06T21:26:53.001 INFO:tasks.workunit.client.1.smithi154.stdout:3/811: fdatasync d0/da/d1a/d28/dbc/d117/dd/d1c/f35 0 2024-05-06T21:26:53.003 INFO:tasks.workunit.client.1.smithi154.stdout:4/661: link d0/d82/d39/d54/f8b d0/d2/d47/d81/fde 0 2024-05-06T21:26:53.004 INFO:tasks.workunit.client.1.smithi154.stdout:6/513: dwrite d8/d11/d51/f6f [0,4194304] 0 2024-05-06T21:26:53.004 INFO:tasks.workunit.client.1.smithi154.stdout:1/694: dwrite d6/d3e/faa [0,4194304] 0 2024-05-06T21:26:53.005 INFO:tasks.workunit.client.1.smithi154.stdout:8/675: creat d3/fda x:0 0 0 2024-05-06T21:26:53.006 INFO:tasks.workunit.client.1.smithi154.stdout:9/748: link d5/c11 d5/d20/d52/d6e/c100 0 2024-05-06T21:26:53.009 INFO:tasks.workunit.client.1.smithi154.stdout:3/812: creat d0/da/d1a/d28/dbc/d117/dd/d1c/d21/f11b x:0 0 0 2024-05-06T21:26:53.010 INFO:tasks.workunit.client.0.smithi032.stdout:0/905: dwrite d4/d3e/d63/d6c/d8f/dc2/fff [0,4194304] 0 2024-05-06T21:26:53.010 INFO:tasks.workunit.client.0.smithi032.stdout:0/906: fsync d4/da/d98/f127 0 2024-05-06T21:26:53.011 INFO:tasks.workunit.client.0.smithi032.stdout:0/907: chown d4/da/d16/d33/d9e/dc9/dcb/l117 48030 1 2024-05-06T21:26:53.013 INFO:tasks.workunit.client.1.smithi154.stdout:4/662: creat d0/d82/d44/fdf x:0 0 0 2024-05-06T21:26:53.013 INFO:tasks.workunit.client.0.smithi032.stdout:0/908: symlink d4/d3e/d63/dca/l12e 0 2024-05-06T21:26:53.027 INFO:tasks.workunit.client.1.smithi154.stdout:6/514: truncate f6 2878462 0 2024-05-06T21:26:53.027 INFO:tasks.workunit.client.1.smithi154.stdout:6/515: readlink d8/d11/d2d/d3d/d4c/l63 0 2024-05-06T21:26:53.028 INFO:tasks.workunit.client.1.smithi154.stdout:9/749: rmdir d5/d20/d52/d6e 39 2024-05-06T21:26:53.029 INFO:tasks.workunit.client.1.smithi154.stdout:9/750: read d5/d20/d52/d59/f67 [454155,50616] 0 2024-05-06T21:26:53.030 INFO:tasks.workunit.client.1.smithi154.stdout:4/663: symlink d0/d82/d44/le0 0 2024-05-06T21:26:53.030 INFO:tasks.workunit.client.1.smithi154.stdout:4/664: fdatasync d0/d2/dc/f48 0 2024-05-06T21:26:53.030 INFO:tasks.workunit.client.1.smithi154.stdout:4/665: write d0/d82/d39/d54/fd1 [407504,23810] 0 2024-05-06T21:26:53.031 INFO:tasks.workunit.client.1.smithi154.stdout:4/666: dread - d0/d82/d44/d73/d9a/fac zero size 2024-05-06T21:26:53.035 INFO:tasks.workunit.client.1.smithi154.stdout:4/667: dread d0/d2/d29/f56 [0,4194304] 0 2024-05-06T21:26:53.035 INFO:tasks.workunit.client.1.smithi154.stdout:6/516: rename d8/d11/f1b to d8/fa0 0 2024-05-06T21:26:53.035 INFO:tasks.workunit.client.1.smithi154.stdout:6/517: creat d8/d11/d2d/d3d/d70/d7b/fa1 x:0 0 0 2024-05-06T21:26:53.035 INFO:tasks.workunit.client.1.smithi154.stdout:6/518: write d8/fc [243778,53840] 0 2024-05-06T21:26:53.035 INFO:tasks.workunit.client.1.smithi154.stdout:6/519: chown d8/d13/d20/f65 13250 1 2024-05-06T21:26:53.036 INFO:tasks.workunit.client.0.smithi032.stdout:0/909: read d4/d3e/d63/fd5 [1163035,109602] 0 2024-05-06T21:26:53.036 INFO:tasks.workunit.client.0.smithi032.stdout:0/910: fdatasync d4/d3e/d63/d6c/d8f/dc2/fff 0 2024-05-06T21:26:53.036 INFO:tasks.workunit.client.0.smithi032.stdout:0/911: fsync d4/da/d16/d33/d9e/dc9/dd8/f102 0 2024-05-06T21:26:53.036 INFO:tasks.workunit.client.1.smithi154.stdout:4/668: creat d0/d82/d44/d73/d4a/dd4/fe1 x:0 0 0 2024-05-06T21:26:53.037 INFO:tasks.workunit.client.1.smithi154.stdout:4/669: write d0/d2/d47/d81/fde [408332,91850] 0 2024-05-06T21:26:53.037 INFO:tasks.workunit.client.0.smithi032.stdout:0/912: mknod d4/c12f 0 2024-05-06T21:26:53.037 INFO:tasks.workunit.client.0.smithi032.stdout:0/913: write d4/da/d16/fb3 [1161753,66445] 0 2024-05-06T21:26:53.037 INFO:tasks.workunit.client.0.smithi032.stdout:0/914: creat d4/da/d16/d33/d9e/dcf/f130 x:0 0 0 2024-05-06T21:26:53.040 INFO:tasks.workunit.client.1.smithi154.stdout:4/670: write d0/d82/d44/d73/d4a/dd4/d1a/f3f [148842,91579] 0 2024-05-06T21:26:53.040 INFO:tasks.workunit.client.1.smithi154.stdout:4/671: creat d0/d82/d44/fe2 x:0 0 0 2024-05-06T21:26:53.040 INFO:tasks.workunit.client.1.smithi154.stdout:4/672: write d0/d82/d44/d73/d4a/dd4/d1a/d7e/f90 [3596356,47559] 0 2024-05-06T21:26:53.045 INFO:tasks.workunit.client.0.smithi032.stdout:5/958: dread d0/f12 [0,4194304] 0 2024-05-06T21:26:53.045 INFO:tasks.workunit.client.0.smithi032.stdout:5/959: fdatasync d0/d16/d2a/d5f/fcf 0 2024-05-06T21:26:53.045 INFO:tasks.workunit.client.1.smithi154.stdout:4/673: unlink d0/d2/d47/d81/fde 0 2024-05-06T21:26:53.045 INFO:tasks.workunit.client.0.smithi032.stdout:5/960: symlink d0/d24/d38/d37/d7b/dc0/l134 0 2024-05-06T21:26:53.046 INFO:tasks.workunit.client.0.smithi032.stdout:5/961: mkdir d0/d16/d2a/dc7/dd2/db1/d12e/d106/d110/d135 0 2024-05-06T21:26:53.047 INFO:tasks.workunit.client.0.smithi032.stdout:5/962: getdents d0/d16/d2a/d5f/d10d/d112/dad 0 2024-05-06T21:26:53.047 INFO:tasks.workunit.client.0.smithi032.stdout:5/963: write d0/d16/d2a/dc7/dd2/db1/fdc [629437,53999] 0 2024-05-06T21:26:53.049 INFO:tasks.workunit.client.0.smithi032.stdout:5/964: link d0/d24/d38/d37/df0/d50/d5a/l6d d0/d16/d2a/l136 0 2024-05-06T21:26:53.050 INFO:tasks.workunit.client.0.smithi032.stdout:5/965: creat d0/d16/d109/f137 x:0 0 0 2024-05-06T21:26:53.051 INFO:tasks.workunit.client.1.smithi154.stdout:4/674: link d0/d82/d44/d73/d4a/d74/d75/cc3 d0/d82/d44/d73/d4a/dd4/d1a/ce3 0 2024-05-06T21:26:53.052 INFO:tasks.workunit.client.0.smithi032.stdout:0/915: dread d4/fe2 [0,4194304] 0 2024-05-06T21:26:53.052 INFO:tasks.workunit.client.0.smithi032.stdout:0/916: chown d4/da/d14/d1a/cb5 6 1 2024-05-06T21:26:53.068 INFO:tasks.workunit.client.0.smithi032.stdout:5/966: dread d0/d16/d2a/d5f/dca/f4f [0,4194304] 0 2024-05-06T21:26:53.068 INFO:tasks.workunit.client.0.smithi032.stdout:5/967: truncate d0/d24/d38/d37/d7b/dc0/fe0 5764072 0 2024-05-06T21:26:53.068 INFO:tasks.workunit.client.0.smithi032.stdout:5/968: write d0/d24/d38/d37/f53 [3216604,129514] 0 2024-05-06T21:26:53.072 INFO:tasks.workunit.client.0.smithi032.stdout:5/969: mknod d0/d24/d38/c138 0 2024-05-06T21:26:53.072 INFO:tasks.workunit.client.0.smithi032.stdout:5/970: readlink d0/d24/d38/d37/d7b/dc0/l134 0 2024-05-06T21:26:53.073 INFO:tasks.workunit.client.1.smithi154.stdout:6/520: dread d8/d13/f64 [0,4194304] 0 2024-05-06T21:26:53.073 INFO:tasks.workunit.client.1.smithi154.stdout:6/521: fsync d8/d13/f71 0 2024-05-06T21:26:53.073 INFO:tasks.workunit.client.0.smithi032.stdout:5/971: creat d0/d16/d2a/dc7/dd2/de1/f139 x:0 0 0 2024-05-06T21:26:53.074 INFO:tasks.workunit.client.1.smithi154.stdout:6/522: symlink d8/d13/d20/la2 0 2024-05-06T21:26:53.075 INFO:tasks.workunit.client.0.smithi032.stdout:6/948: dwrite d8/dd/d18/d13/fa5 [0,4194304] 0 2024-05-06T21:26:53.076 INFO:tasks.workunit.client.1.smithi154.stdout:6/523: mkdir d8/d11/d2d/da3 0 2024-05-06T21:26:53.076 INFO:tasks.workunit.client.1.smithi154.stdout:6/524: fsync d8/d11/d33/d4a/d6c/d8e/f96 0 2024-05-06T21:26:53.077 INFO:tasks.workunit.client.1.smithi154.stdout:4/675: dwrite d0/d2/d47/f6d [0,4194304] 0 2024-05-06T21:26:53.077 INFO:tasks.workunit.client.1.smithi154.stdout:4/676: stat d0/d82 0 2024-05-06T21:26:53.078 INFO:tasks.workunit.client.1.smithi154.stdout:6/525: mknod d8/d11/d2d/d3d/d4c/ca4 0 2024-05-06T21:26:53.078 INFO:tasks.workunit.client.1.smithi154.stdout:6/526: chown d8/d13/d20 2498395 1 2024-05-06T21:26:53.079 INFO:tasks.workunit.client.0.smithi032.stdout:6/949: rename d8/dd/d18/d13/fa7 to d8/dd/d1b/d67/f119 0 2024-05-06T21:26:53.079 INFO:tasks.workunit.client.0.smithi032.stdout:6/950: stat d8/dd/d18/d13/d1d/lae 0 2024-05-06T21:26:53.079 INFO:tasks.workunit.client.1.smithi154.stdout:4/677: symlink d0/d2/dbd/le4 0 2024-05-06T21:26:53.080 INFO:tasks.workunit.client.0.smithi032.stdout:6/951: dread d8/dd/f12 [0,4194304] 0 2024-05-06T21:26:53.080 INFO:tasks.workunit.client.0.smithi032.stdout:6/952: readlink d8/dd/d18/d13/lb1 0 2024-05-06T21:26:53.081 INFO:tasks.workunit.client.1.smithi154.stdout:6/527: creat d8/fa5 x:0 0 0 2024-05-06T21:26:53.082 INFO:tasks.workunit.client.1.smithi154.stdout:4/678: creat d0/d82/d3d/dab/fe5 x:0 0 0 2024-05-06T21:26:53.083 INFO:tasks.workunit.client.1.smithi154.stdout:6/528: link d8/d11/d2d/d3d/d70/c8a d8/d11/d2d/d3d/d70/d7b/d95/ca6 0 2024-05-06T21:26:53.091 INFO:tasks.workunit.client.1.smithi154.stdout:1/695: dwrite d6/db/d10/d26/f6b [0,4194304] 0 2024-05-06T21:26:53.091 INFO:tasks.workunit.client.1.smithi154.stdout:1/696: write d6/db/f34 [1110453,130972] 0 2024-05-06T21:26:53.091 INFO:tasks.workunit.client.1.smithi154.stdout:8/676: dwrite d3/f54 [0,4194304] 0 2024-05-06T21:26:53.091 INFO:tasks.workunit.client.1.smithi154.stdout:8/677: dread - d3/d14/d1a/d29/d32/d40/d59/d67/fc2 zero size 2024-05-06T21:26:53.094 INFO:tasks.workunit.client.1.smithi154.stdout:3/813: dwrite d0/da/d1a/d28/dbc/d117/dd/d1c/d21/f60 [4194304,4194304] 0 2024-05-06T21:26:53.099 INFO:tasks.workunit.client.1.smithi154.stdout:1/697: symlink d6/db/d97/ld5 0 2024-05-06T21:26:53.099 INFO:tasks.workunit.client.1.smithi154.stdout:1/698: creat d6/db/d97/fd6 x:0 0 0 2024-05-06T21:26:53.101 INFO:tasks.workunit.client.0.smithi032.stdout:6/953: dread d8/dd/d18/d3b/ff5 [4194304,4194304] 0 2024-05-06T21:26:53.102 INFO:tasks.workunit.client.1.smithi154.stdout:8/678: mkdir d3/d64/ddb 0 2024-05-06T21:26:53.102 INFO:tasks.workunit.client.1.smithi154.stdout:8/679: readlink d3/l4f 0 2024-05-06T21:26:53.106 INFO:tasks.workunit.client.1.smithi154.stdout:9/751: dwrite d5/d14/d3a/d71/feb [0,4194304] 0 2024-05-06T21:26:53.106 INFO:tasks.workunit.client.1.smithi154.stdout:9/752: write d5/d14/f60 [4949102,14736] 0 2024-05-06T21:26:53.106 INFO:tasks.workunit.client.1.smithi154.stdout:0/764: dwrite d6/dc/d40/d4a/dac/ff0 [8388608,4194304] 0 2024-05-06T21:26:53.106 INFO:tasks.workunit.client.1.smithi154.stdout:0/765: fsync d6/dc/d40/d5e/f8c 0 2024-05-06T21:26:53.106 INFO:tasks.workunit.client.1.smithi154.stdout:1/699: mknod d6/db/d69/d89/cd7 0 2024-05-06T21:26:53.107 INFO:tasks.workunit.client.0.smithi032.stdout:0/917: dwrite d4/da/d16/d33/f36 [0,4194304] 0 2024-05-06T21:26:53.110 INFO:tasks.workunit.client.0.smithi032.stdout:0/918: dread d4/da/f81 [0,4194304] 0 2024-05-06T21:26:53.110 INFO:tasks.workunit.client.0.smithi032.stdout:0/919: write d4/da/d16/d33/d9e/dcf/f101 [530012,110123] 0 2024-05-06T21:26:53.110 INFO:tasks.workunit.client.0.smithi032.stdout:0/920: chown d4/d3e/d42/ldb 0 1 2024-05-06T21:26:53.111 INFO:tasks.workunit.client.1.smithi154.stdout:3/814: write d0/da/d1a/d28/d17/f63 [837511,64069] 0 2024-05-06T21:26:53.111 INFO:tasks.workunit.client.0.smithi032.stdout:0/921: mkdir d4/da/d16/dcc/d131 0 2024-05-06T21:26:53.111 INFO:tasks.workunit.client.1.smithi154.stdout:9/753: creat d5/d20/d37/f101 x:0 0 0 2024-05-06T21:26:53.112 INFO:tasks.workunit.client.1.smithi154.stdout:9/754: chown d5/d14/d3a/fa1 257686082 1 2024-05-06T21:26:53.113 INFO:tasks.workunit.client.1.smithi154.stdout:3/815: write d0/f2b [2270833,77150] 0 2024-05-06T21:26:53.113 INFO:tasks.workunit.client.1.smithi154.stdout:3/816: readlink d0/da/d1a/d28/d17/l7e 0 2024-05-06T21:26:53.116 INFO:tasks.workunit.client.1.smithi154.stdout:0/766: creat d6/dc/d51/d54/dbd/ffb x:0 0 0 2024-05-06T21:26:53.116 INFO:tasks.workunit.client.1.smithi154.stdout:0/767: creat d6/dc/d40/d4a/d6c/dce/ffc x:0 0 0 2024-05-06T21:26:53.117 INFO:tasks.workunit.client.1.smithi154.stdout:0/768: dread - d6/dc/d40/d4a/d6c/dce/fed zero size 2024-05-06T21:26:53.119 INFO:tasks.workunit.client.0.smithi032.stdout:5/972: dwrite d0/d16/d2f/d77/d99/f10c [0,4194304] 0 2024-05-06T21:26:53.119 INFO:tasks.workunit.client.0.smithi032.stdout:5/973: fsync d0/d16/d2a/d5f/d9a/f97 0 2024-05-06T21:26:53.120 INFO:tasks.workunit.client.1.smithi154.stdout:1/700: rename d6/db/d10/d15/fce to d6/fd8 0 2024-05-06T21:26:53.123 INFO:tasks.workunit.client.1.smithi154.stdout:3/817: rmdir d0/da/d1a/d28/d17/dfe 39 2024-05-06T21:26:53.123 INFO:tasks.workunit.client.1.smithi154.stdout:3/818: write d0/da/d1a/d28/dbc/d117/d7c/d80/ff1 [993249,79314] 0 2024-05-06T21:26:53.125 INFO:tasks.workunit.client.0.smithi032.stdout:5/974: rename d0/d16/d46/da9/dea/d123 to d0/d16/d2f/d77/d99/dbc/d13a 0 2024-05-06T21:26:53.126 INFO:tasks.workunit.client.1.smithi154.stdout:0/769: truncate d6/dc/f50 2818152 0 2024-05-06T21:26:53.130 INFO:tasks.workunit.client.1.smithi154.stdout:5/676: sync 2024-05-06T21:26:53.130 INFO:tasks.workunit.client.1.smithi154.stdout:2/605: sync 2024-05-06T21:26:53.130 INFO:tasks.workunit.client.1.smithi154.stdout:2/606: chown db/d12/f43 0 1 2024-05-06T21:26:53.135 INFO:tasks.workunit.client.0.smithi032.stdout:5/975: write d0/d24/d38/f116 [438772,118613] 0 2024-05-06T21:26:53.135 INFO:tasks.workunit.client.0.smithi032.stdout:5/976: chown d0/d24/d38/d37/df0/d50 783 1 2024-05-06T21:26:53.135 INFO:tasks.workunit.client.0.smithi032.stdout:5/977: dread - d0/d16/d2a/d5f/d9a/fe4 zero size 2024-05-06T21:26:53.137 INFO:tasks.workunit.client.0.smithi032.stdout:5/978: mkdir d0/d16/d2a/d59/d111/d13b 0 2024-05-06T21:26:53.137 INFO:tasks.workunit.client.1.smithi154.stdout:3/819: getdents d0/da/d1a/d28/dbc/d117/dd/d1c/d90 0 2024-05-06T21:26:53.137 INFO:tasks.workunit.client.1.smithi154.stdout:3/820: dread - d0/da/d1a/d28/dbc/d117/d52/d62/fde zero size 2024-05-06T21:26:53.137 INFO:tasks.workunit.client.0.smithi032.stdout:5/979: creat d0/d16/d2a/d59/d111/f13c x:0 0 0 2024-05-06T21:26:53.138 INFO:tasks.workunit.client.1.smithi154.stdout:0/770: truncate d6/dc/f38 1132738 0 2024-05-06T21:26:53.138 INFO:tasks.workunit.client.1.smithi154.stdout:0/771: write d6/dc/d40/d85/fec [4370107,118680] 0 2024-05-06T21:26:53.139 INFO:tasks.workunit.client.0.smithi032.stdout:5/980: truncate d0/d16/f1e 3593010 0 2024-05-06T21:26:53.139 INFO:tasks.workunit.client.0.smithi032.stdout:5/981: readlink d0/d24/d38/d37/df0/lba 0 2024-05-06T21:26:53.139 INFO:tasks.workunit.client.0.smithi032.stdout:5/982: chown d0/d16/d2a/d52/c90 16366149 1 2024-05-06T21:26:53.139 INFO:tasks.workunit.client.0.smithi032.stdout:5/983: chown d0/d24/d38 2776977 1 2024-05-06T21:26:53.140 INFO:tasks.workunit.client.0.smithi032.stdout:5/984: rename d0/d24/d38/dc4/f127 to d0/d16/d2a/d5f/d10d/d112/f13d 0 2024-05-06T21:26:53.140 INFO:tasks.workunit.client.0.smithi032.stdout:5/985: chown d0/d16/d2a/d5f/d10d/d112/cf6 3208 1 2024-05-06T21:26:53.140 INFO:tasks.workunit.client.1.smithi154.stdout:2/607: creat db/de/d16/d33/fc0 x:0 0 0 2024-05-06T21:26:53.141 INFO:tasks.workunit.client.0.smithi032.stdout:5/986: mknod d0/d16/d46/da9/dea/c13e 0 2024-05-06T21:26:53.141 INFO:tasks.workunit.client.1.smithi154.stdout:2/608: read db/de/d10/f69 [187644,107736] 0 2024-05-06T21:26:53.142 INFO:tasks.workunit.client.0.smithi032.stdout:5/987: creat d0/d87/d11b/f13f x:0 0 0 2024-05-06T21:26:53.142 INFO:tasks.workunit.client.0.smithi032.stdout:5/988: fsync d0/d87/d11b/dfb/f102 0 2024-05-06T21:26:53.143 INFO:tasks.workunit.client.1.smithi154.stdout:3/821: mkdir d0/dd5/d11c 0 2024-05-06T21:26:53.143 INFO:tasks.workunit.client.0.smithi032.stdout:5/989: rename d0/d16/d2a/d5f/c62 to d0/d16/d2a/dc7/c140 0 2024-05-06T21:26:53.146 INFO:tasks.workunit.client.1.smithi154.stdout:9/755: rename d5/d89 to d5/d20/d52/d59/d102 0 2024-05-06T21:26:53.147 INFO:tasks.workunit.client.1.smithi154.stdout:3/822: symlink d0/dd5/d11c/l11d 0 2024-05-06T21:26:53.148 INFO:tasks.workunit.client.1.smithi154.stdout:0/772: getdents d6/dc/d40/d4a/d6c 0 2024-05-06T21:26:53.150 INFO:tasks.workunit.client.1.smithi154.stdout:5/677: rename d2/d3/d21/d95/dd/f92 to d2/d3/d21/d95/dd/d2a/d54/d43/d73/fea 0 2024-05-06T21:26:53.151 INFO:tasks.workunit.client.1.smithi154.stdout:9/756: mkdir d5/d2e/d8b/dc6/d103 0 2024-05-06T21:26:53.151 INFO:tasks.workunit.client.1.smithi154.stdout:9/757: stat d5/d20/d52 0 2024-05-06T21:26:53.154 INFO:tasks.workunit.client.1.smithi154.stdout:5/678: mkdir d2/d3/d21/d95/deb 0 2024-05-06T21:26:53.157 INFO:tasks.workunit.client.1.smithi154.stdout:9/758: unlink d5/d2e/d66/f88 0 2024-05-06T21:26:53.157 INFO:tasks.workunit.client.1.smithi154.stdout:9/759: dread - d5/d14/d3a/d71/fe2 zero size 2024-05-06T21:26:53.158 INFO:tasks.workunit.client.1.smithi154.stdout:9/760: dread - d5/d14/fef zero size 2024-05-06T21:26:53.158 INFO:tasks.workunit.client.0.smithi032.stdout:5/990: dread d0/d24/d38/d37/df0/d50/f6e [0,4194304] 0 2024-05-06T21:26:53.158 INFO:tasks.workunit.client.1.smithi154.stdout:7/548: sync 2024-05-06T21:26:53.159 INFO:tasks.workunit.client.1.smithi154.stdout:4/679: dwrite d0/d2/d47/fad [0,4194304] 0 2024-05-06T21:26:53.159 INFO:tasks.workunit.client.1.smithi154.stdout:4/680: truncate d0/d82/d3d/dab/fe5 972374 0 2024-05-06T21:26:53.159 INFO:tasks.workunit.client.1.smithi154.stdout:8/680: fdatasync d3/fb 0 2024-05-06T21:26:53.160 INFO:tasks.workunit.client.0.smithi032.stdout:5/991: symlink d0/d24/d38/d37/df0/l141 0 2024-05-06T21:26:53.160 INFO:tasks.workunit.client.0.smithi032.stdout:5/992: write d0/d16/d2a/d5f/dca/f92 [2658073,92282] 0 2024-05-06T21:26:53.161 INFO:tasks.workunit.client.0.smithi032.stdout:5/993: mkdir d0/d16/d2a/d5f/dca/d142 0 2024-05-06T21:26:53.162 INFO:tasks.workunit.client.0.smithi032.stdout:5/994: symlink d0/d16/d2a/dc7/dd2/db1/d12e/d106/l143 0 2024-05-06T21:26:53.164 INFO:tasks.workunit.client.0.smithi032.stdout:5/995: symlink d0/d16/d2a/d5f/d10d/d112/dad/l144 0 2024-05-06T21:26:53.166 INFO:tasks.workunit.client.0.smithi032.stdout:5/996: mknod d0/d16/d2a/d59/d67/d73/dde/c145 0 2024-05-06T21:26:53.166 INFO:tasks.workunit.client.0.smithi032.stdout:5/997: chown d0/d24/d38/d37/df0/l141 1 1 2024-05-06T21:26:53.167 INFO:tasks.workunit.client.1.smithi154.stdout:8/681: dread d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f9e [4194304,4194304] 0 2024-05-06T21:26:53.170 INFO:tasks.workunit.client.1.smithi154.stdout:9/761: rename d5/d14/d3a/d71 to d5/d20/d52/d6e/d104 0 2024-05-06T21:26:53.171 INFO:tasks.workunit.client.1.smithi154.stdout:9/762: write d5/d20/d52/d6e/d83/da2/fcf [250437,61267] 0 2024-05-06T21:26:53.172 INFO:tasks.workunit.client.1.smithi154.stdout:8/682: creat d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/fdc x:0 0 0 2024-05-06T21:26:53.174 INFO:tasks.workunit.client.1.smithi154.stdout:9/763: mknod d5/d20/d52/d6e/d83/c105 0 2024-05-06T21:26:53.176 INFO:tasks.workunit.client.1.smithi154.stdout:8/683: creat d3/d14/d1a/d45/dcf/db4/fdd x:0 0 0 2024-05-06T21:26:53.179 INFO:tasks.workunit.client.1.smithi154.stdout:9/764: truncate d5/d20/f4b 1369839 0 2024-05-06T21:26:53.179 INFO:tasks.workunit.client.1.smithi154.stdout:9/765: read - d5/d2e/d8b/dc6/fff zero size 2024-05-06T21:26:53.180 INFO:tasks.workunit.client.1.smithi154.stdout:7/549: rename d6/d46 to d6/d20/d40/daf 0 2024-05-06T21:26:53.180 INFO:tasks.workunit.client.1.smithi154.stdout:7/550: fdatasync d6/f7d 0 2024-05-06T21:26:53.181 INFO:tasks.workunit.client.1.smithi154.stdout:9/766: truncate d5/d20/d52/f57 3862560 0 2024-05-06T21:26:53.181 INFO:tasks.workunit.client.1.smithi154.stdout:9/767: getdents d5/d20/d84 0 2024-05-06T21:26:53.181 INFO:tasks.workunit.client.1.smithi154.stdout:9/768: fdatasync d5/d20/d52/f57 0 2024-05-06T21:26:53.181 INFO:tasks.workunit.client.1.smithi154.stdout:9/769: fsync d5/d14/f94 0 2024-05-06T21:26:53.185 INFO:tasks.workunit.client.0.smithi032.stdout:5/998: dread d0/d16/d2a/d5f/dca/fa4 [0,4194304] 0 2024-05-06T21:26:53.185 INFO:tasks.workunit.client.0.smithi032.stdout:5/999: readlink d0/d16/d2a/d5f/lff 0 2024-05-06T21:26:53.190 INFO:tasks.workunit.client.1.smithi154.stdout:8/684: dread d3/d14/d1a/d29/d43/f5d [0,4194304] 0 2024-05-06T21:26:53.193 INFO:tasks.workunit.client.1.smithi154.stdout:8/685: rename d3/d14/d1a/d6e/fd3 to d3/d64/d6d/fde 0 2024-05-06T21:26:53.193 INFO:tasks.workunit.client.1.smithi154.stdout:8/686: chown d3/f54 11893081 1 2024-05-06T21:26:53.193 INFO:tasks.workunit.client.1.smithi154.stdout:8/687: truncate d3/d14/d1a/d29/d32/d40/d59/d67/fc2 685171 0 2024-05-06T21:26:53.193 INFO:tasks.workunit.client.1.smithi154.stdout:8/688: write d3/ff [2168113,23197] 0 2024-05-06T21:26:53.193 INFO:tasks.workunit.client.1.smithi154.stdout:8/689: fsync d3/d56/f7f 0 2024-05-06T21:26:53.193 INFO:tasks.workunit.client.1.smithi154.stdout:8/690: chown d3/d38/f63 0 1 2024-05-06T21:26:53.195 INFO:tasks.workunit.client.1.smithi154.stdout:8/691: mkdir d3/d14/d1a/d45/dcf/ddf 0 2024-05-06T21:26:53.215 INFO:tasks.workunit.client.0.smithi032.stdout:6/954: dwrite d8/dd/d18/d3b/db9/f65 [4194304,4194304] 0 2024-05-06T21:26:53.215 INFO:tasks.workunit.client.0.smithi032.stdout:6/955: fsync d8/dd/d18/d3b/f50 0 2024-05-06T21:26:53.216 INFO:tasks.workunit.client.1.smithi154.stdout:1/701: dwrite d6/db/d97/fd6 [0,4194304] 0 2024-05-06T21:26:53.216 INFO:tasks.workunit.client.1.smithi154.stdout:1/702: chown d6/db/d10/d26/l55 0 1 2024-05-06T21:26:53.221 INFO:tasks.workunit.client.0.smithi032.stdout:0/922: dwrite d4/fb4 [0,4194304] 0 2024-05-06T21:26:53.222 INFO:tasks.workunit.client.0.smithi032.stdout:0/923: chown d4/da/d16/d33/c67 921881546 1 2024-05-06T21:26:53.222 INFO:tasks.workunit.client.1.smithi154.stdout:0/773: getdents d6/dc/d51/d54/dbd 0 2024-05-06T21:26:53.222 INFO:tasks.workunit.client.1.smithi154.stdout:0/774: getdents d6/dc/d51/d54/dee 0 2024-05-06T21:26:53.223 INFO:tasks.workunit.client.1.smithi154.stdout:0/775: write d6/dc/d51/f80 [73658,112059] 0 2024-05-06T21:26:53.226 INFO:tasks.workunit.client.0.smithi032.stdout:0/924: mknod d4/c132 0 2024-05-06T21:26:53.227 INFO:tasks.workunit.client.0.smithi032.stdout:0/925: truncate d4/d3e/fc1 3362273 0 2024-05-06T21:26:53.227 INFO:tasks.workunit.client.0.smithi032.stdout:0/926: fsync d4/da/d14/f47 0 2024-05-06T21:26:53.227 INFO:tasks.workunit.client.0.smithi032.stdout:0/927: stat d4/d3e/c90 0 2024-05-06T21:26:53.228 INFO:tasks.workunit.client.1.smithi154.stdout:2/609: dwrite db/f71 [0,4194304] 0 2024-05-06T21:26:53.228 INFO:tasks.workunit.client.1.smithi154.stdout:2/610: fsync db/de/d16/f98 0 2024-05-06T21:26:53.228 INFO:tasks.workunit.client.1.smithi154.stdout:2/611: read db/de/d10/f5f [2913036,57930] 0 2024-05-06T21:26:53.229 INFO:tasks.workunit.client.1.smithi154.stdout:3/823: dwrite d0/da/d1a/d28/dbc/d117/d52/d62/fe0 [0,4194304] 0 2024-05-06T21:26:53.230 INFO:tasks.workunit.client.1.smithi154.stdout:9/770: dwrite d5/f76 [0,4194304] 0 2024-05-06T21:26:53.230 INFO:tasks.workunit.client.1.smithi154.stdout:4/681: dwrite d0/f34 [0,4194304] 0 2024-05-06T21:26:53.231 INFO:tasks.workunit.client.0.smithi032.stdout:0/928: dread d4/f7 [0,4194304] 0 2024-05-06T21:26:53.232 INFO:tasks.workunit.client.0.smithi032.stdout:0/929: chown d4/d96/cbb 6679 1 2024-05-06T21:26:53.233 INFO:tasks.workunit.client.0.smithi032.stdout:0/930: dread d4/da/d16/d4f/f10e [0,4194304] 0 2024-05-06T21:26:53.233 INFO:tasks.workunit.client.0.smithi032.stdout:0/931: dread - d4/da/d14/d4a/fa8 zero size 2024-05-06T21:26:53.234 INFO:tasks.workunit.client.0.smithi032.stdout:0/932: dread - d4/da/d14/d4a/f10d zero size 2024-05-06T21:26:53.234 INFO:tasks.workunit.client.1.smithi154.stdout:1/703: mknod d6/db/dbe/cd9 0 2024-05-06T21:26:53.235 INFO:tasks.workunit.client.0.smithi032.stdout:0/933: link d4/da/d14/d1a/d66/fd3 d4/da/d14/d1a/d66/dbc/f133 0 2024-05-06T21:26:53.235 INFO:tasks.workunit.client.0.smithi032.stdout:0/934: chown d4/da/d16/ceb 1860429 1 2024-05-06T21:26:53.239 INFO:tasks.workunit.client.1.smithi154.stdout:2/612: truncate db/d12/d19/d4b/d78/f9f 43466 0 2024-05-06T21:26:53.239 INFO:tasks.workunit.client.1.smithi154.stdout:2/613: write db/d12/d19/d4b/f75 [1310024,87469] 0 2024-05-06T21:26:53.241 INFO:tasks.workunit.client.1.smithi154.stdout:7/551: dwrite d6/d42/d6c/d6e/f19 [0,4194304] 0 2024-05-06T21:26:53.241 INFO:tasks.workunit.client.1.smithi154.stdout:1/704: dread d6/db/f6f [0,4194304] 0 2024-05-06T21:26:53.242 INFO:tasks.workunit.client.1.smithi154.stdout:3/824: creat d0/d2/f11e x:0 0 0 2024-05-06T21:26:53.246 INFO:tasks.workunit.client.1.smithi154.stdout:8/692: dwrite d3/d14/f20 [4194304,4194304] 0 2024-05-06T21:26:53.246 INFO:tasks.workunit.client.0.smithi032.stdout:6/956: dwrite d8/f17 [4194304,4194304] 0 2024-05-06T21:26:53.246 INFO:tasks.workunit.client.0.smithi032.stdout:6/957: creat d8/dd/d18/d3b/db9/f11a x:0 0 0 2024-05-06T21:26:53.247 INFO:tasks.workunit.client.1.smithi154.stdout:9/771: truncate d5/d2e/d8b/fd2 132292 0 2024-05-06T21:26:53.247 INFO:tasks.workunit.client.1.smithi154.stdout:9/772: chown d5/d2e/d7f 6903 1 2024-05-06T21:26:53.247 INFO:tasks.workunit.client.1.smithi154.stdout:9/773: truncate d5/d14/f82 362817 0 2024-05-06T21:26:53.250 INFO:tasks.workunit.client.1.smithi154.stdout:9/774: read d5/d20/d52/f99 [144255,117839] 0 2024-05-06T21:26:53.250 INFO:tasks.workunit.client.1.smithi154.stdout:9/775: readlink d5/d20/le8 0 2024-05-06T21:26:53.250 INFO:tasks.workunit.client.1.smithi154.stdout:9/776: chown d5/d20/d52/d6e/fae 32502 1 2024-05-06T21:26:53.250 INFO:tasks.workunit.client.1.smithi154.stdout:9/777: write d5/d20/d52/d6e/fb3 [82657,74110] 0 2024-05-06T21:26:53.254 INFO:tasks.workunit.client.1.smithi154.stdout:4/682: rename d0/d82/d3d/l9b to d0/d82/d44/d73/d4a/dd9/le6 0 2024-05-06T21:26:53.254 INFO:tasks.workunit.client.1.smithi154.stdout:8/693: write d3/d56/f8b [3588816,68128] 0 2024-05-06T21:26:53.254 INFO:tasks.workunit.client.1.smithi154.stdout:8/694: write d3/f8 [7091636,61169] 0 2024-05-06T21:26:53.254 INFO:tasks.workunit.client.0.smithi032.stdout:6/958: symlink d8/d3d/d49/dad/d10b/l11b 0 2024-05-06T21:26:53.255 INFO:tasks.workunit.client.0.smithi032.stdout:6/959: dread d8/dd/d1b/f9d [0,4194304] 0 2024-05-06T21:26:53.257 INFO:tasks.workunit.client.1.smithi154.stdout:2/614: creat db/d12/fc1 x:0 0 0 2024-05-06T21:26:53.257 INFO:tasks.workunit.client.0.smithi032.stdout:6/960: mkdir d8/dd/d18/d3b/db9/d102/d11c 0 2024-05-06T21:26:53.258 INFO:tasks.workunit.client.1.smithi154.stdout:7/552: mknod d6/d20/d40/d52/cb0 0 2024-05-06T21:26:53.260 INFO:tasks.workunit.client.1.smithi154.stdout:0/776: dread d6/dc/d42/f8d [0,4194304] 0 2024-05-06T21:26:53.261 INFO:tasks.workunit.client.1.smithi154.stdout:1/705: unlink d6/db/d10/d26/c41 0 2024-05-06T21:26:53.262 INFO:tasks.workunit.client.1.smithi154.stdout:0/777: write d6/dc/f38 [812235,39390] 0 2024-05-06T21:26:53.262 INFO:tasks.workunit.client.1.smithi154.stdout:0/778: creat d6/dc1/ffd x:0 0 0 2024-05-06T21:26:53.266 INFO:tasks.workunit.client.0.smithi032.stdout:1/908: sync 2024-05-06T21:26:53.267 INFO:tasks.workunit.client.0.smithi032.stdout:2/853: sync 2024-05-06T21:26:53.267 INFO:tasks.workunit.client.1.smithi154.stdout:8/695: mknod d3/d14/d1a/d45/dcf/db4/dd1/ce0 0 2024-05-06T21:26:53.268 INFO:tasks.workunit.client.0.smithi032.stdout:6/961: dread d8/d33/f77 [0,4194304] 0 2024-05-06T21:26:53.268 INFO:tasks.workunit.client.0.smithi032.stdout:6/962: fsync d8/dd/d18/d3b/d90/ff8 0 2024-05-06T21:26:53.269 INFO:tasks.workunit.client.0.smithi032.stdout:6/963: fdatasync d8/dd/d18/d13/f91 0 2024-05-06T21:26:53.269 INFO:tasks.workunit.client.0.smithi032.stdout:2/854: unlink df/d19/d1e/d35/dc5/d2e/d33/c6c 0 2024-05-06T21:26:53.269 INFO:tasks.workunit.client.1.smithi154.stdout:2/615: rmdir db/d12/d1d 39 2024-05-06T21:26:53.270 INFO:tasks.workunit.client.1.smithi154.stdout:7/553: mkdir d6/d20/db1 0 2024-05-06T21:26:53.276 INFO:tasks.workunit.client.1.smithi154.stdout:0/779: rename d6/f83 to d6/dc1/dd0/ffe 0 2024-05-06T21:26:53.278 INFO:tasks.workunit.client.1.smithi154.stdout:7/554: rmdir d6/d42/d6c/d6e/d21/d2e 39 2024-05-06T21:26:53.281 INFO:tasks.workunit.client.1.smithi154.stdout:7/555: symlink d6/d20/d85/da2/lb2 0 2024-05-06T21:26:53.281 INFO:tasks.workunit.client.1.smithi154.stdout:7/556: creat d6/fb3 x:0 0 0 2024-05-06T21:26:53.282 INFO:tasks.workunit.client.1.smithi154.stdout:7/557: chown d6/d42/d6c/d6e/d23/f6f 106505 1 2024-05-06T21:26:53.285 INFO:tasks.workunit.client.1.smithi154.stdout:7/558: creat d6/d42/d6c/d6e/fb4 x:0 0 0 2024-05-06T21:26:53.297 INFO:tasks.workunit.client.0.smithi032.stdout:1/909: dread db/f1f [0,4194304] 0 2024-05-06T21:26:53.303 INFO:tasks.workunit.client.1.smithi154.stdout:8/696: dread d3/d64/d6d/dbd/f3a [0,4194304] 0 2024-05-06T21:26:53.305 INFO:tasks.workunit.client.0.smithi032.stdout:6/964: write d8/d3d/d49/dad/fd7 [730378,16525] 0 2024-05-06T21:26:53.306 INFO:tasks.workunit.client.0.smithi032.stdout:6/965: creat d8/db6/f11d x:0 0 0 2024-05-06T21:26:53.338 INFO:tasks.workunit.client.0.smithi032.stdout:1/910: dread db/d16/d5d/fd8 [0,4194304] 0 2024-05-06T21:26:53.344 INFO:tasks.workunit.client.0.smithi032.stdout:0/935: dwrite d4/da/d16/d33/f57 [0,4194304] 0 2024-05-06T21:26:53.344 INFO:tasks.workunit.client.0.smithi032.stdout:0/936: write d4/da/d16/d33/d9e/dcf/f109 [530428,56155] 0 2024-05-06T21:26:53.347 INFO:tasks.workunit.client.0.smithi032.stdout:0/937: link d4/da/d16/d33/d9e/dcf/f109 d4/d96/f134 0 2024-05-06T21:26:53.347 INFO:tasks.workunit.client.0.smithi032.stdout:0/938: fsync d4/da/d16/d33/f38 0 2024-05-06T21:26:53.348 INFO:tasks.workunit.client.0.smithi032.stdout:0/939: rename d4/d3e/d63/cfc to d4/da/d16/d33/d121/c135 0 2024-05-06T21:26:53.349 INFO:tasks.workunit.client.0.smithi032.stdout:0/940: write d4/da/d14/f76 [528291,111323] 0 2024-05-06T21:26:53.350 INFO:tasks.workunit.client.0.smithi032.stdout:0/941: rename d4/da/d14/d1a/f11e to d4/d3e/d63/d6c/f136 0 2024-05-06T21:26:53.350 INFO:tasks.workunit.client.0.smithi032.stdout:0/942: write d4/da/d14/d4a/f10d [404190,105052] 0 2024-05-06T21:26:53.352 INFO:tasks.workunit.client.1.smithi154.stdout:4/683: dwrite d0/d10/fc0 [0,4194304] 0 2024-05-06T21:26:53.352 INFO:tasks.workunit.client.1.smithi154.stdout:4/684: dread - d0/d82/d44/d73/d9a/fac zero size 2024-05-06T21:26:53.356 INFO:tasks.workunit.client.1.smithi154.stdout:4/685: creat d0/d82/d44/d73/d4a/dd4/d1a/fe7 x:0 0 0 2024-05-06T21:26:53.356 INFO:tasks.workunit.client.1.smithi154.stdout:4/686: mknod d0/d82/d44/d73/d4a/dd4/d1a/d7e/ce8 0 2024-05-06T21:26:53.358 INFO:tasks.workunit.client.1.smithi154.stdout:4/687: mkdir d0/d82/d44/de9 0 2024-05-06T21:26:53.358 INFO:tasks.workunit.client.1.smithi154.stdout:4/688: creat d0/d2/fea x:0 0 0 2024-05-06T21:26:53.358 INFO:tasks.workunit.client.1.smithi154.stdout:3/825: dwrite d0/da/d1a/d28/dbc/d117/d30/d71/f88 [0,4194304] 0 2024-05-06T21:26:53.359 INFO:tasks.workunit.client.1.smithi154.stdout:1/706: dwrite d6/db/d5e/fcf [0,4194304] 0 2024-05-06T21:26:53.359 INFO:tasks.workunit.client.1.smithi154.stdout:1/707: chown d6/db/dbe/ld0 7 1 2024-05-06T21:26:53.359 INFO:tasks.workunit.client.1.smithi154.stdout:0/780: dwrite d6/dc/d40/d4a/d6c/dce/dd7/fdb [4194304,4194304] 0 2024-05-06T21:26:53.365 INFO:tasks.workunit.client.0.smithi032.stdout:2/855: dwrite df/fdf [0,4194304] 0 2024-05-06T21:26:53.366 INFO:tasks.workunit.client.1.smithi154.stdout:9/778: dwrite d5/d20/f24 [4194304,4194304] 0 2024-05-06T21:26:53.366 INFO:tasks.workunit.client.1.smithi154.stdout:8/697: dwrite d3/d14/d1a/d45/f99 [0,4194304] 0 2024-05-06T21:26:53.366 INFO:tasks.workunit.client.1.smithi154.stdout:8/698: write d3/d14/d1a/d29/d32/d40/d59/d67/d95/fa5 [639881,66167] 0 2024-05-06T21:26:53.367 INFO:tasks.workunit.client.1.smithi154.stdout:3/826: rename d0/da/d1a/d28/d4d/fd3 to d0/da/d1a/d28/dbc/d81/d48/f11f 0 2024-05-06T21:26:53.368 INFO:tasks.workunit.client.1.smithi154.stdout:4/689: write d0/d2/dc/f18 [393579,110639] 0 2024-05-06T21:26:53.371 INFO:tasks.workunit.client.1.smithi154.stdout:1/708: truncate d6/db/d10/d15/f9c 1079319 0 2024-05-06T21:26:53.374 INFO:tasks.workunit.client.1.smithi154.stdout:0/781: truncate d6/dc/d51/d54/fef 54220 0 2024-05-06T21:26:53.376 INFO:tasks.workunit.client.1.smithi154.stdout:9/779: symlink d5/d14/d87/l106 0 2024-05-06T21:26:53.382 INFO:tasks.workunit.client.1.smithi154.stdout:4/690: creat d0/d82/feb x:0 0 0 2024-05-06T21:26:53.382 INFO:tasks.workunit.client.1.smithi154.stdout:4/691: truncate d0/d2/d47/fbf 1057732 0 2024-05-06T21:26:53.385 INFO:tasks.workunit.client.1.smithi154.stdout:1/709: link d6/d3e/l65 d6/db/d74/dc0/lda 0 2024-05-06T21:26:53.387 INFO:tasks.workunit.client.1.smithi154.stdout:2/616: dwrite db/de/d16/d4f/f8f [0,4194304] 0 2024-05-06T21:26:53.387 INFO:tasks.workunit.client.1.smithi154.stdout:7/559: dwrite d6/d42/d6c/d6e/d21/d69/f80 [0,4194304] 0 2024-05-06T21:26:53.387 INFO:tasks.workunit.client.1.smithi154.stdout:7/560: write d6/fb3 [901313,63579] 0 2024-05-06T21:26:53.387 INFO:tasks.workunit.client.1.smithi154.stdout:0/782: mkdir d6/dc/d40/d85/db2/dbb/dff 0 2024-05-06T21:26:53.388 INFO:tasks.workunit.client.0.smithi032.stdout:6/966: dwrite d8/f8c [4194304,4194304] 0 2024-05-06T21:26:53.393 INFO:tasks.workunit.client.0.smithi032.stdout:6/967: creat d8/d33/f11e x:0 0 0 2024-05-06T21:26:53.393 INFO:tasks.workunit.client.0.smithi032.stdout:6/968: fsync d8/f17 0 2024-05-06T21:26:53.395 INFO:tasks.workunit.client.0.smithi032.stdout:6/969: creat d8/dd/d18/d3b/db9/d102/d11c/f11f x:0 0 0 2024-05-06T21:26:53.395 INFO:tasks.workunit.client.0.smithi032.stdout:6/970: creat d8/d3d/d49/dad/d10b/f120 x:0 0 0 2024-05-06T21:26:53.395 INFO:tasks.workunit.client.0.smithi032.stdout:6/971: creat d8/d3d/d49/d6b/d10a/f121 x:0 0 0 2024-05-06T21:26:53.397 INFO:tasks.workunit.client.1.smithi154.stdout:7/561: dread d6/fd [0,4194304] 0 2024-05-06T21:26:53.399 INFO:tasks.workunit.client.0.smithi032.stdout:6/972: symlink d8/d3d/d49/dad/d10b/l122 0 2024-05-06T21:26:53.403 INFO:tasks.workunit.client.0.smithi032.stdout:7/983: sync 2024-05-06T21:26:53.403 INFO:tasks.workunit.client.0.smithi032.stdout:7/984: dread - db/d89/daa/fad zero size 2024-05-06T21:26:53.409 INFO:tasks.workunit.client.1.smithi154.stdout:2/617: mknod db/cc2 0 2024-05-06T21:26:53.411 INFO:tasks.workunit.client.1.smithi154.stdout:0/783: link d6/dc/d44/d36/d89/faf d6/dc/d51/f100 0 2024-05-06T21:26:53.413 INFO:tasks.workunit.client.1.smithi154.stdout:7/562: creat d6/d42/d6c/d6e/d21/d2e/fb5 x:0 0 0 2024-05-06T21:26:53.423 INFO:tasks.workunit.client.0.smithi032.stdout:0/943: dwrite d4/d3e/fbe [0,4194304] 0 2024-05-06T21:26:53.423 INFO:tasks.workunit.client.0.smithi032.stdout:7/985: dread db/d12/d49/f6f [0,4194304] 0 2024-05-06T21:26:53.423 INFO:tasks.workunit.client.0.smithi032.stdout:7/986: read - db/d12/d16/da1/fff zero size 2024-05-06T21:26:53.426 INFO:tasks.workunit.client.0.smithi032.stdout:7/987: mknod db/d12/de9/c136 0 2024-05-06T21:26:53.427 INFO:tasks.workunit.client.0.smithi032.stdout:0/944: mkdir d4/da/d16/dcc/d131/d137 0 2024-05-06T21:26:53.427 INFO:tasks.workunit.client.0.smithi032.stdout:0/945: chown d4/da/d16/d33/d9e/dc9/dcb/lfe 3821591 1 2024-05-06T21:26:53.427 INFO:tasks.workunit.client.0.smithi032.stdout:0/946: chown d4/da/d16/dcc/c116 48 1 2024-05-06T21:26:53.438 INFO:tasks.workunit.client.0.smithi032.stdout:1/911: dwrite db/d16/d46/f63 [0,4194304] 0 2024-05-06T21:26:53.439 INFO:tasks.workunit.client.0.smithi032.stdout:1/912: mknod db/d37/d52/c128 0 2024-05-06T21:26:53.440 INFO:tasks.workunit.client.0.smithi032.stdout:1/913: creat db/d16/db8/f129 x:0 0 0 2024-05-06T21:26:53.441 INFO:tasks.workunit.client.0.smithi032.stdout:1/914: mkdir db/d47/d4a/da4/da2/d12a 0 2024-05-06T21:26:53.468 INFO:tasks.workunit.client.0.smithi032.stdout:0/947: dread d4/da/d16/d33/f5e [0,4194304] 0 2024-05-06T21:26:53.469 INFO:tasks.workunit.client.0.smithi032.stdout:0/948: mkdir d4/da/d16/d33/d9e/dc9/dcb/d138 0 2024-05-06T21:26:53.471 INFO:tasks.workunit.client.0.smithi032.stdout:0/949: rename d4/l3d to d4/da/d14/d1a/d66/d8a/l139 0 2024-05-06T21:26:53.471 INFO:tasks.workunit.client.0.smithi032.stdout:0/950: stat d4/da/f81 0 2024-05-06T21:26:53.471 INFO:tasks.workunit.client.0.smithi032.stdout:0/951: write d4/da/d16/d33/f5e [3695642,35601] 0 2024-05-06T21:26:53.472 INFO:tasks.workunit.client.0.smithi032.stdout:0/952: rename d4/da/d14/d1a/c30 to d4/da/d16/d33/d9e/dc9/dcb/d138/c13a 0 2024-05-06T21:26:53.472 INFO:tasks.workunit.client.0.smithi032.stdout:0/953: truncate d4/da/d98/f129 440092 0 2024-05-06T21:26:53.481 INFO:tasks.workunit.client.1.smithi154.stdout:9/780: dwrite d5/d2e/d66/fb0 [0,4194304] 0 2024-05-06T21:26:53.482 INFO:tasks.workunit.client.0.smithi032.stdout:2/856: dwrite df/d19/d1e/d35/fa2 [0,4194304] 0 2024-05-06T21:26:53.490 INFO:tasks.workunit.client.1.smithi154.stdout:3/827: dwrite d0/d2/f45 [4194304,4194304] 0 2024-05-06T21:26:53.493 INFO:tasks.workunit.client.1.smithi154.stdout:3/828: unlink d0/da/d1a/d28/dbc/d117/dd/d1c/d21/d37/f4b 0 2024-05-06T21:26:53.493 INFO:tasks.workunit.client.1.smithi154.stdout:3/829: readlink d0/da/d1a/d28/l12 0 2024-05-06T21:26:53.493 INFO:tasks.workunit.client.1.smithi154.stdout:3/830: chown d0/da/d1a/d28/d17/f63 835612 1 2024-05-06T21:26:53.495 INFO:tasks.workunit.client.1.smithi154.stdout:3/831: rename d0/da/d1a/d28/dbc/d117/dd/fc to d0/da/d1a/d28/dbc/d117/dd/d1c/d41/f120 0 2024-05-06T21:26:53.495 INFO:tasks.workunit.client.1.smithi154.stdout:3/832: chown d0/da/d1a/d28/dbc/d117/dd/c46 684 1 2024-05-06T21:26:53.495 INFO:tasks.workunit.client.1.smithi154.stdout:9/781: dread d5/f76 [0,4194304] 0 2024-05-06T21:26:53.497 INFO:tasks.workunit.client.1.smithi154.stdout:9/782: symlink d5/d2e/d8b/dc6/d103/l107 0 2024-05-06T21:26:53.510 INFO:tasks.workunit.client.1.smithi154.stdout:2/618: dwrite db/d12/d1d/f48 [8388608,4194304] 0 2024-05-06T21:26:53.511 INFO:tasks.workunit.client.1.smithi154.stdout:4/692: dwrite d0/d2/f2f [0,4194304] 0 2024-05-06T21:26:53.511 INFO:tasks.workunit.client.1.smithi154.stdout:1/710: dwrite d6/d3e/d7e/fb5 [0,4194304] 0 2024-05-06T21:26:53.512 INFO:tasks.workunit.client.1.smithi154.stdout:0/784: dwrite d6/f53 [0,4194304] 0 2024-05-06T21:26:53.512 INFO:tasks.workunit.client.1.smithi154.stdout:7/563: dwrite d6/f3b [8388608,4194304] 0 2024-05-06T21:26:53.514 INFO:tasks.workunit.client.1.smithi154.stdout:2/619: mknod db/de/cc3 0 2024-05-06T21:26:53.514 INFO:tasks.workunit.client.0.smithi032.stdout:7/988: dwrite db/d12/d16/d2a/d39/d8b/f10e [0,4194304] 0 2024-05-06T21:26:53.514 INFO:tasks.workunit.client.0.smithi032.stdout:7/989: chown db/d12/d16/d21/d41/d78/f36 5 1 2024-05-06T21:26:53.515 INFO:tasks.workunit.client.0.smithi032.stdout:7/990: write db/d12/d16/d21/d41/fe5 [785897,95982] 0 2024-05-06T21:26:53.515 INFO:tasks.workunit.client.0.smithi032.stdout:7/991: write db/d12/d16/d21/d41/d78/f91 [2837590,123457] 0 2024-05-06T21:26:53.515 INFO:tasks.workunit.client.0.smithi032.stdout:7/992: write db/d12/f30 [2504002,4363] 0 2024-05-06T21:26:53.515 INFO:tasks.workunit.client.0.smithi032.stdout:2/857: dwrite df/d19/d1e/d54/f6a [0,4194304] 0 2024-05-06T21:26:53.516 INFO:tasks.workunit.client.1.smithi154.stdout:4/693: mknod d0/d72/d76/db5/db7/cec 0 2024-05-06T21:26:53.519 INFO:tasks.workunit.client.1.smithi154.stdout:3/833: dwrite d0/da/d1a/d28/dbc/d81/d48/da9/db3/fc5 [4194304,4194304] 0 2024-05-06T21:26:53.519 INFO:tasks.workunit.client.1.smithi154.stdout:9/783: dread d5/d14/f60 [0,4194304] 0 2024-05-06T21:26:53.519 INFO:tasks.workunit.client.1.smithi154.stdout:3/834: truncate d0/da/f10d 992833 0 2024-05-06T21:26:53.519 INFO:tasks.workunit.client.1.smithi154.stdout:3/835: stat d0/da/d1a/d28/dbc/d81/d48/da9/db3/f115 0 2024-05-06T21:26:53.519 INFO:tasks.workunit.client.1.smithi154.stdout:3/836: readlink d0/dd5/lef 0 2024-05-06T21:26:53.519 INFO:tasks.workunit.client.1.smithi154.stdout:3/837: readlink d0/da/d1a/d28/dbc/d117/d30/d71/l84 0 2024-05-06T21:26:53.519 INFO:tasks.workunit.client.1.smithi154.stdout:3/838: fdatasync d0/da/d1a/d28/dbc/d117/d7c/d80/ffd 0 2024-05-06T21:26:53.524 INFO:tasks.workunit.client.1.smithi154.stdout:7/564: write d6/d20/f89 [2783683,92367] 0 2024-05-06T21:26:53.527 INFO:tasks.workunit.client.1.smithi154.stdout:4/694: dread d0/d2/d47/d81/f86 [0,4194304] 0 2024-05-06T21:26:53.527 INFO:tasks.workunit.client.1.smithi154.stdout:4/695: write d0/d10/f65 [890321,87533] 0 2024-05-06T21:26:53.530 INFO:tasks.workunit.client.1.smithi154.stdout:0/785: rename d6/dc/d40/d4a/da7/f86 to d6/dc/d44/d36/f101 0 2024-05-06T21:26:53.530 INFO:tasks.workunit.client.1.smithi154.stdout:0/786: chown d6/dc/d51/d54/dbd 18 1 2024-05-06T21:26:53.530 INFO:tasks.workunit.client.1.smithi154.stdout:0/787: chown d6/dc/d40/d4a/d6c/dce/dd7/fd8 973 1 2024-05-06T21:26:53.530 INFO:tasks.workunit.client.1.smithi154.stdout:0/788: chown d6/dc/d40/d4a/da7 1818 1 2024-05-06T21:26:53.531 INFO:tasks.workunit.client.0.smithi032.stdout:7/993: stat db/d12/d16/d21/cd9 0 2024-05-06T21:26:53.531 INFO:tasks.workunit.client.0.smithi032.stdout:7/994: creat db/d12/d16/d2a/d39/d8b/f137 x:0 0 0 2024-05-06T21:26:53.532 INFO:tasks.workunit.client.1.smithi154.stdout:2/620: mknod db/de/d10/d18/cc4 0 2024-05-06T21:26:53.532 INFO:tasks.workunit.client.0.smithi032.stdout:2/858: creat df/d19/d1e/d71/d5f/d7d/d65/d78/da6/d118/f11f x:0 0 0 2024-05-06T21:26:53.532 INFO:tasks.workunit.client.0.smithi032.stdout:2/859: fsync df/d19/d1e/d42/dc6/fe9 0 2024-05-06T21:26:53.534 INFO:tasks.workunit.client.0.smithi032.stdout:7/995: rename db/d12/l129 to db/d12/d16/d2a/d39/d3b/d9c/l138 0 2024-05-06T21:26:53.534 INFO:tasks.workunit.client.0.smithi032.stdout:7/996: chown f3 10874 1 2024-05-06T21:26:53.536 INFO:tasks.workunit.client.0.smithi032.stdout:7/997: rename db/d12/fc9 to db/d12/d16/d2a/d39/d3b/dac/f139 0 2024-05-06T21:26:53.536 INFO:tasks.workunit.client.1.smithi154.stdout:9/784: mkdir d5/d20/d52/d59/d102/d108 0 2024-05-06T21:26:53.538 INFO:tasks.workunit.client.0.smithi032.stdout:7/998: write db/d12/d16/d21/fa3 [607228,109597] 0 2024-05-06T21:26:53.540 INFO:tasks.workunit.client.0.smithi032.stdout:0/954: dwrite d4/d96/f134 [0,4194304] 0 2024-05-06T21:26:53.540 INFO:tasks.workunit.client.0.smithi032.stdout:0/955: fsync d4/da/d16/fb3 0 2024-05-06T21:26:53.540 INFO:tasks.workunit.client.1.smithi154.stdout:1/711: rmdir d6/db/d10 39 2024-05-06T21:26:53.541 INFO:tasks.workunit.client.0.smithi032.stdout:0/956: write d4/f1f [8800817,130576] 0 2024-05-06T21:26:53.543 INFO:tasks.workunit.client.0.smithi032.stdout:7/999: symlink db/d12/d16/d2a/d39/d3b/d111/l13a 0 2024-05-06T21:26:53.543 INFO:tasks.workunit.client.1.smithi154.stdout:7/565: creat d6/d42/d6c/d6e/d21/d69/d7b/d9f/fb6 x:0 0 0 2024-05-06T21:26:53.545 INFO:tasks.workunit.client.1.smithi154.stdout:4/696: mknod d0/d82/d44/d73/d4a/d74/dce/ced 0 2024-05-06T21:26:53.547 INFO:tasks.workunit.client.1.smithi154.stdout:0/789: symlink d6/dc/d40/d85/db2/dbb/l102 0 2024-05-06T21:26:53.548 INFO:tasks.workunit.client.1.smithi154.stdout:5/679: sync 2024-05-06T21:26:53.548 INFO:tasks.workunit.client.1.smithi154.stdout:6/529: sync 2024-05-06T21:26:53.548 INFO:tasks.workunit.client.1.smithi154.stdout:5/680: dread - d2/d3/d21/d95/dd/d2a/f85 zero size 2024-05-06T21:26:53.549 INFO:tasks.workunit.client.0.smithi032.stdout:0/957: dread d4/da/d16/f43 [4194304,4194304] 0 2024-05-06T21:26:53.550 INFO:tasks.workunit.client.1.smithi154.stdout:2/621: rename db/de/d10/d18/l1a to db/d12/d19/d7d/lc5 0 2024-05-06T21:26:53.551 INFO:tasks.workunit.client.1.smithi154.stdout:9/785: read d5/d14/d31/fd3 [256361,88966] 0 2024-05-06T21:26:53.551 INFO:tasks.workunit.client.1.smithi154.stdout:9/786: chown d5/d20 358250 1 2024-05-06T21:26:53.551 INFO:tasks.workunit.client.1.smithi154.stdout:9/787: write d5/d20/d52/d6e/d83/da2/fcf [169360,106555] 0 2024-05-06T21:26:53.551 INFO:tasks.workunit.client.1.smithi154.stdout:1/712: read d6/db/d10/d15/f20 [350563,106596] 0 2024-05-06T21:26:53.551 INFO:tasks.workunit.client.0.smithi032.stdout:0/958: rename d4/d3e/d63/f5c to d4/d3e/d63/d6c/df1/f13b 0 2024-05-06T21:26:53.551 INFO:tasks.workunit.client.0.smithi032.stdout:0/959: chown d4/da/d14/d1a/d66/d8a/f100 205277 1 2024-05-06T21:26:53.553 INFO:tasks.workunit.client.0.smithi032.stdout:0/960: creat d4/d3e/d63/d6c/d120/f13c x:0 0 0 2024-05-06T21:26:53.553 INFO:tasks.workunit.client.0.smithi032.stdout:0/961: fsync d4/da/d16/d33/d9e/dcf/f130 0 2024-05-06T21:26:53.553 INFO:tasks.workunit.client.1.smithi154.stdout:7/566: mknod d6/d20/d40/daf/cb7 0 2024-05-06T21:26:53.555 INFO:tasks.workunit.client.0.smithi032.stdout:0/962: rmdir d4/da/d16/dcc 39 2024-05-06T21:26:53.555 INFO:tasks.workunit.client.0.smithi032.stdout:0/963: dread - d4/d3e/d63/d6c/d8f/dc2/fc5 zero size 2024-05-06T21:26:53.555 INFO:tasks.workunit.client.0.smithi032.stdout:0/964: stat d4/da/d16/l2b 0 2024-05-06T21:26:53.555 INFO:tasks.workunit.client.0.smithi032.stdout:0/965: fsync d4/da/d16/dcc/fd1 0 2024-05-06T21:26:53.556 INFO:tasks.workunit.client.1.smithi154.stdout:4/697: mkdir d0/d72/d76/dbb/dee 0 2024-05-06T21:26:53.556 INFO:tasks.workunit.client.1.smithi154.stdout:0/790: mknod d6/dc/d40/d5e/c103 0 2024-05-06T21:26:53.556 INFO:tasks.workunit.client.1.smithi154.stdout:0/791: stat d6/dc/d44/d9f 0 2024-05-06T21:26:53.556 INFO:tasks.workunit.client.1.smithi154.stdout:4/698: write d0/d2/d47/fbf [988855,109513] 0 2024-05-06T21:26:53.557 INFO:tasks.workunit.client.0.smithi032.stdout:0/966: mkdir d4/da/d16/d33/d121/d13d 0 2024-05-06T21:26:53.557 INFO:tasks.workunit.client.0.smithi032.stdout:0/967: fdatasync d4/da/d16/f3b 0 2024-05-06T21:26:53.557 INFO:tasks.workunit.client.0.smithi032.stdout:0/968: chown d4/d3e/d63/dca/f9b 41414455 1 2024-05-06T21:26:53.557 INFO:tasks.workunit.client.0.smithi032.stdout:0/969: read - d4/d3e/d63/d6c/d8f/dc2/fc5 zero size 2024-05-06T21:26:53.557 INFO:tasks.workunit.client.1.smithi154.stdout:4/699: read d0/d2/f9f [286651,109213] 0 2024-05-06T21:26:53.561 INFO:tasks.workunit.client.0.smithi032.stdout:2/860: dwrite df/d19/d1e/d71/d5f/d7d/d65/d78/fd1 [0,4194304] 0 2024-05-06T21:26:53.566 INFO:tasks.workunit.client.0.smithi032.stdout:2/861: unlink df/d19/d1e/d42/dc6/d11b/d11a/ccd 0 2024-05-06T21:26:53.566 INFO:tasks.workunit.client.0.smithi032.stdout:2/862: chown df/d19/d1e/d35/dc5/d2e/fcb 335787 1 2024-05-06T21:26:53.566 INFO:tasks.workunit.client.0.smithi032.stdout:2/863: chown df/d19/d1e/d71/d5f/d73/ld5 7170 1 2024-05-06T21:26:53.566 INFO:tasks.workunit.client.1.smithi154.stdout:5/681: creat d2/d3/d21/d95/dd/d2a/d54/d43/fec x:0 0 0 2024-05-06T21:26:53.569 INFO:tasks.workunit.client.1.smithi154.stdout:2/622: creat db/de/d10/dbc/fc6 x:0 0 0 2024-05-06T21:26:53.571 INFO:tasks.workunit.client.1.smithi154.stdout:0/792: mkdir d6/dc/d40/d4a/da3/d104 0 2024-05-06T21:26:53.575 INFO:tasks.workunit.client.1.smithi154.stdout:2/623: symlink db/d12/d1d/d60/lc7 0 2024-05-06T21:26:53.577 INFO:tasks.workunit.client.1.smithi154.stdout:0/793: unlink d6/dc/d40/l73 0 2024-05-06T21:26:53.578 INFO:tasks.workunit.client.1.smithi154.stdout:5/682: rmdir d2/d48 39 2024-05-06T21:26:53.578 INFO:tasks.workunit.client.1.smithi154.stdout:0/794: dread d6/dc/d42/f90 [0,4194304] 0 2024-05-06T21:26:53.580 INFO:tasks.workunit.client.1.smithi154.stdout:2/624: mknod db/d12/d19/d91/cc8 0 2024-05-06T21:26:53.580 INFO:tasks.workunit.client.1.smithi154.stdout:2/625: write db/de/d10/d18/fa8 [4101613,20740] 0 2024-05-06T21:26:53.580 INFO:tasks.workunit.client.0.smithi032.stdout:2/864: write df/d19/d1e/d35/d3f/fd2 [4137393,102467] 0 2024-05-06T21:26:53.581 INFO:tasks.workunit.client.1.smithi154.stdout:0/795: link d6/dc/d51/d54/dbd/ffb d6/dc/d40/d85/f105 0 2024-05-06T21:26:53.583 INFO:tasks.workunit.client.1.smithi154.stdout:2/626: rename db/de/d16/d33/f61 to db/d12/d1d/d60/fc9 0 2024-05-06T21:26:53.585 INFO:tasks.workunit.client.1.smithi154.stdout:2/627: mkdir db/d12/d19/d4b/db2/dca 0 2024-05-06T21:26:53.585 INFO:tasks.workunit.client.1.smithi154.stdout:2/628: readlink db/d12/d19/d4b/l9a 0 2024-05-06T21:26:53.594 INFO:tasks.workunit.client.1.smithi154.stdout:0/796: dread d6/dc/f4f [0,4194304] 0 2024-05-06T21:26:53.594 INFO:tasks.workunit.client.1.smithi154.stdout:0/797: chown d6/dc/d51/d54/f84 2791247 1 2024-05-06T21:26:53.595 INFO:tasks.workunit.client.1.smithi154.stdout:0/798: creat d6/dc/d40/d4a/f106 x:0 0 0 2024-05-06T21:26:53.596 INFO:tasks.workunit.client.1.smithi154.stdout:0/799: write d6/dc/f2f [2226507,59741] 0 2024-05-06T21:26:53.597 INFO:tasks.workunit.client.1.smithi154.stdout:0/800: mkdir d6/dc1/dd0/d107 0 2024-05-06T21:26:53.597 INFO:tasks.workunit.client.1.smithi154.stdout:0/801: read - d6/dc/d40/d85/f105 zero size 2024-05-06T21:26:53.599 INFO:tasks.workunit.client.0.smithi032.stdout:2/865: read df/d19/d1e/d54/fb8 [1478055,128739] 0 2024-05-06T21:26:53.601 INFO:tasks.workunit.client.0.smithi032.stdout:2/866: rmdir df/d19/d1e/d71/d5f/d73 39 2024-05-06T21:26:53.601 INFO:tasks.workunit.client.0.smithi032.stdout:2/867: write df/d19/d1e/d42/dc6/d11b/ff6 [35500,79460] 0 2024-05-06T21:26:53.602 INFO:tasks.workunit.client.0.smithi032.stdout:2/868: creat df/d19/f120 x:0 0 0 2024-05-06T21:26:53.603 INFO:tasks.workunit.client.0.smithi032.stdout:2/869: unlink df/d19/d1e/d35/dc5/d2e/dbc/lf9 0 2024-05-06T21:26:53.605 INFO:tasks.workunit.client.0.smithi032.stdout:2/870: rename df/d19/d1e/d71/c70 to df/d19/d1e/d71/d5f/d73/df1/c121 0 2024-05-06T21:26:53.608 INFO:tasks.workunit.client.1.smithi154.stdout:0/802: read d6/fca [3496361,7210] 0 2024-05-06T21:26:53.608 INFO:tasks.workunit.client.1.smithi154.stdout:0/803: chown d6/dc/d44/c5f 0 1 2024-05-06T21:26:53.609 INFO:tasks.workunit.client.1.smithi154.stdout:0/804: unlink d6/dc/fea 0 2024-05-06T21:26:53.610 INFO:tasks.workunit.client.1.smithi154.stdout:0/805: rmdir d6/dc/d40/d4a/d6c 39 2024-05-06T21:26:53.611 INFO:tasks.workunit.client.1.smithi154.stdout:8/699: sync 2024-05-06T21:26:53.611 INFO:tasks.workunit.client.1.smithi154.stdout:8/700: chown d3/d64/d6d/dbd/dce 45803 1 2024-05-06T21:26:53.611 INFO:tasks.workunit.client.1.smithi154.stdout:8/701: readlink d3/d14/d1a/d29/l7b 0 2024-05-06T21:26:53.617 INFO:tasks.workunit.client.1.smithi154.stdout:4/700: dwrite d0/d82/d44/d73/f2c [0,4194304] 0 2024-05-06T21:26:53.617 INFO:tasks.workunit.client.1.smithi154.stdout:4/701: chown d0/d2/dc/f18 931 1 2024-05-06T21:26:53.618 INFO:tasks.workunit.client.1.smithi154.stdout:4/702: mkdir d0/d82/d44/d73/def 0 2024-05-06T21:26:53.618 INFO:tasks.workunit.client.1.smithi154.stdout:4/703: creat d0/d82/d44/ff0 x:0 0 0 2024-05-06T21:26:53.620 INFO:tasks.workunit.client.1.smithi154.stdout:0/806: write d6/f3a [3558160,119900] 0 2024-05-06T21:26:53.627 INFO:tasks.workunit.client.1.smithi154.stdout:5/683: dwrite d2/d3/d21/d95/dd/d2a/d54/d43/d73/f82 [0,4194304] 0 2024-05-06T21:26:53.628 INFO:tasks.workunit.client.1.smithi154.stdout:1/713: dwrite d6/db/d10/d26/f23 [4194304,4194304] 0 2024-05-06T21:26:53.629 INFO:tasks.workunit.client.1.smithi154.stdout:1/714: creat d6/db/d5e/fdb x:0 0 0 2024-05-06T21:26:53.630 INFO:tasks.workunit.client.1.smithi154.stdout:7/567: dwrite d6/d20/d40/f50 [4194304,4194304] 0 2024-05-06T21:26:53.632 INFO:tasks.workunit.client.1.smithi154.stdout:2/629: unlink db/d12/d19/d7d/lc5 0 2024-05-06T21:26:53.641 INFO:tasks.workunit.client.1.smithi154.stdout:1/715: write d6/db/d10/d15/f39 [1424608,38477] 0 2024-05-06T21:26:53.642 INFO:tasks.workunit.client.0.smithi032.stdout:2/871: dwrite df/d19/d1e/d35/dc5/d9f/fa1 [0,4194304] 0 2024-05-06T21:26:53.648 INFO:tasks.workunit.client.1.smithi154.stdout:0/807: dwrite d6/dc/f61 [0,4194304] 0 2024-05-06T21:26:53.650 INFO:tasks.workunit.client.1.smithi154.stdout:1/716: write d6/d3e/f75 [12175,83906] 0 2024-05-06T21:26:53.650 INFO:tasks.workunit.client.1.smithi154.stdout:4/704: getdents d0/d82/d44/d73 0 2024-05-06T21:26:53.650 INFO:tasks.workunit.client.1.smithi154.stdout:4/705: chown d0/d82/d44/d73/l84 104359430 1 2024-05-06T21:26:53.650 INFO:tasks.workunit.client.1.smithi154.stdout:4/706: fsync d0/d82/d3d/dab/fcf 0 2024-05-06T21:26:53.653 INFO:tasks.workunit.client.1.smithi154.stdout:0/808: rmdir d6/dc/d40/d5e/db5 39 2024-05-06T21:26:53.656 INFO:tasks.workunit.client.1.smithi154.stdout:1/717: unlink d6/db/d10/d26/l55 0 2024-05-06T21:26:53.657 INFO:tasks.workunit.client.1.smithi154.stdout:0/809: mkdir d6/dc/d51/d54/dee/d108 0 2024-05-06T21:26:53.657 INFO:tasks.workunit.client.1.smithi154.stdout:0/810: chown d6/dc/d40/d85/db2/dbb/ld1 1 1 2024-05-06T21:26:53.661 INFO:tasks.workunit.client.1.smithi154.stdout:0/811: link d6/dc/d40/d85/db2/dbb/l102 d6/dc/d3c/l109 0 2024-05-06T21:26:53.667 INFO:tasks.workunit.client.1.smithi154.stdout:8/702: dwrite d3/d14/d1a/d29/d32/d40/d79/f4e [0,4194304] 0 2024-05-06T21:26:53.670 INFO:tasks.workunit.client.1.smithi154.stdout:2/630: dwrite db/de/d16/d33/f79 [0,4194304] 0 2024-05-06T21:26:53.674 INFO:tasks.workunit.client.1.smithi154.stdout:5/684: dwrite d2/f1a [0,4194304] 0 2024-05-06T21:26:53.675 INFO:tasks.workunit.client.0.smithi032.stdout:2/872: dwrite df/d19/d1e/d42/dc6/dc1/fdb [0,4194304] 0 2024-05-06T21:26:53.675 INFO:tasks.workunit.client.1.smithi154.stdout:7/568: dwrite d6/f7d [0,4194304] 0 2024-05-06T21:26:53.677 INFO:tasks.workunit.client.1.smithi154.stdout:5/685: link d2/d3/d21/d22/l77 d2/led 0 2024-05-06T21:26:53.677 INFO:tasks.workunit.client.1.smithi154.stdout:4/707: dwrite d0/d2/d47/d81/f86 [0,4194304] 0 2024-05-06T21:26:53.681 INFO:tasks.workunit.client.0.smithi032.stdout:2/873: dread df/d19/d1e/d71/d5f/d7d/f9c [4194304,4194304] 0 2024-05-06T21:26:53.684 INFO:tasks.workunit.client.1.smithi154.stdout:7/569: rename d6/d42/d6c/d6e/d21/c4d to d6/d54/d6a/cb8 0 2024-05-06T21:26:53.685 INFO:tasks.workunit.client.0.smithi032.stdout:2/874: rename df/d19/d1e/d35/dc5/d2e/d33/cd9 to df/d19/d1e/d71/d5f/d7d/d65/d78/da6/c122 0 2024-05-06T21:26:53.685 INFO:tasks.workunit.client.0.smithi032.stdout:1/915: sync 2024-05-06T21:26:53.685 INFO:tasks.workunit.client.0.smithi032.stdout:2/875: write df/d19/d1e/d35/dc5/d2e/d33/f17 [854630,8884] 0 2024-05-06T21:26:53.685 INFO:tasks.workunit.client.0.smithi032.stdout:6/973: sync 2024-05-06T21:26:53.685 INFO:tasks.workunit.client.1.smithi154.stdout:1/718: rmdir d6/db/d10/d26 39 2024-05-06T21:26:53.686 INFO:tasks.workunit.client.0.smithi032.stdout:1/916: unlink db/d47/d4a/da4/da2/cbb 0 2024-05-06T21:26:53.686 INFO:tasks.workunit.client.0.smithi032.stdout:1/917: chown db/d37/d93/dce/df4 1329627534 1 2024-05-06T21:26:53.688 INFO:tasks.workunit.client.1.smithi154.stdout:1/719: dread d6/db/f6f [0,4194304] 0 2024-05-06T21:26:53.688 INFO:tasks.workunit.client.0.smithi032.stdout:6/974: truncate d8/dd/d18/d3b/db9/f83 2014247 0 2024-05-06T21:26:53.688 INFO:tasks.workunit.client.0.smithi032.stdout:6/975: fsync d8/db6/d100/f109 0 2024-05-06T21:26:53.688 INFO:tasks.workunit.client.0.smithi032.stdout:2/876: symlink df/dae/l123 0 2024-05-06T21:26:53.688 INFO:tasks.workunit.client.0.smithi032.stdout:2/877: readlink df/d19/d1e/d42/l69 0 2024-05-06T21:26:53.689 INFO:tasks.workunit.client.0.smithi032.stdout:1/918: creat db/d16/d5d/f12b x:0 0 0 2024-05-06T21:26:53.691 INFO:tasks.workunit.client.0.smithi032.stdout:6/976: mknod d8/dd/d18/d3b/c123 0 2024-05-06T21:26:53.693 INFO:tasks.workunit.client.0.smithi032.stdout:6/977: mknod d8/dd/d1b/c124 0 2024-05-06T21:26:53.693 INFO:tasks.workunit.client.1.smithi154.stdout:0/812: dwrite f4 [8388608,4194304] 0 2024-05-06T21:26:53.695 INFO:tasks.workunit.client.0.smithi032.stdout:6/978: symlink d8/d3d/d49/d6b/l125 0 2024-05-06T21:26:53.697 INFO:tasks.workunit.client.1.smithi154.stdout:4/708: mkdir d0/d82/d44/d73/def/df1 0 2024-05-06T21:26:53.697 INFO:tasks.workunit.client.1.smithi154.stdout:4/709: creat d0/d82/d44/d73/d4a/dd4/ff2 x:0 0 0 2024-05-06T21:26:53.699 INFO:tasks.workunit.client.1.smithi154.stdout:7/570: symlink d6/d42/d6c/d6e/da4/lb9 0 2024-05-06T21:26:53.700 INFO:tasks.workunit.client.0.smithi032.stdout:6/979: creat d8/d3d/d49/df6/f126 x:0 0 0 2024-05-06T21:26:53.700 INFO:tasks.workunit.client.0.smithi032.stdout:6/980: creat d8/d3d/d49/df6/f127 x:0 0 0 2024-05-06T21:26:53.700 INFO:tasks.workunit.client.0.smithi032.stdout:6/981: write d8/d3d/d49/f60 [5641261,28492] 0 2024-05-06T21:26:53.700 INFO:tasks.workunit.client.0.smithi032.stdout:6/982: creat d8/d3d/d49/dad/f128 x:0 0 0 2024-05-06T21:26:53.700 INFO:tasks.workunit.client.0.smithi032.stdout:6/983: creat d8/dd/d18/d13/d7a/f129 x:0 0 0 2024-05-06T21:26:53.700 INFO:tasks.workunit.client.0.smithi032.stdout:6/984: chown d8/d3d/d49/f60 749182 1 2024-05-06T21:26:53.701 INFO:tasks.workunit.client.1.smithi154.stdout:1/720: creat d6/db/d5e/db8/fdc x:0 0 0 2024-05-06T21:26:53.701 INFO:tasks.workunit.client.1.smithi154.stdout:0/813: mknod d6/dc/d40/d5e/db5/c10a 0 2024-05-06T21:26:53.703 INFO:tasks.workunit.client.1.smithi154.stdout:4/710: mkdir d0/d72/d76/db5/db7/df3 0 2024-05-06T21:26:53.704 INFO:tasks.workunit.client.1.smithi154.stdout:1/721: symlink d6/d3e/d7e/ldd 0 2024-05-06T21:26:53.704 INFO:tasks.workunit.client.1.smithi154.stdout:1/722: chown d6/d3e/f82 130075387 1 2024-05-06T21:26:53.705 INFO:tasks.workunit.client.1.smithi154.stdout:0/814: creat d6/dc/d40/d4a/d6c/dce/dd7/de7/f10b x:0 0 0 2024-05-06T21:26:53.705 INFO:tasks.workunit.client.1.smithi154.stdout:4/711: write d0/d82/d39/d54/f8b [1276731,78586] 0 2024-05-06T21:26:53.706 INFO:tasks.workunit.client.1.smithi154.stdout:1/723: creat d6/db/d69/fde x:0 0 0 2024-05-06T21:26:53.706 INFO:tasks.workunit.client.1.smithi154.stdout:1/724: creat d6/d3e/d7e/da5/da8/fdf x:0 0 0 2024-05-06T21:26:53.706 INFO:tasks.workunit.client.1.smithi154.stdout:1/725: fsync d6/db/d5e/fd1 0 2024-05-06T21:26:53.707 INFO:tasks.workunit.client.1.smithi154.stdout:2/631: dwrite db/de/d6f/f93 [0,4194304] 0 2024-05-06T21:26:53.708 INFO:tasks.workunit.client.0.smithi032.stdout:6/985: mkdir d8/d3d/d49/dad/d10b/d12a 0 2024-05-06T21:26:53.709 INFO:tasks.workunit.client.0.smithi032.stdout:6/986: chown d8/d3d/fe4 124034 1 2024-05-06T21:26:53.709 INFO:tasks.workunit.client.0.smithi032.stdout:6/987: fdatasync d8/dd/d18/d13/fc6 0 2024-05-06T21:26:53.709 INFO:tasks.workunit.client.0.smithi032.stdout:6/988: fsync d8/d3d/d49/d6b/f9f 0 2024-05-06T21:26:53.710 INFO:tasks.workunit.client.1.smithi154.stdout:0/815: mkdir d6/dc/d40/d10c 0 2024-05-06T21:26:53.710 INFO:tasks.workunit.client.1.smithi154.stdout:0/816: chown d6/dc/f2f 298241 1 2024-05-06T21:26:53.710 INFO:tasks.workunit.client.1.smithi154.stdout:4/712: creat d0/d72/d76/db5/ff4 x:0 0 0 2024-05-06T21:26:53.710 INFO:tasks.workunit.client.1.smithi154.stdout:4/713: read d0/d82/d44/d73/d4a/dd4/f46 [126124,112049] 0 2024-05-06T21:26:53.711 INFO:tasks.workunit.client.0.smithi032.stdout:6/989: link c7 d8/dd/d18/dda/c12b 0 2024-05-06T21:26:53.712 INFO:tasks.workunit.client.1.smithi154.stdout:1/726: creat d6/db/d10/d15/d1d/d53/da3/fe0 x:0 0 0 2024-05-06T21:26:53.713 INFO:tasks.workunit.client.1.smithi154.stdout:8/703: dwrite d3/d14/d1a/d29/d32/d40/d59/f55 [0,4194304] 0 2024-05-06T21:26:53.713 INFO:tasks.workunit.client.1.smithi154.stdout:8/704: getdents d3/d9f 0 2024-05-06T21:26:53.715 INFO:tasks.workunit.client.1.smithi154.stdout:0/817: mkdir d6/dc/d40/d4a/da3/d10d 0 2024-05-06T21:26:53.716 INFO:tasks.workunit.client.0.smithi032.stdout:2/878: dwrite df/d19/d1e/d35/f3d [0,4194304] 0 2024-05-06T21:26:53.717 INFO:tasks.workunit.client.1.smithi154.stdout:4/714: rmdir d0/d82/d44/d73/d4a/dd4/d1a/d7e 39 2024-05-06T21:26:53.719 INFO:tasks.workunit.client.1.smithi154.stdout:1/727: creat d6/db/d10/fe1 x:0 0 0 2024-05-06T21:26:53.719 INFO:tasks.workunit.client.1.smithi154.stdout:1/728: chown d6/db/d10/l68 219390067 1 2024-05-06T21:26:53.719 INFO:tasks.workunit.client.1.smithi154.stdout:1/729: fsync d6/d3e/d7e/da5/da8/fc2 0 2024-05-06T21:26:53.720 INFO:tasks.workunit.client.0.smithi032.stdout:6/990: write d8/d3d/fd5 [1279517,57437] 0 2024-05-06T21:26:53.721 INFO:tasks.workunit.client.1.smithi154.stdout:4/715: dread d0/d2/f8 [0,4194304] 0 2024-05-06T21:26:53.721 INFO:tasks.workunit.client.1.smithi154.stdout:4/716: creat d0/d2/d29/ff5 x:0 0 0 2024-05-06T21:26:53.721 INFO:tasks.workunit.client.1.smithi154.stdout:4/717: chown d0/d82/f5e 246718 1 2024-05-06T21:26:53.721 INFO:tasks.workunit.client.1.smithi154.stdout:4/718: read d0/d72/d76/f7d [2977889,42866] 0 2024-05-06T21:26:53.721 INFO:tasks.workunit.client.1.smithi154.stdout:4/719: creat d0/d82/ff6 x:0 0 0 2024-05-06T21:26:53.723 INFO:tasks.workunit.client.1.smithi154.stdout:0/818: unlink d6/d27/cb6 0 2024-05-06T21:26:53.723 INFO:tasks.workunit.client.1.smithi154.stdout:0/819: truncate d6/dc/d44/d9f/fad 1119894 0 2024-05-06T21:26:53.723 INFO:tasks.workunit.client.1.smithi154.stdout:0/820: truncate d6/dc/d40/d85/f105 316010 0 2024-05-06T21:26:53.724 INFO:tasks.workunit.client.1.smithi154.stdout:1/730: rmdir d6/db/d10/d26 39 2024-05-06T21:26:53.724 INFO:tasks.workunit.client.1.smithi154.stdout:1/731: chown d6/db/d10/c14 1863214 1 2024-05-06T21:26:53.727 INFO:tasks.workunit.client.1.smithi154.stdout:0/821: symlink d6/dc/d40/d85/db2/dbb/l10e 0 2024-05-06T21:26:53.727 INFO:tasks.workunit.client.1.smithi154.stdout:3/839: sync 2024-05-06T21:26:53.727 INFO:tasks.workunit.client.1.smithi154.stdout:3/840: dread - d0/da/d1a/d28/dbc/d117/d52/d62/fc4 zero size 2024-05-06T21:26:53.728 INFO:tasks.workunit.client.1.smithi154.stdout:1/732: symlink d6/db/d69/le2 0 2024-05-06T21:26:53.728 INFO:tasks.workunit.client.1.smithi154.stdout:1/733: creat d6/db/d69/fe3 x:0 0 0 2024-05-06T21:26:53.729 INFO:tasks.workunit.client.1.smithi154.stdout:0/822: mkdir d6/dc/d39/de0/d10f 0 2024-05-06T21:26:53.731 INFO:tasks.workunit.client.1.smithi154.stdout:3/841: unlink d0/d2/l36 0 2024-05-06T21:26:53.732 INFO:tasks.workunit.client.0.smithi032.stdout:2/879: dwrite df/fb1 [0,4194304] 0 2024-05-06T21:26:53.733 INFO:tasks.workunit.client.0.smithi032.stdout:2/880: readlink df/d19/d1e/d71/d5f/d73/ld5 0 2024-05-06T21:26:53.750 INFO:tasks.workunit.client.1.smithi154.stdout:7/571: dwrite d6/d20/fa7 [0,4194304] 0 2024-05-06T21:26:53.754 INFO:tasks.workunit.client.1.smithi154.stdout:1/734: dwrite d6/db/d10/f35 [4194304,4194304] 0 2024-05-06T21:26:53.757 INFO:tasks.workunit.client.1.smithi154.stdout:1/735: stat d6/db/d10/d26/ccb 0 2024-05-06T21:26:53.757 INFO:tasks.workunit.client.0.smithi032.stdout:6/991: mkdir d8/d3d/d49/d6b/d10a/d12c 0 2024-05-06T21:26:53.758 INFO:tasks.workunit.client.1.smithi154.stdout:0/823: write d6/dc/f95 [10118964,113823] 0 2024-05-06T21:26:53.758 INFO:tasks.workunit.client.1.smithi154.stdout:0/824: write d6/dc/d40/d4a/da7/d70/d96/dd5/fe3 [243091,18193] 0 2024-05-06T21:26:53.759 INFO:tasks.workunit.client.1.smithi154.stdout:1/736: link d6/d3e/c7c d6/db/d10/d26/ce4 0 2024-05-06T21:26:53.762 INFO:tasks.workunit.client.0.smithi032.stdout:2/881: creat df/d19/d1e/d71/d5f/d73/df1/f124 x:0 0 0 2024-05-06T21:26:53.762 INFO:tasks.workunit.client.1.smithi154.stdout:0/825: mknod d6/dc/d40/d4a/d6c/d8a/c110 0 2024-05-06T21:26:53.763 INFO:tasks.workunit.client.1.smithi154.stdout:0/826: dread - d6/d27/fae zero size 2024-05-06T21:26:53.763 INFO:tasks.workunit.client.1.smithi154.stdout:0/827: creat d6/dc/d40/d85/db2/dbb/dff/f111 x:0 0 0 2024-05-06T21:26:53.763 INFO:tasks.workunit.client.1.smithi154.stdout:0/828: dread - d6/dc1/ffd zero size 2024-05-06T21:26:53.765 INFO:tasks.workunit.client.1.smithi154.stdout:0/829: rename d6/dc/d42/f59 to d6/dc/d40/d10c/f112 0 2024-05-06T21:26:53.766 INFO:tasks.workunit.client.1.smithi154.stdout:0/830: rmdir d6/dc/d39 39 2024-05-06T21:26:53.766 INFO:tasks.workunit.client.1.smithi154.stdout:0/831: fsync d6/dc/d39/fb0 0 2024-05-06T21:26:53.769 INFO:tasks.workunit.client.1.smithi154.stdout:0/832: creat d6/dc/d51/d54/dbd/f113 x:0 0 0 2024-05-06T21:26:53.771 INFO:tasks.workunit.client.1.smithi154.stdout:4/720: dwrite d0/d82/d44/f4d [0,4194304] 0 2024-05-06T21:26:53.773 INFO:tasks.workunit.client.1.smithi154.stdout:3/842: dwrite d0/da/d1a/d28/dbc/d117/dd/d1c/d90/ffc [0,4194304] 0 2024-05-06T21:26:53.774 INFO:tasks.workunit.client.1.smithi154.stdout:4/721: stat d0/d82/d39/c52 0 2024-05-06T21:26:53.775 INFO:tasks.workunit.client.0.smithi032.stdout:0/970: sync 2024-05-06T21:26:53.775 INFO:tasks.workunit.client.0.smithi032.stdout:6/992: dread d8/dd/d1b/fe0 [0,4194304] 0 2024-05-06T21:26:53.775 INFO:tasks.workunit.client.0.smithi032.stdout:6/993: dread - d8/dd/d1b/f104 zero size 2024-05-06T21:26:53.778 INFO:tasks.workunit.client.0.smithi032.stdout:6/994: rename d8/dd/d18/d22/f6d to d8/db6/d100/f12d 0 2024-05-06T21:26:53.779 INFO:tasks.workunit.client.0.smithi032.stdout:0/971: getdents d4/da/d16 0 2024-05-06T21:26:53.780 INFO:tasks.workunit.client.1.smithi154.stdout:3/843: mknod d0/c121 0 2024-05-06T21:26:53.780 INFO:tasks.workunit.client.1.smithi154.stdout:3/844: dread - d0/da/d1a/d28/dbc/d81/d48/da9/db3/f115 zero size 2024-05-06T21:26:53.780 INFO:tasks.workunit.client.1.smithi154.stdout:3/845: chown d0/d2/c39 771624 1 2024-05-06T21:26:53.781 INFO:tasks.workunit.client.1.smithi154.stdout:3/846: write d0/da/d1a/d28/dbc/d117/d52/d62/fde [950277,103427] 0 2024-05-06T21:26:53.785 INFO:tasks.workunit.client.1.smithi154.stdout:4/722: rename d0/d82/d44/d73/d4a/d74/db8 to d0/d82/d39/df7 0 2024-05-06T21:26:53.785 INFO:tasks.workunit.client.1.smithi154.stdout:4/723: truncate d0/d2/f69 12706 0 2024-05-06T21:26:53.787 INFO:tasks.workunit.client.1.smithi154.stdout:1/737: dwrite d6/f24 [0,4194304] 0 2024-05-06T21:26:53.788 INFO:tasks.workunit.client.1.smithi154.stdout:4/724: rename d0/d2/d47/l87 to d0/d72/d76/db5/db7/df3/lf8 0 2024-05-06T21:26:53.792 INFO:tasks.workunit.client.1.smithi154.stdout:1/738: mkdir d6/db/d10/de5 0 2024-05-06T21:26:53.792 INFO:tasks.workunit.client.1.smithi154.stdout:1/739: truncate d6/db/d97/fc9 900659 0 2024-05-06T21:26:53.792 INFO:tasks.workunit.client.1.smithi154.stdout:1/740: write d6/db/d69/d89/dac/fae [876511,11174] 0 2024-05-06T21:26:53.792 INFO:tasks.workunit.client.1.smithi154.stdout:1/741: write d6/db/d10/d15/d1d/d53/f5f [1277491,114517] 0 2024-05-06T21:26:53.793 INFO:tasks.workunit.client.1.smithi154.stdout:7/572: dwrite d6/f9 [0,4194304] 0 2024-05-06T21:26:53.796 INFO:tasks.workunit.client.1.smithi154.stdout:1/742: creat d6/db/d10/d26/fe6 x:0 0 0 2024-05-06T21:26:53.796 INFO:tasks.workunit.client.1.smithi154.stdout:1/743: fdatasync d6/db/d10/d26/f8f 0 2024-05-06T21:26:53.796 INFO:tasks.workunit.client.1.smithi154.stdout:1/744: write d6/d3e/f82 [1011167,96109] 0 2024-05-06T21:26:53.799 INFO:tasks.workunit.client.0.smithi032.stdout:6/995: write d8/d33/f4a [2408724,130805] 0 2024-05-06T21:26:53.802 INFO:tasks.workunit.client.0.smithi032.stdout:6/996: mkdir d8/d3d/d12e 0 2024-05-06T21:26:53.803 INFO:tasks.workunit.client.1.smithi154.stdout:3/847: dwrite d0/da/d1a/d28/dbc/d117/dd/d1c/d90/d112/f7b [0,4194304] 0 2024-05-06T21:26:53.805 INFO:tasks.workunit.client.1.smithi154.stdout:1/745: truncate d6/db/d10/d26/f23 1683867 0 2024-05-06T21:26:53.805 INFO:tasks.workunit.client.1.smithi154.stdout:1/746: chown d6/db/d10/l86 514 1 2024-05-06T21:26:53.806 INFO:tasks.workunit.client.1.smithi154.stdout:1/747: stat d6/db/d10/f77 0 2024-05-06T21:26:53.807 INFO:tasks.workunit.client.0.smithi032.stdout:0/972: dwrite d4/d3e/d63/d6c/d8f/fba [0,4194304] 0 2024-05-06T21:26:53.814 INFO:tasks.workunit.client.1.smithi154.stdout:3/848: unlink d0/d2/fc7 0 2024-05-06T21:26:53.814 INFO:tasks.workunit.client.1.smithi154.stdout:4/725: dwrite d0/d2/fd8 [0,4194304] 0 2024-05-06T21:26:53.815 INFO:tasks.workunit.client.1.smithi154.stdout:0/833: rmdir d6/dc/d51/d54/dbd 39 2024-05-06T21:26:53.815 INFO:tasks.workunit.client.1.smithi154.stdout:0/834: fdatasync d6/dc/d40/d4a/d6c/f9e 0 2024-05-06T21:26:53.815 INFO:tasks.workunit.client.1.smithi154.stdout:0/835: read - d6/dc/d51/d54/dbd/fc5 zero size 2024-05-06T21:26:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:0/973: dread d4/f3f [0,4194304] 0 2024-05-06T21:26:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:0/974: write d4/d3e/d63/d6c/d8f/dc2/fc5 [706645,85243] 0 2024-05-06T21:26:53.828 INFO:tasks.workunit.client.1.smithi154.stdout:1/748: dwrite d6/db/d10/d15/d1d/d53/f43 [0,4194304] 0 2024-05-06T21:26:53.828 INFO:tasks.workunit.client.1.smithi154.stdout:1/749: chown d6/f28 2209043 1 2024-05-06T21:26:53.828 INFO:tasks.workunit.client.1.smithi154.stdout:1/750: creat d6/db/dbe/fe7 x:0 0 0 2024-05-06T21:26:53.828 INFO:tasks.workunit.client.1.smithi154.stdout:1/751: dread - d6/db/d10/fc8 zero size 2024-05-06T21:26:53.830 INFO:tasks.workunit.client.0.smithi032.stdout:6/997: dwrite d8/d3d/d49/d6b/d10a/f3f [4194304,4194304] 0 2024-05-06T21:26:53.840 INFO:tasks.workunit.client.1.smithi154.stdout:3/849: mkdir d0/da/d1a/d28/dbc/d117/dd/d1c/d41/d122 0 2024-05-06T21:26:53.840 INFO:tasks.workunit.client.1.smithi154.stdout:3/850: creat d0/da/d1a/d28/dbc/d81/d48/da9/db3/f123 x:0 0 0 2024-05-06T21:26:53.843 INFO:tasks.workunit.client.1.smithi154.stdout:1/752: dwrite d6/db/f6f [0,4194304] 0 2024-05-06T21:26:53.844 INFO:tasks.workunit.client.1.smithi154.stdout:4/726: unlink d0/d82/feb 0 2024-05-06T21:26:53.844 INFO:tasks.workunit.client.1.smithi154.stdout:4/727: chown d0/d10/fd6 28679 1 2024-05-06T21:26:53.844 INFO:tasks.workunit.client.1.smithi154.stdout:4/728: readlink d0/d2/d47/l80 0 2024-05-06T21:26:53.849 INFO:tasks.workunit.client.1.smithi154.stdout:3/851: link d0/da/d1a/d28/dbc/d117/dd/d1c/d21/c114 d0/da/d1a/d28/dbc/d117/dd/d1c/d21/d37/c124 0 2024-05-06T21:26:53.849 INFO:tasks.workunit.client.1.smithi154.stdout:3/852: write d0/da/d1a/d28/dbc/d117/dd/f53 [203757,38131] 0 2024-05-06T21:26:53.852 INFO:tasks.workunit.client.1.smithi154.stdout:4/729: truncate d0/d2/dc/fe 3413365 0 2024-05-06T21:26:53.852 INFO:tasks.workunit.client.1.smithi154.stdout:3/853: dread d0/f50 [0,4194304] 0 2024-05-06T21:26:53.853 INFO:tasks.workunit.client.1.smithi154.stdout:0/836: truncate d6/dc/d40/d4a/da7/d70/d96/dd5/fe3 60801 0 2024-05-06T21:26:53.855 INFO:tasks.workunit.client.1.smithi154.stdout:4/730: creat d0/d72/d76/dc7/ff9 x:0 0 0 2024-05-06T21:26:53.855 INFO:tasks.workunit.client.1.smithi154.stdout:4/731: write d0/d2/dc/fc4 [1508143,64681] 0 2024-05-06T21:26:53.856 INFO:tasks.workunit.client.1.smithi154.stdout:4/732: chown d0/d82/d44/c71 447 1 2024-05-06T21:26:53.856 INFO:tasks.workunit.client.1.smithi154.stdout:4/733: truncate d0/d10/f65 1724958 0 2024-05-06T21:26:53.857 INFO:tasks.workunit.client.1.smithi154.stdout:0/837: truncate d6/dc/f95 1341599 0 2024-05-06T21:26:53.859 INFO:tasks.workunit.client.1.smithi154.stdout:4/734: mknod d0/d82/d39/cfa 0 2024-05-06T21:26:53.859 INFO:tasks.workunit.client.1.smithi154.stdout:4/735: fdatasync d0/d2/dc/f48 0 2024-05-06T21:26:53.859 INFO:tasks.workunit.client.1.smithi154.stdout:4/736: write d0/d82/faf [490239,12509] 0 2024-05-06T21:26:53.862 INFO:tasks.workunit.client.1.smithi154.stdout:0/838: dread d6/dc/d40/d4a/d6c/fb4 [0,4194304] 0 2024-05-06T21:26:53.864 INFO:tasks.workunit.client.1.smithi154.stdout:1/753: dwrite d6/d3e/d7e/da5/da8/fdf [0,4194304] 0 2024-05-06T21:26:53.875 INFO:tasks.workunit.client.1.smithi154.stdout:1/754: unlink d6/db/d5e/fd1 0 2024-05-06T21:26:53.878 INFO:tasks.workunit.client.1.smithi154.stdout:1/755: mknod d6/db/d10/d26/d1b/ce8 0 2024-05-06T21:26:53.881 INFO:tasks.workunit.client.1.smithi154.stdout:3/854: dwrite d0/da/d1a/d28/dbc/d117/d52/d62/fe0 [4194304,4194304] 0 2024-05-06T21:26:53.881 INFO:tasks.workunit.client.1.smithi154.stdout:3/855: dread - d0/da/d1a/d28/dbc/d81/d48/da9/fe4 zero size 2024-05-06T21:26:53.881 INFO:tasks.workunit.client.1.smithi154.stdout:3/856: readlink d0/da/d1a/d28/d17/db0/l61 0 2024-05-06T21:26:53.881 INFO:tasks.workunit.client.1.smithi154.stdout:3/857: fsync d0/da/d1a/d28/d17/db0/f6e 0 2024-05-06T21:26:53.881 INFO:tasks.workunit.client.1.smithi154.stdout:3/858: chown d0/da/d1a/d28/dbc/d117/d52/d62/c78 46351756 1 2024-05-06T21:26:53.881 INFO:tasks.workunit.client.1.smithi154.stdout:1/756: truncate d6/db/d10/d15/d1d/f61 3800916 0 2024-05-06T21:26:53.886 INFO:tasks.workunit.client.1.smithi154.stdout:1/757: unlink d6/d3e/f75 0 2024-05-06T21:26:53.886 INFO:tasks.workunit.client.1.smithi154.stdout:1/758: dread - d6/db/d10/d15/d1d/d53/da3/fe0 zero size 2024-05-06T21:26:53.888 INFO:tasks.workunit.client.1.smithi154.stdout:6/530: sync 2024-05-06T21:26:53.891 INFO:tasks.workunit.client.1.smithi154.stdout:9/788: sync 2024-05-06T21:26:53.891 INFO:tasks.workunit.client.1.smithi154.stdout:5/686: sync 2024-05-06T21:26:53.891 INFO:tasks.workunit.client.1.smithi154.stdout:5/687: chown d2/d48 487689568 1 2024-05-06T21:26:53.893 INFO:tasks.workunit.client.1.smithi154.stdout:4/737: dwrite d0/d2/d47/fbf [0,4194304] 0 2024-05-06T21:26:53.893 INFO:tasks.workunit.client.1.smithi154.stdout:0/839: dwrite d6/dc1/dd0/ffe [0,4194304] 0 2024-05-06T21:26:53.893 INFO:tasks.workunit.client.1.smithi154.stdout:6/531: rename d8/d11/f9c to d8/d11/d2d/d3d/d70/d7b/d95/fa7 0 2024-05-06T21:26:53.895 INFO:tasks.workunit.client.1.smithi154.stdout:9/789: creat d5/d20/d37/dd5/de1/de6/f109 x:0 0 0 2024-05-06T21:26:53.902 INFO:tasks.workunit.client.1.smithi154.stdout:0/840: unlink d6/dc/d51/f100 0 2024-05-06T21:26:53.904 INFO:tasks.workunit.client.1.smithi154.stdout:9/790: link d5/d20/l2b d5/d2e/d66/l10a 0 2024-05-06T21:26:53.904 INFO:tasks.workunit.client.1.smithi154.stdout:4/738: dread d0/d2/f1c [0,4194304] 0 2024-05-06T21:26:53.904 INFO:tasks.workunit.client.1.smithi154.stdout:4/739: write d0/d82/d39/d54/fd1 [1408847,57739] 0 2024-05-06T21:26:53.907 INFO:tasks.workunit.client.1.smithi154.stdout:0/841: symlink d6/dc/d44/d9f/l114 0 2024-05-06T21:26:53.909 INFO:tasks.workunit.client.1.smithi154.stdout:4/740: rename d0/d82/cc8 to d0/d82/d44/de9/cfb 0 2024-05-06T21:26:53.910 INFO:tasks.workunit.client.1.smithi154.stdout:3/859: dwrite d0/da/d1a/d28/dbc/d117/d30/f98 [0,4194304] 0 2024-05-06T21:26:53.911 INFO:tasks.workunit.client.1.smithi154.stdout:0/842: mknod d6/dc/c115 0 2024-05-06T21:26:53.911 INFO:tasks.workunit.client.1.smithi154.stdout:0/843: creat d6/dc/d40/d4a/f116 x:0 0 0 2024-05-06T21:26:53.913 INFO:tasks.workunit.client.1.smithi154.stdout:8/705: sync 2024-05-06T21:26:53.913 INFO:tasks.workunit.client.1.smithi154.stdout:2/632: sync 2024-05-06T21:26:53.913 INFO:tasks.workunit.client.1.smithi154.stdout:2/633: fsync db/d12/f21 0 2024-05-06T21:26:53.913 INFO:tasks.workunit.client.1.smithi154.stdout:8/706: write d3/d14/d1a/d29/f50 [4982462,71568] 0 2024-05-06T21:26:53.915 INFO:tasks.workunit.client.1.smithi154.stdout:9/791: dread d5/d20/d52/f57 [0,4194304] 0 2024-05-06T21:26:53.916 INFO:tasks.workunit.client.1.smithi154.stdout:9/792: dread d5/f73 [0,4194304] 0 2024-05-06T21:26:53.916 INFO:tasks.workunit.client.1.smithi154.stdout:9/793: write d5/d20/d52/d6e/d104/fe2 [546885,123835] 0 2024-05-06T21:26:53.917 INFO:tasks.workunit.client.1.smithi154.stdout:2/634: unlink db/de/d16/d33/l72 0 2024-05-06T21:26:53.925 INFO:tasks.workunit.client.1.smithi154.stdout:3/860: mknod d0/da/d82/c125 0 2024-05-06T21:26:53.927 INFO:tasks.workunit.client.1.smithi154.stdout:3/861: truncate d0/da/d1a/d28/dbc/d117/d52/d62/fde 231605 0 2024-05-06T21:26:53.927 INFO:tasks.workunit.client.1.smithi154.stdout:3/862: write d0/da/d1a/d28/f5b [3226971,122016] 0 2024-05-06T21:26:53.927 INFO:tasks.workunit.client.1.smithi154.stdout:3/863: chown d0/da/d1a/d28/dbc/d117/d7c/d80/d106 26 1 2024-05-06T21:26:53.929 INFO:tasks.workunit.client.1.smithi154.stdout:3/864: mknod d0/da/d1a/d28/dbc/d117/d52/d62/c126 0 2024-05-06T21:26:53.934 INFO:tasks.workunit.client.1.smithi154.stdout:3/865: mkdir d0/da/d1a/d28/d17/dfe/d127 0 2024-05-06T21:26:53.934 INFO:tasks.workunit.client.1.smithi154.stdout:3/866: chown d0/da/d1a/d28/dbc/d117/d7c/d80/d106/f116 1428087 1 2024-05-06T21:26:53.934 INFO:tasks.workunit.client.1.smithi154.stdout:3/867: fdatasync d0/da/d1a/d28/dbc/d117/d30/fab 0 2024-05-06T21:26:53.934 INFO:tasks.workunit.client.1.smithi154.stdout:8/707: dwrite d3/d14/d1a/d45/f7d [0,4194304] 0 2024-05-06T21:26:53.934 INFO:tasks.workunit.client.1.smithi154.stdout:8/708: chown d3/d14/d1a/d29/d32/d40/d79/d2b 2431150 1 2024-05-06T21:26:53.934 INFO:tasks.workunit.client.1.smithi154.stdout:8/709: creat d3/d14/d1a/d29/d43/fe1 x:0 0 0 2024-05-06T21:26:53.955 INFO:tasks.workunit.client.1.smithi154.stdout:6/532: dwrite d8/f2b [0,4194304] 0 2024-05-06T21:26:53.955 INFO:tasks.workunit.client.1.smithi154.stdout:6/533: chown d8/d11/d2d/d3d/d70/c82 1552406 1 2024-05-06T21:26:53.955 INFO:tasks.workunit.client.1.smithi154.stdout:5/688: dread d2/d3/d19/d23/f33 [0,4194304] 0 2024-05-06T21:26:53.955 INFO:tasks.workunit.client.1.smithi154.stdout:5/689: readlink d2/d48/l7a 0 2024-05-06T21:26:53.955 INFO:tasks.workunit.client.1.smithi154.stdout:5/690: truncate d2/d3/d21/d95/dc/d71/f81 4503962 0 2024-05-06T21:26:53.956 INFO:tasks.workunit.client.1.smithi154.stdout:9/794: write d5/f76 [3073432,84795] 0 2024-05-06T21:26:53.957 INFO:tasks.workunit.client.1.smithi154.stdout:6/534: symlink d8/d11/d2d/d3d/la8 0 2024-05-06T21:26:53.957 INFO:tasks.workunit.client.1.smithi154.stdout:6/535: readlink d8/d11/d2d/l41 0 2024-05-06T21:26:53.957 INFO:tasks.workunit.client.1.smithi154.stdout:4/741: dread d0/d82/d39/d54/f8b [0,4194304] 0 2024-05-06T21:26:53.958 INFO:tasks.workunit.client.1.smithi154.stdout:5/691: rename d2/d3/d21/d95/dc/d44/dc0/ccd to d2/d3/d19/dbe/cee 0 2024-05-06T21:26:53.958 INFO:tasks.workunit.client.1.smithi154.stdout:5/692: fsync d2/d3/d21/d95/dc/f15 0 2024-05-06T21:26:53.958 INFO:tasks.workunit.client.1.smithi154.stdout:5/693: readlink d2/d3/l8f 0 2024-05-06T21:26:53.958 INFO:tasks.workunit.client.1.smithi154.stdout:5/694: creat d2/d3/d19/d23/db6/fef x:0 0 0 2024-05-06T21:26:53.958 INFO:tasks.workunit.client.1.smithi154.stdout:5/695: write d2/d3/f6d [4235546,19113] 0 2024-05-06T21:26:53.960 INFO:tasks.workunit.client.1.smithi154.stdout:9/795: unlink d5/d20/d52/d59/ff9 0 2024-05-06T21:26:53.962 INFO:tasks.workunit.client.1.smithi154.stdout:4/742: unlink d0/d2/d47/d81/f86 0 2024-05-06T21:26:53.966 INFO:tasks.workunit.client.1.smithi154.stdout:8/710: dwrite d3/d14/d1a/d29/d43/f5d [4194304,4194304] 0 2024-05-06T21:26:53.967 INFO:tasks.workunit.client.1.smithi154.stdout:8/711: dread d3/d14/d1a/d29/d32/d40/d79/d84/da4/fc0 [0,4194304] 0 2024-05-06T21:26:53.968 INFO:tasks.workunit.client.1.smithi154.stdout:8/712: write d3/d14/d1a/f28 [5437,10947] 0 2024-05-06T21:26:53.968 INFO:tasks.workunit.client.1.smithi154.stdout:5/696: mknod d2/d3/d21/d95/dc/cf0 0 2024-05-06T21:26:53.970 INFO:tasks.workunit.client.1.smithi154.stdout:9/796: symlink d5/dca/l10b 0 2024-05-06T21:26:53.972 INFO:tasks.workunit.client.1.smithi154.stdout:4/743: rmdir d0/d82/d3d 39 2024-05-06T21:26:53.972 INFO:tasks.workunit.client.1.smithi154.stdout:4/744: chown d0/d82/d39/d54/f8b 22772 1 2024-05-06T21:26:53.972 INFO:tasks.workunit.client.1.smithi154.stdout:4/745: chown d0/d82/d39 3 1 2024-05-06T21:26:53.976 INFO:tasks.workunit.client.1.smithi154.stdout:5/697: unlink d2/d3/d8b/fc7 0 2024-05-06T21:26:53.977 INFO:tasks.workunit.client.1.smithi154.stdout:5/698: write d2/d3/d19/d23/faf [52561,78397] 0 2024-05-06T21:26:53.977 INFO:tasks.workunit.client.1.smithi154.stdout:5/699: chown d2/d3/d21/d95/dd/d2a/d54/f5c 61 1 2024-05-06T21:26:53.977 INFO:tasks.workunit.client.1.smithi154.stdout:9/797: mknod d5/d20/d52/d6e/d83/de5/c10c 0 2024-05-06T21:26:53.978 INFO:tasks.workunit.client.1.smithi154.stdout:4/746: mkdir d0/d82/d44/d73/d4a/dd4/d1a/d50/dfc 0 2024-05-06T21:26:53.979 INFO:tasks.workunit.client.1.smithi154.stdout:5/700: mknod d2/d3/d21/d22/d25/d37/cf1 0 2024-05-06T21:26:53.981 INFO:tasks.workunit.client.1.smithi154.stdout:4/747: rename d0/d82/d44/d73/d9a/lb2 to d0/d72/d76/db5/db7/lfd 0 2024-05-06T21:26:53.981 INFO:tasks.workunit.client.1.smithi154.stdout:4/748: getdents d0/d82/d44/d73/def/df1 0 2024-05-06T21:26:53.982 INFO:tasks.workunit.client.1.smithi154.stdout:2/635: dwrite db/d12/d4e/d55/fb0 [0,4194304] 0 2024-05-06T21:26:53.982 INFO:tasks.workunit.client.1.smithi154.stdout:2/636: stat db/de/d16/d33/f4d 0 2024-05-06T21:26:53.982 INFO:tasks.workunit.client.1.smithi154.stdout:2/637: write f5 [4154953,97223] 0 2024-05-06T21:26:53.982 INFO:tasks.workunit.client.1.smithi154.stdout:2/638: write db/d12/d4e/d55/f5e [1570842,70148] 0 2024-05-06T21:26:53.982 INFO:tasks.workunit.client.1.smithi154.stdout:2/639: fsync db/de/d10/f69 0 2024-05-06T21:26:53.982 INFO:tasks.workunit.client.1.smithi154.stdout:5/701: rmdir d2/d3/d19 39 2024-05-06T21:26:53.983 INFO:tasks.workunit.client.1.smithi154.stdout:9/798: mkdir d5/d14/d10d 0 2024-05-06T21:26:53.986 INFO:tasks.workunit.client.1.smithi154.stdout:2/640: mkdir db/d12/d19/d4b/dcb 0 2024-05-06T21:26:53.986 INFO:tasks.workunit.client.1.smithi154.stdout:2/641: stat db/de/d10/f25 0 2024-05-06T21:26:53.987 INFO:tasks.workunit.client.1.smithi154.stdout:5/702: truncate d2/d3/d19/f3c 3226478 0 2024-05-06T21:26:53.987 INFO:tasks.workunit.client.1.smithi154.stdout:0/844: dwrite d6/dc/d40/d4a/d6c/fb4 [0,4194304] 0 2024-05-06T21:26:53.988 INFO:tasks.workunit.client.1.smithi154.stdout:9/799: creat d5/d20/d52/d6e/d104/db1/dba/f10e x:0 0 0 2024-05-06T21:26:53.989 INFO:tasks.workunit.client.1.smithi154.stdout:9/800: write d5/d2e/d8b/fe9 [900165,122157] 0 2024-05-06T21:26:53.989 INFO:tasks.workunit.client.1.smithi154.stdout:2/642: mkdir db/d12/d1d/dcc 0 2024-05-06T21:26:53.990 INFO:tasks.workunit.client.1.smithi154.stdout:2/643: fdatasync db/de/d10/f5f 0 2024-05-06T21:26:53.990 INFO:tasks.workunit.client.1.smithi154.stdout:3/868: dwrite d0/da/d1a/d28/dbc/d117/dd/d1c/d21/fe2 [4194304,4194304] 0 2024-05-06T21:26:53.990 INFO:tasks.workunit.client.1.smithi154.stdout:8/713: dwrite d3/f91 [0,4194304] 0 2024-05-06T21:26:53.990 INFO:tasks.workunit.client.1.smithi154.stdout:6/536: dwrite d8/d13/f71 [0,4194304] 0 2024-05-06T21:26:53.991 INFO:tasks.workunit.client.0.smithi032.stdout:1/919: sync 2024-05-06T21:26:53.992 INFO:tasks.workunit.client.1.smithi154.stdout:4/749: write d0/d82/d39/d63/f8e [2223352,12842] 0 2024-05-06T21:26:53.992 INFO:tasks.workunit.client.1.smithi154.stdout:4/750: creat d0/d82/ffe x:0 0 0 2024-05-06T21:26:53.992 INFO:tasks.workunit.client.1.smithi154.stdout:3/869: write d0/da/d1a/f44 [862422,62623] 0 2024-05-06T21:26:53.994 INFO:tasks.workunit.client.0.smithi032.stdout:1/920: symlink db/d47/d70/d112/l12c 0 2024-05-06T21:26:53.995 INFO:tasks.workunit.client.1.smithi154.stdout:9/801: creat d5/d14/daf/f10f x:0 0 0 2024-05-06T21:26:53.995 INFO:tasks.workunit.client.1.smithi154.stdout:9/802: fsync d5/f73 0 2024-05-06T21:26:53.996 INFO:tasks.workunit.client.0.smithi032.stdout:1/921: rename db/faf to db/d16/d5d/db2/f12d 0 2024-05-06T21:26:53.996 INFO:tasks.workunit.client.0.smithi032.stdout:1/922: readlink db/d16/d46/d57/d58/l125 0 2024-05-06T21:26:53.996 INFO:tasks.workunit.client.0.smithi032.stdout:1/923: write db/d16/db8/f129 [71556,28128] 0 2024-05-06T21:26:53.997 INFO:tasks.workunit.client.1.smithi154.stdout:2/644: truncate db/d12/d1d/f47 437129 0 2024-05-06T21:26:53.997 INFO:tasks.workunit.client.0.smithi032.stdout:1/924: symlink db/d37/l12e 0 2024-05-06T21:26:53.999 INFO:tasks.workunit.client.0.smithi032.stdout:1/925: write db/d37/feb [473679,93842] 0 2024-05-06T21:26:54.004 INFO:tasks.workunit.client.1.smithi154.stdout:4/751: write d0/d82/d44/d73/d4a/d74/f85 [2849053,69807] 0 2024-05-06T21:26:54.004 INFO:tasks.workunit.client.1.smithi154.stdout:4/752: dread - d0/d82/d44/d73/d9a/fac zero size 2024-05-06T21:26:54.004 INFO:tasks.workunit.client.1.smithi154.stdout:4/753: fsync d0/d2/dc/f26 0 2024-05-06T21:26:54.004 INFO:tasks.workunit.client.1.smithi154.stdout:4/754: fsync d0/d72/d76/fb4 0 2024-05-06T21:26:54.004 INFO:tasks.workunit.client.1.smithi154.stdout:4/755: chown d0/d2/d29/d8f 100296 1 2024-05-06T21:26:54.004 INFO:tasks.workunit.client.1.smithi154.stdout:4/756: readlink d0/d82/l7b 0 2024-05-06T21:26:54.004 INFO:tasks.workunit.client.1.smithi154.stdout:5/703: dwrite d2/d3/d19/d23/f9b [0,4194304] 0 2024-05-06T21:26:54.005 INFO:tasks.workunit.client.1.smithi154.stdout:3/870: dread d0/da/d1a/d28/dbc/d117/f10 [0,4194304] 0 2024-05-06T21:26:54.010 INFO:tasks.workunit.client.0.smithi032.stdout:1/926: dread db/f29 [4194304,4194304] 0 2024-05-06T21:26:54.013 INFO:tasks.workunit.client.0.smithi032.stdout:1/927: creat db/d16/d46/d57/f12f x:0 0 0 2024-05-06T21:26:54.013 INFO:tasks.workunit.client.0.smithi032.stdout:1/928: fsync db/dc8/dfc/f115 0 2024-05-06T21:26:54.013 INFO:tasks.workunit.client.0.smithi032.stdout:1/929: dread - db/d37/d93/dce/df4/d127/ff7 zero size 2024-05-06T21:26:54.016 INFO:tasks.workunit.client.0.smithi032.stdout:1/930: rmdir db/d47/d4a/dcb/dec 0 2024-05-06T21:26:54.019 INFO:tasks.workunit.client.1.smithi154.stdout:8/714: mknod d3/d14/d1a/d29/d32/d40/d59/d67/ce2 0 2024-05-06T21:26:54.023 INFO:tasks.workunit.client.1.smithi154.stdout:3/871: dwrite d0/da/d1a/d28/dbc/d81/d48/da9/fe4 [0,4194304] 0 2024-05-06T21:26:54.024 INFO:tasks.workunit.client.1.smithi154.stdout:0/845: getdents d6/dc1 0 2024-05-06T21:26:54.025 INFO:tasks.workunit.client.1.smithi154.stdout:0/846: dread d6/dc/d42/f90 [0,4194304] 0 2024-05-06T21:26:54.025 INFO:tasks.workunit.client.1.smithi154.stdout:0/847: truncate d6/dc/d51/d54/dbd/f113 494981 0 2024-05-06T21:26:54.025 INFO:tasks.workunit.client.1.smithi154.stdout:9/803: symlink d5/d2e/d8b/dc6/l110 0 2024-05-06T21:26:54.025 INFO:tasks.workunit.client.1.smithi154.stdout:9/804: stat d5/d2e/d8b/dc6/d103 0 2024-05-06T21:26:54.026 INFO:tasks.workunit.client.0.smithi032.stdout:2/882: sync 2024-05-06T21:26:54.027 INFO:tasks.workunit.client.0.smithi032.stdout:1/931: read db/d16/d46/f96 [2119403,40417] 0 2024-05-06T21:26:54.027 INFO:tasks.workunit.client.0.smithi032.stdout:1/932: readlink db/l7f 0 2024-05-06T21:26:54.027 INFO:tasks.workunit.client.0.smithi032.stdout:1/933: stat db/d37/l3a 0 2024-05-06T21:26:54.027 INFO:tasks.workunit.client.0.smithi032.stdout:2/883: mknod df/d19/d1e/d35/dc5/d2e/dbe/c125 0 2024-05-06T21:26:54.027 INFO:tasks.workunit.client.0.smithi032.stdout:2/884: chown df/d19/d1e/d71/d5f/d7d/d65/d78/fd1 262161 1 2024-05-06T21:26:54.028 INFO:tasks.workunit.client.1.smithi154.stdout:2/645: creat db/d12/d4e/fcd x:0 0 0 2024-05-06T21:26:54.028 INFO:tasks.workunit.client.1.smithi154.stdout:2/646: readlink db/d12/d19/d4b/l9a 0 2024-05-06T21:26:54.030 INFO:tasks.workunit.client.0.smithi032.stdout:2/885: rmdir df/d19/d1e/d42/dc6/dc1/d10e/d116 0 2024-05-06T21:26:54.031 INFO:tasks.workunit.client.0.smithi032.stdout:6/998: sync 2024-05-06T21:26:54.031 INFO:tasks.workunit.client.0.smithi032.stdout:0/975: sync 2024-05-06T21:26:54.031 INFO:tasks.workunit.client.0.smithi032.stdout:1/934: rmdir db/d37/d52 39 2024-05-06T21:26:54.034 INFO:tasks.workunit.client.0.smithi032.stdout:1/935: unlink db/d47/d4a/lee 0 2024-05-06T21:26:54.037 INFO:tasks.workunit.client.0.smithi032.stdout:0/976: rmdir d4/da/d16/d33/d9e 39 2024-05-06T21:26:54.037 INFO:tasks.workunit.client.0.smithi032.stdout:0/977: creat d4/d3e/d63/d6c/d120/f13e x:0 0 0 2024-05-06T21:26:54.038 INFO:tasks.workunit.client.1.smithi154.stdout:8/715: unlink d3/d14/d1a/l2a 0 2024-05-06T21:26:54.038 INFO:tasks.workunit.client.0.smithi032.stdout:0/978: write d4/da/d16/d33/d9e/dcf/f101 [97760,125375] 0 2024-05-06T21:26:54.039 INFO:tasks.workunit.client.0.smithi032.stdout:0/979: creat d4/d3e/d63/dca/f13f x:0 0 0 2024-05-06T21:26:54.039 INFO:tasks.workunit.client.0.smithi032.stdout:1/936: creat db/d47/d70/f130 x:0 0 0 2024-05-06T21:26:54.041 INFO:tasks.workunit.client.1.smithi154.stdout:2/647: dread db/fab [0,4194304] 0 2024-05-06T21:26:54.042 INFO:tasks.workunit.client.1.smithi154.stdout:2/648: fdatasync db/de/d10/f87 0 2024-05-06T21:26:54.042 INFO:tasks.workunit.client.1.smithi154.stdout:3/872: symlink d0/l128 0 2024-05-06T21:26:54.043 INFO:tasks.workunit.client.1.smithi154.stdout:3/873: write d0/da/d1a/dbf/ff5 [1551627,34737] 0 2024-05-06T21:26:54.043 INFO:tasks.workunit.client.1.smithi154.stdout:3/874: fdatasync d0/da/d1a/d28/d17/f63 0 2024-05-06T21:26:54.043 INFO:tasks.workunit.client.1.smithi154.stdout:3/875: dread - d0/da/d1a/d28/dbc/d81/d48/fbb zero size 2024-05-06T21:26:54.044 INFO:tasks.workunit.client.1.smithi154.stdout:0/848: rmdir d6/dc/d40/d85/db2 39 2024-05-06T21:26:54.044 INFO:tasks.workunit.client.1.smithi154.stdout:0/849: chown d6/dc/d40/d5e/fab 100585683 1 2024-05-06T21:26:54.044 INFO:tasks.workunit.client.0.smithi032.stdout:2/886: dread df/d19/d1e/d35/ff3 [0,4194304] 0 2024-05-06T21:26:54.045 INFO:tasks.workunit.client.1.smithi154.stdout:9/805: truncate d5/d20/f24 4871095 0 2024-05-06T21:26:54.045 INFO:tasks.workunit.client.1.smithi154.stdout:9/806: write d5/d20/d37/dd5/de1/de6/ff4 [5640044,16250] 0 2024-05-06T21:26:54.045 INFO:tasks.workunit.client.1.smithi154.stdout:9/807: write d5/f76 [3305844,24626] 0 2024-05-06T21:26:54.045 INFO:tasks.workunit.client.1.smithi154.stdout:9/808: write d5/d2e/d8b/dc6/fff [467260,99169] 0 2024-05-06T21:26:54.046 INFO:tasks.workunit.client.0.smithi032.stdout:0/980: rename d4/da/d14/f76 to d4/da/d16/d33/d9e/dc9/dcb/f140 0 2024-05-06T21:26:54.046 INFO:tasks.workunit.client.0.smithi032.stdout:0/981: chown d4/da/d16/d33/d9e/faf 1390703 1 2024-05-06T21:26:54.046 INFO:tasks.workunit.client.0.smithi032.stdout:1/937: mknod db/d16/d46/d57/c131 0 2024-05-06T21:26:54.047 INFO:tasks.workunit.client.1.smithi154.stdout:8/716: symlink d3/d64/d6d/dbd/d61/le3 0 2024-05-06T21:26:54.048 INFO:tasks.workunit.client.0.smithi032.stdout:1/938: unlink db/d16/f10f 0 2024-05-06T21:26:54.048 INFO:tasks.workunit.client.1.smithi154.stdout:6/537: rename d8/d11/d51 to d8/d13/da9 0 2024-05-06T21:26:54.048 INFO:tasks.workunit.client.1.smithi154.stdout:6/538: readlink d8/d13/l38 0 2024-05-06T21:26:54.048 INFO:tasks.workunit.client.1.smithi154.stdout:6/539: write d8/d11/d33/d4a/d6c/d8e/f96 [981672,21796] 0 2024-05-06T21:26:54.050 INFO:tasks.workunit.client.1.smithi154.stdout:2/649: truncate db/de/d10/d18/fa8 4835113 0 2024-05-06T21:26:54.055 INFO:tasks.workunit.client.1.smithi154.stdout:3/876: link d0/da/d1a/d28/fe5 d0/da/d1a/d28/dbc/d117/dd/d1c/d21/f129 0 2024-05-06T21:26:54.055 INFO:tasks.workunit.client.1.smithi154.stdout:7/573: sync 2024-05-06T21:26:54.055 INFO:tasks.workunit.client.1.smithi154.stdout:7/574: chown d6/d20/d40/d52/d8b 702 1 2024-05-06T21:26:54.055 INFO:tasks.workunit.client.1.smithi154.stdout:3/877: write d0/da/d1a/d28/fe5 [1471577,23900] 0 2024-05-06T21:26:54.055 INFO:tasks.workunit.client.0.smithi032.stdout:0/982: write d4/da/d14/fe5 [19568,60956] 0 2024-05-06T21:26:54.056 INFO:tasks.workunit.client.0.smithi032.stdout:6/999: dwrite d8/d3d/d49/d6b/d10a/f43 [0,4194304] 0 2024-05-06T21:26:54.056 INFO:tasks.workunit.client.1.smithi154.stdout:0/850: symlink d6/d27/l117 0 2024-05-06T21:26:54.057 INFO:tasks.workunit.client.1.smithi154.stdout:8/717: write d3/d56/f80 [3067029,89382] 0 2024-05-06T21:26:54.058 INFO:tasks.workunit.client.0.smithi032.stdout:1/939: write db/d16/d46/f7e [2862667,118863] 0 2024-05-06T21:26:54.058 INFO:tasks.workunit.client.0.smithi032.stdout:1/940: stat db/d47/d4a/da4/da2/fb0 0 2024-05-06T21:26:54.061 INFO:tasks.workunit.client.1.smithi154.stdout:5/704: rename d2/d3/fa to d2/d3/d21/d95/dd/d2a/d54/d43/ff2 0 2024-05-06T21:26:54.061 INFO:tasks.workunit.client.1.smithi154.stdout:5/705: creat d2/d3/d19/d23/ff3 x:0 0 0 2024-05-06T21:26:54.065 INFO:tasks.workunit.client.1.smithi154.stdout:6/540: mkdir d8/d11/d8d/daa 0 2024-05-06T21:26:54.068 INFO:tasks.workunit.client.0.smithi032.stdout:2/887: dwrite df/d19/d1e/d71/d5f/d7d/d65/dfc/f11d [0,4194304] 0 2024-05-06T21:26:54.069 INFO:tasks.workunit.client.1.smithi154.stdout:0/851: symlink d6/dc/d44/d36/l118 0 2024-05-06T21:26:54.071 INFO:tasks.workunit.client.1.smithi154.stdout:7/575: write d6/fb [3813891,110471] 0 2024-05-06T21:26:54.073 INFO:tasks.workunit.client.0.smithi032.stdout:2/888: rmdir df/d19/d1e/d42/dc6/de8 39 2024-05-06T21:26:54.073 INFO:tasks.workunit.client.1.smithi154.stdout:3/878: dread d0/da/d1a/d28/dbc/d117/dd/d1c/d21/f4e [4194304,4194304] 0 2024-05-06T21:26:54.073 INFO:tasks.workunit.client.1.smithi154.stdout:9/809: rename d5/d14/l58 to d5/d20/d52/d59/d102/l111 0 2024-05-06T21:26:54.073 INFO:tasks.workunit.client.1.smithi154.stdout:2/650: rename db to db/d12/d19/d7d/db1/dce 22 2024-05-06T21:26:54.074 INFO:tasks.workunit.client.1.smithi154.stdout:2/651: read - db/d12/d4e/d55/fa0 zero size 2024-05-06T21:26:54.077 INFO:tasks.workunit.client.0.smithi032.stdout:0/983: dwrite d4/da/d16/f53 [0,4194304] 0 2024-05-06T21:26:54.077 INFO:tasks.workunit.client.1.smithi154.stdout:5/706: creat d2/d3/d21/d95/dd/d2a/d54/d43/db1/ff4 x:0 0 0 2024-05-06T21:26:54.078 INFO:tasks.workunit.client.1.smithi154.stdout:6/541: creat d8/d11/fab x:0 0 0 2024-05-06T21:26:54.079 INFO:tasks.workunit.client.1.smithi154.stdout:7/576: mkdir d6/d20/db1/dba 0 2024-05-06T21:26:54.082 INFO:tasks.workunit.client.1.smithi154.stdout:9/810: mknod d5/d20/d52/d6e/d104/db1/c112 0 2024-05-06T21:26:54.082 INFO:tasks.workunit.client.1.smithi154.stdout:9/811: write d5/d14/f30 [5065734,9351] 0 2024-05-06T21:26:54.082 INFO:tasks.workunit.client.1.smithi154.stdout:9/812: readlink d5/d20/d52/d6e/d104/db1/dba/lbf 0 2024-05-06T21:26:54.082 INFO:tasks.workunit.client.1.smithi154.stdout:9/813: fdatasync d5/d14/fef 0 2024-05-06T21:26:54.083 INFO:tasks.workunit.client.1.smithi154.stdout:3/879: creat d0/da/d1a/d28/dbc/d117/dd/d1c/d90/f12a x:0 0 0 2024-05-06T21:26:54.083 INFO:tasks.workunit.client.0.smithi032.stdout:0/984: symlink d4/da/d16/d33/da7/l141 0 2024-05-06T21:26:54.084 INFO:tasks.workunit.client.1.smithi154.stdout:6/542: dread d8/d11/d2d/d3d/d70/f7d [0,4194304] 0 2024-05-06T21:26:54.085 INFO:tasks.workunit.client.0.smithi032.stdout:0/985: creat d4/da/d16/dcc/d131/d137/f142 x:0 0 0 2024-05-06T21:26:54.085 INFO:tasks.workunit.client.0.smithi032.stdout:0/986: chown d4/d3e/d63/d8d/fb2 178 1 2024-05-06T21:26:54.085 INFO:tasks.workunit.client.1.smithi154.stdout:2/652: truncate db/d86/f88 1376614 0 2024-05-06T21:26:54.089 INFO:tasks.workunit.client.0.smithi032.stdout:0/987: mkdir d4/da/d16/d143 0 2024-05-06T21:26:54.089 INFO:tasks.workunit.client.0.smithi032.stdout:0/988: chown d4/fc 263502460 1 2024-05-06T21:26:54.089 INFO:tasks.workunit.client.0.smithi032.stdout:0/989: chown d4/da/d16/d33/d9e/dc9/f10f 4 1 2024-05-06T21:26:54.089 INFO:tasks.workunit.client.1.smithi154.stdout:5/707: dread d2/d3/d21/d22/f36 [0,4194304] 0 2024-05-06T21:26:54.090 INFO:tasks.workunit.client.0.smithi032.stdout:0/990: mkdir d4/d3e/d144 0 2024-05-06T21:26:54.091 INFO:tasks.workunit.client.1.smithi154.stdout:2/653: dread db/de/f74 [0,4194304] 0 2024-05-06T21:26:54.098 INFO:tasks.workunit.client.1.smithi154.stdout:3/880: mkdir d0/da/d1a/d28/dbc/d117/d7c/d80/d10f/d12b 0 2024-05-06T21:26:54.098 INFO:tasks.workunit.client.1.smithi154.stdout:3/881: write d0/da/d1a/d28/dbc/d117/dd/d1c/fc2 [4759788,65931] 0 2024-05-06T21:26:54.098 INFO:tasks.workunit.client.1.smithi154.stdout:3/882: chown d0/da/d1a/d28/dbc/d117/dd/d1c/d41/f79 1998 1 2024-05-06T21:26:54.100 INFO:tasks.workunit.client.1.smithi154.stdout:8/718: rename d3/d14/d1a/d29/d3e/faa to d3/d14/d1a/d29/d32/fe4 0 2024-05-06T21:26:54.100 INFO:tasks.workunit.client.1.smithi154.stdout:8/719: truncate d3/d14/d1a/d29/d43/fe1 558963 0 2024-05-06T21:26:54.100 INFO:tasks.workunit.client.1.smithi154.stdout:8/720: fdatasync d3/d56/f7f 0 2024-05-06T21:26:54.100 INFO:tasks.workunit.client.1.smithi154.stdout:5/708: symlink d2/lf5 0 2024-05-06T21:26:54.101 INFO:tasks.workunit.client.1.smithi154.stdout:5/709: dread d2/d3/d21/d95/dc/d44/f5b [0,4194304] 0 2024-05-06T21:26:54.102 INFO:tasks.workunit.client.1.smithi154.stdout:5/710: creat d2/d3/d19/d23/db6/ff6 x:0 0 0 2024-05-06T21:26:54.102 INFO:tasks.workunit.client.1.smithi154.stdout:2/654: symlink db/d12/d19/d4b/lcf 0 2024-05-06T21:26:54.103 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:53 smithi032 ceph-mon[27179]: pgmap v27: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 324 MiB/s rd, 375 MiB/s wr, 689 op/s 2024-05-06T21:26:54.103 INFO:tasks.workunit.client.0.smithi032.stdout:0/991: dread d4/d3e/d63/d6c/df1/f10c [0,4194304] 0 2024-05-06T21:26:54.103 INFO:tasks.workunit.client.0.smithi032.stdout:0/992: chown d4/d3e/f11f 65221 1 2024-05-06T21:26:54.104 INFO:tasks.workunit.client.1.smithi154.stdout:9/814: rmdir d5/d20/d37 39 2024-05-06T21:26:54.104 INFO:tasks.workunit.client.1.smithi154.stdout:9/815: chown d5/d20/d52/d6e/d83/da2/cc0 0 1 2024-05-06T21:26:54.105 INFO:tasks.workunit.client.0.smithi032.stdout:0/993: creat d4/d3e/d63/d6c/d8f/dc2/de4/f145 x:0 0 0 2024-05-06T21:26:54.105 INFO:tasks.workunit.client.1.smithi154.stdout:3/883: mkdir d0/da/d1a/d28/dbc/d81/d48/da9/d12c 0 2024-05-06T21:26:54.107 INFO:tasks.workunit.client.1.smithi154.stdout:0/852: rename d6/dc/d39/de0 to d6/dc/d40/d10c/d119 0 2024-05-06T21:26:54.109 INFO:tasks.workunit.client.1.smithi154.stdout:7/577: dwrite d6/d20/d40/f50 [0,4194304] 0 2024-05-06T21:26:54.109 INFO:tasks.workunit.client.1.smithi154.stdout:5/711: symlink d2/d3/d21/d22/lf7 0 2024-05-06T21:26:54.110 INFO:tasks.workunit.client.0.smithi032.stdout:2/889: dwrite df/d19/d1e/d42/dc6/dc1/fc8 [0,4194304] 0 2024-05-06T21:26:54.110 INFO:tasks.workunit.client.0.smithi032.stdout:2/890: read - df/d19/d1e/d35/d3f/fd0 zero size 2024-05-06T21:26:54.112 INFO:tasks.workunit.client.1.smithi154.stdout:3/884: creat d0/da/d1a/d28/dbc/d117/dd/d1c/d21/f12d x:0 0 0 2024-05-06T21:26:54.113 INFO:tasks.workunit.client.0.smithi032.stdout:2/891: mknod df/c126 0 2024-05-06T21:26:54.113 INFO:tasks.workunit.client.1.smithi154.stdout:8/721: write d3/f91 [317696,28310] 0 2024-05-06T21:26:54.114 INFO:tasks.workunit.client.0.smithi032.stdout:2/892: truncate df/d19/d1e/d71/d5f/f80 574267 0 2024-05-06T21:26:54.115 INFO:tasks.workunit.client.1.smithi154.stdout:6/543: rename d8/d13/da9/c5f to d8/d11/d33/d4a/d6c/d8e/cac 0 2024-05-06T21:26:54.115 INFO:tasks.workunit.client.1.smithi154.stdout:6/544: write d8/d13/d20/f7f [762525,3857] 0 2024-05-06T21:26:54.116 INFO:tasks.workunit.client.0.smithi032.stdout:2/893: symlink df/daf/l127 0 2024-05-06T21:26:54.117 INFO:tasks.workunit.client.1.smithi154.stdout:0/853: write d6/dc/d40/d4a/d6c/dce/dd7/fdb [1754692,69884] 0 2024-05-06T21:26:54.119 INFO:tasks.workunit.client.1.smithi154.stdout:9/816: dwrite d5/d14/d87/d65/fa6 [0,4194304] 0 2024-05-06T21:26:54.119 INFO:tasks.workunit.client.1.smithi154.stdout:7/578: creat d6/d42/d6c/d6e/da4/fbb x:0 0 0 2024-05-06T21:26:54.120 INFO:tasks.workunit.client.1.smithi154.stdout:7/579: creat d6/d42/d6c/d6e/d23/fbc x:0 0 0 2024-05-06T21:26:54.121 INFO:tasks.workunit.client.1.smithi154.stdout:5/712: symlink d2/d3/d21/d95/dd/d2a/d54/d43/db1/lf8 0 2024-05-06T21:26:54.121 INFO:tasks.workunit.client.1.smithi154.stdout:5/713: dread - d2/d3/d21/d95/fde zero size 2024-05-06T21:26:54.124 INFO:tasks.workunit.client.0.smithi032.stdout:2/894: dread df/fdf [0,4194304] 0 2024-05-06T21:26:54.124 INFO:tasks.workunit.client.0.smithi032.stdout:2/895: stat df/d19/d1e/d35/dc5/d2e/dbc/l109 0 2024-05-06T21:26:54.125 INFO:tasks.workunit.client.1.smithi154.stdout:3/885: symlink d0/da/d1a/d28/dbc/d117/dd/d1c/d21/d37/l12e 0 2024-05-06T21:26:54.127 INFO:tasks.workunit.client.1.smithi154.stdout:8/722: creat d3/d64/d6d/dbd/dce/fe5 x:0 0 0 2024-05-06T21:26:54.128 INFO:tasks.workunit.client.1.smithi154.stdout:6/545: unlink d8/c73 0 2024-05-06T21:26:54.129 INFO:tasks.workunit.client.1.smithi154.stdout:0/854: mknod d6/dc1/dd0/d107/c11a 0 2024-05-06T21:26:54.138 INFO:tasks.workunit.client.0.smithi032.stdout:2/896: dread df/d19/d1e/d71/d5f/d7d/f9c [0,4194304] 0 2024-05-06T21:26:54.138 INFO:tasks.workunit.client.1.smithi154.stdout:9/817: mknod d5/d2e/da0/c113 0 2024-05-06T21:26:54.139 INFO:tasks.workunit.client.1.smithi154.stdout:2/655: getdents db/d12/d19/d4b 0 2024-05-06T21:26:54.139 INFO:tasks.workunit.client.1.smithi154.stdout:2/656: write f0 [2246813,28881] 0 2024-05-06T21:26:54.139 INFO:tasks.workunit.client.1.smithi154.stdout:2/657: fdatasync db/de/d10/dbc/fc6 0 2024-05-06T21:26:54.139 INFO:tasks.workunit.client.0.smithi032.stdout:2/897: mkdir df/d19/d1e/d71/d5f/d73/df1/d128 0 2024-05-06T21:26:54.141 INFO:tasks.workunit.client.0.smithi032.stdout:2/898: creat df/d19/d1e/d42/dc6/d11b/d11a/f129 x:0 0 0 2024-05-06T21:26:54.141 INFO:tasks.workunit.client.0.smithi032.stdout:2/899: creat df/d19/d1e/d42/dc6/dc1/f12a x:0 0 0 2024-05-06T21:26:54.141 INFO:tasks.workunit.client.1.smithi154.stdout:5/714: unlink d2/d3/fb2 0 2024-05-06T21:26:54.142 INFO:tasks.workunit.client.0.smithi032.stdout:2/900: mkdir df/dae/d12b 0 2024-05-06T21:26:54.143 INFO:tasks.workunit.client.0.smithi032.stdout:2/901: rmdir df/d19/d1e/d42/dc6/d11b 39 2024-05-06T21:26:54.143 INFO:tasks.workunit.client.0.smithi032.stdout:2/902: truncate df/d19/d1e/d71/d5f/f11c 1048287 0 2024-05-06T21:26:54.143 INFO:tasks.workunit.client.1.smithi154.stdout:8/723: creat d3/d14/d1a/d45/dcf/ddf/fe6 x:0 0 0 2024-05-06T21:26:54.146 INFO:tasks.workunit.client.1.smithi154.stdout:0/855: rename d6/dc/d40/d10c/d119/cf3 to d6/dc/d40/d4a/d6c/d8a/c11b 0 2024-05-06T21:26:54.146 INFO:tasks.workunit.client.1.smithi154.stdout:0/856: readlink d6/dc/d40/l81 0 2024-05-06T21:26:54.146 INFO:tasks.workunit.client.1.smithi154.stdout:0/857: dread - d6/dc/d39/fb0 zero size 2024-05-06T21:26:54.148 INFO:tasks.workunit.client.1.smithi154.stdout:8/724: rename d3/d14/d1a/d29/d3e/f66 to d3/d14/d1a/fe7 0 2024-05-06T21:26:54.148 INFO:tasks.workunit.client.1.smithi154.stdout:2/658: write db/de/d16/f52 [784893,39367] 0 2024-05-06T21:26:54.148 INFO:tasks.workunit.client.1.smithi154.stdout:2/659: readlink db/d12/d19/d4b/l9a 0 2024-05-06T21:26:54.150 INFO:tasks.workunit.client.1.smithi154.stdout:0/858: mknod d6/dc/d40/d85/db2/dbb/c11c 0 2024-05-06T21:26:54.150 INFO:tasks.workunit.client.1.smithi154.stdout:8/725: dread d3/d64/d6d/dbd/d61/f81 [0,4194304] 0 2024-05-06T21:26:54.150 INFO:tasks.workunit.client.1.smithi154.stdout:8/726: write d3/d14/d1a/d45/f5a [4818345,30453] 0 2024-05-06T21:26:54.150 INFO:tasks.workunit.client.1.smithi154.stdout:6/546: dwrite d8/d13/da9/f6f [4194304,4194304] 0 2024-05-06T21:26:54.150 INFO:tasks.workunit.client.1.smithi154.stdout:6/547: readlink d8/d13/l50 0 2024-05-06T21:26:54.150 INFO:tasks.workunit.client.1.smithi154.stdout:6/548: write d8/d13/f77 [503201,70036] 0 2024-05-06T21:26:54.150 INFO:tasks.workunit.client.1.smithi154.stdout:6/549: chown d8/d11/d2d/d3d/d4c/c4d 74922 1 2024-05-06T21:26:54.151 INFO:tasks.workunit.client.1.smithi154.stdout:6/550: write d8/d11/d2d/d3d/f6b [1617023,123087] 0 2024-05-06T21:26:54.151 INFO:tasks.workunit.client.1.smithi154.stdout:6/551: write d8/d11/d2d/d3d/d70/f5d [1868080,4323] 0 2024-05-06T21:26:54.151 INFO:tasks.workunit.client.1.smithi154.stdout:6/552: dread - d8/fa5 zero size 2024-05-06T21:26:54.151 INFO:tasks.workunit.client.1.smithi154.stdout:3/886: dwrite d0/da/d1a/d28/dbc/d117/dd/d1c/d90/d112/ff9 [0,4194304] 0 2024-05-06T21:26:54.151 INFO:tasks.workunit.client.1.smithi154.stdout:0/859: read d6/d27/f69 [674127,49188] 0 2024-05-06T21:26:54.154 INFO:tasks.workunit.client.1.smithi154.stdout:1/759: sync 2024-05-06T21:26:54.154 INFO:tasks.workunit.client.1.smithi154.stdout:1/760: readlink d6/db/d5e/ld4 0 2024-05-06T21:26:54.155 INFO:tasks.workunit.client.1.smithi154.stdout:6/553: creat d8/d13/d8f/fad x:0 0 0 2024-05-06T21:26:54.157 INFO:tasks.workunit.client.1.smithi154.stdout:3/887: mknod d0/da/d1a/d28/dbc/d117/c12f 0 2024-05-06T21:26:54.157 INFO:tasks.workunit.client.1.smithi154.stdout:3/888: truncate d0/da/d1a/d28/d17/f54 1308092 0 2024-05-06T21:26:54.158 INFO:tasks.workunit.client.1.smithi154.stdout:2/660: write db/de/f99 [3036065,26796] 0 2024-05-06T21:26:54.158 INFO:tasks.workunit.client.0.smithi032.stdout:2/903: dread df/d19/d1e/d71/d5f/d7d/d25/f60 [0,4194304] 0 2024-05-06T21:26:54.159 INFO:tasks.workunit.client.1.smithi154.stdout:0/860: creat d6/dc/d40/d4a/d6c/f11d x:0 0 0 2024-05-06T21:26:54.159 INFO:tasks.workunit.client.0.smithi032.stdout:2/904: mkdir df/dae/d12b/d12c 0 2024-05-06T21:26:54.160 INFO:tasks.workunit.client.0.smithi032.stdout:2/905: write df/d19/d1e/d35/dc5/d2e/d33/f17 [2604834,62429] 0 2024-05-06T21:26:54.160 INFO:tasks.workunit.client.0.smithi032.stdout:2/906: getdents df/d19/d1e/d71 0 2024-05-06T21:26:54.160 INFO:tasks.workunit.client.0.smithi032.stdout:2/907: unlink df/d19/d1e/d71/d5f/d7d/f92 0 2024-05-06T21:26:54.161 INFO:tasks.workunit.client.1.smithi154.stdout:8/727: getdents d3 0 2024-05-06T21:26:54.166 INFO:tasks.workunit.client.1.smithi154.stdout:3/889: getdents d0/da/d1a/d28/dbc/d117/d30 0 2024-05-06T21:26:54.167 INFO:tasks.workunit.client.1.smithi154.stdout:2/661: rmdir db/d12/d1d 39 2024-05-06T21:26:54.167 INFO:tasks.workunit.client.1.smithi154.stdout:4/757: sync 2024-05-06T21:26:54.168 INFO:tasks.workunit.client.1.smithi154.stdout:0/861: dread d6/dc/d3c/f7d [0,4194304] 0 2024-05-06T21:26:54.169 INFO:tasks.workunit.client.1.smithi154.stdout:6/554: rmdir d8/d11/d2d/d3d/d4c/d86 39 2024-05-06T21:26:54.171 INFO:tasks.workunit.client.1.smithi154.stdout:3/890: rmdir d0/dfa 39 2024-05-06T21:26:54.172 INFO:tasks.workunit.client.1.smithi154.stdout:2/662: link db/d12/d19/d4b/lcf db/de/d16/d4f/ld0 0 2024-05-06T21:26:54.174 INFO:tasks.workunit.client.1.smithi154.stdout:4/758: creat d0/d2/d29/d60/fff x:0 0 0 2024-05-06T21:26:54.175 INFO:tasks.workunit.client.1.smithi154.stdout:8/728: mkdir d3/d14/d1a/d29/d32/de8 0 2024-05-06T21:26:54.176 INFO:tasks.workunit.client.1.smithi154.stdout:0/862: creat d6/dc1/dd0/f11e x:0 0 0 2024-05-06T21:26:54.179 INFO:tasks.workunit.client.1.smithi154.stdout:4/759: creat d0/d82/d44/d73/d4a/d74/d75/f100 x:0 0 0 2024-05-06T21:26:54.179 INFO:tasks.workunit.client.1.smithi154.stdout:4/760: chown d0/d72/d76/db5/db7/df3 646904 1 2024-05-06T21:26:54.180 INFO:tasks.workunit.client.1.smithi154.stdout:4/761: write d0/d2/d47/fbe [71688,117569] 0 2024-05-06T21:26:54.180 INFO:tasks.workunit.client.1.smithi154.stdout:4/762: truncate d0/d82/d3d/dab/fcf 875987 0 2024-05-06T21:26:54.181 INFO:tasks.workunit.client.1.smithi154.stdout:8/729: unlink d3/d56/f80 0 2024-05-06T21:26:54.181 INFO:tasks.workunit.client.1.smithi154.stdout:8/730: write d3/d64/d6d/dbd/f23 [1367067,81520] 0 2024-05-06T21:26:54.201 INFO:tasks.workunit.client.1.smithi154.stdout:3/891: dread d0/da/d1a/d28/dbc/d117/dd/d1c/d41/fca [0,4194304] 0 2024-05-06T21:26:54.202 INFO:tasks.workunit.client.0.smithi032.stdout:2/908: rename df/d19/d1e/d35/dc5/d2e/d33/c7c to df/d19/d1e/c12d 0 2024-05-06T21:26:54.204 INFO:tasks.workunit.client.1.smithi154.stdout:3/892: unlink d0/da/d1a/d28/dbc/d117/dd/d1c/d21/fe2 0 2024-05-06T21:26:54.204 INFO:tasks.workunit.client.1.smithi154.stdout:3/893: truncate d0/da/d1a/d28/dbc/d117/d30/f3d 787865 0 2024-05-06T21:26:54.204 INFO:tasks.workunit.client.1.smithi154.stdout:3/894: chown d0/d2/c1f 9469832 1 2024-05-06T21:26:54.204 INFO:tasks.workunit.client.0.smithi032.stdout:2/909: symlink df/d19/d1e/d71/d5f/l12e 0 2024-05-06T21:26:54.209 INFO:tasks.workunit.client.1.smithi154.stdout:6/555: write d8/d13/f28 [4056554,16895] 0 2024-05-06T21:26:54.209 INFO:tasks.workunit.client.1.smithi154.stdout:6/556: fdatasync d8/fc 0 2024-05-06T21:26:54.210 INFO:tasks.workunit.client.1.smithi154.stdout:2/663: dread db/de/d16/f65 [0,4194304] 0 2024-05-06T21:26:54.211 INFO:tasks.workunit.client.1.smithi154.stdout:2/664: chown l7 201 1 2024-05-06T21:26:54.212 INFO:tasks.workunit.client.1.smithi154.stdout:2/665: symlink db/de/d10/dbc/ld1 0 2024-05-06T21:26:54.213 INFO:tasks.workunit.client.1.smithi154.stdout:2/666: creat db/de/d16/d4f/fd2 x:0 0 0 2024-05-06T21:26:54.213 INFO:tasks.workunit.client.1.smithi154.stdout:2/667: write db/d12/d19/d81/f8b [815280,111820] 0 2024-05-06T21:26:54.213 INFO:tasks.workunit.client.1.smithi154.stdout:2/668: rmdir db/d12/d1d/d60/d95 39 2024-05-06T21:26:54.220 INFO:tasks.workunit.client.1.smithi154.stdout:1/761: dwrite d6/db/d74/fab [0,4194304] 0 2024-05-06T21:26:54.220 INFO:tasks.workunit.client.1.smithi154.stdout:3/895: dread d0/da/d1a/d28/dbc/d117/dd/f3c [4194304,4194304] 0 2024-05-06T21:26:54.220 INFO:tasks.workunit.client.1.smithi154.stdout:3/896: chown d0/da/d1a/d28/dbc/d117/dd/d1c/d90/f12a 10709 1 2024-05-06T21:26:54.221 INFO:tasks.workunit.client.1.smithi154.stdout:8/731: dwrite d3/d14/d1a/d29/d32/d40/d79/d2b/fd7 [0,4194304] 0 2024-05-06T21:26:54.223 INFO:tasks.workunit.client.0.smithi032.stdout:2/910: read df/d19/d1e/d42/dc6/dc1/fdb [3942589,105510] 0 2024-05-06T21:26:54.224 INFO:tasks.workunit.client.0.smithi032.stdout:2/911: creat df/d19/d1e/d42/dc6/d11b/d11a/f12f x:0 0 0 2024-05-06T21:26:54.224 INFO:tasks.workunit.client.1.smithi154.stdout:1/762: unlink d6/db/d10/d26/d1b/c36 0 2024-05-06T21:26:54.233 INFO:tasks.workunit.client.1.smithi154.stdout:2/669: dwrite db/de/f1c [0,4194304] 0 2024-05-06T21:26:54.233 INFO:tasks.workunit.client.1.smithi154.stdout:2/670: truncate db/d12/d1d/d60/d63/f66 1289971 0 2024-05-06T21:26:54.235 INFO:tasks.workunit.client.1.smithi154.stdout:8/732: symlink d3/d14/d1a/d45/dcf/db4/le9 0 2024-05-06T21:26:54.236 INFO:tasks.workunit.client.1.smithi154.stdout:8/733: creat d3/d14/d1a/d29/d32/d40/d79/d84/da4/fea x:0 0 0 2024-05-06T21:26:54.236 INFO:tasks.workunit.client.1.smithi154.stdout:8/734: write d3/d14/f20 [909573,78336] 0 2024-05-06T21:26:54.236 INFO:tasks.workunit.client.0.smithi032.stdout:2/912: read df/d19/d1e/d35/dc5/d2e/f94 [4023775,99025] 0 2024-05-06T21:26:54.236 INFO:tasks.workunit.client.1.smithi154.stdout:1/763: mknod d6/db/d10/d15/d1d/ce9 0 2024-05-06T21:26:54.238 INFO:tasks.workunit.client.1.smithi154.stdout:2/671: symlink db/d12/d4e/d55/ld3 0 2024-05-06T21:26:54.239 INFO:tasks.workunit.client.1.smithi154.stdout:2/672: fdatasync db/de/f74 0 2024-05-06T21:26:54.242 INFO:tasks.workunit.client.1.smithi154.stdout:2/673: getdents db/d12/d19/d91 0 2024-05-06T21:26:54.242 INFO:tasks.workunit.client.1.smithi154.stdout:2/674: chown db/d12/d1d/d60/fa1 62046 1 2024-05-06T21:26:54.242 INFO:tasks.workunit.client.1.smithi154.stdout:2/675: truncate db/d12/d1d/fa7 344903 0 2024-05-06T21:26:54.242 INFO:tasks.workunit.client.1.smithi154.stdout:2/676: truncate db/d12/d4e/d55/fa0 232047 0 2024-05-06T21:26:54.243 INFO:tasks.workunit.client.1.smithi154.stdout:1/764: write d6/db/d10/d26/f6b [2530426,89672] 0 2024-05-06T21:26:54.245 INFO:tasks.workunit.client.1.smithi154.stdout:2/677: mkdir db/d12/d19/d4b/db2/dca/dd4 0 2024-05-06T21:26:54.246 INFO:tasks.workunit.client.0.smithi032.stdout:2/913: write df/d19/d1e/d42/dc6/dc1/fc8 [14723,115654] 0 2024-05-06T21:26:54.247 INFO:tasks.workunit.client.1.smithi154.stdout:8/735: dread d3/d14/d1a/d45/f7d [0,4194304] 0 2024-05-06T21:26:54.247 INFO:tasks.workunit.client.0.smithi032.stdout:2/914: creat df/d19/d1e/d71/d5f/d7d/d65/d78/f130 x:0 0 0 2024-05-06T21:26:54.248 INFO:tasks.workunit.client.0.smithi032.stdout:2/915: chown df/d19/d1e/d42/dc6/d11b/f110 7 1 2024-05-06T21:26:54.248 INFO:tasks.workunit.client.1.smithi154.stdout:2/678: unlink db/de/d16/l92 0 2024-05-06T21:26:54.248 INFO:tasks.workunit.client.1.smithi154.stdout:2/679: fdatasync db/d12/d19/d4b/fbe 0 2024-05-06T21:26:54.248 INFO:tasks.workunit.client.1.smithi154.stdout:2/680: fdatasync db/de/d16/f98 0 2024-05-06T21:26:54.249 INFO:tasks.workunit.client.0.smithi032.stdout:2/916: symlink df/d19/d1e/d71/d5f/d73/df1/d128/l131 0 2024-05-06T21:26:54.249 INFO:tasks.workunit.client.0.smithi032.stdout:2/917: truncate df/d19/d1e/d42/dc6/d11b/d11a/f129 885973 0 2024-05-06T21:26:54.256 INFO:tasks.workunit.client.1.smithi154.stdout:2/681: mknod db/d12/d4e/d55/cd5 0 2024-05-06T21:26:54.256 INFO:tasks.workunit.client.1.smithi154.stdout:2/682: creat db/de/d10/d18/fd6 x:0 0 0 2024-05-06T21:26:54.258 INFO:tasks.workunit.client.1.smithi154.stdout:2/683: mkdir db/d12/dbf/dd7 0 2024-05-06T21:26:54.264 INFO:tasks.workunit.client.1.smithi154.stdout:8/736: dwrite d3/d14/d1a/d45/f99 [4194304,4194304] 0 2024-05-06T21:26:54.264 INFO:tasks.workunit.client.1.smithi154.stdout:8/737: chown d3/d14/d1a/d29/d43/fa0 147269063 1 2024-05-06T21:26:54.265 INFO:tasks.workunit.client.0.smithi032.stdout:2/918: dwrite df/d19/d1e/d35/dc5/d2e/d33/f104 [0,4194304] 0 2024-05-06T21:26:54.266 INFO:tasks.workunit.client.1.smithi154.stdout:8/738: creat d3/d64/d6d/dbd/d61/feb x:0 0 0 2024-05-06T21:26:54.268 INFO:tasks.workunit.client.1.smithi154.stdout:7/580: sync 2024-05-06T21:26:54.270 INFO:tasks.workunit.client.1.smithi154.stdout:8/739: rename d3/d14/d1a/d29/d32/d40/d79/d2b/c85 to d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/dc1/cec 0 2024-05-06T21:26:54.274 INFO:tasks.workunit.client.1.smithi154.stdout:2/684: dwrite db/d12/d4e/d55/f5e [0,4194304] 0 2024-05-06T21:26:54.276 INFO:tasks.workunit.client.1.smithi154.stdout:7/581: mknod d6/d42/d6c/d6e/d21/d69/d7b/cbd 0 2024-05-06T21:26:54.276 INFO:tasks.workunit.client.1.smithi154.stdout:7/582: fsync d6/d42/d6c/f77 0 2024-05-06T21:26:54.278 INFO:tasks.workunit.client.0.smithi032.stdout:2/919: getdents df/dae/d12b 0 2024-05-06T21:26:54.278 INFO:tasks.workunit.client.1.smithi154.stdout:2/685: creat db/de/d16/fd8 x:0 0 0 2024-05-06T21:26:54.281 INFO:tasks.workunit.client.0.smithi032.stdout:2/920: creat df/d19/d1e/d71/d5f/d73/df1/d128/f132 x:0 0 0 2024-05-06T21:26:54.281 INFO:tasks.workunit.client.1.smithi154.stdout:2/686: rename db/d12/f43 to db/d12/d19/d7d/fd9 0 2024-05-06T21:26:54.282 INFO:tasks.workunit.client.1.smithi154.stdout:2/687: mknod db/de/cda 0 2024-05-06T21:26:54.286 INFO:tasks.workunit.client.1.smithi154.stdout:2/688: unlink db/de/d16/f3f 0 2024-05-06T21:26:54.286 INFO:tasks.workunit.client.1.smithi154.stdout:2/689: chown db/de/d6f/f93 1750702187 1 2024-05-06T21:26:54.287 INFO:tasks.workunit.client.1.smithi154.stdout:2/690: truncate db/de/d16/d4f/fd2 471117 0 2024-05-06T21:26:54.298 INFO:tasks.workunit.client.0.smithi032.stdout:2/921: dwrite df/d19/d1e/d71/d5f/d7d/d65/f85 [4194304,4194304] 0 2024-05-06T21:26:54.298 INFO:tasks.workunit.client.0.smithi032.stdout:2/922: chown df/d19/d1e/d35/dc5/d2e/d33/f104 99 1 2024-05-06T21:26:54.303 INFO:tasks.workunit.client.1.smithi154.stdout:7/583: dwrite d6/d42/d6c/d6e/da4/fbb [0,4194304] 0 2024-05-06T21:26:54.303 INFO:tasks.workunit.client.1.smithi154.stdout:7/584: fsync d6/fd 0 2024-05-06T21:26:54.306 INFO:tasks.workunit.client.1.smithi154.stdout:2/691: dwrite db/f13 [4194304,4194304] 0 2024-05-06T21:26:54.306 INFO:tasks.workunit.client.1.smithi154.stdout:2/692: creat db/d12/d4e/fdb x:0 0 0 2024-05-06T21:26:54.306 INFO:tasks.workunit.client.1.smithi154.stdout:2/693: dread - db/de/d10/d18/fa2 zero size 2024-05-06T21:26:54.307 INFO:tasks.workunit.client.1.smithi154.stdout:7/585: unlink d6/d42/d6c/d6e/d21/d2e/ca1 0 2024-05-06T21:26:54.309 INFO:tasks.workunit.client.1.smithi154.stdout:7/586: symlink d6/d20/lbe 0 2024-05-06T21:26:54.310 INFO:tasks.workunit.client.1.smithi154.stdout:2/694: dread db/d12/d1d/d60/d63/f66 [0,4194304] 0 2024-05-06T21:26:54.310 INFO:tasks.workunit.client.1.smithi154.stdout:7/587: getdents d6/d20/d85 0 2024-05-06T21:26:54.311 INFO:tasks.workunit.client.1.smithi154.stdout:7/588: write d6/fb [2835620,20017] 0 2024-05-06T21:26:54.311 INFO:tasks.workunit.client.0.smithi032.stdout:2/923: dwrite df/d19/d1e/d71/d5f/d7d/d65/dfc/f11d [0,4194304] 0 2024-05-06T21:26:54.313 INFO:tasks.workunit.client.1.smithi154.stdout:7/589: getdents d6/d42/d6c/d6e/d21 0 2024-05-06T21:26:54.322 INFO:tasks.workunit.client.0.smithi032.stdout:2/924: read df/d19/d1e/d35/dc5/f43 [4009539,57842] 0 2024-05-06T21:26:54.323 INFO:tasks.workunit.client.1.smithi154.stdout:7/590: dread d6/d42/d6c/d6e/d21/d69/f80 [0,4194304] 0 2024-05-06T21:26:54.323 INFO:tasks.workunit.client.1.smithi154.stdout:2/695: dwrite db/d12/d1d/d60/d63/f66 [0,4194304] 0 2024-05-06T21:26:54.323 INFO:tasks.workunit.client.1.smithi154.stdout:2/696: chown db/d12/d1d 3439 1 2024-05-06T21:26:54.324 INFO:tasks.workunit.client.0.smithi032.stdout:2/925: truncate df/fdf 2423207 0 2024-05-06T21:26:54.324 INFO:tasks.workunit.client.1.smithi154.stdout:7/591: symlink d6/d20/db1/dba/lbf 0 2024-05-06T21:26:54.325 INFO:tasks.workunit.client.0.smithi032.stdout:2/926: creat df/d19/d1e/d54/f133 x:0 0 0 2024-05-06T21:26:54.326 INFO:tasks.workunit.client.1.smithi154.stdout:2/697: mknod db/de/d16/dae/cdc 0 2024-05-06T21:26:54.326 INFO:tasks.workunit.client.0.smithi032.stdout:2/927: symlink df/d19/dbf/l134 0 2024-05-06T21:26:54.327 INFO:tasks.workunit.client.1.smithi154.stdout:7/592: creat d6/d20/d40/d52/d81/fc0 x:0 0 0 2024-05-06T21:26:54.329 INFO:tasks.workunit.client.1.smithi154.stdout:7/593: creat d6/d20/db1/fc1 x:0 0 0 2024-05-06T21:26:54.330 INFO:tasks.workunit.client.1.smithi154.stdout:7/594: chown d6/l53 71379048 1 2024-05-06T21:26:54.330 INFO:tasks.workunit.client.1.smithi154.stdout:7/595: mknod d6/d20/d85/cc2 0 2024-05-06T21:26:54.331 INFO:tasks.workunit.client.0.smithi032.stdout:2/928: dread df/d19/d1e/d35/dc5/f43 [0,4194304] 0 2024-05-06T21:26:54.331 INFO:tasks.workunit.client.0.smithi032.stdout:2/929: stat df/d19/d1e/d42/c11e 0 2024-05-06T21:26:54.333 INFO:tasks.workunit.client.0.smithi032.stdout:2/930: creat df/d19/d1e/d71/d5f/d7d/d25/f135 x:0 0 0 2024-05-06T21:26:54.333 INFO:tasks.workunit.client.0.smithi032.stdout:2/931: write df/f2c [3996180,113674] 0 2024-05-06T21:26:54.334 INFO:tasks.workunit.client.0.smithi032.stdout:2/932: mknod df/daf/df2/c136 0 2024-05-06T21:26:54.335 INFO:tasks.workunit.client.0.smithi032.stdout:2/933: link df/d19/d1e/d54/f6a df/d19/d1e/d35/dc5/d2e/d33/f137 0 2024-05-06T21:26:54.337 INFO:tasks.workunit.client.0.smithi032.stdout:2/934: rename df/d19/d1e/d35/d3f/fd2 to df/d19/d1e/d71/d5f/d7d/d65/d78/f138 0 2024-05-06T21:26:54.338 INFO:tasks.workunit.client.0.smithi032.stdout:2/935: mkdir df/d19/d1e/d35/dc5/d2e/d33/d139 0 2024-05-06T21:26:54.338 INFO:tasks.workunit.client.0.smithi032.stdout:2/936: chown df/d19/d1e/d71/f108 27837338 1 2024-05-06T21:26:54.339 INFO:tasks.workunit.client.1.smithi154.stdout:7/596: write d6/f3b [10659421,22078] 0 2024-05-06T21:26:54.339 INFO:tasks.workunit.client.0.smithi032.stdout:2/937: unlink df/d19/d1e/d42/dc6/fe9 0 2024-05-06T21:26:54.340 INFO:tasks.workunit.client.1.smithi154.stdout:7/597: symlink d6/d20/d40/d52/lc3 0 2024-05-06T21:26:54.340 INFO:tasks.workunit.client.1.smithi154.stdout:7/598: creat d6/d54/fc4 x:0 0 0 2024-05-06T21:26:54.340 INFO:tasks.workunit.client.0.smithi032.stdout:2/938: mknod df/d19/d1e/c13a 0 2024-05-06T21:26:54.341 INFO:tasks.workunit.client.0.smithi032.stdout:2/939: creat df/d19/d1e/d42/f13b x:0 0 0 2024-05-06T21:26:54.346 INFO:tasks.workunit.client.1.smithi154.stdout:9/818: sync 2024-05-06T21:26:54.349 INFO:tasks.workunit.client.1.smithi154.stdout:9/819: rename d5/d14/d31/d39 to d5/d20/d52/d114 0 2024-05-06T21:26:54.351 INFO:tasks.workunit.client.1.smithi154.stdout:9/820: truncate d5/f8 2443801 0 2024-05-06T21:26:54.356 INFO:tasks.workunit.client.1.smithi154.stdout:9/821: dread d5/f2a [0,4194304] 0 2024-05-06T21:26:54.357 INFO:tasks.workunit.client.1.smithi154.stdout:9/822: dread - d5/fab zero size 2024-05-06T21:26:54.357 INFO:tasks.workunit.client.1.smithi154.stdout:9/823: stat d5/d2e/da0/fb4 0 2024-05-06T21:26:54.358 INFO:tasks.workunit.client.1.smithi154.stdout:9/824: truncate d5/d20/d37/f5f 3504863 0 2024-05-06T21:26:54.360 INFO:tasks.workunit.client.1.smithi154.stdout:9/825: mknod d5/d2e/d8b/dc6/d103/c115 0 2024-05-06T21:26:54.363 INFO:tasks.workunit.client.1.smithi154.stdout:9/826: rmdir d5/d14/d3a 39 2024-05-06T21:26:54.365 INFO:tasks.workunit.client.1.smithi154.stdout:9/827: creat d5/d20/d37/dd5/f116 x:0 0 0 2024-05-06T21:26:54.367 INFO:tasks.workunit.client.0.smithi032.stdout:2/940: dwrite df/d19/d1e/d35/dc5/d2e/d33/f1d [0,4194304] 0 2024-05-06T21:26:54.368 INFO:tasks.workunit.client.1.smithi154.stdout:9/828: creat d5/d20/d52/d6e/d83/de5/f117 x:0 0 0 2024-05-06T21:26:54.368 INFO:tasks.workunit.client.1.smithi154.stdout:9/829: stat d5/d20/f2c 0 2024-05-06T21:26:54.368 INFO:tasks.workunit.client.1.smithi154.stdout:9/830: fsync d5/d20/d52/d6e/f9c 0 2024-05-06T21:26:54.368 INFO:tasks.workunit.client.1.smithi154.stdout:9/831: readlink d5/d14/l27 0 2024-05-06T21:26:54.368 INFO:tasks.workunit.client.1.smithi154.stdout:9/832: write d5/d20/d52/d114/fec [362741,56321] 0 2024-05-06T21:26:54.368 INFO:tasks.workunit.client.1.smithi154.stdout:9/833: read - d5/d20/d37/dd5/de1/de6/f109 zero size 2024-05-06T21:26:54.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:53 smithi154 ceph-mon[32880]: pgmap v27: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 324 MiB/s rd, 375 MiB/s wr, 689 op/s 2024-05-06T21:26:54.369 INFO:tasks.workunit.client.1.smithi154.stdout:9/834: rename d5/d14/d31/c70 to d5/d2e/d66/c118 0 2024-05-06T21:26:54.370 INFO:tasks.workunit.client.1.smithi154.stdout:9/835: mknod d5/d20/d52/d114/c119 0 2024-05-06T21:26:54.371 INFO:tasks.workunit.client.1.smithi154.stdout:9/836: write d5/d14/d31/fd3 [3485173,80148] 0 2024-05-06T21:26:54.371 INFO:tasks.workunit.client.1.smithi154.stdout:9/837: truncate d5/d20/d52/d6e/d83/fdb 617868 0 2024-05-06T21:26:54.372 INFO:tasks.workunit.client.1.smithi154.stdout:9/838: rmdir d5/d14/d3a/dd7 0 2024-05-06T21:26:54.374 INFO:tasks.workunit.client.1.smithi154.stdout:9/839: dread d5/d20/f23 [0,4194304] 0 2024-05-06T21:26:54.374 INFO:tasks.workunit.client.1.smithi154.stdout:9/840: fdatasync d5/d2e/d66/fbe 0 2024-05-06T21:26:54.375 INFO:tasks.workunit.client.1.smithi154.stdout:9/841: creat d5/d2e/d8b/dc6/d103/f11a x:0 0 0 2024-05-06T21:26:54.375 INFO:tasks.workunit.client.1.smithi154.stdout:9/842: chown d5/d20/d52/d6e/d104/db1/dba/ce0 1744771 1 2024-05-06T21:26:54.375 INFO:tasks.workunit.client.1.smithi154.stdout:9/843: write d5/f8 [2682969,31774] 0 2024-05-06T21:26:54.376 INFO:tasks.workunit.client.1.smithi154.stdout:9/844: stat d5/d14/l17 0 2024-05-06T21:26:54.377 INFO:tasks.workunit.client.0.smithi032.stdout:2/941: write df/d19/d1e/d54/f6a [1525337,53770] 0 2024-05-06T21:26:54.377 INFO:tasks.workunit.client.0.smithi032.stdout:2/942: chown df/d19/d1e/f99 432014 1 2024-05-06T21:26:54.378 INFO:tasks.workunit.client.1.smithi154.stdout:9/845: mkdir d5/d20/d52/d6e/d83/de5/d11b 0 2024-05-06T21:26:54.380 INFO:tasks.workunit.client.1.smithi154.stdout:4/763: sync 2024-05-06T21:26:54.380 INFO:tasks.workunit.client.1.smithi154.stdout:0/863: sync 2024-05-06T21:26:54.380 INFO:tasks.workunit.client.1.smithi154.stdout:5/715: sync 2024-05-06T21:26:54.380 INFO:tasks.workunit.client.1.smithi154.stdout:0/864: creat d6/dc1/dd0/f11f x:0 0 0 2024-05-06T21:26:54.383 INFO:tasks.workunit.client.1.smithi154.stdout:5/716: mkdir d2/d3/d19/d23/df9 0 2024-05-06T21:26:54.383 INFO:tasks.workunit.client.1.smithi154.stdout:5/717: readlink d2/laa 0 2024-05-06T21:26:54.383 INFO:tasks.workunit.client.0.smithi032.stdout:2/943: dread df/d19/d1e/f107 [0,4194304] 0 2024-05-06T21:26:54.384 INFO:tasks.workunit.client.0.smithi032.stdout:2/944: creat df/d19/d1e/d54/f13c x:0 0 0 2024-05-06T21:26:54.386 INFO:tasks.workunit.client.1.smithi154.stdout:4/764: rmdir d0/d82/d39 39 2024-05-06T21:26:54.386 INFO:tasks.workunit.client.1.smithi154.stdout:9/846: dread d5/d20/d52/d6e/f9b [0,4194304] 0 2024-05-06T21:26:54.387 INFO:tasks.workunit.client.1.smithi154.stdout:5/718: rename d2/d3/ca9 to d2/cfa 0 2024-05-06T21:26:54.387 INFO:tasks.workunit.client.1.smithi154.stdout:5/719: truncate d2/d3/d21/d95/dd/d2a/d54/d43/fec 1015997 0 2024-05-06T21:26:54.387 INFO:tasks.workunit.client.1.smithi154.stdout:5/720: readlink d2/led 0 2024-05-06T21:26:54.388 INFO:tasks.workunit.client.1.smithi154.stdout:5/721: mknod d2/d3/d21/d95/dc/d68/cfb 0 2024-05-06T21:26:54.388 INFO:tasks.workunit.client.1.smithi154.stdout:5/722: read d2/d3/d21/d95/f8c [4037085,59249] 0 2024-05-06T21:26:54.388 INFO:tasks.workunit.client.0.smithi032.stdout:2/945: dread df/d19/dbf/fd6 [0,4194304] 0 2024-05-06T21:26:54.388 INFO:tasks.workunit.client.0.smithi032.stdout:2/946: truncate df/d19/d1e/d42/dc6/d11b/f110 933472 0 2024-05-06T21:26:54.389 INFO:tasks.workunit.client.1.smithi154.stdout:9/847: mkdir d5/d11c 0 2024-05-06T21:26:54.389 INFO:tasks.workunit.client.1.smithi154.stdout:5/723: mknod d2/d3/d19/d23/df9/cfc 0 2024-05-06T21:26:54.389 INFO:tasks.workunit.client.1.smithi154.stdout:5/724: stat d2/d3/c47 0 2024-05-06T21:26:54.390 INFO:tasks.workunit.client.1.smithi154.stdout:9/848: dread d5/d20/d52/d6e/d83/fdb [0,4194304] 0 2024-05-06T21:26:54.390 INFO:tasks.workunit.client.1.smithi154.stdout:5/725: mkdir d2/d3/d19/d23/df9/dfd 0 2024-05-06T21:26:54.391 INFO:tasks.workunit.client.0.smithi032.stdout:2/947: getdents df/d19/d1e/d42/dc6/d11b/d11a 0 2024-05-06T21:26:54.392 INFO:tasks.workunit.client.1.smithi154.stdout:5/726: mknod d2/d3/d8b/cfe 0 2024-05-06T21:26:54.398 INFO:tasks.workunit.client.1.smithi154.stdout:0/865: dwrite d6/dc/d40/d4a/da7/d70/f7e [0,4194304] 0 2024-05-06T21:26:54.399 INFO:tasks.workunit.client.1.smithi154.stdout:4/765: write d0/d82/d39/f4b [1070873,57910] 0 2024-05-06T21:26:54.400 INFO:tasks.workunit.client.1.smithi154.stdout:0/866: getdents d6 0 2024-05-06T21:26:54.402 INFO:tasks.workunit.client.1.smithi154.stdout:4/766: rename d0/d2/fb to d0/d82/d44/de9/f101 0 2024-05-06T21:26:54.402 INFO:tasks.workunit.client.1.smithi154.stdout:0/867: mknod d6/dc/d51/d54/c120 0 2024-05-06T21:26:54.403 INFO:tasks.workunit.client.1.smithi154.stdout:4/767: creat d0/d82/d44/d73/f102 x:0 0 0 2024-05-06T21:26:54.404 INFO:tasks.workunit.client.1.smithi154.stdout:0/868: mkdir d6/dc/d40/d85/db2/dbb/dff/d121 0 2024-05-06T21:26:54.404 INFO:tasks.workunit.client.1.smithi154.stdout:9/849: dread d5/d20/d52/d114/fc3 [0,4194304] 0 2024-05-06T21:26:54.404 INFO:tasks.workunit.client.1.smithi154.stdout:0/869: dread - d6/dc/d40/d4a/d6c/f11d zero size 2024-05-06T21:26:54.404 INFO:tasks.workunit.client.1.smithi154.stdout:9/850: stat d5/d14 0 2024-05-06T21:26:54.404 INFO:tasks.workunit.client.1.smithi154.stdout:4/768: rename d0/d82/d44/d73/d4a/d74/dce/ced to d0/d72/c103 0 2024-05-06T21:26:54.405 INFO:tasks.workunit.client.1.smithi154.stdout:0/870: getdents d6/dc/d40/d4a/dac 0 2024-05-06T21:26:54.405 INFO:tasks.workunit.client.1.smithi154.stdout:0/871: chown d6/dc/d40/d85/db2/dbb 15 1 2024-05-06T21:26:54.414 INFO:tasks.workunit.client.1.smithi154.stdout:9/851: dread d5/d20/d37/dd5/de1/de6/ff4 [0,4194304] 0 2024-05-06T21:26:54.414 INFO:tasks.workunit.client.1.smithi154.stdout:4/769: write d0/d82/d44/d73/d4a/dd4/d1a/f28 [5702547,30754] 0 2024-05-06T21:26:54.415 INFO:tasks.workunit.client.1.smithi154.stdout:9/852: creat d5/d20/d84/f11d x:0 0 0 2024-05-06T21:26:54.416 INFO:tasks.workunit.client.1.smithi154.stdout:9/853: creat d5/d20/d52/f11e x:0 0 0 2024-05-06T21:26:54.417 INFO:tasks.workunit.client.1.smithi154.stdout:9/854: symlink d5/d14/daf/db8/l11f 0 2024-05-06T21:26:54.417 INFO:tasks.workunit.client.1.smithi154.stdout:9/855: chown d5/d20/d52/d6e/d83/de5/c10c 5 1 2024-05-06T21:26:54.417 INFO:tasks.workunit.client.1.smithi154.stdout:9/856: chown d5/d2e/d8b 228 1 2024-05-06T21:26:54.419 INFO:tasks.workunit.client.1.smithi154.stdout:9/857: unlink d5/d14/f82 0 2024-05-06T21:26:54.429 INFO:tasks.workunit.client.1.smithi154.stdout:5/727: dwrite d2/d3/d21/d95/dd/d2a/d54/d43/d73/fea [0,4194304] 0 2024-05-06T21:26:54.429 INFO:tasks.workunit.client.1.smithi154.stdout:5/728: write d2/d3/d21/d95/fde [943380,101055] 0 2024-05-06T21:26:54.429 INFO:tasks.workunit.client.1.smithi154.stdout:5/729: write d2/d3/d21/d95/dc/f66 [3014638,25949] 0 2024-05-06T21:26:54.439 INFO:tasks.workunit.client.1.smithi154.stdout:5/730: write d2/d3/d21/d95/dd/d2a/d54/d43/d73/f82 [633348,98202] 0 2024-05-06T21:26:54.439 INFO:tasks.workunit.client.1.smithi154.stdout:5/731: readlink d2/d3/d21/d95/dd/l1c 0 2024-05-06T21:26:54.441 INFO:tasks.workunit.client.0.smithi032.stdout:2/948: dwrite df/d19/d1e/d71/d5f/d73/fba [4194304,4194304] 0 2024-05-06T21:26:54.441 INFO:tasks.workunit.client.0.smithi032.stdout:2/949: write df/d19/d1e/d35/f41 [73723,19750] 0 2024-05-06T21:26:54.441 INFO:tasks.workunit.client.1.smithi154.stdout:0/872: dwrite d6/dc/d40/fcb [0,4194304] 0 2024-05-06T21:26:54.441 INFO:tasks.workunit.client.1.smithi154.stdout:9/858: dwrite d5/d20/d52/d6e/d83/de5/f117 [0,4194304] 0 2024-05-06T21:26:54.442 INFO:tasks.workunit.client.1.smithi154.stdout:9/859: write d5/f76 [1474609,65825] 0 2024-05-06T21:26:54.442 INFO:tasks.workunit.client.1.smithi154.stdout:9/860: chown d5/d20/ffa 31 1 2024-05-06T21:26:54.442 INFO:tasks.workunit.client.1.smithi154.stdout:9/861: chown d5/d2e/d8b/cde 15 1 2024-05-06T21:26:54.442 INFO:tasks.workunit.client.1.smithi154.stdout:5/732: symlink d2/d3/d21/d22/d25/d37/lff 0 2024-05-06T21:26:54.442 INFO:tasks.workunit.client.0.smithi032.stdout:2/950: symlink df/d19/d1e/d35/dc5/d2e/d33/d139/l13d 0 2024-05-06T21:26:54.443 INFO:tasks.workunit.client.0.smithi032.stdout:2/951: chown df/d19/d1e/d71/d5f/d7d/d65/f74 82136 1 2024-05-06T21:26:54.443 INFO:tasks.workunit.client.0.smithi032.stdout:2/952: mknod df/d19/d1e/d71/d5f/d7d/d65/d78/c13e 0 2024-05-06T21:26:54.443 INFO:tasks.workunit.client.1.smithi154.stdout:4/770: dwrite d0/d82/d44/d73/d4a/d74/d75/f100 [0,4194304] 0 2024-05-06T21:26:54.443 INFO:tasks.workunit.client.1.smithi154.stdout:4/771: chown d0/c1f 459 1 2024-05-06T21:26:54.445 INFO:tasks.workunit.client.0.smithi032.stdout:2/953: rename df/daf/fb5 to df/d19/d1e/d71/d5f/f13f 0 2024-05-06T21:26:54.452 INFO:tasks.workunit.client.1.smithi154.stdout:5/733: dread d2/d3/d19/d23/f84 [0,4194304] 0 2024-05-06T21:26:54.455 INFO:tasks.workunit.client.1.smithi154.stdout:9/862: dwrite d5/d14/f60 [4194304,4194304] 0 2024-05-06T21:26:54.455 INFO:tasks.workunit.client.1.smithi154.stdout:0/873: creat d6/dc/d40/d4a/d6c/d8a/f122 x:0 0 0 2024-05-06T21:26:54.458 INFO:tasks.workunit.client.0.smithi032.stdout:2/954: write df/d19/d1e/d35/ff3 [1239660,17494] 0 2024-05-06T21:26:54.461 INFO:tasks.workunit.client.0.smithi032.stdout:2/955: rename df/d19/fe6 to df/d19/d1e/d35/dc5/d9f/dc0/f140 0 2024-05-06T21:26:54.462 INFO:tasks.workunit.client.1.smithi154.stdout:4/772: mkdir d0/d72/d76/dbb/d104 0 2024-05-06T21:26:54.462 INFO:tasks.workunit.client.1.smithi154.stdout:4/773: chown d0/d82/c95 93968057 1 2024-05-06T21:26:54.463 INFO:tasks.workunit.client.0.smithi032.stdout:2/956: mkdir df/d19/d1e/d71/d5f/d7d/d25/d141 0 2024-05-06T21:26:54.463 INFO:tasks.workunit.client.0.smithi032.stdout:2/957: stat df/d19/d1e/d42/dc6 0 2024-05-06T21:26:54.466 INFO:tasks.workunit.client.1.smithi154.stdout:9/863: truncate d5/d2e/f55 1790885 0 2024-05-06T21:26:54.466 INFO:tasks.workunit.client.1.smithi154.stdout:9/864: chown d5/d2e/d66/fbe 1 1 2024-05-06T21:26:54.467 INFO:tasks.workunit.client.1.smithi154.stdout:9/865: creat d5/d20/d37/dd5/f120 x:0 0 0 2024-05-06T21:26:54.470 INFO:tasks.workunit.client.1.smithi154.stdout:4/774: unlink d0/d82/d44/d73/d4a/dd4/d1a/d50/c59 0 2024-05-06T21:26:54.472 INFO:tasks.workunit.client.1.smithi154.stdout:0/874: write d6/dc/d44/f6d [771105,26172] 0 2024-05-06T21:26:54.473 INFO:tasks.workunit.client.1.smithi154.stdout:9/866: rmdir d5/d2e 39 2024-05-06T21:26:54.474 INFO:tasks.workunit.client.1.smithi154.stdout:4/775: rmdir d0/d72/d76 39 2024-05-06T21:26:54.474 INFO:tasks.workunit.client.1.smithi154.stdout:4/776: chown d0/d2/d29/d8f/c91 1 1 2024-05-06T21:26:54.478 INFO:tasks.workunit.client.1.smithi154.stdout:0/875: rename d6/f3a to d6/dc/d40/d4a/f123 0 2024-05-06T21:26:54.480 INFO:tasks.workunit.client.0.smithi032.stdout:1/941: sync 2024-05-06T21:26:54.481 INFO:tasks.workunit.client.0.smithi032.stdout:0/994: sync 2024-05-06T21:26:54.481 INFO:tasks.workunit.client.0.smithi032.stdout:1/942: truncate db/d16/d46/d57/f12f 707820 0 2024-05-06T21:26:54.481 INFO:tasks.workunit.client.1.smithi154.stdout:6/557: sync 2024-05-06T21:26:54.481 INFO:tasks.workunit.client.1.smithi154.stdout:1/765: sync 2024-05-06T21:26:54.481 INFO:tasks.workunit.client.1.smithi154.stdout:1/766: write d6/db/d10/d15/f39 [3720098,74745] 0 2024-05-06T21:26:54.481 INFO:tasks.workunit.client.1.smithi154.stdout:3/897: sync 2024-05-06T21:26:54.481 INFO:tasks.workunit.client.1.smithi154.stdout:8/740: sync 2024-05-06T21:26:54.483 INFO:tasks.workunit.client.0.smithi032.stdout:0/995: rename d4/d3e/f10b to d4/da/d16/d33/d9e/dc9/dcb/f146 0 2024-05-06T21:26:54.484 INFO:tasks.workunit.client.1.smithi154.stdout:6/558: mknod d8/d11/d2d/d3d/d70/cae 0 2024-05-06T21:26:54.484 INFO:tasks.workunit.client.1.smithi154.stdout:6/559: write d8/d11/d2d/f47 [960362,91971] 0 2024-05-06T21:26:54.484 INFO:tasks.workunit.client.1.smithi154.stdout:6/560: stat d8/d11/d33/c40 0 2024-05-06T21:26:54.486 INFO:tasks.workunit.client.0.smithi032.stdout:1/943: creat db/dc8/de7/dfb/f132 x:0 0 0 2024-05-06T21:26:54.486 INFO:tasks.workunit.client.1.smithi154.stdout:1/767: getdents d6/db/d69/d89/dac 0 2024-05-06T21:26:54.487 INFO:tasks.workunit.client.1.smithi154.stdout:5/734: dwrite d2/d3/d21/d95/dd/d2a/d54/d43/f7b [0,4194304] 0 2024-05-06T21:26:54.487 INFO:tasks.workunit.client.1.smithi154.stdout:5/735: chown d2/d3/d21/d22/d25/c6a 106495693 1 2024-05-06T21:26:54.487 INFO:tasks.workunit.client.1.smithi154.stdout:5/736: truncate d2/d3/d21/d95/dc/d68/fe8 113949 0 2024-05-06T21:26:54.487 INFO:tasks.workunit.client.0.smithi032.stdout:1/944: creat db/d47/d4a/f133 x:0 0 0 2024-05-06T21:26:54.488 INFO:tasks.workunit.client.0.smithi032.stdout:2/958: dwrite df/d19/d1e/d71/d5f/ffb [0,4194304] 0 2024-05-06T21:26:54.489 INFO:tasks.workunit.client.1.smithi154.stdout:7/599: sync 2024-05-06T21:26:54.489 INFO:tasks.workunit.client.1.smithi154.stdout:2/698: sync 2024-05-06T21:26:54.489 INFO:tasks.workunit.client.1.smithi154.stdout:2/699: creat db/de/d16/d33/fdd x:0 0 0 2024-05-06T21:26:54.489 INFO:tasks.workunit.client.1.smithi154.stdout:2/700: fsync db/d12/f21 0 2024-05-06T21:26:54.489 INFO:tasks.workunit.client.1.smithi154.stdout:2/701: chown db/d12/d1d/d60/d95/lb3 113110 1 2024-05-06T21:26:54.489 INFO:tasks.workunit.client.1.smithi154.stdout:2/702: readlink db/d12/d1d/lb7 0 2024-05-06T21:26:54.489 INFO:tasks.workunit.client.1.smithi154.stdout:3/898: creat d0/da/d1a/d28/dbc/d117/dd/d1c/d41/d122/f130 x:0 0 0 2024-05-06T21:26:54.491 INFO:tasks.workunit.client.0.smithi032.stdout:1/945: link db/d37/d52/l104 db/d47/d4a/da4/d4f/l134 0 2024-05-06T21:26:54.493 INFO:tasks.workunit.client.0.smithi032.stdout:2/959: mknod df/dae/c142 0 2024-05-06T21:26:54.494 INFO:tasks.workunit.client.1.smithi154.stdout:6/561: mkdir d8/d13/d20/daf 0 2024-05-06T21:26:54.494 INFO:tasks.workunit.client.0.smithi032.stdout:2/960: mkdir df/d19/d1e/d35/dc5/d2e/d143 0 2024-05-06T21:26:54.495 INFO:tasks.workunit.client.0.smithi032.stdout:2/961: dread - df/d19/d1e/d35/dc5/d2e/dbe/fc4 zero size 2024-05-06T21:26:54.495 INFO:tasks.workunit.client.1.smithi154.stdout:8/741: dread d3/f54 [0,4194304] 0 2024-05-06T21:26:54.495 INFO:tasks.workunit.client.1.smithi154.stdout:8/742: readlink d3/l1c 0 2024-05-06T21:26:54.495 INFO:tasks.workunit.client.1.smithi154.stdout:8/743: write d3/d14/f19 [6579106,26006] 0 2024-05-06T21:26:54.496 INFO:tasks.workunit.client.1.smithi154.stdout:8/744: chown d3/d14/d1a/d29/d32/d40/d79/d2b/c48 173397854 1 2024-05-06T21:26:54.496 INFO:tasks.workunit.client.1.smithi154.stdout:7/600: mkdir d6/d54/d5b/dc5 0 2024-05-06T21:26:54.498 INFO:tasks.workunit.client.1.smithi154.stdout:9/867: dwrite d5/d14/d31/f40 [0,4194304] 0 2024-05-06T21:26:54.498 INFO:tasks.workunit.client.1.smithi154.stdout:9/868: chown d5/d14/d3a/c98 205911 1 2024-05-06T21:26:54.499 INFO:tasks.workunit.client.1.smithi154.stdout:4/777: dwrite d0/d2/d47/fbf [0,4194304] 0 2024-05-06T21:26:54.501 INFO:tasks.workunit.client.1.smithi154.stdout:3/899: creat d0/da/d1a/d28/dbc/d117/d52/f131 x:0 0 0 2024-05-06T21:26:54.501 INFO:tasks.workunit.client.1.smithi154.stdout:3/900: fdatasync d0/da/d1a/d28/d17/f54 0 2024-05-06T21:26:54.505 INFO:tasks.workunit.client.1.smithi154.stdout:6/562: link d8/d11/d33/f8c d8/d13/fb0 0 2024-05-06T21:26:54.505 INFO:tasks.workunit.client.1.smithi154.stdout:6/563: chown d8/d11/d2d/d3d/d70/cae 28 1 2024-05-06T21:26:54.505 INFO:tasks.workunit.client.1.smithi154.stdout:6/564: getdents d8/d11/d33/d4a 0 2024-05-06T21:26:54.505 INFO:tasks.workunit.client.1.smithi154.stdout:6/565: creat d8/d11/d33/d4a/d6c/fb1 x:0 0 0 2024-05-06T21:26:54.508 INFO:tasks.workunit.client.1.smithi154.stdout:8/745: creat d3/d14/d1a/d29/d32/d40/d59/d67/fed x:0 0 0 2024-05-06T21:26:54.509 INFO:tasks.workunit.client.1.smithi154.stdout:2/703: read f0 [4742152,88798] 0 2024-05-06T21:26:54.509 INFO:tasks.workunit.client.1.smithi154.stdout:7/601: stat d6/c72 0 2024-05-06T21:26:54.511 INFO:tasks.workunit.client.1.smithi154.stdout:9/869: mknod d5/d2e/d8b/dc6/c121 0 2024-05-06T21:26:54.520 INFO:tasks.workunit.client.1.smithi154.stdout:6/566: creat d8/d11/d2d/d3d/fb2 x:0 0 0 2024-05-06T21:26:54.522 INFO:tasks.workunit.client.1.smithi154.stdout:2/704: creat db/de/d10/fde x:0 0 0 2024-05-06T21:26:54.522 INFO:tasks.workunit.client.1.smithi154.stdout:9/870: write d5/d14/d31/f40 [1850105,7787] 0 2024-05-06T21:26:54.522 INFO:tasks.workunit.client.1.smithi154.stdout:7/602: mknod d6/d20/d40/daf/d5c/cc6 0 2024-05-06T21:26:54.522 INFO:tasks.workunit.client.1.smithi154.stdout:7/603: write d6/d20/d40/d52/d81/fc0 [131874,67249] 0 2024-05-06T21:26:54.523 INFO:tasks.workunit.client.1.smithi154.stdout:6/567: creat d8/d11/d33/fb3 x:0 0 0 2024-05-06T21:26:54.524 INFO:tasks.workunit.client.1.smithi154.stdout:2/705: symlink db/de/d10/dbc/ldf 0 2024-05-06T21:26:54.524 INFO:tasks.workunit.client.1.smithi154.stdout:2/706: dread - db/de/d10/dbc/fc6 zero size 2024-05-06T21:26:54.524 INFO:tasks.workunit.client.1.smithi154.stdout:7/604: creat d6/d54/d5b/dc5/fc7 x:0 0 0 2024-05-06T21:26:54.526 INFO:tasks.workunit.client.1.smithi154.stdout:2/707: rmdir db/d12/d19/d4b/db2/dca/dd4 0 2024-05-06T21:26:54.526 INFO:tasks.workunit.client.1.smithi154.stdout:2/708: dread - db/d12/d1d/d60/fbb zero size 2024-05-06T21:26:54.527 INFO:tasks.workunit.client.1.smithi154.stdout:7/605: getdents d6/d20/d85 0 2024-05-06T21:26:54.531 INFO:tasks.workunit.client.1.smithi154.stdout:7/606: getdents d6/d42/d6c/d6e/d21/d2e 0 2024-05-06T21:26:54.538 INFO:tasks.workunit.client.0.smithi032.stdout:2/962: dwrite df/f8b [0,4194304] 0 2024-05-06T21:26:54.540 INFO:tasks.workunit.client.0.smithi032.stdout:1/946: dwrite db/d37/d93/dce/df4/d127/ff7 [0,4194304] 0 2024-05-06T21:26:54.553 INFO:tasks.workunit.client.1.smithi154.stdout:5/737: dwrite d2/d3/d21/d95/dc/d71/f75 [0,4194304] 0 2024-05-06T21:26:54.556 INFO:tasks.workunit.client.1.smithi154.stdout:5/738: mkdir d2/d3/d19/d23/d100 0 2024-05-06T21:26:54.559 INFO:tasks.workunit.client.1.smithi154.stdout:5/739: rename d2/d3/d21/d95/dc/d44/c55 to d2/d3/d21/d95/dc/d68/c101 0 2024-05-06T21:26:54.559 INFO:tasks.workunit.client.1.smithi154.stdout:5/740: creat d2/da5/f102 x:0 0 0 2024-05-06T21:26:54.561 INFO:tasks.workunit.client.1.smithi154.stdout:5/741: symlink d2/d3/d19/d23/d100/l103 0 2024-05-06T21:26:54.561 INFO:tasks.workunit.client.1.smithi154.stdout:5/742: stat d2/d3/d19/d23/f78 0 2024-05-06T21:26:54.562 INFO:tasks.workunit.client.1.smithi154.stdout:5/743: rmdir d2/d3/d21/d95/dc/d44 39 2024-05-06T21:26:54.562 INFO:tasks.workunit.client.1.smithi154.stdout:5/744: dread - d2/d3/d21/d95/dc/d44/dc0/fd9 zero size 2024-05-06T21:26:54.565 INFO:tasks.workunit.client.1.smithi154.stdout:5/745: rename d2/d3/d19/d23/f9b to d2/d48/f104 0 2024-05-06T21:26:54.567 INFO:tasks.workunit.client.1.smithi154.stdout:2/709: dwrite db/d12/d19/d7d/db1/fb4 [0,4194304] 0 2024-05-06T21:26:54.567 INFO:tasks.workunit.client.1.smithi154.stdout:3/901: dwrite d0/da/d1a/d28/dbc/d81/d48/da9/fe4 [0,4194304] 0 2024-05-06T21:26:54.568 INFO:tasks.workunit.client.1.smithi154.stdout:9/871: dwrite d5/fab [0,4194304] 0 2024-05-06T21:26:54.568 INFO:tasks.workunit.client.1.smithi154.stdout:9/872: truncate d5/d20/d37/dd5/de1/de6/f109 994164 0 2024-05-06T21:26:54.568 INFO:tasks.workunit.client.1.smithi154.stdout:8/746: dwrite d3/f7a [0,4194304] 0 2024-05-06T21:26:54.568 INFO:tasks.workunit.client.1.smithi154.stdout:8/747: write d3/d14/d1a/d29/d32/d40/d79/f88 [2829939,59833] 0 2024-05-06T21:26:54.569 INFO:tasks.workunit.client.0.smithi032.stdout:2/963: dwrite fe [0,4194304] 0 2024-05-06T21:26:54.569 INFO:tasks.workunit.client.0.smithi032.stdout:2/964: read df/d19/d1e/d35/dc5/d2e/f94 [2049566,71151] 0 2024-05-06T21:26:54.570 INFO:tasks.workunit.client.1.smithi154.stdout:7/607: dwrite d6/d42/d6c/d6e/d21/d2e/fb5 [0,4194304] 0 2024-05-06T21:26:54.570 INFO:tasks.workunit.client.1.smithi154.stdout:9/873: dread d5/d14/daf/db8/fc5 [0,4194304] 0 2024-05-06T21:26:54.572 INFO:tasks.workunit.client.1.smithi154.stdout:3/902: rmdir d0/da/d1a/d28/dbc/d81/d9c 39 2024-05-06T21:26:54.576 INFO:tasks.workunit.client.1.smithi154.stdout:5/746: dread d2/d3/d21/d95/dc/f30 [0,4194304] 0 2024-05-06T21:26:54.577 INFO:tasks.workunit.client.0.smithi032.stdout:2/965: rmdir df/d19/d1e/d42/dc6/dc1/d10e 0 2024-05-06T21:26:54.577 INFO:tasks.workunit.client.1.smithi154.stdout:7/608: symlink d6/lc8 0 2024-05-06T21:26:54.577 INFO:tasks.workunit.client.1.smithi154.stdout:7/609: readlink d6/d20/db1/dba/lbf 0 2024-05-06T21:26:54.578 INFO:tasks.workunit.client.1.smithi154.stdout:9/874: creat d5/f122 x:0 0 0 2024-05-06T21:26:54.579 INFO:tasks.workunit.client.1.smithi154.stdout:9/875: chown d5/d2e/d8b/dc6/c121 3 1 2024-05-06T21:26:54.579 INFO:tasks.workunit.client.0.smithi032.stdout:2/966: dread df/d19/d1e/d42/dc6/f91 [0,4194304] 0 2024-05-06T21:26:54.580 INFO:tasks.workunit.client.0.smithi032.stdout:2/967: fsync df/d19/d1e/d42/dc6/d11b/ff6 0 2024-05-06T21:26:54.581 INFO:tasks.workunit.client.1.smithi154.stdout:9/876: creat d5/d14/d87/f123 x:0 0 0 2024-05-06T21:26:54.581 INFO:tasks.workunit.client.1.smithi154.stdout:9/877: chown d5/d2e/d8b/dc6/d103/f11a 24 1 2024-05-06T21:26:54.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/878: dread d5/d20/d52/d114/fec [0,4194304] 0 2024-05-06T21:26:54.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/879: truncate d5/d20/d37/f5b 2586236 0 2024-05-06T21:26:54.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/880: chown d5/d20/l2b 834 1 2024-05-06T21:26:54.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/881: stat d5/d20/d37 0 2024-05-06T21:26:54.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/882: creat d5/d20/d52/d59/f124 x:0 0 0 2024-05-06T21:26:54.584 INFO:tasks.workunit.client.1.smithi154.stdout:9/883: fsync d5/d20/d37/f38 0 2024-05-06T21:26:54.586 INFO:tasks.workunit.client.1.smithi154.stdout:9/884: stat d5/d20/d52/d59/d102/l111 0 2024-05-06T21:26:54.589 INFO:tasks.workunit.client.1.smithi154.stdout:7/610: read d6/f32 [3759640,115332] 0 2024-05-06T21:26:54.593 INFO:tasks.workunit.client.1.smithi154.stdout:7/611: rename d6/fa5 to d6/d42/d6c/d6e/d21/d2e/d9d/fc9 0 2024-05-06T21:26:54.593 INFO:tasks.workunit.client.1.smithi154.stdout:7/612: write d6/f7d [5191435,91058] 0 2024-05-06T21:26:54.593 INFO:tasks.workunit.client.1.smithi154.stdout:7/613: write d6/d42/d6c/d6e/d23/fbc [593379,38480] 0 2024-05-06T21:26:54.593 INFO:tasks.workunit.client.1.smithi154.stdout:7/614: dread - d6/d42/d6c/d6e/d21/d2e/d9d/fc9 zero size 2024-05-06T21:26:54.593 INFO:tasks.workunit.client.1.smithi154.stdout:3/903: dwrite d0/da/d1a/fe3 [4194304,4194304] 0 2024-05-06T21:26:54.595 INFO:tasks.workunit.client.1.smithi154.stdout:7/615: rmdir d6/d20/db1/dba 39 2024-05-06T21:26:54.596 INFO:tasks.workunit.client.0.smithi032.stdout:2/968: dread df/d19/d1e/d35/dc5/d9f/fa1 [0,4194304] 0 2024-05-06T21:26:54.597 INFO:tasks.workunit.client.1.smithi154.stdout:2/710: dwrite db/de/d16/d33/fc0 [0,4194304] 0 2024-05-06T21:26:54.598 INFO:tasks.workunit.client.0.smithi032.stdout:2/969: creat df/dae/f144 x:0 0 0 2024-05-06T21:26:54.598 INFO:tasks.workunit.client.0.smithi032.stdout:2/970: stat df/d19/d1e/d71/d5f/d7d/d65/dfc 0 2024-05-06T21:26:54.598 INFO:tasks.workunit.client.1.smithi154.stdout:5/747: dwrite d2/d3/d21/fa2 [4194304,4194304] 0 2024-05-06T21:26:54.598 INFO:tasks.workunit.client.1.smithi154.stdout:3/904: creat d0/da/d1a/d28/dbc/d81/d48/da9/f132 x:0 0 0 2024-05-06T21:26:54.599 INFO:tasks.workunit.client.1.smithi154.stdout:2/711: dread db/de/f74 [0,4194304] 0 2024-05-06T21:26:54.600 INFO:tasks.workunit.client.0.smithi032.stdout:2/971: link df/d19/d1e/d35/dc5/d2e/d33/f27 df/d19/d1e/d71/d5f/d73/df1/f145 0 2024-05-06T21:26:54.600 INFO:tasks.workunit.client.1.smithi154.stdout:7/616: unlink d6/d20/d40/d52/d81/l94 0 2024-05-06T21:26:54.600 INFO:tasks.workunit.client.1.smithi154.stdout:7/617: fdatasync d6/d42/d6c/d6e/d23/f6f 0 2024-05-06T21:26:54.601 INFO:tasks.workunit.client.0.smithi032.stdout:2/972: truncate df/d19/d1e/d54/fb8 3999958 0 2024-05-06T21:26:54.601 INFO:tasks.workunit.client.0.smithi032.stdout:2/973: rmdir df/d19/d1e/d71 39 2024-05-06T21:26:54.605 INFO:tasks.workunit.client.1.smithi154.stdout:5/748: mknod d2/d3/d21/d22/d25/d37/c105 0 2024-05-06T21:26:54.607 INFO:tasks.workunit.client.1.smithi154.stdout:9/885: dwrite d5/d20/f24 [0,4194304] 0 2024-05-06T21:26:54.608 INFO:tasks.workunit.client.1.smithi154.stdout:3/905: symlink d0/da/d1a/d28/dbc/d117/dd/d1c/d90/de1/l133 0 2024-05-06T21:26:54.608 INFO:tasks.workunit.client.1.smithi154.stdout:3/906: chown d0/da/d1a/d28/f111 20429273 1 2024-05-06T21:26:54.608 INFO:tasks.workunit.client.1.smithi154.stdout:3/907: readlink d0/l4c 0 2024-05-06T21:26:54.608 INFO:tasks.workunit.client.1.smithi154.stdout:3/908: chown d0/da/d1a/d28/dbc/d117/d52/d62/c78 10167 1 2024-05-06T21:26:54.610 INFO:tasks.workunit.client.1.smithi154.stdout:2/712: rename db/de/d16/d4f/c42 to db/d12/d1d/dcc/ce0 0 2024-05-06T21:26:54.611 INFO:tasks.workunit.client.1.smithi154.stdout:7/618: symlink d6/d42/lca 0 2024-05-06T21:26:54.616 INFO:tasks.workunit.client.1.smithi154.stdout:5/749: unlink d2/d3/d21/l90 0 2024-05-06T21:26:54.617 INFO:tasks.workunit.client.1.smithi154.stdout:5/750: stat d2/f1a 0 2024-05-06T21:26:54.618 INFO:tasks.workunit.client.1.smithi154.stdout:2/713: dread db/de/f1c [0,4194304] 0 2024-05-06T21:26:54.619 INFO:tasks.workunit.client.0.smithi032.stdout:2/974: dwrite df/d19/d1e/d71/d5f/f105 [0,4194304] 0 2024-05-06T21:26:54.619 INFO:tasks.workunit.client.0.smithi032.stdout:2/975: fsync df/d19/d1e/d35/fa0 0 2024-05-06T21:26:54.623 INFO:tasks.workunit.client.1.smithi154.stdout:9/886: write d5/d20/ffa [2597467,126955] 0 2024-05-06T21:26:54.623 INFO:tasks.workunit.client.1.smithi154.stdout:9/887: chown d5/d14/d31/fd3 49600418 1 2024-05-06T21:26:54.624 INFO:tasks.workunit.client.1.smithi154.stdout:5/751: dread d2/d3/d21/d95/dd/d2a/d54/d43/ff2 [0,4194304] 0 2024-05-06T21:26:54.626 INFO:tasks.workunit.client.1.smithi154.stdout:9/888: mknod d5/d14/daf/c125 0 2024-05-06T21:26:54.626 INFO:tasks.workunit.client.1.smithi154.stdout:9/889: readlink d5/dca/l10b 0 2024-05-06T21:26:54.627 INFO:tasks.workunit.client.1.smithi154.stdout:9/890: truncate d5/f8 2030244 0 2024-05-06T21:26:54.629 INFO:tasks.workunit.client.0.smithi032.stdout:2/976: dread df/d19/d1e/d71/d5f/d7d/d65/d78/f138 [0,4194304] 0 2024-05-06T21:26:54.630 INFO:tasks.workunit.client.1.smithi154.stdout:3/909: dwrite d0/da/d1a/d28/dbc/d117/dd/d1c/d21/f12d [0,4194304] 0 2024-05-06T21:26:54.631 INFO:tasks.workunit.client.1.smithi154.stdout:9/891: rmdir d5/dca/dfd 0 2024-05-06T21:26:54.637 INFO:tasks.workunit.client.1.smithi154.stdout:7/619: dwrite d6/d42/d6c/d6e/f76 [0,4194304] 0 2024-05-06T21:26:54.640 INFO:tasks.workunit.client.0.smithi032.stdout:2/977: dread df/d19/d1e/d35/fd4 [0,4194304] 0 2024-05-06T21:26:54.644 INFO:tasks.workunit.client.0.smithi032.stdout:2/978: dread df/d19/d1e/d71/d5f/f80 [0,4194304] 0 2024-05-06T21:26:54.646 INFO:tasks.workunit.client.0.smithi032.stdout:2/979: mknod df/d19/d1e/d35/dc5/d2e/d103/c146 0 2024-05-06T21:26:54.648 INFO:tasks.workunit.client.0.smithi032.stdout:2/980: symlink df/daf/df2/l147 0 2024-05-06T21:26:54.648 INFO:tasks.workunit.client.0.smithi032.stdout:2/981: fdatasync df/d19/d1e/f107 0 2024-05-06T21:26:54.648 INFO:tasks.workunit.client.0.smithi032.stdout:2/982: chown df/d19/d1e/d42/dc6/dc1/c10a 544 1 2024-05-06T21:26:54.649 INFO:tasks.workunit.client.0.smithi032.stdout:2/983: dread - df/d19/d1e/d71/d5f/f13f zero size 2024-05-06T21:26:54.649 INFO:tasks.workunit.client.1.smithi154.stdout:5/752: write d2/d3/d21/d22/f2e [1185555,84808] 0 2024-05-06T21:26:54.649 INFO:tasks.workunit.client.1.smithi154.stdout:2/714: dwrite db/d12/d1d/d60/d63/f70 [0,4194304] 0 2024-05-06T21:26:54.649 INFO:tasks.workunit.client.1.smithi154.stdout:2/715: fsync db/de/d16/f1f 0 2024-05-06T21:26:54.649 INFO:tasks.workunit.client.1.smithi154.stdout:5/753: fsync d2/d3/d21/d95/dd/fad 0 2024-05-06T21:26:54.649 INFO:tasks.workunit.client.1.smithi154.stdout:2/716: write db/d12/d4e/d55/fa0 [448168,111740] 0 2024-05-06T21:26:54.649 INFO:tasks.workunit.client.1.smithi154.stdout:5/754: write d2/f4c [516757,90879] 0 2024-05-06T21:26:54.651 INFO:tasks.workunit.client.0.smithi032.stdout:2/984: mkdir df/d19/d1e/d71/d5f/d73/df1/d148 0 2024-05-06T21:26:54.651 INFO:tasks.workunit.client.1.smithi154.stdout:7/620: dread d6/d42/d6c/d6e/d23/f28 [0,4194304] 0 2024-05-06T21:26:54.653 INFO:tasks.workunit.client.0.smithi032.stdout:2/985: rename df/d19/d1e/d35/dc5/d2e/d33/l114 to df/d19/d1e/d35/dc5/d2e/dbc/de3/l149 0 2024-05-06T21:26:54.655 INFO:tasks.workunit.client.1.smithi154.stdout:2/717: rename db/de/d16/d33/l58 to db/d12/d19/d4b/le1 0 2024-05-06T21:26:54.657 INFO:tasks.workunit.client.1.smithi154.stdout:0/876: sync 2024-05-06T21:26:54.657 INFO:tasks.workunit.client.1.smithi154.stdout:5/755: truncate d2/d3/d21/d95/dd/d2a/d8d/fcf 591551 0 2024-05-06T21:26:54.657 INFO:tasks.workunit.client.1.smithi154.stdout:5/756: fdatasync d2/d3/d21/fa2 0 2024-05-06T21:26:54.658 INFO:tasks.workunit.client.1.smithi154.stdout:5/757: chown d2/d3/d21/d95/dc/d44/dc0 46 1 2024-05-06T21:26:54.658 INFO:tasks.workunit.client.1.smithi154.stdout:7/621: rmdir d6/d54/d5b 39 2024-05-06T21:26:54.660 INFO:tasks.workunit.client.1.smithi154.stdout:2/718: mkdir db/d12/d1d/d60/d63/de2 0 2024-05-06T21:26:54.662 INFO:tasks.workunit.client.1.smithi154.stdout:0/877: mknod d6/dc/d40/d4a/da7/d70/d96/dd5/c124 0 2024-05-06T21:26:54.664 INFO:tasks.workunit.client.0.smithi032.stdout:2/986: write df/d19/d1e/d35/fa0 [3063458,103872] 0 2024-05-06T21:26:54.664 INFO:tasks.workunit.client.1.smithi154.stdout:7/622: creat d6/d42/d6c/d6e/d21/d2e/fcb x:0 0 0 2024-05-06T21:26:54.664 INFO:tasks.workunit.client.1.smithi154.stdout:7/623: fdatasync d6/d42/d6c/d6e/d21/d2e/fb5 0 2024-05-06T21:26:54.665 INFO:tasks.workunit.client.1.smithi154.stdout:2/719: rmdir db/d12/d19/d81 39 2024-05-06T21:26:54.665 INFO:tasks.workunit.client.1.smithi154.stdout:2/720: symlink db/d12/d1d/d60/d63/de2/le3 0 2024-05-06T21:26:54.667 INFO:tasks.workunit.client.1.smithi154.stdout:2/721: creat db/d86/fe4 x:0 0 0 2024-05-06T21:26:54.667 INFO:tasks.workunit.client.1.smithi154.stdout:2/722: fdatasync db/f3c 0 2024-05-06T21:26:54.667 INFO:tasks.workunit.client.1.smithi154.stdout:2/723: chown db/de/f74 9582069 1 2024-05-06T21:26:54.667 INFO:tasks.workunit.client.1.smithi154.stdout:2/724: write db/d12/d1d/d60/fbb [452653,27871] 0 2024-05-06T21:26:54.667 INFO:tasks.workunit.client.1.smithi154.stdout:2/725: truncate db/de/d16/d33/fdd 38654 0 2024-05-06T21:26:54.669 INFO:tasks.workunit.client.1.smithi154.stdout:2/726: symlink db/d12/dbf/dd7/le5 0 2024-05-06T21:26:54.670 INFO:tasks.workunit.client.1.smithi154.stdout:3/910: dwrite d0/da/d1a/d28/dbc/d117/dd/d1c/d21/f60 [4194304,4194304] 0 2024-05-06T21:26:54.670 INFO:tasks.workunit.client.1.smithi154.stdout:3/911: truncate d0/f50 831393 0 2024-05-06T21:26:54.671 INFO:tasks.workunit.client.1.smithi154.stdout:3/912: write d0/d2/d22/ff7 [922845,111682] 0 2024-05-06T21:26:54.671 INFO:tasks.workunit.client.1.smithi154.stdout:9/892: dwrite d5/d20/d52/d114/fec [0,4194304] 0 2024-05-06T21:26:54.671 INFO:tasks.workunit.client.1.smithi154.stdout:2/727: creat db/d12/d19/d7d/fe6 x:0 0 0 2024-05-06T21:26:54.679 INFO:tasks.workunit.client.1.smithi154.stdout:0/878: write d6/dc/d44/d36/f4d [5628356,36625] 0 2024-05-06T21:26:54.685 INFO:tasks.workunit.client.1.smithi154.stdout:3/913: write d0/da/d1a/d28/dbc/d117/f2a [1858262,11935] 0 2024-05-06T21:26:54.685 INFO:tasks.workunit.client.1.smithi154.stdout:3/914: dread - d0/da/d1a/d28/dbc/d81/d48/da9/db3/f115 zero size 2024-05-06T21:26:54.685 INFO:tasks.workunit.client.1.smithi154.stdout:3/915: readlink d0/da/d1a/d28/dbc/d81/l3a 0 2024-05-06T21:26:54.685 INFO:tasks.workunit.client.1.smithi154.stdout:3/916: write d0/da/d1a/d28/dbc/d117/dd/f53 [441085,33671] 0 2024-05-06T21:26:54.685 INFO:tasks.workunit.client.1.smithi154.stdout:3/917: chown d0/da/d1a/d28/dbc/d117/l9e 26395 1 2024-05-06T21:26:54.685 INFO:tasks.workunit.client.1.smithi154.stdout:3/918: chown d0/da/d1a/d28/dbc/d81/d48/f65 597262 1 2024-05-06T21:26:54.686 INFO:tasks.workunit.client.1.smithi154.stdout:3/919: creat d0/da/d1a/d28/dbc/d81/d48/da9/d12c/f134 x:0 0 0 2024-05-06T21:26:54.686 INFO:tasks.workunit.client.1.smithi154.stdout:3/920: dread - d0/da/d1a/d28/dbc/d117/d52/f9f zero size 2024-05-06T21:26:54.687 INFO:tasks.workunit.client.1.smithi154.stdout:9/893: dread d5/d14/d87/d65/fa6 [0,4194304] 0 2024-05-06T21:26:54.687 INFO:tasks.workunit.client.1.smithi154.stdout:3/921: creat d0/da/d1a/d28/dbc/d117/dd/d1c/d41/f135 x:0 0 0 2024-05-06T21:26:54.687 INFO:tasks.workunit.client.1.smithi154.stdout:9/894: creat d5/d20/d52/d6e/d104/db1/dba/f126 x:0 0 0 2024-05-06T21:26:54.688 INFO:tasks.workunit.client.1.smithi154.stdout:3/922: truncate d0/da/d1a/d28/dbc/f9b 538844 0 2024-05-06T21:26:54.690 INFO:tasks.workunit.client.1.smithi154.stdout:3/923: creat d0/da/d1a/d28/d17/db0/d76/f136 x:0 0 0 2024-05-06T21:26:54.711 INFO:tasks.workunit.client.1.smithi154.stdout:7/624: dwrite d6/d54/d5b/d82/f86 [0,4194304] 0 2024-05-06T21:26:54.711 INFO:tasks.workunit.client.1.smithi154.stdout:7/625: creat d6/d54/fcc x:0 0 0 2024-05-06T21:26:54.712 INFO:tasks.workunit.client.0.smithi032.stdout:2/987: dwrite df/d19/d1e/d35/ffa [4194304,4194304] 0 2024-05-06T21:26:54.712 INFO:tasks.workunit.client.1.smithi154.stdout:5/758: dwrite d2/d3/d21/d95/dd/d2a/d8d/fcf [0,4194304] 0 2024-05-06T21:26:54.712 INFO:tasks.workunit.client.1.smithi154.stdout:9/895: dwrite d5/d20/d52/f57 [0,4194304] 0 2024-05-06T21:26:54.714 INFO:tasks.workunit.client.0.smithi032.stdout:2/988: unlink df/d19/d1e/d71/d5f/ffb 0 2024-05-06T21:26:54.716 INFO:tasks.workunit.client.0.smithi032.stdout:2/989: mkdir df/d19/d1e/d71/d5f/d73/d14a 0 2024-05-06T21:26:54.716 INFO:tasks.workunit.client.1.smithi154.stdout:7/626: creat d6/d20/d40/d52/d8b/fcd x:0 0 0 2024-05-06T21:26:54.720 INFO:tasks.workunit.client.1.smithi154.stdout:9/896: creat d5/d20/d52/d6e/f127 x:0 0 0 2024-05-06T21:26:54.720 INFO:tasks.workunit.client.1.smithi154.stdout:9/897: write d5/f28 [2331681,55334] 0 2024-05-06T21:26:54.724 INFO:tasks.workunit.client.1.smithi154.stdout:7/627: mknod d6/d54/d5b/cce 0 2024-05-06T21:26:54.726 INFO:tasks.workunit.client.1.smithi154.stdout:1/768: sync 2024-05-06T21:26:54.726 INFO:tasks.workunit.client.1.smithi154.stdout:4/778: sync 2024-05-06T21:26:54.726 INFO:tasks.workunit.client.1.smithi154.stdout:4/779: stat d0/d82/d44/de9/f101 0 2024-05-06T21:26:54.726 INFO:tasks.workunit.client.1.smithi154.stdout:4/780: chown d0/d82/d44/d73/d4a/dd4/d1a/d7e/ce8 69027 1 2024-05-06T21:26:54.726 INFO:tasks.workunit.client.1.smithi154.stdout:4/781: write d0/d2/d47/d81/f92 [9584,80988] 0 2024-05-06T21:26:54.726 INFO:tasks.workunit.client.1.smithi154.stdout:4/782: stat d0/d82/d39/lb1 0 2024-05-06T21:26:54.727 INFO:tasks.workunit.client.1.smithi154.stdout:5/759: dwrite d2/d3/d21/f60 [4194304,4194304] 0 2024-05-06T21:26:54.728 INFO:tasks.workunit.client.1.smithi154.stdout:1/769: symlink d6/lea 0 2024-05-06T21:26:54.729 INFO:tasks.workunit.client.0.smithi032.stdout:2/990: getdents df/d19/d1e/d71/d5f/d73/df1 0 2024-05-06T21:26:54.730 INFO:tasks.workunit.client.0.smithi032.stdout:2/991: dread - df/d19/d1e/d35/dc5/d2e/dbe/fc4 zero size 2024-05-06T21:26:54.730 INFO:tasks.workunit.client.1.smithi154.stdout:5/760: unlink d2/d3/d21/d22/d25/db0/lbf 0 2024-05-06T21:26:54.732 INFO:tasks.workunit.client.1.smithi154.stdout:9/898: write d5/d2e/d7f/fcd [1214998,34530] 0 2024-05-06T21:26:54.732 INFO:tasks.workunit.client.1.smithi154.stdout:1/770: symlink d6/db/d10/d15/d1d/leb 0 2024-05-06T21:26:54.734 INFO:tasks.workunit.client.1.smithi154.stdout:5/761: creat d2/d3/d21/d22/d25/db0/f106 x:0 0 0 2024-05-06T21:26:54.736 INFO:tasks.workunit.client.1.smithi154.stdout:9/899: getdents d5/d20/d37 0 2024-05-06T21:26:54.736 INFO:tasks.workunit.client.1.smithi154.stdout:9/900: readlink d5/d20/d52/d6e/d83/da2/lad 0 2024-05-06T21:26:54.738 INFO:tasks.workunit.client.1.smithi154.stdout:1/771: creat d6/fec x:0 0 0 2024-05-06T21:26:54.739 INFO:tasks.workunit.client.1.smithi154.stdout:1/772: chown d6/db/d10 1595 1 2024-05-06T21:26:54.739 INFO:tasks.workunit.client.1.smithi154.stdout:4/783: write d0/d2/f53 [1606793,105689] 0 2024-05-06T21:26:54.739 INFO:tasks.workunit.client.1.smithi154.stdout:4/784: fdatasync d0/d2/dc/f18 0 2024-05-06T21:26:54.739 INFO:tasks.workunit.client.1.smithi154.stdout:4/785: fdatasync d0/d82/d44/d73/d4a/d74/d75/f100 0 2024-05-06T21:26:54.739 INFO:tasks.workunit.client.1.smithi154.stdout:5/762: mknod d2/d3/d21/d22/d25/db0/c107 0 2024-05-06T21:26:54.739 INFO:tasks.workunit.client.1.smithi154.stdout:5/763: chown d2/d3/d21/d95/dc/f15 459 1 2024-05-06T21:26:54.739 INFO:tasks.workunit.client.1.smithi154.stdout:5/764: truncate d2/d3/d19/d23/ff3 712381 0 2024-05-06T21:26:54.739 INFO:tasks.workunit.client.1.smithi154.stdout:5/765: stat d2/d3/l4e 0 2024-05-06T21:26:54.739 INFO:tasks.workunit.client.1.smithi154.stdout:9/901: mknod d5/d20/d52/d6e/d83/de5/c128 0 2024-05-06T21:26:54.740 INFO:tasks.workunit.client.1.smithi154.stdout:9/902: chown d5/d20/d52/d6e/d83/da2/cc0 0 1 2024-05-06T21:26:54.740 INFO:tasks.workunit.client.1.smithi154.stdout:1/773: fdatasync d6/d3e/d7e/da5/da8/faf 0 2024-05-06T21:26:54.742 INFO:tasks.workunit.client.1.smithi154.stdout:4/786: mkdir d0/d2/d47/d105 0 2024-05-06T21:26:54.742 INFO:tasks.workunit.client.1.smithi154.stdout:4/787: fdatasync d0/d82/d44/d73/d4a/dd4/ff2 0 2024-05-06T21:26:54.743 INFO:tasks.workunit.client.1.smithi154.stdout:5/766: mknod d2/d3/d21/d95/dc/c108 0 2024-05-06T21:26:54.743 INFO:tasks.workunit.client.1.smithi154.stdout:5/767: write d2/d48/f7c [420479,65750] 0 2024-05-06T21:26:54.743 INFO:tasks.workunit.client.1.smithi154.stdout:5/768: chown d2/d3/d21/d95/dc/d68/d69/cdf 29857373 1 2024-05-06T21:26:54.743 INFO:tasks.workunit.client.1.smithi154.stdout:8/748: sync 2024-05-06T21:26:54.743 INFO:tasks.workunit.client.1.smithi154.stdout:6/568: sync 2024-05-06T21:26:54.743 INFO:tasks.workunit.client.1.smithi154.stdout:8/749: chown d3/d64/cba 361444 1 2024-05-06T21:26:54.743 INFO:tasks.workunit.client.1.smithi154.stdout:8/750: truncate d3/d14/d1a/d29/f74 4863919 0 2024-05-06T21:26:54.743 INFO:tasks.workunit.client.1.smithi154.stdout:8/751: chown d3/d14/d1a/d29/d32/d40/d59/f41 0 1 2024-05-06T21:26:54.743 INFO:tasks.workunit.client.1.smithi154.stdout:9/903: mkdir d5/d14/d3a/d129 0 2024-05-06T21:26:54.744 INFO:tasks.workunit.client.1.smithi154.stdout:8/752: write d3/d14/d1a/d45/f5a [4507238,14872] 0 2024-05-06T21:26:54.749 INFO:tasks.workunit.client.0.smithi032.stdout:2/992: dwrite df/d19/d1e/d35/d3f/f44 [4194304,4194304] 0 2024-05-06T21:26:54.749 INFO:tasks.workunit.client.0.smithi032.stdout:2/993: chown df/d19/d1e/d71/d5f/d7d/d65/cc2 6048 1 2024-05-06T21:26:54.752 INFO:tasks.workunit.client.1.smithi154.stdout:1/774: mknod d6/db/d10/d15/d1d/ced 0 2024-05-06T21:26:54.752 INFO:tasks.workunit.client.1.smithi154.stdout:1/775: chown d6/d3e/d7e/fb5 12971237 1 2024-05-06T21:26:54.752 INFO:tasks.workunit.client.1.smithi154.stdout:1/776: chown d6/db/d10/d15/d1d/d53/f98 91082733 1 2024-05-06T21:26:54.752 INFO:tasks.workunit.client.1.smithi154.stdout:1/777: creat d6/db/d10/d15/d1d/d53/da3/fee x:0 0 0 2024-05-06T21:26:54.752 INFO:tasks.workunit.client.1.smithi154.stdout:1/778: chown d6/d3e/d7e/ca2 22718 1 2024-05-06T21:26:54.754 INFO:tasks.workunit.client.1.smithi154.stdout:4/788: creat d0/d82/d44/d73/def/df1/f106 x:0 0 0 2024-05-06T21:26:54.754 INFO:tasks.workunit.client.1.smithi154.stdout:4/789: dread - d0/d82/d44/d73/d4a/dd4/fe1 zero size 2024-05-06T21:26:54.758 INFO:tasks.workunit.client.1.smithi154.stdout:6/569: rename d8/d13/l38 to d8/d11/d33/d4a/lb4 0 2024-05-06T21:26:54.759 INFO:tasks.workunit.client.1.smithi154.stdout:7/628: dwrite d6/d20/d40/d52/d81/fc0 [0,4194304] 0 2024-05-06T21:26:54.759 INFO:tasks.workunit.client.1.smithi154.stdout:7/629: chown d6/d20/d40/d52/l74 0 1 2024-05-06T21:26:54.761 INFO:tasks.workunit.client.1.smithi154.stdout:8/753: getdents d3/d38 0 2024-05-06T21:26:54.761 INFO:tasks.workunit.client.1.smithi154.stdout:8/754: fdatasync d3/d64/d6d/dbd/d61/feb 0 2024-05-06T21:26:54.761 INFO:tasks.workunit.client.1.smithi154.stdout:4/790: symlink d0/d82/d44/d73/def/df1/l107 0 2024-05-06T21:26:54.763 INFO:tasks.workunit.client.1.smithi154.stdout:5/769: rmdir d2/d3/d21/d95/dc/d44/dc0 39 2024-05-06T21:26:54.763 INFO:tasks.workunit.client.1.smithi154.stdout:5/770: chown d2/d3/d21/d95/dc/d68/c79 6 1 2024-05-06T21:26:54.763 INFO:tasks.workunit.client.1.smithi154.stdout:9/904: dwrite d5/d20/d37/dd5/f116 [0,4194304] 0 2024-05-06T21:26:54.769 INFO:tasks.workunit.client.1.smithi154.stdout:6/570: write d8/d13/f64 [937267,290] 0 2024-05-06T21:26:54.769 INFO:tasks.workunit.client.1.smithi154.stdout:8/755: mkdir d3/d14/d1a/d45/dcf/db4/dee 0 2024-05-06T21:26:54.770 INFO:tasks.workunit.client.1.smithi154.stdout:4/791: symlink d0/d82/l108 0 2024-05-06T21:26:54.772 INFO:tasks.workunit.client.1.smithi154.stdout:5/771: creat d2/d3/d21/d22/f109 x:0 0 0 2024-05-06T21:26:54.774 INFO:tasks.workunit.client.1.smithi154.stdout:4/792: dread d0/d2/f8 [0,4194304] 0 2024-05-06T21:26:54.777 INFO:tasks.workunit.client.1.smithi154.stdout:9/905: rename d5/d2e/d8b/ffc to d5/d14/d3a/f12a 0 2024-05-06T21:26:54.779 INFO:tasks.workunit.client.0.smithi032.stdout:2/994: dwrite df/d19/d1e/d35/dc5/d9f/dc0/f140 [0,4194304] 0 2024-05-06T21:26:54.779 INFO:tasks.workunit.client.0.smithi032.stdout:2/995: creat df/d19/dbf/f14b x:0 0 0 2024-05-06T21:26:54.779 INFO:tasks.workunit.client.0.smithi032.stdout:2/996: chown df/dae/l123 840 1 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:7/630: dwrite d6/d20/d40/d52/f88 [0,4194304] 0 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:7/631: write d6/d42/d6c/d6e/f31 [2303927,13073] 0 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:7/632: fdatasync d6/d42/d6c/d6e/d21/d2e/fb5 0 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:1/779: dwrite d6/db/d10/d26/f6b [0,4194304] 0 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:1/780: dread - d6/fec zero size 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:8/756: truncate d3/d14/d1a/d29/d32/d40/d59/f55 1010283 0 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:1/781: creat d6/db/d97/fef x:0 0 0 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:6/571: symlink d8/d11/d33/d92/lb5 0 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:6/572: read d8/d13/f28 [2377400,21910] 0 2024-05-06T21:26:54.780 INFO:tasks.workunit.client.1.smithi154.stdout:6/573: fdatasync d8/d11/d2d/d3d/d70/d7b/fa1 0 2024-05-06T21:26:54.783 INFO:tasks.workunit.client.1.smithi154.stdout:5/772: creat d2/d3/d19/d23/df9/f10a x:0 0 0 2024-05-06T21:26:54.783 INFO:tasks.workunit.client.1.smithi154.stdout:5/773: dread - d2/d3/d21/d95/dd/d2a/d54/dce/fd8 zero size 2024-05-06T21:26:54.785 INFO:tasks.workunit.client.1.smithi154.stdout:9/906: mkdir d5/d14/d87/d12b 0 2024-05-06T21:26:54.791 INFO:tasks.workunit.client.1.smithi154.stdout:7/633: dread d6/f25 [0,4194304] 0 2024-05-06T21:26:54.795 INFO:tasks.workunit.client.1.smithi154.stdout:7/634: read d6/d42/d6c/d6e/f31 [561765,130618] 0 2024-05-06T21:26:54.795 INFO:tasks.workunit.client.1.smithi154.stdout:7/635: write d6/d42/d6c/d6e/d21/d2e/fcb [159582,14890] 0 2024-05-06T21:26:54.802 INFO:tasks.workunit.client.1.smithi154.stdout:8/757: mknod d3/d14/d1a/cef 0 2024-05-06T21:26:54.802 INFO:tasks.workunit.client.1.smithi154.stdout:8/758: write d3/d14/d1a/d29/d32/d40/d59/d67/d95/fa5 [1337411,6741] 0 2024-05-06T21:26:54.802 INFO:tasks.workunit.client.1.smithi154.stdout:8/759: fdatasync d3/d14/d1a/d29/d32/d40/d59/f55 0 2024-05-06T21:26:54.802 INFO:tasks.workunit.client.1.smithi154.stdout:1/782: mknod d6/db/dbe/cf0 0 2024-05-06T21:26:54.802 INFO:tasks.workunit.client.1.smithi154.stdout:8/760: write d3/d64/d6d/dbd/d61/f81 [616966,71855] 0 2024-05-06T21:26:54.804 INFO:tasks.workunit.client.1.smithi154.stdout:6/574: creat d8/d11/d33/d92/fb6 x:0 0 0 2024-05-06T21:26:54.804 INFO:tasks.workunit.client.1.smithi154.stdout:6/575: write d8/d11/d33/fb3 [194921,16074] 0 2024-05-06T21:26:54.804 INFO:tasks.workunit.client.1.smithi154.stdout:6/576: stat d8/d11/d8d/daa 0 2024-05-06T21:26:54.805 INFO:tasks.workunit.client.1.smithi154.stdout:9/907: unlink d5/d20/d52/d6e/fb3 0 2024-05-06T21:26:54.806 INFO:tasks.workunit.client.1.smithi154.stdout:1/783: creat d6/db/d10/d94/ff1 x:0 0 0 2024-05-06T21:26:54.807 INFO:tasks.workunit.client.1.smithi154.stdout:8/761: rename d3/f91 to d3/d14/d1a/d29/d32/d40/ff0 0 2024-05-06T21:26:54.808 INFO:tasks.workunit.client.1.smithi154.stdout:6/577: symlink d8/d11/d33/d4a/d6c/lb7 0 2024-05-06T21:26:54.809 INFO:tasks.workunit.client.1.smithi154.stdout:9/908: truncate d5/d2e/f55 1160108 0 2024-05-06T21:26:54.809 INFO:tasks.workunit.client.1.smithi154.stdout:9/909: chown d5/d14/d87/d65/l7c 402170552 1 2024-05-06T21:26:54.809 INFO:tasks.workunit.client.1.smithi154.stdout:9/910: fdatasync d5/d20/d52/f4f 0 2024-05-06T21:26:54.810 INFO:tasks.workunit.client.1.smithi154.stdout:1/784: truncate d6/f28 1331880 0 2024-05-06T21:26:54.811 INFO:tasks.workunit.client.1.smithi154.stdout:8/762: rename d3/d14/d1a/f3c to d3/d14/d1a/d29/d32/d40/d59/d67/d94/ff1 0 2024-05-06T21:26:54.813 INFO:tasks.workunit.client.1.smithi154.stdout:1/785: creat d6/db/d10/de5/ff2 x:0 0 0 2024-05-06T21:26:54.814 INFO:tasks.workunit.client.1.smithi154.stdout:1/786: getdents d6/db/d10/d15/d1d/d53 0 2024-05-06T21:26:54.821 INFO:tasks.workunit.client.1.smithi154.stdout:9/911: dread d5/d20/d37/f38 [0,4194304] 0 2024-05-06T21:26:54.823 INFO:tasks.workunit.client.1.smithi154.stdout:5/774: dwrite d2/d3/f35 [4194304,4194304] 0 2024-05-06T21:26:54.823 INFO:tasks.workunit.client.1.smithi154.stdout:5/775: readlink d2/d3/d21/d95/dd/d2a/d54/d43/ldd 0 2024-05-06T21:26:54.825 INFO:tasks.workunit.client.1.smithi154.stdout:5/776: link d2/d3/d19/d23/df9/cfc d2/d3/d21/d22/c10b 0 2024-05-06T21:26:54.825 INFO:tasks.workunit.client.1.smithi154.stdout:5/777: fdatasync d2/d3/d21/d95/dd/d2a/d54/d43/db1/ff4 0 2024-05-06T21:26:54.826 INFO:tasks.workunit.client.1.smithi154.stdout:4/793: dwrite d0/d82/d3d/dab/fe5 [0,4194304] 0 2024-05-06T21:26:54.826 INFO:tasks.workunit.client.1.smithi154.stdout:4/794: stat d0/d82/d44/d73/d4a/d74 0 2024-05-06T21:26:54.826 INFO:tasks.workunit.client.1.smithi154.stdout:4/795: fdatasync d0/d82/faf 0 2024-05-06T21:26:54.826 INFO:tasks.workunit.client.1.smithi154.stdout:4/796: write d0/d82/d44/d73/d4a/dd4/d1a/f3f [529908,100178] 0 2024-05-06T21:26:54.827 INFO:tasks.workunit.client.0.smithi032.stdout:2/997: dwrite df/d19/dbf/fd6 [0,4194304] 0 2024-05-06T21:26:54.827 INFO:tasks.workunit.client.0.smithi032.stdout:2/998: truncate df/d19/d1e/d35/dc5/d2e/d33/f27 1450071 0 2024-05-06T21:26:54.829 INFO:tasks.workunit.client.1.smithi154.stdout:7/636: dwrite d6/d42/d6c/f77 [0,4194304] 0 2024-05-06T21:26:54.829 INFO:tasks.workunit.client.1.smithi154.stdout:7/637: fsync d6/d42/d6c/d6e/d21/d2e/d9d/fc9 0 2024-05-06T21:26:54.829 INFO:tasks.workunit.client.1.smithi154.stdout:7/638: write d6/d54/f84 [556503,5985] 0 2024-05-06T21:26:54.829 INFO:tasks.workunit.client.1.smithi154.stdout:7/639: chown d6/d42/d6c/d6e/c95 576 1 2024-05-06T21:26:54.831 INFO:tasks.workunit.client.1.smithi154.stdout:4/797: symlink d0/d72/d76/dbb/dee/l109 0 2024-05-06T21:26:54.832 INFO:tasks.workunit.client.0.smithi032.stdout:2/999: rename df/f2c to df/d19/d1e/d35/dc5/d2e/d143/f14c 0 2024-05-06T21:26:54.833 INFO:tasks.workunit.client.1.smithi154.stdout:4/798: creat d0/d82/d3d/f10a x:0 0 0 2024-05-06T21:26:54.834 INFO:tasks.workunit.client.1.smithi154.stdout:6/578: dwrite d8/d11/d33/d4a/d6c/fb1 [0,4194304] 0 2024-05-06T21:26:54.834 INFO:tasks.workunit.client.1.smithi154.stdout:6/579: stat d8/d11/d2d/c72 0 2024-05-06T21:26:54.834 INFO:tasks.workunit.client.1.smithi154.stdout:1/787: dwrite d6/db/d10/f77 [0,4194304] 0 2024-05-06T21:26:54.834 INFO:tasks.workunit.client.1.smithi154.stdout:1/788: write d6/db/d10/fc8 [224864,94809] 0 2024-05-06T21:26:54.838 INFO:tasks.workunit.client.1.smithi154.stdout:6/580: truncate d8/d13/d20/f5a 276844 0 2024-05-06T21:26:54.838 INFO:tasks.workunit.client.1.smithi154.stdout:6/581: truncate d8/d11/d2d/d3d/f6b 2665545 0 2024-05-06T21:26:54.839 INFO:tasks.workunit.client.1.smithi154.stdout:1/789: dread d6/f66 [0,4194304] 0 2024-05-06T21:26:54.846 INFO:tasks.workunit.client.1.smithi154.stdout:4/799: rename d0/d82/d44/d73/d4a/dd4/d1a/d50 to d0/d82/d44/d73/d4a/dd4/d1a/d10b 0 2024-05-06T21:26:54.846 INFO:tasks.workunit.client.1.smithi154.stdout:4/800: fsync d0/d82/d44/d73/d4a/d74/d75/f99 0 2024-05-06T21:26:54.846 INFO:tasks.workunit.client.1.smithi154.stdout:4/801: fdatasync d0/d72/d76/f7d 0 2024-05-06T21:26:54.847 INFO:tasks.workunit.client.1.smithi154.stdout:4/802: mknod d0/d2/d47/d81/c10c 0 2024-05-06T21:26:54.854 INFO:tasks.workunit.client.1.smithi154.stdout:8/763: rename d3/d14/d1a/d29/d32/d40/d59/d67/d94 to d3/d38/df2 0 2024-05-06T21:26:54.854 INFO:tasks.workunit.client.1.smithi154.stdout:8/764: chown d3/d14/d1a/d29/d32/d40/d79/l4c 3106 1 2024-05-06T21:26:54.854 INFO:tasks.workunit.client.1.smithi154.stdout:8/765: getdents d3/d14/d1a/d29/d32/de8 0 2024-05-06T21:26:54.854 INFO:tasks.workunit.client.1.smithi154.stdout:8/766: fdatasync d3/d14/f18 0 2024-05-06T21:26:54.854 INFO:tasks.workunit.client.1.smithi154.stdout:8/767: truncate d3/d14/d1a/d45/dcf/db4/fdd 526093 0 2024-05-06T21:26:54.855 INFO:tasks.workunit.client.1.smithi154.stdout:1/790: dread d6/f24 [0,4194304] 0 2024-05-06T21:26:54.855 INFO:tasks.workunit.client.1.smithi154.stdout:1/791: write d6/db/d69/d89/f8e [31951,57926] 0 2024-05-06T21:26:54.855 INFO:tasks.workunit.client.1.smithi154.stdout:1/792: chown d6/d3e/l65 1412209 1 2024-05-06T21:26:54.855 INFO:tasks.workunit.client.1.smithi154.stdout:1/793: chown d6/db/d69/d89/dac/lc3 1 1 2024-05-06T21:26:54.855 INFO:tasks.workunit.client.1.smithi154.stdout:1/794: creat d6/db/d10/ff3 x:0 0 0 2024-05-06T21:26:54.855 INFO:tasks.workunit.client.1.smithi154.stdout:1/795: readlink d6/db/d10/d15/d1d/l2a 0 2024-05-06T21:26:54.858 INFO:tasks.workunit.client.1.smithi154.stdout:1/796: mknod d6/db/d69/dc1/cf4 0 2024-05-06T21:26:54.858 INFO:tasks.workunit.client.1.smithi154.stdout:1/797: truncate d6/db/d69/dc1/fd3 576018 0 2024-05-06T21:26:54.859 INFO:tasks.workunit.client.1.smithi154.stdout:0/879: sync 2024-05-06T21:26:54.859 INFO:tasks.workunit.client.1.smithi154.stdout:3/924: sync 2024-05-06T21:26:54.859 INFO:tasks.workunit.client.1.smithi154.stdout:2/728: sync 2024-05-06T21:26:54.859 INFO:tasks.workunit.client.1.smithi154.stdout:0/880: write d6/dc/d44/f11 [926988,115715] 0 2024-05-06T21:26:54.860 INFO:tasks.workunit.client.1.smithi154.stdout:5/778: dwrite d2/d3/d21/d95/dd/fad [0,4194304] 0 2024-05-06T21:26:54.860 INFO:tasks.workunit.client.1.smithi154.stdout:1/798: creat d6/db/d10/d15/ff5 x:0 0 0 2024-05-06T21:26:54.862 INFO:tasks.workunit.client.1.smithi154.stdout:6/582: dread d8/d11/d33/fb3 [0,4194304] 0 2024-05-06T21:26:54.862 INFO:tasks.workunit.client.1.smithi154.stdout:9/912: dwrite d5/d20/d52/d6e/f9c [0,4194304] 0 2024-05-06T21:26:54.862 INFO:tasks.workunit.client.1.smithi154.stdout:9/913: write d5/d20/f23 [820999,37902] 0 2024-05-06T21:26:54.862 INFO:tasks.workunit.client.1.smithi154.stdout:9/914: chown d5/d20/d37/f64 6 1 2024-05-06T21:26:54.862 INFO:tasks.workunit.client.1.smithi154.stdout:9/915: stat d5/d20/ffa 0 2024-05-06T21:26:54.864 INFO:tasks.workunit.client.1.smithi154.stdout:2/729: mknod db/d12/d1d/ce7 0 2024-05-06T21:26:54.864 INFO:tasks.workunit.client.1.smithi154.stdout:5/779: symlink d2/d3/d19/d23/d100/l10c 0 2024-05-06T21:26:54.865 INFO:tasks.workunit.client.1.smithi154.stdout:5/780: chown d2/d3/d8b/cfe 342063523 1 2024-05-06T21:26:54.867 INFO:tasks.workunit.client.1.smithi154.stdout:2/730: mkdir db/d12/d19/d4b/d78/de8 0 2024-05-06T21:26:54.869 INFO:tasks.workunit.client.1.smithi154.stdout:0/881: dread d6/dc/f16 [0,4194304] 0 2024-05-06T21:26:54.871 INFO:tasks.workunit.client.1.smithi154.stdout:5/781: rmdir d2/d3/d19/d23/df9 39 2024-05-06T21:26:54.871 INFO:tasks.workunit.client.1.smithi154.stdout:5/782: fsync d2/d3/d21/d95/dc/d68/fc8 0 2024-05-06T21:26:54.872 INFO:tasks.workunit.client.1.smithi154.stdout:5/783: dread - d2/d3/d19/d23/db6/ff6 zero size 2024-05-06T21:26:54.873 INFO:tasks.workunit.client.1.smithi154.stdout:7/640: dwrite d6/f9e [0,4194304] 0 2024-05-06T21:26:54.873 INFO:tasks.workunit.client.1.smithi154.stdout:7/641: chown d6/d20/d40/daf/d5c/l90 271 1 2024-05-06T21:26:54.873 INFO:tasks.workunit.client.1.smithi154.stdout:7/642: chown d6/d54/d5b/dc5 40044727 1 2024-05-06T21:26:54.873 INFO:tasks.workunit.client.1.smithi154.stdout:7/643: write d6/fb [180350,18380] 0 2024-05-06T21:26:54.875 INFO:tasks.workunit.client.1.smithi154.stdout:5/784: rename d2/d3/d19/dbe/cee to d2/d48/c10d 0 2024-05-06T21:26:54.875 INFO:tasks.workunit.client.1.smithi154.stdout:5/785: fdatasync d2/d3/d21/d95/fe 0 2024-05-06T21:26:54.875 INFO:tasks.workunit.client.1.smithi154.stdout:5/786: fsync d2/d48/f104 0 2024-05-06T21:26:54.875 INFO:tasks.workunit.client.1.smithi154.stdout:3/925: write d0/d2/f45 [7198865,12136] 0 2024-05-06T21:26:54.879 INFO:tasks.workunit.client.1.smithi154.stdout:3/926: getdents d0/d2 0 2024-05-06T21:26:54.882 INFO:tasks.workunit.client.1.smithi154.stdout:5/787: dread d2/d3/d21/d95/dd/d2a/d54/f5c [0,4194304] 0 2024-05-06T21:26:54.883 INFO:tasks.workunit.client.1.smithi154.stdout:2/731: dread db/de/d16/d33/f4d [4194304,4194304] 0 2024-05-06T21:26:54.884 INFO:tasks.workunit.client.1.smithi154.stdout:2/732: creat db/de/fe9 x:0 0 0 2024-05-06T21:26:54.886 INFO:tasks.workunit.client.1.smithi154.stdout:2/733: creat db/d12/d19/d4b/db2/fea x:0 0 0 2024-05-06T21:26:54.887 INFO:tasks.workunit.client.1.smithi154.stdout:2/734: read db/de/d10/f25 [3272736,3355] 0 2024-05-06T21:26:54.888 INFO:tasks.workunit.client.1.smithi154.stdout:1/799: write d6/db/d10/d26/f8f [704902,103681] 0 2024-05-06T21:26:54.889 INFO:tasks.workunit.client.1.smithi154.stdout:2/735: link db/de/d10/f69 db/d12/d1d/feb 0 2024-05-06T21:26:54.889 INFO:tasks.workunit.client.1.smithi154.stdout:2/736: stat db/d12/d19/d91 0 2024-05-06T21:26:54.889 INFO:tasks.workunit.client.1.smithi154.stdout:4/803: dwrite d0/d82/d44/d73/d4a/dd4/f21 [0,4194304] 0 2024-05-06T21:26:54.891 INFO:tasks.workunit.client.1.smithi154.stdout:2/737: mknod db/de/d10/dbc/cec 0 2024-05-06T21:26:54.892 INFO:tasks.workunit.client.1.smithi154.stdout:4/804: getdents d0/d82/d39/da6 0 2024-05-06T21:26:54.894 INFO:tasks.workunit.client.1.smithi154.stdout:2/738: unlink db/lf 0 2024-05-06T21:26:54.897 INFO:tasks.workunit.client.1.smithi154.stdout:4/805: link d0/d2/dc/fc4 d0/d82/d44/d73/d4a/dd4/d1a/f10d 0 2024-05-06T21:26:54.899 INFO:tasks.workunit.client.1.smithi154.stdout:4/806: mknod d0/d2/d47/d81/c10e 0 2024-05-06T21:26:54.899 INFO:tasks.workunit.client.1.smithi154.stdout:4/807: write d0/d10/fd6 [924052,124870] 0 2024-05-06T21:26:54.900 INFO:tasks.workunit.client.1.smithi154.stdout:4/808: mknod d0/d72/d76/c10f 0 2024-05-06T21:26:54.902 INFO:tasks.workunit.client.1.smithi154.stdout:4/809: rename d0/d82/d44/d73/d4a/dd4/f21 to d0/d82/d44/d73/d4a/dd4/dcd/f110 0 2024-05-06T21:26:54.903 INFO:tasks.workunit.client.1.smithi154.stdout:8/768: dwrite d3/d38/df2/ff1 [0,4194304] 0 2024-05-06T21:26:54.903 INFO:tasks.workunit.client.1.smithi154.stdout:8/769: stat d3/d14/d1a/d29/d32/d40/d4b/fc7 0 2024-05-06T21:26:54.903 INFO:tasks.workunit.client.1.smithi154.stdout:8/770: creat d3/d14/ff3 x:0 0 0 2024-05-06T21:26:54.903 INFO:tasks.workunit.client.1.smithi154.stdout:8/771: write d3/fb [813587,48531] 0 2024-05-06T21:26:54.907 INFO:tasks.workunit.client.1.smithi154.stdout:8/772: symlink d3/d14/d1a/d45/lf4 0 2024-05-06T21:26:54.908 INFO:tasks.workunit.client.1.smithi154.stdout:9/916: dwrite d5/d20/d52/d6e/d83/fdb [0,4194304] 0 2024-05-06T21:26:54.908 INFO:tasks.workunit.client.1.smithi154.stdout:8/773: symlink d3/d64/d6d/lf5 0 2024-05-06T21:26:54.913 INFO:tasks.workunit.client.1.smithi154.stdout:9/917: symlink d5/d14/d31/l12c 0 2024-05-06T21:26:54.916 INFO:tasks.workunit.client.1.smithi154.stdout:9/918: unlink d5/d20/d52/d6e/c100 0 2024-05-06T21:26:54.916 INFO:tasks.workunit.client.1.smithi154.stdout:6/583: dwrite d8/d13/da9/f6f [0,4194304] 0 2024-05-06T21:26:54.917 INFO:tasks.workunit.client.1.smithi154.stdout:6/584: chown d8/d11/d2d/l41 126849 1 2024-05-06T21:26:54.917 INFO:tasks.workunit.client.1.smithi154.stdout:3/927: dwrite d0/da/d1a/d28/dbc/d117/d52/d62/fc4 [0,4194304] 0 2024-05-06T21:26:54.917 INFO:tasks.workunit.client.1.smithi154.stdout:7/644: fdatasync d6/d54/f84 0 2024-05-06T21:26:54.917 INFO:tasks.workunit.client.1.smithi154.stdout:7/645: readlink d6/d20/d40/d52/lc3 0 2024-05-06T21:26:54.918 INFO:tasks.workunit.client.1.smithi154.stdout:6/585: mknod d8/d13/d8f/cb8 0 2024-05-06T21:26:54.918 INFO:tasks.workunit.client.1.smithi154.stdout:6/586: creat d8/d11/d2d/d3d/d70/d7b/d95/fb9 x:0 0 0 2024-05-06T21:26:54.918 INFO:tasks.workunit.client.1.smithi154.stdout:1/800: dread d6/db/d10/fc8 [0,4194304] 0 2024-05-06T21:26:54.919 INFO:tasks.workunit.client.1.smithi154.stdout:0/882: dwrite d6/dc1/fda [0,4194304] 0 2024-05-06T21:26:54.920 INFO:tasks.workunit.client.1.smithi154.stdout:6/587: write d8/d13/d20/f5a [29012,123169] 0 2024-05-06T21:26:54.920 INFO:tasks.workunit.client.1.smithi154.stdout:6/588: truncate d8/d7e/f83 1263403 0 2024-05-06T21:26:54.920 INFO:tasks.workunit.client.1.smithi154.stdout:6/589: write d8/d11/d2d/d3d/d70/d7b/d95/fa7 [311044,66705] 0 2024-05-06T21:26:54.921 INFO:tasks.workunit.client.1.smithi154.stdout:5/788: dwrite d2/d3/d21/d95/dd/d2a/d54/d43/d73/fd4 [0,4194304] 0 2024-05-06T21:26:54.921 INFO:tasks.workunit.client.1.smithi154.stdout:5/789: stat d2/d3/d21/d95/dd/d2a/d54/d43/ff2 0 2024-05-06T21:26:54.921 INFO:tasks.workunit.client.1.smithi154.stdout:5/790: dread - d2/d3/d19/d23/df9/f10a zero size 2024-05-06T21:26:54.923 INFO:tasks.workunit.client.1.smithi154.stdout:3/928: rmdir d0/da/d1a/d28/dbc/d117/dd/d1c/d90/d112 39 2024-05-06T21:26:54.923 INFO:tasks.workunit.client.1.smithi154.stdout:7/646: dread d6/fb3 [0,4194304] 0 2024-05-06T21:26:54.924 INFO:tasks.workunit.client.1.smithi154.stdout:2/739: dwrite db/de/d16/f98 [0,4194304] 0 2024-05-06T21:26:54.924 INFO:tasks.workunit.client.1.smithi154.stdout:2/740: dread - db/de/d10/d18/fa2 zero size 2024-05-06T21:26:54.930 INFO:tasks.workunit.client.1.smithi154.stdout:9/919: dread d5/d20/d52/d6e/f9c [0,4194304] 0 2024-05-06T21:26:54.930 INFO:tasks.workunit.client.1.smithi154.stdout:9/920: readlink d5/d20/d52/d59/lbb 0 2024-05-06T21:26:54.933 INFO:tasks.workunit.client.1.smithi154.stdout:0/883: symlink d6/dc/d40/d4a/da3/d10d/l125 0 2024-05-06T21:26:54.933 INFO:tasks.workunit.client.1.smithi154.stdout:0/884: chown d6/dc/d40/d4a/da7/d70/lf5 484783 1 2024-05-06T21:26:54.936 INFO:tasks.workunit.client.1.smithi154.stdout:3/929: dread d0/da/d1a/dbf/ff5 [0,4194304] 0 2024-05-06T21:26:54.938 INFO:tasks.workunit.client.1.smithi154.stdout:7/647: read d6/d42/d6c/d6e/f19 [854833,34509] 0 2024-05-06T21:26:54.939 INFO:tasks.workunit.client.1.smithi154.stdout:5/791: link d2/d3/d21/l7e d2/d3/d19/d23/df9/dfd/l10e 0 2024-05-06T21:26:54.942 INFO:tasks.workunit.client.1.smithi154.stdout:4/810: dwrite d0/d2/d29/d60/fff [0,4194304] 0 2024-05-06T21:26:54.943 INFO:tasks.workunit.client.1.smithi154.stdout:4/811: stat d0/l5 0 2024-05-06T21:26:54.943 INFO:tasks.workunit.client.1.smithi154.stdout:4/812: write d0/d82/f77 [4856286,86523] 0 2024-05-06T21:26:54.943 INFO:tasks.workunit.client.1.smithi154.stdout:8/774: dwrite d3/d14/d1a/d29/d32/d40/d59/f55 [0,4194304] 0 2024-05-06T21:26:54.944 INFO:tasks.workunit.client.1.smithi154.stdout:1/801: getdents d6/db/dbe 0 2024-05-06T21:26:54.946 INFO:tasks.workunit.client.1.smithi154.stdout:9/921: mkdir d5/d14/d3a/d129/d12d 0 2024-05-06T21:26:54.951 INFO:tasks.workunit.client.1.smithi154.stdout:3/930: creat d0/da/d1a/d28/dbc/d117/d7c/d80/d106/f137 x:0 0 0 2024-05-06T21:26:54.951 INFO:tasks.workunit.client.1.smithi154.stdout:3/931: chown d0/da/d1a/d28/dbc/d117/dd/d1c/d21/d37/fc1 307 1 2024-05-06T21:26:54.951 INFO:tasks.workunit.client.1.smithi154.stdout:3/932: getdents d0/da/d1a/d28/dbc/d117/d30 0 2024-05-06T21:26:54.953 INFO:tasks.workunit.client.1.smithi154.stdout:6/590: dwrite d8/d11/d2d/d3d/d70/d7b/f81 [0,4194304] 0 2024-05-06T21:26:54.953 INFO:tasks.workunit.client.1.smithi154.stdout:5/792: rename d2/d3/d19/d23/d100/l103 to d2/d3/d21/d95/dc/d44/dc0/de6/l10f 0 2024-05-06T21:26:54.953 INFO:tasks.workunit.client.1.smithi154.stdout:5/793: chown d2/d3/d21/d22/d25/db0 9188 1 2024-05-06T21:26:54.958 INFO:tasks.workunit.client.1.smithi154.stdout:1/802: dread d6/db/d10/f77 [0,4194304] 0 2024-05-06T21:26:54.958 INFO:tasks.workunit.client.1.smithi154.stdout:9/922: dread d5/d14/f30 [0,4194304] 0 2024-05-06T21:26:54.958 INFO:tasks.workunit.client.1.smithi154.stdout:7/648: dwrite d6/d42/d6c/d6e/f76 [0,4194304] 0 2024-05-06T21:26:54.963 INFO:tasks.workunit.client.0.smithi032.stdout:0/996: sync 2024-05-06T21:26:54.963 INFO:tasks.workunit.client.0.smithi032.stdout:1/947: sync 2024-05-06T21:26:54.963 INFO:tasks.workunit.client.0.smithi032.stdout:1/948: chown db/dc8/dfc/f115 791465 1 2024-05-06T21:26:54.963 INFO:tasks.workunit.client.0.smithi032.stdout:0/997: chown d4/da/d16/d33/d9e/dc9/dcb/l117 25 1 2024-05-06T21:26:54.964 INFO:tasks.workunit.client.1.smithi154.stdout:4/813: creat d0/d82/d44/d73/d4a/dd4/d1a/d10b/dfc/f111 x:0 0 0 2024-05-06T21:26:54.964 INFO:tasks.workunit.client.1.smithi154.stdout:4/814: chown d0/d72/c103 193 1 2024-05-06T21:26:54.964 INFO:tasks.workunit.client.0.smithi032.stdout:0/998: symlink d4/da/d14/d1a/d66/d8a/l147 0 2024-05-06T21:26:54.965 INFO:tasks.workunit.client.0.smithi032.stdout:0/999: symlink d4/d3e/l148 0 2024-05-06T21:26:54.966 INFO:tasks.workunit.client.1.smithi154.stdout:8/775: symlink d3/d14/d1a/d45/dcf/db4/dee/lf6 0 2024-05-06T21:26:54.969 INFO:tasks.workunit.client.1.smithi154.stdout:9/923: dread d5/d2e/d66/fbe [0,4194304] 0 2024-05-06T21:26:54.973 INFO:tasks.workunit.client.1.smithi154.stdout:9/924: read d5/d14/f30 [67346,23576] 0 2024-05-06T21:26:54.982 INFO:tasks.workunit.client.1.smithi154.stdout:4/815: dwrite d0/d2/fd7 [0,4194304] 0 2024-05-06T21:26:54.983 INFO:tasks.workunit.client.0.smithi032.stdout:1/949: dwrite db/d37/d93/dce/f103 [0,4194304] 0 2024-05-06T21:26:54.983 INFO:tasks.workunit.client.0.smithi032.stdout:1/950: dread - db/dc8/f110 zero size 2024-05-06T21:26:54.984 INFO:tasks.workunit.client.0.smithi032.stdout:1/951: rename db/d16/d46/f96 to db/d47/d70/f135 0 2024-05-06T21:26:54.985 INFO:tasks.workunit.client.1.smithi154.stdout:0/885: truncate d6/dc/d44/d36/d89/faf 2662537 0 2024-05-06T21:26:54.986 INFO:tasks.workunit.client.0.smithi032.stdout:1/952: write db/d47/d4a/f66 [320546,89633] 0 2024-05-06T21:26:54.986 INFO:tasks.workunit.client.1.smithi154.stdout:3/933: creat d0/da/d1a/d28/dbc/d81/f138 x:0 0 0 2024-05-06T21:26:54.987 INFO:tasks.workunit.client.1.smithi154.stdout:6/591: mkdir d8/d11/d2d/d3d/d4c/dba 0 2024-05-06T21:26:54.989 INFO:tasks.workunit.client.1.smithi154.stdout:7/649: symlink d6/d20/db1/lcf 0 2024-05-06T21:26:54.991 INFO:tasks.workunit.client.1.smithi154.stdout:8/776: creat d3/d64/d6d/ff7 x:0 0 0 2024-05-06T21:26:54.991 INFO:tasks.workunit.client.1.smithi154.stdout:8/777: chown d3/d14/d1a/d29/da3 0 1 2024-05-06T21:26:54.992 INFO:tasks.workunit.client.1.smithi154.stdout:9/925: unlink d5/d20/l2b 0 2024-05-06T21:26:54.992 INFO:tasks.workunit.client.1.smithi154.stdout:9/926: stat d5/d2e 0 2024-05-06T21:26:54.996 INFO:tasks.workunit.client.1.smithi154.stdout:4/816: unlink d0/d2/d47/fbe 0 2024-05-06T21:26:54.997 INFO:tasks.workunit.client.1.smithi154.stdout:3/934: unlink d0/da/d1a/d28/dbc/d117/dd/d1c/d21/c114 0 2024-05-06T21:26:54.999 INFO:tasks.workunit.client.1.smithi154.stdout:5/794: rmdir d2/d3/d21/d95/dc/d68 39 2024-05-06T21:26:55.002 INFO:tasks.workunit.client.1.smithi154.stdout:8/778: rename d3/d14/d1a/d29/d32/d40/d4b/fc7 to d3/d14/d1a/d45/ff8 0 2024-05-06T21:26:55.004 INFO:tasks.workunit.client.1.smithi154.stdout:9/927: creat d5/d20/d52/d114/f12e x:0 0 0 2024-05-06T21:26:55.007 INFO:tasks.workunit.client.1.smithi154.stdout:4/817: dread d0/d10/fc0 [0,4194304] 0 2024-05-06T21:26:55.007 INFO:tasks.workunit.client.1.smithi154.stdout:4/818: chown d0/d82/d39/d54/c97 27372837 1 2024-05-06T21:26:55.007 INFO:tasks.workunit.client.1.smithi154.stdout:4/819: fsync d0/d2/fa 0 2024-05-06T21:26:55.010 INFO:tasks.workunit.client.1.smithi154.stdout:3/935: write d0/da/d1a/d28/dbc/d117/dd/f3c [629108,12328] 0 2024-05-06T21:26:55.010 INFO:tasks.workunit.client.1.smithi154.stdout:3/936: chown d0/da/d1a/d28/dbc/d117/d7c/d80/d106 60128107 1 2024-05-06T21:26:55.010 INFO:tasks.workunit.client.1.smithi154.stdout:3/937: fdatasync d0/da/f70 0 2024-05-06T21:26:55.011 INFO:tasks.workunit.client.1.smithi154.stdout:8/779: dread d3/d14/d1a/d29/d32/d40/d79/f88 [0,4194304] 0 2024-05-06T21:26:55.012 INFO:tasks.workunit.client.1.smithi154.stdout:4/820: mknod d0/d82/d39/d63/c112 0 2024-05-06T21:26:55.012 INFO:tasks.workunit.client.1.smithi154.stdout:4/821: write d0/d82/ff6 [129954,101512] 0 2024-05-06T21:26:55.013 INFO:tasks.workunit.client.1.smithi154.stdout:4/822: creat d0/d82/d44/d73/def/df1/f113 x:0 0 0 2024-05-06T21:26:55.014 INFO:tasks.workunit.client.1.smithi154.stdout:9/928: dread d5/d20/d37/f5f [0,4194304] 0 2024-05-06T21:26:55.014 INFO:tasks.workunit.client.1.smithi154.stdout:9/929: stat d5/d20/d52/d6e/d83/da2/cbc 0 2024-05-06T21:26:55.016 INFO:tasks.workunit.client.0.smithi032.stdout:1/953: dwrite db/d37/d93/dce/df4/d127/ff7 [4194304,4194304] 0 2024-05-06T21:26:55.018 INFO:tasks.workunit.client.1.smithi154.stdout:4/823: rename d0/d82/d44/le0 to d0/d82/d44/d73/d4a/dd4/l114 0 2024-05-06T21:26:55.018 INFO:tasks.workunit.client.1.smithi154.stdout:5/795: dwrite d2/d3/d19/d23/db6/fe9 [0,4194304] 0 2024-05-06T21:26:55.019 INFO:tasks.workunit.client.1.smithi154.stdout:5/796: readlink d2/d3/d21/d95/dd/d2a/d54/d43/db1/lf8 0 2024-05-06T21:26:55.020 INFO:tasks.workunit.client.0.smithi032.stdout:1/954: truncate db/f92 721917 0 2024-05-06T21:26:55.020 INFO:tasks.workunit.client.0.smithi032.stdout:1/955: chown db/l35 1860762111 1 2024-05-06T21:26:55.020 INFO:tasks.workunit.client.0.smithi032.stdout:1/956: write db/fd6 [567323,22477] 0 2024-05-06T21:26:55.023 INFO:tasks.workunit.client.0.smithi032.stdout:1/957: mkdir db/d16/d46/d57/d58/d68/d136 0 2024-05-06T21:26:55.023 INFO:tasks.workunit.client.1.smithi154.stdout:0/886: dwrite d6/dc/d51/f55 [0,4194304] 0 2024-05-06T21:26:55.025 INFO:tasks.workunit.client.0.smithi032.stdout:1/958: symlink db/d16/d46/d57/l137 0 2024-05-06T21:26:55.025 INFO:tasks.workunit.client.0.smithi032.stdout:1/959: fsync db/d16/d5d/f12b 0 2024-05-06T21:26:55.026 INFO:tasks.workunit.client.1.smithi154.stdout:5/797: link d2/d3/d21/d95/dc/d68/c79 d2/d3/d21/d95/dc/c110 0 2024-05-06T21:26:55.027 INFO:tasks.workunit.client.0.smithi032.stdout:1/960: mkdir db/d138 0 2024-05-06T21:26:55.027 INFO:tasks.workunit.client.0.smithi032.stdout:1/961: truncate db/d37/feb 1168551 0 2024-05-06T21:26:55.027 INFO:tasks.workunit.client.0.smithi032.stdout:1/962: chown db/d47/d4a/la5 1 1 2024-05-06T21:26:55.027 INFO:tasks.workunit.client.0.smithi032.stdout:1/963: dread - db/dc8/de7/dfb/f132 zero size 2024-05-06T21:26:55.029 INFO:tasks.workunit.client.1.smithi154.stdout:3/938: dread d0/da/d1a/d28/dbc/d117/dd/f3c [4194304,4194304] 0 2024-05-06T21:26:55.029 INFO:tasks.workunit.client.1.smithi154.stdout:3/939: fdatasync d0/da/d1a/dbf/ff5 0 2024-05-06T21:26:55.030 INFO:tasks.workunit.client.0.smithi032.stdout:1/964: mkdir db/d47/d4a/dcb/d139 0 2024-05-06T21:26:55.032 INFO:tasks.workunit.client.0.smithi032.stdout:1/965: dread db/d16/f75 [0,4194304] 0 2024-05-06T21:26:55.033 INFO:tasks.workunit.client.1.smithi154.stdout:0/887: creat d6/dc/d40/d4a/dac/f126 x:0 0 0 2024-05-06T21:26:55.035 INFO:tasks.workunit.client.1.smithi154.stdout:8/780: dwrite d3/d14/d1a/d29/d32/d40/ff0 [0,4194304] 0 2024-05-06T21:26:55.036 INFO:tasks.workunit.client.1.smithi154.stdout:8/781: read d3/d14/d1a/d45/dcf/db4/fdd [137049,86739] 0 2024-05-06T21:26:55.038 INFO:tasks.workunit.client.1.smithi154.stdout:5/798: mknod d2/d3/d8b/c111 0 2024-05-06T21:26:55.039 INFO:tasks.workunit.client.1.smithi154.stdout:3/940: symlink d0/da/d1a/d28/dbc/d117/d30/l139 0 2024-05-06T21:26:55.043 INFO:tasks.workunit.client.1.smithi154.stdout:8/782: rename d3/d14/d1a/d29/d43/l58 to d3/d14/d1a/d29/d32/d40/d4b/d4d/lf9 0 2024-05-06T21:26:55.045 INFO:tasks.workunit.client.1.smithi154.stdout:8/783: truncate d3/d14/d1a/d29/d32/d40/d79/f4e 2438091 0 2024-05-06T21:26:55.046 INFO:tasks.workunit.client.1.smithi154.stdout:0/888: dread f4 [0,4194304] 0 2024-05-06T21:26:55.047 INFO:tasks.workunit.client.1.smithi154.stdout:8/784: creat d3/d64/d6d/dbd/d6b/ffa x:0 0 0 2024-05-06T21:26:55.048 INFO:tasks.workunit.client.1.smithi154.stdout:9/930: dwrite d5/d2e/f55 [0,4194304] 0 2024-05-06T21:26:55.049 INFO:tasks.workunit.client.0.smithi032.stdout:1/966: dread db/f29 [0,4194304] 0 2024-05-06T21:26:55.050 INFO:tasks.workunit.client.1.smithi154.stdout:4/824: dwrite d0/d82/f77 [0,4194304] 0 2024-05-06T21:26:55.050 INFO:tasks.workunit.client.1.smithi154.stdout:4/825: creat d0/d2/d47/f115 x:0 0 0 2024-05-06T21:26:55.050 INFO:tasks.workunit.client.1.smithi154.stdout:4/826: chown d0/d2/cb3 83928 1 2024-05-06T21:26:55.050 INFO:tasks.workunit.client.1.smithi154.stdout:4/827: write d0/f23 [550560,13250] 0 2024-05-06T21:26:55.053 INFO:tasks.workunit.client.0.smithi032.stdout:1/967: mknod db/d16/d46/d57/d58/c13a 0 2024-05-06T21:26:55.053 INFO:tasks.workunit.client.0.smithi032.stdout:1/968: dread - db/d16/d46/f124 zero size 2024-05-06T21:26:55.071 INFO:tasks.workunit.client.0.smithi032.stdout:1/969: write db/d16/f32 [7133489,43621] 0 2024-05-06T21:26:55.073 INFO:tasks.workunit.client.0.smithi032.stdout:1/970: unlink db/d16/d46/d57/d58/d68/l9d 0 2024-05-06T21:26:55.074 INFO:tasks.workunit.client.0.smithi032.stdout:1/971: getdents db/d47/d4a/da4/d4f/dd0 0 2024-05-06T21:26:55.074 INFO:tasks.workunit.client.0.smithi032.stdout:1/972: write db/d16/d5d/fd8 [3499908,40609] 0 2024-05-06T21:26:55.083 INFO:tasks.workunit.client.1.smithi154.stdout:0/889: dwrite d6/fb1 [0,4194304] 0 2024-05-06T21:26:55.083 INFO:tasks.workunit.client.1.smithi154.stdout:9/931: dwrite d5/d20/d37/dd5/ffe [0,4194304] 0 2024-05-06T21:26:55.084 INFO:tasks.workunit.client.1.smithi154.stdout:9/932: stat d5/d20/d52/d6e/d83/da2/cbc 0 2024-05-06T21:26:55.084 INFO:tasks.workunit.client.1.smithi154.stdout:4/828: dwrite d0/d82/d44/d73/d9a/fac [0,4194304] 0 2024-05-06T21:26:55.084 INFO:tasks.workunit.client.1.smithi154.stdout:4/829: creat d0/d2/f116 x:0 0 0 2024-05-06T21:26:55.098 INFO:tasks.workunit.client.1.smithi154.stdout:5/799: dwrite d2/d3/d19/d23/db6/ff6 [0,4194304] 0 2024-05-06T21:26:55.103 INFO:tasks.workunit.client.1.smithi154.stdout:8/785: dwrite d3/d64/d6d/dbd/f23 [0,4194304] 0 2024-05-06T21:26:55.103 INFO:tasks.workunit.client.1.smithi154.stdout:8/786: chown d3/d14/d1a/d29/d32/d40/d79/d84 0 1 2024-05-06T21:26:55.104 INFO:tasks.workunit.client.1.smithi154.stdout:9/933: rename d5/d20/d52/d6e/fae to d5/d14/f12f 0 2024-05-06T21:26:55.107 INFO:tasks.workunit.client.1.smithi154.stdout:5/800: mkdir d2/d3/d8b/d112 0 2024-05-06T21:26:55.109 INFO:tasks.workunit.client.1.smithi154.stdout:8/787: mkdir d3/d14/d1a/d29/d32/d40/d4b/dfb 0 2024-05-06T21:26:55.111 INFO:tasks.workunit.client.1.smithi154.stdout:5/801: creat d2/d48/f113 x:0 0 0 2024-05-06T21:26:55.111 INFO:tasks.workunit.client.1.smithi154.stdout:5/802: readlink d2/d3/d21/d22/d25/d37/lff 0 2024-05-06T21:26:55.111 INFO:tasks.workunit.client.0.smithi032.stdout:1/973: dwrite db/d37/d52/f6b [0,4194304] 0 2024-05-06T21:26:55.113 INFO:tasks.workunit.client.1.smithi154.stdout:4/830: dwrite d0/d82/d44/d73/d4a/dd4/fa3 [0,4194304] 0 2024-05-06T21:26:55.114 INFO:tasks.workunit.client.0.smithi032.stdout:1/974: getdents db/d37/d93/dce/df4 0 2024-05-06T21:26:55.114 INFO:tasks.workunit.client.0.smithi032.stdout:1/975: fsync db/d16/f18 0 2024-05-06T21:26:55.114 INFO:tasks.workunit.client.0.smithi032.stdout:1/976: chown db/dc8/dfc 7075970 1 2024-05-06T21:26:55.114 INFO:tasks.workunit.client.0.smithi032.stdout:1/977: stat db/d16/d46/d57/d58/f97 0 2024-05-06T21:26:55.115 INFO:tasks.workunit.client.0.smithi032.stdout:1/978: fdatasync db/d16/d46/d57/d58/d68/fc4 0 2024-05-06T21:26:55.115 INFO:tasks.workunit.client.0.smithi032.stdout:1/979: fdatasync db/f92 0 2024-05-06T21:26:55.115 INFO:tasks.workunit.client.1.smithi154.stdout:5/803: link d2/d3/d19/d23/faf d2/d3/d21/d95/dc/d44/d9a/f114 0 2024-05-06T21:26:55.115 INFO:tasks.workunit.client.1.smithi154.stdout:5/804: dread - d2/d3/d21/d22/f109 zero size 2024-05-06T21:26:55.115 INFO:tasks.workunit.client.1.smithi154.stdout:5/805: chown d2/d3/f35 31070 1 2024-05-06T21:26:55.116 INFO:tasks.workunit.client.1.smithi154.stdout:8/788: getdents d3/d64/d6d/dbd/d6b 0 2024-05-06T21:26:55.116 INFO:tasks.workunit.client.1.smithi154.stdout:8/789: chown d3/fb 30259 1 2024-05-06T21:26:55.116 INFO:tasks.workunit.client.0.smithi032.stdout:1/980: mkdir db/d138/d13b 0 2024-05-06T21:26:55.124 INFO:tasks.workunit.client.1.smithi154.stdout:5/806: getdents d2/d3/d19 0 2024-05-06T21:26:55.124 INFO:tasks.workunit.client.1.smithi154.stdout:5/807: fsync d2/d3/d21/d95/dd/f70 0 2024-05-06T21:26:55.125 INFO:tasks.workunit.client.1.smithi154.stdout:8/790: mkdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/dfc 0 2024-05-06T21:26:55.126 INFO:tasks.workunit.client.1.smithi154.stdout:5/808: mkdir d2/d3/d21/d95/dc/d68/d69/d115 0 2024-05-06T21:26:55.127 INFO:tasks.workunit.client.1.smithi154.stdout:8/791: unlink d3/d14/d1a/d29/d3e/l78 0 2024-05-06T21:26:55.137 INFO:tasks.workunit.client.1.smithi154.stdout:2/741: sync 2024-05-06T21:26:55.137 INFO:tasks.workunit.client.1.smithi154.stdout:5/809: dread d2/da5/fe5 [4194304,4194304] 0 2024-05-06T21:26:55.137 INFO:tasks.workunit.client.1.smithi154.stdout:5/810: dread - d2/d3/d21/d95/dd/d2a/d54/dce/fd8 zero size 2024-05-06T21:26:55.137 INFO:tasks.workunit.client.1.smithi154.stdout:9/934: dwrite d5/d20/d52/d6e/d83/da2/fcf [0,4194304] 0 2024-05-06T21:26:55.138 INFO:tasks.workunit.client.1.smithi154.stdout:0/890: dwrite d6/dc/d51/d54/fef [0,4194304] 0 2024-05-06T21:26:55.138 INFO:tasks.workunit.client.1.smithi154.stdout:4/831: dwrite d0/d2/d29/ff5 [0,4194304] 0 2024-05-06T21:26:55.139 INFO:tasks.workunit.client.1.smithi154.stdout:2/742: mkdir db/de/d10/dbc/ded 0 2024-05-06T21:26:55.140 INFO:tasks.workunit.client.1.smithi154.stdout:1/803: sync 2024-05-06T21:26:55.140 INFO:tasks.workunit.client.1.smithi154.stdout:1/804: truncate d6/db/d10/d15/d1d/f57 342866 0 2024-05-06T21:26:55.145 INFO:tasks.workunit.client.1.smithi154.stdout:2/743: getdents db/d12/d19/d4b 0 2024-05-06T21:26:55.146 INFO:tasks.workunit.client.1.smithi154.stdout:2/744: readlink db/de/d10/dbc/ldf 0 2024-05-06T21:26:55.146 INFO:tasks.workunit.client.1.smithi154.stdout:2/745: creat db/d12/d1d/d60/fee x:0 0 0 2024-05-06T21:26:55.146 INFO:tasks.workunit.client.1.smithi154.stdout:2/746: chown db/d12/d19/d4b/d78/f9f 27693 1 2024-05-06T21:26:55.148 INFO:tasks.workunit.client.1.smithi154.stdout:4/832: dread d0/d82/d44/d73/d4a/d74/fa4 [0,4194304] 0 2024-05-06T21:26:55.149 INFO:tasks.workunit.client.1.smithi154.stdout:1/805: rename d6/db/f5b to d6/db/d5e/db8/ff6 0 2024-05-06T21:26:55.153 INFO:tasks.workunit.client.1.smithi154.stdout:2/747: link db/de/d10/dbc/ldf db/d12/d19/d7d/lef 0 2024-05-06T21:26:55.156 INFO:tasks.workunit.client.1.smithi154.stdout:4/833: getdents d0/d82/d44/d73/d4a/dd4/dcd 0 2024-05-06T21:26:55.157 INFO:tasks.workunit.client.1.smithi154.stdout:1/806: symlink d6/db/d10/d26/d1b/lf7 0 2024-05-06T21:26:55.162 INFO:tasks.workunit.client.1.smithi154.stdout:4/834: getdents d0/d72/d76/dbb/dee 0 2024-05-06T21:26:55.162 INFO:tasks.workunit.client.1.smithi154.stdout:4/835: fdatasync d0/d82/d39/f4b 0 2024-05-06T21:26:55.162 INFO:tasks.workunit.client.1.smithi154.stdout:1/807: mknod d6/db/d10/d15/d1d/d53/cf8 0 2024-05-06T21:26:55.162 INFO:tasks.workunit.client.1.smithi154.stdout:5/811: dwrite d2/d3/d19/d23/f86 [0,4194304] 0 2024-05-06T21:26:55.162 INFO:tasks.workunit.client.1.smithi154.stdout:4/836: write d0/d2/f1c [4465849,17020] 0 2024-05-06T21:26:55.163 INFO:tasks.workunit.client.1.smithi154.stdout:3/941: sync 2024-05-06T21:26:55.163 INFO:tasks.workunit.client.1.smithi154.stdout:6/592: sync 2024-05-06T21:26:55.164 INFO:tasks.workunit.client.1.smithi154.stdout:1/808: rename d6/f47 to d6/db/d97/ff9 0 2024-05-06T21:26:55.165 INFO:tasks.workunit.client.1.smithi154.stdout:2/748: read db/de/d16/f27 [2132551,119972] 0 2024-05-06T21:26:55.166 INFO:tasks.workunit.client.1.smithi154.stdout:5/812: mknod d2/d3/d21/d22/d25/c116 0 2024-05-06T21:26:55.167 INFO:tasks.workunit.client.1.smithi154.stdout:4/837: symlink d0/d82/d44/d73/d4a/dd4/l117 0 2024-05-06T21:26:55.168 INFO:tasks.workunit.client.1.smithi154.stdout:6/593: mknod d8/d11/d33/d4a/cbb 0 2024-05-06T21:26:55.169 INFO:tasks.workunit.client.1.smithi154.stdout:2/749: unlink db/de/d16/d4f/ld0 0 2024-05-06T21:26:55.169 INFO:tasks.workunit.client.1.smithi154.stdout:2/750: fdatasync db/d12/d19/d7d/fe6 0 2024-05-06T21:26:55.171 INFO:tasks.workunit.client.1.smithi154.stdout:4/838: rename d0/d82/l108 to d0/d72/d76/db5/db7/df3/l118 0 2024-05-06T21:26:55.172 INFO:tasks.workunit.client.1.smithi154.stdout:6/594: link d8/d11/d2d/d3d/fb2 d8/d11/d2d/d3d/d70/d7b/d95/fbc 0 2024-05-06T21:26:55.173 INFO:tasks.workunit.client.1.smithi154.stdout:9/935: dwrite d5/d20/d52/f4f [0,4194304] 0 2024-05-06T21:26:55.173 INFO:tasks.workunit.client.1.smithi154.stdout:9/936: dread - d5/d20/d52/d59/d102/fe4 zero size 2024-05-06T21:26:55.173 INFO:tasks.workunit.client.1.smithi154.stdout:2/751: unlink db/d12/d19/l2e 0 2024-05-06T21:26:55.174 INFO:tasks.workunit.client.1.smithi154.stdout:7/650: sync 2024-05-06T21:26:55.175 INFO:tasks.workunit.client.1.smithi154.stdout:4/839: link d0/d82/d44/d73/d4a/dd4/d1a/d7e/ce8 d0/d82/d44/d73/d4a/dd4/d1a/dd2/c119 0 2024-05-06T21:26:55.176 INFO:tasks.workunit.client.1.smithi154.stdout:6/595: symlink d8/d11/d2d/da3/lbd 0 2024-05-06T21:26:55.178 INFO:tasks.workunit.client.1.smithi154.stdout:0/891: dwrite d6/dc/d40/d4a/f123 [0,4194304] 0 2024-05-06T21:26:55.178 INFO:tasks.workunit.client.1.smithi154.stdout:0/892: write d6/dc/d40/d4a/d6c/dce/ffc [854065,81295] 0 2024-05-06T21:26:55.178 INFO:tasks.workunit.client.1.smithi154.stdout:0/893: creat d6/dc/d40/d4a/da7/d70/d96/dd5/f127 x:0 0 0 2024-05-06T21:26:55.179 INFO:tasks.workunit.client.1.smithi154.stdout:2/752: unlink db/d12/d19/d7d/fd9 0 2024-05-06T21:26:55.179 INFO:tasks.workunit.client.1.smithi154.stdout:2/753: chown db/de/d10 217 1 2024-05-06T21:26:55.179 INFO:tasks.workunit.client.1.smithi154.stdout:2/754: write db/d12/d1d/feb [1067687,66244] 0 2024-05-06T21:26:55.182 INFO:tasks.workunit.client.1.smithi154.stdout:7/651: rename d6/d54/f58 to d6/d42/d6c/d6e/fd0 0 2024-05-06T21:26:55.182 INFO:tasks.workunit.client.1.smithi154.stdout:6/596: rename d8/d11/d2d/d3d/d4c to d8/d11/d2d/d3d/d4c/dbe 22 2024-05-06T21:26:55.182 INFO:tasks.workunit.client.1.smithi154.stdout:6/597: stat d8/d11/d33/d4a/d6c/l7a 0 2024-05-06T21:26:55.185 INFO:tasks.workunit.client.1.smithi154.stdout:7/652: getdents d6/d20/d85/da2 0 2024-05-06T21:26:55.186 INFO:tasks.workunit.client.1.smithi154.stdout:7/653: write d6/d20/d40/d52/f91 [379736,91773] 0 2024-05-06T21:26:55.187 INFO:tasks.workunit.client.1.smithi154.stdout:7/654: stat d6/d42/d6c/d6e 0 2024-05-06T21:26:55.187 INFO:tasks.workunit.client.1.smithi154.stdout:7/655: dread - d6/d54/d6a/f8a zero size 2024-05-06T21:26:55.187 INFO:tasks.workunit.client.1.smithi154.stdout:6/598: creat d8/d11/d33/d4a/d6c/d8e/fbf x:0 0 0 2024-05-06T21:26:55.191 INFO:tasks.workunit.client.1.smithi154.stdout:6/599: link d8/d11/f69 d8/d11/d2d/d3d/d4c/dba/fc0 0 2024-05-06T21:26:55.192 INFO:tasks.workunit.client.1.smithi154.stdout:0/894: dread d6/dc/d44/f72 [0,4194304] 0 2024-05-06T21:26:55.194 INFO:tasks.workunit.client.1.smithi154.stdout:6/600: mknod d8/d13/da9/cc1 0 2024-05-06T21:26:55.216 INFO:tasks.workunit.client.1.smithi154.stdout:5/813: dwrite d2/d3/d21/d22/d25/f32 [0,4194304] 0 2024-05-06T21:26:55.216 INFO:tasks.workunit.client.1.smithi154.stdout:5/814: dread - d2/d3/d21/d95/dd/fb9 zero size 2024-05-06T21:26:55.218 INFO:tasks.workunit.client.1.smithi154.stdout:9/937: dwrite d5/d20/d37/dd5/de1/de6/f109 [0,4194304] 0 2024-05-06T21:26:55.219 INFO:tasks.workunit.client.1.smithi154.stdout:5/815: creat d2/d3/d19/d23/df9/dfd/f117 x:0 0 0 2024-05-06T21:26:55.222 INFO:tasks.workunit.client.1.smithi154.stdout:4/840: truncate d0/d2/f1c 2140132 0 2024-05-06T21:26:55.223 INFO:tasks.workunit.client.1.smithi154.stdout:4/841: chown d0/d82/d44/d73/d4a/dd4/f46 48247 1 2024-05-06T21:26:55.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:54 smithi032 ceph-mon[27179]: pgmap v28: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 287 MiB/s rd, 324 MiB/s wr, 457 op/s 2024-05-06T21:26:55.224 INFO:tasks.workunit.client.1.smithi154.stdout:3/942: dwrite d0/da/d1a/d28/dbc/d117/d52/d62/fe0 [4194304,4194304] 0 2024-05-06T21:26:55.225 INFO:tasks.workunit.client.1.smithi154.stdout:2/755: dwrite db/d12/d19/d4b/db2/fea [0,4194304] 0 2024-05-06T21:26:55.225 INFO:tasks.workunit.client.1.smithi154.stdout:6/601: dwrite d8/d13/d20/f5a [0,4194304] 0 2024-05-06T21:26:55.225 INFO:tasks.workunit.client.1.smithi154.stdout:6/602: dread - d8/d11/d33/f8c zero size 2024-05-06T21:26:55.225 INFO:tasks.workunit.client.1.smithi154.stdout:6/603: write d8/d11/d33/d4a/f54 [147292,15019] 0 2024-05-06T21:26:55.225 INFO:tasks.workunit.client.1.smithi154.stdout:6/604: write f6 [1587105,127346] 0 2024-05-06T21:26:55.225 INFO:tasks.workunit.client.1.smithi154.stdout:4/842: truncate d0/d2/fd8 3642 0 2024-05-06T21:26:55.225 INFO:tasks.workunit.client.1.smithi154.stdout:0/895: dwrite d6/dc/d40/d4a/d6c/f9e [0,4194304] 0 2024-05-06T21:26:55.225 INFO:tasks.workunit.client.1.smithi154.stdout:0/896: write d6/dc/d51/d54/dbd/f113 [19034,28972] 0 2024-05-06T21:26:55.236 INFO:tasks.workunit.client.1.smithi154.stdout:2/756: symlink db/d12/d19/d4b/dcb/lf0 0 2024-05-06T21:26:55.240 INFO:tasks.workunit.client.1.smithi154.stdout:7/656: dwrite d6/d20/d40/d52/d81/fc0 [0,4194304] 0 2024-05-06T21:26:55.240 INFO:tasks.workunit.client.1.smithi154.stdout:7/657: read - d6/d20/d40/daf/d5c/f7c zero size 2024-05-06T21:26:55.240 INFO:tasks.workunit.client.1.smithi154.stdout:7/658: dread - d6/d20/d40/daf/d5c/f7c zero size 2024-05-06T21:26:55.242 INFO:tasks.workunit.client.1.smithi154.stdout:5/816: dread d2/d3/d21/d22/f36 [0,4194304] 0 2024-05-06T21:26:55.242 INFO:tasks.workunit.client.1.smithi154.stdout:9/938: dwrite d5/f8 [0,4194304] 0 2024-05-06T21:26:55.242 INFO:tasks.workunit.client.1.smithi154.stdout:0/897: write d6/fa8 [2409446,87083] 0 2024-05-06T21:26:55.242 INFO:tasks.workunit.client.1.smithi154.stdout:4/843: mknod d0/d82/d44/d73/d4a/dd4/d1a/d10b/c11a 0 2024-05-06T21:26:55.247 INFO:tasks.workunit.client.1.smithi154.stdout:2/757: mknod db/d12/d1d/d60/d63/cf1 0 2024-05-06T21:26:55.249 INFO:tasks.workunit.client.1.smithi154.stdout:7/659: unlink d6/d20/d40/d52/d81/c8f 0 2024-05-06T21:26:55.250 INFO:tasks.workunit.client.1.smithi154.stdout:7/660: dread - d6/d42/d6c/d6e/fb4 zero size 2024-05-06T21:26:55.250 INFO:tasks.workunit.client.1.smithi154.stdout:7/661: truncate d6/d20/d40/daf/d5c/f7c 253449 0 2024-05-06T21:26:55.251 INFO:tasks.workunit.client.1.smithi154.stdout:5/817: write d2/d3/d19/d23/db6/fe9 [2536367,118448] 0 2024-05-06T21:26:55.262 INFO:tasks.workunit.client.1.smithi154.stdout:9/939: creat d5/d2e/dee/f130 x:0 0 0 2024-05-06T21:26:55.269 INFO:tasks.workunit.client.1.smithi154.stdout:0/898: rename d6/dc/d40/d4a/da3 to d6/dc/d40/d4a/da7/d70/d128 0 2024-05-06T21:26:55.269 INFO:tasks.workunit.client.1.smithi154.stdout:0/899: write d6/dc/d51/d54/dbd/ffb [893764,3669] 0 2024-05-06T21:26:55.269 INFO:tasks.workunit.client.1.smithi154.stdout:0/900: creat d6/dc/d44/d36/f129 x:0 0 0 2024-05-06T21:26:55.269 INFO:tasks.workunit.client.1.smithi154.stdout:0/901: fsync d6/dc/d40/d85/db2/dbb/fbc 0 2024-05-06T21:26:55.271 INFO:tasks.workunit.client.1.smithi154.stdout:2/758: link db/de/d16/f27 db/de/d10/ff2 0 2024-05-06T21:26:55.272 INFO:tasks.workunit.client.1.smithi154.stdout:7/662: mkdir d6/d42/dd1 0 2024-05-06T21:26:55.273 INFO:tasks.workunit.client.1.smithi154.stdout:5/818: dwrite d2/d3/d21/d95/dd/d2a/d54/d43/fec [0,4194304] 0 2024-05-06T21:26:55.277 INFO:tasks.workunit.client.1.smithi154.stdout:3/943: dwrite d0/da/d1a/d28/dbc/f9b [0,4194304] 0 2024-05-06T21:26:55.277 INFO:tasks.workunit.client.1.smithi154.stdout:3/944: fsync d0/d2/fb6 0 2024-05-06T21:26:55.278 INFO:tasks.workunit.client.1.smithi154.stdout:9/940: unlink d5/d14/d3a/l7a 0 2024-05-06T21:26:55.281 INFO:tasks.workunit.client.1.smithi154.stdout:2/759: read db/de/d16/f65 [5052676,55248] 0 2024-05-06T21:26:55.281 INFO:tasks.workunit.client.1.smithi154.stdout:4/844: rename d0/d10/f41 to d0/d2/d47/f11b 0 2024-05-06T21:26:55.285 INFO:tasks.workunit.client.1.smithi154.stdout:0/902: mknod d6/dc/d40/d85/db2/dbb/dff/d121/c12a 0 2024-05-06T21:26:55.288 INFO:tasks.workunit.client.1.smithi154.stdout:7/663: mkdir d6/d42/d6c/dd2 0 2024-05-06T21:26:55.289 INFO:tasks.workunit.client.1.smithi154.stdout:7/664: stat d6/d20/c2f 0 2024-05-06T21:26:55.298 INFO:tasks.workunit.client.1.smithi154.stdout:3/945: link d0/da/d1a/d28/dbc/ca2 d0/dd5/d11c/c13a 0 2024-05-06T21:26:55.298 INFO:tasks.workunit.client.1.smithi154.stdout:7/665: read d6/fd [7940187,124983] 0 2024-05-06T21:26:55.300 INFO:tasks.workunit.client.1.smithi154.stdout:0/903: mknod d6/dc/d40/d4a/da7/d70/d96/c12b 0 2024-05-06T21:26:55.303 INFO:tasks.workunit.client.1.smithi154.stdout:3/946: creat d0/da/d1a/d28/dbc/d117/dd/d1c/d90/d112/d118/f13b x:0 0 0 2024-05-06T21:26:55.303 INFO:tasks.workunit.client.1.smithi154.stdout:3/947: write d0/da/d1a/d28/dbc/d81/d48/f11f [417069,113092] 0 2024-05-06T21:26:55.304 INFO:tasks.workunit.client.1.smithi154.stdout:7/666: mkdir d6/d20/d40/d52/d8b/dd3 0 2024-05-06T21:26:55.306 INFO:tasks.workunit.client.1.smithi154.stdout:0/904: creat d6/dc/d40/d85/db2/dbb/dff/d121/f12c x:0 0 0 2024-05-06T21:26:55.306 INFO:tasks.workunit.client.1.smithi154.stdout:0/905: write d6/d27/f28 [5018540,50992] 0 2024-05-06T21:26:55.306 INFO:tasks.workunit.client.1.smithi154.stdout:3/948: getdents d0/da/d1a/d28/dbc/d117 0 2024-05-06T21:26:55.307 INFO:tasks.workunit.client.1.smithi154.stdout:7/667: mknod d6/d20/d40/d52/d81/cd4 0 2024-05-06T21:26:55.309 INFO:tasks.workunit.client.1.smithi154.stdout:8/792: sync 2024-05-06T21:26:55.309 INFO:tasks.workunit.client.1.smithi154.stdout:0/906: rename d6/dc/d44/d36/d89/faa to d6/dc/d51/d54/f12d 0 2024-05-06T21:26:55.310 INFO:tasks.workunit.client.1.smithi154.stdout:7/668: creat d6/d20/d40/d52/d8b/dd3/fd5 x:0 0 0 2024-05-06T21:26:55.311 INFO:tasks.workunit.client.1.smithi154.stdout:7/669: creat d6/d54/d5b/dc5/fd6 x:0 0 0 2024-05-06T21:26:55.311 INFO:tasks.workunit.client.1.smithi154.stdout:0/907: dread d6/dc/d40/d4a/da7/d70/d96/dd5/fe5 [0,4194304] 0 2024-05-06T21:26:55.312 INFO:tasks.workunit.client.1.smithi154.stdout:8/793: mkdir d3/d14/d1a/d29/d32/d40/dfd 0 2024-05-06T21:26:55.314 INFO:tasks.workunit.client.1.smithi154.stdout:9/941: dwrite d5/d14/d3a/fa1 [0,4194304] 0 2024-05-06T21:26:55.314 INFO:tasks.workunit.client.1.smithi154.stdout:7/670: mkdir d6/d42/d6c/d6e/d21/d69/dd7 0 2024-05-06T21:26:55.314 INFO:tasks.workunit.client.1.smithi154.stdout:2/760: dwrite db/d12/d19/f56 [0,4194304] 0 2024-05-06T21:26:55.315 INFO:tasks.workunit.client.1.smithi154.stdout:0/908: symlink d6/dc/d40/d4a/da7/d70/d128/d10d/l12e 0 2024-05-06T21:26:55.316 INFO:tasks.workunit.client.1.smithi154.stdout:4/845: dwrite d0/fa2 [0,4194304] 0 2024-05-06T21:26:55.317 INFO:tasks.workunit.client.1.smithi154.stdout:8/794: creat d3/d38/ffe x:0 0 0 2024-05-06T21:26:55.318 INFO:tasks.workunit.client.1.smithi154.stdout:9/942: creat d5/d14/f131 x:0 0 0 2024-05-06T21:26:55.320 INFO:tasks.workunit.client.1.smithi154.stdout:7/671: creat d6/d42/d6c/d6e/d21/fd8 x:0 0 0 2024-05-06T21:26:55.320 INFO:tasks.workunit.client.1.smithi154.stdout:7/672: truncate d6/d42/d6c/d6e/d21/d2e/d9d/fc9 835594 0 2024-05-06T21:26:55.327 INFO:tasks.workunit.client.1.smithi154.stdout:2/761: dread db/d12/d19/f56 [0,4194304] 0 2024-05-06T21:26:55.328 INFO:tasks.workunit.client.1.smithi154.stdout:4/846: mkdir d0/d2/d29/d11c 0 2024-05-06T21:26:55.328 INFO:tasks.workunit.client.1.smithi154.stdout:3/949: dwrite d0/da/d1a/d28/dbc/d81/d48/da9/fb7 [0,4194304] 0 2024-05-06T21:26:55.329 INFO:tasks.workunit.client.1.smithi154.stdout:8/795: creat d3/d14/d1a/d29/d32/d40/dfd/fff x:0 0 0 2024-05-06T21:26:55.329 INFO:tasks.workunit.client.1.smithi154.stdout:8/796: fdatasync d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/fd0 0 2024-05-06T21:26:55.330 INFO:tasks.workunit.client.1.smithi154.stdout:0/909: getdents d6/dc/d44/d36 0 2024-05-06T21:26:55.331 INFO:tasks.workunit.client.1.smithi154.stdout:9/943: read d5/d20/d52/d6e/d83/fdb [2673029,86847] 0 2024-05-06T21:26:55.332 INFO:tasks.workunit.client.1.smithi154.stdout:2/762: link db/f3c db/d12/d1d/d60/d63/de2/ff3 0 2024-05-06T21:26:55.332 INFO:tasks.workunit.client.1.smithi154.stdout:7/673: write d6/d20/d40/d52/f88 [56291,92439] 0 2024-05-06T21:26:55.336 INFO:tasks.workunit.client.1.smithi154.stdout:0/910: mknod d6/dc/d40/d85/db2/dbb/dff/c12f 0 2024-05-06T21:26:55.336 INFO:tasks.workunit.client.1.smithi154.stdout:1/809: sync 2024-05-06T21:26:55.338 INFO:tasks.workunit.client.1.smithi154.stdout:2/763: mknod db/de/d10/cf4 0 2024-05-06T21:26:55.344 INFO:tasks.workunit.client.1.smithi154.stdout:1/810: link d6/db/d69/l8c d6/db/d10/d26/d1b/lfa 0 2024-05-06T21:26:55.345 INFO:tasks.workunit.client.1.smithi154.stdout:9/944: dread d5/d14/f60 [0,4194304] 0 2024-05-06T21:26:55.345 INFO:tasks.workunit.client.1.smithi154.stdout:9/945: fsync d5/d14/f30 0 2024-05-06T21:26:55.346 INFO:tasks.workunit.client.1.smithi154.stdout:1/811: creat d6/db/d69/d89/ffb x:0 0 0 2024-05-06T21:26:55.348 INFO:tasks.workunit.client.1.smithi154.stdout:9/946: symlink d5/d2e/d8b/dc6/d103/l132 0 2024-05-06T21:26:55.348 INFO:tasks.workunit.client.1.smithi154.stdout:9/947: truncate d5/d20/d52/d59/f124 387488 0 2024-05-06T21:26:55.348 INFO:tasks.workunit.client.1.smithi154.stdout:9/948: dread d5/f73 [0,4194304] 0 2024-05-06T21:26:55.348 INFO:tasks.workunit.client.1.smithi154.stdout:9/949: write d5/d14/f30 [607217,8247] 0 2024-05-06T21:26:55.349 INFO:tasks.workunit.client.1.smithi154.stdout:1/812: truncate d6/f66 136277 0 2024-05-06T21:26:55.349 INFO:tasks.workunit.client.1.smithi154.stdout:1/813: chown d6/db/d10/d15 11301108 1 2024-05-06T21:26:55.349 INFO:tasks.workunit.client.1.smithi154.stdout:1/814: truncate d6/db/d69/fde 971949 0 2024-05-06T21:26:55.354 INFO:tasks.workunit.client.1.smithi154.stdout:9/950: rename d5/d14/d87/f9e to d5/d20/d37/f133 0 2024-05-06T21:26:55.359 INFO:tasks.workunit.client.1.smithi154.stdout:9/951: rename d5/f28 to d5/d2e/d7f/f134 0 2024-05-06T21:26:55.360 INFO:tasks.workunit.client.1.smithi154.stdout:9/952: chown d5/d14/daf/f10f 5892 1 2024-05-06T21:26:55.361 INFO:tasks.workunit.client.1.smithi154.stdout:9/953: chown d5/d2e/d66/l10a 39 1 2024-05-06T21:26:55.362 INFO:tasks.workunit.client.1.smithi154.stdout:9/954: stat d5/d20/f2c 0 2024-05-06T21:26:55.362 INFO:tasks.workunit.client.1.smithi154.stdout:9/955: write d5/d14/daf/f10f [946968,117149] 0 2024-05-06T21:26:55.367 INFO:tasks.workunit.client.1.smithi154.stdout:4/847: dwrite d0/d2/dc/f18 [0,4194304] 0 2024-05-06T21:26:55.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:54 smithi154 ceph-mon[32880]: pgmap v28: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 287 MiB/s rd, 324 MiB/s wr, 457 op/s 2024-05-06T21:26:55.372 INFO:tasks.workunit.client.1.smithi154.stdout:4/848: dread d0/d2/d29/fa5 [0,4194304] 0 2024-05-06T21:26:55.372 INFO:tasks.workunit.client.1.smithi154.stdout:4/849: chown d0/d82/d44/d73/d4a/dd4/d1a/f10d 11690 1 2024-05-06T21:26:55.372 INFO:tasks.workunit.client.1.smithi154.stdout:4/850: read - d0/d82/d44/d73/d4a/d74/d75/f99 zero size 2024-05-06T21:26:55.373 INFO:tasks.workunit.client.1.smithi154.stdout:4/851: chown d0/d2/fcb 158186 1 2024-05-06T21:26:55.374 INFO:tasks.workunit.client.1.smithi154.stdout:0/911: dwrite d6/dc/d51/f80 [0,4194304] 0 2024-05-06T21:26:55.375 INFO:tasks.workunit.client.1.smithi154.stdout:7/674: dwrite d6/d42/d6c/d6e/d5e/f71 [0,4194304] 0 2024-05-06T21:26:55.375 INFO:tasks.workunit.client.1.smithi154.stdout:7/675: dread d6/d20/d40/daf/d5c/f7c [0,4194304] 0 2024-05-06T21:26:55.377 INFO:tasks.workunit.client.1.smithi154.stdout:4/852: creat d0/d82/d39/df7/f11d x:0 0 0 2024-05-06T21:26:55.379 INFO:tasks.workunit.client.1.smithi154.stdout:0/912: dread d6/dc/d3c/f7d [4194304,4194304] 0 2024-05-06T21:26:55.384 INFO:tasks.workunit.client.1.smithi154.stdout:7/676: mkdir d6/d42/d6c/d6e/d21/d69/d7b/dd9 0 2024-05-06T21:26:55.384 INFO:tasks.workunit.client.1.smithi154.stdout:7/677: read d6/d20/d40/daf/d5c/f7c [181948,112235] 0 2024-05-06T21:26:55.385 INFO:tasks.workunit.client.1.smithi154.stdout:4/853: mknod d0/d82/d39/da6/c11e 0 2024-05-06T21:26:55.386 INFO:tasks.workunit.client.1.smithi154.stdout:0/913: getdents d6/dc/d39 0 2024-05-06T21:26:55.386 INFO:tasks.workunit.client.1.smithi154.stdout:0/914: stat d6/dc/d42/c5b 0 2024-05-06T21:26:55.388 INFO:tasks.workunit.client.1.smithi154.stdout:7/678: link d6/d42/d6c/d6e/c95 d6/d20/cda 0 2024-05-06T21:26:55.389 INFO:tasks.workunit.client.1.smithi154.stdout:4/854: mkdir d0/d72/d76/dc7/d11f 0 2024-05-06T21:26:55.390 INFO:tasks.workunit.client.1.smithi154.stdout:1/815: dwrite d6/d3e/d7e/da5/da8/faf [0,4194304] 0 2024-05-06T21:26:55.390 INFO:tasks.workunit.client.1.smithi154.stdout:1/816: fsync d6/db/d5e/db8/ff6 0 2024-05-06T21:26:55.391 INFO:tasks.workunit.client.1.smithi154.stdout:2/764: dwrite db/de/d10/f25 [0,4194304] 0 2024-05-06T21:26:55.391 INFO:tasks.workunit.client.1.smithi154.stdout:9/956: dwrite d5/d20/d52/f57 [0,4194304] 0 2024-05-06T21:26:55.397 INFO:tasks.workunit.client.1.smithi154.stdout:0/915: dread d6/dc/f2f [0,4194304] 0 2024-05-06T21:26:55.399 INFO:tasks.workunit.client.1.smithi154.stdout:2/765: symlink db/d12/d1d/lf5 0 2024-05-06T21:26:55.399 INFO:tasks.workunit.client.1.smithi154.stdout:2/766: dread - db/de/d10/fde zero size 2024-05-06T21:26:55.401 INFO:tasks.workunit.client.1.smithi154.stdout:9/957: mkdir d5/d20/d52/d6e/d104/d135 0 2024-05-06T21:26:55.404 INFO:tasks.workunit.client.1.smithi154.stdout:0/916: creat d6/dc/d40/d4a/d6c/d8a/f130 x:0 0 0 2024-05-06T21:26:55.407 INFO:tasks.workunit.client.1.smithi154.stdout:2/767: symlink db/d12/d19/d4b/db2/dca/lf6 0 2024-05-06T21:26:55.412 INFO:tasks.workunit.client.1.smithi154.stdout:0/917: mknod d6/d27/c131 0 2024-05-06T21:26:55.412 INFO:tasks.workunit.client.1.smithi154.stdout:0/918: fsync d6/dc/d40/d4a/da7/d70/f7e 0 2024-05-06T21:26:55.413 INFO:tasks.workunit.client.1.smithi154.stdout:2/768: dread db/d12/f37 [0,4194304] 0 2024-05-06T21:26:55.414 INFO:tasks.workunit.client.1.smithi154.stdout:9/958: getdents d5/d20/d52/d6e 0 2024-05-06T21:26:55.415 INFO:tasks.workunit.client.1.smithi154.stdout:9/959: read d5/f76 [2307698,75200] 0 2024-05-06T21:26:55.416 INFO:tasks.workunit.client.1.smithi154.stdout:0/919: creat d6/dc/d44/f132 x:0 0 0 2024-05-06T21:26:55.417 INFO:tasks.workunit.client.1.smithi154.stdout:2/769: mknod db/d86/cf7 0 2024-05-06T21:26:55.418 INFO:tasks.workunit.client.1.smithi154.stdout:9/960: creat d5/d14/d3a/f136 x:0 0 0 2024-05-06T21:26:55.419 INFO:tasks.workunit.client.1.smithi154.stdout:1/817: dwrite d6/db/d10/d26/f7d [0,4194304] 0 2024-05-06T21:26:55.420 INFO:tasks.workunit.client.1.smithi154.stdout:0/920: mkdir d6/dc/d39/d133 0 2024-05-06T21:26:55.421 INFO:tasks.workunit.client.1.smithi154.stdout:0/921: read d6/dc/d42/f7f [13962,60362] 0 2024-05-06T21:26:55.421 INFO:tasks.workunit.client.1.smithi154.stdout:0/922: dread - d6/dc/d40/d5e/fe1 zero size 2024-05-06T21:26:55.421 INFO:tasks.workunit.client.1.smithi154.stdout:0/923: fsync d6/dc/d40/d4a/d6c/f9e 0 2024-05-06T21:26:55.422 INFO:tasks.workunit.client.1.smithi154.stdout:9/961: mknod d5/d14/d87/c137 0 2024-05-06T21:26:55.422 INFO:tasks.workunit.client.1.smithi154.stdout:9/962: chown d5/d20/d52/d114/c3f 767402 1 2024-05-06T21:26:55.423 INFO:tasks.workunit.client.1.smithi154.stdout:6/605: sync 2024-05-06T21:26:55.423 INFO:tasks.workunit.client.1.smithi154.stdout:6/606: write d8/d11/d33/d4a/d6c/d8e/fbf [703379,71808] 0 2024-05-06T21:26:55.423 INFO:tasks.workunit.client.1.smithi154.stdout:6/607: fdatasync d8/f2b 0 2024-05-06T21:26:55.427 INFO:tasks.workunit.client.1.smithi154.stdout:1/818: symlink d6/db/d10/de5/lfc 0 2024-05-06T21:26:55.427 INFO:tasks.workunit.client.1.smithi154.stdout:1/819: fsync d6/db/d10/d26/f6b 0 2024-05-06T21:26:55.427 INFO:tasks.workunit.client.1.smithi154.stdout:7/679: dwrite d6/d20/d40/daf/f83 [0,4194304] 0 2024-05-06T21:26:55.428 INFO:tasks.workunit.client.1.smithi154.stdout:4/855: dwrite d0/d82/d44/d73/d9a/fac [0,4194304] 0 2024-05-06T21:26:55.428 INFO:tasks.workunit.client.1.smithi154.stdout:0/924: rmdir d6/dc/d51/d54 39 2024-05-06T21:26:55.431 INFO:tasks.workunit.client.1.smithi154.stdout:6/608: unlink f6 0 2024-05-06T21:26:55.433 INFO:tasks.workunit.client.1.smithi154.stdout:2/770: dwrite db/de/fe9 [0,4194304] 0 2024-05-06T21:26:55.433 INFO:tasks.workunit.client.1.smithi154.stdout:2/771: creat db/d12/d19/d7d/ff8 x:0 0 0 2024-05-06T21:26:55.433 INFO:tasks.workunit.client.1.smithi154.stdout:1/820: link d6/db/d10/fa9 d6/db/d97/ffd 0 2024-05-06T21:26:55.434 INFO:tasks.workunit.client.1.smithi154.stdout:1/821: chown d6/db/f6f 445509 1 2024-05-06T21:26:55.434 INFO:tasks.workunit.client.1.smithi154.stdout:1/822: dread - d6/db/d69/fe3 zero size 2024-05-06T21:26:55.434 INFO:tasks.workunit.client.1.smithi154.stdout:1/823: readlink d6/d3e/d7e/da5/la6 0 2024-05-06T21:26:55.437 INFO:tasks.workunit.client.1.smithi154.stdout:7/680: symlink d6/d54/d6a/ldb 0 2024-05-06T21:26:55.441 INFO:tasks.workunit.client.1.smithi154.stdout:0/925: rmdir d6/dc/d40/d10c/d119 39 2024-05-06T21:26:55.445 INFO:tasks.workunit.client.1.smithi154.stdout:6/609: dread d8/d11/f6d [0,4194304] 0 2024-05-06T21:26:55.446 INFO:tasks.workunit.client.1.smithi154.stdout:1/824: symlink d6/db/d10/d15/d1d/d53/lfe 0 2024-05-06T21:26:55.446 INFO:tasks.workunit.client.1.smithi154.stdout:1/825: chown d6/db/d69/f71 0 1 2024-05-06T21:26:55.446 INFO:tasks.workunit.client.1.smithi154.stdout:0/926: mknod d6/c134 0 2024-05-06T21:26:55.447 INFO:tasks.workunit.client.1.smithi154.stdout:0/927: fdatasync d6/dc/d44/d36/f4d 0 2024-05-06T21:26:55.449 INFO:tasks.workunit.client.1.smithi154.stdout:3/950: sync 2024-05-06T21:26:55.449 INFO:tasks.workunit.client.1.smithi154.stdout:8/797: sync 2024-05-06T21:26:55.449 INFO:tasks.workunit.client.1.smithi154.stdout:5/819: sync 2024-05-06T21:26:55.450 INFO:tasks.workunit.client.1.smithi154.stdout:3/951: write d0/da/d1a/d28/dbc/d117/d7c/fb9 [1627090,50165] 0 2024-05-06T21:26:55.450 INFO:tasks.workunit.client.1.smithi154.stdout:2/772: write db/d12/d19/f56 [4039863,33164] 0 2024-05-06T21:26:55.451 INFO:tasks.workunit.client.1.smithi154.stdout:4/856: dwrite d0/d2/d29/fd0 [0,4194304] 0 2024-05-06T21:26:55.451 INFO:tasks.workunit.client.1.smithi154.stdout:4/857: fsync d0/d82/d3d/dab/fcf 0 2024-05-06T21:26:55.451 INFO:tasks.workunit.client.1.smithi154.stdout:4/858: write d0/d2/f116 [114928,128197] 0 2024-05-06T21:26:55.451 INFO:tasks.workunit.client.1.smithi154.stdout:5/820: rmdir d2/d3/d19/dbe 39 2024-05-06T21:26:55.452 INFO:tasks.workunit.client.1.smithi154.stdout:5/821: creat d2/d48/f118 x:0 0 0 2024-05-06T21:26:55.452 INFO:tasks.workunit.client.1.smithi154.stdout:8/798: mkdir d3/d14/d1a/d45/dcf/db4/d100 0 2024-05-06T21:26:55.452 INFO:tasks.workunit.client.1.smithi154.stdout:8/799: write d3/d14/d1a/d29/d32/fe4 [57561,53315] 0 2024-05-06T21:26:55.453 INFO:tasks.workunit.client.1.smithi154.stdout:3/952: creat d0/da/d1a/d28/dbc/d117/f13c x:0 0 0 2024-05-06T21:26:55.454 INFO:tasks.workunit.client.1.smithi154.stdout:2/773: truncate db/d12/d4e/d55/f5e 2465880 0 2024-05-06T21:26:55.458 INFO:tasks.workunit.client.1.smithi154.stdout:2/774: dread db/d12/f37 [0,4194304] 0 2024-05-06T21:26:55.458 INFO:tasks.workunit.client.1.smithi154.stdout:2/775: stat db/de/d10/dbc/ld1 0 2024-05-06T21:26:55.460 INFO:tasks.workunit.client.1.smithi154.stdout:8/800: symlink d3/d9f/l101 0 2024-05-06T21:26:55.460 INFO:tasks.workunit.client.1.smithi154.stdout:5/822: truncate d2/d3/d21/d95/dd/d2a/d54/d43/d73/f82 1001655 0 2024-05-06T21:26:55.460 INFO:tasks.workunit.client.1.smithi154.stdout:3/953: mkdir d0/da/d1a/d28/dbc/d117/d52/d62/d13d 0 2024-05-06T21:26:55.463 INFO:tasks.workunit.client.1.smithi154.stdout:4/859: getdents d0/d82/d44/d73 0 2024-05-06T21:26:55.464 INFO:tasks.workunit.client.1.smithi154.stdout:5/823: truncate d2/d3/d19/d23/f84 2840670 0 2024-05-06T21:26:55.465 INFO:tasks.workunit.client.1.smithi154.stdout:5/824: write d2/d3/d21/d95/dd/d2a/d8d/f9c [929464,103724] 0 2024-05-06T21:26:55.465 INFO:tasks.workunit.client.1.smithi154.stdout:5/825: fdatasync d2/d3/d21/d95/dc/fae 0 2024-05-06T21:26:55.468 INFO:tasks.workunit.client.1.smithi154.stdout:5/826: mkdir d2/d3/d21/d95/dd/d2a/dbb/d119 0 2024-05-06T21:26:55.470 INFO:tasks.workunit.client.1.smithi154.stdout:2/776: write db/d12/d4e/d55/f7a [3280842,131060] 0 2024-05-06T21:26:55.470 INFO:tasks.workunit.client.1.smithi154.stdout:2/777: write db/d12/d4e/fcd [885265,96118] 0 2024-05-06T21:26:55.472 INFO:tasks.workunit.client.1.smithi154.stdout:0/928: dwrite d6/dc/d51/d54/fef [0,4194304] 0 2024-05-06T21:26:55.476 INFO:tasks.workunit.client.1.smithi154.stdout:6/610: dwrite d8/d11/d2d/d3d/d70/d7b/d95/fa7 [0,4194304] 0 2024-05-06T21:26:55.477 INFO:tasks.workunit.client.1.smithi154.stdout:2/778: mknod db/d12/d19/d4b/db2/cf9 0 2024-05-06T21:26:55.478 INFO:tasks.workunit.client.1.smithi154.stdout:2/779: write db/d12/d4e/fcd [817165,3595] 0 2024-05-06T21:26:55.481 INFO:tasks.workunit.client.1.smithi154.stdout:5/827: rename d2/d3/d21/d22/f36 to d2/d3/d21/d95/dc/d71/f11a 0 2024-05-06T21:26:55.481 INFO:tasks.workunit.client.1.smithi154.stdout:5/828: write d2/d3/d21/d95/dc/d68/d69/fc2 [407332,29038] 0 2024-05-06T21:26:55.484 INFO:tasks.workunit.client.1.smithi154.stdout:6/611: rmdir d8/d13/da9 39 2024-05-06T21:26:55.487 INFO:tasks.workunit.client.1.smithi154.stdout:2/780: mkdir db/d12/d19/d4b/d78/de8/dfa 0 2024-05-06T21:26:55.490 INFO:tasks.workunit.client.1.smithi154.stdout:2/781: getdents db/d12/dbf/dd7 0 2024-05-06T21:26:55.492 INFO:tasks.workunit.client.1.smithi154.stdout:2/782: mknod db/d12/d19/cfb 0 2024-05-06T21:26:55.493 INFO:tasks.workunit.client.1.smithi154.stdout:2/783: fsync db/d12/d4e/d55/f5e 0 2024-05-06T21:26:55.495 INFO:tasks.workunit.client.1.smithi154.stdout:5/829: dread d2/d48/f7c [0,4194304] 0 2024-05-06T21:26:55.496 INFO:tasks.workunit.client.1.smithi154.stdout:1/826: dwrite d6/db/d10/f33 [0,4194304] 0 2024-05-06T21:26:55.497 INFO:tasks.workunit.client.0.smithi032.stdout:1/981: sync 2024-05-06T21:26:55.499 INFO:tasks.workunit.client.1.smithi154.stdout:5/830: rmdir d2/da5 39 2024-05-06T21:26:55.499 INFO:tasks.workunit.client.0.smithi032.stdout:1/982: mkdir db/dc8/de7/d13c 0 2024-05-06T21:26:55.502 INFO:tasks.workunit.client.0.smithi032.stdout:1/983: unlink db/d16/d5d/l65 0 2024-05-06T21:26:55.502 INFO:tasks.workunit.client.0.smithi032.stdout:1/984: dread - db/d16/d46/d55/f6a zero size 2024-05-06T21:26:55.502 INFO:tasks.workunit.client.1.smithi154.stdout:5/831: creat d2/d3/d21/d95/dc/d44/f11b x:0 0 0 2024-05-06T21:26:55.502 INFO:tasks.workunit.client.1.smithi154.stdout:5/832: truncate d2/d3/d21/d22/d25/db0/f106 366092 0 2024-05-06T21:26:55.503 INFO:tasks.workunit.client.0.smithi032.stdout:1/985: creat db/d37/d93/dce/df4/f13d x:0 0 0 2024-05-06T21:26:55.503 INFO:tasks.workunit.client.1.smithi154.stdout:5/833: rmdir d2/d3/d21/d22/d25 39 2024-05-06T21:26:55.503 INFO:tasks.workunit.client.1.smithi154.stdout:5/834: creat d2/d3/d21/d95/dc/d44/d9a/f11c x:0 0 0 2024-05-06T21:26:55.503 INFO:tasks.workunit.client.1.smithi154.stdout:5/835: write d2/da5/fc1 [848704,85638] 0 2024-05-06T21:26:55.504 INFO:tasks.workunit.client.0.smithi032.stdout:1/986: rmdir db/d47/d4a/dcb/df1 39 2024-05-06T21:26:55.505 INFO:tasks.workunit.client.1.smithi154.stdout:5/836: symlink d2/d48/l11d 0 2024-05-06T21:26:55.505 INFO:tasks.workunit.client.1.smithi154.stdout:5/837: write d2/d3/d21/d95/dc/d68/f9e [306002,120130] 0 2024-05-06T21:26:55.518 INFO:tasks.workunit.client.1.smithi154.stdout:4/860: dwrite d0/d82/d44/d73/d4a/dd4/fa3 [0,4194304] 0 2024-05-06T21:26:55.528 INFO:tasks.workunit.client.1.smithi154.stdout:4/861: dread d0/d2/dc/f20 [0,4194304] 0 2024-05-06T21:26:55.532 INFO:tasks.workunit.client.0.smithi032.stdout:1/987: dwrite db/d47/d4a/f133 [0,4194304] 0 2024-05-06T21:26:55.532 INFO:tasks.workunit.client.0.smithi032.stdout:1/988: write db/d16/d5d/f12b [538740,28843] 0 2024-05-06T21:26:55.535 INFO:tasks.workunit.client.0.smithi032.stdout:1/989: link db/d16/l36 db/d47/d4a/l13e 0 2024-05-06T21:26:55.535 INFO:tasks.workunit.client.1.smithi154.stdout:0/929: dwrite d6/dc/d40/d4a/f106 [0,4194304] 0 2024-05-06T21:26:55.536 INFO:tasks.workunit.client.0.smithi032.stdout:1/990: mknod db/d16/d46/d57/d58/d68/d136/c13f 0 2024-05-06T21:26:55.537 INFO:tasks.workunit.client.1.smithi154.stdout:8/801: dwrite d3/f7a [0,4194304] 0 2024-05-06T21:26:55.537 INFO:tasks.workunit.client.0.smithi032.stdout:1/991: rmdir db/d16/d46/d55 39 2024-05-06T21:26:55.537 INFO:tasks.workunit.client.0.smithi032.stdout:1/992: dread - db/dc8/dfc/f115 zero size 2024-05-06T21:26:55.538 INFO:tasks.workunit.client.0.smithi032.stdout:1/993: dread - db/dc8/de7/fea zero size 2024-05-06T21:26:55.539 INFO:tasks.workunit.client.1.smithi154.stdout:6/612: dwrite d8/d13/f28 [0,4194304] 0 2024-05-06T21:26:55.539 INFO:tasks.workunit.client.0.smithi032.stdout:1/994: mkdir db/d16/d46/d57/d58/d140 0 2024-05-06T21:26:55.539 INFO:tasks.workunit.client.0.smithi032.stdout:1/995: dread - db/dc8/f110 zero size 2024-05-06T21:26:55.540 INFO:tasks.workunit.client.0.smithi032.stdout:1/996: creat db/d47/d4a/dcb/f141 x:0 0 0 2024-05-06T21:26:55.540 INFO:tasks.workunit.client.1.smithi154.stdout:1/827: dwrite d6/f17 [4194304,4194304] 0 2024-05-06T21:26:55.540 INFO:tasks.workunit.client.1.smithi154.stdout:5/838: dwrite d2/d3/d21/d95/dc/d44/f11b [0,4194304] 0 2024-05-06T21:26:55.541 INFO:tasks.workunit.client.1.smithi154.stdout:8/802: stat d3/c13 0 2024-05-06T21:26:55.543 INFO:tasks.workunit.client.0.smithi032.stdout:1/997: mkdir db/d16/d5d/d142 0 2024-05-06T21:26:55.543 INFO:tasks.workunit.client.0.smithi032.stdout:1/998: dread - db/d47/d4a/dcb/f11a zero size 2024-05-06T21:26:55.543 INFO:tasks.workunit.client.0.smithi032.stdout:1/999: readlink db/d47/l121 0 2024-05-06T21:26:55.543 INFO:tasks.workunit.client.1.smithi154.stdout:6/613: creat d8/d13/da9/fc2 x:0 0 0 2024-05-06T21:26:55.543 INFO:tasks.workunit.client.1.smithi154.stdout:6/614: fdatasync d8/d11/f67 0 2024-05-06T21:26:55.544 INFO:tasks.workunit.client.1.smithi154.stdout:4/862: dwrite d0/d82/d44/d73/d4a/d74/f85 [4194304,4194304] 0 2024-05-06T21:26:55.545 INFO:tasks.workunit.client.1.smithi154.stdout:1/828: symlink d6/db/d5e/db8/lff 0 2024-05-06T21:26:55.549 INFO:tasks.workunit.client.0.smithi032.stderr:+ rm -rf -- ./tmp.nrfkA4qOS7 2024-05-06T21:26:55.551 INFO:tasks.workunit.client.1.smithi154.stdout:8/803: mkdir d3/d64/d6d/d102 0 2024-05-06T21:26:55.552 INFO:tasks.workunit.client.1.smithi154.stdout:4/863: mkdir d0/d82/ddb/d120 0 2024-05-06T21:26:55.554 INFO:tasks.workunit.client.1.smithi154.stdout:8/804: truncate d3/d14/d1a/d29/f3d 1488850 0 2024-05-06T21:26:55.554 INFO:tasks.workunit.client.1.smithi154.stdout:5/839: dread d2/d3/d21/d95/f83 [0,4194304] 0 2024-05-06T21:26:55.554 INFO:tasks.workunit.client.1.smithi154.stdout:4/864: symlink d0/d82/d3d/l121 0 2024-05-06T21:26:55.556 INFO:tasks.workunit.client.1.smithi154.stdout:5/840: mknod d2/d3/d21/d95/dd/d2a/d54/d43/c11e 0 2024-05-06T21:26:55.557 INFO:tasks.workunit.client.1.smithi154.stdout:4/865: mkdir d0/d82/d44/d73/d4a/dd9/d122 0 2024-05-06T21:26:55.557 INFO:tasks.workunit.client.1.smithi154.stdout:4/866: fsync d0/d2/fd7 0 2024-05-06T21:26:55.559 INFO:tasks.workunit.client.1.smithi154.stdout:1/829: dread d6/db/d74/f80 [0,4194304] 0 2024-05-06T21:26:55.559 INFO:tasks.workunit.client.1.smithi154.stdout:1/830: truncate d6/db/d69/d89/f8d 133563 0 2024-05-06T21:26:55.559 INFO:tasks.workunit.client.1.smithi154.stdout:1/831: truncate d6/db/d10/fe1 531068 0 2024-05-06T21:26:55.560 INFO:tasks.workunit.client.1.smithi154.stdout:1/832: mkdir d6/db/d10/d15/d1d/d53/d100 0 2024-05-06T21:26:55.564 INFO:tasks.workunit.client.1.smithi154.stdout:0/930: dwrite d6/dc/f2f [0,4194304] 0 2024-05-06T21:26:55.564 INFO:tasks.workunit.client.1.smithi154.stdout:0/931: creat d6/dc/d40/d85/db2/dbb/dff/f135 x:0 0 0 2024-05-06T21:26:55.564 INFO:tasks.workunit.client.1.smithi154.stdout:1/833: getdents d6/db/d69/dc1 0 2024-05-06T21:26:55.564 INFO:tasks.workunit.client.1.smithi154.stdout:0/932: chown d6/d27/f28 32524 1 2024-05-06T21:26:55.564 INFO:tasks.workunit.client.1.smithi154.stdout:0/933: write d6/dc/d44/d36/f4e [1665968,92600] 0 2024-05-06T21:26:55.564 INFO:tasks.workunit.client.1.smithi154.stdout:6/615: dwrite d8/d11/d33/d4a/d6c/f98 [0,4194304] 0 2024-05-06T21:26:55.574 INFO:tasks.workunit.client.1.smithi154.stdout:1/834: link d6/db/d69/d89/dac/lc3 d6/db/d10/d94/l101 0 2024-05-06T21:26:55.581 INFO:tasks.workunit.client.1.smithi154.stdout:6/616: unlink d8/d11/f6d 0 2024-05-06T21:26:55.587 INFO:tasks.workunit.client.1.smithi154.stdout:9/963: sync 2024-05-06T21:26:55.587 INFO:tasks.workunit.client.1.smithi154.stdout:9/964: stat d5/d14/d87/l106 0 2024-05-06T21:26:55.587 INFO:tasks.workunit.client.1.smithi154.stdout:9/965: chown d5/d2e/d8b/dc6/d103 0 1 2024-05-06T21:26:55.587 INFO:tasks.workunit.client.1.smithi154.stdout:9/966: readlink d5/dca/l10b 0 2024-05-06T21:26:55.588 INFO:tasks.workunit.client.1.smithi154.stdout:0/934: dwrite d6/dc/f95 [0,4194304] 0 2024-05-06T21:26:55.589 INFO:tasks.workunit.client.1.smithi154.stdout:5/841: dwrite d2/d3/f88 [0,4194304] 0 2024-05-06T21:26:55.589 INFO:tasks.workunit.client.1.smithi154.stdout:9/967: read d5/d20/d52/d6e/d104/fe2 [418443,39776] 0 2024-05-06T21:26:55.589 INFO:tasks.workunit.client.1.smithi154.stdout:5/842: fsync d2/d3/d21/d95/dd/d2a/d54/d43/d73/fea 0 2024-05-06T21:26:55.589 INFO:tasks.workunit.client.1.smithi154.stdout:5/843: write d2/d48/f118 [888134,116948] 0 2024-05-06T21:26:55.589 INFO:tasks.workunit.client.1.smithi154.stdout:4/867: dwrite d0/d82/d44/d73/d4a/dd4/d1a/d10b/dfc/f111 [0,4194304] 0 2024-05-06T21:26:55.589 INFO:tasks.workunit.client.1.smithi154.stdout:6/617: dread d8/d11/d2d/d3d/f6b [0,4194304] 0 2024-05-06T21:26:55.590 INFO:tasks.workunit.client.1.smithi154.stdout:0/935: mkdir d6/dc/d51/d136 0 2024-05-06T21:26:55.591 INFO:tasks.workunit.client.1.smithi154.stdout:0/936: stat d6/dc/d51/d54/dbd/fc5 0 2024-05-06T21:26:55.591 INFO:tasks.workunit.client.1.smithi154.stdout:0/937: creat d6/dc/d40/d85/db2/dbb/f137 x:0 0 0 2024-05-06T21:26:55.597 INFO:tasks.workunit.client.1.smithi154.stdout:5/844: write d2/d3/d21/d95/dd/d2a/d54/d43/f93 [2683958,96364] 0 2024-05-06T21:26:55.597 INFO:tasks.workunit.client.1.smithi154.stdout:9/968: rename d5/d2e/d7f to d5/d20/d52/d6e/d83/de5/d138 0 2024-05-06T21:26:55.597 INFO:tasks.workunit.client.1.smithi154.stdout:9/969: write d5/d20/d52/d59/d102/fe4 [977832,85819] 0 2024-05-06T21:26:55.600 INFO:tasks.workunit.client.1.smithi154.stdout:4/868: mkdir d0/d72/d76/d123 0 2024-05-06T21:26:55.600 INFO:tasks.workunit.client.1.smithi154.stdout:6/618: getdents d8/d11/d2d/d3d/d4c/d86 0 2024-05-06T21:26:55.602 INFO:tasks.workunit.client.1.smithi154.stdout:5/845: mkdir d2/d3/d19/dbe/d11f 0 2024-05-06T21:26:55.603 INFO:tasks.workunit.client.1.smithi154.stdout:6/619: getdents d8/d13/d20 0 2024-05-06T21:26:55.605 INFO:tasks.workunit.client.1.smithi154.stdout:9/970: write d5/d20/d37/dd5/de1/de6/f109 [2837670,1898] 0 2024-05-06T21:26:55.608 INFO:tasks.workunit.client.1.smithi154.stdout:5/846: getdents d2/d3/d21/d95/dc/d68 0 2024-05-06T21:26:55.608 INFO:tasks.workunit.client.1.smithi154.stdout:4/869: write d0/d82/d44/d73/f2c [765208,124736] 0 2024-05-06T21:26:55.610 INFO:tasks.workunit.client.1.smithi154.stdout:9/971: dread d5/d2e/d8b/fb2 [0,4194304] 0 2024-05-06T21:26:55.610 INFO:tasks.workunit.client.1.smithi154.stdout:6/620: rmdir d8/d11/d8d 39 2024-05-06T21:26:55.616 INFO:tasks.workunit.client.1.smithi154.stdout:5/847: link d2/d3/d8b/c111 d2/d3/d19/d23/c120 0 2024-05-06T21:26:55.616 INFO:tasks.workunit.client.1.smithi154.stdout:0/938: dwrite d6/dc/d40/d4a/da7/d70/d96/dd5/fe5 [0,4194304] 0 2024-05-06T21:26:55.621 INFO:tasks.workunit.client.1.smithi154.stdout:4/870: rename d0/d72/d76/db5/ff4 to d0/d2/d47/d105/f124 0 2024-05-06T21:26:55.621 INFO:tasks.workunit.client.1.smithi154.stdout:4/871: dread - d0/d82/d39/fca zero size 2024-05-06T21:26:55.621 INFO:tasks.workunit.client.1.smithi154.stdout:4/872: dread - d0/d82/d44/fe2 zero size 2024-05-06T21:26:55.621 INFO:tasks.workunit.client.1.smithi154.stdout:4/873: chown d0/d82/d39/f4b 0 1 2024-05-06T21:26:55.624 INFO:tasks.workunit.client.1.smithi154.stdout:0/939: dread d6/dc/d40/d4a/d6c/dce/dd7/fd8 [0,4194304] 0 2024-05-06T21:26:55.627 INFO:tasks.workunit.client.1.smithi154.stdout:9/972: symlink d5/d14/daf/db8/l139 0 2024-05-06T21:26:55.634 INFO:tasks.workunit.client.1.smithi154.stdout:5/848: rename d2/d3/d21/d95/dd/fb9 to d2/d3/d21/d95/dc/d44/d9a/f121 0 2024-05-06T21:26:55.634 INFO:tasks.workunit.client.1.smithi154.stdout:5/849: stat d2/d3/d21/d95/dc/d44/d9a 0 2024-05-06T21:26:55.634 INFO:tasks.workunit.client.1.smithi154.stdout:0/940: mknod d6/dc/d51/d136/c138 0 2024-05-06T21:26:55.635 INFO:tasks.workunit.client.1.smithi154.stdout:0/941: truncate d6/dc/d40/d4a/d6c/dce/fed 338641 0 2024-05-06T21:26:55.635 INFO:tasks.workunit.client.1.smithi154.stdout:0/942: readlink d6/dc/l82 0 2024-05-06T21:26:55.635 INFO:tasks.workunit.client.1.smithi154.stdout:0/943: read d6/dc/d51/d54/dbd/f113 [428437,130405] 0 2024-05-06T21:26:55.635 INFO:tasks.workunit.client.1.smithi154.stdout:0/944: creat d6/dc/d40/d85/db2/dbb/dff/f139 x:0 0 0 2024-05-06T21:26:55.635 INFO:tasks.workunit.client.1.smithi154.stdout:0/945: chown d6/dc/f33 166239 1 2024-05-06T21:26:55.636 INFO:tasks.workunit.client.1.smithi154.stdout:9/973: link d5/d2e/la8 d5/d20/d52/d6e/d104/db1/dbd/l13a 0 2024-05-06T21:26:55.636 INFO:tasks.workunit.client.1.smithi154.stdout:9/974: truncate d5/d20/f23 992274 0 2024-05-06T21:26:55.637 INFO:tasks.workunit.client.1.smithi154.stdout:6/621: getdents d8/d11/d2d/d3d 0 2024-05-06T21:26:55.640 INFO:tasks.workunit.client.1.smithi154.stdout:5/850: link d2/d3/d21/d22/lcc d2/d3/d21/d95/dd/d2a/dbb/l122 0 2024-05-06T21:26:55.642 INFO:tasks.workunit.client.1.smithi154.stdout:4/874: dwrite d0/d82/d44/fe2 [0,4194304] 0 2024-05-06T21:26:55.645 INFO:tasks.workunit.client.1.smithi154.stdout:9/975: creat d5/d20/f13b x:0 0 0 2024-05-06T21:26:55.646 INFO:tasks.workunit.client.1.smithi154.stdout:6/622: truncate d8/d13/f3f 5767846 0 2024-05-06T21:26:55.650 INFO:tasks.workunit.client.1.smithi154.stdout:0/946: write d6/dc/d40/d4a/f106 [325772,88271] 0 2024-05-06T21:26:55.653 INFO:tasks.workunit.client.1.smithi154.stdout:4/875: write d0/d2/d29/d60/fff [1313255,30116] 0 2024-05-06T21:26:55.653 INFO:tasks.workunit.client.1.smithi154.stdout:4/876: write d0/d82/d44/d73/f36 [179350,113392] 0 2024-05-06T21:26:55.657 INFO:tasks.workunit.client.1.smithi154.stdout:7/681: sync 2024-05-06T21:26:55.657 INFO:tasks.workunit.client.1.smithi154.stdout:3/954: sync 2024-05-06T21:26:55.657 INFO:tasks.workunit.client.1.smithi154.stdout:2/784: sync 2024-05-06T21:26:55.657 INFO:tasks.workunit.client.1.smithi154.stdout:7/682: creat d6/d42/d6c/d6e/fdc x:0 0 0 2024-05-06T21:26:55.657 INFO:tasks.workunit.client.1.smithi154.stdout:7/683: dread - d6/d42/d6c/d6e/d21/d69/d7b/d9f/fb6 zero size 2024-05-06T21:26:55.657 INFO:tasks.workunit.client.1.smithi154.stdout:0/947: mknod d6/dc/d51/d54/dee/d108/c13a 0 2024-05-06T21:26:55.657 INFO:tasks.workunit.client.1.smithi154.stdout:0/948: stat d6/dc/f16 0 2024-05-06T21:26:55.660 INFO:tasks.workunit.client.1.smithi154.stdout:4/877: creat d0/d82/d44/d73/def/f125 x:0 0 0 2024-05-06T21:26:55.660 INFO:tasks.workunit.client.1.smithi154.stdout:6/623: getdents d8/d13/d8f 0 2024-05-06T21:26:55.660 INFO:tasks.workunit.client.1.smithi154.stdout:6/624: write d8/d13/f77 [1106752,27338] 0 2024-05-06T21:26:55.662 INFO:tasks.workunit.client.1.smithi154.stdout:3/955: mkdir d0/dfa/d13e 0 2024-05-06T21:26:55.662 INFO:tasks.workunit.client.1.smithi154.stdout:3/956: chown d0/da/d1a/d28/dbc/d117/d7c/d80/d106 12 1 2024-05-06T21:26:55.662 INFO:tasks.workunit.client.1.smithi154.stdout:3/957: write d0/da/d1a/d28/dbc/d117/d7c/d80/d106/f110 [440298,120944] 0 2024-05-06T21:26:55.662 INFO:tasks.workunit.client.1.smithi154.stdout:5/851: dwrite d2/d3/d21/d95/dc/d68/fc8 [0,4194304] 0 2024-05-06T21:26:55.662 INFO:tasks.workunit.client.1.smithi154.stdout:5/852: write d2/d3/d21/d95/dd/f18 [4529804,118515] 0 2024-05-06T21:26:55.663 INFO:tasks.workunit.client.1.smithi154.stdout:2/785: creat db/d12/d19/d4b/d78/de8/dfa/ffc x:0 0 0 2024-05-06T21:26:55.663 INFO:tasks.workunit.client.1.smithi154.stdout:2/786: creat db/d12/d19/d7d/ffd x:0 0 0 2024-05-06T21:26:55.667 INFO:tasks.workunit.client.1.smithi154.stdout:7/684: mkdir d6/d42/d6c/d6e/d21/d69/ddd 0 2024-05-06T21:26:55.671 INFO:tasks.workunit.client.1.smithi154.stdout:0/949: creat d6/dc/d51/d136/f13b x:0 0 0 2024-05-06T21:26:55.671 INFO:tasks.workunit.client.1.smithi154.stdout:0/950: fsync d6/dc/d51/d54/fef 0 2024-05-06T21:26:55.674 INFO:tasks.workunit.client.1.smithi154.stdout:6/625: symlink d8/d11/d2d/d3d/lc3 0 2024-05-06T21:26:55.674 INFO:tasks.workunit.client.1.smithi154.stdout:6/626: creat d8/d11/d33/d4a/d6c/d8e/fc4 x:0 0 0 2024-05-06T21:26:55.678 INFO:tasks.workunit.client.1.smithi154.stdout:8/805: sync 2024-05-06T21:26:55.683 INFO:tasks.workunit.client.1.smithi154.stdout:5/853: symlink d2/d3/d19/dbe/l123 0 2024-05-06T21:26:55.683 INFO:tasks.workunit.client.1.smithi154.stdout:3/958: dwrite d0/da/fb1 [0,4194304] 0 2024-05-06T21:26:55.687 INFO:tasks.workunit.client.1.smithi154.stdout:2/787: mknod db/de/d6f/cfe 0 2024-05-06T21:26:55.688 INFO:tasks.workunit.client.1.smithi154.stdout:7/685: mknod d6/d20/d40/d52/cde 0 2024-05-06T21:26:55.690 INFO:tasks.workunit.client.1.smithi154.stdout:4/878: rename d0/d72 to d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126 0 2024-05-06T21:26:55.690 INFO:tasks.workunit.client.1.smithi154.stdout:8/806: read d3/f7a [2329949,40037] 0 2024-05-06T21:26:55.693 INFO:tasks.workunit.client.1.smithi154.stdout:6/627: rmdir d8/d11/d2d 39 2024-05-06T21:26:55.693 INFO:tasks.workunit.client.1.smithi154.stdout:6/628: readlink d8/d11/d2d/d3d/d4c/l5c 0 2024-05-06T21:26:55.693 INFO:tasks.workunit.client.1.smithi154.stdout:6/629: chown d8/d11/d33/d4a/d6c/d8e 12689281 1 2024-05-06T21:26:55.693 INFO:tasks.workunit.client.1.smithi154.stdout:6/630: dread - d8/d11/d33/d4a/d6c/d8e/fc4 zero size 2024-05-06T21:26:55.693 INFO:tasks.workunit.client.1.smithi154.stdout:6/631: readlink d8/l1c 0 2024-05-06T21:26:55.693 INFO:tasks.workunit.client.1.smithi154.stdout:5/854: getdents d2/d3/d19/d23/d100 0 2024-05-06T21:26:55.694 INFO:tasks.workunit.client.1.smithi154.stdout:5/855: chown d2/d3/d19/d23/df9/f10a 0 1 2024-05-06T21:26:55.699 INFO:tasks.workunit.client.1.smithi154.stdout:3/959: creat d0/da/d1a/d28/dbc/d117/d52/d62/d13d/f13f x:0 0 0 2024-05-06T21:26:55.702 INFO:tasks.workunit.client.1.smithi154.stdout:7/686: symlink d6/d42/d6c/d6e/d5e/ldf 0 2024-05-06T21:26:55.702 INFO:tasks.workunit.client.1.smithi154.stdout:7/687: chown d6/l16 51617290 1 2024-05-06T21:26:55.703 INFO:tasks.workunit.client.1.smithi154.stdout:0/951: rename d6/dc/d40/d85/db2/dbb/dff/f139 to d6/dc/d40/d4a/dac/f13c 0 2024-05-06T21:26:55.706 INFO:tasks.workunit.client.1.smithi154.stdout:8/807: symlink d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/l103 0 2024-05-06T21:26:55.706 INFO:tasks.workunit.client.1.smithi154.stdout:8/808: fsync d3/d14/d1a/d29/d32/d40/d59/d67/fc2 0 2024-05-06T21:26:55.707 INFO:tasks.workunit.client.1.smithi154.stdout:6/632: creat d8/d11/d8d/fc5 x:0 0 0 2024-05-06T21:26:55.708 INFO:tasks.workunit.client.1.smithi154.stdout:2/788: dwrite db/de/d10/d18/fa2 [0,4194304] 0 2024-05-06T21:26:55.709 INFO:tasks.workunit.client.1.smithi154.stdout:3/960: symlink d0/da/d1a/d28/dbc/d117/dd/d1c/d21/l140 0 2024-05-06T21:26:55.710 INFO:tasks.workunit.client.1.smithi154.stdout:3/961: fsync d0/da/d1a/d28/dbc/d117/d7c/fd9 0 2024-05-06T21:26:55.710 INFO:tasks.workunit.client.1.smithi154.stdout:3/962: write d0/da/d1a/d28/dbc/d117/d7c/fb9 [2483799,41116] 0 2024-05-06T21:26:55.710 INFO:tasks.workunit.client.1.smithi154.stdout:3/963: chown d0/da/d1a/d28/dbc/d117/d52/ccd 6579 1 2024-05-06T21:26:55.710 INFO:tasks.workunit.client.1.smithi154.stdout:0/952: creat d6/dc/d51/d54/dee/d108/f13d x:0 0 0 2024-05-06T21:26:55.711 INFO:tasks.workunit.client.1.smithi154.stdout:0/953: chown d6/dc/d44/d36/l118 0 1 2024-05-06T21:26:55.711 INFO:tasks.workunit.client.1.smithi154.stdout:7/688: dread d6/d42/d6c/d6e/f19 [0,4194304] 0 2024-05-06T21:26:55.712 INFO:tasks.workunit.client.1.smithi154.stdout:6/633: unlink d8/d11/d33/d4a/f54 0 2024-05-06T21:26:55.716 INFO:tasks.workunit.client.1.smithi154.stdout:2/789: symlink db/de/d10/dbc/ded/lff 0 2024-05-06T21:26:55.716 INFO:tasks.workunit.client.1.smithi154.stdout:2/790: chown db/de/d16/f52 122726 1 2024-05-06T21:26:55.717 INFO:tasks.workunit.client.1.smithi154.stdout:1/835: sync 2024-05-06T21:26:55.718 INFO:tasks.workunit.client.1.smithi154.stdout:5/856: rmdir d2/d3/d19/d23/db6 39 2024-05-06T21:26:55.719 INFO:tasks.workunit.client.1.smithi154.stdout:3/964: mkdir d0/da/d1a/d28/dbc/d117/d7c/d80/d106/d141 0 2024-05-06T21:26:55.719 INFO:tasks.workunit.client.1.smithi154.stdout:3/965: dread - d0/da/d1a/d28/dbc/d81/d48/da9/f132 zero size 2024-05-06T21:26:55.720 INFO:tasks.workunit.client.1.smithi154.stdout:0/954: mkdir d6/dc/d44/d13e 0 2024-05-06T21:26:55.721 INFO:tasks.workunit.client.1.smithi154.stdout:8/809: rmdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d 39 2024-05-06T21:26:55.721 INFO:tasks.workunit.client.1.smithi154.stdout:8/810: write d3/d14/f19 [2825970,75231] 0 2024-05-06T21:26:55.722 INFO:tasks.workunit.client.1.smithi154.stdout:8/811: read d3/d64/d6d/dbd/d61/f81 [591150,69525] 0 2024-05-06T21:26:55.722 INFO:tasks.workunit.client.1.smithi154.stdout:8/812: stat d3/d14/d1a/d29/d32 0 2024-05-06T21:26:55.722 INFO:tasks.workunit.client.1.smithi154.stdout:7/689: rmdir d6/d42/d6c/d6e/d21/d69/d7b 39 2024-05-06T21:26:55.724 INFO:tasks.workunit.client.1.smithi154.stdout:4/879: dwrite d0/d82/d44/d73/d4a/dd4/ff2 [0,4194304] 0 2024-05-06T21:26:55.725 INFO:tasks.workunit.client.1.smithi154.stdout:2/791: rename db/d12/d4e/d55/fb0 to db/d12/d19/d81/f100 0 2024-05-06T21:26:55.728 INFO:tasks.workunit.client.1.smithi154.stdout:5/857: mkdir d2/d3/d19/d23/db6/d124 0 2024-05-06T21:26:55.728 INFO:tasks.workunit.client.1.smithi154.stdout:6/634: write d8/d13/da9/f6f [4160575,62484] 0 2024-05-06T21:26:55.728 INFO:tasks.workunit.client.1.smithi154.stdout:3/966: mknod d0/d2/c142 0 2024-05-06T21:26:55.729 INFO:tasks.workunit.client.1.smithi154.stdout:3/967: write d0/da/d1a/d28/dbc/d81/d48/da9/d12c/f134 [798876,51437] 0 2024-05-06T21:26:55.730 INFO:tasks.workunit.client.1.smithi154.stdout:8/813: mknod d3/d14/d1a/d45/dcf/db4/dee/c104 0 2024-05-06T21:26:55.730 INFO:tasks.workunit.client.1.smithi154.stdout:8/814: creat d3/d14/d1a/d29/d32/d40/d59/d67/f105 x:0 0 0 2024-05-06T21:26:55.731 INFO:tasks.workunit.client.1.smithi154.stdout:7/690: mkdir d6/d42/d6c/d6e/d21/d69/de0 0 2024-05-06T21:26:55.732 INFO:tasks.workunit.client.1.smithi154.stdout:7/691: creat d6/d42/d6c/d6e/d21/d2e/fe1 x:0 0 0 2024-05-06T21:26:55.735 INFO:tasks.workunit.client.1.smithi154.stdout:4/880: symlink d0/d82/d44/d73/d4a/d74/d75/l127 0 2024-05-06T21:26:55.737 INFO:tasks.workunit.client.1.smithi154.stdout:0/955: rename d6/dc/d44/f11 to d6/dc/d44/d9f/f13f 0 2024-05-06T21:26:55.737 INFO:tasks.workunit.client.1.smithi154.stdout:0/956: fdatasync d6/dc/d44/d36/f101 0 2024-05-06T21:26:55.739 INFO:tasks.workunit.client.1.smithi154.stdout:2/792: unlink db/d12/d1d/d60/fee 0 2024-05-06T21:26:55.740 INFO:tasks.workunit.client.1.smithi154.stdout:1/836: getdents d6/db/d10/d26/d1b 0 2024-05-06T21:26:55.743 INFO:tasks.workunit.client.1.smithi154.stdout:5/858: mknod d2/d3/d19/d23/c125 0 2024-05-06T21:26:55.743 INFO:tasks.workunit.client.1.smithi154.stdout:5/859: chown d2/d3/d19/d23/df9/dfd/l10e 14 1 2024-05-06T21:26:55.743 INFO:tasks.workunit.client.1.smithi154.stdout:5/860: getdents d2/d3/d19/d23/db6/d124 0 2024-05-06T21:26:55.744 INFO:tasks.workunit.client.1.smithi154.stdout:6/635: truncate d8/d7e/f83 293949 0 2024-05-06T21:26:55.744 INFO:tasks.workunit.client.1.smithi154.stdout:6/636: chown d8/l61 322 1 2024-05-06T21:26:55.746 INFO:tasks.workunit.client.1.smithi154.stdout:3/968: mkdir d0/da/d1a/d28/dbc/d81/d48/da9/d143 0 2024-05-06T21:26:55.751 INFO:tasks.workunit.client.1.smithi154.stdout:8/815: symlink d3/l106 0 2024-05-06T21:26:55.754 INFO:tasks.workunit.client.1.smithi154.stdout:7/692: mkdir d6/d42/de2 0 2024-05-06T21:26:55.755 INFO:tasks.workunit.client.1.smithi154.stdout:4/881: creat d0/d82/ddb/f128 x:0 0 0 2024-05-06T21:26:55.757 INFO:tasks.workunit.client.1.smithi154.stdout:1/837: truncate d6/d3e/d7e/da5/da8/fad 502488 0 2024-05-06T21:26:55.757 INFO:tasks.workunit.client.1.smithi154.stdout:1/838: fdatasync d6/db/d97/fc9 0 2024-05-06T21:26:55.757 INFO:tasks.workunit.client.1.smithi154.stdout:1/839: fdatasync d6/db/d10/d15/f9c 0 2024-05-06T21:26:55.757 INFO:tasks.workunit.client.1.smithi154.stdout:1/840: truncate d6/db/d10/d15/d1d/d53/f98 1474885 0 2024-05-06T21:26:55.757 INFO:tasks.workunit.client.1.smithi154.stdout:4/882: dread d0/d2/f69 [0,4194304] 0 2024-05-06T21:26:55.758 INFO:tasks.workunit.client.1.smithi154.stdout:4/883: dread d0/d2/d29/fa5 [0,4194304] 0 2024-05-06T21:26:55.759 INFO:tasks.workunit.client.1.smithi154.stdout:5/861: mkdir d2/d3/d19/d23/d100/d126 0 2024-05-06T21:26:55.763 INFO:tasks.workunit.client.1.smithi154.stdout:6/637: rename d8/d11/d33/d4a/d6c/d8e/cac to d8/d7e/cc6 0 2024-05-06T21:26:55.764 INFO:tasks.workunit.client.1.smithi154.stdout:2/793: dwrite db/d12/d19/d7d/fe6 [0,4194304] 0 2024-05-06T21:26:55.764 INFO:tasks.workunit.client.1.smithi154.stdout:2/794: creat db/d12/d4e/d55/f101 x:0 0 0 2024-05-06T21:26:55.766 INFO:tasks.workunit.client.1.smithi154.stdout:3/969: creat d0/d2/d22/f144 x:0 0 0 2024-05-06T21:26:55.767 INFO:tasks.workunit.client.1.smithi154.stdout:3/970: stat d0/da/d1a/d28/c15 0 2024-05-06T21:26:55.767 INFO:tasks.workunit.client.1.smithi154.stdout:1/841: mknod d6/d3e/c102 0 2024-05-06T21:26:55.767 INFO:tasks.workunit.client.1.smithi154.stdout:1/842: chown d6/db/d10/d94/l101 816 1 2024-05-06T21:26:55.767 INFO:tasks.workunit.client.1.smithi154.stdout:4/884: rmdir d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/d123 0 2024-05-06T21:26:55.768 INFO:tasks.workunit.client.1.smithi154.stdout:7/693: dread d6/f10 [0,4194304] 0 2024-05-06T21:26:55.768 INFO:tasks.workunit.client.1.smithi154.stdout:0/957: dwrite d6/dc/d51/d54/dee/d108/f13d [0,4194304] 0 2024-05-06T21:26:55.776 INFO:tasks.workunit.client.1.smithi154.stdout:8/816: dwrite d3/d56/f8b [0,4194304] 0 2024-05-06T21:26:55.776 INFO:tasks.workunit.client.1.smithi154.stdout:2/795: rename db/d12/d1d/d83/faa to db/d86/f102 0 2024-05-06T21:26:55.776 INFO:tasks.workunit.client.1.smithi154.stdout:7/694: dread d6/d20/d40/d52/f91 [0,4194304] 0 2024-05-06T21:26:55.776 INFO:tasks.workunit.client.1.smithi154.stdout:7/695: truncate d6/d42/d6c/d6e/d21/d69/d7b/f7e 5062213 0 2024-05-06T21:26:55.776 INFO:tasks.workunit.client.1.smithi154.stdout:6/638: dread d8/d13/f3f [0,4194304] 0 2024-05-06T21:26:55.776 INFO:tasks.workunit.client.1.smithi154.stdout:1/843: truncate d6/db/d10/d15/d1d/d53/f5f 910956 0 2024-05-06T21:26:55.776 INFO:tasks.workunit.client.1.smithi154.stdout:3/971: write d0/da/d1a/d28/d17/f49 [3009741,232] 0 2024-05-06T21:26:55.776 INFO:tasks.workunit.client.1.smithi154.stdout:3/972: chown d0/da/d1a/d28/dbc/d81/d48/da9/db3 91511405 1 2024-05-06T21:26:55.777 INFO:tasks.workunit.client.1.smithi154.stdout:4/885: unlink d0/d82/d44/d73/d4a/dd4/d1a/f35 0 2024-05-06T21:26:55.784 INFO:tasks.workunit.client.1.smithi154.stdout:5/862: mknod d2/d3/d21/d95/dd/d2a/d54/c127 0 2024-05-06T21:26:55.784 INFO:tasks.workunit.client.1.smithi154.stdout:6/639: write d8/d13/d20/f5a [2588358,47507] 0 2024-05-06T21:26:55.784 INFO:tasks.workunit.client.1.smithi154.stdout:6/640: truncate d8/d11/fab 210264 0 2024-05-06T21:26:55.788 INFO:tasks.workunit.client.1.smithi154.stdout:4/886: dread d0/d2/f1b [0,4194304] 0 2024-05-06T21:26:55.788 INFO:tasks.workunit.client.1.smithi154.stdout:4/887: write d0/d2/f53 [2365506,54742] 0 2024-05-06T21:26:55.788 INFO:tasks.workunit.client.1.smithi154.stdout:4/888: chown d0/d10/f15 90442574 1 2024-05-06T21:26:55.789 INFO:tasks.workunit.client.1.smithi154.stdout:8/817: mknod d3/d14/d1a/d29/d32/d40/d59/c107 0 2024-05-06T21:26:55.792 INFO:tasks.workunit.client.1.smithi154.stdout:0/958: rename d6/dc/d40/d4a/da7/d70/d128/d104 to d6/dc/d40/d4a/d140 0 2024-05-06T21:26:55.793 INFO:tasks.workunit.client.1.smithi154.stdout:2/796: symlink db/de/l103 0 2024-05-06T21:26:55.799 INFO:tasks.workunit.client.1.smithi154.stdout:3/973: creat d0/da/d1a/d28/dbc/d117/d30/d71/f145 x:0 0 0 2024-05-06T21:26:55.801 INFO:tasks.workunit.client.1.smithi154.stdout:8/818: dread d3/d14/d1a/d45/f5a [0,4194304] 0 2024-05-06T21:26:55.801 INFO:tasks.workunit.client.1.smithi154.stdout:6/641: dwrite d8/d13/da9/fc2 [0,4194304] 0 2024-05-06T21:26:55.802 INFO:tasks.workunit.client.1.smithi154.stdout:6/642: fdatasync d8/d11/d2d/d3d/f6b 0 2024-05-06T21:26:55.806 INFO:tasks.workunit.client.1.smithi154.stdout:5/863: unlink d2/d48/c10d 0 2024-05-06T21:26:55.809 INFO:tasks.workunit.client.1.smithi154.stdout:1/844: rename d6/d3e/d7e/ldd to d6/db/d10/d15/d1d/d53/l103 0 2024-05-06T21:26:55.814 INFO:tasks.workunit.client.1.smithi154.stdout:9/976: sync 2024-05-06T21:26:55.815 INFO:tasks.workunit.client.1.smithi154.stdout:6/643: mknod d8/d11/d8d/daa/cc7 0 2024-05-06T21:26:55.815 INFO:tasks.workunit.client.1.smithi154.stdout:6/644: write d8/d11/d8d/fc5 [1012067,26190] 0 2024-05-06T21:26:55.817 INFO:tasks.workunit.client.1.smithi154.stdout:6/645: write d8/d11/d2d/d3d/f6b [1206340,69494] 0 2024-05-06T21:26:55.818 INFO:tasks.workunit.client.1.smithi154.stdout:5/864: mkdir d2/d3/d19/d23/df9/dfd/d128 0 2024-05-06T21:26:55.818 INFO:tasks.workunit.client.1.smithi154.stdout:2/797: dwrite db/d12/d1d/d60/d63/de2/ff3 [0,4194304] 0 2024-05-06T21:26:55.820 INFO:tasks.workunit.client.1.smithi154.stdout:0/959: dwrite d6/dc/d44/f46 [4194304,4194304] 0 2024-05-06T21:26:55.821 INFO:tasks.workunit.client.1.smithi154.stdout:8/819: rename d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/c70 to d3/d64/d6d/dbd/c108 0 2024-05-06T21:26:55.821 INFO:tasks.workunit.client.1.smithi154.stdout:8/820: read d3/d14/d1a/d45/f93 [7644,118666] 0 2024-05-06T21:26:55.822 INFO:tasks.workunit.client.1.smithi154.stdout:1/845: dread d6/db/d69/d89/f8d [0,4194304] 0 2024-05-06T21:26:55.826 INFO:tasks.workunit.client.1.smithi154.stdout:9/977: mkdir d5/d2e/dee/d13c 0 2024-05-06T21:26:55.827 INFO:tasks.workunit.client.1.smithi154.stdout:3/974: dwrite d0/da/d1a/d28/dbc/d117/dd/d1c/d21/d37/f85 [4194304,4194304] 0 2024-05-06T21:26:55.828 INFO:tasks.workunit.client.1.smithi154.stdout:6/646: mknod d8/d13/d20/cc8 0 2024-05-06T21:26:55.828 INFO:tasks.workunit.client.1.smithi154.stdout:6/647: write d8/d11/d33/d4a/d6c/d8e/fc4 [110418,97230] 0 2024-05-06T21:26:55.828 INFO:tasks.workunit.client.1.smithi154.stdout:6/648: fdatasync d8/d13/f71 0 2024-05-06T21:26:55.828 INFO:tasks.workunit.client.1.smithi154.stdout:5/865: mkdir d2/d3/d8b/d112/d129 0 2024-05-06T21:26:55.833 INFO:tasks.workunit.client.1.smithi154.stdout:2/798: unlink db/de/d16/d33/f79 0 2024-05-06T21:26:55.833 INFO:tasks.workunit.client.1.smithi154.stdout:2/799: stat db/d12/d1d/lf5 0 2024-05-06T21:26:55.833 INFO:tasks.workunit.client.1.smithi154.stdout:2/800: stat db/de/f1c 0 2024-05-06T21:26:55.836 INFO:tasks.workunit.client.1.smithi154.stdout:8/821: truncate d3/ff 2639275 0 2024-05-06T21:26:55.843 INFO:tasks.workunit.client.1.smithi154.stdout:9/978: symlink d5/d20/d37/dd5/de1/l13d 0 2024-05-06T21:26:55.843 INFO:tasks.workunit.client.1.smithi154.stdout:9/979: write d5/d20/d37/f101 [290858,28697] 0 2024-05-06T21:26:55.846 INFO:tasks.workunit.client.1.smithi154.stdout:3/975: dwrite d0/d2/d22/ff7 [0,4194304] 0 2024-05-06T21:26:55.846 INFO:tasks.workunit.client.1.smithi154.stdout:6/649: getdents d8/d11/d2d/d3d/d4c/dba 0 2024-05-06T21:26:55.846 INFO:tasks.workunit.client.1.smithi154.stdout:6/650: fdatasync d8/d11/d33/d4a/d6c/d8e/f96 0 2024-05-06T21:26:55.846 INFO:tasks.workunit.client.1.smithi154.stdout:0/960: dwrite d6/dc/d44/d9f/fad [0,4194304] 0 2024-05-06T21:26:55.846 INFO:tasks.workunit.client.1.smithi154.stdout:0/961: write d6/dc1/ffd [330983,30851] 0 2024-05-06T21:26:55.846 INFO:tasks.workunit.client.1.smithi154.stdout:0/962: write d6/dc/d40/d4a/f106 [668606,94445] 0 2024-05-06T21:26:55.846 INFO:tasks.workunit.client.1.smithi154.stdout:0/963: write d6/dc/d44/d36/f101 [259465,101702] 0 2024-05-06T21:26:55.848 INFO:tasks.workunit.client.1.smithi154.stdout:5/866: creat d2/d3/d19/d23/df9/f12a x:0 0 0 2024-05-06T21:26:55.848 INFO:tasks.workunit.client.1.smithi154.stdout:5/867: readlink d2/d3/d21/d22/l77 0 2024-05-06T21:26:55.848 INFO:tasks.workunit.client.1.smithi154.stdout:5/868: dread - d2/d3/d19/d23/df9/dfd/f117 zero size 2024-05-06T21:26:55.849 INFO:tasks.workunit.client.1.smithi154.stdout:5/869: write d2/d3/d21/d95/dc/d68/d69/fa3 [976465,1024] 0 2024-05-06T21:26:55.849 INFO:tasks.workunit.client.1.smithi154.stdout:5/870: truncate d2/d3/fe2 288447 0 2024-05-06T21:26:55.849 INFO:tasks.workunit.client.1.smithi154.stdout:0/964: dread d6/dc/d44/d36/f57 [0,4194304] 0 2024-05-06T21:26:55.849 INFO:tasks.workunit.client.1.smithi154.stdout:3/976: dread d0/f50 [0,4194304] 0 2024-05-06T21:26:55.849 INFO:tasks.workunit.client.1.smithi154.stdout:2/801: mkdir db/d12/d4e/d104 0 2024-05-06T21:26:55.849 INFO:tasks.workunit.client.1.smithi154.stdout:2/802: chown db/de/d16/c45 83179026 1 2024-05-06T21:26:55.850 INFO:tasks.workunit.client.1.smithi154.stdout:8/822: creat d3/d14/d1a/d29/d32/d40/d79/d84/f109 x:0 0 0 2024-05-06T21:26:55.855 INFO:tasks.workunit.client.1.smithi154.stdout:6/651: truncate d8/d11/f79 2831520 0 2024-05-06T21:26:55.857 INFO:tasks.workunit.client.1.smithi154.stdout:5/871: dread d2/f1a [0,4194304] 0 2024-05-06T21:26:55.862 INFO:tasks.workunit.client.1.smithi154.stdout:0/965: symlink d6/dc/d40/d4a/d6c/l141 0 2024-05-06T21:26:55.864 INFO:tasks.workunit.client.1.smithi154.stdout:3/977: mknod d0/da/d1a/d28/dbc/d117/d7c/d80/d10f/c146 0 2024-05-06T21:26:55.866 INFO:tasks.workunit.client.1.smithi154.stdout:9/980: dwrite d5/d20/d52/d114/fc3 [0,4194304] 0 2024-05-06T21:26:55.867 INFO:tasks.workunit.client.1.smithi154.stdout:8/823: truncate d3/d14/d1a/d29/d32/d40/d59/d67/fc2 520771 0 2024-05-06T21:26:55.870 INFO:tasks.workunit.client.1.smithi154.stdout:2/803: dwrite db/d12/d19/d7d/ff8 [0,4194304] 0 2024-05-06T21:26:55.870 INFO:tasks.workunit.client.1.smithi154.stdout:5/872: rmdir d2/d3/d19/d23/d100 39 2024-05-06T21:26:55.873 INFO:tasks.workunit.client.1.smithi154.stdout:0/966: rename d6/dc/d40/d4a/da7/d70/d96/dd5/f127 to d6/dc/d40/d4a/d6c/d8a/f142 0 2024-05-06T21:26:55.873 INFO:tasks.workunit.client.1.smithi154.stdout:0/967: write d6/dc/d40/d4a/da7/d70/d96/dd5/fe3 [439029,39504] 0 2024-05-06T21:26:55.874 INFO:tasks.workunit.client.1.smithi154.stdout:3/978: mkdir d0/da/d1a/d28/dbc/d117/dd/d1c/d147 0 2024-05-06T21:26:55.875 INFO:tasks.workunit.client.1.smithi154.stdout:3/979: fsync d0/da/d1a/d28/dbc/d117/dd/f3c 0 2024-05-06T21:26:55.884 INFO:tasks.workunit.client.1.smithi154.stdout:8/824: mknod d3/d14/d1a/d29/d32/d40/d59/c10a 0 2024-05-06T21:26:55.884 INFO:tasks.workunit.client.1.smithi154.stdout:8/825: truncate d3/d14/d1a/d29/d32/fe4 1141366 0 2024-05-06T21:26:55.885 INFO:tasks.workunit.client.1.smithi154.stdout:9/981: dwrite d5/d2e/d8b/dc6/d103/f11a [0,4194304] 0 2024-05-06T21:26:55.889 INFO:tasks.workunit.client.1.smithi154.stdout:2/804: truncate db/d12/d19/d4b/f75 1120310 0 2024-05-06T21:26:55.890 INFO:tasks.workunit.client.1.smithi154.stdout:5/873: mkdir d2/d3/d19/d23/df9/dfd/d12b 0 2024-05-06T21:26:55.892 INFO:tasks.workunit.client.1.smithi154.stdout:0/968: creat d6/dc/d40/d10c/f143 x:0 0 0 2024-05-06T21:26:55.894 INFO:tasks.workunit.client.1.smithi154.stdout:3/980: dwrite d0/da/d1a/d28/d17/db0/f77 [4194304,4194304] 0 2024-05-06T21:26:55.895 INFO:tasks.workunit.client.1.smithi154.stdout:8/826: truncate d3/d14/d1a/d29/d32/d40/ff0 359797 0 2024-05-06T21:26:55.901 INFO:tasks.workunit.client.1.smithi154.stdout:9/982: mknod d5/d20/d37/c13e 0 2024-05-06T21:26:55.903 INFO:tasks.workunit.client.1.smithi154.stdout:2/805: getdents db/d12/d19/d81 0 2024-05-06T21:26:55.903 INFO:tasks.workunit.client.1.smithi154.stdout:2/806: chown db/d12/d19/d7d/db1/fb4 22 1 2024-05-06T21:26:55.907 INFO:tasks.workunit.client.1.smithi154.stdout:9/983: mkdir d5/d20/d52/d59/d102/d108/d13f 0 2024-05-06T21:26:55.907 INFO:tasks.workunit.client.1.smithi154.stdout:9/984: write d5/d20/d37/dd5/f120 [1035768,65172] 0 2024-05-06T21:26:55.909 INFO:tasks.workunit.client.1.smithi154.stdout:2/807: symlink db/d12/d1d/dcc/l105 0 2024-05-06T21:26:55.913 INFO:tasks.workunit.client.1.smithi154.stdout:2/808: mknod db/d86/c106 0 2024-05-06T21:26:55.915 INFO:tasks.workunit.client.1.smithi154.stdout:9/985: read d5/d20/f2c [1791251,99768] 0 2024-05-06T21:26:55.916 INFO:tasks.workunit.client.1.smithi154.stdout:3/981: dread d0/da/d1a/fe3 [4194304,4194304] 0 2024-05-06T21:26:55.916 INFO:tasks.workunit.client.1.smithi154.stdout:3/982: readlink d0/dd5/d11c/l11d 0 2024-05-06T21:26:55.916 INFO:tasks.workunit.client.1.smithi154.stdout:3/983: dread - d0/da/d1a/d28/dbc/d117/dd/d1c/d90/f12a zero size 2024-05-06T21:26:55.916 INFO:tasks.workunit.client.1.smithi154.stdout:3/984: chown d0/da/d1a/d28/dbc/d81/d48/da9 1492873239 1 2024-05-06T21:26:55.916 INFO:tasks.workunit.client.1.smithi154.stdout:2/809: unlink db/f7f 0 2024-05-06T21:26:55.917 INFO:tasks.workunit.client.1.smithi154.stdout:9/986: dread d5/d14/daf/db8/fc5 [0,4194304] 0 2024-05-06T21:26:55.919 INFO:tasks.workunit.client.1.smithi154.stdout:8/827: write d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f9e [2524840,79153] 0 2024-05-06T21:26:55.919 INFO:tasks.workunit.client.1.smithi154.stdout:8/828: write d3/f7a [462786,96828] 0 2024-05-06T21:26:55.919 INFO:tasks.workunit.client.1.smithi154.stdout:2/810: symlink db/de/d6f/l107 0 2024-05-06T21:26:55.919 INFO:tasks.workunit.client.1.smithi154.stdout:2/811: write db/f71 [4618103,45633] 0 2024-05-06T21:26:55.919 INFO:tasks.workunit.client.1.smithi154.stdout:2/812: stat db/d12 0 2024-05-06T21:26:55.924 INFO:tasks.workunit.client.1.smithi154.stdout:9/987: unlink d5/d20/d52/c2f 0 2024-05-06T21:26:55.929 INFO:tasks.workunit.client.1.smithi154.stdout:3/985: write d0/da/d1a/d28/dbc/d117/dd/d1c/d21/f42 [568645,122729] 0 2024-05-06T21:26:55.931 INFO:tasks.workunit.client.1.smithi154.stdout:2/813: write db/d12/f21 [1496688,86367] 0 2024-05-06T21:26:55.934 INFO:tasks.workunit.client.1.smithi154.stdout:0/969: dwrite d6/dc/d44/d36/f57 [0,4194304] 0 2024-05-06T21:26:55.934 INFO:tasks.workunit.client.1.smithi154.stdout:0/970: creat d6/dc/d51/d136/f144 x:0 0 0 2024-05-06T21:26:55.935 INFO:tasks.workunit.client.1.smithi154.stdout:8/829: symlink d3/d14/d1a/d29/d32/d40/d79/d90/l10b 0 2024-05-06T21:26:55.935 INFO:tasks.workunit.client.1.smithi154.stdout:5/874: dwrite d2/d3/d21/d95/dd/d2a/d54/d43/f7b [0,4194304] 0 2024-05-06T21:26:55.935 INFO:tasks.workunit.client.1.smithi154.stdout:3/986: creat d0/da/d1a/d28/dbc/d117/dd/d1c/d90/dc9/f148 x:0 0 0 2024-05-06T21:26:55.937 INFO:tasks.workunit.client.1.smithi154.stdout:9/988: dread d5/d14/f12f [0,4194304] 0 2024-05-06T21:26:55.942 INFO:tasks.workunit.client.1.smithi154.stdout:8/830: stat d3/d14/d1a/d29/d32/d40/d4b/d4d/lf9 0 2024-05-06T21:26:55.944 INFO:tasks.workunit.client.1.smithi154.stdout:5/875: getdents d2/d3/d21/d95/dc 0 2024-05-06T21:26:55.947 INFO:tasks.workunit.client.1.smithi154.stdout:3/987: symlink d0/da/d1a/d28/dbc/d10a/l149 0 2024-05-06T21:26:55.950 INFO:tasks.workunit.client.1.smithi154.stdout:9/989: link d5/d14/d87/d65/c7b d5/d20/d37/dd5/de1/c140 0 2024-05-06T21:26:55.953 INFO:tasks.workunit.client.1.smithi154.stdout:8/831: unlink d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/l103 0 2024-05-06T21:26:55.956 INFO:tasks.workunit.client.1.smithi154.stdout:3/988: symlink d0/da/d1a/d28/dbc/d117/dd/d1c/d90/de1/l14a 0 2024-05-06T21:26:55.956 INFO:tasks.workunit.client.1.smithi154.stdout:3/989: chown d0/da/d1a/d28/dbc/d117/dd/d1c/la4 1940870 1 2024-05-06T21:26:55.957 INFO:tasks.workunit.client.1.smithi154.stdout:9/990: symlink d5/d20/d52/d6e/d104/db1/dbd/l141 0 2024-05-06T21:26:55.960 INFO:tasks.workunit.client.1.smithi154.stdout:8/832: truncate d3/d14/d1a/d29/d32/d40/d79/f88 1348737 0 2024-05-06T21:26:55.964 INFO:tasks.workunit.client.1.smithi154.stdout:8/833: mknod d3/d14/d1a/d29/d32/d40/dfd/c10c 0 2024-05-06T21:26:55.965 INFO:tasks.workunit.client.1.smithi154.stdout:8/834: read d3/d14/d1a/d29/d32/d40/d79/f9d [379820,129297] 0 2024-05-06T21:26:55.971 INFO:tasks.workunit.client.1.smithi154.stdout:5/876: dwrite d2/d3/d21/d95/dc/d71/f11a [0,4194304] 0 2024-05-06T21:26:55.971 INFO:tasks.workunit.client.1.smithi154.stdout:5/877: chown d2/d3/d19/d23/d100/d126 411566 1 2024-05-06T21:26:55.971 INFO:tasks.workunit.client.1.smithi154.stdout:5/878: chown d2/d3/d21/d95/dc/d68/c79 116720545 1 2024-05-06T21:26:55.972 INFO:tasks.workunit.client.1.smithi154.stdout:5/879: mknod d2/d3/d21/d95/dd/d2a/d8d/c12c 0 2024-05-06T21:26:55.972 INFO:tasks.workunit.client.1.smithi154.stdout:5/880: dread - d2/d3/d21/d95/dd/f70 zero size 2024-05-06T21:26:55.972 INFO:tasks.workunit.client.1.smithi154.stdout:5/881: creat d2/d3/d21/d95/dd/d2a/d54/d43/f12d x:0 0 0 2024-05-06T21:26:55.973 INFO:tasks.workunit.client.1.smithi154.stdout:5/882: write d2/d3/d21/d22/f2e [3062575,124759] 0 2024-05-06T21:26:55.973 INFO:tasks.workunit.client.1.smithi154.stdout:5/883: dread - d2/d3/d21/d95/dc/d44/d9a/f11c zero size 2024-05-06T21:26:55.975 INFO:tasks.workunit.client.1.smithi154.stdout:0/971: dwrite d6/dc1/fda [4194304,4194304] 0 2024-05-06T21:26:55.976 INFO:tasks.workunit.client.1.smithi154.stdout:2/814: dwrite db/d12/d19/d81/f100 [0,4194304] 0 2024-05-06T21:26:55.976 INFO:tasks.workunit.client.1.smithi154.stdout:2/815: chown db/d12/d19/d4b/d78/de8/dfa 1572 1 2024-05-06T21:26:55.976 INFO:tasks.workunit.client.1.smithi154.stdout:2/816: write db/de/f99 [4524605,127541] 0 2024-05-06T21:26:55.976 INFO:tasks.workunit.client.1.smithi154.stdout:2/817: write db/d12/d1d/d60/fbb [1385280,111318] 0 2024-05-06T21:26:55.978 INFO:tasks.workunit.client.1.smithi154.stdout:5/884: symlink d2/d3/d21/d95/dd/dda/l12e 0 2024-05-06T21:26:55.979 INFO:tasks.workunit.client.1.smithi154.stdout:3/990: dwrite d0/da/d1a/d28/dbc/d117/dd/d1c/d41/f120 [8388608,4194304] 0 2024-05-06T21:26:55.979 INFO:tasks.workunit.client.1.smithi154.stdout:5/885: dread d2/d3/d21/d95/f7 [0,4194304] 0 2024-05-06T21:26:55.979 INFO:tasks.workunit.client.1.smithi154.stdout:5/886: fdatasync d2/d3/f6d 0 2024-05-06T21:26:55.985 INFO:tasks.workunit.client.1.smithi154.stdout:0/972: mkdir d6/dc/d40/d4a/da7/d145 0 2024-05-06T21:26:55.985 INFO:tasks.workunit.client.1.smithi154.stdout:0/973: chown d6/dc/d40/d4a/d6c/dce/df2 147843654 1 2024-05-06T21:26:55.985 INFO:tasks.workunit.client.1.smithi154.stdout:0/974: readlink d6/dc/d40/d5e/lc0 0 2024-05-06T21:26:55.985 INFO:tasks.workunit.client.1.smithi154.stdout:0/975: stat d6/dc/d40/d85/db2/dbb/dff/d121/f12c 0 2024-05-06T21:26:55.985 INFO:tasks.workunit.client.1.smithi154.stdout:3/991: read d0/da/d1a/d28/d4d/fbe [925146,30003] 0 2024-05-06T21:26:55.987 INFO:tasks.workunit.client.1.smithi154.stdout:2/818: creat db/d12/d4e/d104/f108 x:0 0 0 2024-05-06T21:26:55.988 INFO:tasks.workunit.client.1.smithi154.stdout:5/887: write d2/d3/d21/f26 [738557,37168] 0 2024-05-06T21:26:55.988 INFO:tasks.workunit.client.1.smithi154.stdout:5/888: write d2/d3/d19/d23/df9/f12a [660218,123436] 0 2024-05-06T21:26:55.991 INFO:tasks.workunit.client.1.smithi154.stdout:9/991: rename d5/d20/d37/dd5 to d5/d14/d87/d142 0 2024-05-06T21:26:55.993 INFO:tasks.workunit.client.1.smithi154.stdout:0/976: link d6/dc/d44/l30 d6/dc/d40/d4a/da7/d70/d96/l146 0 2024-05-06T21:26:55.994 INFO:tasks.workunit.client.1.smithi154.stdout:3/992: creat d0/da/d1a/d28/d17/dfe/d127/f14b x:0 0 0 2024-05-06T21:26:55.994 INFO:tasks.workunit.client.1.smithi154.stdout:3/993: truncate d0/da/d1a/d28/dbc/fba 881850 0 2024-05-06T21:26:55.999 INFO:tasks.workunit.client.1.smithi154.stdout:2/819: rmdir db/de/d10 39 2024-05-06T21:26:55.999 INFO:tasks.workunit.client.1.smithi154.stdout:2/820: fsync db/d12/d19/d4b/f75 0 2024-05-06T21:26:56.002 INFO:tasks.workunit.client.1.smithi154.stdout:2/821: mknod db/d12/d19/d81/c109 0 2024-05-06T21:26:56.004 INFO:tasks.workunit.client.1.smithi154.stdout:0/977: dread d6/dc/d40/d4a/da7/d70/f7e [0,4194304] 0 2024-05-06T21:26:56.004 INFO:tasks.workunit.client.1.smithi154.stdout:8/835: rename d3/d14/d1a/d45/dcf/ddf to d3/d14/d1a/d29/d32/d40/d10d 0 2024-05-06T21:26:56.005 INFO:tasks.workunit.client.1.smithi154.stdout:0/978: fsync d6/dc/d40/d4a/d6c/dce/dd7/fd8 0 2024-05-06T21:26:56.005 INFO:tasks.workunit.client.1.smithi154.stdout:0/979: readlink d6/dc/d3c/l109 0 2024-05-06T21:26:56.005 INFO:tasks.workunit.client.1.smithi154.stdout:0/980: chown d6/dc/d44/d36/l118 4473 1 2024-05-06T21:26:56.006 INFO:tasks.workunit.client.1.smithi154.stdout:2/822: rename db/d12/d4e/d104/f108 to db/d12/d1d/d60/f10a 0 2024-05-06T21:26:56.013 INFO:tasks.workunit.client.1.smithi154.stdout:7/696: sync 2024-05-06T21:26:56.013 INFO:tasks.workunit.client.1.smithi154.stdout:7/697: fdatasync d6/d42/d6c/d6e/fb4 0 2024-05-06T21:26:56.014 INFO:tasks.workunit.client.1.smithi154.stdout:2/823: link c3 db/de/d10/dbc/c10b 0 2024-05-06T21:26:56.015 INFO:tasks.workunit.client.1.smithi154.stdout:7/698: creat d6/d20/d40/daf/d5c/fe3 x:0 0 0 2024-05-06T21:26:56.023 INFO:tasks.workunit.client.1.smithi154.stdout:7/699: dread d6/d20/d40/d52/f88 [0,4194304] 0 2024-05-06T21:26:56.025 INFO:tasks.workunit.client.1.smithi154.stdout:7/700: link d6/d42/d6c/d6e/d21/l6d d6/d20/d85/le4 0 2024-05-06T21:26:56.027 INFO:tasks.workunit.client.1.smithi154.stdout:2/824: dread db/de/d10/d18/fa2 [0,4194304] 0 2024-05-06T21:26:56.027 INFO:tasks.workunit.client.1.smithi154.stdout:7/701: mkdir d6/d42/d6c/d6e/d21/de5 0 2024-05-06T21:26:56.027 INFO:tasks.workunit.client.1.smithi154.stdout:2/825: write db/de/d10/d18/fd6 [922003,83803] 0 2024-05-06T21:26:56.028 INFO:tasks.workunit.client.1.smithi154.stdout:7/702: creat d6/d42/dd1/fe6 x:0 0 0 2024-05-06T21:26:56.030 INFO:tasks.workunit.client.1.smithi154.stdout:2/826: creat db/de/d10/f10c x:0 0 0 2024-05-06T21:26:56.031 INFO:tasks.workunit.client.1.smithi154.stdout:7/703: truncate d6/d20/d40/d52/f9c 998417 0 2024-05-06T21:26:56.031 INFO:tasks.workunit.client.1.smithi154.stdout:7/704: read d6/f32 [2835280,15715] 0 2024-05-06T21:26:56.031 INFO:tasks.workunit.client.1.smithi154.stdout:7/705: truncate d6/d54/fcc 788838 0 2024-05-06T21:26:56.031 INFO:tasks.workunit.client.1.smithi154.stdout:7/706: readlink d6/d20/d40/daf/d5c/la8 0 2024-05-06T21:26:56.031 INFO:tasks.workunit.client.1.smithi154.stdout:7/707: readlink d6/d42/d6c/d6e/d23/lab 0 2024-05-06T21:26:56.032 INFO:tasks.workunit.client.1.smithi154.stdout:2/827: symlink db/d12/d1d/d83/l10d 0 2024-05-06T21:26:56.032 INFO:tasks.workunit.client.1.smithi154.stdout:2/828: fdatasync f0 0 2024-05-06T21:26:56.032 INFO:tasks.workunit.client.1.smithi154.stdout:7/708: getdents d6/d42/d6c/d6e/d21/d2e/d9d 0 2024-05-06T21:26:56.032 INFO:tasks.workunit.client.1.smithi154.stdout:7/709: fdatasync d6/d20/f89 0 2024-05-06T21:26:56.032 INFO:tasks.workunit.client.1.smithi154.stdout:7/710: write d6/d42/d6c/d6e/fdc [257402,72019] 0 2024-05-06T21:26:56.034 INFO:tasks.workunit.client.1.smithi154.stdout:3/994: dwrite d0/da/d1a/d28/d17/f49 [4194304,4194304] 0 2024-05-06T21:26:56.034 INFO:tasks.workunit.client.1.smithi154.stdout:5/889: dwrite d2/d3/d21/d95/dc/f15 [0,4194304] 0 2024-05-06T21:26:56.036 INFO:tasks.workunit.client.1.smithi154.stdout:0/981: dwrite d6/dc/d40/d85/db2/dbb/dff/d121/f12c [0,4194304] 0 2024-05-06T21:26:56.036 INFO:tasks.workunit.client.1.smithi154.stdout:0/982: dread - d6/dc/d42/fba zero size 2024-05-06T21:26:56.036 INFO:tasks.workunit.client.1.smithi154.stdout:8/836: dwrite d3/d14/d1a/d29/d43/fe1 [0,4194304] 0 2024-05-06T21:26:56.037 INFO:tasks.workunit.client.1.smithi154.stdout:9/992: dwrite d5/f122 [0,4194304] 0 2024-05-06T21:26:56.037 INFO:tasks.workunit.client.1.smithi154.stdout:2/829: truncate db/f13 7708397 0 2024-05-06T21:26:56.043 INFO:tasks.workunit.client.1.smithi154.stdout:0/983: symlink d6/dc/d40/d5e/l147 0 2024-05-06T21:26:56.043 INFO:tasks.workunit.client.1.smithi154.stdout:8/837: write d3/d14/d1a/d29/f3d [286947,124483] 0 2024-05-06T21:26:56.059 INFO:tasks.workunit.client.1.smithi154.stdout:2/830: dwrite db/de/d10/f30 [0,4194304] 0 2024-05-06T21:26:56.061 INFO:tasks.workunit.client.1.smithi154.stdout:3/995: dwrite d0/fea [0,4194304] 0 2024-05-06T21:26:56.061 INFO:tasks.workunit.client.1.smithi154.stdout:3/996: read - d0/da/d1a/d28/dbc/d81/f138 zero size 2024-05-06T21:26:56.066 INFO:tasks.workunit.client.1.smithi154.stdout:5/890: rename d2/d3/d21/d22/d25 to d2/d48/d12f 0 2024-05-06T21:26:56.066 INFO:tasks.workunit.client.1.smithi154.stdout:5/891: creat d2/d3/d21/d95/dd/d2a/d54/d43/d73/f130 x:0 0 0 2024-05-06T21:26:56.071 INFO:tasks.workunit.client.1.smithi154.stdout:8/838: truncate d3/d14/f19 6924251 0 2024-05-06T21:26:56.071 INFO:tasks.workunit.client.1.smithi154.stdout:8/839: truncate d3/d14/d1a/f28 824258 0 2024-05-06T21:26:56.072 INFO:tasks.workunit.client.1.smithi154.stdout:2/831: mknod db/d12/dbf/dd7/c10e 0 2024-05-06T21:26:56.075 INFO:tasks.workunit.client.1.smithi154.stdout:5/892: dread d2/d3/d21/d95/dc/f66 [0,4194304] 0 2024-05-06T21:26:56.076 INFO:tasks.workunit.client.1.smithi154.stdout:9/993: rename d5/d20/d52/d6e/d83/de5/d11b to d5/d2e/da0/d143 0 2024-05-06T21:26:56.078 INFO:tasks.workunit.client.1.smithi154.stdout:0/984: getdents d6/dc/d40/d85 0 2024-05-06T21:26:56.079 INFO:tasks.workunit.client.1.smithi154.stdout:0/985: creat d6/dc/d40/d85/db2/dbb/f148 x:0 0 0 2024-05-06T21:26:56.082 INFO:tasks.workunit.client.1.smithi154.stdout:4/889: sync 2024-05-06T21:26:56.083 INFO:tasks.workunit.client.1.smithi154.stdout:1/846: sync 2024-05-06T21:26:56.084 INFO:tasks.workunit.client.1.smithi154.stdout:3/997: rmdir d0/da/d1a/d28/dbc/d117/d52 39 2024-05-06T21:26:56.085 INFO:tasks.workunit.client.1.smithi154.stdout:5/893: truncate d2/d3/d21/d95/dd/f64 3119194 0 2024-05-06T21:26:56.088 INFO:tasks.workunit.client.1.smithi154.stdout:2/832: rename db/de/d16/d4f/fd2 to db/d12/d4e/d104/f10f 0 2024-05-06T21:26:56.090 INFO:tasks.workunit.client.1.smithi154.stdout:9/994: creat d5/d11c/f144 x:0 0 0 2024-05-06T21:26:56.090 INFO:tasks.workunit.client.1.smithi154.stdout:9/995: creat d5/d20/d52/f145 x:0 0 0 2024-05-06T21:26:56.092 INFO:tasks.workunit.client.1.smithi154.stdout:0/986: symlink d6/dc/d40/d4a/dac/l149 0 2024-05-06T21:26:56.094 INFO:tasks.workunit.client.1.smithi154.stdout:8/840: rmdir d3/d14/d1a/d29/d32/d40/d59/d67/da7 39 2024-05-06T21:26:56.095 INFO:tasks.workunit.client.1.smithi154.stdout:2/833: write db/de/d16/d33/fc0 [3902442,100168] 0 2024-05-06T21:26:56.096 INFO:tasks.workunit.client.1.smithi154.stdout:1/847: truncate d6/db/d5e/db8/ff6 677189 0 2024-05-06T21:26:56.097 INFO:tasks.workunit.client.1.smithi154.stdout:4/890: mknod d0/d2/dbd/c129 0 2024-05-06T21:26:56.097 INFO:tasks.workunit.client.1.smithi154.stdout:6/652: sync 2024-05-06T21:26:56.098 INFO:tasks.workunit.client.1.smithi154.stdout:3/998: rmdir d0/dd5 39 2024-05-06T21:26:56.101 INFO:tasks.workunit.client.1.smithi154.stdout:5/894: creat d2/d3/d21/d95/dc/f131 x:0 0 0 2024-05-06T21:26:56.104 INFO:tasks.workunit.client.1.smithi154.stdout:9/996: symlink d5/d14/d87/d65/l146 0 2024-05-06T21:26:56.106 INFO:tasks.workunit.client.1.smithi154.stdout:0/987: symlink d6/dc/d51/l14a 0 2024-05-06T21:26:56.111 INFO:tasks.workunit.client.1.smithi154.stdout:2/834: symlink db/d12/dbf/dd7/l110 0 2024-05-06T21:26:56.111 INFO:tasks.workunit.client.1.smithi154.stdout:2/835: readlink db/d12/d19/l3d 0 2024-05-06T21:26:56.112 INFO:tasks.workunit.client.1.smithi154.stdout:1/848: rename d6/db/d10/d26/f6b to d6/db/d69/f104 0 2024-05-06T21:26:56.113 INFO:tasks.workunit.client.1.smithi154.stdout:3/999: mknod d0/da/d1a/d28/dbc/d81/d48/da9/db3/c14c 0 2024-05-06T21:26:56.115 INFO:tasks.workunit.client.1.smithi154.stdout:0/988: symlink d6/dc/d40/d85/db2/dbb/l14b 0 2024-05-06T21:26:56.116 INFO:tasks.workunit.client.1.smithi154.stdout:8/841: getdents d3/d14/d1a/d29/d3e 0 2024-05-06T21:26:56.118 INFO:tasks.workunit.client.1.smithi154.stdout:1/849: mkdir d6/d3e/d7e/da5/d105 0 2024-05-06T21:26:56.119 INFO:tasks.workunit.client.1.smithi154.stdout:5/895: getdents d2/d3/d21/d95/dc/d44 0 2024-05-06T21:26:56.121 INFO:tasks.workunit.client.1.smithi154.stdout:0/989: creat d6/dc/d40/d5e/f14c x:0 0 0 2024-05-06T21:26:56.121 INFO:tasks.workunit.client.1.smithi154.stdout:2/836: dread db/de/d16/f52 [0,4194304] 0 2024-05-06T21:26:56.122 INFO:tasks.workunit.client.1.smithi154.stdout:0/990: getdents d6/dc/d40/d10c/d119 0 2024-05-06T21:26:56.124 INFO:tasks.workunit.client.1.smithi154.stdout:2/837: mkdir db/d12/d1d/d60/d111 0 2024-05-06T21:26:56.127 INFO:tasks.workunit.client.1.smithi154.stdout:0/991: dread d6/dc/d40/d4a/d6c/dce/fed [0,4194304] 0 2024-05-06T21:26:56.127 INFO:tasks.workunit.client.1.smithi154.stdout:0/992: read - d6/dc/d40/d5e/fe1 zero size 2024-05-06T21:26:56.127 INFO:tasks.workunit.client.1.smithi154.stdout:0/993: rename d6/dc to d6/dc/d40/d10c/d119/d14d 22 2024-05-06T21:26:56.132 INFO:tasks.workunit.client.1.smithi154.stdout:0/994: rename d6/dc/d40/d4a/d6c/d8a/f130 to d6/dc/d40/f14e 0 2024-05-06T21:26:56.135 INFO:tasks.workunit.client.1.smithi154.stdout:0/995: creat d6/dc1/dd0/d107/f14f x:0 0 0 2024-05-06T21:26:56.136 INFO:tasks.workunit.client.1.smithi154.stdout:0/996: write d6/dc/d51/d54/dbd/fc5 [386617,23909] 0 2024-05-06T21:26:56.136 INFO:tasks.workunit.client.1.smithi154.stdout:0/997: write d6/dc/d40/d85/db2/dbb/fbc [172119,52541] 0 2024-05-06T21:26:56.136 INFO:tasks.workunit.client.1.smithi154.stdout:0/998: write d6/dc/d40/d4a/d6c/fb4 [4367450,105529] 0 2024-05-06T21:26:56.136 INFO:tasks.workunit.client.1.smithi154.stdout:0/999: write d6/dc/d42/f90 [669607,129856] 0 2024-05-06T21:26:56.136 INFO:tasks.workunit.client.1.smithi154.stdout:4/891: dwrite d0/d82/d44/d73/f2c [0,4194304] 0 2024-05-06T21:26:56.138 INFO:tasks.workunit.client.1.smithi154.stdout:4/892: symlink d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/dc7/d11f/l12a 0 2024-05-06T21:26:56.140 INFO:tasks.workunit.client.1.smithi154.stdout:4/893: mknod d0/d82/d44/d73/d4a/dd4/dcd/c12b 0 2024-05-06T21:26:56.146 INFO:tasks.workunit.client.1.smithi154.stdout:4/894: write d0/d2/dc/f20 [2477356,85481] 0 2024-05-06T21:26:56.147 INFO:tasks.workunit.client.1.smithi154.stdout:4/895: symlink d0/d82/d44/d73/d4a/dd4/d1a/dd2/l12c 0 2024-05-06T21:26:56.149 INFO:tasks.workunit.client.1.smithi154.stdout:4/896: symlink d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/db5/db7/df3/l12d 0 2024-05-06T21:26:56.149 INFO:tasks.workunit.client.1.smithi154.stdout:4/897: dread - d0/d2/d47/d81/fdd zero size 2024-05-06T21:26:56.158 INFO:tasks.workunit.client.1.smithi154.stdout:1/850: dwrite d6/d3e/fa0 [0,4194304] 0 2024-05-06T21:26:56.167 INFO:tasks.workunit.client.1.smithi154.stdout:9/997: dwrite d5/d2e/fc4 [0,4194304] 0 2024-05-06T21:26:56.167 INFO:tasks.workunit.client.1.smithi154.stdout:2/838: dwrite db/de/d16/f28 [4194304,4194304] 0 2024-05-06T21:26:56.167 INFO:tasks.workunit.client.1.smithi154.stdout:5/896: dwrite d2/d3/d21/d95/dd/d2a/d54/d43/db1/ff4 [0,4194304] 0 2024-05-06T21:26:56.168 INFO:tasks.workunit.client.1.smithi154.stdout:8/842: dwrite d3/d14/d1a/d29/d32/d40/d79/f4e [0,4194304] 0 2024-05-06T21:26:56.170 INFO:tasks.workunit.client.1.smithi154.stdout:9/998: creat d5/d2e/d8b/f147 x:0 0 0 2024-05-06T21:26:56.172 INFO:tasks.workunit.client.1.smithi154.stdout:2/839: symlink db/de/d10/dbc/l112 0 2024-05-06T21:26:56.172 INFO:tasks.workunit.client.1.smithi154.stdout:2/840: write db/d12/d4e/fcd [1632782,18864] 0 2024-05-06T21:26:56.172 INFO:tasks.workunit.client.1.smithi154.stdout:1/851: dread d6/db/d97/ff9 [0,4194304] 0 2024-05-06T21:26:56.173 INFO:tasks.workunit.client.1.smithi154.stdout:5/897: write d2/d3/d21/d95/dd/fad [3648330,2957] 0 2024-05-06T21:26:56.174 INFO:tasks.workunit.client.1.smithi154.stdout:8/843: rename d3/d14/d1a/d45/dcf/db4/le9 to d3/d64/l10e 0 2024-05-06T21:26:56.174 INFO:tasks.workunit.client.1.smithi154.stdout:8/844: chown d3/fb 13233236 1 2024-05-06T21:26:56.175 INFO:tasks.workunit.client.1.smithi154.stdout:2/841: mknod db/d12/d19/d4b/c113 0 2024-05-06T21:26:56.176 INFO:tasks.workunit.client.1.smithi154.stdout:4/898: dwrite d0/d82/d44/f4d [0,4194304] 0 2024-05-06T21:26:56.177 INFO:tasks.workunit.client.1.smithi154.stdout:4/899: fsync d0/f34 0 2024-05-06T21:26:56.177 INFO:tasks.workunit.client.1.smithi154.stdout:4/900: write d0/d2/f53 [1560732,17346] 0 2024-05-06T21:26:56.177 INFO:tasks.workunit.client.1.smithi154.stdout:4/901: readlink d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/dbb/dee/l109 0 2024-05-06T21:26:56.180 INFO:tasks.workunit.client.1.smithi154.stdout:8/845: unlink d3/d14/d1a/fe7 0 2024-05-06T21:26:56.180 INFO:tasks.workunit.client.1.smithi154.stdout:8/846: dread - d3/d14/d1a/d45/ff8 zero size 2024-05-06T21:26:56.181 INFO:tasks.workunit.client.1.smithi154.stdout:8/847: creat d3/d14/d1a/f10f x:0 0 0 2024-05-06T21:26:56.181 INFO:tasks.workunit.client.1.smithi154.stdout:8/848: chown d3/d14/f20 110765441 1 2024-05-06T21:26:56.181 INFO:tasks.workunit.client.1.smithi154.stdout:4/902: dread d0/d2/dc/fc4 [0,4194304] 0 2024-05-06T21:26:56.182 INFO:tasks.workunit.client.1.smithi154.stdout:4/903: creat d0/d82/d44/d73/d4a/dd4/f12e x:0 0 0 2024-05-06T21:26:56.186 INFO:tasks.workunit.client.1.smithi154.stdout:5/898: rename d2/d3/d21/d22/c10b to d2/d3/d21/d95/dd/d2a/d54/c132 0 2024-05-06T21:26:56.186 INFO:tasks.workunit.client.1.smithi154.stdout:5/899: chown d2/d3/d21/d95/l62 1884 1 2024-05-06T21:26:56.189 INFO:tasks.workunit.client.1.smithi154.stdout:4/904: mknod d0/d82/ddb/d120/c12f 0 2024-05-06T21:26:56.190 INFO:tasks.workunit.client.1.smithi154.stdout:4/905: write d0/d82/d44/d73/def/f125 [81023,83726] 0 2024-05-06T21:26:56.190 INFO:tasks.workunit.client.1.smithi154.stdout:4/906: fdatasync d0/d82/d39/d63/f8e 0 2024-05-06T21:26:56.191 INFO:tasks.workunit.client.1.smithi154.stdout:5/900: link d2/d3/l5d d2/d3/d19/dbe/d11f/l133 0 2024-05-06T21:26:56.192 INFO:tasks.workunit.client.1.smithi154.stdout:8/849: dread d3/d64/d6d/dbd/f3a [0,4194304] 0 2024-05-06T21:26:56.193 INFO:tasks.workunit.client.1.smithi154.stdout:4/907: symlink d0/d82/d44/d73/d4a/d74/d75/l130 0 2024-05-06T21:26:56.193 INFO:tasks.workunit.client.1.smithi154.stdout:4/908: chown d0/d82/f77 18350 1 2024-05-06T21:26:56.195 INFO:tasks.workunit.client.1.smithi154.stdout:4/909: creat d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/f131 x:0 0 0 2024-05-06T21:26:56.195 INFO:tasks.workunit.client.1.smithi154.stdout:4/910: dread - d0/d2/d47/d105/f124 zero size 2024-05-06T21:26:56.198 INFO:tasks.workunit.client.1.smithi154.stdout:4/911: unlink d0/d82/d44/c78 0 2024-05-06T21:26:56.198 INFO:tasks.workunit.client.1.smithi154.stdout:4/912: creat d0/d82/ddb/f132 x:0 0 0 2024-05-06T21:26:56.198 INFO:tasks.workunit.client.1.smithi154.stdout:4/913: fdatasync d0/d82/d44/d73/f36 0 2024-05-06T21:26:56.201 INFO:tasks.workunit.client.1.smithi154.stdout:5/901: write d2/d3/d21/d95/dc/d44/f11b [3453884,91695] 0 2024-05-06T21:26:56.204 INFO:tasks.workunit.client.1.smithi154.stdout:5/902: truncate d2/d3/d21/d22/f2e 3057275 0 2024-05-06T21:26:56.205 INFO:tasks.workunit.client.1.smithi154.stdout:5/903: stat d2/d3/d21/d95/dd/d2a/d54/c132 0 2024-05-06T21:26:56.205 INFO:tasks.workunit.client.1.smithi154.stdout:1/852: dwrite d6/db/f99 [4194304,4194304] 0 2024-05-06T21:26:56.205 INFO:tasks.workunit.client.1.smithi154.stdout:1/853: write d6/db/d5e/db8/fdc [178139,93271] 0 2024-05-06T21:26:56.206 INFO:tasks.workunit.client.1.smithi154.stdout:1/854: write d6/db/d10/de5/ff2 [516632,65770] 0 2024-05-06T21:26:56.206 INFO:tasks.workunit.client.1.smithi154.stdout:8/850: write d3/d14/f18 [3728757,21321] 0 2024-05-06T21:26:56.206 INFO:tasks.workunit.client.1.smithi154.stdout:8/851: stat d3/d14/d1a/d29/f3d 0 2024-05-06T21:26:56.206 INFO:tasks.workunit.client.1.smithi154.stdout:5/904: getdents d2/d3/d21/d95/dc/d44/d9a/dab 0 2024-05-06T21:26:56.207 INFO:tasks.workunit.client.1.smithi154.stdout:9/999: dwrite d5/d2e/dee/f130 [0,4194304] 0 2024-05-06T21:26:56.207 INFO:tasks.workunit.client.1.smithi154.stdout:2/842: dwrite db/d12/d1d/f48 [0,4194304] 0 2024-05-06T21:26:56.211 INFO:tasks.workunit.client.1.smithi154.stdout:5/905: dread d2/d3/d21/d95/dc/d68/d69/fa3 [0,4194304] 0 2024-05-06T21:26:56.211 INFO:tasks.workunit.client.1.smithi154.stdout:8/852: creat d3/d14/d1a/d29/d32/d40/d10d/f110 x:0 0 0 2024-05-06T21:26:56.211 INFO:tasks.workunit.client.1.smithi154.stdout:8/853: creat d3/d64/d6d/dbd/dce/f111 x:0 0 0 2024-05-06T21:26:56.211 INFO:tasks.workunit.client.1.smithi154.stdout:8/854: chown d3/d14/d1a/d29/d32/d40/d59/d67/f105 14391 1 2024-05-06T21:26:56.211 INFO:tasks.workunit.client.1.smithi154.stdout:8/855: creat d3/d14/d1a/d45/dcf/db4/f112 x:0 0 0 2024-05-06T21:26:56.211 INFO:tasks.workunit.client.1.smithi154.stdout:8/856: fsync d3/d14/d1a/d45/f7d 0 2024-05-06T21:26:56.211 INFO:tasks.workunit.client.1.smithi154.stdout:8/857: chown d3/d14/fbf 894 1 2024-05-06T21:26:56.214 INFO:tasks.workunit.client.1.smithi154.stdout:2/843: symlink db/d86/l114 0 2024-05-06T21:26:56.216 INFO:tasks.workunit.client.1.smithi154.stdout:1/855: dread d6/d3e/d7e/fb5 [4194304,4194304] 0 2024-05-06T21:26:56.217 INFO:tasks.workunit.client.1.smithi154.stdout:5/906: unlink d2/d3/d21/d95/dc/d44/dc0/de6/l10f 0 2024-05-06T21:26:56.218 INFO:tasks.workunit.client.1.smithi154.stdout:5/907: write d2/d3/d21/d95/dc/d71/f81 [5196951,51559] 0 2024-05-06T21:26:56.218 INFO:tasks.workunit.client.1.smithi154.stdout:4/914: dwrite d0/d82/d44/d73/d4a/dd4/d1a/d10b/dfc/f111 [0,4194304] 0 2024-05-06T21:26:56.219 INFO:tasks.workunit.client.1.smithi154.stdout:4/915: write d0/d82/d44/d73/def/df1/f113 [104281,45887] 0 2024-05-06T21:26:56.219 INFO:tasks.workunit.client.1.smithi154.stdout:4/916: creat d0/d82/d44/d73/d4a/dd4/d1a/d10b/dfc/f133 x:0 0 0 2024-05-06T21:26:56.230 INFO:tasks.workunit.client.1.smithi154.stdout:5/908: creat d2/d3/d19/d23/df9/dfd/d12b/f134 x:0 0 0 2024-05-06T21:26:56.247 INFO:tasks.workunit.client.1.smithi154.stdout:4/917: mknod d0/d10/c134 0 2024-05-06T21:26:56.247 INFO:tasks.workunit.client.1.smithi154.stdout:4/918: dread - d0/d82/d3d/f10a zero size 2024-05-06T21:26:56.248 INFO:tasks.workunit.client.1.smithi154.stdout:1/856: unlink d6/db/d74/cc7 0 2024-05-06T21:26:56.249 INFO:tasks.workunit.client.1.smithi154.stdout:5/909: creat d2/d3/d19/dbe/f135 x:0 0 0 2024-05-06T21:26:56.249 INFO:tasks.workunit.client.1.smithi154.stdout:5/910: dread - d2/d3/d21/d95/dd/d2a/d54/dce/fd8 zero size 2024-05-06T21:26:56.249 INFO:tasks.workunit.client.1.smithi154.stdout:1/857: truncate d6/d3e/d7e/da5/da8/fc2 604886 0 2024-05-06T21:26:56.250 INFO:tasks.workunit.client.1.smithi154.stdout:5/911: mkdir d2/d136 0 2024-05-06T21:26:56.252 INFO:tasks.workunit.client.1.smithi154.stdout:1/858: symlink d6/db/d74/l106 0 2024-05-06T21:26:56.252 INFO:tasks.workunit.client.1.smithi154.stdout:1/859: dread - d6/db/d10/d94/ff1 zero size 2024-05-06T21:26:56.259 INFO:tasks.workunit.client.1.smithi154.stdout:2/844: dwrite db/d12/f21 [0,4194304] 0 2024-05-06T21:26:56.260 INFO:tasks.workunit.client.1.smithi154.stdout:4/919: write d0/d2/d47/fbf [4470925,92501] 0 2024-05-06T21:26:56.260 INFO:tasks.workunit.client.1.smithi154.stdout:4/920: dread - d0/d82/d44/d73/d4a/dd4/fe1 zero size 2024-05-06T21:26:56.261 INFO:tasks.workunit.client.1.smithi154.stdout:4/921: read d0/d2/f53 [355434,73735] 0 2024-05-06T21:26:56.261 INFO:tasks.workunit.client.1.smithi154.stdout:8/858: dwrite d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f9e [0,4194304] 0 2024-05-06T21:26:56.262 INFO:tasks.workunit.client.1.smithi154.stdout:2/845: rename db/c29 to db/de/d10/c115 0 2024-05-06T21:26:56.262 INFO:tasks.workunit.client.1.smithi154.stdout:2/846: chown db/d12/d1d/l6c 0 1 2024-05-06T21:26:56.262 INFO:tasks.workunit.client.1.smithi154.stdout:2/847: chown db/d12/d19/f56 199988247 1 2024-05-06T21:26:56.269 INFO:tasks.workunit.client.1.smithi154.stdout:2/848: mkdir db/d12/d4e/d55/d116 0 2024-05-06T21:26:56.273 INFO:tasks.workunit.client.1.smithi154.stdout:5/912: dwrite d2/d3/d21/d95/dc/d44/d9a/fd0 [0,4194304] 0 2024-05-06T21:26:56.273 INFO:tasks.workunit.client.1.smithi154.stdout:2/849: rename db/d12/d19/d91 to db/d12/d1d/d60/d63/d117 0 2024-05-06T21:26:56.276 INFO:tasks.workunit.client.1.smithi154.stdout:8/859: dread d3/d14/f20 [4194304,4194304] 0 2024-05-06T21:26:56.277 INFO:tasks.workunit.client.1.smithi154.stdout:5/913: symlink d2/d3/d21/d95/dc/d44/dc0/l137 0 2024-05-06T21:26:56.279 INFO:tasks.workunit.client.1.smithi154.stdout:8/860: symlink d3/d56/l113 0 2024-05-06T21:26:56.280 INFO:tasks.workunit.client.1.smithi154.stdout:2/850: write db/de/d10/d18/fa2 [3600473,26722] 0 2024-05-06T21:26:56.282 INFO:tasks.workunit.client.1.smithi154.stdout:8/861: link d3/d14/d1a/d29/da3/cca d3/d64/c114 0 2024-05-06T21:26:56.284 INFO:tasks.workunit.client.1.smithi154.stdout:2/851: rename db/c22 to db/de/d10/dbc/ded/c118 0 2024-05-06T21:26:56.287 INFO:tasks.workunit.client.1.smithi154.stdout:2/852: rename db/d12/d4e/fdb to db/d12/f119 0 2024-05-06T21:26:56.287 INFO:tasks.workunit.client.1.smithi154.stdout:2/853: write db/d12/d4e/d55/f7a [3267149,81138] 0 2024-05-06T21:26:56.290 INFO:tasks.workunit.client.1.smithi154.stdout:1/860: dwrite d6/db/d5e/db8/fdc [0,4194304] 0 2024-05-06T21:26:56.290 INFO:tasks.workunit.client.1.smithi154.stdout:1/861: creat d6/db/d10/de5/f107 x:0 0 0 2024-05-06T21:26:56.292 INFO:tasks.workunit.client.1.smithi154.stdout:8/862: write d3/d14/d1a/d29/d43/f5d [2167032,100176] 0 2024-05-06T21:26:56.296 INFO:tasks.workunit.client.1.smithi154.stdout:8/863: rename d3/d14/d1a/d29/d32/d40/d59/f55 to d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/dfc/f115 0 2024-05-06T21:26:56.297 INFO:tasks.workunit.client.1.smithi154.stdout:8/864: creat d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/f116 x:0 0 0 2024-05-06T21:26:56.297 INFO:tasks.workunit.client.1.smithi154.stdout:7/711: sync 2024-05-06T21:26:56.297 INFO:tasks.workunit.client.1.smithi154.stdout:7/712: dread - d6/d42/d6c/d6e/d21/d69/d7b/d9f/fb6 zero size 2024-05-06T21:26:56.301 INFO:tasks.workunit.client.1.smithi154.stdout:1/862: write d6/db/d10/d26/f23 [976276,14603] 0 2024-05-06T21:26:56.301 INFO:tasks.workunit.client.1.smithi154.stdout:8/865: symlink d3/d14/d1a/d29/d32/l117 0 2024-05-06T21:26:56.302 INFO:tasks.workunit.client.1.smithi154.stdout:2/854: dread db/de/d16/f65 [0,4194304] 0 2024-05-06T21:26:56.302 INFO:tasks.workunit.client.1.smithi154.stdout:2/855: creat db/de/d10/f11a x:0 0 0 2024-05-06T21:26:56.307 INFO:tasks.workunit.client.1.smithi154.stdout:8/866: truncate d3/d14/f19 1790845 0 2024-05-06T21:26:56.307 INFO:tasks.workunit.client.1.smithi154.stdout:6/653: sync 2024-05-06T21:26:56.308 INFO:tasks.workunit.client.1.smithi154.stdout:1/863: mkdir d6/db/d10/d15/d108 0 2024-05-06T21:26:56.308 INFO:tasks.workunit.client.1.smithi154.stdout:1/864: fsync d6/db/f34 0 2024-05-06T21:26:56.308 INFO:tasks.workunit.client.1.smithi154.stdout:5/914: dwrite d2/d3/d21/d95/dc/d44/d9a/f11c [0,4194304] 0 2024-05-06T21:26:56.309 INFO:tasks.workunit.client.1.smithi154.stdout:4/922: dwrite d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/f7d [0,4194304] 0 2024-05-06T21:26:56.309 INFO:tasks.workunit.client.1.smithi154.stdout:4/923: fsync d0/f34 0 2024-05-06T21:26:56.311 INFO:tasks.workunit.client.1.smithi154.stdout:2/856: mkdir db/d12/d1d/d11b 0 2024-05-06T21:26:56.311 INFO:tasks.workunit.client.1.smithi154.stdout:8/867: mknod d3/d14/d1a/d29/d43/c118 0 2024-05-06T21:26:56.318 INFO:tasks.workunit.client.1.smithi154.stdout:5/915: rename d2/d3/d21/d22/c89 to d2/d3/c138 0 2024-05-06T21:26:56.319 INFO:tasks.workunit.client.1.smithi154.stdout:6/654: write d8/d11/d2d/d3d/d70/d7b/d95/fa7 [3522057,91954] 0 2024-05-06T21:26:56.319 INFO:tasks.workunit.client.1.smithi154.stdout:6/655: chown d8/d11/fab 104830988 1 2024-05-06T21:26:56.319 INFO:tasks.workunit.client.1.smithi154.stdout:6/656: chown d8/d11/f99 926851199 1 2024-05-06T21:26:56.319 INFO:tasks.workunit.client.1.smithi154.stdout:6/657: read d8/d13/da9/f6f [3692560,126377] 0 2024-05-06T21:26:56.319 INFO:tasks.workunit.client.1.smithi154.stdout:6/658: truncate d8/d11/d8d/fc5 1513063 0 2024-05-06T21:26:56.319 INFO:tasks.workunit.client.1.smithi154.stdout:6/659: chown d8/d11/d2d/da3 47 1 2024-05-06T21:26:56.319 INFO:tasks.workunit.client.1.smithi154.stdout:6/660: creat d8/d11/d2d/d3d/d70/d7b/d95/fc9 x:0 0 0 2024-05-06T21:26:56.322 INFO:tasks.workunit.client.1.smithi154.stdout:7/713: dwrite d6/d54/f84 [0,4194304] 0 2024-05-06T21:26:56.326 INFO:tasks.workunit.client.1.smithi154.stdout:8/868: truncate d3/d14/d1a/d29/f74 3931187 0 2024-05-06T21:26:56.328 INFO:tasks.workunit.client.1.smithi154.stdout:1/865: dwrite d6/db/d5e/db8/ff6 [0,4194304] 0 2024-05-06T21:26:56.329 INFO:tasks.workunit.client.1.smithi154.stdout:5/916: mknod d2/d3/d19/d23/df9/dfd/c139 0 2024-05-06T21:26:56.329 INFO:tasks.workunit.client.1.smithi154.stdout:1/866: fdatasync d6/db/d5e/db8/fdc 0 2024-05-06T21:26:56.336 INFO:tasks.workunit.client.1.smithi154.stdout:4/924: dwrite d0/d82/d44/d73/d4a/dd4/d1a/fe7 [0,4194304] 0 2024-05-06T21:26:56.336 INFO:tasks.workunit.client.1.smithi154.stdout:4/925: dread - d0/d82/ddb/f128 zero size 2024-05-06T21:26:56.336 INFO:tasks.workunit.client.1.smithi154.stdout:6/661: mkdir d8/d11/d2d/d3d/d4c/dca 0 2024-05-06T21:26:56.338 INFO:tasks.workunit.client.1.smithi154.stdout:1/867: read d6/d3e/d7e/fb5 [8104089,120830] 0 2024-05-06T21:26:56.341 INFO:tasks.workunit.client.1.smithi154.stdout:2/857: getdents db/de 0 2024-05-06T21:26:56.341 INFO:tasks.workunit.client.1.smithi154.stdout:2/858: truncate db/d12/d19/d4b/d78/f9f 61008 0 2024-05-06T21:26:56.343 INFO:tasks.workunit.client.1.smithi154.stdout:8/869: rmdir d3/d64/d6d/dbd/d6b 39 2024-05-06T21:26:56.345 INFO:tasks.workunit.client.1.smithi154.stdout:5/917: creat d2/d3/d21/d95/deb/f13a x:0 0 0 2024-05-06T21:26:56.345 INFO:tasks.workunit.client.1.smithi154.stdout:5/918: chown d2/d3/d19/d23/ff3 56 1 2024-05-06T21:26:56.345 INFO:tasks.workunit.client.1.smithi154.stdout:5/919: stat d2/d3/d21/d95/dd/c4a 0 2024-05-06T21:26:56.345 INFO:tasks.workunit.client.1.smithi154.stdout:5/920: fdatasync d2/d3/d21/d95/dc/fae 0 2024-05-06T21:26:56.349 INFO:tasks.workunit.client.1.smithi154.stdout:6/662: unlink d8/d13/f64 0 2024-05-06T21:26:56.352 INFO:tasks.workunit.client.1.smithi154.stdout:2/859: symlink db/de/d6f/l11c 0 2024-05-06T21:26:56.352 INFO:tasks.workunit.client.1.smithi154.stdout:2/860: truncate db/d86/fe4 446429 0 2024-05-06T21:26:56.353 INFO:tasks.workunit.client.1.smithi154.stdout:5/921: creat d2/d3/d21/d95/dc/d44/f13b x:0 0 0 2024-05-06T21:26:56.354 INFO:tasks.workunit.client.1.smithi154.stdout:5/922: chown d2/d3/cca 1472483 1 2024-05-06T21:26:56.357 INFO:tasks.workunit.client.1.smithi154.stdout:6/663: link d8/d11/d33/d4a/d6c/fb1 d8/d11/d2d/d3d/d4c/dba/fcb 0 2024-05-06T21:26:56.358 INFO:tasks.workunit.client.1.smithi154.stdout:1/868: getdents d6/db/d69/d89 0 2024-05-06T21:26:56.360 INFO:tasks.workunit.client.1.smithi154.stdout:4/926: dwrite d0/d82/d39/fca [0,4194304] 0 2024-05-06T21:26:56.361 INFO:tasks.workunit.client.1.smithi154.stdout:8/870: dwrite d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/fd0 [0,4194304] 0 2024-05-06T21:26:56.361 INFO:tasks.workunit.client.1.smithi154.stdout:7/714: dwrite d6/d20/d40/daf/d5c/fe3 [0,4194304] 0 2024-05-06T21:26:56.361 INFO:tasks.workunit.client.1.smithi154.stdout:7/715: write d6/d42/d6c/d6e/d21/d69/d7b/fad [1429988,125967] 0 2024-05-06T21:26:56.361 INFO:tasks.workunit.client.1.smithi154.stdout:7/716: write d6/d42/d6c/d6e/d21/d69/f78 [336436,44548] 0 2024-05-06T21:26:56.361 INFO:tasks.workunit.client.1.smithi154.stdout:7/717: fsync d6/d20/d40/daf/d5c/f7c 0 2024-05-06T21:26:56.363 INFO:tasks.workunit.client.1.smithi154.stdout:2/861: truncate db/d12/d19/f56 1491040 0 2024-05-06T21:26:56.363 INFO:tasks.workunit.client.1.smithi154.stdout:2/862: chown db/de/d16/f98 0 1 2024-05-06T21:26:56.367 INFO:tasks.workunit.client.1.smithi154.stdout:1/869: rmdir d6/db/d10/d15/d108 0 2024-05-06T21:26:56.373 INFO:tasks.workunit.client.1.smithi154.stdout:5/923: dwrite d2/d48/d12f/db0/f106 [0,4194304] 0 2024-05-06T21:26:56.373 INFO:tasks.workunit.client.1.smithi154.stdout:4/927: dread d0/d82/d44/d73/f2c [0,4194304] 0 2024-05-06T21:26:56.373 INFO:tasks.workunit.client.1.smithi154.stdout:5/924: truncate d2/d3/d21/d95/dc/d68/d69/f91 906525 0 2024-05-06T21:26:56.373 INFO:tasks.workunit.client.1.smithi154.stdout:4/928: creat d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/f135 x:0 0 0 2024-05-06T21:26:56.373 INFO:tasks.workunit.client.1.smithi154.stdout:8/871: mknod d3/d14/d1a/d29/d32/d40/d59/d67/d95/c119 0 2024-05-06T21:26:56.373 INFO:tasks.workunit.client.1.smithi154.stdout:8/872: chown d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/dc1/cec 3809 1 2024-05-06T21:26:56.373 INFO:tasks.workunit.client.1.smithi154.stdout:4/929: write d0/d2/f69 [683049,96430] 0 2024-05-06T21:26:56.374 INFO:tasks.workunit.client.1.smithi154.stdout:8/873: creat d3/d14/d1a/d29/da3/f11a x:0 0 0 2024-05-06T21:26:56.375 INFO:tasks.workunit.client.1.smithi154.stdout:2/863: write db/de/fe9 [3049259,91053] 0 2024-05-06T21:26:56.376 INFO:tasks.workunit.client.1.smithi154.stdout:7/718: link d6/d20/d40/d52/d81/fc0 d6/d42/dd1/fe7 0 2024-05-06T21:26:56.376 INFO:tasks.workunit.client.1.smithi154.stdout:7/719: write d6/d42/d6c/d6e/d21/d2e/fe1 [446788,39378] 0 2024-05-06T21:26:56.376 INFO:tasks.workunit.client.1.smithi154.stdout:7/720: write d6/d20/d40/daf/d5c/f7c [205217,43254] 0 2024-05-06T21:26:56.377 INFO:tasks.workunit.client.1.smithi154.stdout:6/664: getdents d8/d13 0 2024-05-06T21:26:56.377 INFO:tasks.workunit.client.1.smithi154.stdout:6/665: creat d8/d11/d2d/d3d/d70/d7b/fcc x:0 0 0 2024-05-06T21:26:56.386 INFO:tasks.workunit.client.1.smithi154.stdout:5/925: symlink d2/d48/d12f/l13c 0 2024-05-06T21:26:56.386 INFO:tasks.workunit.client.1.smithi154.stdout:7/721: write d6/f7d [3574425,114561] 0 2024-05-06T21:26:56.387 INFO:tasks.workunit.client.1.smithi154.stdout:7/722: dread d6/d42/d6c/d6e/d21/d2e/d9d/fc9 [0,4194304] 0 2024-05-06T21:26:56.387 INFO:tasks.workunit.client.1.smithi154.stdout:7/723: chown d6/f32 40952 1 2024-05-06T21:26:56.387 INFO:tasks.workunit.client.1.smithi154.stdout:7/724: creat d6/d42/d6c/d6e/fe8 x:0 0 0 2024-05-06T21:26:56.387 INFO:tasks.workunit.client.1.smithi154.stdout:4/930: unlink d0/d82/d44/d73/d4a/dd4/d1a/d10b/dfc/f133 0 2024-05-06T21:26:56.389 INFO:tasks.workunit.client.1.smithi154.stdout:8/874: rmdir d3/d64/d6d/d102 0 2024-05-06T21:26:56.394 INFO:tasks.workunit.client.1.smithi154.stdout:2/864: rename db/d86/dbd to db/d12/d1d/d11d 0 2024-05-06T21:26:56.400 INFO:tasks.workunit.client.1.smithi154.stdout:6/666: mkdir d8/d11/d2d/d3d/d4c/dba/dcd 0 2024-05-06T21:26:56.401 INFO:tasks.workunit.client.1.smithi154.stdout:1/870: mkdir d6/d3e/d7e/da5/da8/d109 0 2024-05-06T21:26:56.402 INFO:tasks.workunit.client.1.smithi154.stdout:1/871: read d6/db/d10/d15/f4a [3559711,72159] 0 2024-05-06T21:26:56.402 INFO:tasks.workunit.client.1.smithi154.stdout:1/872: truncate d6/db/d69/f71 4578081 0 2024-05-06T21:26:56.404 INFO:tasks.workunit.client.1.smithi154.stdout:5/926: unlink d2/d3/d21/d95/dc/d44/d9a/f121 0 2024-05-06T21:26:56.405 INFO:tasks.workunit.client.1.smithi154.stdout:5/927: stat d2/d3/d19/d23/df9/f10a 0 2024-05-06T21:26:56.405 INFO:tasks.workunit.client.1.smithi154.stdout:5/928: stat d2/d3/d21/d95/dc/l1b 0 2024-05-06T21:26:56.405 INFO:tasks.workunit.client.1.smithi154.stdout:5/929: write d2/d3/d21/d95/dc/fae [893806,42597] 0 2024-05-06T21:26:56.410 INFO:tasks.workunit.client.1.smithi154.stdout:7/725: link d6/d42/d6c/d6e/d21/d2e/fe1 d6/d54/d6a/fe9 0 2024-05-06T21:26:56.413 INFO:tasks.workunit.client.1.smithi154.stdout:2/865: unlink db/de/d10/f69 0 2024-05-06T21:26:56.414 INFO:tasks.workunit.client.1.smithi154.stdout:2/866: stat db 0 2024-05-06T21:26:56.416 INFO:tasks.workunit.client.1.smithi154.stdout:4/931: rename d0/d2/dbd to d0/d82/d44/d73/d4a/dd4/d1a/d7e/d136 0 2024-05-06T21:26:56.416 INFO:tasks.workunit.client.1.smithi154.stdout:4/932: chown d0/d82/d44/d73/d4a/dd4/d1a/fe7 500753537 1 2024-05-06T21:26:56.416 INFO:tasks.workunit.client.1.smithi154.stdout:4/933: readlink d0/d82/d44/d73/d4a/d74/d75/lc1 0 2024-05-06T21:26:56.422 INFO:tasks.workunit.client.1.smithi154.stdout:1/873: dwrite d6/db/d97/ff9 [0,4194304] 0 2024-05-06T21:26:56.423 INFO:tasks.workunit.client.1.smithi154.stdout:2/867: mknod db/d12/d1d/c11e 0 2024-05-06T21:26:56.423 INFO:tasks.workunit.client.1.smithi154.stdout:2/868: creat db/de/d6f/f11f x:0 0 0 2024-05-06T21:26:56.424 INFO:tasks.workunit.client.1.smithi154.stdout:2/869: chown db/d12/d19/d4b/db2/fea 54340248 1 2024-05-06T21:26:56.425 INFO:tasks.workunit.client.1.smithi154.stdout:4/934: write d0/d82/d44/d73/d4a/dd4/ff2 [2352064,58811] 0 2024-05-06T21:26:56.426 INFO:tasks.workunit.client.1.smithi154.stdout:4/935: write d0/d82/d44/d73/def/df1/f106 [502723,27262] 0 2024-05-06T21:26:56.427 INFO:tasks.workunit.client.1.smithi154.stdout:2/870: mkdir db/de/d10/dbc/ded/d120 0 2024-05-06T21:26:56.429 INFO:tasks.workunit.client.1.smithi154.stdout:7/726: dwrite d6/d20/d40/daf/d5c/f8d [0,4194304] 0 2024-05-06T21:26:56.429 INFO:tasks.workunit.client.1.smithi154.stdout:7/727: chown d6/d42/d6c/d6e/caa 5413927 1 2024-05-06T21:26:56.429 INFO:tasks.workunit.client.1.smithi154.stdout:7/728: stat d6/d20/d40/d52/d81 0 2024-05-06T21:26:56.429 INFO:tasks.workunit.client.1.smithi154.stdout:6/667: rename d8/d11/l29 to d8/d11/d33/lce 0 2024-05-06T21:26:56.430 INFO:tasks.workunit.client.1.smithi154.stdout:4/936: rmdir d0/d82/d44/d73/d4a/dd4/dcd 39 2024-05-06T21:26:56.430 INFO:tasks.workunit.client.1.smithi154.stdout:4/937: stat d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/dc7/d11f/l12a 0 2024-05-06T21:26:56.431 INFO:tasks.workunit.client.1.smithi154.stdout:2/871: truncate db/d12/d19/d4b/db2/fea 3262680 0 2024-05-06T21:26:56.433 INFO:tasks.workunit.client.1.smithi154.stdout:1/874: dread d6/db/d97/ff9 [0,4194304] 0 2024-05-06T21:26:56.433 INFO:tasks.workunit.client.1.smithi154.stdout:1/875: stat d6/db/d10/d15/d1d/d53/c5a 0 2024-05-06T21:26:56.435 INFO:tasks.workunit.client.1.smithi154.stdout:7/729: unlink d6/d54/d5b/dc5/fc7 0 2024-05-06T21:26:56.436 INFO:tasks.workunit.client.1.smithi154.stdout:5/930: rename d2/d3/d19/d23/d100/d126 to d2/d48/d13d 0 2024-05-06T21:26:56.436 INFO:tasks.workunit.client.1.smithi154.stdout:5/931: dread - d2/d3/d21/d95/dd/d2a/d54/d43/f12d zero size 2024-05-06T21:26:56.439 INFO:tasks.workunit.client.1.smithi154.stdout:4/938: link d0/d2/fcb d0/d82/d39/da6/f137 0 2024-05-06T21:26:56.439 INFO:tasks.workunit.client.1.smithi154.stdout:4/939: chown d0/d2/fa 52691 1 2024-05-06T21:26:56.442 INFO:tasks.workunit.client.1.smithi154.stdout:1/876: unlink d6/d3e/f72 0 2024-05-06T21:26:56.442 INFO:tasks.workunit.client.1.smithi154.stdout:6/668: write d8/d11/f24 [8228333,4636] 0 2024-05-06T21:26:56.444 INFO:tasks.workunit.client.1.smithi154.stdout:6/669: dread d8/d11/d2d/d3d/d4c/f58 [0,4194304] 0 2024-05-06T21:26:56.445 INFO:tasks.workunit.client.1.smithi154.stdout:6/670: dread - d8/d11/d33/f8c zero size 2024-05-06T21:26:56.445 INFO:tasks.workunit.client.1.smithi154.stdout:6/671: chown d8/d11/d8d/daa 8860 1 2024-05-06T21:26:56.446 INFO:tasks.workunit.client.1.smithi154.stdout:7/730: link d6/d20/d40/daf/d5c/cc6 d6/d20/db1/cea 0 2024-05-06T21:26:56.446 INFO:tasks.workunit.client.1.smithi154.stdout:7/731: write d6/f32 [482926,97631] 0 2024-05-06T21:26:56.446 INFO:tasks.workunit.client.1.smithi154.stdout:7/732: fsync d6/d20/db1/fc1 0 2024-05-06T21:26:56.450 INFO:tasks.workunit.client.1.smithi154.stdout:1/877: fsync d6/d3e/d7e/da5/da8/fdf 0 2024-05-06T21:26:56.452 INFO:tasks.workunit.client.1.smithi154.stdout:6/672: symlink d8/d11/d2d/d3d/d4c/dba/lcf 0 2024-05-06T21:26:56.455 INFO:tasks.workunit.client.1.smithi154.stdout:7/733: symlink d6/d20/db1/leb 0 2024-05-06T21:26:56.456 INFO:tasks.workunit.client.1.smithi154.stdout:4/940: rmdir d0/d10 39 2024-05-06T21:26:56.458 INFO:tasks.workunit.client.1.smithi154.stdout:1/878: mknod d6/d3e/d7e/da5/da8/d109/c10a 0 2024-05-06T21:26:56.458 INFO:tasks.workunit.client.1.smithi154.stdout:1/879: write d6/db/d10/de5/ff2 [885517,36516] 0 2024-05-06T21:26:56.458 INFO:tasks.workunit.client.1.smithi154.stdout:5/932: dwrite d2/d3/d19/d23/df9/dfd/f117 [0,4194304] 0 2024-05-06T21:26:56.458 INFO:tasks.workunit.client.1.smithi154.stdout:2/872: dwrite f0 [4194304,4194304] 0 2024-05-06T21:26:56.459 INFO:tasks.workunit.client.1.smithi154.stdout:7/734: mknod d6/d42/d6c/d6e/d23/cec 0 2024-05-06T21:26:56.461 INFO:tasks.workunit.client.1.smithi154.stdout:4/941: creat d0/d82/ddb/d120/f138 x:0 0 0 2024-05-06T21:26:56.461 INFO:tasks.workunit.client.1.smithi154.stdout:4/942: write d0/d82/d44/d73/def/f125 [996188,130638] 0 2024-05-06T21:26:56.461 INFO:tasks.workunit.client.1.smithi154.stdout:4/943: write d0/d82/d3d/dab/fcf [598852,48246] 0 2024-05-06T21:26:56.462 INFO:tasks.workunit.client.1.smithi154.stdout:4/944: dread d0/d82/f5e [0,4194304] 0 2024-05-06T21:26:56.462 INFO:tasks.workunit.client.1.smithi154.stdout:1/880: symlink d6/d3e/l10b 0 2024-05-06T21:26:56.465 INFO:tasks.workunit.client.1.smithi154.stdout:5/933: creat d2/d3/d21/d95/dd/d2a/dbb/d119/f13e x:0 0 0 2024-05-06T21:26:56.465 INFO:tasks.workunit.client.1.smithi154.stdout:6/673: dread d8/fa0 [0,4194304] 0 2024-05-06T21:26:56.465 INFO:tasks.workunit.client.1.smithi154.stdout:6/674: chown d8/d11/d33/l68 84092149 1 2024-05-06T21:26:56.466 INFO:tasks.workunit.client.1.smithi154.stdout:2/873: mknod db/de/d16/dae/c121 0 2024-05-06T21:26:56.466 INFO:tasks.workunit.client.1.smithi154.stdout:2/874: fsync db/d12/d19/d4b/d78/de8/dfa/ffc 0 2024-05-06T21:26:56.466 INFO:tasks.workunit.client.1.smithi154.stdout:2/875: truncate db/de/d16/fd8 128328 0 2024-05-06T21:26:56.467 INFO:tasks.workunit.client.1.smithi154.stdout:7/735: mknod d6/d42/d6c/d6e/d21/d2e/ced 0 2024-05-06T21:26:56.467 INFO:tasks.workunit.client.1.smithi154.stdout:7/736: creat d6/d20/d40/daf/d5c/fee x:0 0 0 2024-05-06T21:26:56.471 INFO:tasks.workunit.client.1.smithi154.stdout:4/945: unlink d0/d2/fd7 0 2024-05-06T21:26:56.471 INFO:tasks.workunit.client.1.smithi154.stdout:4/946: stat d0/d82/ddb/d120/c12f 0 2024-05-06T21:26:56.471 INFO:tasks.workunit.client.1.smithi154.stdout:4/947: write d0/d82/ddb/d120/f138 [1007958,44768] 0 2024-05-06T21:26:56.472 INFO:tasks.workunit.client.1.smithi154.stdout:1/881: symlink d6/d3e/d7e/da5/d105/l10c 0 2024-05-06T21:26:56.473 INFO:tasks.workunit.client.1.smithi154.stdout:5/934: dread d2/d3/d21/d95/dc/d44/d9a/fd0 [0,4194304] 0 2024-05-06T21:26:56.474 INFO:tasks.workunit.client.1.smithi154.stdout:6/675: symlink d8/d11/d2d/d3d/d4c/ld0 0 2024-05-06T21:26:56.477 INFO:tasks.workunit.client.1.smithi154.stdout:2/876: rename db/d12/dbf/dd7/le5 to db/d12/d19/d4b/l122 0 2024-05-06T21:26:56.477 INFO:tasks.workunit.client.1.smithi154.stdout:2/877: dread - db/de/d10/f87 zero size 2024-05-06T21:26:56.479 INFO:tasks.workunit.client.1.smithi154.stdout:5/935: dread d2/f1a [0,4194304] 0 2024-05-06T21:26:56.479 INFO:tasks.workunit.client.1.smithi154.stdout:7/737: symlink d6/d20/db1/dba/lef 0 2024-05-06T21:26:56.490 INFO:tasks.workunit.client.1.smithi154.stdout:2/878: creat db/de/d16/dae/f123 x:0 0 0 2024-05-06T21:26:56.490 INFO:tasks.workunit.client.1.smithi154.stdout:5/936: dread d2/d48/d12f/db0/f106 [0,4194304] 0 2024-05-06T21:26:56.490 INFO:tasks.workunit.client.1.smithi154.stdout:5/937: chown d2/d3/d21/d95/dd/d2a/dbb/d119/f13e 4192313 1 2024-05-06T21:26:56.492 INFO:tasks.workunit.client.1.smithi154.stdout:4/948: dwrite d0/d82/d39/fca [0,4194304] 0 2024-05-06T21:26:56.492 INFO:tasks.workunit.client.1.smithi154.stdout:7/738: symlink d6/d20/d40/d52/d8b/dd3/lf0 0 2024-05-06T21:26:56.495 INFO:tasks.workunit.client.1.smithi154.stdout:6/676: rmdir d8/d11/d33/d92 39 2024-05-06T21:26:56.495 INFO:tasks.workunit.client.1.smithi154.stdout:6/677: chown d8/d11/d33/d92/lb5 0 1 2024-05-06T21:26:56.500 INFO:tasks.workunit.client.1.smithi154.stdout:5/938: unlink d2/d3/d19/d23/d100/l10c 0 2024-05-06T21:26:56.500 INFO:tasks.workunit.client.1.smithi154.stdout:5/939: readlink d2/d3/d21/d22/lf7 0 2024-05-06T21:26:56.504 INFO:tasks.workunit.client.1.smithi154.stdout:7/739: dread d6/d42/d6c/d6e/d21/d69/d7b/f7e [0,4194304] 0 2024-05-06T21:26:56.505 INFO:tasks.workunit.client.1.smithi154.stdout:6/678: read d8/d13/da9/f6f [6774352,48802] 0 2024-05-06T21:26:56.505 INFO:tasks.workunit.client.1.smithi154.stdout:1/882: dwrite d6/db/d10/d26/f23 [0,4194304] 0 2024-05-06T21:26:56.507 INFO:tasks.workunit.client.1.smithi154.stdout:4/949: link d0/d82/d44/d73/d4a/d74/d75/l127 d0/d82/d44/d73/d4a/d74/l139 0 2024-05-06T21:26:56.514 INFO:tasks.workunit.client.1.smithi154.stdout:4/950: dread d0/d82/d39/fca [0,4194304] 0 2024-05-06T21:26:56.528 INFO:tasks.workunit.client.1.smithi154.stdout:4/951: dwrite d0/d82/d44/ff0 [0,4194304] 0 2024-05-06T21:26:56.528 INFO:tasks.workunit.client.1.smithi154.stdout:4/952: chown d0/d82/d44/d73/d4a/dd9/le6 3223748 1 2024-05-06T21:26:56.528 INFO:tasks.workunit.client.1.smithi154.stdout:2/879: mkdir db/d12/d1d/d124 0 2024-05-06T21:26:56.532 INFO:tasks.workunit.client.1.smithi154.stdout:7/740: symlink d6/d20/d85/da2/lf1 0 2024-05-06T21:26:56.535 INFO:tasks.workunit.client.1.smithi154.stdout:1/883: link d6/db/d10/f33 d6/db/d97/f10d 0 2024-05-06T21:26:56.539 INFO:tasks.workunit.client.1.smithi154.stdout:4/953: symlink d0/d10/l13a 0 2024-05-06T21:26:56.542 INFO:tasks.workunit.client.1.smithi154.stdout:5/940: rename d2/d3/d21/d95/dd/d2a/dbb/d119/f13e to d2/d3/d21/d95/dd/d2a/dbb/f13f 0 2024-05-06T21:26:56.542 INFO:tasks.workunit.client.1.smithi154.stdout:5/941: write d2/f4c [1516462,70523] 0 2024-05-06T21:26:56.542 INFO:tasks.workunit.client.1.smithi154.stdout:5/942: readlink d2/d3/l5d 0 2024-05-06T21:26:56.542 INFO:tasks.workunit.client.1.smithi154.stdout:5/943: dread - d2/d3/d19/d23/df9/dfd/d12b/f134 zero size 2024-05-06T21:26:56.543 INFO:tasks.workunit.client.1.smithi154.stdout:7/741: mknod d6/d20/d85/cf2 0 2024-05-06T21:26:56.543 INFO:tasks.workunit.client.1.smithi154.stdout:7/742: creat d6/d42/d6c/ff3 x:0 0 0 2024-05-06T21:26:56.545 INFO:tasks.workunit.client.1.smithi154.stdout:1/884: truncate d6/db/d10/fa9 1416347 0 2024-05-06T21:26:56.547 INFO:tasks.workunit.client.1.smithi154.stdout:2/880: dwrite db/de/f9d [0,4194304] 0 2024-05-06T21:26:56.547 INFO:tasks.workunit.client.1.smithi154.stdout:4/954: creat d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/dbb/f13b x:0 0 0 2024-05-06T21:26:56.547 INFO:tasks.workunit.client.1.smithi154.stdout:4/955: dread - d0/d82/d39/df7/f11d zero size 2024-05-06T21:26:56.550 INFO:tasks.workunit.client.1.smithi154.stdout:6/679: rename d8/d11/d2d/d3d/d4c/d86 to d8/d13/d20/daf/dd1 0 2024-05-06T21:26:56.554 INFO:tasks.workunit.client.1.smithi154.stdout:5/944: symlink d2/d3/d21/d95/dd/d2a/d54/d43/l140 0 2024-05-06T21:26:56.554 INFO:tasks.workunit.client.1.smithi154.stdout:5/945: chown d2/d3/d21/d95/dd/d2a/d54/d43/d73/fea 2128532 1 2024-05-06T21:26:56.556 INFO:tasks.workunit.client.1.smithi154.stdout:7/743: mknod d6/d20/cf4 0 2024-05-06T21:26:56.562 INFO:tasks.workunit.client.1.smithi154.stdout:2/881: mknod db/de/d10/d18/c125 0 2024-05-06T21:26:56.565 INFO:tasks.workunit.client.1.smithi154.stdout:7/744: mkdir d6/d20/d40/daf/d5c/df5 0 2024-05-06T21:26:56.567 INFO:tasks.workunit.client.1.smithi154.stdout:1/885: getdents d6/db/d10 0 2024-05-06T21:26:56.569 INFO:tasks.workunit.client.1.smithi154.stdout:1/886: write d6/db/d10/fc8 [25151,108275] 0 2024-05-06T21:26:56.571 INFO:tasks.workunit.client.1.smithi154.stdout:2/882: rename db/de/d16/c45 to db/de/d10/dbc/ded/d120/c126 0 2024-05-06T21:26:56.572 INFO:tasks.workunit.client.1.smithi154.stdout:2/883: dread - db/de/d10/f11a zero size 2024-05-06T21:26:56.577 INFO:tasks.workunit.client.1.smithi154.stdout:4/956: dwrite d0/d82/d44/ff0 [0,4194304] 0 2024-05-06T21:26:56.579 INFO:tasks.workunit.client.1.smithi154.stdout:2/884: dread db/de/d10/d18/fa2 [0,4194304] 0 2024-05-06T21:26:56.583 INFO:tasks.workunit.client.1.smithi154.stdout:1/887: dread d6/d3e/fa0 [0,4194304] 0 2024-05-06T21:26:56.584 INFO:tasks.workunit.client.1.smithi154.stdout:1/888: mkdir d6/d10e 0 2024-05-06T21:26:56.585 INFO:tasks.workunit.client.1.smithi154.stdout:1/889: readlink d6/db/d10/d94/l101 0 2024-05-06T21:26:56.586 INFO:tasks.workunit.client.1.smithi154.stdout:1/890: unlink d6/c3d 0 2024-05-06T21:26:56.588 INFO:tasks.workunit.client.1.smithi154.stdout:1/891: getdents d6/db/d97 0 2024-05-06T21:26:56.589 INFO:tasks.workunit.client.1.smithi154.stdout:4/957: write d0/d82/d3d/dab/fe5 [3562621,102537] 0 2024-05-06T21:26:56.589 INFO:tasks.workunit.client.1.smithi154.stdout:5/946: dwrite d2/d3/d21/d95/dd/d2a/d54/dce/fd8 [0,4194304] 0 2024-05-06T21:26:56.589 INFO:tasks.workunit.client.1.smithi154.stdout:5/947: dread - d2/d3/d21/d95/deb/f13a zero size 2024-05-06T21:26:56.589 INFO:tasks.workunit.client.1.smithi154.stdout:6/680: dwrite d8/d11/d33/d4a/d6c/d8e/f96 [0,4194304] 0 2024-05-06T21:26:56.590 INFO:tasks.workunit.client.1.smithi154.stdout:1/892: symlink d6/d3e/l10f 0 2024-05-06T21:26:56.595 INFO:tasks.workunit.client.1.smithi154.stdout:7/745: dwrite d6/d54/d5b/d82/f86 [0,4194304] 0 2024-05-06T21:26:56.595 INFO:tasks.workunit.client.1.smithi154.stdout:2/885: dread db/d12/d1d/f8a [0,4194304] 0 2024-05-06T21:26:56.598 INFO:tasks.workunit.client.1.smithi154.stdout:4/958: write d0/d82/d44/de9/f101 [4051491,13162] 0 2024-05-06T21:26:56.598 INFO:tasks.workunit.client.1.smithi154.stdout:4/959: write d0/d2/d29/fa5 [957331,51628] 0 2024-05-06T21:26:56.599 INFO:tasks.workunit.client.1.smithi154.stdout:6/681: rename d8/d13/d8f/cb8 to d8/d11/d2d/d3d/d70/d7b/d95/cd2 0 2024-05-06T21:26:56.600 INFO:tasks.workunit.client.1.smithi154.stdout:1/893: unlink d6/db/d10/d15/d1d/d53/da3/fee 0 2024-05-06T21:26:56.604 INFO:tasks.workunit.client.1.smithi154.stdout:7/746: truncate d6/d42/d6c/d6e/d21/d2e/fb5 2844653 0 2024-05-06T21:26:56.604 INFO:tasks.workunit.client.1.smithi154.stdout:7/747: chown d6/d20/d40/daf/c7f 3817160 1 2024-05-06T21:26:56.606 INFO:tasks.workunit.client.1.smithi154.stdout:2/886: mkdir db/d12/d19/d4b/d78/de8/d127 0 2024-05-06T21:26:56.606 INFO:tasks.workunit.client.1.smithi154.stdout:2/887: creat db/f128 x:0 0 0 2024-05-06T21:26:56.608 INFO:tasks.workunit.client.1.smithi154.stdout:4/960: write d0/d2/d47/fbf [3502622,94511] 0 2024-05-06T21:26:56.608 INFO:tasks.workunit.client.1.smithi154.stdout:4/961: write d0/d82/d44/d73/d4a/dd4/d1a/f28 [2737437,80557] 0 2024-05-06T21:26:56.611 INFO:tasks.workunit.client.1.smithi154.stdout:6/682: symlink d8/d13/d20/daf/dd1/ld3 0 2024-05-06T21:26:56.611 INFO:tasks.workunit.client.1.smithi154.stdout:6/683: creat d8/d11/d2d/d3d/d70/d7b/fd4 x:0 0 0 2024-05-06T21:26:56.611 INFO:tasks.workunit.client.1.smithi154.stdout:6/684: chown d8/d11/d2d/d3d/d70/d7b/fcc 1115461 1 2024-05-06T21:26:56.613 INFO:tasks.workunit.client.1.smithi154.stdout:1/894: rename d6/db/d69/l90 to d6/db/d10/d26/l110 0 2024-05-06T21:26:56.613 INFO:tasks.workunit.client.1.smithi154.stdout:4/962: write d0/d2/f1b [350359,4778] 0 2024-05-06T21:26:56.614 INFO:tasks.workunit.client.1.smithi154.stdout:6/685: read d8/d13/f77 [27738,7813] 0 2024-05-06T21:26:56.615 INFO:tasks.workunit.client.1.smithi154.stdout:2/888: symlink db/de/d16/l129 0 2024-05-06T21:26:56.619 INFO:tasks.workunit.client.1.smithi154.stdout:7/748: dwrite d6/d42/d6c/f77 [4194304,4194304] 0 2024-05-06T21:26:56.623 INFO:tasks.workunit.client.1.smithi154.stdout:4/963: link d0/d82/d44/d73/d4a/dd4/d1a/ce3 d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/c13c 0 2024-05-06T21:26:56.629 INFO:tasks.workunit.client.1.smithi154.stdout:2/889: dread db/d12/d1d/fa7 [0,4194304] 0 2024-05-06T21:26:56.633 INFO:tasks.workunit.client.1.smithi154.stdout:4/964: dread d0/d10/fc0 [0,4194304] 0 2024-05-06T21:26:56.640 INFO:tasks.workunit.client.1.smithi154.stdout:8/875: sync 2024-05-06T21:26:56.640 INFO:tasks.workunit.client.1.smithi154.stdout:8/876: stat d3/d14/d1a/d6e 0 2024-05-06T21:26:56.642 INFO:tasks.workunit.client.1.smithi154.stdout:4/965: write d0/d2/d47/fad [2439050,46895] 0 2024-05-06T21:26:56.644 INFO:tasks.workunit.client.1.smithi154.stdout:8/877: symlink d3/d14/d1a/d45/dcf/l11b 0 2024-05-06T21:26:56.645 INFO:tasks.workunit.client.1.smithi154.stdout:8/878: read - d3/d14/d1a/d45/ff8 zero size 2024-05-06T21:26:56.645 INFO:tasks.workunit.client.1.smithi154.stdout:8/879: fdatasync d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/f116 0 2024-05-06T21:26:56.645 INFO:tasks.workunit.client.1.smithi154.stdout:8/880: chown d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/fd0 267737275 1 2024-05-06T21:26:56.645 INFO:tasks.workunit.client.1.smithi154.stdout:8/881: readlink d3/d14/d1a/d29/d32/l117 0 2024-05-06T21:26:56.645 INFO:tasks.workunit.client.1.smithi154.stdout:1/895: dwrite d6/db/d10/d15/f39 [0,4194304] 0 2024-05-06T21:26:56.645 INFO:tasks.workunit.client.1.smithi154.stdout:7/749: dwrite d6/fd [0,4194304] 0 2024-05-06T21:26:56.647 INFO:tasks.workunit.client.1.smithi154.stdout:4/966: dread d0/d2/f8 [0,4194304] 0 2024-05-06T21:26:56.647 INFO:tasks.workunit.client.1.smithi154.stdout:2/890: rename db/c38 to db/d12/d1d/d60/d63/d117/c12a 0 2024-05-06T21:26:56.647 INFO:tasks.workunit.client.1.smithi154.stdout:6/686: rmdir d8/d11/d2d/d3d/d70/d7b 39 2024-05-06T21:26:56.650 INFO:tasks.workunit.client.1.smithi154.stdout:6/687: symlink d8/d11/d33/d4a/ld5 0 2024-05-06T21:26:56.654 INFO:tasks.workunit.client.1.smithi154.stdout:7/750: rmdir d6/d42/d6c/d6e/d21 39 2024-05-06T21:26:56.659 INFO:tasks.workunit.client.1.smithi154.stdout:7/751: creat d6/d42/d6c/dd2/ff6 x:0 0 0 2024-05-06T21:26:56.662 INFO:tasks.workunit.client.1.smithi154.stdout:7/752: rename c0 to d6/d54/d5b/cf7 0 2024-05-06T21:26:56.667 INFO:tasks.workunit.client.1.smithi154.stdout:7/753: mknod d6/d42/d6c/d6e/d21/d69/cf8 0 2024-05-06T21:26:56.670 INFO:tasks.workunit.client.1.smithi154.stdout:7/754: symlink d6/d42/d6c/d6e/d21/d69/dd7/lf9 0 2024-05-06T21:26:56.675 INFO:tasks.workunit.client.1.smithi154.stdout:8/882: dwrite d3/d14/d1a/d29/d43/f5d [4194304,4194304] 0 2024-05-06T21:26:56.677 INFO:tasks.workunit.client.1.smithi154.stdout:8/883: symlink d3/d38/df2/l11c 0 2024-05-06T21:26:56.677 INFO:tasks.workunit.client.1.smithi154.stdout:8/884: write d3/d14/ff3 [960095,10497] 0 2024-05-06T21:26:56.677 INFO:tasks.workunit.client.1.smithi154.stdout:8/885: fsync d3/d14/d1a/d29/d32/d40/d79/d2b/fd7 0 2024-05-06T21:26:56.677 INFO:tasks.workunit.client.1.smithi154.stdout:8/886: write d3/d14/ff3 [139956,101557] 0 2024-05-06T21:26:56.679 INFO:tasks.workunit.client.1.smithi154.stdout:8/887: creat d3/d14/d1a/d29/d3e/f11d x:0 0 0 2024-05-06T21:26:56.679 INFO:tasks.workunit.client.1.smithi154.stdout:7/755: write d6/d54/d5b/d82/f86 [3303310,108417] 0 2024-05-06T21:26:56.679 INFO:tasks.workunit.client.1.smithi154.stdout:6/688: dwrite d8/d11/d2d/f3a [0,4194304] 0 2024-05-06T21:26:56.680 INFO:tasks.workunit.client.1.smithi154.stdout:8/888: link d3/d14/d1a/d29/d32/fe4 d3/d38/df2/f11e 0 2024-05-06T21:26:56.680 INFO:tasks.workunit.client.1.smithi154.stdout:2/891: dwrite db/de/d10/f10c [0,4194304] 0 2024-05-06T21:26:56.681 INFO:tasks.workunit.client.1.smithi154.stdout:4/967: dwrite d0/d82/ddb/f132 [0,4194304] 0 2024-05-06T21:26:56.681 INFO:tasks.workunit.client.1.smithi154.stdout:4/968: read d0/d2/d29/fa5 [176576,29502] 0 2024-05-06T21:26:56.681 INFO:tasks.workunit.client.1.smithi154.stdout:4/969: creat d0/d2/d47/f13d x:0 0 0 2024-05-06T21:26:56.681 INFO:tasks.workunit.client.1.smithi154.stdout:7/756: symlink d6/d42/d6c/d6e/d21/d69/de0/lfa 0 2024-05-06T21:26:56.682 INFO:tasks.workunit.client.1.smithi154.stdout:8/889: mkdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/dfc/d11f 0 2024-05-06T21:26:56.685 INFO:tasks.workunit.client.1.smithi154.stdout:2/892: dread db/de/d16/f1f [0,4194304] 0 2024-05-06T21:26:56.685 INFO:tasks.workunit.client.1.smithi154.stdout:4/970: symlink d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/l13e 0 2024-05-06T21:26:56.685 INFO:tasks.workunit.client.1.smithi154.stdout:4/971: write d0/d2/d47/f6d [3331104,128332] 0 2024-05-06T21:26:56.687 INFO:tasks.workunit.client.1.smithi154.stdout:2/893: creat db/d12/d1d/d60/d63/d117/f12b x:0 0 0 2024-05-06T21:26:56.687 INFO:tasks.workunit.client.1.smithi154.stdout:4/972: truncate d0/d82/d44/d73/f2c 2290441 0 2024-05-06T21:26:56.692 INFO:tasks.workunit.client.1.smithi154.stdout:8/890: dread d3/ff [0,4194304] 0 2024-05-06T21:26:56.697 INFO:tasks.workunit.client.1.smithi154.stdout:2/894: dread db/d12/d1d/d60/d63/f70 [0,4194304] 0 2024-05-06T21:26:56.699 INFO:tasks.workunit.client.1.smithi154.stdout:2/895: creat db/de/d10/dbc/ded/f12c x:0 0 0 2024-05-06T21:26:56.701 INFO:tasks.workunit.client.1.smithi154.stdout:6/689: dwrite d8/d11/d2d/d3d/d70/d7b/fcc [0,4194304] 0 2024-05-06T21:26:56.701 INFO:tasks.workunit.client.1.smithi154.stdout:6/690: creat d8/d11/d33/d4a/d6c/d8e/fd6 x:0 0 0 2024-05-06T21:26:56.702 INFO:tasks.workunit.client.1.smithi154.stdout:2/896: rmdir db/d12/d19/d4b/db2 39 2024-05-06T21:26:56.706 INFO:tasks.workunit.client.1.smithi154.stdout:6/691: getdents d8/d13/d8f 0 2024-05-06T21:26:56.706 INFO:tasks.workunit.client.1.smithi154.stdout:6/692: chown d8/d11/d2d/d3d/fb2 3527097 1 2024-05-06T21:26:56.707 INFO:tasks.workunit.client.1.smithi154.stdout:2/897: mkdir db/d12/d4e/d55/d116/d12d 0 2024-05-06T21:26:56.709 INFO:tasks.workunit.client.1.smithi154.stdout:7/757: dwrite d6/d20/f1b [8388608,4194304] 0 2024-05-06T21:26:56.709 INFO:tasks.workunit.client.1.smithi154.stdout:7/758: chown d6/d20/d40/d52/f91 12216 1 2024-05-06T21:26:56.709 INFO:tasks.workunit.client.1.smithi154.stdout:6/693: dread d8/d13/d20/f65 [0,4194304] 0 2024-05-06T21:26:56.709 INFO:tasks.workunit.client.1.smithi154.stdout:7/759: write d6/f1a [4731734,8649] 0 2024-05-06T21:26:56.713 INFO:tasks.workunit.client.1.smithi154.stdout:6/694: unlink d8/l88 0 2024-05-06T21:26:56.715 INFO:tasks.workunit.client.1.smithi154.stdout:6/695: creat d8/d11/d2d/d3d/d70/fd7 x:0 0 0 2024-05-06T21:26:56.715 INFO:tasks.workunit.client.1.smithi154.stdout:6/696: dread - d8/fa5 zero size 2024-05-06T21:26:56.716 INFO:tasks.workunit.client.1.smithi154.stdout:6/697: mkdir d8/d13/d8f/dd8 0 2024-05-06T21:26:56.718 INFO:tasks.workunit.client.1.smithi154.stdout:6/698: creat d8/d11/d2d/d3d/d4c/dba/fd9 x:0 0 0 2024-05-06T21:26:56.718 INFO:tasks.workunit.client.1.smithi154.stdout:6/699: readlink d8/d11/d33/lce 0 2024-05-06T21:26:56.718 INFO:tasks.workunit.client.1.smithi154.stdout:6/700: write d8/d13/d8f/fad [440977,39020] 0 2024-05-06T21:26:56.718 INFO:tasks.workunit.client.1.smithi154.stdout:6/701: stat d8/d11/d2d/d3d/d4c/dba/dcd 0 2024-05-06T21:26:56.719 INFO:tasks.workunit.client.1.smithi154.stdout:7/760: write d6/d20/fa7 [4031380,22458] 0 2024-05-06T21:26:56.720 INFO:tasks.workunit.client.1.smithi154.stdout:8/891: dwrite d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/dfc/f115 [0,4194304] 0 2024-05-06T21:26:56.720 INFO:tasks.workunit.client.1.smithi154.stdout:8/892: chown d3/d38/cd4 50187 1 2024-05-06T21:26:56.722 INFO:tasks.workunit.client.1.smithi154.stdout:7/761: rename d6/d54/d5b/cce to d6/d42/dd1/cfb 0 2024-05-06T21:26:56.725 INFO:tasks.workunit.client.1.smithi154.stdout:8/893: mkdir d3/d64/d6d/dbd/d6b/d120 0 2024-05-06T21:26:56.728 INFO:tasks.workunit.client.1.smithi154.stdout:7/762: rename d6/d54/d5b/dc5/fd6 to d6/d42/d6c/d6e/d21/d69/d7b/ffc 0 2024-05-06T21:26:56.728 INFO:tasks.workunit.client.1.smithi154.stdout:7/763: readlink d6/d42/d6c/d6e/d23/l27 0 2024-05-06T21:26:56.730 INFO:tasks.workunit.client.1.smithi154.stdout:7/764: mknod d6/d54/d6a/cfd 0 2024-05-06T21:26:56.732 INFO:tasks.workunit.client.1.smithi154.stdout:8/894: mkdir d3/d14/d1a/d29/d32/d40/d79/d121 0 2024-05-06T21:26:56.732 INFO:tasks.workunit.client.1.smithi154.stdout:8/895: read - d3/d64/d6d/dbd/dce/fe5 zero size 2024-05-06T21:26:56.733 INFO:tasks.workunit.client.1.smithi154.stdout:8/896: dread - d3/d14/d1a/d29/d32/d40/d79/d84/f109 zero size 2024-05-06T21:26:56.733 INFO:tasks.workunit.client.1.smithi154.stdout:8/897: write d3/d14/d1a/d29/da3/f11a [711619,28040] 0 2024-05-06T21:26:56.735 INFO:tasks.workunit.client.1.smithi154.stdout:6/702: dwrite d8/d11/d2d/d3d/d70/d7b/d95/f9a [0,4194304] 0 2024-05-06T21:26:56.735 INFO:tasks.workunit.client.1.smithi154.stdout:6/703: write d8/d11/f79 [381022,100698] 0 2024-05-06T21:26:56.735 INFO:tasks.workunit.client.1.smithi154.stdout:8/898: creat d3/d9f/f122 x:0 0 0 2024-05-06T21:26:56.745 INFO:tasks.workunit.client.1.smithi154.stdout:6/704: symlink d8/d11/d2d/d3d/d70/d7b/lda 0 2024-05-06T21:26:56.747 INFO:tasks.workunit.client.1.smithi154.stdout:8/899: creat d3/d14/d1a/d45/dcf/db4/dee/f123 x:0 0 0 2024-05-06T21:26:56.747 INFO:tasks.workunit.client.1.smithi154.stdout:8/900: chown d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/la8 29 1 2024-05-06T21:26:56.748 INFO:tasks.workunit.client.1.smithi154.stdout:8/901: creat d3/d14/d1a/d29/d32/d40/f124 x:0 0 0 2024-05-06T21:26:56.748 INFO:tasks.workunit.client.1.smithi154.stdout:8/902: fsync d3/d14/d1a/d29/d3e/f52 0 2024-05-06T21:26:56.755 INFO:tasks.workunit.client.1.smithi154.stdout:7/765: dwrite d6/d42/d6c/d6e/fdc [0,4194304] 0 2024-05-06T21:26:56.755 INFO:tasks.workunit.client.1.smithi154.stdout:7/766: write d6/d42/dd1/fe7 [4853574,85631] 0 2024-05-06T21:26:56.762 INFO:tasks.workunit.client.1.smithi154.stdout:8/903: dread d3/d14/d1a/d29/d43/fa0 [0,4194304] 0 2024-05-06T21:26:56.768 INFO:tasks.workunit.client.1.smithi154.stdout:7/767: dread d6/d42/d6c/d6e/f19 [0,4194304] 0 2024-05-06T21:26:56.770 INFO:tasks.workunit.client.1.smithi154.stdout:7/768: symlink d6/lfe 0 2024-05-06T21:26:56.773 INFO:tasks.workunit.client.1.smithi154.stdout:6/705: dwrite d8/d11/d33/f55 [0,4194304] 0 2024-05-06T21:26:56.786 INFO:tasks.workunit.client.1.smithi154.stdout:8/904: dwrite d3/d14/d1a/d29/d32/d40/d59/d67/fc2 [0,4194304] 0 2024-05-06T21:26:56.786 INFO:tasks.workunit.client.1.smithi154.stdout:8/905: creat d3/d14/d1a/d29/d32/d40/d79/d84/f125 x:0 0 0 2024-05-06T21:26:56.793 INFO:tasks.workunit.client.1.smithi154.stdout:8/906: symlink d3/d14/d1a/d29/d32/de8/l126 0 2024-05-06T21:26:56.802 INFO:tasks.workunit.client.1.smithi154.stdout:8/907: read d3/d64/d6d/dbd/f23 [452413,123551] 0 2024-05-06T21:26:56.804 INFO:tasks.workunit.client.1.smithi154.stdout:8/908: mkdir d3/d64/d6d/dbd/d127 0 2024-05-06T21:26:56.805 INFO:tasks.workunit.client.1.smithi154.stdout:8/909: getdents d3/d14/d1a/d29/d32/d40/d59/d67/da7 0 2024-05-06T21:26:56.807 INFO:tasks.workunit.client.1.smithi154.stdout:8/910: symlink d3/d9f/l128 0 2024-05-06T21:26:56.807 INFO:tasks.workunit.client.1.smithi154.stdout:8/911: write d3/d14/d1a/d29/d32/d40/d59/d67/fed [1021800,80859] 0 2024-05-06T21:26:56.807 INFO:tasks.workunit.client.1.smithi154.stdout:8/912: chown d3/d14/fbf 11 1 2024-05-06T21:26:56.808 INFO:tasks.workunit.client.1.smithi154.stdout:8/913: truncate d3/d64/d6d/dbd/f3a 1972412 0 2024-05-06T21:26:56.808 INFO:tasks.workunit.client.1.smithi154.stdout:7/769: dwrite d6/d54/f84 [0,4194304] 0 2024-05-06T21:26:56.808 INFO:tasks.workunit.client.1.smithi154.stdout:7/770: truncate d6/d42/d6c/d6e/d23/fbc 1352730 0 2024-05-06T21:26:56.808 INFO:tasks.workunit.client.1.smithi154.stdout:7/771: chown d6/d20/d40/daf/d5c/fe3 7 1 2024-05-06T21:26:56.808 INFO:tasks.workunit.client.1.smithi154.stdout:7/772: chown d6/d42/dd1 13445766 1 2024-05-06T21:26:56.808 INFO:tasks.workunit.client.1.smithi154.stdout:6/706: dwrite d8/d11/d2d/d3d/d70/d7b/d95/fa7 [0,4194304] 0 2024-05-06T21:26:56.810 INFO:tasks.workunit.client.1.smithi154.stdout:7/773: creat d6/d42/fff x:0 0 0 2024-05-06T21:26:56.811 INFO:tasks.workunit.client.1.smithi154.stdout:6/707: fsync d8/d13/d20/daf/dd1/f8b 0 2024-05-06T21:26:56.812 INFO:tasks.workunit.client.1.smithi154.stdout:6/708: stat d8/d11/d2d/f47 0 2024-05-06T21:26:56.812 INFO:tasks.workunit.client.1.smithi154.stdout:6/709: creat d8/d11/d2d/d3d/d4c/fdb x:0 0 0 2024-05-06T21:26:56.812 INFO:tasks.workunit.client.1.smithi154.stdout:7/774: unlink d6/c59 0 2024-05-06T21:26:56.816 INFO:tasks.workunit.client.1.smithi154.stdout:7/775: rename d6/c72 to d6/d42/d6c/d6e/d21/de5/c100 0 2024-05-06T21:26:56.816 INFO:tasks.workunit.client.1.smithi154.stdout:7/776: chown d6/d42/d6c/d6e/da4/lb9 62 1 2024-05-06T21:26:56.819 INFO:tasks.workunit.client.1.smithi154.stdout:8/914: write d3/d64/d6d/dbd/f3a [2995293,16163] 0 2024-05-06T21:26:56.819 INFO:tasks.workunit.client.1.smithi154.stdout:8/915: fdatasync d3/d14/d1a/d29/d32/d40/d79/d84/da4/fc0 0 2024-05-06T21:26:56.819 INFO:tasks.workunit.client.1.smithi154.stdout:8/916: chown d3/d38/df2/ff1 70110681 1 2024-05-06T21:26:56.820 INFO:tasks.workunit.client.1.smithi154.stdout:6/710: write d8/d11/f1d [1018971,54881] 0 2024-05-06T21:26:56.820 INFO:tasks.workunit.client.1.smithi154.stdout:6/711: chown d8/d13/da9/cc1 117455008 1 2024-05-06T21:26:56.820 INFO:tasks.workunit.client.1.smithi154.stdout:6/712: write d8/d13/f71 [4507665,68340] 0 2024-05-06T21:26:56.821 INFO:tasks.workunit.client.1.smithi154.stdout:6/713: mknod d8/d13/d8f/cdc 0 2024-05-06T21:26:56.823 INFO:tasks.workunit.client.1.smithi154.stdout:6/714: truncate d8/d11/f24 2245591 0 2024-05-06T21:26:56.824 INFO:tasks.workunit.client.1.smithi154.stdout:6/715: fdatasync d8/d11/d33/fb3 0 2024-05-06T21:26:56.824 INFO:tasks.workunit.client.1.smithi154.stdout:6/716: chown d8/d11/d33/lce 3035 1 2024-05-06T21:26:56.826 INFO:tasks.workunit.client.1.smithi154.stdout:6/717: rename d8/d11/d8d/daa/cc7 to d8/d13/d20/daf/dd1/cdd 0 2024-05-06T21:26:56.828 INFO:tasks.workunit.client.1.smithi154.stdout:6/718: symlink d8/d11/d33/d4a/lde 0 2024-05-06T21:26:56.828 INFO:tasks.workunit.client.1.smithi154.stdout:6/719: dread - d8/fa5 zero size 2024-05-06T21:26:56.829 INFO:tasks.workunit.client.1.smithi154.stdout:6/720: mkdir d8/ddf 0 2024-05-06T21:26:56.830 INFO:tasks.workunit.client.1.smithi154.stdout:6/721: truncate d8/d11/d2d/d3d/d4c/dba/fcb 2639917 0 2024-05-06T21:26:56.831 INFO:tasks.workunit.client.1.smithi154.stdout:6/722: truncate d8/d11/d2d/d3d/d70/d7b/fd4 108787 0 2024-05-06T21:26:56.831 INFO:tasks.workunit.client.1.smithi154.stdout:6/723: write d8/d11/d2d/d3d/d70/fd7 [898942,103927] 0 2024-05-06T21:26:56.831 INFO:tasks.workunit.client.1.smithi154.stdout:6/724: creat d8/d11/d2d/d3d/d70/fe0 x:0 0 0 2024-05-06T21:26:56.841 INFO:tasks.workunit.client.1.smithi154.stdout:6/725: write d8/f10 [4086188,82658] 0 2024-05-06T21:26:56.841 INFO:tasks.workunit.client.1.smithi154.stdout:6/726: write d8/d11/f99 [615414,103449] 0 2024-05-06T21:26:56.841 INFO:tasks.workunit.client.1.smithi154.stdout:6/727: chown d8/d11/d2d/d3d/d70/d7b/l93 0 1 2024-05-06T21:26:56.842 INFO:tasks.workunit.client.1.smithi154.stdout:7/777: dwrite d6/d20/d40/d52/f91 [0,4194304] 0 2024-05-06T21:26:56.842 INFO:tasks.workunit.client.1.smithi154.stdout:7/778: readlink d6/d42/lca 0 2024-05-06T21:26:56.842 INFO:tasks.workunit.client.1.smithi154.stdout:7/779: truncate d6/d42/d6c/d6e/d21/d2e/d9d/fc9 1513284 0 2024-05-06T21:26:56.842 INFO:tasks.workunit.client.1.smithi154.stdout:8/917: dwrite d3/d9f/f122 [0,4194304] 0 2024-05-06T21:26:56.842 INFO:tasks.workunit.client.1.smithi154.stdout:8/918: fsync d3/f9 0 2024-05-06T21:26:56.843 INFO:tasks.workunit.client.1.smithi154.stdout:6/728: symlink d8/d13/d8f/le1 0 2024-05-06T21:26:56.850 INFO:tasks.workunit.client.1.smithi154.stdout:8/919: mkdir d3/d64/d6d/dbd/d6b/d120/d129 0 2024-05-06T21:26:56.852 INFO:tasks.workunit.client.1.smithi154.stdout:6/729: stat d8/d11/d33/lce 0 2024-05-06T21:26:56.852 INFO:tasks.workunit.client.1.smithi154.stdout:7/780: dread d6/f3b [4194304,4194304] 0 2024-05-06T21:26:56.857 INFO:tasks.workunit.client.1.smithi154.stdout:8/920: rename d3/l6c to d3/d14/d1a/d29/d32/d40/d79/d121/l12a 0 2024-05-06T21:26:56.858 INFO:tasks.workunit.client.1.smithi154.stdout:6/730: mknod d8/d11/d8d/daa/ce2 0 2024-05-06T21:26:56.859 INFO:tasks.workunit.client.1.smithi154.stdout:7/781: rmdir d6/d42/d6c/d6e/d21/d69/d7b/d9f 39 2024-05-06T21:26:56.859 INFO:tasks.workunit.client.1.smithi154.stdout:7/782: creat d6/d20/d40/d52/d81/f101 x:0 0 0 2024-05-06T21:26:56.865 INFO:tasks.workunit.client.1.smithi154.stdout:8/921: rename d3/d14/d1a/d29/d32/d40/d79/d2b/l5e to d3/d64/d6d/dbd/dce/l12b 0 2024-05-06T21:26:56.865 INFO:tasks.workunit.client.1.smithi154.stdout:8/922: stat d3/d14/d1a/d29/d32/d40/d79/d90/fd8 0 2024-05-06T21:26:56.865 INFO:tasks.workunit.client.1.smithi154.stdout:8/923: dread - d3/d64/d6d/ff7 zero size 2024-05-06T21:26:56.868 INFO:tasks.workunit.client.1.smithi154.stdout:6/731: link d8/d11/d33/d4a/d6c/f98 d8/d11/d2d/d3d/d4c/fe3 0 2024-05-06T21:26:56.868 INFO:tasks.workunit.client.1.smithi154.stdout:6/732: creat d8/d11/d33/d4a/d6c/fe4 x:0 0 0 2024-05-06T21:26:56.868 INFO:tasks.workunit.client.1.smithi154.stdout:6/733: read - d8/d11/d2d/d3d/d70/f80 zero size 2024-05-06T21:26:56.869 INFO:tasks.workunit.client.1.smithi154.stdout:6/734: dread - d8/d11/d33/d92/fb6 zero size 2024-05-06T21:26:56.879 INFO:tasks.workunit.client.1.smithi154.stdout:7/783: rename d6/d20/d40/daf/d5c/c73 to d6/d42/d6c/d6e/d5e/c102 0 2024-05-06T21:26:56.879 INFO:tasks.workunit.client.1.smithi154.stdout:7/784: creat d6/d54/d5b/dc5/f103 x:0 0 0 2024-05-06T21:26:56.879 INFO:tasks.workunit.client.1.smithi154.stdout:7/785: stat d6/d42/d6c/d6e/d21/d69/d7b/d9f/fb6 0 2024-05-06T21:26:56.879 INFO:tasks.workunit.client.1.smithi154.stdout:7/786: stat d6/d42/d6c/d6e/d21/c51 0 2024-05-06T21:26:56.890 INFO:tasks.workunit.client.1.smithi154.stdout:8/924: dwrite d3/f7a [4194304,4194304] 0 2024-05-06T21:26:56.891 INFO:tasks.workunit.client.1.smithi154.stdout:8/925: chown d3/d14/d1a/d45/dcf/db4/fdd 279341645 1 2024-05-06T21:26:56.891 INFO:tasks.workunit.client.1.smithi154.stdout:7/787: unlink d6/d42/d6c/d6e/d21/d2e/l3d 0 2024-05-06T21:26:56.896 INFO:tasks.workunit.client.1.smithi154.stdout:6/735: dwrite d8/d11/fab [0,4194304] 0 2024-05-06T21:26:56.901 INFO:tasks.workunit.client.1.smithi154.stdout:8/926: write d3/d14/d1a/d29/d32/d40/d79/f4e [3302724,99345] 0 2024-05-06T21:26:56.903 INFO:tasks.workunit.client.1.smithi154.stdout:6/736: rmdir d8/d11/d2d 39 2024-05-06T21:26:56.906 INFO:tasks.workunit.client.1.smithi154.stdout:8/927: mknod d3/d14/d1a/d29/d32/d40/c12c 0 2024-05-06T21:26:56.907 INFO:tasks.workunit.client.1.smithi154.stdout:6/737: rmdir d8/d11/d2d/d3d/d70/d7b 39 2024-05-06T21:26:56.909 INFO:tasks.workunit.client.1.smithi154.stdout:8/928: creat d3/d64/d6d/dbd/d127/f12d x:0 0 0 2024-05-06T21:26:56.912 INFO:tasks.workunit.client.1.smithi154.stdout:8/929: truncate d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/f9e 50234 0 2024-05-06T21:26:56.914 INFO:tasks.workunit.client.1.smithi154.stdout:8/930: getdents d3/d14/d1a/d29/da3 0 2024-05-06T21:26:56.915 INFO:tasks.workunit.client.1.smithi154.stdout:5/948: sync 2024-05-06T21:26:56.915 INFO:tasks.workunit.client.1.smithi154.stdout:5/949: fdatasync d2/da5/fe5 0 2024-05-06T21:26:56.915 INFO:tasks.workunit.client.1.smithi154.stdout:1/896: sync 2024-05-06T21:26:56.917 INFO:tasks.workunit.client.1.smithi154.stdout:6/738: write d8/d11/d2d/d3d/d70/d7b/d95/f9a [3020835,39435] 0 2024-05-06T21:26:56.918 INFO:tasks.workunit.client.1.smithi154.stdout:6/739: chown d8/d11/d2d/c45 1775383 1 2024-05-06T21:26:56.918 INFO:tasks.workunit.client.1.smithi154.stdout:5/950: getdents d2/d3/d21/d95/dd/dda 0 2024-05-06T21:26:56.920 INFO:tasks.workunit.client.1.smithi154.stdout:6/740: creat d8/d11/d33/d4a/fe5 x:0 0 0 2024-05-06T21:26:56.921 INFO:tasks.workunit.client.1.smithi154.stdout:5/951: truncate d2/d3/d21/d95/dd/d2a/d54/d43/ff2 3836237 0 2024-05-06T21:26:56.921 INFO:tasks.workunit.client.1.smithi154.stdout:8/931: dread d3/d14/d1a/d29/d32/d40/d4b/d4d/fc9 [0,4194304] 0 2024-05-06T21:26:56.921 INFO:tasks.workunit.client.1.smithi154.stdout:8/932: dread - d3/d14/d1a/d29/d32/d40/d79/d84/da4/fea zero size 2024-05-06T21:26:56.925 INFO:tasks.workunit.client.1.smithi154.stdout:5/952: rename d2/l67 to d2/d3/d21/d22/l141 0 2024-05-06T21:26:56.926 INFO:tasks.workunit.client.1.smithi154.stdout:8/933: creat d3/d64/f12e x:0 0 0 2024-05-06T21:26:56.927 INFO:tasks.workunit.client.1.smithi154.stdout:6/741: write d8/fa0 [2507865,110578] 0 2024-05-06T21:26:56.928 INFO:tasks.workunit.client.1.smithi154.stdout:7/788: dwrite d6/d42/d6c/d6e/fdc [0,4194304] 0 2024-05-06T21:26:56.928 INFO:tasks.workunit.client.1.smithi154.stdout:7/789: creat d6/d20/d40/f104 x:0 0 0 2024-05-06T21:26:56.929 INFO:tasks.workunit.client.1.smithi154.stdout:8/934: mkdir d3/d14/d1a/d45/dcf/d12f 0 2024-05-06T21:26:56.931 INFO:tasks.workunit.client.1.smithi154.stdout:6/742: rename d8/d11/d2d/d3d/d4c/l78 to d8/d11/d33/le6 0 2024-05-06T21:26:56.938 INFO:tasks.workunit.client.1.smithi154.stdout:7/790: write d6/f25 [466725,112710] 0 2024-05-06T21:26:56.939 INFO:tasks.workunit.client.1.smithi154.stdout:7/791: getdents d6/d42/d6c/d6e/d21/d2e/d9d 0 2024-05-06T21:26:56.939 INFO:tasks.workunit.client.1.smithi154.stdout:7/792: write d6/d20/d40/d52/d81/f101 [571181,55226] 0 2024-05-06T21:26:56.939 INFO:tasks.workunit.client.1.smithi154.stdout:7/793: creat d6/d42/d6c/d6e/d21/d69/ddd/f105 x:0 0 0 2024-05-06T21:26:56.940 INFO:tasks.workunit.client.1.smithi154.stdout:7/794: chown d6/d20/db1/cea 66460 1 2024-05-06T21:26:56.940 INFO:tasks.workunit.client.1.smithi154.stdout:6/743: dread d8/fc [0,4194304] 0 2024-05-06T21:26:56.940 INFO:tasks.workunit.client.1.smithi154.stdout:6/744: chown d8/d11/d2d/d3d/d4c/dba/lcf 3 1 2024-05-06T21:26:56.940 INFO:tasks.workunit.client.1.smithi154.stdout:6/745: fdatasync d8/d11/d2d/d3d/d70/d7b/d95/fb9 0 2024-05-06T21:26:56.942 INFO:tasks.workunit.client.1.smithi154.stdout:6/746: rmdir d8/d13/d20 39 2024-05-06T21:26:56.944 INFO:tasks.workunit.client.1.smithi154.stdout:8/935: read d3/f7a [4586199,87442] 0 2024-05-06T21:26:56.946 INFO:tasks.workunit.client.1.smithi154.stdout:6/747: mknod d8/d11/d33/d4a/d6c/ce7 0 2024-05-06T21:26:56.946 INFO:tasks.workunit.client.1.smithi154.stdout:6/748: write d8/d11/f24 [1533111,128547] 0 2024-05-06T21:26:56.948 INFO:tasks.workunit.client.1.smithi154.stdout:8/936: dread d3/d38/df2/f11e [0,4194304] 0 2024-05-06T21:26:56.949 INFO:tasks.workunit.client.1.smithi154.stdout:6/749: truncate d8/d13/d20/f74 401160 0 2024-05-06T21:26:56.950 INFO:tasks.workunit.client.1.smithi154.stdout:6/750: stat d8/d11/d2d/d3d/d4c/f84 0 2024-05-06T21:26:56.951 INFO:tasks.workunit.client.1.smithi154.stdout:6/751: dread d8/d11/d33/fb3 [0,4194304] 0 2024-05-06T21:26:56.952 INFO:tasks.workunit.client.1.smithi154.stdout:6/752: write d8/d11/d2d/f3a [4486005,123733] 0 2024-05-06T21:26:56.952 INFO:tasks.workunit.client.1.smithi154.stdout:6/753: stat d8/d13/d20/l6e 0 2024-05-06T21:26:56.953 INFO:tasks.workunit.client.1.smithi154.stdout:2/898: sync 2024-05-06T21:26:56.964 INFO:tasks.workunit.client.1.smithi154.stdout:5/953: dwrite d2/d3/d21/f26 [0,4194304] 0 2024-05-06T21:26:56.964 INFO:tasks.workunit.client.1.smithi154.stdout:5/954: write d2/d3/f6d [1833123,107063] 0 2024-05-06T21:26:56.968 INFO:tasks.workunit.client.1.smithi154.stdout:1/897: dwrite d6/db/d5e/db8/fdc [0,4194304] 0 2024-05-06T21:26:56.968 INFO:tasks.workunit.client.1.smithi154.stdout:1/898: write d6/fec [707221,44163] 0 2024-05-06T21:26:56.968 INFO:tasks.workunit.client.1.smithi154.stdout:1/899: chown d6/db/d10/d15/d1d/d53/f5f 204276623 1 2024-05-06T21:26:56.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:56 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:56.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:56 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:56.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:56 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:26:56.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:56 smithi032 ceph-mon[27179]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:26:56.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:56 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:26:56.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:56 smithi032 ceph-mon[27179]: Upgrade: Need to upgrade myself (mgr.smithi154.kilvol) 2024-05-06T21:26:56.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:56 smithi032 ceph-mon[27179]: Upgrade: Need to upgrade myself (mgr.smithi154.kilvol) 2024-05-06T21:26:56.986 INFO:tasks.workunit.client.1.smithi154.stdout:8/937: dwrite d3/f7a [0,4194304] 0 2024-05-06T21:26:56.989 INFO:tasks.workunit.client.1.smithi154.stdout:6/754: dwrite d8/d7e/f83 [0,4194304] 0 2024-05-06T21:26:56.991 INFO:tasks.workunit.client.1.smithi154.stdout:2/899: creat db/d12/d4e/d55/d116/f12e x:0 0 0 2024-05-06T21:26:56.991 INFO:tasks.workunit.client.1.smithi154.stdout:4/973: sync 2024-05-06T21:26:56.991 INFO:tasks.workunit.client.1.smithi154.stdout:4/974: truncate d0/d82/d3d/f7c 558601 0 2024-05-06T21:26:56.993 INFO:tasks.workunit.client.1.smithi154.stdout:5/955: symlink d2/d3/d21/l142 0 2024-05-06T21:26:57.012 INFO:tasks.workunit.client.1.smithi154.stdout:1/900: getdents d6 0 2024-05-06T21:26:57.012 INFO:tasks.workunit.client.1.smithi154.stdout:1/901: chown d6/db/c2f 516509392 1 2024-05-06T21:26:57.031 INFO:tasks.workunit.client.1.smithi154.stdout:1/902: dwrite d6/db/d10/d15/d1d/d53/f98 [0,4194304] 0 2024-05-06T21:26:57.093 INFO:tasks.workunit.client.1.smithi154.stdout:8/938: mkdir d3/d14/d1a/d29/d32/d40/d79/d84/dbe/d130 0 2024-05-06T21:26:57.103 INFO:tasks.workunit.client.1.smithi154.stdout:6/755: rmdir d8/d11/d2d/d3d/d70/d7b/d95 39 2024-05-06T21:26:57.106 INFO:tasks.workunit.client.1.smithi154.stdout:2/900: symlink db/d12/d1d/d60/d63/l12f 0 2024-05-06T21:26:57.107 INFO:tasks.workunit.client.1.smithi154.stdout:4/975: creat d0/d82/d39/df7/f13f x:0 0 0 2024-05-06T21:26:57.109 INFO:tasks.workunit.client.1.smithi154.stdout:7/795: rename d6/d42/d6c to d6/d42/d106 0 2024-05-06T21:26:57.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:56 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:57.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:56 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:57.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:56 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:26:57.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:56 smithi154 ceph-mon[32880]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:26:57.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:56 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:26:57.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:56 smithi154 ceph-mon[32880]: Upgrade: Need to upgrade myself (mgr.smithi154.kilvol) 2024-05-06T21:26:57.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:56 smithi154 ceph-mon[32880]: Upgrade: Need to upgrade myself (mgr.smithi154.kilvol) 2024-05-06T21:26:57.119 INFO:tasks.workunit.client.1.smithi154.stdout:6/756: dwrite d8/d11/d33/d4a/d6c/fb1 [0,4194304] 0 2024-05-06T21:26:57.122 INFO:tasks.workunit.client.1.smithi154.stdout:1/903: mkdir d6/d3e/d7e/da5/d111 0 2024-05-06T21:26:57.123 INFO:tasks.workunit.client.1.smithi154.stdout:8/939: truncate d3/d14/d1a/d45/f7d 1125552 0 2024-05-06T21:26:57.125 INFO:tasks.workunit.client.1.smithi154.stdout:2/901: link db/d12/d19/d4b/l122 db/d12/d1d/d60/l130 0 2024-05-06T21:26:57.126 INFO:tasks.workunit.client.1.smithi154.stdout:1/904: write d6/db/d97/ffd [1373210,27909] 0 2024-05-06T21:26:57.126 INFO:tasks.workunit.client.1.smithi154.stdout:1/905: chown d6/db/d74 994096292 1 2024-05-06T21:26:57.126 INFO:tasks.workunit.client.1.smithi154.stdout:7/796: rmdir d6/d42/d106/d6e/da4 39 2024-05-06T21:26:57.126 INFO:tasks.workunit.client.1.smithi154.stdout:7/797: fsync d6/d42/d106/d6e/d21/d2e/fe1 0 2024-05-06T21:26:57.127 INFO:tasks.workunit.client.1.smithi154.stdout:7/798: truncate d6/d42/d106/d6e/fd0 4990665 0 2024-05-06T21:26:57.129 INFO:tasks.workunit.client.1.smithi154.stdout:8/940: rename d3/c7 to d3/d38/df2/c131 0 2024-05-06T21:26:57.131 INFO:tasks.workunit.client.1.smithi154.stdout:2/902: creat db/d12/dbf/f131 x:0 0 0 2024-05-06T21:26:57.131 INFO:tasks.workunit.client.1.smithi154.stdout:2/903: chown db/d12/d19/d81/c109 40 1 2024-05-06T21:26:57.132 INFO:tasks.workunit.client.1.smithi154.stdout:8/941: mknod d3/d64/d6d/dbd/d6b/c132 0 2024-05-06T21:26:57.139 INFO:tasks.workunit.client.1.smithi154.stdout:1/906: read d6/d3e/faa [931007,11512] 0 2024-05-06T21:26:57.139 INFO:tasks.workunit.client.1.smithi154.stdout:4/976: dwrite d0/d82/ddb/f132 [0,4194304] 0 2024-05-06T21:26:57.139 INFO:tasks.workunit.client.1.smithi154.stdout:2/904: creat db/d12/d19/d7d/f132 x:0 0 0 2024-05-06T21:26:57.140 INFO:tasks.workunit.client.1.smithi154.stdout:2/905: chown db/d12/d19/d4b/lcf 496876 1 2024-05-06T21:26:57.141 INFO:tasks.workunit.client.1.smithi154.stdout:6/757: dwrite d8/d13/f71 [0,4194304] 0 2024-05-06T21:26:57.149 INFO:tasks.workunit.client.1.smithi154.stdout:4/977: truncate d0/d2/dc/fc4 824985 0 2024-05-06T21:26:57.153 INFO:tasks.workunit.client.1.smithi154.stdout:8/942: dwrite d3/d14/d1a/d29/d32/d40/d79/d2b/fd7 [0,4194304] 0 2024-05-06T21:26:57.153 INFO:tasks.workunit.client.1.smithi154.stdout:8/943: chown d3/d14/d1a/d29/d32/d40/d59/c107 48089 1 2024-05-06T21:26:57.154 INFO:tasks.workunit.client.1.smithi154.stdout:2/906: unlink db/d12/f119 0 2024-05-06T21:26:57.154 INFO:tasks.workunit.client.1.smithi154.stdout:2/907: chown db/d12/d19/d4b/c113 610 1 2024-05-06T21:26:57.154 INFO:tasks.workunit.client.1.smithi154.stdout:6/758: creat d8/d11/d2d/da3/fe8 x:0 0 0 2024-05-06T21:26:57.154 INFO:tasks.workunit.client.1.smithi154.stdout:6/759: chown d8/fa5 9679 1 2024-05-06T21:26:57.155 INFO:tasks.workunit.client.1.smithi154.stdout:6/760: fdatasync d8/d11/d8d/fc5 0 2024-05-06T21:26:57.165 INFO:tasks.workunit.client.1.smithi154.stdout:4/978: symlink d0/d2/d29/l140 0 2024-05-06T21:26:57.165 INFO:tasks.workunit.client.1.smithi154.stdout:1/907: dwrite d6/d3e/d7e/da5/da8/faf [0,4194304] 0 2024-05-06T21:26:57.168 INFO:tasks.workunit.client.1.smithi154.stdout:8/944: mknod d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/c133 0 2024-05-06T21:26:57.170 INFO:tasks.workunit.client.1.smithi154.stdout:2/908: mkdir db/d12/d19/d4b/d78/de8/d127/d133 0 2024-05-06T21:26:57.170 INFO:tasks.workunit.client.1.smithi154.stdout:2/909: write db/d12/fc1 [899212,15915] 0 2024-05-06T21:26:57.170 INFO:tasks.workunit.client.1.smithi154.stdout:2/910: creat db/d12/f134 x:0 0 0 2024-05-06T21:26:57.170 INFO:tasks.workunit.client.1.smithi154.stdout:2/911: creat db/de/d16/d33/f135 x:0 0 0 2024-05-06T21:26:57.170 INFO:tasks.workunit.client.1.smithi154.stdout:2/912: fsync db/de/d6f/f11f 0 2024-05-06T21:26:57.174 INFO:tasks.workunit.client.1.smithi154.stdout:6/761: dwrite d8/fa0 [0,4194304] 0 2024-05-06T21:26:57.174 INFO:tasks.workunit.client.1.smithi154.stdout:6/762: readlink d8/d11/d33/d4a/d6c/l7a 0 2024-05-06T21:26:57.174 INFO:tasks.workunit.client.1.smithi154.stdout:6/763: write d8/d13/d8f/fad [1008636,26732] 0 2024-05-06T21:26:57.179 INFO:tasks.workunit.client.1.smithi154.stdout:1/908: link d6/db/d5e/fcf d6/d3e/d7e/da5/da8/f112 0 2024-05-06T21:26:57.186 INFO:tasks.workunit.client.1.smithi154.stdout:8/945: dwrite d3/d14/d1a/d29/f3d [0,4194304] 0 2024-05-06T21:26:57.186 INFO:tasks.workunit.client.1.smithi154.stdout:8/946: write d3/d14/d1a/f10f [791929,6583] 0 2024-05-06T21:26:57.188 INFO:tasks.workunit.client.1.smithi154.stdout:8/947: creat d3/d64/d6d/dbd/d6b/f134 x:0 0 0 2024-05-06T21:26:57.192 INFO:tasks.workunit.client.1.smithi154.stdout:8/948: rename d3/d64/d6d/dbd/d61/f81 to d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/dc1/f135 0 2024-05-06T21:26:57.192 INFO:tasks.workunit.client.1.smithi154.stdout:8/949: chown d3/d14/d1a/d29/d32/d40/d4b/l8f 1046108738 1 2024-05-06T21:26:57.192 INFO:tasks.workunit.client.1.smithi154.stdout:8/950: write d3/f8 [8558615,42956] 0 2024-05-06T21:26:57.192 INFO:tasks.workunit.client.1.smithi154.stdout:2/913: dread db/d12/d1d/f48 [4194304,4194304] 0 2024-05-06T21:26:57.192 INFO:tasks.workunit.client.1.smithi154.stdout:2/914: dread - db/de/d16/d33/f90 zero size 2024-05-06T21:26:57.194 INFO:tasks.workunit.client.1.smithi154.stdout:6/764: dwrite d8/d11/d33/d4a/d6c/d8e/f96 [0,4194304] 0 2024-05-06T21:26:57.194 INFO:tasks.workunit.client.1.smithi154.stdout:6/765: fsync d8/d11/d2d/d3d/d4c/dba/fcb 0 2024-05-06T21:26:57.194 INFO:tasks.workunit.client.1.smithi154.stdout:1/909: dread d6/db/d69/f104 [0,4194304] 0 2024-05-06T21:26:57.195 INFO:tasks.workunit.client.1.smithi154.stdout:8/951: rename d3/d14/f19 to d3/d14/d1a/d6e/f136 0 2024-05-06T21:26:57.198 INFO:tasks.workunit.client.1.smithi154.stdout:7/799: rmdir d6/d42/d106 39 2024-05-06T21:26:57.200 INFO:tasks.workunit.client.1.smithi154.stdout:7/800: mkdir d6/d20/db1/d107 0 2024-05-06T21:26:57.202 INFO:tasks.workunit.client.1.smithi154.stdout:7/801: rename d6/d42/d106/d6e/d21/d2e/fe1 to d6/d20/db1/f108 0 2024-05-06T21:26:57.202 INFO:tasks.workunit.client.1.smithi154.stdout:6/766: read d8/f2b [2803744,54361] 0 2024-05-06T21:26:57.204 INFO:tasks.workunit.client.1.smithi154.stdout:7/802: truncate d6/d20/d40/d52/f9c 701569 0 2024-05-06T21:26:57.206 INFO:tasks.workunit.client.1.smithi154.stdout:8/952: write d3/d14/d1a/d45/f5f [183695,62487] 0 2024-05-06T21:26:57.207 INFO:tasks.workunit.client.1.smithi154.stdout:7/803: creat d6/d20/d40/d52/f109 x:0 0 0 2024-05-06T21:26:57.209 INFO:tasks.workunit.client.1.smithi154.stdout:6/767: symlink d8/d13/d20/daf/dd1/le9 0 2024-05-06T21:26:57.215 INFO:tasks.workunit.client.1.smithi154.stdout:2/915: dwrite db/d12/d1d/d60/d63/f66 [4194304,4194304] 0 2024-05-06T21:26:57.215 INFO:tasks.workunit.client.1.smithi154.stdout:2/916: write db/d12/d1d/d60/f10a [692384,105526] 0 2024-05-06T21:26:57.215 INFO:tasks.workunit.client.1.smithi154.stdout:2/917: write db/d12/d4e/fcd [2517055,119117] 0 2024-05-06T21:26:57.216 INFO:tasks.workunit.client.1.smithi154.stdout:2/918: write db/de/d10/f87 [184931,86567] 0 2024-05-06T21:26:57.219 INFO:tasks.workunit.client.1.smithi154.stdout:1/910: dwrite d6/f17 [0,4194304] 0 2024-05-06T21:26:57.224 INFO:tasks.workunit.client.1.smithi154.stdout:2/919: dread db/de/d10/d18/fa2 [0,4194304] 0 2024-05-06T21:26:57.227 INFO:tasks.workunit.client.1.smithi154.stdout:6/768: dwrite d8/d11/d2d/f3a [4194304,4194304] 0 2024-05-06T21:26:57.235 INFO:tasks.workunit.client.1.smithi154.stdout:7/804: mknod d6/d20/d40/d52/d8b/c10a 0 2024-05-06T21:26:57.237 INFO:tasks.workunit.client.1.smithi154.stdout:8/953: mknod d3/d14/d1a/d29/d32/d40/d79/c137 0 2024-05-06T21:26:57.251 INFO:tasks.workunit.client.1.smithi154.stdout:1/911: creat d6/d3e/d7e/da5/da8/f113 x:0 0 0 2024-05-06T21:26:57.252 INFO:tasks.workunit.client.1.smithi154.stdout:1/912: dread d6/db/d10/d15/d1d/f57 [0,4194304] 0 2024-05-06T21:26:57.252 INFO:tasks.workunit.client.1.smithi154.stdout:6/769: dwrite d8/d11/d2d/d3d/d4c/dba/fc0 [0,4194304] 0 2024-05-06T21:26:57.252 INFO:tasks.workunit.client.1.smithi154.stdout:6/770: chown d8/d11/d8d 237313 1 2024-05-06T21:26:57.252 INFO:tasks.workunit.client.1.smithi154.stdout:2/920: creat db/de/f136 x:0 0 0 2024-05-06T21:26:57.255 INFO:tasks.workunit.client.1.smithi154.stdout:7/805: truncate d6/fd 6370293 0 2024-05-06T21:26:57.255 INFO:tasks.workunit.client.1.smithi154.stdout:7/806: chown d6/d42/d106/d6e/d21 9862 1 2024-05-06T21:26:57.255 INFO:tasks.workunit.client.1.smithi154.stdout:2/921: fdatasync db/de/d10/f87 0 2024-05-06T21:26:57.259 INFO:tasks.workunit.client.1.smithi154.stdout:8/954: mkdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/dfc/d138 0 2024-05-06T21:26:57.261 INFO:tasks.workunit.client.1.smithi154.stdout:1/913: stat d6/d3e/d7e/da5/da8/cbb 0 2024-05-06T21:26:57.268 INFO:tasks.workunit.client.1.smithi154.stdout:7/807: rename d6/d42/d106/d6e/d23/fae to d6/d20/f10b 0 2024-05-06T21:26:57.269 INFO:tasks.workunit.client.1.smithi154.stdout:2/922: dwrite db/de/d10/d18/fa8 [0,4194304] 0 2024-05-06T21:26:57.269 INFO:tasks.workunit.client.1.smithi154.stdout:8/955: creat d3/d14/d1a/d29/d32/d40/d59/f139 x:0 0 0 2024-05-06T21:26:57.269 INFO:tasks.workunit.client.1.smithi154.stdout:2/923: truncate db/d12/d19/d4b/fbe 536771 0 2024-05-06T21:26:57.270 INFO:tasks.workunit.client.1.smithi154.stdout:8/956: creat d3/d14/d1a/d45/dcf/db4/f13a x:0 0 0 2024-05-06T21:26:57.271 INFO:tasks.workunit.client.1.smithi154.stdout:1/914: symlink d6/db/d69/l114 0 2024-05-06T21:26:57.273 INFO:tasks.workunit.client.1.smithi154.stdout:6/771: getdents d8/d7e 0 2024-05-06T21:26:57.273 INFO:tasks.workunit.client.1.smithi154.stdout:6/772: readlink d8/d13/d20/daf/dd1/le9 0 2024-05-06T21:26:57.283 INFO:tasks.workunit.client.1.smithi154.stdout:2/924: rename db/d12/d19/d81/f8b to db/d12/d4e/d55/d116/f137 0 2024-05-06T21:26:57.285 INFO:tasks.workunit.client.1.smithi154.stdout:6/773: link d8/d11/d2d/da3/lbd d8/d13/da9/lea 0 2024-05-06T21:26:57.286 INFO:tasks.workunit.client.1.smithi154.stdout:6/774: write d8/d13/d20/f65 [925499,81686] 0 2024-05-06T21:26:57.289 INFO:tasks.workunit.client.1.smithi154.stdout:1/915: dwrite d6/db/d10/f84 [0,4194304] 0 2024-05-06T21:26:57.290 INFO:tasks.workunit.client.1.smithi154.stdout:7/808: rmdir d6/d20/d40/d52 39 2024-05-06T21:26:57.295 INFO:tasks.workunit.client.1.smithi154.stdout:2/925: mknod db/d12/d19/c138 0 2024-05-06T21:26:57.295 INFO:tasks.workunit.client.1.smithi154.stdout:8/957: rmdir d3/d14/d1a/d6e 39 2024-05-06T21:26:57.299 INFO:tasks.workunit.client.1.smithi154.stdout:8/958: link d3/d14/d1a/d45/c65 d3/d14/d1a/d29/d32/d40/dfd/c13b 0 2024-05-06T21:26:57.300 INFO:tasks.workunit.client.1.smithi154.stdout:8/959: chown d3/d64/d6d/dbd/d6b/d120 11984 1 2024-05-06T21:26:57.300 INFO:tasks.workunit.client.1.smithi154.stdout:1/916: write d6/db/d10/d15/d1d/d53/f98 [3751913,23766] 0 2024-05-06T21:26:57.300 INFO:tasks.workunit.client.1.smithi154.stdout:7/809: dread d6/f1a [0,4194304] 0 2024-05-06T21:26:57.300 INFO:tasks.workunit.client.1.smithi154.stdout:7/810: truncate d6/d54/d5b/dc5/f103 385446 0 2024-05-06T21:26:57.301 INFO:tasks.workunit.client.1.smithi154.stdout:8/960: link d3/d14/d1a/d45/dcf/db4/cc4 d3/d38/c13c 0 2024-05-06T21:26:57.303 INFO:tasks.workunit.client.1.smithi154.stdout:1/917: mknod d6/d3e/d7e/da5/d105/c115 0 2024-05-06T21:26:57.304 INFO:tasks.workunit.client.1.smithi154.stdout:7/811: getdents d6/d20/d40/daf 0 2024-05-06T21:26:57.304 INFO:tasks.workunit.client.1.smithi154.stdout:7/812: truncate d6/f7d 6076102 0 2024-05-06T21:26:57.304 INFO:tasks.workunit.client.1.smithi154.stdout:7/813: readlink d6/d42/d106/d6e/d21/d69/de0/lfa 0 2024-05-06T21:26:57.305 INFO:tasks.workunit.client.1.smithi154.stdout:8/961: link d3/d14/d1a/d29/d32/d40/d59/d67/d95/ccc d3/d14/d1a/d45/dcf/c13d 0 2024-05-06T21:26:57.307 INFO:tasks.workunit.client.1.smithi154.stdout:1/918: stat d6/d3e/d7e/lcc 0 2024-05-06T21:26:57.307 INFO:tasks.workunit.client.1.smithi154.stdout:1/919: truncate d6/db/d10/d15/f4a 8411692 0 2024-05-06T21:26:57.309 INFO:tasks.workunit.client.1.smithi154.stdout:8/962: unlink d3/d38/df2/fa9 0 2024-05-06T21:26:57.311 INFO:tasks.workunit.client.1.smithi154.stdout:1/920: symlink d6/db/dbe/l116 0 2024-05-06T21:26:57.311 INFO:tasks.workunit.client.1.smithi154.stdout:1/921: chown d6/db/dbe/l116 50 1 2024-05-06T21:26:57.311 INFO:tasks.workunit.client.1.smithi154.stdout:1/922: write d6/db/d10/d15/f4a [592750,23781] 0 2024-05-06T21:26:57.314 INFO:tasks.workunit.client.1.smithi154.stdout:8/963: creat d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/dfc/f13e x:0 0 0 2024-05-06T21:26:57.314 INFO:tasks.workunit.client.1.smithi154.stdout:8/964: fsync d3/d14/d1a/d29/d43/fe1 0 2024-05-06T21:26:57.314 INFO:tasks.workunit.client.1.smithi154.stdout:6/775: dwrite d8/d11/d2d/d3d/d70/d7b/d95/fa7 [0,4194304] 0 2024-05-06T21:26:57.314 INFO:tasks.workunit.client.1.smithi154.stdout:6/776: dread - d8/d11/d33/f8c zero size 2024-05-06T21:26:57.314 INFO:tasks.workunit.client.1.smithi154.stdout:6/777: chown d8/d11/d33 0 1 2024-05-06T21:26:57.318 INFO:tasks.workunit.client.1.smithi154.stdout:2/926: dwrite db/de/f136 [0,4194304] 0 2024-05-06T21:26:57.320 INFO:tasks.workunit.client.1.smithi154.stdout:8/965: rename d3/d14/d1a/d29/d32/cc6 to d3/d64/d6d/dbd/dce/c13f 0 2024-05-06T21:26:57.321 INFO:tasks.workunit.client.1.smithi154.stdout:6/778: mknod d8/d11/d33/d4a/ceb 0 2024-05-06T21:26:57.321 INFO:tasks.workunit.client.1.smithi154.stdout:6/779: write d8/d11/d33/fb3 [805166,62009] 0 2024-05-06T21:26:57.321 INFO:tasks.workunit.client.1.smithi154.stdout:6/780: write d8/d11/f99 [844399,27716] 0 2024-05-06T21:26:57.322 INFO:tasks.workunit.client.1.smithi154.stdout:6/781: write d8/d13/da9/fc2 [4361253,68477] 0 2024-05-06T21:26:57.322 INFO:tasks.workunit.client.1.smithi154.stdout:6/782: read - d8/d11/d2d/d3d/fb2 zero size 2024-05-06T21:26:57.322 INFO:tasks.workunit.client.1.smithi154.stdout:6/783: write d8/d7e/f83 [4850293,83477] 0 2024-05-06T21:26:57.326 INFO:tasks.workunit.client.1.smithi154.stdout:7/814: dwrite d6/d42/d106/d6e/d23/fbc [0,4194304] 0 2024-05-06T21:26:57.342 INFO:tasks.workunit.client.1.smithi154.stdout:2/927: mkdir db/d12/d19/d81/d139 0 2024-05-06T21:26:57.343 INFO:tasks.workunit.client.1.smithi154.stdout:8/966: mknod d3/d14/d1a/d29/d32/d40/d10d/c140 0 2024-05-06T21:26:57.345 INFO:tasks.workunit.client.1.smithi154.stdout:7/815: dwrite d6/d54/fc4 [0,4194304] 0 2024-05-06T21:26:57.345 INFO:tasks.workunit.client.1.smithi154.stdout:7/816: write d6/d42/d106/d6e/d21/fd8 [1042893,36015] 0 2024-05-06T21:26:57.347 INFO:tasks.workunit.client.1.smithi154.stdout:2/928: symlink db/d12/d19/d4b/l13a 0 2024-05-06T21:26:57.348 INFO:tasks.workunit.client.1.smithi154.stdout:6/784: rename d8/d11/d2d/d3d/c6a to d8/d13/d20/daf/dd1/cec 0 2024-05-06T21:26:57.371 INFO:tasks.workunit.client.1.smithi154.stdout:5/956: sync 2024-05-06T21:26:57.372 INFO:tasks.workunit.client.1.smithi154.stdout:6/785: dwrite d8/d13/da9/f6f [0,4194304] 0 2024-05-06T21:26:57.372 INFO:tasks.workunit.client.1.smithi154.stdout:5/957: mknod d2/d3/d19/d23/db6/c143 0 2024-05-06T21:26:57.376 INFO:tasks.workunit.client.1.smithi154.stdout:6/786: rename d8/d13/da9/l53 to d8/d11/d2d/led 0 2024-05-06T21:26:57.377 INFO:tasks.workunit.client.1.smithi154.stdout:5/958: mkdir d2/d3/d21/d95/dd/d2a/d8d/d144 0 2024-05-06T21:26:57.378 INFO:tasks.workunit.client.1.smithi154.stdout:6/787: creat d8/d11/d8d/daa/fee x:0 0 0 2024-05-06T21:26:57.378 INFO:tasks.workunit.client.1.smithi154.stdout:6/788: creat d8/d11/d33/fef x:0 0 0 2024-05-06T21:26:57.381 INFO:tasks.workunit.client.1.smithi154.stdout:5/959: rename d2/d48/d12f/d37/cf1 to d2/d3/d21/d95/dc/d44/d9a/dab/c145 0 2024-05-06T21:26:57.385 INFO:tasks.workunit.client.1.smithi154.stdout:6/789: mkdir d8/d13/d20/daf/dd1/df0 0 2024-05-06T21:26:57.386 INFO:tasks.workunit.client.1.smithi154.stdout:6/790: unlink d8/d11/d2d/d3d/d4c/c66 0 2024-05-06T21:26:57.388 INFO:tasks.workunit.client.1.smithi154.stdout:6/791: mkdir d8/d11/df1 0 2024-05-06T21:26:57.388 INFO:tasks.workunit.client.1.smithi154.stdout:6/792: creat d8/d11/d33/d4a/d6c/d8e/ff2 x:0 0 0 2024-05-06T21:26:57.398 INFO:tasks.workunit.client.1.smithi154.stdout:6/793: rmdir d8/d11/d2d/d3d/d4c 39 2024-05-06T21:26:57.398 INFO:tasks.workunit.client.1.smithi154.stdout:6/794: write d8/d11/d2d/d3d/d70/d7b/d95/fb9 [174258,128901] 0 2024-05-06T21:26:57.398 INFO:tasks.workunit.client.1.smithi154.stdout:6/795: write d8/d11/f99 [1867686,89152] 0 2024-05-06T21:26:57.398 INFO:tasks.workunit.client.1.smithi154.stdout:6/796: write d8/d11/d2d/d3d/d70/fd7 [2022819,46875] 0 2024-05-06T21:26:57.399 INFO:tasks.workunit.client.1.smithi154.stdout:6/797: mknod d8/d13/d8f/dd8/cf3 0 2024-05-06T21:26:57.399 INFO:tasks.workunit.client.1.smithi154.stdout:6/798: dread - d8/d11/d2d/d3d/d4c/dba/fd9 zero size 2024-05-06T21:26:57.399 INFO:tasks.workunit.client.1.smithi154.stdout:6/799: stat d8/c1e 0 2024-05-06T21:26:57.413 INFO:tasks.workunit.client.1.smithi154.stdout:6/800: dwrite d8/f2b [0,4194304] 0 2024-05-06T21:26:57.414 INFO:tasks.workunit.client.1.smithi154.stdout:6/801: mknod d8/d11/d2d/d3d/cf4 0 2024-05-06T21:26:57.416 INFO:tasks.workunit.client.1.smithi154.stdout:6/802: mkdir d8/d11/d2d/d3d/d4c/df5 0 2024-05-06T21:26:57.416 INFO:tasks.workunit.client.1.smithi154.stdout:6/803: chown d8/d11/d2d/d3d/d4c/f58 5201 1 2024-05-06T21:26:57.417 INFO:tasks.workunit.client.1.smithi154.stdout:6/804: creat d8/d11/d33/d4a/ff6 x:0 0 0 2024-05-06T21:26:57.418 INFO:tasks.workunit.client.1.smithi154.stdout:6/805: truncate d8/d13/d20/f5a 4165889 0 2024-05-06T21:26:57.420 INFO:tasks.workunit.client.1.smithi154.stdout:6/806: symlink d8/d11/d2d/d3d/d4c/dba/dcd/lf7 0 2024-05-06T21:26:57.420 INFO:tasks.workunit.client.1.smithi154.stdout:6/807: dread - d8/d11/d33/d4a/d6c/fe4 zero size 2024-05-06T21:26:57.427 INFO:tasks.workunit.client.1.smithi154.stdout:6/808: dread d8/d11/f99 [0,4194304] 0 2024-05-06T21:26:57.443 INFO:tasks.workunit.client.1.smithi154.stdout:6/809: dwrite d8/fa5 [0,4194304] 0 2024-05-06T21:26:57.444 INFO:tasks.workunit.client.1.smithi154.stdout:6/810: creat d8/d11/d8d/ff8 x:0 0 0 2024-05-06T21:26:57.446 INFO:tasks.workunit.client.1.smithi154.stdout:6/811: mknod d8/d11/d33/d4a/d6c/d8e/cf9 0 2024-05-06T21:26:57.447 INFO:tasks.workunit.client.1.smithi154.stdout:6/812: mknod d8/d11/d2d/d3d/d4c/df5/cfa 0 2024-05-06T21:26:57.447 INFO:tasks.workunit.client.1.smithi154.stdout:6/813: dread - d8/d13/d20/f85 zero size 2024-05-06T21:26:57.448 INFO:tasks.workunit.client.1.smithi154.stdout:6/814: chown d8/l61 145377572 1 2024-05-06T21:26:57.448 INFO:tasks.workunit.client.1.smithi154.stdout:6/815: write d8/d11/d33/d4a/d6c/d8e/fd6 [173615,99348] 0 2024-05-06T21:26:57.448 INFO:tasks.workunit.client.1.smithi154.stdout:6/816: readlink d8/d11/d2d/d3d/d4c/l5c 0 2024-05-06T21:26:57.448 INFO:tasks.workunit.client.1.smithi154.stdout:6/817: write d8/d11/f24 [1670052,68393] 0 2024-05-06T21:26:57.448 INFO:tasks.workunit.client.1.smithi154.stdout:6/818: truncate d8/d11/d8d/f91 3061138 0 2024-05-06T21:26:57.449 INFO:tasks.workunit.client.1.smithi154.stdout:6/819: creat d8/d11/d8d/daa/ffb x:0 0 0 2024-05-06T21:26:57.451 INFO:tasks.workunit.client.1.smithi154.stdout:6/820: link d8/d11/d2d/d3d/d70/d7b/lda d8/d11/d33/lfc 0 2024-05-06T21:26:57.451 INFO:tasks.workunit.client.1.smithi154.stdout:6/821: chown d8/d13/d20/cc8 41 1 2024-05-06T21:26:57.451 INFO:tasks.workunit.client.1.smithi154.stdout:6/822: fdatasync d8/d13/d20/f5a 0 2024-05-06T21:26:57.451 INFO:tasks.workunit.client.1.smithi154.stdout:6/823: chown d8/d13/c75 22 1 2024-05-06T21:26:57.452 INFO:tasks.workunit.client.1.smithi154.stdout:6/824: unlink d8/d11/d33/d4a/lb4 0 2024-05-06T21:26:57.453 INFO:tasks.workunit.client.1.smithi154.stdout:6/825: creat d8/d11/d33/d4a/d6c/ffd x:0 0 0 2024-05-06T21:26:57.453 INFO:tasks.workunit.client.1.smithi154.stdout:6/826: write d8/fa0 [4809939,120832] 0 2024-05-06T21:26:57.454 INFO:tasks.workunit.client.1.smithi154.stdout:6/827: creat d8/d13/d8f/dd8/ffe x:0 0 0 2024-05-06T21:26:57.454 INFO:tasks.workunit.client.1.smithi154.stdout:6/828: stat d8/ce 0 2024-05-06T21:26:57.454 INFO:tasks.workunit.client.1.smithi154.stdout:6/829: mknod d8/d11/d8d/daa/cff 0 2024-05-06T21:26:57.461 INFO:tasks.workunit.client.1.smithi154.stdout:6/830: dread d8/d11/d33/d4a/f49 [0,4194304] 0 2024-05-06T21:26:57.475 INFO:tasks.workunit.client.1.smithi154.stdout:6/831: dwrite d8/d11/d2d/da3/fe8 [0,4194304] 0 2024-05-06T21:26:57.479 INFO:tasks.workunit.client.1.smithi154.stdout:6/832: rmdir d8/d11/d33/d4a/d6c/d8e 39 2024-05-06T21:26:57.481 INFO:tasks.workunit.client.1.smithi154.stdout:6/833: link d8/d11/d8d/daa/cff d8/d11/d2d/d3d/d4c/df5/c100 0 2024-05-06T21:26:57.605 INFO:tasks.workunit.client.1.smithi154.stdout:1/923: sync 2024-05-06T21:26:57.605 INFO:tasks.workunit.client.1.smithi154.stdout:4/979: sync 2024-05-06T21:26:57.605 INFO:tasks.workunit.client.1.smithi154.stdout:1/924: read d6/db/d10/d15/f4a [4929946,4574] 0 2024-05-06T21:26:57.614 INFO:tasks.workunit.client.1.smithi154.stdout:4/980: dread d0/d2/d29/d60/fff [0,4194304] 0 2024-05-06T21:26:57.614 INFO:tasks.workunit.client.1.smithi154.stdout:4/981: readlink d0/d10/lc9 0 2024-05-06T21:26:57.618 INFO:tasks.workunit.client.1.smithi154.stdout:4/982: write d0/d82/d39/fca [586434,122989] 0 2024-05-06T21:26:57.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:57 smithi032 ceph-mon[27179]: pgmap v29: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 408 MiB/s rd, 485 MiB/s wr, 676 op/s 2024-05-06T21:26:58.019 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:57 smithi154 ceph-mon[32880]: pgmap v29: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 408 MiB/s rd, 485 MiB/s wr, 676 op/s 2024-05-06T21:26:58.082 INFO:tasks.workunit.client.1.smithi154.stdout:1/925: unlink d6/d3e/d7e/da5/da8/fdf 0 2024-05-06T21:26:58.084 INFO:tasks.workunit.client.1.smithi154.stdout:4/983: unlink d0/d82/d44/d73/d4a/dd4/d1a/d7e/ce8 0 2024-05-06T21:26:58.092 INFO:tasks.workunit.client.1.smithi154.stdout:1/926: dread d6/db/d97/f10d [0,4194304] 0 2024-05-06T21:26:58.092 INFO:tasks.workunit.client.1.smithi154.stdout:1/927: dread d6/db/d10/fa1 [0,4194304] 0 2024-05-06T21:26:58.095 INFO:tasks.workunit.client.1.smithi154.stdout:7/817: sync 2024-05-06T21:26:58.095 INFO:tasks.workunit.client.1.smithi154.stdout:8/967: sync 2024-05-06T21:26:58.095 INFO:tasks.workunit.client.1.smithi154.stdout:2/929: sync 2024-05-06T21:26:58.095 INFO:tasks.workunit.client.1.smithi154.stdout:5/960: sync 2024-05-06T21:26:58.095 INFO:tasks.workunit.client.1.smithi154.stdout:6/834: sync 2024-05-06T21:26:58.095 INFO:tasks.workunit.client.1.smithi154.stdout:5/961: chown d2/d3/d21/d95/dd/d2a/d54/d43/f12d 1809695920 1 2024-05-06T21:26:58.095 INFO:tasks.workunit.client.1.smithi154.stdout:6/835: truncate d8/d11/d8d/daa/fee 536427 0 2024-05-06T21:26:58.095 INFO:tasks.workunit.client.1.smithi154.stdout:5/962: stat d2/d3/d21/d95/dc/d68/cfb 0 2024-05-06T21:26:58.096 INFO:tasks.workunit.client.1.smithi154.stdout:4/984: unlink d0/d2/dc/la7 0 2024-05-06T21:26:58.103 INFO:tasks.workunit.client.1.smithi154.stdout:5/963: dread d2/d3/d21/f60 [4194304,4194304] 0 2024-05-06T21:26:58.407 INFO:tasks.workunit.client.1.smithi154.stdout:1/928: rmdir d6/db/d10/d15/d1d/d53/d100 0 2024-05-06T21:26:58.411 INFO:tasks.workunit.client.1.smithi154.stdout:2/930: link db/d12/d1d/d60/d63/l94 db/d12/d19/d4b/d78/de8/d127/l13b 0 2024-05-06T21:26:58.414 INFO:tasks.workunit.client.1.smithi154.stdout:8/968: creat d3/d14/d1a/d29/d32/d40/d79/d2b/f141 x:0 0 0 2024-05-06T21:26:58.415 INFO:tasks.workunit.client.1.smithi154.stdout:8/969: chown d3/d14/d1a/d29/d32/d40/d79/d2b/fd7 3687749 1 2024-05-06T21:26:58.417 INFO:tasks.workunit.client.1.smithi154.stdout:6/836: link d8/d13/d20/l97 d8/d11/d33/d4a/l101 0 2024-05-06T21:26:58.419 INFO:tasks.workunit.client.1.smithi154.stdout:4/985: creat d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/dc7/f141 x:0 0 0 2024-05-06T21:26:58.422 INFO:tasks.workunit.client.1.smithi154.stdout:5/964: symlink d2/d3/d19/dbe/d11f/l146 0 2024-05-06T21:26:58.422 INFO:tasks.workunit.client.1.smithi154.stdout:5/965: dread - d2/d3/d19/dbe/f135 zero size 2024-05-06T21:26:58.423 INFO:tasks.workunit.client.1.smithi154.stdout:5/966: dread d2/d3/d21/d95/dd/d2a/d54/f5c [0,4194304] 0 2024-05-06T21:26:58.423 INFO:tasks.workunit.client.1.smithi154.stdout:5/967: readlink d2/lf5 0 2024-05-06T21:26:58.426 INFO:tasks.workunit.client.1.smithi154.stdout:2/931: truncate db/de/f136 2447290 0 2024-05-06T21:26:58.426 INFO:tasks.workunit.client.1.smithi154.stdout:2/932: creat db/d12/d1d/d60/d63/d117/f13c x:0 0 0 2024-05-06T21:26:58.426 INFO:tasks.workunit.client.1.smithi154.stdout:2/933: chown db/d12/d4e/d55/f5e 10173 1 2024-05-06T21:26:58.427 INFO:tasks.workunit.client.1.smithi154.stdout:4/986: mkdir d0/d82/d39/d63/d142 0 2024-05-06T21:26:58.433 INFO:tasks.workunit.client.1.smithi154.stdout:2/934: unlink db/d12/f134 0 2024-05-06T21:26:58.433 INFO:tasks.workunit.client.1.smithi154.stdout:2/935: chown db/de/d10 933 1 2024-05-06T21:26:58.433 INFO:tasks.workunit.client.1.smithi154.stdout:2/936: write db/d12/d1d/f48 [8719152,9163] 0 2024-05-06T21:26:58.435 INFO:tasks.workunit.client.1.smithi154.stdout:2/937: mkdir db/d12/d19/d4b/d78/de8/d13d 0 2024-05-06T21:26:58.435 INFO:tasks.workunit.client.1.smithi154.stdout:2/938: stat db/d12/d1d 0 2024-05-06T21:26:58.435 INFO:tasks.workunit.client.1.smithi154.stdout:2/939: write db/d12/fc1 [1071747,109768] 0 2024-05-06T21:26:58.448 INFO:tasks.workunit.client.1.smithi154.stdout:8/970: dwrite d3/fb [0,4194304] 0 2024-05-06T21:26:58.448 INFO:tasks.workunit.client.1.smithi154.stdout:5/968: dread d2/d3/d21/d95/dd/d2a/d54/d43/f7b [0,4194304] 0 2024-05-06T21:26:58.448 INFO:tasks.workunit.client.1.smithi154.stdout:5/969: fsync d2/d3/d21/d95/deb/f13a 0 2024-05-06T21:26:58.449 INFO:tasks.workunit.client.1.smithi154.stdout:5/970: dread d2/d3/d19/d23/faf [0,4194304] 0 2024-05-06T21:26:58.452 INFO:tasks.workunit.client.1.smithi154.stdout:8/971: symlink d3/d64/d6d/dbd/d127/l142 0 2024-05-06T21:26:58.452 INFO:tasks.workunit.client.1.smithi154.stdout:4/987: dwrite d0/d82/ddb/f128 [0,4194304] 0 2024-05-06T21:26:58.454 INFO:tasks.workunit.client.1.smithi154.stdout:5/971: rename d2/d3/d21/d95/dc/d68/c79 to d2/d3/d21/d95/dd/d2a/d54/dce/c147 0 2024-05-06T21:26:58.456 INFO:tasks.workunit.client.1.smithi154.stdout:8/972: mkdir d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/d143 0 2024-05-06T21:26:58.457 INFO:tasks.workunit.client.1.smithi154.stdout:8/973: truncate d3/d14/d1a/d45/dcf/db4/f112 949990 0 2024-05-06T21:26:58.459 INFO:tasks.workunit.client.1.smithi154.stdout:2/940: dwrite db/f3c [0,4194304] 0 2024-05-06T21:26:58.461 INFO:tasks.workunit.client.1.smithi154.stdout:4/988: creat d0/d82/d44/d73/d4a/dd9/d122/f143 x:0 0 0 2024-05-06T21:26:58.461 INFO:tasks.workunit.client.1.smithi154.stdout:4/989: write d0/d82/d44/d73/d4a/dd4/d1a/f8a [2292764,112776] 0 2024-05-06T21:26:58.465 INFO:tasks.workunit.client.1.smithi154.stdout:5/972: creat d2/d3/d21/d95/dd/d2a/f148 x:0 0 0 2024-05-06T21:26:58.467 INFO:tasks.workunit.client.1.smithi154.stdout:8/974: rename d3/d64/d6d/dbd/d6b/fa6 to d3/d38/f144 0 2024-05-06T21:26:58.467 INFO:tasks.workunit.client.1.smithi154.stdout:8/975: chown d3/d14/d1a/d29/d32/la2 0 1 2024-05-06T21:26:58.472 INFO:tasks.workunit.client.1.smithi154.stdout:4/990: dread d0/fa2 [0,4194304] 0 2024-05-06T21:26:58.472 INFO:tasks.workunit.client.1.smithi154.stdout:4/991: write d0/d2/f1b [1203393,31149] 0 2024-05-06T21:26:58.475 INFO:tasks.workunit.client.1.smithi154.stdout:8/976: link d3/d14/d1a/d29/d32/l37 d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/dfc/d11f/l145 0 2024-05-06T21:26:58.475 INFO:tasks.workunit.client.1.smithi154.stdout:8/977: truncate d3/d64/f12e 956903 0 2024-05-06T21:26:58.482 INFO:tasks.workunit.client.1.smithi154.stdout:4/992: write d0/d82/ddb/f128 [2849455,90873] 0 2024-05-06T21:26:58.491 INFO:tasks.workunit.client.1.smithi154.stdout:5/973: dwrite d2/d3/d21/d95/f5f [0,4194304] 0 2024-05-06T21:26:58.491 INFO:tasks.workunit.client.1.smithi154.stdout:5/974: creat d2/d48/f149 x:0 0 0 2024-05-06T21:26:58.494 INFO:tasks.workunit.client.1.smithi154.stdout:5/975: dread d2/d3/d19/d23/faf [0,4194304] 0 2024-05-06T21:26:58.499 INFO:tasks.workunit.client.1.smithi154.stdout:5/976: getdents d2/d3/d21/d95/dc/d44/dc0/de6 0 2024-05-06T21:26:58.502 INFO:tasks.workunit.client.1.smithi154.stdout:5/977: mkdir d2/d3/d21/d95/dd/d2a/d8d/d14a 0 2024-05-06T21:26:58.505 INFO:tasks.workunit.client.1.smithi154.stdout:5/978: mknod d2/d3/d21/d95/dc/d68/c14b 0 2024-05-06T21:26:58.512 INFO:tasks.workunit.client.1.smithi154.stdout:8/978: rename d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/dfc to d3/d14/d1a/d29/d32/d40/d79/d84/dbe/d130/d146 0 2024-05-06T21:26:58.515 INFO:tasks.workunit.client.1.smithi154.stdout:8/979: write d3/d14/d1a/d29/d32/d40/d79/d90/f8c [1620177,22823] 0 2024-05-06T21:26:58.515 INFO:tasks.workunit.client.1.smithi154.stdout:5/979: dread d2/d3/d21/d95/dc/d68/fc8 [0,4194304] 0 2024-05-06T21:26:58.525 INFO:tasks.workunit.client.1.smithi154.stdout:5/980: dread d2/d48/d12f/d37/f46 [0,4194304] 0 2024-05-06T21:26:58.525 INFO:tasks.workunit.client.1.smithi154.stdout:5/981: readlink d2/d3/d21/d95/dd/d2a/d54/d43/le1 0 2024-05-06T21:26:58.525 INFO:tasks.workunit.client.1.smithi154.stdout:5/982: fsync d2/d3/d21/d95/dd/f2c 0 2024-05-06T21:26:58.526 INFO:tasks.workunit.client.1.smithi154.stdout:5/983: symlink d2/d3/d21/d95/dd/l14c 0 2024-05-06T21:26:58.528 INFO:tasks.workunit.client.1.smithi154.stdout:5/984: mknod d2/d3/d8b/d112/c14d 0 2024-05-06T21:26:58.532 INFO:tasks.workunit.client.1.smithi154.stdout:5/985: dread d2/d3/d21/d95/f7 [0,4194304] 0 2024-05-06T21:26:58.532 INFO:tasks.workunit.client.1.smithi154.stdout:5/986: creat d2/d48/f14e x:0 0 0 2024-05-06T21:26:58.534 INFO:tasks.workunit.client.1.smithi154.stdout:5/987: symlink d2/d3/d8b/l14f 0 2024-05-06T21:26:58.534 INFO:tasks.workunit.client.1.smithi154.stdout:5/988: chown d2/d3/le7 1008 1 2024-05-06T21:26:58.534 INFO:tasks.workunit.client.1.smithi154.stdout:5/989: creat d2/d3/d21/d95/dc/f150 x:0 0 0 2024-05-06T21:26:58.534 INFO:tasks.workunit.client.1.smithi154.stdout:5/990: creat d2/d3/d21/d95/dd/d2a/d54/d43/d73/f151 x:0 0 0 2024-05-06T21:26:58.534 INFO:tasks.workunit.client.1.smithi154.stdout:5/991: truncate d2/d3/d21/d95/dc/d68/d69/f91 1879373 0 2024-05-06T21:26:58.535 INFO:tasks.workunit.client.1.smithi154.stdout:8/980: dwrite d3/d14/d1a/f10f [0,4194304] 0 2024-05-06T21:26:58.537 INFO:tasks.workunit.client.1.smithi154.stdout:5/992: symlink d2/d3/d19/d23/l152 0 2024-05-06T21:26:58.539 INFO:tasks.workunit.client.1.smithi154.stdout:5/993: link d2/d48/d12f/db0/f106 d2/d48/d12f/d37/f153 0 2024-05-06T21:26:58.546 INFO:tasks.workunit.client.1.smithi154.stdout:8/981: read d3/d38/df2/ff1 [223280,2487] 0 2024-05-06T21:26:58.549 INFO:tasks.workunit.client.1.smithi154.stdout:8/982: rmdir d3/d38 39 2024-05-06T21:26:58.550 INFO:tasks.workunit.client.1.smithi154.stdout:5/994: write d2/d3/d21/d95/dc/d71/f98 [2262535,77734] 0 2024-05-06T21:26:58.550 INFO:tasks.workunit.client.1.smithi154.stdout:5/995: dread - d2/d3/d21/d22/fd5 zero size 2024-05-06T21:26:58.550 INFO:tasks.workunit.client.1.smithi154.stdout:5/996: write d2/da5/fc1 [1821919,117221] 0 2024-05-06T21:26:58.552 INFO:tasks.workunit.client.1.smithi154.stdout:5/997: symlink d2/d3/d21/d22/l154 0 2024-05-06T21:26:58.552 INFO:tasks.workunit.client.1.smithi154.stdout:5/998: truncate d2/da5/f102 595181 0 2024-05-06T21:26:58.552 INFO:tasks.workunit.client.1.smithi154.stdout:5/999: fdatasync d2/d3/d19/d23/f78 0 2024-05-06T21:26:58.556 INFO:tasks.workunit.client.1.smithi154.stdout:8/983: dread d3/d64/d6d/dbd/f23 [0,4194304] 0 2024-05-06T21:26:58.556 INFO:tasks.workunit.client.1.smithi154.stdout:8/984: fdatasync d3/d14/d1a/d29/d43/fa0 0 2024-05-06T21:26:58.572 INFO:tasks.workunit.client.1.smithi154.stdout:8/985: dwrite d3/d14/d1a/d29/f74 [4194304,4194304] 0 2024-05-06T21:26:58.574 INFO:tasks.workunit.client.1.smithi154.stdout:8/986: symlink d3/d64/d6d/dbd/d6b/d120/l147 0 2024-05-06T21:26:58.574 INFO:tasks.workunit.client.1.smithi154.stdout:8/987: dread - d3/d14/d1a/d29/d32/d40/dfd/fff zero size 2024-05-06T21:26:58.574 INFO:tasks.workunit.client.1.smithi154.stdout:8/988: symlink d3/d14/d1a/d29/d32/d40/d59/l148 0 2024-05-06T21:26:58.589 INFO:tasks.workunit.client.1.smithi154.stdout:8/989: dwrite d3/d64/d6d/dbd/d61/feb [0,4194304] 0 2024-05-06T21:26:58.592 INFO:tasks.workunit.client.1.smithi154.stdout:8/990: unlink d3/d64/d6d/dbd/d6b/c132 0 2024-05-06T21:26:58.593 INFO:tasks.workunit.client.1.smithi154.stdout:8/991: mknod d3/d14/d1a/d29/d32/d40/d4b/d4d/d4a/d6f/d8d/c149 0 2024-05-06T21:26:58.594 INFO:tasks.workunit.client.1.smithi154.stdout:8/992: write d3/d14/d1a/d29/d3e/f11d [497133,26270] 0 2024-05-06T21:26:58.602 INFO:tasks.workunit.client.1.smithi154.stdout:8/993: dread d3/d14/d1a/d29/d32/d40/d79/d84/dbe/d130/d146/f115 [0,4194304] 0 2024-05-06T21:26:58.603 INFO:tasks.workunit.client.1.smithi154.stdout:8/994: creat d3/d56/f14a x:0 0 0 2024-05-06T21:26:58.603 INFO:tasks.workunit.client.1.smithi154.stdout:8/995: stat d3/d64/d6d/dbd/cb6 0 2024-05-06T21:26:58.604 INFO:tasks.workunit.client.1.smithi154.stdout:8/996: read - d3/d64/d6d/dbd/d6b/ffa zero size 2024-05-06T21:26:58.606 INFO:tasks.workunit.client.1.smithi154.stdout:8/997: mknod d3/d14/d1a/d29/d43/c14b 0 2024-05-06T21:26:58.607 INFO:tasks.workunit.client.1.smithi154.stdout:8/998: dread d3/d64/f12e [0,4194304] 0 2024-05-06T21:26:58.607 INFO:tasks.workunit.client.1.smithi154.stdout:8/999: fsync d3/d14/d1a/d29/d32/d40/d79/d2b/fd7 0 2024-05-06T21:26:59.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.061+0000 7ff088141700 1 -- 172.21.15.32:0/91423704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080100250 msgr2=0x7ff080100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.061+0000 7ff088141700 1 --2- 172.21.15.32:0/91423704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080100250 0x7ff080100660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009910 tx=0x7ff07c009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:59.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.061+0000 7ff088141700 1 -- 172.21.15.32:0/91423704 shutdown_connections 2024-05-06T21:26:59.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.061+0000 7ff088141700 1 --2- 172.21.15.32:0/91423704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff080101450 0x7ff0801018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.061+0000 7ff088141700 1 --2- 172.21.15.32:0/91423704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080100250 0x7ff080100660 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.061+0000 7ff088141700 1 -- 172.21.15.32:0/91423704 >> 172.21.15.32:0/91423704 conn(0x7ff0800fb7e0 msgr2=0x7ff0800fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:59.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.061+0000 7ff088141700 1 -- 172.21.15.32:0/91423704 shutdown_connections 2024-05-06T21:26:59.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.061+0000 7ff088141700 1 -- 172.21.15.32:0/91423704 wait complete. 2024-05-06T21:26:59.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.062+0000 7ff088141700 1 Processor -- start 2024-05-06T21:26:59.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.062+0000 7ff088141700 1 -- start start 2024-05-06T21:26:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.062+0000 7ff088141700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff080100250 0x7ff080197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.062+0000 7ff088141700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080101450 0x7ff080198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.062+0000 7ff088141700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff080198850 con 0x7ff080101450 2024-05-06T21:26:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.062+0000 7ff088141700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08019d260 con 0x7ff080100250 2024-05-06T21:26:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.062+0000 7ff0856dc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080101450 0x7ff080198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff085edd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff080100250 0x7ff080197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff0856dc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080101450 0x7ff080198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39156/0 (socket says 172.21.15.32:39156) 2024-05-06T21:26:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff0856dc700 1 -- 172.21.15.32:0/1061531588 learned_addr learned my addr 172.21.15.32:0/1061531588 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff085edd700 1 -- 172.21.15.32:0/1061531588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080101450 msgr2=0x7ff080198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff085edd700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080101450 0x7ff080198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff085edd700 1 -- 172.21.15.32:0/1061531588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c0095f0 con 0x7ff080100250 2024-05-06T21:26:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff0856dc700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080101450 0x7ff080198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:26:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff085edd700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff080100250 0x7ff080197cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff07c000c00 tx=0x7ff07c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff076ffd700 1 -- 172.21.15.32:0/1061531588 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07c01d070 con 0x7ff080100250 2024-05-06T21:26:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff076ffd700 1 -- 172.21.15.32:0/1061531588 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff07c005dc0 con 0x7ff080100250 2024-05-06T21:26:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08019d400 con 0x7ff080100250 2024-05-06T21:26:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff076ffd700 1 -- 172.21.15.32:0/1061531588 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07c017400 con 0x7ff080100250 2024-05-06T21:26:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.063+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08019d8c0 con 0x7ff080100250 2024-05-06T21:26:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.064+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff080105530 con 0x7ff080100250 2024-05-06T21:26:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.066+0000 7ff076ffd700 1 -- 172.21.15.32:0/1061531588 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7ff07c003810 con 0x7ff080100250 2024-05-06T21:26:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.066+0000 7ff076ffd700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ff06c06d3c0 0x7ff06c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.066+0000 7ff076ffd700 1 -- 172.21.15.32:0/1061531588 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff07c08db50 con 0x7ff080100250 2024-05-06T21:26:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.067+0000 7ff0856dc700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ff06c06d3c0 0x7ff06c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:59.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.067+0000 7ff0856dc700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ff06c06d3c0 0x7ff06c06f870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff070011550 tx=0x7ff070009260 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:59.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.071+0000 7ff076ffd700 1 -- 172.21.15.32:0/1061531588 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7ff07c057290 con 0x7ff080100250 2024-05-06T21:26:59.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:58 smithi032 ceph-mon[27179]: Upgrade: Updating mgr.smithi032.ecoohh 2024-05-06T21:26:59.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:58 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:59.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:58 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi032.ecoohh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:26:59.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:58 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi032.ecoohh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:26:59.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:58 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:26:59.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:58 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:26:59.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:58 smithi032 ceph-mon[27179]: Deploying daemon mgr.smithi032.ecoohh on smithi032 2024-05-06T21:26:59.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:58 smithi032 ceph-mon[27179]: pgmap v30: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 281 MiB/s rd, 329 MiB/s wr, 472 op/s 2024-05-06T21:26:59.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:58 smithi154 ceph-mon[32880]: Upgrade: Updating mgr.smithi032.ecoohh 2024-05-06T21:26:59.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:58 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:26:59.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:58 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi032.ecoohh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:26:59.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:58 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi032.ecoohh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:26:59.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:58 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:26:59.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:58 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:26:59.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:58 smithi154 ceph-mon[32880]: Deploying daemon mgr.smithi032.ecoohh on smithi032 2024-05-06T21:26:59.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:58 smithi154 ceph-mon[32880]: pgmap v30: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 281 MiB/s rd, 329 MiB/s wr, 472 op/s 2024-05-06T21:26:59.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.408+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 --> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff080061190 con 0x7ff06c06d3c0 2024-05-06T21:26:59.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.409+0000 7ff076ffd700 1 -- 172.21.15.32:0/1061531588 <== mgr.24395 v2:172.21.15.154:6828/2671631515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7ff080061190 con 0x7ff06c06d3c0 2024-05-06T21:26:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ff06c06d3c0 msgr2=0x7ff06c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ff06c06d3c0 0x7ff06c06f870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff070011550 tx=0x7ff070009260 comp rx=0 tx=0).stop 2024-05-06T21:26:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff080100250 msgr2=0x7ff080197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff080100250 0x7ff080197cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff07c000c00 tx=0x7ff07c00f690 comp rx=0 tx=0).stop 2024-05-06T21:26:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 shutdown_connections 2024-05-06T21:26:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7ff06c06d3c0 0x7ff06c06f870 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff080100250 0x7ff080197cf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 --2- 172.21.15.32:0/1061531588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff080101450 0x7ff080198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 >> 172.21.15.32:0/1061531588 conn(0x7ff0800fb7e0 msgr2=0x7ff080102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:59.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 shutdown_connections 2024-05-06T21:26:59.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.413+0000 7ff088141700 1 -- 172.21.15.32:0/1061531588 wait complete. 2024-05-06T21:26:59.430 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:26:59.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.553+0000 7f88ba8a4700 1 -- 172.21.15.32:0/4038480791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b41003d0 msgr2=0x7f88b4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.553+0000 7f88ba8a4700 1 --2- 172.21.15.32:0/4038480791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b41003d0 0x7f88b4100840 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009910 tx=0x7f88a8009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:59.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.553+0000 7f88ba8a4700 1 -- 172.21.15.32:0/4038480791 shutdown_connections 2024-05-06T21:26:59.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.553+0000 7f88ba8a4700 1 --2- 172.21.15.32:0/4038480791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b41003d0 0x7f88b4100840 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.553+0000 7f88ba8a4700 1 --2- 172.21.15.32:0/4038480791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b40ff130 0x7f88b40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.553+0000 7f88ba8a4700 1 -- 172.21.15.32:0/4038480791 >> 172.21.15.32:0/4038480791 conn(0x7f88b40fa780 msgr2=0x7f88b40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:59.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.553+0000 7f88ba8a4700 1 -- 172.21.15.32:0/4038480791 shutdown_connections 2024-05-06T21:26:59.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.553+0000 7f88ba8a4700 1 -- 172.21.15.32:0/4038480791 wait complete. 2024-05-06T21:26:59.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.554+0000 7f88ba8a4700 1 Processor -- start 2024-05-06T21:26:59.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.554+0000 7f88ba8a4700 1 -- start start 2024-05-06T21:26:59.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.554+0000 7f88ba8a4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:59.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.554+0000 7f88ba8a4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b41003d0 0x7f88b419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:59.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.554+0000 7f88ba8a4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b419ad80 con 0x7f88b40ff130 2024-05-06T21:26:59.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.554+0000 7f88ba8a4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b419aec0 con 0x7f88b41003d0 2024-05-06T21:26:59.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.554+0000 7f88b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:59.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.554+0000 7f88b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39170/0 (socket says 172.21.15.32:39170) 2024-05-06T21:26:59.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.555+0000 7f88b3fff700 1 -- 172.21.15.32:0/2517543376 learned_addr learned my addr 172.21.15.32:0/2517543376 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:59.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.554+0000 7f88b37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b41003d0 0x7f88b419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:59.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.555+0000 7f88b37fe700 1 -- 172.21.15.32:0/2517543376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b40ff130 msgr2=0x7f88b4069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.555+0000 7f88b37fe700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.555+0000 7f88b37fe700 1 -- 172.21.15.32:0/2517543376 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80095f0 con 0x7f88b41003d0 2024-05-06T21:26:59.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.555+0000 7f88b3fff700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:26:59.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.555+0000 7f88b37fe700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b41003d0 0x7f88b419a760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009910 tx=0x7f88a800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:59.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.555+0000 7f88b17fa700 1 -- 172.21.15.32:0/2517543376 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a801d070 con 0x7f88b41003d0 2024-05-06T21:26:59.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.555+0000 7f88b17fa700 1 -- 172.21.15.32:0/2517543376 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f88a8005dc0 con 0x7f88b41003d0 2024-05-06T21:26:59.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.556+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b419b140 con 0x7f88b41003d0 2024-05-06T21:26:59.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.556+0000 7f88b17fa700 1 -- 172.21.15.32:0/2517543376 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a8017400 con 0x7f88b41003d0 2024-05-06T21:26:59.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.556+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b419b630 con 0x7f88b41003d0 2024-05-06T21:26:59.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.557+0000 7f88b17fa700 1 -- 172.21.15.32:0/2517543376 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f88a800fac0 con 0x7f88b41003d0 2024-05-06T21:26:59.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.557+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b4107c10 con 0x7f88b41003d0 2024-05-06T21:26:59.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.558+0000 7f88b17fa700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f889c06d3b0 0x7f889c06f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:59.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.558+0000 7f88b17fa700 1 -- 172.21.15.32:0/2517543376 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f88a808df40 con 0x7f88b41003d0 2024-05-06T21:26:59.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.558+0000 7f88b3fff700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f889c06d3b0 0x7f889c06f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:59.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.559+0000 7f88b3fff700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f889c06d3b0 0x7f889c06f860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f88a4011550 tx=0x7f88a4009260 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:59.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.562+0000 7f88b17fa700 1 -- 172.21.15.32:0/2517543376 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f88a80c2470 con 0x7f88b41003d0 2024-05-06T21:26:59.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.843+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 --> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88b4104d20 con 0x7f889c06d3b0 2024-05-06T21:26:59.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.847+0000 7f88b17fa700 1 -- 172.21.15.32:0/2517543376 <== mgr.24395 v2:172.21.15.154:6828/2671631515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f88b4104d20 con 0x7f889c06d3b0 2024-05-06T21:26:59.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.852+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f889c06d3b0 msgr2=0x7f889c06f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.852+0000 7f88ba8a4700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f889c06d3b0 0x7f889c06f860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f88a4011550 tx=0x7f88a4009260 comp rx=0 tx=0).stop 2024-05-06T21:26:59.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.852+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b41003d0 msgr2=0x7f88b419a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.852+0000 7f88ba8a4700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b41003d0 0x7f88b419a760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009910 tx=0x7f88a800f690 comp rx=0 tx=0).stop 2024-05-06T21:26:59.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.853+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 shutdown_connections 2024-05-06T21:26:59.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.853+0000 7f88ba8a4700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f889c06d3b0 0x7f889c06f860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.853+0000 7f88ba8a4700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.853+0000 7f88ba8a4700 1 --2- 172.21.15.32:0/2517543376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b41003d0 0x7f88b419a760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.853+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 >> 172.21.15.32:0/2517543376 conn(0x7f88b40fa780 msgr2=0x7f88b4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:59.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.854+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 shutdown_connections 2024-05-06T21:26:59.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.854+0000 7f88ba8a4700 1 -- 172.21.15.32:0/2517543376 wait complete. 2024-05-06T21:26:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.987+0000 7fd061f20700 1 -- 172.21.15.32:0/839608301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c1003d0 msgr2=0x7fd05c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.987+0000 7fd061f20700 1 --2- 172.21.15.32:0/839608301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c1003d0 0x7fd05c100840 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd050009910 tx=0x7fd050009c20 comp rx=0 tx=0).stop 2024-05-06T21:26:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.987+0000 7fd061f20700 1 -- 172.21.15.32:0/839608301 shutdown_connections 2024-05-06T21:26:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.987+0000 7fd061f20700 1 --2- 172.21.15.32:0/839608301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c1003d0 0x7fd05c100840 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.987+0000 7fd061f20700 1 --2- 172.21.15.32:0/839608301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05c0ff130 0x7fd05c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.987+0000 7fd061f20700 1 -- 172.21.15.32:0/839608301 >> 172.21.15.32:0/839608301 conn(0x7fd05c0fa780 msgr2=0x7fd05c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.987+0000 7fd061f20700 1 -- 172.21.15.32:0/839608301 shutdown_connections 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.987+0000 7fd061f20700 1 -- 172.21.15.32:0/839608301 wait complete. 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd061f20700 1 Processor -- start 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd061f20700 1 -- start start 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd061f20700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c0ff130 0x7fd05c194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd061f20700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05c1003d0 0x7fd05c194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd061f20700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c1954c0 con 0x7fd05c0ff130 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd061f20700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c195600 con 0x7fd05c1003d0 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd05b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c0ff130 0x7fd05c194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd05b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c0ff130 0x7fd05c194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39196/0 (socket says 172.21.15.32:39196) 2024-05-06T21:26:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd05b7fe700 1 -- 172.21.15.32:0/2708186277 learned_addr learned my addr 172.21.15.32:0/2708186277 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:26:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.988+0000 7fd05affd700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05c1003d0 0x7fd05c194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.989+0000 7fd05b7fe700 1 -- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05c1003d0 msgr2=0x7fd05c194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.989+0000 7fd05b7fe700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05c1003d0 0x7fd05c194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.989+0000 7fd05b7fe700 1 -- 172.21.15.32:0/2708186277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0500095f0 con 0x7fd05c0ff130 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.989+0000 7fd05b7fe700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c0ff130 0x7fd05c194960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd04c007910 tx=0x7fd04c007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.989+0000 7fd058ff9700 1 -- 172.21.15.32:0/2708186277 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd04c012070 con 0x7fd05c0ff130 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.989+0000 7fd058ff9700 1 -- 172.21.15.32:0/2708186277 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd04c007e60 con 0x7fd05c0ff130 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.989+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c0685a0 con 0x7fd05c0ff130 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.989+0000 7fd058ff9700 1 -- 172.21.15.32:0/2708186277 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd04c0054c0 con 0x7fd05c0ff130 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.989+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c068af0 con 0x7fd05c0ff130 2024-05-06T21:26:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.991+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c107c10 con 0x7fd05c0ff130 2024-05-06T21:26:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.991+0000 7fd058ff9700 1 -- 172.21.15.32:0/2708186277 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7fd04c016070 con 0x7fd05c0ff130 2024-05-06T21:26:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.992+0000 7fd058ff9700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fd04406d410 0x7fd04406f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:26:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.992+0000 7fd05affd700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fd04406d410 0x7fd04406f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:26:59.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.992+0000 7fd058ff9700 1 -- 172.21.15.32:0/2708186277 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd04c08df30 con 0x7fd05c0ff130 2024-05-06T21:26:59.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.993+0000 7fd05affd700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fd04406d410 0x7fd04406f8c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd05000b5c0 tx=0x7fd050005ee0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:26:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:26:59.996+0000 7fd058ff9700 1 -- 172.21.15.32:0/2708186277 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7fd04c05b1b0 con 0x7fd05c0ff130 2024-05-06T21:27:00.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:59 smithi032 ceph-mon[27179]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:00.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:26:59 smithi032 ceph-mon[27179]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:00.241 INFO:tasks.workunit.client.1.smithi154.stdout:1/929: sync 2024-05-06T21:27:00.242 INFO:tasks.workunit.client.1.smithi154.stdout:4/993: sync 2024-05-06T21:27:00.242 INFO:tasks.workunit.client.1.smithi154.stdout:6/837: sync 2024-05-06T21:27:00.242 INFO:tasks.workunit.client.1.smithi154.stdout:2/941: sync 2024-05-06T21:27:00.243 INFO:tasks.workunit.client.1.smithi154.stdout:1/930: rename d6/db/d10/d26/d1b/lf7 to d6/db/d69/l117 0 2024-05-06T21:27:00.245 INFO:tasks.workunit.client.1.smithi154.stdout:2/942: truncate db/d12/d19/d7d/ff8 451944 0 2024-05-06T21:27:00.245 INFO:tasks.workunit.client.1.smithi154.stdout:6/838: truncate d8/d11/d2d/f47 588203 0 2024-05-06T21:27:00.248 INFO:tasks.workunit.client.1.smithi154.stdout:4/994: creat d0/d82/d39/f144 x:0 0 0 2024-05-06T21:27:00.252 INFO:tasks.workunit.client.1.smithi154.stdout:2/943: creat db/d12/d19/d4b/d78/de8/d127/f13e x:0 0 0 2024-05-06T21:27:00.255 INFO:tasks.workunit.client.1.smithi154.stdout:4/995: mkdir d0/d82/d39/d145 0 2024-05-06T21:27:00.256 INFO:tasks.workunit.client.1.smithi154.stdout:4/996: dread - d0/d82/d44/fdf zero size 2024-05-06T21:27:00.257 INFO:tasks.workunit.client.1.smithi154.stdout:2/944: mkdir db/d12/d1d/d60/d13f 0 2024-05-06T21:27:00.261 INFO:tasks.workunit.client.1.smithi154.stdout:1/931: dwrite d6/f52 [4194304,4194304] 0 2024-05-06T21:27:00.263 INFO:tasks.workunit.client.1.smithi154.stdout:2/945: mknod db/de/d16/d4f/c140 0 2024-05-06T21:27:00.263 INFO:tasks.workunit.client.1.smithi154.stdout:2/946: fdatasync db/fab 0 2024-05-06T21:27:00.265 INFO:tasks.workunit.client.1.smithi154.stdout:6/839: rename d8/d11/d8d to d8/d11/d2d/d3d/d70/d7b/d102 0 2024-05-06T21:27:00.265 INFO:tasks.workunit.client.1.smithi154.stdout:6/840: stat d8/d11/d2d/d3d/d70/l7c 0 2024-05-06T21:27:00.269 INFO:tasks.workunit.client.1.smithi154.stdout:4/997: mknod d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/dbb/dee/c146 0 2024-05-06T21:27:00.270 INFO:tasks.workunit.client.1.smithi154.stdout:4/998: read - d0/d2/d47/d81/fdd zero size 2024-05-06T21:27:00.271 INFO:tasks.workunit.client.1.smithi154.stdout:1/932: rename d6/db/d69/d89/cd7 to d6/d3e/d7e/da5/da8/d109/c118 0 2024-05-06T21:27:00.274 INFO:tasks.workunit.client.1.smithi154.stdout:6/841: stat d8/d11/c21 0 2024-05-06T21:27:00.277 INFO:tasks.workunit.client.1.smithi154.stdout:4/999: mkdir d0/d82/d44/d73/d4a/dd4/d1a/dd2/d126/d76/dbb/dee/d147 0 2024-05-06T21:27:00.278 INFO:tasks.workunit.client.1.smithi154.stdout:2/947: getdents db/de/d10 0 2024-05-06T21:27:00.278 INFO:tasks.workunit.client.1.smithi154.stdout:1/933: getdents d6/db/d10/d26/d1b 0 2024-05-06T21:27:00.279 INFO:tasks.workunit.client.1.smithi154.stdout:6/842: truncate d8/d7e/f83 784680 0 2024-05-06T21:27:00.279 INFO:tasks.workunit.client.1.smithi154.stdout:6/843: getdents d8/d7e 0 2024-05-06T21:27:00.280 INFO:tasks.workunit.client.1.smithi154.stdout:2/948: rename db/d12/dbf/f131 to db/d12/d1d/d60/f141 0 2024-05-06T21:27:00.281 INFO:tasks.workunit.client.1.smithi154.stdout:6/844: getdents d8/d11/d2d/d3d/d70 0 2024-05-06T21:27:00.286 INFO:tasks.workunit.client.1.smithi154.stdout:6/845: creat d8/d11/d33/d92/f103 x:0 0 0 2024-05-06T21:27:00.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.288+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 --> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd05c104d20 con 0x7fd04406d410 2024-05-06T21:27:00.297 INFO:tasks.workunit.client.1.smithi154.stdout:2/949: dwrite db/de/d10/f87 [0,4194304] 0 2024-05-06T21:27:00.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.305+0000 7fd058ff9700 1 -- 172.21.15.32:0/2708186277 <== mgr.24395 v2:172.21.15.154:6828/2671631515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd05c104d20 con 0x7fd04406d410 2024-05-06T21:27:00.307 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:27:00.307 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (7m) 38s ago 8m 24.6M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:27:00.307 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (8m) 38s ago 8m 7578k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:27:00.307 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (7m) 33s ago 7m 7512k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:27:00.307 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (8m) 38s ago 8m 6665k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:27:00.307 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (7m) 33s ago 7m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:27:00.307 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (7m) 38s ago 8m 88.7M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (3m) 38s ago 3m 13.0M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (2m) 38s ago 2m 119M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (3m) 33s ago 3m 23.1M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (2m) 33s ago 2m 14.5M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:9283,8765,8443 running (10m) 38s ago 10m 322M - 18.2.0 dc2bc1663786 7711cd2179ff 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (66s) 33s ago 7m 488M - 19.0.0-2497-gf273489c 3b8ac54a9a71 49af90f5d83c 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (10m) 38s ago 10m 48.4M 2048M 18.2.0 dc2bc1663786 b06a214f4520 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (7m) 33s ago 7m 39.6M 2048M 18.2.0 dc2bc1663786 8a37ef7f53f9 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (8m) 38s ago 8m 15.8M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (7m) 33s ago 7m 17.0M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (6m) 38s ago 6m 84.9M 1217M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (6m) 38s ago 6m 74.7M 1217M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:27:00.308 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (5m) 38s ago 5m 71.7M 1217M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:27:00.309 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (5m) 33s ago 5m 78.5M 2240M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:27:00.309 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (5m) 33s ago 5m 72.5M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:27:00.309 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (4m) 33s ago 4m 73.9M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:27:00.309 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 starting - - - - 2024-05-06T21:27:00.309 INFO:tasks.workunit.client.1.smithi154.stdout:6/846: dwrite d8/d11/d2d/d3d/d70/f80 [0,4194304] 0 2024-05-06T21:27:00.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.309+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fd04406d410 msgr2=0x7fd04406f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:00.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.309+0000 7fd061f20700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fd04406d410 0x7fd04406f8c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd05000b5c0 tx=0x7fd050005ee0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.309+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c0ff130 msgr2=0x7fd05c194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:00.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.309+0000 7fd061f20700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c0ff130 0x7fd05c194960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd04c007910 tx=0x7fd04c007c20 comp rx=0 tx=0).stop 2024-05-06T21:27:00.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.309+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 shutdown_connections 2024-05-06T21:27:00.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.309+0000 7fd061f20700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7fd04406d410 0x7fd04406f8c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.309+0000 7fd061f20700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd05c0ff130 0x7fd05c194960 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.309+0000 7fd061f20700 1 --2- 172.21.15.32:0/2708186277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05c1003d0 0x7fd05c194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.309+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 >> 172.21.15.32:0/2708186277 conn(0x7fd05c0fa780 msgr2=0x7fd05c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:00.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.310+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 shutdown_connections 2024-05-06T21:27:00.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.310+0000 7fd061f20700 1 -- 172.21.15.32:0/2708186277 wait complete. 2024-05-06T21:27:00.312 INFO:tasks.workunit.client.1.smithi154.stdout:6/847: creat d8/d11/d2d/d3d/d70/d7b/d102/daa/f104 x:0 0 0 2024-05-06T21:27:00.315 INFO:tasks.workunit.client.1.smithi154.stdout:2/950: dwrite db/de/d6f/f93 [0,4194304] 0 2024-05-06T21:27:00.315 INFO:tasks.workunit.client.1.smithi154.stdout:2/951: chown db 620064628 1 2024-05-06T21:27:00.336 INFO:tasks.workunit.client.1.smithi154.stdout:6/848: dwrite d8/d11/f67 [0,4194304] 0 2024-05-06T21:27:00.336 INFO:tasks.workunit.client.1.smithi154.stdout:2/952: dwrite db/d12/d1d/d60/d63/d117/f13c [0,4194304] 0 2024-05-06T21:27:00.347 INFO:tasks.workunit.client.1.smithi154.stdout:6/849: rename d8/d11/d2d/d3d/d70/d7b/d102/daa/f104 to d8/d13/d20/daf/dd1/df0/f105 0 2024-05-06T21:27:00.348 INFO:tasks.workunit.client.1.smithi154.stdout:2/953: readlink db/d12/d1d/d83/lb5 0 2024-05-06T21:27:00.349 INFO:tasks.workunit.client.1.smithi154.stdout:2/954: dread db/d12/d19/d4b/fbe [0,4194304] 0 2024-05-06T21:27:00.350 INFO:tasks.workunit.client.1.smithi154.stdout:6/850: getdents d8/d11/d33/d4a/d6c 0 2024-05-06T21:27:00.350 INFO:tasks.workunit.client.1.smithi154.stdout:6/851: write d8/d13/d20/f65 [1511794,30006] 0 2024-05-06T21:27:00.350 INFO:tasks.workunit.client.1.smithi154.stdout:2/955: getdents db/d12/d19/d4b/db2/dca 0 2024-05-06T21:27:00.352 INFO:tasks.workunit.client.1.smithi154.stdout:6/852: link d8/d11/d33/d4a/l89 d8/d13/da9/l106 0 2024-05-06T21:27:00.352 INFO:tasks.workunit.client.1.smithi154.stdout:6/853: write d8/d11/d2d/d3d/d70/d7b/f81 [4922578,84525] 0 2024-05-06T21:27:00.355 INFO:tasks.workunit.client.1.smithi154.stdout:6/854: link d8/d11/d2d/led d8/d11/d2d/d3d/d70/d7b/d95/l107 0 2024-05-06T21:27:00.357 INFO:tasks.workunit.client.1.smithi154.stdout:6/855: creat d8/d11/d2d/d3d/d70/d7b/f108 x:0 0 0 2024-05-06T21:27:00.359 INFO:tasks.workunit.client.1.smithi154.stdout:6/856: rename d8/d11/d2d/d3d/d4c/dba/dcd to d8/d13/d20/d109 0 2024-05-06T21:27:00.361 INFO:tasks.workunit.client.1.smithi154.stdout:6/857: rename d8/d13/d8f/le1 to d8/d11/d2d/d3d/l10a 0 2024-05-06T21:27:00.361 INFO:tasks.workunit.client.1.smithi154.stdout:2/956: dread db/de/d16/d4f/f8f [0,4194304] 0 2024-05-06T21:27:00.362 INFO:tasks.workunit.client.1.smithi154.stdout:6/858: mkdir d8/d13/d8f/d10b 0 2024-05-06T21:27:00.362 INFO:tasks.workunit.client.1.smithi154.stdout:2/957: dread db/de/d16/f1f [0,4194304] 0 2024-05-06T21:27:00.364 INFO:tasks.workunit.client.1.smithi154.stdout:2/958: getdents db/de/d10/dbc/ded 0 2024-05-06T21:27:00.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:59 smithi154 ceph-mon[32880]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:00.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:26:59 smithi154 ceph-mon[32880]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:00.373 INFO:tasks.workunit.client.1.smithi154.stdout:2/959: write db/de/d6f/f93 [2672296,85614] 0 2024-05-06T21:27:00.373 INFO:tasks.workunit.client.1.smithi154.stdout:2/960: stat db/d12/d19/d81/c9b 0 2024-05-06T21:27:00.375 INFO:tasks.workunit.client.1.smithi154.stdout:2/961: dread db/d12/f37 [0,4194304] 0 2024-05-06T21:27:00.376 INFO:tasks.workunit.client.1.smithi154.stdout:2/962: write db/d12/d1d/f64 [4988793,33624] 0 2024-05-06T21:27:00.377 INFO:tasks.workunit.client.1.smithi154.stdout:2/963: fdatasync db/de/d16/f28 0 2024-05-06T21:27:00.377 INFO:tasks.workunit.client.1.smithi154.stdout:2/964: write db/de/d16/d33/f44 [1929907,39552] 0 2024-05-06T21:27:00.386 INFO:tasks.workunit.client.1.smithi154.stdout:2/965: dread db/de/d10/f25 [0,4194304] 0 2024-05-06T21:27:00.400 INFO:tasks.workunit.client.1.smithi154.stdout:2/966: dwrite db/de/f136 [0,4194304] 0 2024-05-06T21:27:00.419 INFO:tasks.workunit.client.1.smithi154.stdout:2/967: dwrite db/d12/d19/d7d/fe6 [0,4194304] 0 2024-05-06T21:27:00.420 INFO:tasks.workunit.client.1.smithi154.stdout:2/968: read db/de/d10/d18/fd6 [4425,83955] 0 2024-05-06T21:27:00.420 INFO:tasks.workunit.client.1.smithi154.stdout:2/969: creat db/d12/d4e/f142 x:0 0 0 2024-05-06T21:27:00.422 INFO:tasks.workunit.client.1.smithi154.stdout:2/970: dread db/d12/d19/d7d/fba [0,4194304] 0 2024-05-06T21:27:00.422 INFO:tasks.workunit.client.1.smithi154.stdout:2/971: symlink db/d12/d19/d4b/db2/l143 0 2024-05-06T21:27:00.423 INFO:tasks.workunit.client.1.smithi154.stdout:2/972: mknod db/d12/d19/d4b/c144 0 2024-05-06T21:27:00.423 INFO:tasks.workunit.client.1.smithi154.stdout:2/973: chown db/d12/d19/c35 2035682 1 2024-05-06T21:27:00.424 INFO:tasks.workunit.client.1.smithi154.stdout:2/974: mknod db/d12/d19/d7d/c145 0 2024-05-06T21:27:00.429 INFO:tasks.workunit.client.1.smithi154.stdout:7/818: mkdir d6/d42/d106/d6e/d21/de5/d10c 0 2024-05-06T21:27:00.431 INFO:tasks.workunit.client.1.smithi154.stdout:7/819: mknod d6/d54/d5b/dc5/c10d 0 2024-05-06T21:27:00.435 INFO:tasks.workunit.client.1.smithi154.stdout:7/820: creat d6/d42/d106/d6e/d21/d2e/d9d/f10e x:0 0 0 2024-05-06T21:27:00.441 INFO:tasks.workunit.client.1.smithi154.stdout:2/975: dwrite db/d12/f37 [0,4194304] 0 2024-05-06T21:27:00.444 INFO:tasks.workunit.client.1.smithi154.stdout:7/821: dread d6/d20/d40/d52/f91 [0,4194304] 0 2024-05-06T21:27:00.444 INFO:tasks.workunit.client.1.smithi154.stdout:7/822: truncate d6/f9 5096678 0 2024-05-06T21:27:00.444 INFO:tasks.workunit.client.1.smithi154.stdout:7/823: stat d6/d42/d106/d6e/d21/d69/ddd/f105 0 2024-05-06T21:27:00.451 INFO:tasks.workunit.client.1.smithi154.stdout:7/824: getdents d6/d54/d5b/dc5 0 2024-05-06T21:27:00.451 INFO:tasks.workunit.client.1.smithi154.stdout:7/825: readlink d6/d42/d106/d6e/d5e/ldf 0 2024-05-06T21:27:00.453 INFO:tasks.workunit.client.1.smithi154.stdout:7/826: symlink d6/d42/dd1/l10f 0 2024-05-06T21:27:00.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.457+0000 7f52f75b9700 1 -- 172.21.15.32:0/3375848864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f0100350 msgr2=0x7f52f01007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:00.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.457+0000 7f52f75b9700 1 --2- 172.21.15.32:0/3375848864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f0100350 0x7f52f01007a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009910 tx=0x7f52e0009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:00.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.457+0000 7f52f75b9700 1 -- 172.21.15.32:0/3375848864 shutdown_connections 2024-05-06T21:27:00.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.457+0000 7f52f75b9700 1 --2- 172.21.15.32:0/3375848864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f0100350 0x7f52f01007a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.457+0000 7f52f75b9700 1 --2- 172.21.15.32:0/3375848864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f00ff150 0x7f52f00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.457+0000 7f52f75b9700 1 -- 172.21.15.32:0/3375848864 >> 172.21.15.32:0/3375848864 conn(0x7f52f00fa700 msgr2=0x7f52f00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:00.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.457+0000 7f52f75b9700 1 -- 172.21.15.32:0/3375848864 shutdown_connections 2024-05-06T21:27:00.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.457+0000 7f52f75b9700 1 -- 172.21.15.32:0/3375848864 wait complete. 2024-05-06T21:27:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.457+0000 7f52f75b9700 1 Processor -- start 2024-05-06T21:27:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f75b9700 1 -- start start 2024-05-06T21:27:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f75b9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f00ff150 0x7f52f0069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f75b9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f0100350 0x7f52f019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f75b9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f019adc0 con 0x7f52f00ff150 2024-05-06T21:27:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f75b9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f019af00 con 0x7f52f0100350 2024-05-06T21:27:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f5355700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f00ff150 0x7f52f0069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f5355700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f00ff150 0x7f52f0069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39206/0 (socket says 172.21.15.32:39206) 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f5355700 1 -- 172.21.15.32:0/2642214661 learned_addr learned my addr 172.21.15.32:0/2642214661 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f4b54700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f0100350 0x7f52f019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f5355700 1 -- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f0100350 msgr2=0x7f52f019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f5355700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f0100350 0x7f52f019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f5355700 1 -- 172.21.15.32:0/2642214661 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e00095f0 con 0x7f52f00ff150 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.458+0000 7f52f5355700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f00ff150 0x7f52f0069990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00d900 tx=0x7f52ec00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.459+0000 7f52e67fc700 1 -- 172.21.15.32:0/2642214661 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ec0041f0 con 0x7f52f00ff150 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.459+0000 7f52e67fc700 1 -- 172.21.15.32:0/2642214661 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52ec004350 con 0x7f52f00ff150 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.459+0000 7f52e67fc700 1 -- 172.21.15.32:0/2642214661 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ec003d20 con 0x7f52f00ff150 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.459+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f019b1e0 con 0x7f52f00ff150 2024-05-06T21:27:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.459+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f019b730 con 0x7f52f00ff150 2024-05-06T21:27:00.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.460+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f0107ca0 con 0x7f52f00ff150 2024-05-06T21:27:00.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.461+0000 7f52e67fc700 1 -- 172.21.15.32:0/2642214661 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f52ec009730 con 0x7f52f00ff150 2024-05-06T21:27:00.463 INFO:tasks.workunit.client.1.smithi154.stdout:7/827: rmdir d6/d54/d5b 39 2024-05-06T21:27:00.463 INFO:tasks.workunit.client.1.smithi154.stdout:2/976: dwrite db/de/d10/f67 [4194304,4194304] 0 2024-05-06T21:27:00.463 INFO:tasks.workunit.client.1.smithi154.stdout:7/828: creat d6/d42/d106/d6e/d21/d2e/f110 x:0 0 0 2024-05-06T21:27:00.463 INFO:tasks.workunit.client.1.smithi154.stdout:7/829: fdatasync d6/d20/d40/f50 0 2024-05-06T21:27:00.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.461+0000 7f52e67fc700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f52dc06d3c0 0x7f52dc06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:00.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.462+0000 7f52e67fc700 1 -- 172.21.15.32:0/2642214661 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f52ec08cad0 con 0x7f52f00ff150 2024-05-06T21:27:00.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.462+0000 7f52f4b54700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f52dc06d3c0 0x7f52dc06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:00.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.463+0000 7f52f4b54700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f52dc06d3c0 0x7f52dc06f870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f52e0006010 tx=0x7f52e000b540 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:00.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.468+0000 7f52e67fc700 1 -- 172.21.15.32:0/2642214661 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f52ec059dc0 con 0x7f52f00ff150 2024-05-06T21:27:00.469 INFO:tasks.workunit.client.1.smithi154.stdout:2/977: dread db/d12/d19/d81/f100 [0,4194304] 0 2024-05-06T21:27:00.474 INFO:tasks.workunit.client.1.smithi154.stdout:2/978: creat db/d12/d1d/dcc/f146 x:0 0 0 2024-05-06T21:27:00.475 INFO:tasks.workunit.client.1.smithi154.stdout:2/979: readlink db/d12/d1d/d60/d63/de2/le3 0 2024-05-06T21:27:00.475 INFO:tasks.workunit.client.1.smithi154.stdout:2/980: creat db/de/d10/dbc/ded/f147 x:0 0 0 2024-05-06T21:27:00.475 INFO:tasks.workunit.client.1.smithi154.stdout:2/981: write db/de/d16/d33/f90 [607696,25794] 0 2024-05-06T21:27:00.475 INFO:tasks.workunit.client.1.smithi154.stdout:2/982: unlink db/d12/d19/d81/c9b 0 2024-05-06T21:27:00.475 INFO:tasks.workunit.client.1.smithi154.stdout:2/983: fsync db/d12/d4e/f142 0 2024-05-06T21:27:00.475 INFO:tasks.workunit.client.1.smithi154.stdout:2/984: truncate db/d12/d19/d7d/ffd 762604 0 2024-05-06T21:27:00.475 INFO:tasks.workunit.client.1.smithi154.stdout:2/985: write db/d12/d19/d7d/ffd [490564,34155] 0 2024-05-06T21:27:00.475 INFO:tasks.workunit.client.1.smithi154.stdout:2/986: write db/d12/d19/d4b/f75 [231692,115492] 0 2024-05-06T21:27:00.484 INFO:tasks.workunit.client.1.smithi154.stdout:2/987: dread db/de/d10/f67 [4194304,4194304] 0 2024-05-06T21:27:00.485 INFO:tasks.workunit.client.1.smithi154.stdout:2/988: mknod db/d12/d4e/d55/d116/c148 0 2024-05-06T21:27:00.486 INFO:tasks.workunit.client.1.smithi154.stdout:2/989: fdatasync db/d12/d1d/f47 0 2024-05-06T21:27:00.487 INFO:tasks.workunit.client.1.smithi154.stdout:2/990: creat db/d12/d1d/d60/d13f/f149 x:0 0 0 2024-05-06T21:27:00.503 INFO:tasks.workunit.client.1.smithi154.stdout:2/991: dwrite db/de/d6f/f11f [0,4194304] 0 2024-05-06T21:27:00.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.798+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f52f019be20 con 0x7f52f00ff150 2024-05-06T21:27:00.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.799+0000 7f52e67fc700 1 -- 172.21.15.32:0/2642214661 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f52ec059950 con 0x7f52f00ff150 2024-05-06T21:27:00.800 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:27:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:27:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:27:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:27:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:27:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-05-06T21:27:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 1 2024-05-06T21:27:00.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 1 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:27:00.801 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:27:00.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f52dc06d3c0 msgr2=0x7f52dc06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f52dc06d3c0 0x7f52dc06f870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f52e0006010 tx=0x7f52e000b540 comp rx=0 tx=0).stop 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f00ff150 msgr2=0x7f52f0069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f00ff150 0x7f52f0069990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00d900 tx=0x7f52ec00dc10 comp rx=0 tx=0).stop 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 shutdown_connections 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f52dc06d3c0 0x7f52dc06f870 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52f00ff150 0x7f52f0069990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 --2- 172.21.15.32:0/2642214661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f0100350 0x7f52f019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 >> 172.21.15.32:0/2642214661 conn(0x7f52f00fa700 msgr2=0x7f52f0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 shutdown_connections 2024-05-06T21:27:00.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.801+0000 7f52f75b9700 1 -- 172.21.15.32:0/2642214661 wait complete. 2024-05-06T21:27:00.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.942+0000 7f3b74813700 1 -- 172.21.15.32:0/1634986962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70106860 msgr2=0x7f3b70106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:00.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.942+0000 7f3b74813700 1 --2- 172.21.15.32:0/1634986962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70106860 0x7f3b70106c70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800b0a0 tx=0x7f3b6800b3b0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.942+0000 7f3b74813700 1 -- 172.21.15.32:0/1634986962 shutdown_connections 2024-05-06T21:27:00.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.942+0000 7f3b74813700 1 --2- 172.21.15.32:0/1634986962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b70107a60 0x7f3b70107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.942+0000 7f3b74813700 1 --2- 172.21.15.32:0/1634986962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70106860 0x7f3b70106c70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.942+0000 7f3b74813700 1 -- 172.21.15.32:0/1634986962 >> 172.21.15.32:0/1634986962 conn(0x7f3b700758b0 msgr2=0x7f3b70077d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:00.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.942+0000 7f3b74813700 1 -- 172.21.15.32:0/1634986962 shutdown_connections 2024-05-06T21:27:00.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.942+0000 7f3b74813700 1 -- 172.21.15.32:0/1634986962 wait complete. 2024-05-06T21:27:00.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.943+0000 7f3b74813700 1 Processor -- start 2024-05-06T21:27:00.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.943+0000 7f3b74813700 1 -- start start 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.943+0000 7f3b74813700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70106860 0x7f3b7019c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.943+0000 7f3b74813700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b70107a60 0x7f3b7019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.943+0000 7f3b74813700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7019cdc0 con 0x7f3b70107a60 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.943+0000 7f3b74813700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7019cf00 con 0x7f3b70106860 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.944+0000 7f3b6dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b70107a60 0x7f3b7019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.944+0000 7f3b6dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b70107a60 0x7f3b7019c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39228/0 (socket says 172.21.15.32:39228) 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.944+0000 7f3b6dd9b700 1 -- 172.21.15.32:0/1873912958 learned_addr learned my addr 172.21.15.32:0/1873912958 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.944+0000 7f3b6dd9b700 1 -- 172.21.15.32:0/1873912958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70106860 msgr2=0x7f3b7019c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.944+0000 7f3b6dd9b700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70106860 0x7f3b7019c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.944+0000 7f3b6dd9b700 1 -- 172.21.15.32:0/1873912958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68009d00 con 0x7f3b70107a60 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.944+0000 7f3b6dd9b700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b70107a60 0x7f3b7019c7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400b4b0 tx=0x7f3b6400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.945+0000 7f3b5f7fe700 1 -- 172.21.15.32:0/1873912958 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b64011800 con 0x7f3b70107a60 2024-05-06T21:27:00.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.945+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b701a19b0 con 0x7f3b70107a60 2024-05-06T21:27:00.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.945+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b701a1f00 con 0x7f3b70107a60 2024-05-06T21:27:00.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.945+0000 7f3b5f7fe700 1 -- 172.21.15.32:0/1873912958 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b64011e10 con 0x7f3b70107a60 2024-05-06T21:27:00.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.945+0000 7f3b5f7fe700 1 -- 172.21.15.32:0/1873912958 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6400f2e0 con 0x7f3b70107a60 2024-05-06T21:27:00.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.946+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b50005320 con 0x7f3b70107a60 2024-05-06T21:27:00.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.947+0000 7f3b5f7fe700 1 -- 172.21.15.32:0/1873912958 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f3b64011960 con 0x7f3b70107a60 2024-05-06T21:27:00.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.948+0000 7f3b5f7fe700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f3b5806d400 0x7f3b5806f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:00.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.948+0000 7f3b5f7fe700 1 -- 172.21.15.32:0/1873912958 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f3b6408c740 con 0x7f3b70107a60 2024-05-06T21:27:00.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.948+0000 7f3b6e59c700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f3b5806d400 0x7f3b5806f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:00.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.949+0000 7f3b6e59c700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f3b5806d400 0x7f3b5806f8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009fd0 tx=0x7f3b68006000 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:00.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:00.955+0000 7f3b5f7fe700 1 -- 172.21.15.32:0/1873912958 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f3b64059aa0 con 0x7f3b70107a60 2024-05-06T21:27:01.072 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:00 smithi032 ceph-mon[27179]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:01.072 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:00 smithi032 ceph-mon[27179]: pgmap v31: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 281 MiB/s rd, 329 MiB/s wr, 472 op/s 2024-05-06T21:27:01.072 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:00 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2642214661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:27:01.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:00 smithi154 ceph-mon[32880]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:01.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:00 smithi154 ceph-mon[32880]: pgmap v31: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 281 MiB/s rd, 329 MiB/s wr, 472 op/s 2024-05-06T21:27:01.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:00 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2642214661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:27:01.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.255+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3b50005cc0 con 0x7f3b70107a60 2024-05-06T21:27:01.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.255+0000 7f3b5f7fe700 1 -- 172.21.15.32:0/1873912958 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f3b64015750 con 0x7f3b70107a60 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:e19 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 19 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:26:11.972572+0000 2024-05-06T21:27:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:27:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:27:01.259 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:27:01.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f3b5806d400 msgr2=0x7f3b5806f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:01.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f3b5806d400 0x7f3b5806f8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009fd0 tx=0x7f3b68006000 comp rx=0 tx=0).stop 2024-05-06T21:27:01.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b70107a60 msgr2=0x7f3b7019c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:01.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b70107a60 0x7f3b7019c7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400b4b0 tx=0x7f3b6400b870 comp rx=0 tx=0).stop 2024-05-06T21:27:01.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 shutdown_connections 2024-05-06T21:27:01.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f3b5806d400 0x7f3b5806f8b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70106860 0x7f3b7019c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 --2- 172.21.15.32:0/1873912958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b70107a60 0x7f3b7019c7a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 >> 172.21.15.32:0/1873912958 conn(0x7f3b700758b0 msgr2=0x7f3b7010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:01.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 shutdown_connections 2024-05-06T21:27:01.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.258+0000 7f3b74813700 1 -- 172.21.15.32:0/1873912958 wait complete. 2024-05-06T21:27:01.261 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 19 2024-05-06T21:27:01.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.376+0000 7f7ce39fc700 1 -- 172.21.15.32:0/3230016438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc100250 msgr2=0x7f7cdc100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.376+0000 7f7ce39fc700 1 --2- 172.21.15.32:0/3230016438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc100250 0x7f7cdc100660 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009910 tx=0x7f7cd8009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.376+0000 7f7ce39fc700 1 -- 172.21.15.32:0/3230016438 shutdown_connections 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.376+0000 7f7ce39fc700 1 --2- 172.21.15.32:0/3230016438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc101450 0x7f7cdc1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.376+0000 7f7ce39fc700 1 --2- 172.21.15.32:0/3230016438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc100250 0x7f7cdc100660 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.376+0000 7f7ce39fc700 1 -- 172.21.15.32:0/3230016438 >> 172.21.15.32:0/3230016438 conn(0x7f7cdc0fb7e0 msgr2=0x7f7cdc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.376+0000 7f7ce39fc700 1 -- 172.21.15.32:0/3230016438 shutdown_connections 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.377+0000 7f7ce39fc700 1 -- 172.21.15.32:0/3230016438 wait complete. 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.377+0000 7f7ce39fc700 1 Processor -- start 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.377+0000 7f7ce39fc700 1 -- start start 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.377+0000 7f7ce39fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc100250 0x7f7cdc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.377+0000 7f7ce39fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc101450 0x7f7cdc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.377+0000 7f7ce39fc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc073680 con 0x7f7cdc101450 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.377+0000 7f7ce39fc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0737c0 con 0x7f7cdc100250 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7ce0f97700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc101450 0x7f7cdc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7ce0f97700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc101450 0x7f7cdc073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39246/0 (socket says 172.21.15.32:39246) 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7ce1798700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc100250 0x7f7cdc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7ce0f97700 1 -- 172.21.15.32:0/2283693394 learned_addr learned my addr 172.21.15.32:0/2283693394 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7ce0f97700 1 -- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc100250 msgr2=0x7f7cdc074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7ce0f97700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc100250 0x7f7cdc074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7ce0f97700 1 -- 172.21.15.32:0/2283693394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd80095f0 con 0x7f7cdc101450 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7ce1798700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc100250 0x7f7cdc074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7ce0f97700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc101450 0x7f7cdc073140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000e920 tx=0x7f7cd000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.378+0000 7f7cce7fc700 1 -- 172.21.15.32:0/2283693394 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd000c9d0 con 0x7f7cdc101450 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.379+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc073aa0 con 0x7f7cdc101450 2024-05-06T21:27:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.379+0000 7f7cce7fc700 1 -- 172.21.15.32:0/2283693394 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7cd0010430 con 0x7f7cdc101450 2024-05-06T21:27:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.379+0000 7f7cce7fc700 1 -- 172.21.15.32:0/2283693394 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd0018650 con 0x7f7cdc101450 2024-05-06T21:27:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.379+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc19db40 con 0x7f7cdc101450 2024-05-06T21:27:01.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.380+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc0005320 con 0x7f7cdc101450 2024-05-06T21:27:01.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.380+0000 7f7cce7fc700 1 -- 172.21.15.32:0/2283693394 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f7cd000cb30 con 0x7f7cdc101450 2024-05-06T21:27:01.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.381+0000 7f7cce7fc700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f7cc806d3c0 0x7f7cc806f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:01.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.381+0000 7f7cce7fc700 1 -- 172.21.15.32:0/2283693394 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7cd0014070 con 0x7f7cdc101450 2024-05-06T21:27:01.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.381+0000 7f7ce1798700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f7cc806d3c0 0x7f7cc806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:01.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.382+0000 7f7ce1798700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f7cc806d3c0 0x7f7cc806f870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800b6f0 tx=0x7f7cd8005fb0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.386+0000 7f7cce7fc700 1 -- 172.21.15.32:0/2283693394 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f7cd0053470 con 0x7f7cdc101450 2024-05-06T21:27:01.535 INFO:tasks.workunit.client.1.smithi154.stdout:6/859: sync 2024-05-06T21:27:01.536 INFO:tasks.workunit.client.1.smithi154.stdout:1/934: sync 2024-05-06T21:27:01.536 INFO:tasks.workunit.client.1.smithi154.stdout:2/992: sync 2024-05-06T21:27:01.536 INFO:tasks.workunit.client.1.smithi154.stdout:7/830: sync 2024-05-06T21:27:01.537 INFO:tasks.workunit.client.1.smithi154.stdout:1/935: dread d6/db/d69/dc1/fd3 [0,4194304] 0 2024-05-06T21:27:01.537 INFO:tasks.workunit.client.1.smithi154.stdout:1/936: write d6/db/d97/ffd [2385464,15481] 0 2024-05-06T21:27:01.537 INFO:tasks.workunit.client.1.smithi154.stdout:1/937: getdents d6/db/d69/dc1 0 2024-05-06T21:27:01.538 INFO:tasks.workunit.client.1.smithi154.stdout:2/993: link db/d12/d1d/f48 db/d12/d1d/d60/d63/f14a 0 2024-05-06T21:27:01.538 INFO:tasks.workunit.client.1.smithi154.stdout:2/994: fsync db/d12/f37 0 2024-05-06T21:27:01.539 INFO:tasks.workunit.client.1.smithi154.stdout:6/860: mknod d8/d11/d2d/d3d/d70/d7b/c10c 0 2024-05-06T21:27:01.542 INFO:tasks.workunit.client.1.smithi154.stdout:2/995: creat db/d12/d1d/d11d/f14b x:0 0 0 2024-05-06T21:27:01.546 INFO:tasks.workunit.client.1.smithi154.stdout:6/861: dread d8/d11/f79 [0,4194304] 0 2024-05-06T21:27:01.555 INFO:tasks.workunit.client.1.smithi154.stdout:1/938: write d6/db/d10/d15/f60 [4152272,18074] 0 2024-05-06T21:27:01.561 INFO:tasks.workunit.client.1.smithi154.stdout:1/939: creat d6/d3e/d7e/da5/d105/f119 x:0 0 0 2024-05-06T21:27:01.562 INFO:tasks.workunit.client.1.smithi154.stdout:1/940: mkdir d6/db/d69/d11a 0 2024-05-06T21:27:01.562 INFO:tasks.workunit.client.1.smithi154.stdout:1/941: readlink d6/db/d10/d26/l110 0 2024-05-06T21:27:01.562 INFO:tasks.workunit.client.1.smithi154.stdout:1/942: creat d6/db/d10/d26/f11b x:0 0 0 2024-05-06T21:27:01.568 INFO:tasks.workunit.client.1.smithi154.stdout:2/996: dwrite db/de/d10/dbc/ded/f147 [0,4194304] 0 2024-05-06T21:27:01.573 INFO:tasks.workunit.client.1.smithi154.stdout:2/997: getdents db/d12/d19/d4b/d78 0 2024-05-06T21:27:01.573 INFO:tasks.workunit.client.1.smithi154.stdout:2/998: readlink db/de/d16/d4f/l9e 0 2024-05-06T21:27:01.573 INFO:tasks.workunit.client.1.smithi154.stdout:2/999: write db/d12/f37 [4784895,84326] 0 2024-05-06T21:27:01.576 INFO:tasks.workunit.client.1.smithi154.stdout:7/831: dwrite d6/d20/f89 [0,4194304] 0 2024-05-06T21:27:01.576 INFO:tasks.workunit.client.1.smithi154.stdout:7/832: write d6/d42/d106/d6e/d21/d2e/fcb [560797,68285] 0 2024-05-06T21:27:01.576 INFO:tasks.workunit.client.1.smithi154.stdout:7/833: chown d6/d42/d106/d6e/d21/d69/ddd/f105 6393243 1 2024-05-06T21:27:01.579 INFO:tasks.workunit.client.1.smithi154.stdout:7/834: truncate d6/d42/d106/d6e/da4/fbb 581773 0 2024-05-06T21:27:01.579 INFO:tasks.workunit.client.1.smithi154.stdout:7/835: write d6/d20/d40/d52/f88 [4191907,5622] 0 2024-05-06T21:27:01.579 INFO:tasks.workunit.client.1.smithi154.stdout:6/862: dwrite d8/d11/d2d/d3d/d70/d7b/f81 [0,4194304] 0 2024-05-06T21:27:01.579 INFO:tasks.workunit.client.1.smithi154.stdout:6/863: fsync d8/d13/f71 0 2024-05-06T21:27:01.581 INFO:tasks.workunit.client.1.smithi154.stdout:6/864: link d8/d11/d33/d4a/d6c/l7a d8/d11/d2d/l10d 0 2024-05-06T21:27:01.597 INFO:tasks.workunit.client.1.smithi154.stdout:6/865: dread d8/f10 [0,4194304] 0 2024-05-06T21:27:01.597 INFO:tasks.workunit.client.1.smithi154.stdout:6/866: creat d8/d11/d2d/d3d/d70/d7b/f10e x:0 0 0 2024-05-06T21:27:01.597 INFO:tasks.workunit.client.1.smithi154.stdout:6/867: readlink d8/d11/d2d/d3d/l10a 0 2024-05-06T21:27:01.612 INFO:tasks.workunit.client.1.smithi154.stdout:7/836: dwrite d6/d20/f79 [0,4194304] 0 2024-05-06T21:27:01.612 INFO:tasks.workunit.client.1.smithi154.stdout:6/868: dwrite d8/f2b [0,4194304] 0 2024-05-06T21:27:01.621 INFO:tasks.workunit.client.1.smithi154.stdout:7/837: dread d6/d42/d106/d6e/f76 [0,4194304] 0 2024-05-06T21:27:01.621 INFO:tasks.workunit.client.1.smithi154.stdout:7/838: fdatasync d6/d20/d40/d52/f91 0 2024-05-06T21:27:01.624 INFO:tasks.workunit.client.1.smithi154.stdout:7/839: rename d6/d42/d106/d6e/d23/f6f to d6/d42/d106/d6e/d21/d69/d7b/dd9/f111 0 2024-05-06T21:27:01.625 INFO:tasks.workunit.client.1.smithi154.stdout:6/869: write d8/d11/d2d/d3d/d4c/dba/fcb [339417,107849] 0 2024-05-06T21:27:01.625 INFO:tasks.workunit.client.1.smithi154.stdout:6/870: write d8/d11/d2d/d3d/d70/d7b/d95/fc9 [92685,56367] 0 2024-05-06T21:27:01.628 INFO:tasks.workunit.client.1.smithi154.stdout:7/840: mknod d6/d54/d6a/c112 0 2024-05-06T21:27:01.628 INFO:tasks.workunit.client.1.smithi154.stdout:7/841: fsync d6/f1a 0 2024-05-06T21:27:01.628 INFO:tasks.workunit.client.1.smithi154.stdout:7/842: truncate d6/d42/dd1/fe6 885791 0 2024-05-06T21:27:01.632 INFO:tasks.workunit.client.1.smithi154.stdout:7/843: symlink d6/d42/d106/d6e/d21/d2e/d9d/l113 0 2024-05-06T21:27:01.632 INFO:tasks.workunit.client.1.smithi154.stdout:7/844: fsync d6/d42/d106/d6e/d21/d69/d7b/f7e 0 2024-05-06T21:27:01.639 INFO:tasks.workunit.client.1.smithi154.stdout:7/845: creat d6/d42/d106/d6e/d21/de5/f114 x:0 0 0 2024-05-06T21:27:01.642 INFO:tasks.workunit.client.1.smithi154.stdout:7/846: unlink d6/d42/d106/d6e/d21/d2e/fcb 0 2024-05-06T21:27:01.646 INFO:tasks.workunit.client.1.smithi154.stdout:7/847: rename d6/d20/d85/cc2 to d6/d42/d106/d6e/d21/d69/dd7/c115 0 2024-05-06T21:27:01.646 INFO:tasks.workunit.client.1.smithi154.stdout:7/848: fsync d6/f1a 0 2024-05-06T21:27:01.648 INFO:tasks.workunit.client.1.smithi154.stdout:7/849: getdents d6/d42/d106/d6e/d21/d69/de0 0 2024-05-06T21:27:01.649 INFO:tasks.workunit.client.1.smithi154.stdout:7/850: write d6/d20/d40/daf/d5c/f8d [4359300,48078] 0 2024-05-06T21:27:01.664 INFO:tasks.workunit.client.1.smithi154.stdout:7/851: dwrite d6/d42/d106/d6e/d21/d2e/fb5 [0,4194304] 0 2024-05-06T21:27:01.666 INFO:tasks.workunit.client.1.smithi154.stdout:7/852: rmdir d6/d42/d106/d6e/d21 39 2024-05-06T21:27:01.667 INFO:tasks.workunit.client.1.smithi154.stdout:7/853: creat d6/d42/d106/d6e/d23/f116 x:0 0 0 2024-05-06T21:27:01.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.683+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 --> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cc0000bf0 con 0x7f7cc806d3c0 2024-05-06T21:27:01.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.684+0000 7f7cce7fc700 1 -- 172.21.15.32:0/2283693394 <== mgr.24395 v2:172.21.15.154:6828/2671631515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f7cc0000bf0 con 0x7f7cc806d3c0 2024-05-06T21:27:01.685 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:27:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:27:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:27:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:27:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [], 2024-05-06T21:27:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "1/23 daemons upgraded", 2024-05-06T21:27:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading mgr daemons", 2024-05-06T21:27:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:27:01.686 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:27:01.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f7cc806d3c0 msgr2=0x7f7cc806f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:01.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f7cc806d3c0 0x7f7cc806f870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800b6f0 tx=0x7f7cd8005fb0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc101450 msgr2=0x7f7cdc073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:01.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc101450 0x7f7cdc073140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000e920 tx=0x7f7cd000ec30 comp rx=0 tx=0).stop 2024-05-06T21:27:01.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 shutdown_connections 2024-05-06T21:27:01.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f7cc806d3c0 0x7f7cc806f870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cdc100250 0x7f7cdc074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 --2- 172.21.15.32:0/2283693394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7cdc101450 0x7f7cdc073140 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 >> 172.21.15.32:0/2283693394 conn(0x7f7cdc0fb7e0 msgr2=0x7f7cdc104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:01.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.687+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 shutdown_connections 2024-05-06T21:27:01.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.688+0000 7f7ce39fc700 1 -- 172.21.15.32:0/2283693394 wait complete. 2024-05-06T21:27:01.692 INFO:tasks.workunit.client.1.smithi154.stdout:7/854: dwrite d6/d20/db1/fc1 [0,4194304] 0 2024-05-06T21:27:01.692 INFO:tasks.workunit.client.1.smithi154.stdout:7/855: write d6/d42/d106/ff3 [72442,31226] 0 2024-05-06T21:27:01.697 INFO:tasks.workunit.client.1.smithi154.stdout:7/856: truncate d6/fb 1420507 0 2024-05-06T21:27:01.697 INFO:tasks.workunit.client.1.smithi154.stdout:7/857: fdatasync d6/d20/f79 0 2024-05-06T21:27:01.701 INFO:tasks.workunit.client.1.smithi154.stdout:7/858: creat d6/d42/d106/d6e/d21/d69/ddd/f117 x:0 0 0 2024-05-06T21:27:01.701 INFO:tasks.workunit.client.1.smithi154.stdout:7/859: chown d6/d20/c2f 296 1 2024-05-06T21:27:01.704 INFO:tasks.workunit.client.1.smithi154.stdout:7/860: rename d6/d42/d106/d6e/d21/d69/ddd/f105 to d6/d42/d106/dd2/f118 0 2024-05-06T21:27:01.707 INFO:tasks.workunit.client.1.smithi154.stdout:7/861: rename d6/d20/d40/daf/d5c/la8 to d6/d42/d106/d6e/d21/d69/d7b/dd9/l119 0 2024-05-06T21:27:01.725 INFO:tasks.workunit.client.1.smithi154.stdout:7/862: dwrite d6/d42/d106/f77 [0,4194304] 0 2024-05-06T21:27:01.735 INFO:tasks.workunit.client.1.smithi154.stdout:7/863: write d6/d42/dd1/fe7 [3224738,93333] 0 2024-05-06T21:27:01.735 INFO:tasks.workunit.client.1.smithi154.stdout:7/864: fdatasync d6/f9 0 2024-05-06T21:27:01.737 INFO:tasks.workunit.client.1.smithi154.stdout:7/865: creat d6/d20/db1/f11a x:0 0 0 2024-05-06T21:27:01.754 INFO:tasks.workunit.client.1.smithi154.stdout:7/866: dwrite d6/d42/d106/d6e/f76 [0,4194304] 0 2024-05-06T21:27:01.771 INFO:tasks.workunit.client.1.smithi154.stdout:7/867: dwrite d6/d20/fa7 [4194304,4194304] 0 2024-05-06T21:27:01.776 INFO:tasks.workunit.client.1.smithi154.stdout:7/868: truncate d6/f10 2405504 0 2024-05-06T21:27:01.776 INFO:tasks.workunit.client.1.smithi154.stdout:7/869: fsync d6/f32 0 2024-05-06T21:27:01.777 INFO:tasks.workunit.client.1.smithi154.stdout:7/870: truncate d6/d54/d5b/d82/f86 2240514 0 2024-05-06T21:27:01.777 INFO:tasks.workunit.client.1.smithi154.stdout:7/871: chown d6/d20/d40/d52/f9c 44726515 1 2024-05-06T21:27:01.787 INFO:tasks.workunit.client.1.smithi154.stdout:7/872: rename d6/d42/d106/d6e/d21/d2e/d9d to d6/d20/d40/daf/d11b 0 2024-05-06T21:27:01.790 INFO:tasks.workunit.client.1.smithi154.stdout:7/873: symlink d6/d20/d40/d52/d81/l11c 0 2024-05-06T21:27:01.790 INFO:tasks.workunit.client.1.smithi154.stdout:7/874: stat d6/d20/d40/d52/d81 0 2024-05-06T21:27:01.791 INFO:tasks.workunit.client.1.smithi154.stdout:7/875: stat d6/d20/d40/daf/c7f 0 2024-05-06T21:27:01.792 INFO:tasks.workunit.client.1.smithi154.stdout:7/876: dread d6/fb3 [0,4194304] 0 2024-05-06T21:27:01.795 INFO:tasks.workunit.client.1.smithi154.stdout:7/877: rmdir d6/d42/d106/d6e/d23 39 2024-05-06T21:27:01.795 INFO:tasks.workunit.client.1.smithi154.stdout:7/878: fsync d6/d20/d40/f50 0 2024-05-06T21:27:01.798 INFO:tasks.workunit.client.1.smithi154.stdout:7/879: unlink d6/c2b 0 2024-05-06T21:27:01.798 INFO:tasks.workunit.client.1.smithi154.stdout:7/880: creat d6/d42/d106/d6e/d21/de5/f11d x:0 0 0 2024-05-06T21:27:01.801 INFO:tasks.workunit.client.1.smithi154.stdout:7/881: mkdir d6/d42/d106/d6e/d21/d69/d7b/dd9/d11e 0 2024-05-06T21:27:01.801 INFO:tasks.workunit.client.1.smithi154.stdout:7/882: truncate d6/d20/d40/daf/d11b/f10e 901987 0 2024-05-06T21:27:01.806 INFO:tasks.workunit.client.1.smithi154.stdout:7/883: dread d6/f25 [0,4194304] 0 2024-05-06T21:27:01.810 INFO:tasks.workunit.client.1.smithi154.stdout:7/884: link d6/d20/l68 d6/d42/d106/d6e/da4/l11f 0 2024-05-06T21:27:01.812 INFO:tasks.workunit.client.1.smithi154.stdout:7/885: dread d6/d42/d106/d6e/d21/fd8 [0,4194304] 0 2024-05-06T21:27:01.813 INFO:tasks.workunit.client.1.smithi154.stdout:7/886: read d6/d54/d5b/d82/f86 [130357,53122] 0 2024-05-06T21:27:01.820 INFO:tasks.workunit.client.1.smithi154.stdout:7/887: dread d6/d20/d40/d52/f88 [0,4194304] 0 2024-05-06T21:27:01.821 INFO:tasks.workunit.client.1.smithi154.stdout:7/888: mkdir d6/d42/d106/d6e/d21/d69/d7b/d9f/d120 0 2024-05-06T21:27:01.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.820+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/153670417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080feb50 msgr2=0x7f6d080fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:01.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.820+0000 7f6d0ef6e700 1 --2- 172.21.15.32:0/153670417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080feb50 0x7f6d080fef60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800b0a0 tx=0x7f6cf800b3b0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.820+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/153670417 shutdown_connections 2024-05-06T21:27:01.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.820+0000 7f6d0ef6e700 1 --2- 172.21.15.32:0/153670417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d080ff4a0 0x7f6d080ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.820+0000 7f6d0ef6e700 1 --2- 172.21.15.32:0/153670417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080feb50 0x7f6d080fef60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.820+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/153670417 >> 172.21.15.32:0/153670417 conn(0x7f6d080fa780 msgr2=0x7f6d080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:01.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/153670417 shutdown_connections 2024-05-06T21:27:01.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/153670417 wait complete. 2024-05-06T21:27:01.823 INFO:tasks.workunit.client.1.smithi154.stdout:7/889: symlink d6/d42/d106/d6e/d21/d69/d7b/d9f/d120/l121 0 2024-05-06T21:27:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d0ef6e700 1 Processor -- start 2024-05-06T21:27:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d0ef6e700 1 -- start start 2024-05-06T21:27:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d0ef6e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d080feb50 0x7f6d08197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d0ef6e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080ff4a0 0x7f6d08198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d0ef6e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08198840 con 0x7f6d080ff4a0 2024-05-06T21:27:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d0ef6e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0819d250 con 0x7f6d080feb50 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d07fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080ff4a0 0x7f6d08198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d07fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080ff4a0 0x7f6d08198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48342/0 (socket says 172.21.15.32:48342) 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d07fff700 1 -- 172.21.15.32:0/3160089998 learned_addr learned my addr 172.21.15.32:0/3160089998 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.821+0000 7f6d0cd0a700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d080feb50 0x7f6d08197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.822+0000 7f6d07fff700 1 -- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d080feb50 msgr2=0x7f6d08197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.822+0000 7f6d07fff700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d080feb50 0x7f6d08197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.822+0000 7f6d07fff700 1 -- 172.21.15.32:0/3160089998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8009d00 con 0x7f6d080ff4a0 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.822+0000 7f6d07fff700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080ff4a0 0x7f6d08198220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000d8d0 tx=0x7f6cf000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.822+0000 7f6d05ffb700 1 -- 172.21.15.32:0/3160089998 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf00098a0 con 0x7f6d080ff4a0 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.822+0000 7f6d05ffb700 1 -- 172.21.15.32:0/3160089998 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6cf0010460 con 0x7f6d080ff4a0 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.822+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0819d450 con 0x7f6d080ff4a0 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.822+0000 7f6d05ffb700 1 -- 172.21.15.32:0/3160089998 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf000f5f0 con 0x7f6d080ff4a0 2024-05-06T21:27:01.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.822+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0819d970 con 0x7f6d080ff4a0 2024-05-06T21:27:01.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.823+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0810aef0 con 0x7f6d080ff4a0 2024-05-06T21:27:01.826 INFO:tasks.workunit.client.1.smithi154.stdout:7/890: creat d6/d20/db1/dba/f122 x:0 0 0 2024-05-06T21:27:01.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.824+0000 7f6d05ffb700 1 -- 172.21.15.32:0/3160089998 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f6cf0009a00 con 0x7f6d080ff4a0 2024-05-06T21:27:01.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.824+0000 7f6d05ffb700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f6cf406d3c0 0x7f6cf406f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:01.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.824+0000 7f6d05ffb700 1 -- 172.21.15.32:0/3160089998 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6cf008cba0 con 0x7f6d080ff4a0 2024-05-06T21:27:01.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.825+0000 7f6d0cd0a700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f6cf406d3c0 0x7f6cf406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:01.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.825+0000 7f6d0cd0a700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f6cf406d3c0 0x7f6cf406f870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800b830 tx=0x7f6cf80060c0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:01.828 INFO:tasks.workunit.client.1.smithi154.stdout:7/891: dread d6/d20/d40/d52/f91 [0,4194304] 0 2024-05-06T21:27:01.829 INFO:tasks.workunit.client.1.smithi154.stdout:6/871: sync 2024-05-06T21:27:01.829 INFO:tasks.workunit.client.1.smithi154.stdout:1/943: sync 2024-05-06T21:27:01.829 INFO:tasks.workunit.client.1.smithi154.stdout:6/872: creat d8/d11/d2d/da3/f10f x:0 0 0 2024-05-06T21:27:01.830 INFO:tasks.workunit.client.1.smithi154.stdout:7/892: mkdir d6/d20/d40/d52/d81/d123 0 2024-05-06T21:27:01.830 INFO:tasks.workunit.client.1.smithi154.stdout:1/944: creat d6/db/d69/d89/f11c x:0 0 0 2024-05-06T21:27:01.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:01.830+0000 7f6d05ffb700 1 -- 172.21.15.32:0/3160089998 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f6cf00562e0 con 0x7f6d080ff4a0 2024-05-06T21:27:01.832 INFO:tasks.workunit.client.1.smithi154.stdout:1/945: unlink d6/db/d69/d89/l95 0 2024-05-06T21:27:01.832 INFO:tasks.workunit.client.1.smithi154.stdout:1/946: stat d6/d3e/d7e/da5/da8/f112 0 2024-05-06T21:27:01.833 INFO:tasks.workunit.client.1.smithi154.stdout:1/947: rename d6/f66 to d6/db/d5e/f11d 0 2024-05-06T21:27:01.834 INFO:tasks.workunit.client.1.smithi154.stdout:1/948: mknod d6/db/d69/d11a/c11e 0 2024-05-06T21:27:01.835 INFO:tasks.workunit.client.1.smithi154.stdout:1/949: mknod d6/d3e/d7e/da5/d105/c11f 0 2024-05-06T21:27:01.836 INFO:tasks.workunit.client.1.smithi154.stdout:1/950: symlink d6/d3e/d7e/da5/l120 0 2024-05-06T21:27:01.837 INFO:tasks.workunit.client.1.smithi154.stdout:6/873: dread d8/d11/d2d/d3d/d70/d7b/fcc [0,4194304] 0 2024-05-06T21:27:01.837 INFO:tasks.workunit.client.1.smithi154.stdout:6/874: chown d8/ce 18396050 1 2024-05-06T21:27:01.837 INFO:tasks.workunit.client.1.smithi154.stdout:6/875: dread - d8/d11/d2d/d3d/d70/fe0 zero size 2024-05-06T21:27:01.838 INFO:tasks.workunit.client.1.smithi154.stdout:1/951: symlink d6/db/d10/d26/d1b/l121 0 2024-05-06T21:27:01.839 INFO:tasks.workunit.client.1.smithi154.stdout:7/893: dread d6/d20/fa7 [4194304,4194304] 0 2024-05-06T21:27:01.840 INFO:tasks.workunit.client.1.smithi154.stdout:7/894: dread d6/d54/d5b/dc5/f103 [0,4194304] 0 2024-05-06T21:27:01.845 INFO:tasks.workunit.client.1.smithi154.stdout:6/876: dread d8/fc [0,4194304] 0 2024-05-06T21:27:01.845 INFO:tasks.workunit.client.1.smithi154.stdout:6/877: write d8/d11/f79 [1021428,24536] 0 2024-05-06T21:27:01.846 INFO:tasks.workunit.client.1.smithi154.stdout:6/878: mkdir d8/d110 0 2024-05-06T21:27:01.847 INFO:tasks.workunit.client.1.smithi154.stdout:6/879: creat d8/d11/d2d/d3d/d4c/f111 x:0 0 0 2024-05-06T21:27:01.847 INFO:tasks.workunit.client.1.smithi154.stdout:6/880: stat d8/d11/d2d/d3d/d70/cae 0 2024-05-06T21:27:01.847 INFO:tasks.workunit.client.1.smithi154.stdout:1/952: dread d6/db/d97/ff9 [0,4194304] 0 2024-05-06T21:27:01.847 INFO:tasks.workunit.client.1.smithi154.stdout:1/953: fsync d6/db/d10/d26/f7d 0 2024-05-06T21:27:01.847 INFO:tasks.workunit.client.1.smithi154.stdout:6/881: rmdir d8/d13/d20/daf/dd1 39 2024-05-06T21:27:01.849 INFO:tasks.workunit.client.1.smithi154.stdout:6/882: symlink d8/ddf/l112 0 2024-05-06T21:27:01.849 INFO:tasks.workunit.client.1.smithi154.stdout:6/883: mkdir d8/d110/d113 0 2024-05-06T21:27:01.850 INFO:tasks.workunit.client.1.smithi154.stdout:6/884: stat d8/d11/d2d/d3d/d4c 0 2024-05-06T21:27:01.851 INFO:tasks.workunit.client.1.smithi154.stdout:6/885: mkdir d8/d13/d20/d109/d114 0 2024-05-06T21:27:01.857 INFO:tasks.workunit.client.1.smithi154.stdout:1/954: dread d6/db/d10/d15/f39 [0,4194304] 0 2024-05-06T21:27:01.858 INFO:tasks.workunit.client.1.smithi154.stdout:1/955: creat d6/db/d69/d11a/f122 x:0 0 0 2024-05-06T21:27:01.859 INFO:tasks.workunit.client.1.smithi154.stdout:1/956: write d6/fec [525253,123498] 0 2024-05-06T21:27:01.860 INFO:tasks.workunit.client.1.smithi154.stdout:1/957: write d6/fec [1656999,38592] 0 2024-05-06T21:27:01.860 INFO:tasks.workunit.client.1.smithi154.stdout:1/958: write d6/db/d97/fc9 [117052,33656] 0 2024-05-06T21:27:01.861 INFO:tasks.workunit.client.1.smithi154.stdout:1/959: mknod d6/db/d69/d89/c123 0 2024-05-06T21:27:01.861 INFO:tasks.workunit.client.1.smithi154.stdout:1/960: write d6/db/d5e/fdb [674423,6279] 0 2024-05-06T21:27:01.862 INFO:tasks.workunit.client.1.smithi154.stdout:1/961: truncate d6/d3e/d7e/da5/da8/faf 92267 0 2024-05-06T21:27:01.878 INFO:tasks.workunit.client.1.smithi154.stdout:1/962: dwrite d6/db/d69/d89/f8e [0,4194304] 0 2024-05-06T21:27:01.880 INFO:tasks.workunit.client.1.smithi154.stdout:1/963: mknod d6/db/d69/c124 0 2024-05-06T21:27:01.882 INFO:tasks.workunit.client.1.smithi154.stdout:1/964: symlink d6/db/d74/dc0/l125 0 2024-05-06T21:27:01.883 INFO:tasks.workunit.client.1.smithi154.stdout:1/965: rmdir d6/d3e 39 2024-05-06T21:27:01.883 INFO:tasks.workunit.client.1.smithi154.stdout:1/966: creat d6/db/d10/d15/d1d/d53/da3/f126 x:0 0 0 2024-05-06T21:27:01.884 INFO:tasks.workunit.client.1.smithi154.stdout:1/967: creat d6/db/d74/dc0/f127 x:0 0 0 2024-05-06T21:27:01.886 INFO:tasks.workunit.client.1.smithi154.stdout:1/968: creat d6/db/d10/f128 x:0 0 0 2024-05-06T21:27:01.886 INFO:tasks.workunit.client.1.smithi154.stdout:1/969: truncate d6/db/d10/d26/f23 4446171 0 2024-05-06T21:27:01.888 INFO:tasks.workunit.client.1.smithi154.stdout:1/970: mkdir d6/db/d74/dc0/d129 0 2024-05-06T21:27:01.888 INFO:tasks.workunit.client.1.smithi154.stdout:1/971: chown d6/d3e/d7e/da5/d105/f119 12344391 1 2024-05-06T21:27:01.888 INFO:tasks.workunit.client.1.smithi154.stdout:1/972: creat d6/db/d10/d26/f12a x:0 0 0 2024-05-06T21:27:01.888 INFO:tasks.workunit.client.1.smithi154.stdout:1/973: fsync d6/db/d69/d89/f11c 0 2024-05-06T21:27:01.888 INFO:tasks.workunit.client.1.smithi154.stdout:1/974: readlink d6/db/d10/d26/d1b/l121 0 2024-05-06T21:27:01.933 INFO:tasks.workunit.client.1.smithi154.stdout:1/975: dwrite d6/db/d69/f71 [4194304,4194304] 0 2024-05-06T21:27:01.933 INFO:tasks.workunit.client.1.smithi154.stdout:1/976: creat d6/db/d5e/db8/f12b x:0 0 0 2024-05-06T21:27:01.936 INFO:tasks.workunit.client.1.smithi154.stdout:1/977: mkdir d6/db/d10/d94/d12c 0 2024-05-06T21:27:01.960 INFO:tasks.workunit.client.1.smithi154.stdout:1/978: dwrite d6/db/d97/fca [0,4194304] 0 2024-05-06T21:27:02.137 INFO:tasks.workunit.client.1.smithi154.stdout:7/895: sync 2024-05-06T21:27:02.137 INFO:tasks.workunit.client.1.smithi154.stdout:6/886: sync 2024-05-06T21:27:02.137 INFO:tasks.workunit.client.1.smithi154.stdout:6/887: chown d8/d11/d2d/d3d/d70/d7b/d95/fa7 353954398 1 2024-05-06T21:27:02.138 INFO:tasks.workunit.client.1.smithi154.stdout:7/896: truncate d6/d42/d106/d6e/fdc 3732433 0 2024-05-06T21:27:02.138 INFO:tasks.workunit.client.1.smithi154.stdout:7/897: fsync d6/d20/f79 0 2024-05-06T21:27:02.138 INFO:tasks.workunit.client.1.smithi154.stdout:7/898: chown d6/d54/d5b 46 1 2024-05-06T21:27:02.139 INFO:tasks.workunit.client.1.smithi154.stdout:7/899: chown d6/d20/d40/daf/d11b/l113 61229297 1 2024-05-06T21:27:02.139 INFO:tasks.workunit.client.1.smithi154.stdout:7/900: write d6/d20/db1/f108 [1377461,17637] 0 2024-05-06T21:27:02.144 INFO:tasks.workunit.client.1.smithi154.stdout:7/901: getdents d6/d42/d106/d6e/d21/de5 0 2024-05-06T21:27:02.154 INFO:tasks.workunit.client.1.smithi154.stdout:6/888: dwrite d8/d11/d2d/d3d/d4c/f111 [0,4194304] 0 2024-05-06T21:27:02.156 INFO:tasks.workunit.client.1.smithi154.stdout:6/889: write d8/d13/d8f/fad [1004941,95321] 0 2024-05-06T21:27:02.160 INFO:tasks.workunit.client.1.smithi154.stdout:6/890: unlink d8/d11/d2d/d3d/d70/f7d 0 2024-05-06T21:27:02.160 INFO:tasks.workunit.client.1.smithi154.stdout:7/902: dwrite d6/d42/d106/ff3 [0,4194304] 0 2024-05-06T21:27:02.161 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:01 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1873912958' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:27:02.161 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:01 smithi032 ceph-mon[27179]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:02.168 INFO:tasks.workunit.client.1.smithi154.stdout:7/903: write d6/d42/d106/d6e/d21/d2e/fb5 [161509,57066] 0 2024-05-06T21:27:02.170 INFO:tasks.workunit.client.1.smithi154.stdout:7/904: creat d6/d42/d106/d6e/d21/f124 x:0 0 0 2024-05-06T21:27:02.171 INFO:tasks.workunit.client.1.smithi154.stdout:7/905: write d6/d20/d40/d52/d8b/dd3/fd5 [850779,81253] 0 2024-05-06T21:27:02.180 INFO:tasks.workunit.client.1.smithi154.stdout:7/906: write d6/f9e [1372587,96951] 0 2024-05-06T21:27:02.183 INFO:tasks.workunit.client.1.smithi154.stdout:7/907: symlink d6/d42/d106/d6e/d21/d69/ddd/l125 0 2024-05-06T21:27:02.195 INFO:tasks.workunit.client.1.smithi154.stdout:7/908: rename d6/d20/db1 to d6/d20/d40/d52/d81/d123/d126 0 2024-05-06T21:27:02.196 INFO:tasks.workunit.client.1.smithi154.stdout:7/909: readlink d6/d20/d40/daf/l55 0 2024-05-06T21:27:02.201 INFO:tasks.workunit.client.1.smithi154.stdout:6/891: creat d8/d11/d2d/d3d/d70/d7b/f115 x:0 0 0 2024-05-06T21:27:02.202 INFO:tasks.workunit.client.1.smithi154.stdout:6/892: symlink d8/d11/d2d/d3d/d70/d7b/d95/l116 0 2024-05-06T21:27:02.204 INFO:tasks.workunit.client.1.smithi154.stdout:7/910: write d6/d42/d106/d6e/f76 [1414615,118632] 0 2024-05-06T21:27:02.204 INFO:tasks.workunit.client.1.smithi154.stdout:6/893: rename d8/d13/l50 to d8/d11/d2d/d3d/d70/d7b/d102/daa/l117 0 2024-05-06T21:27:02.204 INFO:tasks.workunit.client.1.smithi154.stdout:6/894: fdatasync d8/d11/d33/d4a/d6c/d8e/fd6 0 2024-05-06T21:27:02.206 INFO:tasks.workunit.client.1.smithi154.stdout:7/911: mknod d6/d20/d40/daf/c127 0 2024-05-06T21:27:02.228 INFO:tasks.workunit.client.1.smithi154.stdout:6/895: dwrite d8/d13/d20/daf/dd1/f8b [0,4194304] 0 2024-05-06T21:27:02.228 INFO:tasks.workunit.client.1.smithi154.stdout:6/896: write d8/d11/d33/fef [909246,59036] 0 2024-05-06T21:27:02.231 INFO:tasks.workunit.client.1.smithi154.stdout:7/912: dwrite d6/d42/d106/d6e/d21/d69/f80 [0,4194304] 0 2024-05-06T21:27:02.231 INFO:tasks.workunit.client.1.smithi154.stdout:6/897: unlink d8/d11/d33/d4a/d6c/d8e/fbf 0 2024-05-06T21:27:02.232 INFO:tasks.workunit.client.1.smithi154.stdout:1/979: sync 2024-05-06T21:27:02.232 INFO:tasks.workunit.client.1.smithi154.stdout:1/980: truncate d6/db/d10/fc8 739922 0 2024-05-06T21:27:02.233 INFO:tasks.workunit.client.1.smithi154.stdout:1/981: dread d6/db/d10/fa1 [0,4194304] 0 2024-05-06T21:27:02.236 INFO:tasks.workunit.client.1.smithi154.stdout:7/913: rmdir d6/d54/d6a 39 2024-05-06T21:27:02.236 INFO:tasks.workunit.client.1.smithi154.stdout:7/914: write d6/d42/d106/d6e/d21/d69/ddd/f117 [468277,80267] 0 2024-05-06T21:27:02.237 INFO:tasks.workunit.client.1.smithi154.stdout:6/898: dread d8/d11/d2d/d3d/f6b [0,4194304] 0 2024-05-06T21:27:02.239 INFO:tasks.workunit.client.1.smithi154.stdout:7/915: mkdir d6/d42/d106/d6e/d128 0 2024-05-06T21:27:02.239 INFO:tasks.workunit.client.1.smithi154.stdout:7/916: write d6/d20/d40/daf/d5c/f7c [341260,73192] 0 2024-05-06T21:27:02.239 INFO:tasks.workunit.client.1.smithi154.stdout:6/899: unlink d8/d13/d20/f5a 0 2024-05-06T21:27:02.244 INFO:tasks.workunit.client.1.smithi154.stdout:7/917: dread d6/d20/fa7 [4194304,4194304] 0 2024-05-06T21:27:02.244 INFO:tasks.workunit.client.1.smithi154.stdout:7/918: chown d6/d20/d40/d52/lc3 404309 1 2024-05-06T21:27:02.245 INFO:tasks.workunit.client.1.smithi154.stdout:7/919: write d6/d54/d6a/fe9 [575489,544] 0 2024-05-06T21:27:02.247 INFO:tasks.workunit.client.1.smithi154.stdout:7/920: mkdir d6/d42/d106/d6e/d21/d69/de0/d129 0 2024-05-06T21:27:02.248 INFO:tasks.workunit.client.1.smithi154.stdout:6/900: dread d8/d11/d2d/d3d/d70/d7b/d102/f91 [0,4194304] 0 2024-05-06T21:27:02.248 INFO:tasks.workunit.client.1.smithi154.stdout:6/901: write d8/d13/da9/f6f [4503744,27296] 0 2024-05-06T21:27:02.248 INFO:tasks.workunit.client.1.smithi154.stdout:6/902: write d8/d11/d2d/d3d/d4c/f84 [1033388,44237] 0 2024-05-06T21:27:02.249 INFO:tasks.workunit.client.1.smithi154.stdout:6/903: write d8/d11/d2d/d3d/d70/d7b/f10e [464729,122801] 0 2024-05-06T21:27:02.249 INFO:tasks.workunit.client.1.smithi154.stdout:7/921: truncate d6/d20/d40/daf/f83 2283099 0 2024-05-06T21:27:02.257 INFO:tasks.workunit.client.1.smithi154.stdout:7/922: rename d6/d20/d40/d52/d81/d123/d126 to d6/d54/d5b/d82/d12a 0 2024-05-06T21:27:02.258 INFO:tasks.workunit.client.1.smithi154.stdout:7/923: rmdir d6/d20/d40/d52/d8b 39 2024-05-06T21:27:02.260 INFO:tasks.workunit.client.1.smithi154.stdout:7/924: creat d6/d42/d106/d6e/d21/d69/f12b x:0 0 0 2024-05-06T21:27:02.262 INFO:tasks.workunit.client.1.smithi154.stdout:7/925: mknod d6/d20/d40/d52/d81/c12c 0 2024-05-06T21:27:02.263 INFO:tasks.workunit.client.1.smithi154.stdout:7/926: symlink d6/d54/d5b/dc5/l12d 0 2024-05-06T21:27:02.264 INFO:tasks.workunit.client.1.smithi154.stdout:7/927: mkdir d6/d42/dd1/d12e 0 2024-05-06T21:27:02.265 INFO:tasks.workunit.client.1.smithi154.stdout:1/982: dwrite d6/f28 [0,4194304] 0 2024-05-06T21:27:02.268 INFO:tasks.workunit.client.1.smithi154.stdout:6/904: dwrite d8/fc [0,4194304] 0 2024-05-06T21:27:02.269 INFO:tasks.workunit.client.1.smithi154.stdout:6/905: symlink d8/d13/d20/daf/l118 0 2024-05-06T21:27:02.275 INFO:tasks.workunit.client.1.smithi154.stdout:6/906: creat d8/d13/d20/daf/f119 x:0 0 0 2024-05-06T21:27:02.275 INFO:tasks.workunit.client.1.smithi154.stdout:6/907: creat d8/d11/d2d/da3/f11a x:0 0 0 2024-05-06T21:27:02.281 INFO:tasks.workunit.client.1.smithi154.stdout:6/908: getdents d8/d13/d8f/dd8 0 2024-05-06T21:27:02.286 INFO:tasks.workunit.client.1.smithi154.stdout:7/928: dwrite d6/d42/d106/dd2/ff6 [0,4194304] 0 2024-05-06T21:27:02.300 INFO:tasks.workunit.client.1.smithi154.stdout:7/929: dwrite d6/d54/d6a/fe9 [0,4194304] 0 2024-05-06T21:27:02.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.308+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6d0819df80 con 0x7f6d080ff4a0 2024-05-06T21:27:02.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.308+0000 7f6d05ffb700 1 -- 172.21.15.32:0/3160089998 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6cf00599a0 con 0x7f6d080ff4a0 2024-05-06T21:27:02.310 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f6cf406d3c0 msgr2=0x7f6cf406f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f6cf406d3c0 0x7f6cf406f870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800b830 tx=0x7f6cf80060c0 comp rx=0 tx=0).stop 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080ff4a0 msgr2=0x7f6d08198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080ff4a0 0x7f6d08198220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000d8d0 tx=0x7f6cf000dbe0 comp rx=0 tx=0).stop 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 shutdown_connections 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:6828/2671631515,v1:172.21.15.154:6829/2671631515] conn(0x7f6cf406d3c0 0x7f6cf406f870 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d080feb50 0x7f6d08197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 --2- 172.21.15.32:0/3160089998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d080ff4a0 0x7f6d08198220 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 >> 172.21.15.32:0/3160089998 conn(0x7f6d080fa780 msgr2=0x7f6d08107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:02.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 shutdown_connections 2024-05-06T21:27:02.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:02.311+0000 7f6d0ef6e700 1 -- 172.21.15.32:0/3160089998 wait complete. 2024-05-06T21:27:02.342 INFO:tasks.workunit.client.1.smithi154.stdout:7/930: rmdir d6/d42/d106/d6e/d21/de5 39 2024-05-06T21:27:02.345 INFO:tasks.workunit.client.1.smithi154.stdout:7/931: symlink d6/d54/d5b/l12f 0 2024-05-06T21:27:02.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:01 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1873912958' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:27:02.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:01 smithi154 ceph-mon[32880]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:02.391 INFO:tasks.workunit.client.1.smithi154.stdout:7/932: dwrite d6/fb [0,4194304] 0 2024-05-06T21:27:02.395 INFO:tasks.workunit.client.1.smithi154.stdout:7/933: rename d6/l16 to d6/d42/d106/d6e/d21/d69/de0/d129/l130 0 2024-05-06T21:27:02.395 INFO:tasks.workunit.client.1.smithi154.stdout:7/934: chown d6/d42/d106/d6e/d21/d69/dd7/lf9 1920087243 1 2024-05-06T21:27:02.395 INFO:tasks.workunit.client.1.smithi154.stdout:7/935: chown d6/d54/d5b/d82/d12a/f108 363712727 1 2024-05-06T21:27:02.395 INFO:tasks.workunit.client.1.smithi154.stdout:7/936: write d6/f32 [1264766,124574] 0 2024-05-06T21:27:02.396 INFO:tasks.workunit.client.1.smithi154.stdout:7/937: chown d6/d42/dd1/cfb 116 1 2024-05-06T21:27:02.398 INFO:tasks.workunit.client.1.smithi154.stdout:7/938: creat d6/d42/d106/d6e/f131 x:0 0 0 2024-05-06T21:27:02.402 INFO:tasks.workunit.client.1.smithi154.stdout:7/939: mknod d6/c132 0 2024-05-06T21:27:02.416 INFO:tasks.workunit.client.1.smithi154.stdout:7/940: dwrite d6/d54/d6a/f8a [0,4194304] 0 2024-05-06T21:27:02.417 INFO:tasks.workunit.client.1.smithi154.stdout:7/941: fdatasync d6/d42/d106/dd2/ff6 0 2024-05-06T21:27:02.424 INFO:tasks.workunit.client.1.smithi154.stdout:7/942: dread d6/d20/d40/f50 [0,4194304] 0 2024-05-06T21:27:02.426 INFO:tasks.workunit.client.1.smithi154.stdout:7/943: write d6/d20/d40/d52/f9c [286915,98226] 0 2024-05-06T21:27:02.426 INFO:tasks.workunit.client.1.smithi154.stdout:7/944: chown d6/d20/d40/daf/d5c 1472 1 2024-05-06T21:27:02.542 INFO:tasks.workunit.client.1.smithi154.stdout:1/983: sync 2024-05-06T21:27:02.639 INFO:tasks.workunit.client.1.smithi154.stdout:6/909: sync 2024-05-06T21:27:02.639 INFO:tasks.workunit.client.1.smithi154.stdout:7/945: sync 2024-05-06T21:27:02.640 INFO:tasks.workunit.client.1.smithi154.stdout:7/946: mknod d6/d54/c133 0 2024-05-06T21:27:02.642 INFO:tasks.workunit.client.1.smithi154.stdout:7/947: unlink d6/d20/d40/d52/d8b/c10a 0 2024-05-06T21:27:02.642 INFO:tasks.workunit.client.1.smithi154.stdout:6/910: rename d8/d11/df1 to d8/d11/d2d/d3d/d4c/df5/d11b 0 2024-05-06T21:27:02.642 INFO:tasks.workunit.client.1.smithi154.stdout:6/911: write d8/fc [5171496,63365] 0 2024-05-06T21:27:02.644 INFO:tasks.workunit.client.1.smithi154.stdout:6/912: mknod d8/d13/c11c 0 2024-05-06T21:27:02.644 INFO:tasks.workunit.client.1.smithi154.stdout:7/948: creat d6/d42/d106/d6e/d21/d69/d7b/dd9/d11e/f134 x:0 0 0 2024-05-06T21:27:02.644 INFO:tasks.workunit.client.1.smithi154.stdout:7/949: chown d6/d54/d6a/f8a 3557415 1 2024-05-06T21:27:02.645 INFO:tasks.workunit.client.1.smithi154.stdout:6/913: mknod d8/d11/d2d/d3d/d70/d7b/d102/daa/c11d 0 2024-05-06T21:27:02.655 INFO:tasks.workunit.client.1.smithi154.stdout:6/914: dread d8/d11/d2d/d3d/d70/f80 [0,4194304] 0 2024-05-06T21:27:02.657 INFO:tasks.workunit.client.1.smithi154.stdout:6/915: mknod d8/c11e 0 2024-05-06T21:27:02.658 INFO:tasks.workunit.client.1.smithi154.stdout:6/916: creat d8/d13/d20/d109/f11f x:0 0 0 2024-05-06T21:27:02.665 INFO:tasks.workunit.client.1.smithi154.stdout:7/950: dwrite d6/d20/d40/d52/f91 [0,4194304] 0 2024-05-06T21:27:02.668 INFO:tasks.workunit.client.1.smithi154.stdout:7/951: rename d6/d42/d106/dd2/ff6 to d6/d54/d5b/d82/f135 0 2024-05-06T21:27:02.668 INFO:tasks.workunit.client.1.smithi154.stdout:7/952: read d6/d20/d40/d52/f88 [2093802,119030] 0 2024-05-06T21:27:02.670 INFO:tasks.workunit.client.1.smithi154.stdout:7/953: rmdir d6/d42/d106/d6e/d21/d69/de0 39 2024-05-06T21:27:02.671 INFO:tasks.workunit.client.1.smithi154.stdout:6/917: write d8/fa5 [1470571,126131] 0 2024-05-06T21:27:02.681 INFO:tasks.workunit.client.1.smithi154.stdout:6/918: dread d8/d11/d2d/d3d/d4c/f111 [0,4194304] 0 2024-05-06T21:27:02.683 INFO:tasks.workunit.client.1.smithi154.stdout:6/919: mkdir d8/d11/d2d/d3d/d4c/df5/d120 0 2024-05-06T21:27:02.685 INFO:tasks.workunit.client.1.smithi154.stdout:1/984: sync 2024-05-06T21:27:02.685 INFO:tasks.workunit.client.1.smithi154.stdout:1/985: chown d6/d3e/d7e/da5/la6 2 1 2024-05-06T21:27:02.702 INFO:tasks.workunit.client.1.smithi154.stdout:6/920: dwrite d8/d13/da9/fc2 [0,4194304] 0 2024-05-06T21:27:02.702 INFO:tasks.workunit.client.1.smithi154.stdout:6/921: stat d8/d11/d2d/d3d/d70/l7c 0 2024-05-06T21:27:02.702 INFO:tasks.workunit.client.1.smithi154.stdout:6/922: truncate d8/d11/d2d/d3d/d70/d7b/d95/fa7 4473450 0 2024-05-06T21:27:02.708 INFO:tasks.workunit.client.1.smithi154.stdout:6/923: dread d8/d11/d2d/d3d/d4c/dba/fcb [0,4194304] 0 2024-05-06T21:27:02.710 INFO:tasks.workunit.client.1.smithi154.stdout:6/924: mkdir d8/d11/d2d/d3d/d70/d7b/d95/d121 0 2024-05-06T21:27:02.732 INFO:tasks.workunit.client.1.smithi154.stdout:6/925: dwrite d8/d11/f99 [0,4194304] 0 2024-05-06T21:27:02.732 INFO:tasks.workunit.client.1.smithi154.stdout:6/926: truncate d8/d11/d33/d4a/d6c/fe4 540130 0 2024-05-06T21:27:02.741 INFO:tasks.workunit.client.1.smithi154.stdout:6/927: dread d8/d11/d33/d4a/d6c/d8e/f96 [0,4194304] 0 2024-05-06T21:27:02.743 INFO:tasks.workunit.client.1.smithi154.stdout:6/928: rename d8/d7e/cc6 to d8/d11/d33/d4a/d6c/c122 0 2024-05-06T21:27:02.745 INFO:tasks.workunit.client.1.smithi154.stdout:6/929: mkdir d8/d11/d2d/d3d/d4c/df5/d123 0 2024-05-06T21:27:02.745 INFO:tasks.workunit.client.1.smithi154.stdout:6/930: truncate d8/fa5 4900508 0 2024-05-06T21:27:02.746 INFO:tasks.workunit.client.1.smithi154.stdout:6/931: read d8/d13/d20/f65 [1127469,5917] 0 2024-05-06T21:27:02.764 INFO:tasks.workunit.client.1.smithi154.stdout:6/932: dwrite d8/d13/d20/daf/dd1/df0/f105 [0,4194304] 0 2024-05-06T21:27:02.767 INFO:tasks.workunit.client.1.smithi154.stdout:6/933: mknod d8/d11/d33/d4a/d6c/d8e/c124 0 2024-05-06T21:27:02.786 INFO:tasks.workunit.client.1.smithi154.stdout:6/934: dwrite d8/d11/d2d/da3/f10f [0,4194304] 0 2024-05-06T21:27:02.844 INFO:tasks.workunit.client.1.smithi154.stdout:7/954: sync 2024-05-06T21:27:02.845 INFO:tasks.workunit.client.1.smithi154.stdout:7/955: rename d6/d20/d40/daf/d5c/cc6 to d6/d42/d106/d6e/d23/c136 0 2024-05-06T21:27:02.846 INFO:tasks.workunit.client.1.smithi154.stdout:7/956: dread d6/d20/d40/daf/d11b/f10e [0,4194304] 0 2024-05-06T21:27:02.853 INFO:tasks.workunit.client.1.smithi154.stdout:7/957: mkdir d6/d20/d40/d52/d81/d137 0 2024-05-06T21:27:02.855 INFO:tasks.workunit.client.1.smithi154.stdout:7/958: creat d6/d54/d5b/dc5/f138 x:0 0 0 2024-05-06T21:27:02.857 INFO:tasks.workunit.client.1.smithi154.stdout:7/959: creat d6/d20/d40/d52/d8b/f139 x:0 0 0 2024-05-06T21:27:02.857 INFO:tasks.workunit.client.1.smithi154.stdout:7/960: dread - d6/d42/d106/d6e/d21/d69/f12b zero size 2024-05-06T21:27:02.857 INFO:tasks.workunit.client.1.smithi154.stdout:7/961: write d6/d20/d40/f104 [888460,111187] 0 2024-05-06T21:27:02.857 INFO:tasks.workunit.client.1.smithi154.stdout:7/962: dread - d6/d42/d106/dd2/f118 zero size 2024-05-06T21:27:02.858 INFO:tasks.workunit.client.1.smithi154.stdout:7/963: creat d6/d42/d106/d6e/d5e/f13a x:0 0 0 2024-05-06T21:27:02.858 INFO:tasks.workunit.client.1.smithi154.stdout:7/964: stat d6/d42/d106/d6e/c12 0 2024-05-06T21:27:02.858 INFO:tasks.workunit.client.1.smithi154.stdout:7/965: chown d6/d42/d106/d6e/d21/d69/d7b/dd9/d11e 2031 1 2024-05-06T21:27:02.864 INFO:tasks.workunit.client.1.smithi154.stdout:7/966: read d6/d20/f89 [2035896,117965] 0 2024-05-06T21:27:02.864 INFO:tasks.workunit.client.1.smithi154.stdout:7/967: creat d6/d54/d5b/dc5/f13b x:0 0 0 2024-05-06T21:27:02.879 INFO:tasks.workunit.client.1.smithi154.stdout:7/968: write d6/d42/d106/d6e/da4/fbb [575971,29863] 0 2024-05-06T21:27:02.880 INFO:tasks.workunit.client.1.smithi154.stdout:7/969: stat d6/d42/d106/d6e/d21/d2e/fb5 0 2024-05-06T21:27:02.909 INFO:tasks.workunit.client.1.smithi154.stdout:7/970: dwrite d6/d20/f79 [0,4194304] 0 2024-05-06T21:27:02.920 INFO:tasks.workunit.client.1.smithi154.stdout:7/971: write d6/d54/d5b/d82/f135 [2490330,33750] 0 2024-05-06T21:27:02.920 INFO:tasks.workunit.client.1.smithi154.stdout:7/972: dread - d6/d54/d5b/d82/d12a/f11a zero size 2024-05-06T21:27:02.920 INFO:tasks.workunit.client.1.smithi154.stdout:7/973: stat d6/f3b 0 2024-05-06T21:27:02.920 INFO:tasks.workunit.client.1.smithi154.stdout:7/974: write d6/d54/d5b/dc5/f13b [836585,119823] 0 2024-05-06T21:27:02.924 INFO:tasks.workunit.client.1.smithi154.stdout:7/975: creat d6/d42/d106/d6e/d21/d69/d7b/f13c x:0 0 0 2024-05-06T21:27:02.926 INFO:tasks.workunit.client.1.smithi154.stdout:7/976: dread d6/d20/d40/daf/d5c/f7c [0,4194304] 0 2024-05-06T21:27:02.930 INFO:tasks.workunit.client.1.smithi154.stdout:7/977: unlink d6/d54/d5b/d82/d12a/f11a 0 2024-05-06T21:27:02.931 INFO:tasks.workunit.client.1.smithi154.stdout:7/978: getdents d6 0 2024-05-06T21:27:02.931 INFO:tasks.workunit.client.1.smithi154.stdout:7/979: fsync d6/d42/dd1/fe6 0 2024-05-06T21:27:02.942 INFO:tasks.workunit.client.1.smithi154.stdout:7/980: dread d6/d54/f84 [0,4194304] 0 2024-05-06T21:27:02.942 INFO:tasks.workunit.client.1.smithi154.stdout:7/981: readlink d6/d20/d40/daf/l55 0 2024-05-06T21:27:02.947 INFO:tasks.workunit.client.1.smithi154.stdout:7/982: unlink d6/d54/d5b/d82/d12a/f108 0 2024-05-06T21:27:02.950 INFO:tasks.workunit.client.1.smithi154.stdout:7/983: creat d6/d42/d106/d6e/d21/d69/d7b/dd9/f13d x:0 0 0 2024-05-06T21:27:02.950 INFO:tasks.workunit.client.1.smithi154.stdout:7/984: write d6/f1a [2041249,63241] 0 2024-05-06T21:27:02.950 INFO:tasks.workunit.client.1.smithi154.stdout:7/985: creat d6/d42/d106/d6e/d21/d69/d7b/dd9/d11e/f13e x:0 0 0 2024-05-06T21:27:02.950 INFO:tasks.workunit.client.1.smithi154.stdout:7/986: fsync d6/d54/d5b/d82/d12a/fc1 0 2024-05-06T21:27:02.957 INFO:tasks.workunit.client.1.smithi154.stdout:7/987: link d6/d42/d106/d6e/d21/d69/d7b/cbd d6/d42/d106/d6e/d21/d69/c13f 0 2024-05-06T21:27:02.957 INFO:tasks.workunit.client.1.smithi154.stdout:7/988: readlink d6/d20/d40/l65 0 2024-05-06T21:27:02.959 INFO:tasks.workunit.client.1.smithi154.stdout:7/989: mknod d6/d42/d106/d6e/d21/d69/c140 0 2024-05-06T21:27:02.963 INFO:tasks.workunit.client.1.smithi154.stdout:1/986: sync 2024-05-06T21:27:02.965 INFO:tasks.workunit.client.1.smithi154.stdout:1/987: mkdir d6/db/d12d 0 2024-05-06T21:27:02.966 INFO:tasks.workunit.client.1.smithi154.stdout:1/988: mknod d6/db/dbe/c12e 0 2024-05-06T21:27:02.968 INFO:tasks.workunit.client.1.smithi154.stdout:7/990: rmdir d6/d20/d40/daf 39 2024-05-06T21:27:02.969 INFO:tasks.workunit.client.1.smithi154.stdout:1/989: creat d6/f12f x:0 0 0 2024-05-06T21:27:02.969 INFO:tasks.workunit.client.1.smithi154.stdout:1/990: fsync d6/db/d10/d15/f39 0 2024-05-06T21:27:02.969 INFO:tasks.workunit.client.1.smithi154.stdout:1/991: fsync d6/db/d10/f51 0 2024-05-06T21:27:02.971 INFO:tasks.workunit.client.1.smithi154.stdout:1/992: creat d6/db/f130 x:0 0 0 2024-05-06T21:27:02.971 INFO:tasks.workunit.client.1.smithi154.stdout:1/993: fsync d6/db/d5e/db8/ff6 0 2024-05-06T21:27:02.972 INFO:tasks.workunit.client.1.smithi154.stdout:7/991: rename d6/d42/d106/d6e/d21/d69/de0/d129/l130 to d6/d42/d106/d6e/d21/de5/d10c/l141 0 2024-05-06T21:27:02.973 INFO:tasks.workunit.client.1.smithi154.stdout:1/994: mkdir d6/db/d69/d131 0 2024-05-06T21:27:02.975 INFO:tasks.workunit.client.1.smithi154.stdout:6/935: sync 2024-05-06T21:27:02.975 INFO:tasks.workunit.client.1.smithi154.stdout:6/936: write d8/d11/d33/d4a/fe5 [503523,1766] 0 2024-05-06T21:27:02.976 INFO:tasks.workunit.client.1.smithi154.stdout:1/995: mknod d6/db/d10/d15/d1d/d53/da3/c132 0 2024-05-06T21:27:02.976 INFO:tasks.workunit.client.1.smithi154.stdout:6/937: stat d8/d13/da9/l106 0 2024-05-06T21:27:02.977 INFO:tasks.workunit.client.1.smithi154.stdout:6/938: dread - d8/d11/d33/d4a/ff6 zero size 2024-05-06T21:27:02.983 INFO:tasks.workunit.client.1.smithi154.stdout:6/939: write d8/d11/d2d/d3d/d70/f80 [1955286,112095] 0 2024-05-06T21:27:02.983 INFO:tasks.workunit.client.1.smithi154.stdout:6/940: chown d8/d11/d33/d4a/ff6 19706 1 2024-05-06T21:27:02.985 INFO:tasks.workunit.client.1.smithi154.stdout:6/941: mkdir d8/d11/d2d/d3d/d4c/df5/d125 0 2024-05-06T21:27:02.987 INFO:tasks.workunit.client.1.smithi154.stdout:6/942: mknod d8/d11/d2d/d3d/d4c/df5/d120/c126 0 2024-05-06T21:27:02.997 INFO:tasks.workunit.client.1.smithi154.stdout:7/992: dwrite d6/d42/d106/d6e/d21/d69/d7b/d9f/fb6 [0,4194304] 0 2024-05-06T21:27:02.998 INFO:tasks.workunit.client.1.smithi154.stdout:6/943: write d8/fc [2078789,63339] 0 2024-05-06T21:27:02.999 INFO:tasks.workunit.client.1.smithi154.stdout:7/993: creat d6/d42/d106/dd2/f142 x:0 0 0 2024-05-06T21:27:03.004 INFO:tasks.workunit.client.1.smithi154.stdout:6/944: unlink d8/d11/d2d/d3d/d70/d7b/d95/fc9 0 2024-05-06T21:27:03.004 INFO:tasks.workunit.client.1.smithi154.stdout:7/994: read d6/d20/d40/d52/d8b/dd3/fd5 [830617,123839] 0 2024-05-06T21:27:03.007 INFO:tasks.workunit.client.1.smithi154.stdout:7/995: rmdir d6/d42/de2 0 2024-05-06T21:27:03.007 INFO:tasks.workunit.client.1.smithi154.stdout:7/996: fsync d6/d54/d6a/fe9 0 2024-05-06T21:27:03.008 INFO:tasks.workunit.client.1.smithi154.stdout:7/997: write d6/f7d [5658390,100152] 0 2024-05-06T21:27:03.008 INFO:tasks.workunit.client.1.smithi154.stdout:7/998: write d6/d42/d106/d6e/d21/d69/d7b/f13c [258460,26212] 0 2024-05-06T21:27:03.009 INFO:tasks.workunit.client.1.smithi154.stdout:6/945: symlink d8/d11/d2d/d3d/d4c/l127 0 2024-05-06T21:27:03.012 INFO:tasks.workunit.client.1.smithi154.stdout:6/946: dread d8/d7e/f83 [0,4194304] 0 2024-05-06T21:27:03.013 INFO:tasks.workunit.client.1.smithi154.stdout:7/999: dread d6/d20/f89 [0,4194304] 0 2024-05-06T21:27:03.014 INFO:tasks.workunit.client.1.smithi154.stdout:6/947: creat d8/d11/d2d/d3d/d4c/df5/d120/f128 x:0 0 0 2024-05-06T21:27:03.017 INFO:tasks.workunit.client.1.smithi154.stdout:6/948: link d8/d11/d2d/d3d/d4c/l127 d8/d11/l129 0 2024-05-06T21:27:03.018 INFO:tasks.workunit.client.1.smithi154.stdout:6/949: creat d8/d13/f12a x:0 0 0 2024-05-06T21:27:03.020 INFO:tasks.workunit.client.1.smithi154.stdout:6/950: mknod d8/d11/d2d/d3d/c12b 0 2024-05-06T21:27:03.025 INFO:tasks.workunit.client.1.smithi154.stdout:6/951: rmdir d8/d13/d20 39 2024-05-06T21:27:03.025 INFO:tasks.workunit.client.1.smithi154.stdout:6/952: creat d8/d11/d2d/d3d/d4c/f12c x:0 0 0 2024-05-06T21:27:03.029 INFO:tasks.workunit.client.1.smithi154.stdout:6/953: link d8/d11/d2d/d3d/d70/d7b/l93 d8/d110/l12d 0 2024-05-06T21:27:03.029 INFO:tasks.workunit.client.1.smithi154.stdout:6/954: fdatasync d8/d11/d2d/d3d/d70/d7b/fd4 0 2024-05-06T21:27:03.033 INFO:tasks.workunit.client.1.smithi154.stdout:6/955: mkdir d8/d11/d33/d4a/d6c/d8e/d12e 0 2024-05-06T21:27:03.036 INFO:tasks.workunit.client.1.smithi154.stdout:6/956: creat d8/d11/d2d/d3d/d70/d7b/d95/f12f x:0 0 0 2024-05-06T21:27:03.036 INFO:tasks.workunit.client.1.smithi154.stdout:6/957: write d8/d11/d2d/d3d/d70/f80 [3366993,7152] 0 2024-05-06T21:27:03.037 INFO:tasks.workunit.client.1.smithi154.stdout:6/958: symlink d8/d13/d20/l130 0 2024-05-06T21:27:03.041 INFO:tasks.workunit.client.1.smithi154.stdout:6/959: rename d8/d11/d33/l68 to d8/d11/d33/d4a/d6c/d8e/l131 0 2024-05-06T21:27:03.044 INFO:tasks.workunit.client.1.smithi154.stdout:6/960: creat d8/d7e/f132 x:0 0 0 2024-05-06T21:27:03.046 INFO:tasks.workunit.client.1.smithi154.stdout:6/961: creat d8/d11/d2d/d3d/d4c/df5/d123/f133 x:0 0 0 2024-05-06T21:27:03.068 INFO:tasks.workunit.client.1.smithi154.stdout:6/962: dwrite d8/d13/d20/f85 [0,4194304] 0 2024-05-06T21:27:03.068 INFO:tasks.workunit.client.1.smithi154.stdout:6/963: chown d8/d11/d2d/d3d/d70/d7b/d95/d121 1269 1 2024-05-06T21:27:03.079 INFO:tasks.workunit.client.1.smithi154.stdout:6/964: dread d8/d11/f67 [0,4194304] 0 2024-05-06T21:27:03.079 INFO:tasks.workunit.client.1.smithi154.stdout:6/965: truncate d8/d11/d33/d4a/d6c/f98 4892127 0 2024-05-06T21:27:03.079 INFO:tasks.workunit.client.1.smithi154.stdout:6/966: fdatasync d8/d13/f12a 0 2024-05-06T21:27:03.079 INFO:tasks.workunit.client.1.smithi154.stdout:6/967: chown d8/d13/d20/daf/dd1 9022 1 2024-05-06T21:27:03.090 INFO:tasks.workunit.client.1.smithi154.stdout:6/968: dread d8/d13/d20/f85 [0,4194304] 0 2024-05-06T21:27:03.092 INFO:tasks.workunit.client.1.smithi154.stdout:6/969: mkdir d8/d7e/d134 0 2024-05-06T21:27:03.093 INFO:tasks.workunit.client.1.smithi154.stdout:6/970: symlink d8/d7e/d134/l135 0 2024-05-06T21:27:03.093 INFO:tasks.workunit.client.1.smithi154.stdout:6/971: dread - d8/d11/d2d/d3d/d70/d7b/fa1 zero size 2024-05-06T21:27:03.093 INFO:tasks.workunit.client.1.smithi154.stdout:6/972: readlink d8/d11/d2d/led 0 2024-05-06T21:27:03.094 INFO:tasks.workunit.client.1.smithi154.stdout:6/973: creat d8/d13/d8f/d10b/f136 x:0 0 0 2024-05-06T21:27:03.096 INFO:tasks.workunit.client.1.smithi154.stdout:6/974: rmdir d8/d11/d2d/d3d/d70/d7b/d95/d121 0 2024-05-06T21:27:03.096 INFO:tasks.workunit.client.1.smithi154.stdout:6/975: dread - d8/d13/d20/d109/f11f zero size 2024-05-06T21:27:03.104 INFO:tasks.workunit.client.1.smithi154.stdout:6/976: dread d8/d13/d20/daf/dd1/f8b [0,4194304] 0 2024-05-06T21:27:03.108 INFO:tasks.workunit.client.1.smithi154.stdout:6/977: dread d8/d11/d2d/d3d/d70/f80 [0,4194304] 0 2024-05-06T21:27:03.108 INFO:tasks.workunit.client.1.smithi154.stdout:6/978: truncate d8/d11/f79 3509170 0 2024-05-06T21:27:03.109 INFO:tasks.workunit.client.1.smithi154.stdout:6/979: creat d8/d11/d33/f137 x:0 0 0 2024-05-06T21:27:03.109 INFO:tasks.workunit.client.1.smithi154.stdout:6/980: stat d8/d11/d33/f8c 0 2024-05-06T21:27:03.110 INFO:tasks.workunit.client.1.smithi154.stdout:6/981: creat d8/d110/f138 x:0 0 0 2024-05-06T21:27:03.111 INFO:tasks.workunit.client.1.smithi154.stdout:6/982: symlink d8/d11/d2d/d3d/d4c/dba/l139 0 2024-05-06T21:27:03.111 INFO:tasks.workunit.client.1.smithi154.stdout:6/983: creat d8/d11/d2d/d3d/d4c/df5/d120/f13a x:0 0 0 2024-05-06T21:27:03.111 INFO:tasks.workunit.client.1.smithi154.stdout:6/984: chown d8/d110 39281410 1 2024-05-06T21:27:03.112 INFO:tasks.workunit.client.1.smithi154.stdout:6/985: truncate d8/d11/fab 3323846 0 2024-05-06T21:27:03.115 INFO:tasks.workunit.client.1.smithi154.stdout:6/986: dread d8/d11/d2d/d3d/d70/f80 [0,4194304] 0 2024-05-06T21:27:03.115 INFO:tasks.workunit.client.1.smithi154.stdout:6/987: creat d8/d11/d2d/d3d/d70/d7b/f13b x:0 0 0 2024-05-06T21:27:03.116 INFO:tasks.workunit.client.1.smithi154.stdout:6/988: dread d8/d11/d2d/d3d/d70/d7b/fd4 [0,4194304] 0 2024-05-06T21:27:03.117 INFO:tasks.workunit.client.1.smithi154.stdout:6/989: stat d8/d11/d2d/l2e 0 2024-05-06T21:27:03.135 INFO:tasks.workunit.client.1.smithi154.stdout:6/990: dwrite d8/d7e/f132 [0,4194304] 0 2024-05-06T21:27:03.135 INFO:tasks.workunit.client.1.smithi154.stdout:6/991: creat d8/d11/d2d/d3d/d70/d7b/d95/f13c x:0 0 0 2024-05-06T21:27:03.142 INFO:tasks.workunit.client.1.smithi154.stdout:6/992: write d8/d11/d2d/d3d/d4c/fe3 [178032,119529] 0 2024-05-06T21:27:03.146 INFO:tasks.workunit.client.1.smithi154.stdout:6/993: creat d8/ddf/f13d x:0 0 0 2024-05-06T21:27:03.153 INFO:tasks.workunit.client.1.smithi154.stdout:1/996: sync 2024-05-06T21:27:03.154 INFO:tasks.workunit.client.1.smithi154.stdout:1/997: write d6/db/d5e/fdb [473509,100024] 0 2024-05-06T21:27:03.162 INFO:tasks.workunit.client.1.smithi154.stdout:1/998: read d6/db/d97/fca [3407866,13040] 0 2024-05-06T21:27:03.163 INFO:tasks.workunit.client.1.smithi154.stdout:1/999: chown d6/db/d10/d15/l3a 71824 1 2024-05-06T21:27:03.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:02 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/3160089998' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:27:03.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:02 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:03.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:02 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:03.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:02 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:03.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:02 smithi032 ceph-mon[27179]: pgmap v32: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 314 MiB/s rd, 373 MiB/s wr, 587 op/s 2024-05-06T21:27:03.329 INFO:tasks.workunit.client.1.smithi154.stdout:6/994: sync 2024-05-06T21:27:03.330 INFO:tasks.workunit.client.1.smithi154.stdout:6/995: stat d8/d13/d8f/d10b/f136 0 2024-05-06T21:27:03.352 INFO:tasks.workunit.client.1.smithi154.stdout:6/996: dwrite d8/d11/d2d/d3d/d70/fe0 [0,4194304] 0 2024-05-06T21:27:03.352 INFO:tasks.workunit.client.1.smithi154.stdout:6/997: creat d8/d13/f13e x:0 0 0 2024-05-06T21:27:03.352 INFO:tasks.workunit.client.1.smithi154.stdout:6/998: write d8/d11/d2d/d3d/d4c/dba/fd9 [806447,121211] 0 2024-05-06T21:27:03.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:02 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/3160089998' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:27:03.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:02 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:03.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:02 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:03.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:02 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:03.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:02 smithi154 ceph-mon[32880]: pgmap v32: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 314 MiB/s rd, 373 MiB/s wr, 587 op/s 2024-05-06T21:27:03.520 INFO:tasks.workunit.client.1.smithi154.stdout:6/999: sync 2024-05-06T21:27:03.524 INFO:tasks.workunit.client.1.smithi154.stderr:+ rm -rf -- ./tmp.OnfRIoG0QN 2024-05-06T21:27:06.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:05 smithi154 ceph-mon[32880]: pgmap v33: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 154 MiB/s rd, 205 MiB/s wr, 334 op/s 2024-05-06T21:27:06.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:05 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:27:06.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:05 smithi032 ceph-mon[27179]: pgmap v33: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 154 MiB/s rd, 205 MiB/s wr, 334 op/s 2024-05-06T21:27:06.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:05 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:27:07.875 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-06T21:27:07.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-06T21:27:07.956 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:07 smithi032 ceph-mon[27179]: pgmap v34: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 167 MiB/s rd, 217 MiB/s wr, 443 op/s 2024-05-06T21:27:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:07 smithi154 ceph-mon[32880]: pgmap v34: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 167 MiB/s rd, 217 MiB/s wr, 443 op/s 2024-05-06T21:27:09.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:08 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:27:09.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:08 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:09.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:08 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:09.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:08 smithi032 ceph-mon[27179]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:27:09.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:08 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:09.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:08 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:10.092 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:09 smithi032 ceph-mon[27179]: pgmap v35: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 56 MiB/s wr, 224 op/s 2024-05-06T21:27:10.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:09 smithi154 ceph-mon[32880]: pgmap v35: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 56 MiB/s wr, 224 op/s 2024-05-06T21:27:11.281 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:11 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:11.281 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:11 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:11.281 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:11 smithi032 ceph-mon[27179]: pgmap v36: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 56 MiB/s wr, 224 op/s 2024-05-06T21:27:11.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:11 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:11.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:11 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:11.619 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:11 smithi154 ceph-mon[32880]: pgmap v36: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 56 MiB/s wr, 224 op/s 2024-05-06T21:27:12.420 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:12 smithi032 ceph-mon[27179]: Standby manager daemon smithi032.ecoohh restarted 2024-05-06T21:27:12.420 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:12 smithi032 ceph-mon[27179]: Standby manager daemon smithi032.ecoohh started 2024-05-06T21:27:12.420 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:12 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi032.ecoohh/crt"}]: dispatch 2024-05-06T21:27:12.421 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:12 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:27:12.421 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:12 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi032.ecoohh/key"}]: dispatch 2024-05-06T21:27:12.421 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:12 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:27:12.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:12 smithi154 ceph-mon[32880]: Standby manager daemon smithi032.ecoohh restarted 2024-05-06T21:27:12.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:12 smithi154 ceph-mon[32880]: Standby manager daemon smithi032.ecoohh started 2024-05-06T21:27:12.619 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:12 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi032.ecoohh/crt"}]: dispatch 2024-05-06T21:27:12.619 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:12 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:27:12.619 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:12 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi032.ecoohh/key"}]: dispatch 2024-05-06T21:27:12.619 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:12 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:27:13.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:13 smithi154 ceph-mon[32880]: mgrmap e26: smithi154.kilvol(active, since 67s), standbys: smithi032.ecoohh 2024-05-06T21:27:13.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:13 smithi154 ceph-mon[32880]: pgmap v37: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 46 MiB/s rd, 57 MiB/s wr, 358 op/s 2024-05-06T21:27:13.680 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:13 smithi032 ceph-mon[27179]: mgrmap e26: smithi154.kilvol(active, since 67s), standbys: smithi032.ecoohh 2024-05-06T21:27:13.681 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:13 smithi032 ceph-mon[27179]: pgmap v37: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 46 MiB/s rd, 57 MiB/s wr, 358 op/s 2024-05-06T21:27:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:27:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:27:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:15.369 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr fail", "who": "smithi154.kilvol"}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr fail", "who": "smithi154.kilvol"}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: osdmap e49: 6 total, 6 up, 6 in 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd='[{"prefix": "mgr fail", "who": "smithi154.kilvol"}]': finished 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: mgrmap e27: smithi032.ecoohh(active, starting, since 0.00647787s) 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:27:15.370 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: Manager daemon smithi032.ecoohh is now available 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:27:15.371 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:15 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:27:15.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.24395 172.21.15.154:0/2103809597' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr fail", "who": "smithi154.kilvol"}]: dispatch 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "mgr fail", "who": "smithi154.kilvol"}]: dispatch 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: osdmap e49: 6 total, 6 up, 6 in 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.24395 ' entity='mgr.smithi154.kilvol' cmd='[{"prefix": "mgr fail", "who": "smithi154.kilvol"}]': finished 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: mgrmap e27: smithi032.ecoohh(active, starting, since 0.00647787s) 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:27:15.475 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:27:15.476 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:27:15.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:27:15.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: Manager daemon smithi032.ecoohh is now available 2024-05-06T21:27:15.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:15.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:27:15.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:27:15.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:27:15.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:27:15.477 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:15 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:27:15.901 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-06T21:27:15.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-06T21:27:16.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:16 smithi154 ceph-mon[32880]: mgrmap e28: smithi032.ecoohh(active, since 1.00821s) 2024-05-06T21:27:16.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:16 smithi154 ceph-mon[32880]: [06/May/2024:21:27:15] ENGINE Bus STARTING 2024-05-06T21:27:16.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:16 smithi154 ceph-mon[32880]: [06/May/2024:21:27:15] ENGINE Serving on http://172.21.15.32:8765 2024-05-06T21:27:16.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:16 smithi154 ceph-mon[32880]: [06/May/2024:21:27:15] ENGINE Serving on https://172.21.15.32:7150 2024-05-06T21:27:16.619 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:16 smithi154 ceph-mon[32880]: [06/May/2024:21:27:15] ENGINE Bus STARTED 2024-05-06T21:27:16.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:16 smithi032 ceph-mon[27179]: mgrmap e28: smithi032.ecoohh(active, since 1.00821s) 2024-05-06T21:27:16.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:16 smithi032 ceph-mon[27179]: [06/May/2024:21:27:15] ENGINE Bus STARTING 2024-05-06T21:27:16.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:16 smithi032 ceph-mon[27179]: [06/May/2024:21:27:15] ENGINE Serving on http://172.21.15.32:8765 2024-05-06T21:27:16.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:16 smithi032 ceph-mon[27179]: [06/May/2024:21:27:15] ENGINE Serving on https://172.21.15.32:7150 2024-05-06T21:27:16.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:16 smithi032 ceph-mon[27179]: [06/May/2024:21:27:15] ENGINE Bus STARTED 2024-05-06T21:27:17.587 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:17 smithi154 ceph-mon[32880]: pgmap v4: 65 pgs: 65 active+clean; 645 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-05-06T21:27:17.588 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:17 smithi154 ceph-mon[32880]: mgrmap e29: smithi032.ecoohh(active, since 2s) 2024-05-06T21:27:17.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:17 smithi032 ceph-mon[27179]: pgmap v4: 65 pgs: 65 active+clean; 645 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-05-06T21:27:17.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:17 smithi032 ceph-mon[27179]: mgrmap e29: smithi032.ecoohh(active, since 2s) 2024-05-06T21:27:19.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:19 smithi154 ceph-mon[32880]: pgmap v5: 65 pgs: 65 active+clean; 645 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-05-06T21:27:19.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:19 smithi154 ceph-mon[32880]: mgrmap e30: smithi032.ecoohh(active, since 4s) 2024-05-06T21:27:19.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:19 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:19.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:19 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:19.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:19 smithi032 ceph-mon[27179]: pgmap v5: 65 pgs: 65 active+clean; 645 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-05-06T21:27:19.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:19 smithi032 ceph-mon[27179]: mgrmap e30: smithi032.ecoohh(active, since 4s) 2024-05-06T21:27:19.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:19 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:19.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:19 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:21.189 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:20 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:21.190 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:20 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:21.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:20 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:21.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:20 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:22.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:21 smithi154 ceph-mon[32880]: pgmap v6: 65 pgs: 65 active+clean; 589 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 28 KiB/s wr, 58 op/s 2024-05-06T21:27:22.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:21 smithi032 ceph-mon[27179]: pgmap v6: 65 pgs: 65 active+clean; 589 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 28 KiB/s wr, 58 op/s 2024-05-06T21:27:24.188 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:23 smithi032 ceph-mon[27179]: pgmap v7: 65 pgs: 65 active+clean; 370 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 55 KiB/s rd, 1.0 MiB/s wr, 237 op/s 2024-05-06T21:27:24.189 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:23 smithi032 ceph-mon[27179]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:27:24.189 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:23 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/381302135' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:27:24.189 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:23 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/381302135' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:27:24.189 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:23 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/381302135' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:27:24.189 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:23 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/381302135' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:27:24.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:23 smithi154 ceph-mon[32880]: pgmap v7: 65 pgs: 65 active+clean; 370 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 55 KiB/s rd, 1.0 MiB/s wr, 237 op/s 2024-05-06T21:27:24.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:23 smithi154 ceph-mon[32880]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:27:24.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:23 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/381302135' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:27:24.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:23 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/381302135' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:27:24.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:23 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/381302135' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:27:24.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:23 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/381302135' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:27:25.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:24 smithi032 ceph-mon[27179]: mgrmap e31: smithi032.ecoohh(active, since 9s), standbys: smithi154.kilvol 2024-05-06T21:27:25.043 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:24 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi154.kilvol", "id": "smithi154.kilvol"}]: dispatch 2024-05-06T21:27:25.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:24 smithi154 ceph-mon[32880]: mgrmap e31: smithi032.ecoohh(active, since 9s), standbys: smithi154.kilvol 2024-05-06T21:27:25.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:24 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi154.kilvol", "id": "smithi154.kilvol"}]: dispatch 2024-05-06T21:27:26.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:25 smithi032 ceph-mon[27179]: pgmap v8: 65 pgs: 65 active+clean; 370 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 816 KiB/s wr, 184 op/s 2024-05-06T21:27:26.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:25 smithi154 ceph-mon[32880]: pgmap v8: 65 pgs: 65 active+clean; 370 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 816 KiB/s wr, 184 op/s 2024-05-06T21:27:28.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:27 smithi032 ceph-mon[27179]: pgmap v9: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54 KiB/s rd, 1.4 MiB/s wr, 309 op/s 2024-05-06T21:27:28.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:27 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:28.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:27 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:28.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:27 smithi154 ceph-mon[32880]: pgmap v9: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54 KiB/s rd, 1.4 MiB/s wr, 309 op/s 2024-05-06T21:27:28.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:27 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:28.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:27 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:29.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:29 smithi154 ceph-mon[32880]: pgmap v10: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50 KiB/s rd, 1.3 MiB/s wr, 283 op/s 2024-05-06T21:27:29.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:29 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:29.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:29 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:29.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:29 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:27:29.857 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:29 smithi032 ceph-mon[27179]: pgmap v10: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50 KiB/s rd, 1.3 MiB/s wr, 283 op/s 2024-05-06T21:27:29.857 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:29 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:29.857 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:29 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:29.857 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:29 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:27:32.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:31 smithi032 ceph-mon[27179]: pgmap v11: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57 KiB/s rd, 1.4 MiB/s wr, 302 op/s 2024-05-06T21:27:32.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:31 smithi154 ceph-mon[32880]: pgmap v11: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57 KiB/s rd, 1.4 MiB/s wr, 302 op/s 2024-05-06T21:27:32.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.470+0000 7fbe03efc700 1 -- 172.21.15.32:0/2431633657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc1003f0 msgr2=0x7fbdfc100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:32.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.470+0000 7fbe03efc700 1 --2- 172.21.15.32:0/2431633657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc1003f0 0x7fbdfc100860 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009910 tx=0x7fbdec009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:32.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.471+0000 7fbe03efc700 1 -- 172.21.15.32:0/2431633657 shutdown_connections 2024-05-06T21:27:32.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.471+0000 7fbe03efc700 1 --2- 172.21.15.32:0/2431633657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc1003f0 0x7fbdfc100860 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:32.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.471+0000 7fbe03efc700 1 --2- 172.21.15.32:0/2431633657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdfc0ff150 0x7fbdfc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:32.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.471+0000 7fbe03efc700 1 -- 172.21.15.32:0/2431633657 >> 172.21.15.32:0/2431633657 conn(0x7fbdfc0fa7a0 msgr2=0x7fbdfc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:32.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.471+0000 7fbe03efc700 1 -- 172.21.15.32:0/2431633657 shutdown_connections 2024-05-06T21:27:32.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.471+0000 7fbe03efc700 1 -- 172.21.15.32:0/2431633657 wait complete. 2024-05-06T21:27:32.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe03efc700 1 Processor -- start 2024-05-06T21:27:32.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe03efc700 1 -- start start 2024-05-06T21:27:32.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe03efc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc0ff150 0x7fbdfc19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:32.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe03efc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdfc1003f0 0x7fbdfc19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:32.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe03efc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc19cf20 con 0x7fbdfc0ff150 2024-05-06T21:27:32.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe03efc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc19d060 con 0x7fbdfc1003f0 2024-05-06T21:27:32.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe01c98700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc0ff150 0x7fbdfc19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:32.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe01497700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdfc1003f0 0x7fbdfc19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:32.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe01c98700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc0ff150 0x7fbdfc19c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56920/0 (socket says 172.21.15.32:56920) 2024-05-06T21:27:32.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.472+0000 7fbe01c98700 1 -- 172.21.15.32:0/3966040872 learned_addr learned my addr 172.21.15.32:0/3966040872 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:32.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.473+0000 7fbe01c98700 1 -- 172.21.15.32:0/3966040872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdfc1003f0 msgr2=0x7fbdfc19c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:32.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.473+0000 7fbe01c98700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdfc1003f0 0x7fbdfc19c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:32.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.473+0000 7fbe01c98700 1 -- 172.21.15.32:0/3966040872 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec0095f0 con 0x7fbdfc0ff150 2024-05-06T21:27:32.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.473+0000 7fbe01c98700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc0ff150 0x7fbdfc19c3c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800e920 tx=0x7fbdf800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:32.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.474+0000 7fbdf2ffd700 1 -- 172.21.15.32:0/3966040872 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf800c9d0 con 0x7fbdfc0ff150 2024-05-06T21:27:32.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.474+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc1a1b10 con 0x7fbdfc0ff150 2024-05-06T21:27:32.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.474+0000 7fbdf2ffd700 1 -- 172.21.15.32:0/3966040872 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbdf8010430 con 0x7fbdfc0ff150 2024-05-06T21:27:32.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.474+0000 7fbdf2ffd700 1 -- 172.21.15.32:0/3966040872 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf8018650 con 0x7fbdfc0ff150 2024-05-06T21:27:32.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.474+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc1a2060 con 0x7fbdfc0ff150 2024-05-06T21:27:32.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.475+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc068ab0 con 0x7fbdfc0ff150 2024-05-06T21:27:32.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.476+0000 7fbdf2ffd700 1 -- 172.21.15.32:0/3966040872 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7fbdf800cb30 con 0x7fbdfc0ff150 2024-05-06T21:27:32.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.477+0000 7fbdf2ffd700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fbde806dfb0 0x7fbde8070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:32.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.477+0000 7fbdf2ffd700 1 -- 172.21.15.32:0/3966040872 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbdf8014070 con 0x7fbdfc0ff150 2024-05-06T21:27:32.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.477+0000 7fbe01497700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fbde806dfb0 0x7fbde8070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:32.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.477+0000 7fbe01497700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fbde806dfb0 0x7fbde8070460 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009fd0 tx=0x7fbdec005fd0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:32.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.482+0000 7fbdf2ffd700 1 -- 172.21.15.32:0/3966040872 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7fbdf8053470 con 0x7fbdfc0ff150 2024-05-06T21:27:32.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.828+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 --> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdfc104e40 con 0x7fbde806dfb0 2024-05-06T21:27:32.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.830+0000 7fbdf2ffd700 1 -- 172.21.15.32:0/3966040872 <== mgr.14724 v2:172.21.15.32:6800/559791322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fbdfc104e40 con 0x7fbde806dfb0 2024-05-06T21:27:32.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.832+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fbde806dfb0 msgr2=0x7fbde8070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:32.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.832+0000 7fbe03efc700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fbde806dfb0 0x7fbde8070460 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009fd0 tx=0x7fbdec005fd0 comp rx=0 tx=0).stop 2024-05-06T21:27:32.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.832+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc0ff150 msgr2=0x7fbdfc19c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:32.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.832+0000 7fbe03efc700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc0ff150 0x7fbdfc19c3c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800e920 tx=0x7fbdf800ec30 comp rx=0 tx=0).stop 2024-05-06T21:27:32.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.833+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 shutdown_connections 2024-05-06T21:27:32.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.833+0000 7fbe03efc700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fbde806dfb0 0x7fbde8070460 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:32.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.833+0000 7fbe03efc700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdfc0ff150 0x7fbdfc19c3c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:32.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.833+0000 7fbe03efc700 1 --2- 172.21.15.32:0/3966040872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdfc1003f0 0x7fbdfc19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:32.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.833+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 >> 172.21.15.32:0/3966040872 conn(0x7fbdfc0fa7a0 msgr2=0x7fbdfc103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:32.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.833+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 shutdown_connections 2024-05-06T21:27:32.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:32.833+0000 7fbe03efc700 1 -- 172.21.15.32:0/3966040872 wait complete. 2024-05-06T21:27:32.847 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:27:33.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.007+0000 7f17f23e7700 1 -- 172.21.15.32:0/2833964705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec103680 msgr2=0x7f17ec105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:33.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.007+0000 7f17f23e7700 1 --2- 172.21.15.32:0/2833964705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec103680 0x7f17ec105a60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009910 tx=0x7f17e0009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:33.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.007+0000 7f17f23e7700 1 -- 172.21.15.32:0/2833964705 shutdown_connections 2024-05-06T21:27:33.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.007+0000 7f17f23e7700 1 --2- 172.21.15.32:0/2833964705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec103680 0x7f17ec105a60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.007+0000 7f17f23e7700 1 --2- 172.21.15.32:0/2833964705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17ec100d60 0x7f17ec103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.007+0000 7f17f23e7700 1 -- 172.21.15.32:0/2833964705 >> 172.21.15.32:0/2833964705 conn(0x7f17ec0fa780 msgr2=0x7f17ec0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.007+0000 7f17f23e7700 1 -- 172.21.15.32:0/2833964705 shutdown_connections 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.007+0000 7f17f23e7700 1 -- 172.21.15.32:0/2833964705 wait complete. 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.008+0000 7f17f23e7700 1 Processor -- start 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.008+0000 7f17f23e7700 1 -- start start 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.008+0000 7f17f23e7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec100d60 0x7f17ec19c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.008+0000 7f17f23e7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17ec103680 0x7f17ec19c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.008+0000 7f17f23e7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec19cc40 con 0x7f17ec100d60 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.008+0000 7f17f23e7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec19cd80 con 0x7f17ec103680 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17ebfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec100d60 0x7f17ec19c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17ebfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec100d60 0x7f17ec19c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56946/0 (socket says 172.21.15.32:56946) 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17ebfff700 1 -- 172.21.15.32:0/1073025965 learned_addr learned my addr 172.21.15.32:0/1073025965 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:33.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17ebfff700 1 -- 172.21.15.32:0/1073025965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17ec103680 msgr2=0x7f17ec19c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:33.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17ebfff700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17ec103680 0x7f17ec19c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17ebfff700 1 -- 172.21.15.32:0/1073025965 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e00095f0 con 0x7f17ec100d60 2024-05-06T21:27:33.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17ebfff700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec100d60 0x7f17ec19c0e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00e8f0 tx=0x7f17dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:33.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17e97fa700 1 -- 172.21.15.32:0/1073025965 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17dc009790 con 0x7f17ec100d60 2024-05-06T21:27:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17e97fa700 1 -- 172.21.15.32:0/1073025965 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17dc004ce0 con 0x7f17ec100d60 2024-05-06T21:27:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17e97fa700 1 -- 172.21.15.32:0/1073025965 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17dc005690 con 0x7f17ec100d60 2024-05-06T21:27:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.009+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec1a1830 con 0x7f17ec100d60 2024-05-06T21:27:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.010+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec1a1d80 con 0x7f17ec100d60 2024-05-06T21:27:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.011+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec0fc340 con 0x7f17ec100d60 2024-05-06T21:27:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.012+0000 7f17e97fa700 1 -- 172.21.15.32:0/1073025965 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f17dc004750 con 0x7f17ec100d60 2024-05-06T21:27:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.013+0000 7f17e97fa700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f17d406e010 0x7f17d40704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.013+0000 7f17e97fa700 1 -- 172.21.15.32:0/1073025965 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f17dc014070 con 0x7f17ec100d60 2024-05-06T21:27:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.013+0000 7f17eb7fe700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f17d406e010 0x7f17d40704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.014+0000 7f17eb7fe700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f17d406e010 0x7f17d40704c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009fd0 tx=0x7f17e0000bc0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.017+0000 7f17e97fa700 1 -- 172.21.15.32:0/1073025965 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f17dc05b640 con 0x7f17ec100d60 2024-05-06T21:27:33.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.369+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 --> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17ec061190 con 0x7f17d406e010 2024-05-06T21:27:33.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.371+0000 7f17e97fa700 1 -- 172.21.15.32:0/1073025965 <== mgr.14724 v2:172.21.15.32:6800/559791322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f17ec061190 con 0x7f17d406e010 2024-05-06T21:27:33.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f17d406e010 msgr2=0x7f17d40704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:33.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f17d406e010 0x7f17d40704c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009fd0 tx=0x7f17e0000bc0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec100d60 msgr2=0x7f17ec19c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:33.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec100d60 0x7f17ec19c0e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00e8f0 tx=0x7f17dc00ecb0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 shutdown_connections 2024-05-06T21:27:33.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f17d406e010 0x7f17d40704c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17ec100d60 0x7f17ec19c0e0 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00e8f0 tx=0x7f17dc00ecb0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 --2- 172.21.15.32:0/1073025965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17ec103680 0x7f17ec19c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 >> 172.21.15.32:0/1073025965 conn(0x7f17ec0fa780 msgr2=0x7f17ec1042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:33.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 shutdown_connections 2024-05-06T21:27:33.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.374+0000 7f17f23e7700 1 -- 172.21.15.32:0/1073025965 wait complete. 2024-05-06T21:27:33.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.524+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/1889206492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a14103680 msgr2=0x7f8a14105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:33.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.524+0000 7f8a1c7d2700 1 --2- 172.21.15.32:0/1889206492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a14103680 0x7f8a14105a60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009910 tx=0x7f8a04009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:33.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.524+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/1889206492 shutdown_connections 2024-05-06T21:27:33.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.524+0000 7f8a1c7d2700 1 --2- 172.21.15.32:0/1889206492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a14103680 0x7f8a14105a60 secure :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009910 tx=0x7f8a04009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:33.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.524+0000 7f8a1c7d2700 1 --2- 172.21.15.32:0/1889206492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a14100d60 0x7f8a14103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.524+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/1889206492 >> 172.21.15.32:0/1889206492 conn(0x7f8a140fa780 msgr2=0x7f8a140fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:33.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.527+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/1889206492 shutdown_connections 2024-05-06T21:27:33.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.527+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/1889206492 wait complete. 2024-05-06T21:27:33.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.528+0000 7f8a1c7d2700 1 Processor -- start 2024-05-06T21:27:33.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.528+0000 7f8a1c7d2700 1 -- start start 2024-05-06T21:27:33.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.528+0000 7f8a1c7d2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a14100d60 0x7f8a1419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:33.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.528+0000 7f8a1c7d2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a1419c8e0 0x7f8a141a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:33.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.528+0000 7f8a1c7d2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419cde0 con 0x7f8a14100d60 2024-05-06T21:27:33.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.528+0000 7f8a1c7d2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419cf50 con 0x7f8a1419c8e0 2024-05-06T21:27:33.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.529+0000 7f8a19d6d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a1419c8e0 0x7f8a141a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:33.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.529+0000 7f8a19d6d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a1419c8e0 0x7f8a141a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.32:48246/0 (socket says 172.21.15.32:48246) 2024-05-06T21:27:33.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.529+0000 7f8a19d6d700 1 -- 172.21.15.32:0/2700974535 learned_addr learned my addr 172.21.15.32:0/2700974535 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:33.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.529+0000 7f8a1a56e700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a14100d60 0x7f8a1419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:33.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.531+0000 7f8a19d6d700 1 -- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a14100d60 msgr2=0x7f8a1419c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:33.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.531+0000 7f8a19d6d700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a14100d60 0x7f8a1419c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.531+0000 7f8a19d6d700 1 -- 172.21.15.32:0/2700974535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a040095f0 con 0x7f8a1419c8e0 2024-05-06T21:27:33.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.531+0000 7f8a19d6d700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a1419c8e0 0x7f8a141a1950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a04000c00 tx=0x7f8a0400bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:33.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.532+0000 7f8a0b7fe700 1 -- 172.21.15.32:0/2700974535 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a0401d070 con 0x7f8a1419c8e0 2024-05-06T21:27:33.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.532+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a141a1e90 con 0x7f8a1419c8e0 2024-05-06T21:27:33.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.532+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a141a2350 con 0x7f8a1419c8e0 2024-05-06T21:27:33.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.532+0000 7f8a0b7fe700 1 -- 172.21.15.32:0/2700974535 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8a0400f460 con 0x7f8a1419c8e0 2024-05-06T21:27:33.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.532+0000 7f8a0b7fe700 1 -- 172.21.15.32:0/2700974535 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a04021620 con 0x7f8a1419c8e0 2024-05-06T21:27:33.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.534+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f8005320 con 0x7f8a1419c8e0 2024-05-06T21:27:33.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.535+0000 7f8a0b7fe700 1 -- 172.21.15.32:0/2700974535 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f8a04003a60 con 0x7f8a1419c8e0 2024-05-06T21:27:33.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.536+0000 7f8a0b7fe700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8a0006e0c0 0x7f8a00070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:33.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.536+0000 7f8a0b7fe700 1 -- 172.21.15.32:0/2700974535 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8a0408ef10 con 0x7f8a1419c8e0 2024-05-06T21:27:33.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.537+0000 7f8a1a56e700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8a0006e0c0 0x7f8a00070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:33.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.538+0000 7f8a1a56e700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8a0006e0c0 0x7f8a00070570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a10006fd0 tx=0x7f8a10009190 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.544+0000 7f8a0b7fe700 1 -- 172.21.15.32:0/2700974535 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f8a0405c140 con 0x7f8a1419c8e0 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: pgmap v12: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.9 MiB/s wr, 350 op/s 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: Updating smithi032:/etc/ceph/ceph.conf 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:33.724 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:27:33.725 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:33 smithi032 ceph-mon[27179]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:27:33.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: pgmap v12: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.9 MiB/s wr, 350 op/s 2024-05-06T21:27:33.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:33.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:33.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:27:33.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:27:33.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: Updating smithi032:/etc/ceph/ceph.conf 2024-05-06T21:27:33.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-06T21:27:33.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:27:33.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:27:33.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:33.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:27:33.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:33 smithi154 ceph-mon[32880]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:27:33.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.870+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 --> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f89f8000bf0 con 0x7f8a0006e0c0 2024-05-06T21:27:33.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.883+0000 7f8a0b7fe700 1 -- 172.21.15.32:0/2700974535 <== mgr.14724 v2:172.21.15.32:6800/559791322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f89f8000bf0 con 0x7f8a0006e0c0 2024-05-06T21:27:33.884 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:27:33.884 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (7m) 6s ago 9m 24.6M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:27:33.884 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (9m) 6s ago 9m 7666k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:27:33.884 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (8m) 15s ago 8m 7596k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:27:33.884 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (9m) 6s ago 9m 6665k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (8m) 15s ago 8m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (7m) 6s ago 8m 88.2M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (3m) 6s ago 3m 13.7M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (3m) 6s ago 3m 149M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (3m) 15s ago 3m 214M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (3m) 15s ago 3m 15.2M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (32s) 6s ago 10m 478M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (100s) 15s ago 8m 78.2M - 19.0.0-2497-gf273489c 3b8ac54a9a71 49af90f5d83c 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (10m) 6s ago 10m 52.6M 2048M 18.2.0 dc2bc1663786 b06a214f4520 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (8m) 15s ago 8m 42.9M 2048M 18.2.0 dc2bc1663786 8a37ef7f53f9 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (9m) 6s ago 9m 16.1M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (8m) 15s ago 8m 16.6M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (7m) 6s ago 7m 204M 1217M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:27:33.885 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (6m) 6s ago 6m 224M 1217M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:27:33.886 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (6m) 6s ago 6m 173M 1217M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:27:33.886 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (6m) 15s ago 6m 251M 2240M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:27:33.886 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (5m) 15s ago 5m 223M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:27:33.886 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (5m) 15s ago 5m 225M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:27:33.886 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (39s) 6s ago 8m 48.1M - 2.43.0 a07b618ecd1d 33938375ced1 2024-05-06T21:27:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8a0006e0c0 msgr2=0x7f8a00070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8a0006e0c0 0x7f8a00070570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a10006fd0 tx=0x7f8a10009190 comp rx=0 tx=0).stop 2024-05-06T21:27:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a1419c8e0 msgr2=0x7f8a141a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a1419c8e0 0x7f8a141a1950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a04000c00 tx=0x7f8a0400bd70 comp rx=0 tx=0).stop 2024-05-06T21:27:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 shutdown_connections 2024-05-06T21:27:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8a0006e0c0 0x7f8a00070570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a14100d60 0x7f8a1419c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 --2- 172.21.15.32:0/2700974535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a1419c8e0 0x7f8a141a1950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 >> 172.21.15.32:0/2700974535 conn(0x7f8a140fa780 msgr2=0x7f8a141019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:33.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 shutdown_connections 2024-05-06T21:27:33.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:33.886+0000 7f8a1c7d2700 1 -- 172.21.15.32:0/2700974535 wait complete. 2024-05-06T21:27:34.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.004+0000 7fe50fd14700 1 -- 172.21.15.32:0/255126398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe508100ce0 msgr2=0x7fe5081030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:34.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.004+0000 7fe50fd14700 1 --2- 172.21.15.32:0/255126398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe508100ce0 0x7fe5081030c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe504009910 tx=0x7fe504009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:34.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.004+0000 7fe50fd14700 1 -- 172.21.15.32:0/255126398 shutdown_connections 2024-05-06T21:27:34.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.004+0000 7fe50fd14700 1 --2- 172.21.15.32:0/255126398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe508103600 0x7fe5081059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:34.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.004+0000 7fe50fd14700 1 --2- 172.21.15.32:0/255126398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe508100ce0 0x7fe5081030c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:34.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.005+0000 7fe50fd14700 1 -- 172.21.15.32:0/255126398 >> 172.21.15.32:0/255126398 conn(0x7fe5080fa700 msgr2=0x7fe5080fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:34.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.005+0000 7fe50fd14700 1 -- 172.21.15.32:0/255126398 shutdown_connections 2024-05-06T21:27:34.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.005+0000 7fe50fd14700 1 -- 172.21.15.32:0/255126398 wait complete. 2024-05-06T21:27:34.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.005+0000 7fe50fd14700 1 Processor -- start 2024-05-06T21:27:34.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50fd14700 1 -- start start 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50fd14700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe508100ce0 0x7fe508197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50fd14700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe508103600 0x7fe5081981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50fd14700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5081987f0 con 0x7fe508103600 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50fd14700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508198960 con 0x7fe508100ce0 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50d2af700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe508103600 0x7fe5081981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50d2af700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe508103600 0x7fe5081981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56998/0 (socket says 172.21.15.32:56998) 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50d2af700 1 -- 172.21.15.32:0/774812928 learned_addr learned my addr 172.21.15.32:0/774812928 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50dab0700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe508100ce0 0x7fe508197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50dab0700 1 -- 172.21.15.32:0/774812928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe508103600 msgr2=0x7fe5081981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50dab0700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe508103600 0x7fe5081981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.006+0000 7fe50dab0700 1 -- 172.21.15.32:0/774812928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5040095f0 con 0x7fe508100ce0 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.007+0000 7fe50dab0700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe508100ce0 0x7fe508197cb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe504005b40 tx=0x7fe50400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.007+0000 7fe4feffd700 1 -- 172.21.15.32:0/774812928 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe50401d070 con 0x7fe508100ce0 2024-05-06T21:27:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.007+0000 7fe4feffd700 1 -- 172.21.15.32:0/774812928 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe504005dc0 con 0x7fe508100ce0 2024-05-06T21:27:34.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.007+0000 7fe4feffd700 1 -- 172.21.15.32:0/774812928 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe504022470 con 0x7fe508100ce0 2024-05-06T21:27:34.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.007+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50819d390 con 0x7fe508100ce0 2024-05-06T21:27:34.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.007+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50819d7c0 con 0x7fe508100ce0 2024-05-06T21:27:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.008+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5080fc2c0 con 0x7fe508100ce0 2024-05-06T21:27:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.009+0000 7fe4feffd700 1 -- 172.21.15.32:0/774812928 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7fe504003680 con 0x7fe508100ce0 2024-05-06T21:27:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.009+0000 7fe4feffd700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fe4f406dfb0 0x7fe4f4070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.009+0000 7fe4feffd700 1 -- 172.21.15.32:0/774812928 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe50408f230 con 0x7fe508100ce0 2024-05-06T21:27:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.009+0000 7fe50d2af700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fe4f406dfb0 0x7fe4f4070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.010+0000 7fe50d2af700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fe4f406dfb0 0x7fe4f4070460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe5081991c0 tx=0x7fe4f8009260 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:34.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.015+0000 7fe4feffd700 1 -- 172.21.15.32:0/774812928 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7fe5040588a0 con 0x7fe508100ce0 2024-05-06T21:27:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.502+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe50802cec0 con 0x7fe508100ce0 2024-05-06T21:27:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.503+0000 7fe4feffd700 1 -- 172.21.15.32:0/774812928 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fe504058070 con 0x7fe508100ce0 2024-05-06T21:27:34.504 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:27:34.504 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:27:34.504 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:27:34.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:27:34.504 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:27:34.504 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:27:34.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:27:34.504 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:27:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:27:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fe4f406dfb0 msgr2=0x7fe4f4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fe4f406dfb0 0x7fe4f4070460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe5081991c0 tx=0x7fe4f8009260 comp rx=0 tx=0).stop 2024-05-06T21:27:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe508100ce0 msgr2=0x7fe508197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe508100ce0 0x7fe508197cb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe504005b40 tx=0x7fe50400fa00 comp rx=0 tx=0).stop 2024-05-06T21:27:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 shutdown_connections 2024-05-06T21:27:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fe4f406dfb0 0x7fe4f4070460 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe508100ce0 0x7fe508197cb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 --2- 172.21.15.32:0/774812928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe508103600 0x7fe5081981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 >> 172.21.15.32:0/774812928 conn(0x7fe5080fa700 msgr2=0x7fe508104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 shutdown_connections 2024-05-06T21:27:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.506+0000 7fe50fd14700 1 -- 172.21.15.32:0/774812928 wait complete. 2024-05-06T21:27:34.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.665+0000 7f8b6ef85700 1 -- 172.21.15.32:0/3467412344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68100240 msgr2=0x7f8b68100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:34.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.665+0000 7f8b6ef85700 1 --2- 172.21.15.32:0/3467412344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68100240 0x7f8b68100650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009910 tx=0x7f8b5c009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:34.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.665+0000 7f8b6ef85700 1 -- 172.21.15.32:0/3467412344 shutdown_connections 2024-05-06T21:27:34.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.665+0000 7f8b6ef85700 1 --2- 172.21.15.32:0/3467412344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b68101440 0x7f8b68101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:34.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.665+0000 7f8b6ef85700 1 --2- 172.21.15.32:0/3467412344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68100240 0x7f8b68100650 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:34.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.665+0000 7f8b6ef85700 1 -- 172.21.15.32:0/3467412344 >> 172.21.15.32:0/3467412344 conn(0x7f8b680fb7f0 msgr2=0x7f8b680fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:34.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.665+0000 7f8b6ef85700 1 -- 172.21.15.32:0/3467412344 shutdown_connections 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.665+0000 7f8b6ef85700 1 -- 172.21.15.32:0/3467412344 wait complete. 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.666+0000 7f8b6ef85700 1 Processor -- start 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.666+0000 7f8b6ef85700 1 -- start start 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.666+0000 7f8b6ef85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b68100240 0x7f8b68074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.666+0000 7f8b6ef85700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68101440 0x7f8b68073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.666+0000 7f8b6ef85700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b68073680 con 0x7f8b68101440 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.666+0000 7f8b6ef85700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680737c0 con 0x7f8b68100240 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.666+0000 7f8b67fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68101440 0x7f8b68073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.666+0000 7f8b67fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68101440 0x7f8b68073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57022/0 (socket says 172.21.15.32:57022) 2024-05-06T21:27:34.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.667+0000 7f8b67fff700 1 -- 172.21.15.32:0/1052751487 learned_addr learned my addr 172.21.15.32:0/1052751487 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:34.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.667+0000 7f8b67fff700 1 -- 172.21.15.32:0/1052751487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b68100240 msgr2=0x7f8b68074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:34.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.667+0000 7f8b67fff700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b68100240 0x7f8b68074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:34.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.667+0000 7f8b67fff700 1 -- 172.21.15.32:0/1052751487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c0095f0 con 0x7f8b68101440 2024-05-06T21:27:34.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.667+0000 7f8b67fff700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68101440 0x7f8b68073140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400d900 tx=0x7f8b5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:34.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.667+0000 7f8b65ffb700 1 -- 172.21.15.32:0/1052751487 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b540041f0 con 0x7f8b68101440 2024-05-06T21:27:34.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.667+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b68073aa0 con 0x7f8b68101440 2024-05-06T21:27:34.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.668+0000 7f8b65ffb700 1 -- 172.21.15.32:0/1052751487 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8b54004ce0 con 0x7f8b68101440 2024-05-06T21:27:34.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.668+0000 7f8b65ffb700 1 -- 172.21.15.32:0/1052751487 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5400b750 con 0x7f8b68101440 2024-05-06T21:27:34.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.668+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6819db10 con 0x7f8b68101440 2024-05-06T21:27:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.669+0000 7f8b65ffb700 1 -- 172.21.15.32:0/1052751487 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f8b54004e50 con 0x7f8b68101440 2024-05-06T21:27:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.669+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b68108d90 con 0x7f8b68101440 2024-05-06T21:27:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.670+0000 7f8b65ffb700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8b5806dda0 0x7f8b58070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.670+0000 7f8b65ffb700 1 -- 172.21.15.32:0/1052751487 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8b5408ddb0 con 0x7f8b68101440 2024-05-06T21:27:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.670+0000 7f8b6cd21700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8b5806dda0 0x7f8b58070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.671+0000 7f8b6cd21700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8b5806dda0 0x7f8b58070250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00b5c0 tx=0x7f8b5c005960 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:34.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:34.676+0000 7f8b65ffb700 1 -- 172.21.15.32:0/1052751487 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f8b5405aed0 con 0x7f8b68101440 2024-05-06T21:27:35.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.059+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8b6819e0c0 con 0x7f8b68101440 2024-05-06T21:27:35.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.059+0000 7f8b65ffb700 1 -- 172.21.15.32:0/1052751487 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f8b54016760 con 0x7f8b68101440 2024-05-06T21:27:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:e20 2024-05-06T21:27:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:27:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 20 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:27:07.836937+0000 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:27:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:27:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:27:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:27:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:27:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:27:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:27:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:27:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:27:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:27:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8b5806dda0 msgr2=0x7f8b58070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8b5806dda0 0x7f8b58070250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00b5c0 tx=0x7f8b5c005960 comp rx=0 tx=0).stop 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68101440 msgr2=0x7f8b68073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68101440 0x7f8b68073140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400d900 tx=0x7f8b5400dcc0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 shutdown_connections 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f8b5806dda0 0x7f8b58070250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b68100240 0x7f8b68074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 --2- 172.21.15.32:0/1052751487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b68101440 0x7f8b68073140 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 >> 172.21.15.32:0/1052751487 conn(0x7f8b680fb7f0 msgr2=0x7f8b68104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 shutdown_connections 2024-05-06T21:27:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.063+0000 7f8b6ef85700 1 -- 172.21.15.32:0/1052751487 wait complete. 2024-05-06T21:27:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 20 2024-05-06T21:27:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:27:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:27:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: Reconfiguring prometheus.smithi032 (dependencies changed)... 2024-05-06T21:27:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:34 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/774812928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:27:35.181 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: Reconfiguring prometheus.smithi032 (dependencies changed)... 2024-05-06T21:27:35.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:34 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/774812928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:27:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.185+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2161224938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c00ff130 msgr2=0x7fc6c00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.185+0000 7fc6c7ca7700 1 --2- 172.21.15.32:0/2161224938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c00ff130 0x7fc6c00ff540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009910 tx=0x7fc6bc009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.185+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2161224938 shutdown_connections 2024-05-06T21:27:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.185+0000 7fc6c7ca7700 1 --2- 172.21.15.32:0/2161224938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c01003d0 0x7fc6c0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.185+0000 7fc6c7ca7700 1 --2- 172.21.15.32:0/2161224938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c00ff130 0x7fc6c00ff540 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.185+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2161224938 >> 172.21.15.32:0/2161224938 conn(0x7fc6c00fa780 msgr2=0x7fc6c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.185+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2161224938 shutdown_connections 2024-05-06T21:27:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.185+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2161224938 wait complete. 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c7ca7700 1 Processor -- start 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c7ca7700 1 -- start start 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c7ca7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c00ff130 0x7fc6c01949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c7ca7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c01003d0 0x7fc6c0194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c7ca7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0195510 con 0x7fc6c01003d0 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c7ca7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0195650 con 0x7fc6c00ff130 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c5242700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c01003d0 0x7fc6c0194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c5242700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c01003d0 0x7fc6c0194ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57036/0 (socket says 172.21.15.32:57036) 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c5242700 1 -- 172.21.15.32:0/2366999573 learned_addr learned my addr 172.21.15.32:0/2366999573 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c5a43700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c00ff130 0x7fc6c01949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c5242700 1 -- 172.21.15.32:0/2366999573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c00ff130 msgr2=0x7fc6c01949b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:35.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c5242700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c00ff130 0x7fc6c01949b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.186+0000 7fc6c5242700 1 -- 172.21.15.32:0/2366999573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc0095f0 con 0x7fc6c01003d0 2024-05-06T21:27:35.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.187+0000 7fc6c5242700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c01003d0 0x7fc6c0194ef0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000eab0 tx=0x7fc6b000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.187+0000 7fc6b6ffd700 1 -- 172.21.15.32:0/2366999573 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b0013070 con 0x7fc6c01003d0 2024-05-06T21:27:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.187+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c00685a0 con 0x7fc6c01003d0 2024-05-06T21:27:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.187+0000 7fc6b6ffd700 1 -- 172.21.15.32:0/2366999573 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6b0017410 con 0x7fc6c01003d0 2024-05-06T21:27:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.187+0000 7fc6b6ffd700 1 -- 172.21.15.32:0/2366999573 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b00165e0 con 0x7fc6c01003d0 2024-05-06T21:27:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.187+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c0068af0 con 0x7fc6c01003d0 2024-05-06T21:27:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.188+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c0107c10 con 0x7fc6c01003d0 2024-05-06T21:27:35.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.190+0000 7fc6b6ffd700 1 -- 172.21.15.32:0/2366999573 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7fc6b0017580 con 0x7fc6c01003d0 2024-05-06T21:27:35.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.190+0000 7fc6b6ffd700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fc6ac06dfc0 0x7fc6ac070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:35.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.190+0000 7fc6b6ffd700 1 -- 172.21.15.32:0/2366999573 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc6b008f9b0 con 0x7fc6c01003d0 2024-05-06T21:27:35.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.191+0000 7fc6c5a43700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fc6ac06dfc0 0x7fc6ac070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:35.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.191+0000 7fc6c5a43700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fc6ac06dfc0 0x7fc6ac070470 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009fd0 tx=0x7fc6bc005940 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:35.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.195+0000 7fc6b6ffd700 1 -- 172.21.15.32:0/2366999573 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7fc6b005cca0 con 0x7fc6c01003d0 2024-05-06T21:27:35.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.594+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 --> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6c0104d20 con 0x7fc6ac06dfc0 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.596+0000 7fc6b6ffd700 1 -- 172.21.15.32:0/2366999573 <== mgr.14724 v2:172.21.15.32:6800/559791322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fc6c0104d20 con 0x7fc6ac06dfc0 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "2/23 daemons upgraded", 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "", 2024-05-06T21:27:35.597 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:27:35.598 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:27:35.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.598+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fc6ac06dfc0 msgr2=0x7fc6ac070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fc6ac06dfc0 0x7fc6ac070470 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009fd0 tx=0x7fc6bc005940 comp rx=0 tx=0).stop 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c01003d0 msgr2=0x7fc6c0194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c01003d0 0x7fc6c0194ef0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000eab0 tx=0x7fc6b000edc0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 shutdown_connections 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fc6ac06dfc0 0x7fc6ac070470 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c00ff130 0x7fc6c01949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 --2- 172.21.15.32:0/2366999573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6c01003d0 0x7fc6c0194ef0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 >> 172.21.15.32:0/2366999573 conn(0x7fc6c00fa780 msgr2=0x7fc6c0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 shutdown_connections 2024-05-06T21:27:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.599+0000 7fc6c7ca7700 1 -- 172.21.15.32:0/2366999573 wait complete. 2024-05-06T21:27:35.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.716+0000 7f9ca0025700 1 -- 172.21.15.32:0/261566202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c980ff130 msgr2=0x7f9c980ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:35.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.716+0000 7f9ca0025700 1 --2- 172.21.15.32:0/261566202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c980ff130 0x7f9c980ff540 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009910 tx=0x7f9c94009c20 comp rx=0 tx=0).stop 2024-05-06T21:27:35.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.716+0000 7f9ca0025700 1 -- 172.21.15.32:0/261566202 shutdown_connections 2024-05-06T21:27:35.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.716+0000 7f9ca0025700 1 --2- 172.21.15.32:0/261566202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c981003d0 0x7f9c98100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.716+0000 7f9ca0025700 1 --2- 172.21.15.32:0/261566202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c980ff130 0x7f9c980ff540 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.716+0000 7f9ca0025700 1 -- 172.21.15.32:0/261566202 >> 172.21.15.32:0/261566202 conn(0x7f9c980fa780 msgr2=0x7f9c980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:35.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.717+0000 7f9ca0025700 1 -- 172.21.15.32:0/261566202 shutdown_connections 2024-05-06T21:27:35.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.717+0000 7f9ca0025700 1 -- 172.21.15.32:0/261566202 wait complete. 2024-05-06T21:27:35.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.717+0000 7f9ca0025700 1 Processor -- start 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.717+0000 7f9ca0025700 1 -- start start 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.717+0000 7f9ca0025700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c980ff130 0x7f9c98195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.717+0000 7f9ca0025700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c981003d0 0x7f9c98195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.717+0000 7f9ca0025700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98196600 con 0x7f9c981003d0 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.717+0000 7f9ca0025700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98196740 con 0x7f9c980ff130 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c9d5c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c981003d0 0x7f9c98195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c9d5c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c981003d0 0x7f9c98195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57046/0 (socket says 172.21.15.32:57046) 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c9d5c0700 1 -- 172.21.15.32:0/1105249623 learned_addr learned my addr 172.21.15.32:0/1105249623 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c9d5c0700 1 -- 172.21.15.32:0/1105249623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c980ff130 msgr2=0x7f9c98195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c9d5c0700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c980ff130 0x7f9c98195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c9d5c0700 1 -- 172.21.15.32:0/1105249623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940095f0 con 0x7f9c981003d0 2024-05-06T21:27:35.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c9d5c0700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c981003d0 0x7f9c98195fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800e920 tx=0x7f9c8800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:35.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c8effd700 1 -- 172.21.15.32:0/1105249623 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c88009790 con 0x7f9c981003d0 2024-05-06T21:27:35.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9819b1f0 con 0x7f9c981003d0 2024-05-06T21:27:35.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c8effd700 1 -- 172.21.15.32:0/1105249623 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9c8800cba0 con 0x7f9c981003d0 2024-05-06T21:27:35.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.718+0000 7f9c8effd700 1 -- 172.21.15.32:0/1105249623 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c88018630 con 0x7f9c981003d0 2024-05-06T21:27:35.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.719+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9819b740 con 0x7f9c981003d0 2024-05-06T21:27:35.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.720+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c98107c10 con 0x7f9c981003d0 2024-05-06T21:27:35.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.720+0000 7f9c8effd700 1 -- 172.21.15.32:0/1105249623 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f9c88010430 con 0x7f9c981003d0 2024-05-06T21:27:35.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.721+0000 7f9c8effd700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f9c8406dfc0 0x7f9c84070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:27:35.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.721+0000 7f9c8effd700 1 -- 172.21.15.32:0/1105249623 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9c88014070 con 0x7f9c981003d0 2024-05-06T21:27:35.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.721+0000 7f9c9ddc1700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f9c8406dfc0 0x7f9c84070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:27:35.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.721+0000 7f9c9ddc1700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f9c8406dfc0 0x7f9c84070470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009fd0 tx=0x7f9c94000bc0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:27:35.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:35.725+0000 7f9c8effd700 1 -- 172.21.15.32:0/1105249623 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f9c88053470 con 0x7f9c981003d0 2024-05-06T21:27:36.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.094+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9c9819bd20 con 0x7f9c981003d0 2024-05-06T21:27:36.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.094+0000 7f9c8effd700 1 -- 172.21.15.32:0/1105249623 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9c8805b040 con 0x7f9c981003d0 2024-05-06T21:27:36.095 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:27:36.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.097+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f9c8406dfc0 msgr2=0x7f9c84070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.097+0000 7f9ca0025700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f9c8406dfc0 0x7f9c84070470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009fd0 tx=0x7f9c94000bc0 comp rx=0 tx=0).stop 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.097+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c981003d0 msgr2=0x7f9c98195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.097+0000 7f9ca0025700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c981003d0 0x7f9c98195fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800e920 tx=0x7f9c8800ece0 comp rx=0 tx=0).stop 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.098+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 shutdown_connections 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.098+0000 7f9ca0025700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f9c8406dfc0 0x7f9c84070470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.098+0000 7f9ca0025700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c980ff130 0x7f9c98195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.098+0000 7f9ca0025700 1 --2- 172.21.15.32:0/1105249623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c981003d0 0x7f9c98195fe0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.098+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 >> 172.21.15.32:0/1105249623 conn(0x7f9c980fa780 msgr2=0x7f9c98068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.098+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 shutdown_connections 2024-05-06T21:27:36.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:27:36.098+0000 7f9ca0025700 1 -- 172.21.15.32:0/1105249623 wait complete. 2024-05-06T21:27:36.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:36 smithi032 ceph-mon[27179]: pgmap v13: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 2.3 MiB/s wr, 235 op/s 2024-05-06T21:27:36.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:36 smithi032 ceph-mon[27179]: Reconfiguring daemon prometheus.smithi032 on smithi032 2024-05-06T21:27:36.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:36 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1052751487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:27:36.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:36 smithi154 ceph-mon[32880]: pgmap v13: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 2.3 MiB/s wr, 235 op/s 2024-05-06T21:27:36.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:36 smithi154 ceph-mon[32880]: Reconfiguring daemon prometheus.smithi032 on smithi032 2024-05-06T21:27:36.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:36 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1052751487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:27:37.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:37 smithi154 ceph-mon[32880]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:37.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:37 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1105249623' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:27:37.410 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:37 smithi032 ceph-mon[27179]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:27:37.410 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:37 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1105249623' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:27:38.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:38 smithi154 ceph-mon[32880]: pgmap v14: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 3.4 MiB/s wr, 358 op/s 2024-05-06T21:27:38.414 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:38 smithi032 ceph-mon[27179]: pgmap v14: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 3.4 MiB/s wr, 358 op/s 2024-05-06T21:27:40.149 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:40 smithi032 ceph-mon[27179]: pgmap v15: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 2.8 MiB/s wr, 214 op/s 2024-05-06T21:27:40.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:40 smithi154 ceph-mon[32880]: pgmap v15: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 2.8 MiB/s wr, 214 op/s 2024-05-06T21:27:41.978 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:41 smithi154 ceph-mon[32880]: pgmap v16: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.8 MiB/s wr, 256 op/s 2024-05-06T21:27:41.978 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:41 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:41.978 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:41 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:41.978 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:41 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:27:41.978 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:41 smithi154 ceph-mon[32880]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:27:41.978 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:41 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:42.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:41 smithi032 ceph-mon[27179]: pgmap v16: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.8 MiB/s wr, 256 op/s 2024-05-06T21:27:42.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:41 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:42.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:41 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:42.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:41 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:27:42.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:41 smithi032 ceph-mon[27179]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:27:42.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:41 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:43.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:42 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:27:43.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:42 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:27:43.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:42 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:27:43.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:42 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:27:43.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:42 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:27:43.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:42 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:27:43.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:42 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:27:43.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:42 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:27:44.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:43 smithi154 ceph-mon[32880]: pgmap v17: 65 pgs: 65 active+clean; 327 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 3.8 MiB/s wr, 440 op/s 2024-05-06T21:27:44.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:43 smithi154 ceph-mon[32880]: Upgrade: Updating mgr.smithi154.kilvol 2024-05-06T21:27:44.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:43 smithi154 ceph-mon[32880]: Deploying daemon mgr.smithi154.kilvol on smithi154 2024-05-06T21:27:44.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:43 smithi032 ceph-mon[27179]: pgmap v17: 65 pgs: 65 active+clean; 327 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 3.8 MiB/s wr, 440 op/s 2024-05-06T21:27:44.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:43 smithi032 ceph-mon[27179]: Upgrade: Updating mgr.smithi154.kilvol 2024-05-06T21:27:44.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:43 smithi032 ceph-mon[27179]: Deploying daemon mgr.smithi154.kilvol on smithi154 2024-05-06T21:27:45.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:44 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:27:45.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:44 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:27:46.197 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:45 smithi154 ceph-mon[32880]: pgmap v18: 65 pgs: 65 active+clean; 327 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 368 op/s 2024-05-06T21:27:46.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:45 smithi032 ceph-mon[27179]: pgmap v18: 65 pgs: 65 active+clean; 327 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 368 op/s 2024-05-06T21:27:48.051 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:47 smithi154 ceph-mon[32880]: pgmap v19: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 3.2 MiB/s wr, 570 op/s 2024-05-06T21:27:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:47 smithi032 ceph-mon[27179]: pgmap v19: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 3.2 MiB/s wr, 570 op/s 2024-05-06T21:27:50.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:49 smithi154 ceph-mon[32880]: pgmap v20: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 447 op/s 2024-05-06T21:27:50.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:49 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:50.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:49 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:50.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:49 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:50.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:49 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:50.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:49 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:50.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:49 smithi032 ceph-mon[27179]: pgmap v20: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 447 op/s 2024-05-06T21:27:50.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:49 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:50.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:49 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:50.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:49 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:27:50.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:49 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:50.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:49 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:52.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:51 smithi032 ceph-mon[27179]: pgmap v21: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 2.5 MiB/s wr, 533 op/s 2024-05-06T21:27:52.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:51 smithi154 ceph-mon[32880]: pgmap v21: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 2.5 MiB/s wr, 533 op/s 2024-05-06T21:27:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:53 smithi032 ceph-mon[27179]: pgmap v22: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54 KiB/s rd, 3.3 MiB/s wr, 657 op/s 2024-05-06T21:27:53.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:53 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:53.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:53 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:54.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:53 smithi154 ceph-mon[32880]: pgmap v22: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54 KiB/s rd, 3.3 MiB/s wr, 657 op/s 2024-05-06T21:27:54.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:53 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:54.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:53 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:55.066 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:54 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:55.066 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:54 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:55.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:54 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:55.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:54 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:55.951 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:55 smithi154 ceph-mon[32880]: pgmap v23: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.1 MiB/s wr, 454 op/s 2024-05-06T21:27:56.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:55 smithi032 ceph-mon[27179]: pgmap v23: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.1 MiB/s wr, 454 op/s 2024-05-06T21:27:58.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:57 smithi032 ceph-mon[27179]: pgmap v24: 65 pgs: 65 active+clean; 320 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s rd, 2.7 MiB/s wr, 608 op/s 2024-05-06T21:27:58.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:57 smithi032 ceph-mon[27179]: Standby manager daemon smithi154.kilvol restarted 2024-05-06T21:27:58.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:57 smithi032 ceph-mon[27179]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:27:58.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:57 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/2652520288' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:27:58.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:57 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/2652520288' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:27:58.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:57 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/2652520288' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:27:58.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:57 smithi032 ceph-mon[27179]: from='mgr.? 172.21.15.154:0/2652520288' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:27:58.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:57 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:58.224 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:57 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:58.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:57 smithi154 ceph-mon[32880]: pgmap v24: 65 pgs: 65 active+clean; 320 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s rd, 2.7 MiB/s wr, 608 op/s 2024-05-06T21:27:58.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:57 smithi154 ceph-mon[32880]: Standby manager daemon smithi154.kilvol restarted 2024-05-06T21:27:58.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:57 smithi154 ceph-mon[32880]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:27:58.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:57 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/2652520288' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:27:58.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:57 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/2652520288' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:27:58.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:57 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/2652520288' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:27:58.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:57 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/2652520288' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:27:58.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:57 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:58.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:57 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:27:59.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:58 smithi032 ceph-mon[27179]: mgrmap e32: smithi032.ecoohh(active, since 43s), standbys: smithi154.kilvol 2024-05-06T21:27:59.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:58 smithi154 ceph-mon[32880]: mgrmap e32: smithi032.ecoohh(active, since 43s), standbys: smithi154.kilvol 2024-05-06T21:28:00.206 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:59 smithi032 ceph-mon[27179]: pgmap v25: 65 pgs: 65 active+clean; 320 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 405 op/s 2024-05-06T21:28:00.206 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:27:59 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:28:00.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:59 smithi154 ceph-mon[32880]: pgmap v25: 65 pgs: 65 active+clean; 320 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 405 op/s 2024-05-06T21:28:00.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:27:59 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:28:02.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:01 smithi032 ceph-mon[27179]: pgmap v26: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 2.1 MiB/s wr, 469 op/s 2024-05-06T21:28:02.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:01 smithi154 ceph-mon[32880]: pgmap v26: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 2.1 MiB/s wr, 469 op/s 2024-05-06T21:28:03.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:03 smithi032 ceph-mon[27179]: pgmap v27: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 420 op/s 2024-05-06T21:28:04.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:03 smithi154 ceph-mon[32880]: pgmap v27: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 420 op/s 2024-05-06T21:28:05.782 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: pgmap v28: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.0 MiB/s wr, 254 op/s 2024-05-06T21:28:05.782 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:05.782 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:05.782 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:05.782 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: Upgrade: Setting container_image for all mgr 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi032.ecoohh"}]: dispatch 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi032.ecoohh"}]: dispatch 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi032.ecoohh"}]': finished 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi154.kilvol"}]: dispatch 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi154.kilvol"}]: dispatch 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi154.kilvol"}]': finished 2024-05-06T21:28:05.783 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:05 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: pgmap v28: 65 pgs: 65 active+clean; 322 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.0 MiB/s wr, 254 op/s 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: Upgrade: Setting container_image for all mgr 2024-05-06T21:28:05.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:05.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi032.ecoohh"}]: dispatch 2024-05-06T21:28:05.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi032.ecoohh"}]: dispatch 2024-05-06T21:28:05.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi032.ecoohh"}]': finished 2024-05-06T21:28:05.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi154.kilvol"}]: dispatch 2024-05-06T21:28:05.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi154.kilvol"}]: dispatch 2024-05-06T21:28:05.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi154.kilvol"}]': finished 2024-05-06T21:28:05.869 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:05 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T21:28:06.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.228+0000 7f0513ceb700 1 -- 172.21.15.32:0/3250536280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 msgr2=0x7f050c0fe300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:06.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.228+0000 7f0513ceb700 1 --2- 172.21.15.32:0/3250536280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 0x7f050c0fe300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009910 tx=0x7f04fc009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:06.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.228+0000 7f0513ceb700 1 -- 172.21.15.32:0/3250536280 shutdown_connections 2024-05-06T21:28:06.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.228+0000 7f0513ceb700 1 --2- 172.21.15.32:0/3250536280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 0x7f050c0fe300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.228+0000 7f0513ceb700 1 --2- 172.21.15.32:0/3250536280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c101880 0x7f050c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.228+0000 7f0513ceb700 1 -- 172.21.15.32:0/3250536280 >> 172.21.15.32:0/3250536280 conn(0x7f050c0f9f10 msgr2=0x7f050c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:06.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.228+0000 7f0513ceb700 1 -- 172.21.15.32:0/3250536280 shutdown_connections 2024-05-06T21:28:06.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.228+0000 7f0513ceb700 1 -- 172.21.15.32:0/3250536280 wait complete. 2024-05-06T21:28:06.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.229+0000 7f0513ceb700 1 Processor -- start 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.229+0000 7f0513ceb700 1 -- start start 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.229+0000 7f0513ceb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c101880 0x7f050c100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.229+0000 7f0513ceb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 0x7f050c0ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.229+0000 7f0513ceb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0ffb10 con 0x7f050c1021d0 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.229+0000 7f0513ceb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0ffc50 con 0x7f050c101880 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511286700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 0x7f050c0ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511a87700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c101880 0x7f050c100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511a87700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c101880 0x7f050c100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.32:42190/0 (socket says 172.21.15.32:42190) 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511286700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 0x7f050c0ff5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39626/0 (socket says 172.21.15.32:39626) 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511a87700 1 -- 172.21.15.32:0/3387806275 learned_addr learned my addr 172.21.15.32:0/3387806275 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511a87700 1 -- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 msgr2=0x7f050c0ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511a87700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 0x7f050c0ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511a87700 1 -- 172.21.15.32:0/3387806275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508009520 con 0x7f050c101880 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511286700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 0x7f050c0ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:28:06.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.230+0000 7f0511a87700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c101880 0x7f050c100f80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f050800eab0 tx=0x7f050800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:06.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.231+0000 7f0502ffd700 1 -- 172.21.15.32:0/3387806275 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050800cba0 con 0x7f050c101880 2024-05-06T21:28:06.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.231+0000 7f0502ffd700 1 -- 172.21.15.32:0/3387806275 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f05080044d0 con 0x7f050c101880 2024-05-06T21:28:06.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.231+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc0095f0 con 0x7f050c101880 2024-05-06T21:28:06.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.231+0000 7f0502ffd700 1 -- 172.21.15.32:0/3387806275 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0508005020 con 0x7f050c101880 2024-05-06T21:28:06.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.231+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c1002f0 con 0x7f050c101880 2024-05-06T21:28:06.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.233+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c108d20 con 0x7f050c101880 2024-05-06T21:28:06.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.233+0000 7f0502ffd700 1 -- 172.21.15.32:0/3387806275 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 32) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f0508004710 con 0x7f050c101880 2024-05-06T21:28:06.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.234+0000 7f0502ffd700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f04f806dde0 0x7f04f8070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:06.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.234+0000 7f0502ffd700 1 -- 172.21.15.32:0/3387806275 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0508014070 con 0x7f050c101880 2024-05-06T21:28:06.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.234+0000 7f0511286700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f04f806dde0 0x7f04f8070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:06.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.234+0000 7f0511286700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f04f806dde0 0x7f04f8070290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00b760 tx=0x7f04fc005fd0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:06.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.239+0000 7f0502ffd700 1 -- 172.21.15.32:0/3387806275 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f050805af60 con 0x7f050c101880 2024-05-06T21:28:06.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.511+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 --> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f050c105f70 con 0x7f04f806dde0 2024-05-06T21:28:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.512+0000 7f0502ffd700 1 -- 172.21.15.32:0/3387806275 <== mgr.14724 v2:172.21.15.32:6800/559791322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f050c105f70 con 0x7f04f806dde0 2024-05-06T21:28:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.514+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f04f806dde0 msgr2=0x7f04f8070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.514+0000 7f0513ceb700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f04f806dde0 0x7f04f8070290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00b760 tx=0x7f04fc005fd0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.514+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c101880 msgr2=0x7f050c100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.514+0000 7f0513ceb700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c101880 0x7f050c100f80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f050800eab0 tx=0x7f050800edc0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.514+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 shutdown_connections 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.514+0000 7f0513ceb700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f04f806dde0 0x7f04f8070290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.514+0000 7f0513ceb700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c101880 0x7f050c100f80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.514+0000 7f0513ceb700 1 --2- 172.21.15.32:0/3387806275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f050c1021d0 0x7f050c0ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.514+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 >> 172.21.15.32:0/3387806275 conn(0x7f050c0f9f10 msgr2=0x7f050c104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.515+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 shutdown_connections 2024-05-06T21:28:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.515+0000 7f0513ceb700 1 -- 172.21.15.32:0/3387806275 wait complete. 2024-05-06T21:28:06.527 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:28:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.686+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/690955996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d840ff680 msgr2=0x7f0d840ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.686+0000 7f0d8b9b3700 1 --2- 172.21.15.32:0/690955996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d840ff680 0x7f0d840ffad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0d800084f0 tx=0x7f0d8000af90 comp rx=0 tx=0).stop 2024-05-06T21:28:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.686+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/690955996 shutdown_connections 2024-05-06T21:28:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.686+0000 7f0d8b9b3700 1 --2- 172.21.15.32:0/690955996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d840ff680 0x7f0d840ffad0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.686+0000 7f0d8b9b3700 1 --2- 172.21.15.32:0/690955996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d840fe480 0x7f0d840fe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.686+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/690955996 >> 172.21.15.32:0/690955996 conn(0x7f0d840f9a50 msgr2=0x7f0d840fbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.686+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/690955996 shutdown_connections 2024-05-06T21:28:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.686+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/690955996 wait complete. 2024-05-06T21:28:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.687+0000 7f0d8b9b3700 1 Processor -- start 2024-05-06T21:28:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.687+0000 7f0d8b9b3700 1 -- start start 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d8b9b3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d840fe480 0x7f0d8419c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d8b9b3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d840ff680 0x7f0d8419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d8b9b3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8419cbb0 con 0x7f0d840fe480 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d8b9b3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8419ccf0 con 0x7f0d840ff680 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d88f4e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d840ff680 0x7f0d8419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d88f4e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d840ff680 0x7f0d8419c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.32:42206/0 (socket says 172.21.15.32:42206) 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d88f4e700 1 -- 172.21.15.32:0/337801118 learned_addr learned my addr 172.21.15.32:0/337801118 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d8974f700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d840fe480 0x7f0d8419c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d88f4e700 1 -- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d840fe480 msgr2=0x7f0d8419c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d88f4e700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d840fe480 0x7f0d8419c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d88f4e700 1 -- 172.21.15.32:0/337801118 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800081d0 con 0x7f0d840ff680 2024-05-06T21:28:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.688+0000 7f0d8974f700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d840fe480 0x7f0d8419c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:28:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.690+0000 7f0d88f4e700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d840ff680 0x7f0d8419c590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000a380 tx=0x7f0d8000a460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.690+0000 7f0d7a7fc700 1 -- 172.21.15.32:0/337801118 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d80015040 con 0x7f0d840ff680 2024-05-06T21:28:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.690+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d841a1740 con 0x7f0d840ff680 2024-05-06T21:28:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.690+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d841a1c90 con 0x7f0d840ff680 2024-05-06T21:28:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.690+0000 7f0d7a7fc700 1 -- 172.21.15.32:0/337801118 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d80005280 con 0x7f0d840ff680 2024-05-06T21:28:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.690+0000 7f0d7a7fc700 1 -- 172.21.15.32:0/337801118 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d80003d60 con 0x7f0d840ff680 2024-05-06T21:28:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.691+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d68005320 con 0x7f0d840ff680 2024-05-06T21:28:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.692+0000 7f0d7a7fc700 1 -- 172.21.15.32:0/337801118 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 32) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f0d80003680 con 0x7f0d840ff680 2024-05-06T21:28:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.693+0000 7f0d7a7fc700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f0d7006dfc0 0x7f0d70070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.693+0000 7f0d7a7fc700 1 -- 172.21.15.32:0/337801118 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0d8008f7b0 con 0x7f0d840ff680 2024-05-06T21:28:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.693+0000 7f0d8974f700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f0d7006dfc0 0x7f0d70070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.695+0000 7f0d8974f700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f0d7006dfc0 0x7f0d70070470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ff4e0 tx=0x7f0d7c00f040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:06.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.700+0000 7f0d7a7fc700 1 -- 172.21.15.32:0/337801118 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f0d8005c970 con 0x7f0d840ff680 2024-05-06T21:28:06.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.993+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 --> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d68000bf0 con 0x7f0d7006dfc0 2024-05-06T21:28:06.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.995+0000 7f0d7a7fc700 1 -- 172.21.15.32:0/337801118 <== mgr.14724 v2:172.21.15.32:6800/559791322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f0d68000bf0 con 0x7f0d7006dfc0 2024-05-06T21:28:06.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f0d7006dfc0 msgr2=0x7f0d70070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:06.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f0d7006dfc0 0x7f0d70070470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ff4e0 tx=0x7f0d7c00f040 comp rx=0 tx=0).stop 2024-05-06T21:28:06.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d840ff680 msgr2=0x7f0d8419c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:06.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d840ff680 0x7f0d8419c590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000a380 tx=0x7f0d8000a460 comp rx=0 tx=0).stop 2024-05-06T21:28:06.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 shutdown_connections 2024-05-06T21:28:06.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f0d7006dfc0 0x7f0d70070470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d840fe480 0x7f0d8419c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 --2- 172.21.15.32:0/337801118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d840ff680 0x7f0d8419c590 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:06.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 >> 172.21.15.32:0/337801118 conn(0x7f0d840f9a50 msgr2=0x7f0d841028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:06.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 shutdown_connections 2024-05-06T21:28:06.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:06.998+0000 7f0d8b9b3700 1 -- 172.21.15.32:0/337801118 wait complete. 2024-05-06T21:28:07.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.123+0000 7f79bc341700 1 -- 172.21.15.32:0/2225257118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4100240 msgr2=0x7f79b4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:07.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.123+0000 7f79bc341700 1 --2- 172.21.15.32:0/2225257118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4100240 0x7f79b4100650 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009910 tx=0x7f79b0009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:07.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.124+0000 7f79bc341700 1 -- 172.21.15.32:0/2225257118 shutdown_connections 2024-05-06T21:28:07.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.124+0000 7f79bc341700 1 --2- 172.21.15.32:0/2225257118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b4101440 0x7f79b4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.124+0000 7f79bc341700 1 --2- 172.21.15.32:0/2225257118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4100240 0x7f79b4100650 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.124+0000 7f79bc341700 1 -- 172.21.15.32:0/2225257118 >> 172.21.15.32:0/2225257118 conn(0x7f79b40fb7f0 msgr2=0x7f79b40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:07.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.124+0000 7f79bc341700 1 -- 172.21.15.32:0/2225257118 shutdown_connections 2024-05-06T21:28:07.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.124+0000 7f79bc341700 1 -- 172.21.15.32:0/2225257118 wait complete. 2024-05-06T21:28:07.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.124+0000 7f79bc341700 1 Processor -- start 2024-05-06T21:28:07.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.124+0000 7f79bc341700 1 -- start start 2024-05-06T21:28:07.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79bc341700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b4100240 0x7f79b4197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:07.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79bc341700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4101440 0x7f79b4198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:07.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79bc341700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4198850 con 0x7f79b4101440 2024-05-06T21:28:07.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79bc341700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b419d260 con 0x7f79b4100240 2024-05-06T21:28:07.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79b98dc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4101440 0x7f79b4198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:07.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79b98dc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4101440 0x7f79b4198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39670/0 (socket says 172.21.15.32:39670) 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79b98dc700 1 -- 172.21.15.32:0/218979839 learned_addr learned my addr 172.21.15.32:0/218979839 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79ba0dd700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b4100240 0x7f79b4197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79b98dc700 1 -- 172.21.15.32:0/218979839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b4100240 msgr2=0x7f79b4197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79b98dc700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b4100240 0x7f79b4197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79b98dc700 1 -- 172.21.15.32:0/218979839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00095f0 con 0x7f79b4101440 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79b98dc700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4101440 0x7f79b4198230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f79a400e920 tx=0x7f79a400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.125+0000 7f79ab7fe700 1 -- 172.21.15.32:0/218979839 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79a400c9d0 con 0x7f79b4101440 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.126+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b419d460 con 0x7f79b4101440 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.126+0000 7f79ab7fe700 1 -- 172.21.15.32:0/218979839 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79a4010430 con 0x7f79b4101440 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.126+0000 7f79ab7fe700 1 -- 172.21.15.32:0/218979839 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79a4018650 con 0x7f79b4101440 2024-05-06T21:28:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.126+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b419d980 con 0x7f79b4101440 2024-05-06T21:28:07.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.127+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b4105520 con 0x7f79b4101440 2024-05-06T21:28:07.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.128+0000 7f79ab7fe700 1 -- 172.21.15.32:0/218979839 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 32) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f79a40105a0 con 0x7f79b4101440 2024-05-06T21:28:07.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.129+0000 7f79ab7fe700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f79a006dfc0 0x7f79a0070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.129+0000 7f79ab7fe700 1 -- 172.21.15.32:0/218979839 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f79a4014070 con 0x7f79b4101440 2024-05-06T21:28:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.129+0000 7f79ba0dd700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f79a006dfc0 0x7f79a0070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.129+0000 7f79ba0dd700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f79a006dfc0 0x7f79a0070470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79b41991d0 tx=0x7f79b0005940 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:07.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.134+0000 7f79ab7fe700 1 -- 172.21.15.32:0/218979839 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f79a4057710 con 0x7f79b4101440 2024-05-06T21:28:07.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.366+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 --> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f79b4061190 con 0x7f79a006dfc0 2024-05-06T21:28:07.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.377+0000 7f79ab7fe700 1 -- 172.21.15.32:0/218979839 <== mgr.14724 v2:172.21.15.32:6800/559791322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f79b4061190 con 0x7f79a006dfc0 2024-05-06T21:28:07.378 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:28:07.378 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (8m) 2s ago 9m 24.6M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:28:07.378 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (10m) 2s ago 10m 7713k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:28:07.378 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (9m) 14s ago 8m 7646k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:28:07.378 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (10m) 2s ago 10m 6665k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:28:07.378 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (8m) 14s ago 8m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:28:07.378 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (8m) 2s ago 9m 88.2M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:28:07.378 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (4m) 2s ago 4m 14.0M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (4m) 2s ago 4m 162M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (4m) 14s ago 4m 138M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (4m) 14s ago 4m 15.4M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (65s) 2s ago 11m 493M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (19s) 14s ago 8m 64.5M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (11m) 2s ago 11m 53.4M 2048M 18.2.0 dc2bc1663786 b06a214f4520 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (8m) 14s ago 8m 42.7M 2048M 18.2.0 dc2bc1663786 8a37ef7f53f9 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (9m) 2s ago 9m 16.0M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (8m) 14s ago 8m 16.7M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (7m) 2s ago 7m 205M 1217M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (7m) 2s ago 7m 230M 1217M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (7m) 2s ago 6m 188M 1217M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (6m) 14s ago 6m 263M 2240M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (6m) 14s ago 6m 232M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:28:07.379 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (5m) 14s ago 5m 229M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:28:07.380 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (27s) 2s ago 9m 45.9M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:28:07.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f79a006dfc0 msgr2=0x7f79a0070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:07.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f79a006dfc0 0x7f79a0070470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79b41991d0 tx=0x7f79b0005940 comp rx=0 tx=0).stop 2024-05-06T21:28:07.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4101440 msgr2=0x7f79b4198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:07.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4101440 0x7f79b4198230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f79a400e920 tx=0x7f79a400ec30 comp rx=0 tx=0).stop 2024-05-06T21:28:07.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 shutdown_connections 2024-05-06T21:28:07.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f79a006dfc0 0x7f79a0070470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79b4100240 0x7f79b4197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 --2- 172.21.15.32:0/218979839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79b4101440 0x7f79b4198230 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 >> 172.21.15.32:0/218979839 conn(0x7f79b40fb7f0 msgr2=0x7f79b4102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:07.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 shutdown_connections 2024-05-06T21:28:07.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.380+0000 7f79bc341700 1 -- 172.21.15.32:0/218979839 wait complete. 2024-05-06T21:28:07.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.495+0000 7fb937b83700 1 -- 172.21.15.32:0/642826283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930101440 msgr2=0x7fb930101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:07.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.495+0000 7fb937b83700 1 --2- 172.21.15.32:0/642826283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930101440 0x7fb930101890 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb924009910 tx=0x7fb924009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:07.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.495+0000 7fb937b83700 1 -- 172.21.15.32:0/642826283 shutdown_connections 2024-05-06T21:28:07.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.495+0000 7fb937b83700 1 --2- 172.21.15.32:0/642826283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930101440 0x7fb930101890 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.495+0000 7fb937b83700 1 --2- 172.21.15.32:0/642826283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb930100240 0x7fb930100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.495+0000 7fb937b83700 1 -- 172.21.15.32:0/642826283 >> 172.21.15.32:0/642826283 conn(0x7fb9300fb7f0 msgr2=0x7fb9300fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:07.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.495+0000 7fb937b83700 1 -- 172.21.15.32:0/642826283 shutdown_connections 2024-05-06T21:28:07.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.495+0000 7fb937b83700 1 -- 172.21.15.32:0/642826283 wait complete. 2024-05-06T21:28:07.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb937b83700 1 Processor -- start 2024-05-06T21:28:07.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb937b83700 1 -- start start 2024-05-06T21:28:07.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb937b83700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930100240 0x7fb930074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:07.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb937b83700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb930101440 0x7fb930073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:07.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb937b83700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb930073680 con 0x7fb930100240 2024-05-06T21:28:07.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb937b83700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300737c0 con 0x7fb930101440 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb93591f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930100240 0x7fb930074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb93591f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930100240 0x7fb930074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39692/0 (socket says 172.21.15.32:39692) 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb93591f700 1 -- 172.21.15.32:0/2369052638 learned_addr learned my addr 172.21.15.32:0/2369052638 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb93511e700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb930101440 0x7fb930073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb93591f700 1 -- 172.21.15.32:0/2369052638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb930101440 msgr2=0x7fb930073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb93591f700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb930101440 0x7fb930073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.496+0000 7fb93591f700 1 -- 172.21.15.32:0/2369052638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240095f0 con 0x7fb930100240 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.497+0000 7fb93591f700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930100240 0x7fb930074af0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb92000efc0 tx=0x7fb92000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.497+0000 7fb92effd700 1 -- 172.21.15.32:0/2369052638 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb920018070 con 0x7fb930100240 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.497+0000 7fb92effd700 1 -- 172.21.15.32:0/2369052638 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb92000f040 con 0x7fb930100240 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.497+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb930073a40 con 0x7fb930100240 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.497+0000 7fb92effd700 1 -- 172.21.15.32:0/2369052638 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb920004490 con 0x7fb930100240 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.497+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb930073f90 con 0x7fb930100240 2024-05-06T21:28:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.498+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb930108d90 con 0x7fb930100240 2024-05-06T21:28:07.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.499+0000 7fb92effd700 1 -- 172.21.15.32:0/2369052638 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 32) v1 ==== 92158+0+0 (secure 0 0 0) 0x7fb9200046c0 con 0x7fb930100240 2024-05-06T21:28:07.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.499+0000 7fb92effd700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fb91806dfc0 0x7fb918070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:07.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.499+0000 7fb92effd700 1 -- 172.21.15.32:0/2369052638 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb92008df50 con 0x7fb930100240 2024-05-06T21:28:07.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.499+0000 7fb93511e700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fb91806dfc0 0x7fb918070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.500+0000 7fb93511e700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fb91806dfc0 0x7fb918070470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb924009fd0 tx=0x7fb924005940 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:07.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.504+0000 7fb92effd700 1 -- 172.21.15.32:0/2369052638 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7fb9200c2470 con 0x7fb930100240 2024-05-06T21:28:07.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.930+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb93019e050 con 0x7fb930100240 2024-05-06T21:28:07.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.930+0000 7fb92effd700 1 -- 172.21.15.32:0/2369052638 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fb93019e050 con 0x7fb930100240 2024-05-06T21:28:07.930 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:28:07.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:28:07.932 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:28:07.932 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-05-06T21:28:07.932 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:28:07.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:28:07.932 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fb91806dfc0 msgr2=0x7fb918070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fb91806dfc0 0x7fb918070470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb924009fd0 tx=0x7fb924005940 comp rx=0 tx=0).stop 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930100240 msgr2=0x7fb930074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930100240 0x7fb930074af0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb92000efc0 tx=0x7fb92000c3a0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 shutdown_connections 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7fb91806dfc0 0x7fb918070470 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb930100240 0x7fb930074af0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 --2- 172.21.15.32:0/2369052638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb930101440 0x7fb930073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 >> 172.21.15.32:0/2369052638 conn(0x7fb9300fb7f0 msgr2=0x7fb930104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:07.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 shutdown_connections 2024-05-06T21:28:07.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:07.932+0000 7fb937b83700 1 -- 172.21.15.32:0/2369052638 wait complete. 2024-05-06T21:28:08.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.052+0000 7f1db2c76700 1 -- 172.21.15.32:0/2488705340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 msgr2=0x7f1dac100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.052+0000 7f1db2c76700 1 --2- 172.21.15.32:0/2488705340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 0x7f1dac100650 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009910 tx=0x7f1da0009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:08.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.052+0000 7f1db2c76700 1 -- 172.21.15.32:0/2488705340 shutdown_connections 2024-05-06T21:28:08.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.052+0000 7f1db2c76700 1 --2- 172.21.15.32:0/2488705340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dac101440 0x7f1dac101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.052+0000 7f1db2c76700 1 --2- 172.21.15.32:0/2488705340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 0x7f1dac100650 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.052+0000 7f1db2c76700 1 -- 172.21.15.32:0/2488705340 >> 172.21.15.32:0/2488705340 conn(0x7f1dac0fb7f0 msgr2=0x7f1dac0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:08.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.052+0000 7f1db2c76700 1 -- 172.21.15.32:0/2488705340 shutdown_connections 2024-05-06T21:28:08.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.052+0000 7f1db2c76700 1 -- 172.21.15.32:0/2488705340 wait complete. 2024-05-06T21:28:08.054 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:07 smithi032 ceph-mon[27179]: pgmap v29: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-05-06T21:28:08.054 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:07 smithi032 ceph-mon[27179]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:08.054 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:07 smithi032 ceph-mon[27179]: Upgrade: Updating mon.smithi032 2024-05-06T21:28:08.054 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:07 smithi032 ceph-mon[27179]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:08.054 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:07 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:28:08.054 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:07 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:28:08.054 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:07 smithi032 ceph-mon[27179]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:08.054 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:07 smithi032 ceph-mon[27179]: Deploying daemon mon.smithi032 on smithi032 2024-05-06T21:28:08.054 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:07 smithi032 ceph-mon[27179]: from='client.24543 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1db2c76700 1 Processor -- start 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1db2c76700 1 -- start start 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1db2c76700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 0x7f1dac197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1db2c76700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dac101440 0x7f1dac198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1db2c76700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac198850 con 0x7f1dac100240 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1db2c76700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac19d260 con 0x7f1dac101440 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1db0a12700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 0x7f1dac197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1db0a12700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 0x7f1dac197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39714/0 (socket says 172.21.15.32:39714) 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1db0a12700 1 -- 172.21.15.32:0/1415575797 learned_addr learned my addr 172.21.15.32:0/1415575797 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:08.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.053+0000 7f1dabfff700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dac101440 0x7f1dac198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.054+0000 7f1db0a12700 1 -- 172.21.15.32:0/1415575797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dac101440 msgr2=0x7f1dac198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.054+0000 7f1db0a12700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dac101440 0x7f1dac198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.054+0000 7f1db0a12700 1 -- 172.21.15.32:0/1415575797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00095f0 con 0x7f1dac100240 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.054+0000 7f1db0a12700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 0x7f1dac197cf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1da000bda0 tx=0x7f1da000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.054+0000 7f1da9ffb700 1 -- 172.21.15.32:0/1415575797 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da001d070 con 0x7f1dac100240 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.054+0000 7f1da9ffb700 1 -- 172.21.15.32:0/1415575797 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1da000f460 con 0x7f1dac100240 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.054+0000 7f1da9ffb700 1 -- 172.21.15.32:0/1415575797 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da0021620 con 0x7f1dac100240 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.054+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac19d400 con 0x7f1dac100240 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.054+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac19d8c0 con 0x7f1dac100240 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.056+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac105520 con 0x7f1dac100240 2024-05-06T21:28:08.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.056+0000 7f1da9ffb700 1 -- 172.21.15.32:0/1415575797 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 32) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f1da000f5d0 con 0x7f1dac100240 2024-05-06T21:28:08.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.056+0000 7f1da9ffb700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f1d9c06dfb0 0x7f1d9c070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:08.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.057+0000 7f1da9ffb700 1 -- 172.21.15.32:0/1415575797 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1da008f030 con 0x7f1dac100240 2024-05-06T21:28:08.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.057+0000 7f1dabfff700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f1d9c06dfb0 0x7f1d9c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:08.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.057+0000 7f1dabfff700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f1d9c06dfb0 0x7f1d9c070460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d98005950 tx=0x7f1d9800b410 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:08.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.061+0000 7f1da9ffb700 1 -- 172.21.15.32:0/1415575797 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f1da00586a0 con 0x7f1dac100240 2024-05-06T21:28:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:07 smithi154 ceph-mon[32880]: pgmap v29: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-05-06T21:28:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:07 smithi154 ceph-mon[32880]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:07 smithi154 ceph-mon[32880]: Upgrade: Updating mon.smithi032 2024-05-06T21:28:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:07 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:07 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:28:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:07 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:28:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:07 smithi154 ceph-mon[32880]: from='mgr.14724 172.21.15.32:0/3884306972' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:07 smithi154 ceph-mon[32880]: Deploying daemon mon.smithi032 on smithi032 2024-05-06T21:28:08.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:07 smithi154 ceph-mon[32880]: from='client.24543 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:08.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.326+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1dac02cc30 con 0x7f1dac100240 2024-05-06T21:28:08.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.327+0000 7f1da9ffb700 1 -- 172.21.15.32:0/1415575797 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f1da005bd60 con 0x7f1dac100240 2024-05-06T21:28:08.328 INFO:teuthology.orchestra.run.smithi032.stdout:e20 2024-05-06T21:28:08.328 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:28:08.328 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:28:08.328 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:28:08.328 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:28:08.329 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:28:08.329 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:28:08.329 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 20 2024-05-06T21:28:08.329 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:28:08.329 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:28:08.330 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:27:07.836937+0000 2024-05-06T21:28:08.330 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:28:08.330 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:28:08.330 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:28:08.330 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:28:08.331 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:28:08.331 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:28:08.331 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:28:08.331 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:28:08.331 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:28:08.331 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:28:08.332 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:28:08.332 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:28:08.332 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:28:08.332 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:28:08.332 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:28:08.333 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:28:08.333 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:28:08.333 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:28:08.333 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:28:08.333 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:28:08.333 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:28:08.334 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:08.334 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:08.334 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:28:08.334 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:28:08.334 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:28:08.334 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:28:08.335 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:08.335 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:08.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f1d9c06dfb0 msgr2=0x7f1d9c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f1d9c06dfb0 0x7f1d9c070460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d98005950 tx=0x7f1d9800b410 comp rx=0 tx=0).stop 2024-05-06T21:28:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 msgr2=0x7f1dac197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 0x7f1dac197cf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1da000bda0 tx=0x7f1da000bdd0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 shutdown_connections 2024-05-06T21:28:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f1d9c06dfb0 0x7f1d9c070460 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dac100240 0x7f1dac197cf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 --2- 172.21.15.32:0/1415575797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dac101440 0x7f1dac198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 >> 172.21.15.32:0/1415575797 conn(0x7f1dac0fb7f0 msgr2=0x7f1dac102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:08.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 shutdown_connections 2024-05-06T21:28:08.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.329+0000 7f1db2c76700 1 -- 172.21.15.32:0/1415575797 wait complete. 2024-05-06T21:28:08.338 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 20 2024-05-06T21:28:08.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.447+0000 7f7aef8e5700 1 -- 172.21.15.32:0/2246657953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 msgr2=0x7f7ae80ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.447+0000 7f7aef8e5700 1 --2- 172.21.15.32:0/2246657953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 0x7f7ae80ff540 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009910 tx=0x7f7ae4009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:08.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.447+0000 7f7aef8e5700 1 -- 172.21.15.32:0/2246657953 shutdown_connections 2024-05-06T21:28:08.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.447+0000 7f7aef8e5700 1 --2- 172.21.15.32:0/2246657953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ae81003d0 0x7f7ae8100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.447+0000 7f7aef8e5700 1 --2- 172.21.15.32:0/2246657953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 0x7f7ae80ff540 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.447+0000 7f7aef8e5700 1 -- 172.21.15.32:0/2246657953 >> 172.21.15.32:0/2246657953 conn(0x7f7ae80fa780 msgr2=0x7f7ae80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:08.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.447+0000 7f7aef8e5700 1 -- 172.21.15.32:0/2246657953 shutdown_connections 2024-05-06T21:28:08.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.447+0000 7f7aef8e5700 1 -- 172.21.15.32:0/2246657953 wait complete. 2024-05-06T21:28:08.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aef8e5700 1 Processor -- start 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aef8e5700 1 -- start start 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aef8e5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 0x7f7ae8195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aef8e5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ae81003d0 0x7f7ae8195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aef8e5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8196600 con 0x7f7ae80ff130 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aef8e5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8196740 con 0x7f7ae81003d0 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aed681700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 0x7f7ae8195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aed681700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 0x7f7ae8195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39732/0 (socket says 172.21.15.32:39732) 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aed681700 1 -- 172.21.15.32:0/368900876 learned_addr learned my addr 172.21.15.32:0/368900876 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.448+0000 7f7aece80700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ae81003d0 0x7f7ae8195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.449+0000 7f7aed681700 1 -- 172.21.15.32:0/368900876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ae81003d0 msgr2=0x7f7ae8195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.449+0000 7f7aed681700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ae81003d0 0x7f7ae8195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.449+0000 7f7aed681700 1 -- 172.21.15.32:0/368900876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae40095f0 con 0x7f7ae80ff130 2024-05-06T21:28:08.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.449+0000 7f7aed681700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 0x7f7ae8195aa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400bd70 tx=0x7f7ae400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:08.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.449+0000 7f7ade7fc700 1 -- 172.21.15.32:0/368900876 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae401d070 con 0x7f7ae80ff130 2024-05-06T21:28:08.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.449+0000 7f7ade7fc700 1 -- 172.21.15.32:0/368900876 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ae4005dc0 con 0x7f7ae80ff130 2024-05-06T21:28:08.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.449+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae819b190 con 0x7f7ae80ff130 2024-05-06T21:28:08.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.449+0000 7f7ade7fc700 1 -- 172.21.15.32:0/368900876 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae4021410 con 0x7f7ae80ff130 2024-05-06T21:28:08.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.449+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae819b630 con 0x7f7ae80ff130 2024-05-06T21:28:08.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.451+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae8107c10 con 0x7f7ae80ff130 2024-05-06T21:28:08.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.451+0000 7f7ade7fc700 1 -- 172.21.15.32:0/368900876 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 32) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f7ae400f7d0 con 0x7f7ae80ff130 2024-05-06T21:28:08.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.452+0000 7f7ade7fc700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f7ad406dfc0 0x7f7ad4070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:08.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.452+0000 7f7ade7fc700 1 -- 172.21.15.32:0/368900876 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7ae408f140 con 0x7f7ae80ff130 2024-05-06T21:28:08.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.452+0000 7f7aece80700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f7ad406dfc0 0x7f7ad4070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:08.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.452+0000 7f7aece80700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f7ad406dfc0 0x7f7ad4070470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8007be0 tx=0x7f7ad80073d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.457+0000 7f7ade7fc700 1 -- 172.21.15.32:0/368900876 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f7ae405c260 con 0x7f7ae80ff130 2024-05-06T21:28:08.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.768+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 --> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae819bcc0 con 0x7f7ad406dfc0 2024-05-06T21:28:08.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.769+0000 7f7ade7fc700 1 -- 172.21.15.32:0/368900876 <== mgr.14724 v2:172.21.15.32:6800/559791322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7ae819bcc0 con 0x7f7ad406dfc0 2024-05-06T21:28:08.769 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:28:08.769 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:28:08.770 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:28:08.770 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:28:08.770 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:28:08.770 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:28:08.770 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:28:08.770 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "2/23 daemons upgraded", 2024-05-06T21:28:08.770 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading mon daemons", 2024-05-06T21:28:08.770 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:28:08.770 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:28:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f7ad406dfc0 msgr2=0x7f7ad4070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f7ad406dfc0 0x7f7ad4070470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8007be0 tx=0x7f7ad80073d0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 msgr2=0x7f7ae8195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 0x7f7ae8195aa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400bd70 tx=0x7f7ae400bda0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 shutdown_connections 2024-05-06T21:28:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f7ad406dfc0 0x7f7ad4070470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ae80ff130 0x7f7ae8195aa0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 --2- 172.21.15.32:0/368900876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ae81003d0 0x7f7ae8195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 >> 172.21.15.32:0/368900876 conn(0x7f7ae80fa780 msgr2=0x7f7ae8068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 shutdown_connections 2024-05-06T21:28:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.771+0000 7f7aef8e5700 1 -- 172.21.15.32:0/368900876 wait complete. 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.883+0000 7f608a826700 1 -- 172.21.15.32:0/2261615808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60841003d0 msgr2=0x7f6084100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.883+0000 7f608a826700 1 --2- 172.21.15.32:0/2261615808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60841003d0 0x7f6084100840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6078009910 tx=0x7f6078009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.883+0000 7f608a826700 1 -- 172.21.15.32:0/2261615808 shutdown_connections 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.883+0000 7f608a826700 1 --2- 172.21.15.32:0/2261615808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60841003d0 0x7f6084100840 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.883+0000 7f608a826700 1 --2- 172.21.15.32:0/2261615808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60840ff130 0x7f60840ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.883+0000 7f608a826700 1 -- 172.21.15.32:0/2261615808 >> 172.21.15.32:0/2261615808 conn(0x7f60840fa780 msgr2=0x7f60840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.883+0000 7f608a826700 1 -- 172.21.15.32:0/2261615808 shutdown_connections 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.883+0000 7f608a826700 1 -- 172.21.15.32:0/2261615808 wait complete. 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f608a826700 1 Processor -- start 2024-05-06T21:28:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f608a826700 1 -- start start 2024-05-06T21:28:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f608a826700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60840ff130 0x7f6084194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f608a826700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841003d0 0x7f6084194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f608a826700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60841954c0 con 0x7f60840ff130 2024-05-06T21:28:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f608a826700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6084195600 con 0x7f60841003d0 2024-05-06T21:28:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f6083fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60840ff130 0x7f6084194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f6083fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60840ff130 0x7f6084194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39756/0 (socket says 172.21.15.32:39756) 2024-05-06T21:28:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f6083fff700 1 -- 172.21.15.32:0/2187006885 learned_addr learned my addr 172.21.15.32:0/2187006885 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.884+0000 7f60837fe700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841003d0 0x7f6084194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f6083fff700 1 -- 172.21.15.32:0/2187006885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841003d0 msgr2=0x7f6084194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f6083fff700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841003d0 0x7f6084194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f6083fff700 1 -- 172.21.15.32:0/2187006885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780095f0 con 0x7f60840ff130 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f60837fe700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841003d0 0x7f6084194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f6083fff700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60840ff130 0x7f6084194960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f607400eab0 tx=0x7f607400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f60817fa700 1 -- 172.21.15.32:0/2187006885 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6074013070 con 0x7f60840ff130 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f60817fa700 1 -- 172.21.15.32:0/2187006885 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6074017410 con 0x7f60840ff130 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f60817fa700 1 -- 172.21.15.32:0/2187006885 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60740165e0 con 0x7f60840ff130 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60840685a0 con 0x7f60840ff130 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.885+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6084068af0 con 0x7f60840ff130 2024-05-06T21:28:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.886+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6084107c10 con 0x7f60840ff130 2024-05-06T21:28:08.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.887+0000 7f60817fa700 1 -- 172.21.15.32:0/2187006885 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 32) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f6074017580 con 0x7f60840ff130 2024-05-06T21:28:08.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.887+0000 7f60817fa700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f606c06dfc0 0x7f606c070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:08.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.887+0000 7f60817fa700 1 -- 172.21.15.32:0/2187006885 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f607408f5d0 con 0x7f60840ff130 2024-05-06T21:28:08.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.887+0000 7f60837fe700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f606c06dfc0 0x7f606c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:08.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.888+0000 7f60837fe700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f606c06dfc0 0x7f606c070470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6078009fd0 tx=0x7f6078005940 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:08.892+0000 7f60817fa700 1 -- 172.21.15.32:0/2187006885 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185428 (secure 0 0 0) 0x7f607405c820 con 0x7f60840ff130 2024-05-06T21:28:09.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:08 smithi154 ceph-mon[32880]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:09.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:08 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/2369052638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:28:09.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:08 smithi154 ceph-mon[32880]: from='client.? 172.21.15.32:0/1415575797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:28:09.171 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:08 smithi032 ceph-mon[27179]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:09.171 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:08 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/2369052638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:28:09.172 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:08 smithi032 ceph-mon[27179]: from='client.? 172.21.15.32:0/1415575797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:28:09.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.242+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6084107e00 con 0x7f60840ff130 2024-05-06T21:28:09.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.243+0000 7f60817fa700 1 -- 172.21.15.32:0/2187006885 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f607405c3b0 con 0x7f60840ff130 2024-05-06T21:28:09.244 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f606c06dfc0 msgr2=0x7f606c070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f606c06dfc0 0x7f606c070470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6078009fd0 tx=0x7f6078005940 comp rx=0 tx=0).stop 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60840ff130 msgr2=0x7f6084194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60840ff130 0x7f6084194960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f607400eab0 tx=0x7f607400edc0 comp rx=0 tx=0).stop 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 shutdown_connections 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:6800/559791322,v1:172.21.15.32:6801/559791322] conn(0x7f606c06dfc0 0x7f606c070470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60840ff130 0x7f6084194960 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 --2- 172.21.15.32:0/2187006885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841003d0 0x7f6084194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 >> 172.21.15.32:0/2187006885 conn(0x7f60840fa780 msgr2=0x7f6084103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 shutdown_connections 2024-05-06T21:28:09.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:09.245+0000 7f608a826700 1 -- 172.21.15.32:0/2187006885 wait complete. 2024-05-06T21:28:09.446 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:09 smithi032 systemd[1]: Stopping Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:28:09.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:09 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032[27175]: 2024-05-06T21:28:09.446+0000 7ff5773d4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi032 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:28:09.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:09 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032[27175]: 2024-05-06T21:28:09.446+0000 7ff5773d4700 -1 mon.smithi032@0(leader) e2 *** Got Signal Terminated *** 2024-05-06T21:28:09.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:09 smithi032 podman[76458]: 2024-05-06 21:28:09.630629148 +0000 UTC m=+0.305432000 container died b06a214f4520aaf7f5d13e1f511b6714213190207c21135a394cb2ee6fdd5787 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1) 2024-05-06T21:28:10.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:10 smithi032 podman[76458]: 2024-05-06 21:28:10.422491837 +0000 UTC m=+1.097294672 container cleanup b06a214f4520aaf7f5d13e1f511b6714213190207c21135a394cb2ee6fdd5787 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, ceph=True, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.build-date=20231212, GIT_CLEAN=True) 2024-05-06T21:28:10.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:10 smithi032 bash[76458]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032 2024-05-06T21:28:10.758 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-05-06T21:28:10.758 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-06T21:28:10.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:10 smithi032 podman[76472]: 2024-05-06 21:28:10.674225236 +0000 UTC m=+1.038606377 container remove b06a214f4520aaf7f5d13e1f511b6714213190207c21135a394cb2ee6fdd5787 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.build-date=20231212, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-06T21:28:10.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:10 smithi032 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032.service: Deactivated successfully. 2024-05-06T21:28:10.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:10 smithi032 systemd[1]: Stopped Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:28:10.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:10 smithi032 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032.service: Consumed 13.259s CPU time. 2024-05-06T21:28:11.166 DEBUG:teuthology.parallel:result is None 2024-05-06T21:28:11.395 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 systemd[1]: Starting Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:28:11.396 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 podman[76624]: 2024-05-06 21:28:11.251383319 +0000 UTC m=+0.019795612 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:28:11.658 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 podman[76624]: 2024-05-06 21:28:11.397264225 +0000 UTC m=+0.165676507 container create 6db9bd569f47ffa7da1fb144ef9da907e3fa8daa2fd9ed1cb5c94f4f0630317a (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-06T21:28:11.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 podman[76624]: 2024-05-06 21:28:11.658823145 +0000 UTC m=+0.427235446 container init 6db9bd569f47ffa7da1fb144ef9da907e3fa8daa2fd9ed1cb5c94f4f0630317a (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:28:11.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 podman[76624]: 2024-05-06 21:28:11.670728901 +0000 UTC m=+0.439141185 container start 6db9bd569f47ffa7da1fb144ef9da907e3fa8daa2fd9ed1cb5c94f4f0630317a (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-05-06T21:28:11.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T21:28:11.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev), process ceph-mon, pid 2 2024-05-06T21:28:11.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: pidfile_write: ignore empty --pid-file 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: load: jerasure load: lrc 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: RocksDB version: 7.9.2 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Git sha 0 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Compile date 2024-05-02 20:02:22 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: DB SUMMARY 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: DB Session ID: G3YP2VLA9BJW19WW19UY 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: CURRENT file: CURRENT 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1501 Bytes 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi032/store.db dir, Total Num: 1, files: 000032.sst 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi032/store.db: 000030.log size: 1237468 ; 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.error_if_exists: 0 2024-05-06T21:28:11.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.create_if_missing: 0 2024-05-06T21:28:11.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.paranoid_checks: 1 2024-05-06T21:28:11.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T21:28:11.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T21:28:11.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T21:28:11.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.env: 0x55955f84ec60 2024-05-06T21:28:11.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T21:28:11.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.info_log: 0x55956189f980 2024-05-06T21:28:11.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.statistics: (nil) 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.use_fsync: 0 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_log_file_size: 0 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.allow_fallocate: 1 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T21:28:11.977 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.use_direct_reads: 0 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.db_log_dir: 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.wal_dir: 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T21:28:11.978 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.write_buffer_manager: 0x5595618721e0 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.unordered_write: 0 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T21:28:11.979 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.row_cache: None 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.wal_filter: None 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.two_write_queues: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.wal_compression: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.atomic_flush: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.log_readahead_size: 0 2024-05-06T21:28:11.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_background_jobs: 2 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_background_compactions: -1 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_subcompactions: 1 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T21:28:11.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_open_files: -1 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_background_flushes: -1 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Compression algorithms supported: 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: kZSTD supported: 0 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: kXpressCompression supported: 0 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: kZlibCompression supported: 1 2024-05-06T21:28:11.982 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: kSnappyCompression supported: 1 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: kLZ4Compression supported: 1 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: kBZip2Compression supported: 0 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi032/store.db/MANIFEST-000015 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.merge_operator: 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_filter: None 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55956189fa80) 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: cache_index_and_filter_blocks: 1 2024-05-06T21:28:11.983 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: pin_top_level_index_and_filter: 1 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: index_type: 0 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: data_block_index_type: 0 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: index_shortening: 1 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: checksum: 4 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: no_block_cache: 0 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_cache: 0x5595618a3090 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_cache_name: BinnedLRUCache 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_cache_options: 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: capacity : 536870912 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: num_shard_bits : 4 2024-05-06T21:28:11.984 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: strict_capacity_limit : 0 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: high_pri_pool_ratio: 0.000 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_cache_compressed: (nil) 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: persistent_cache: (nil) 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_size: 4096 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_size_deviation: 10 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_restart_interval: 16 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: index_block_restart_interval: 1 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: metadata_block_size: 4096 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: partition_filters: 0 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: use_delta_encoding: 1 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: filter_policy: bloomfilter 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: whole_key_filtering: 1 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: verify_compression: 0 2024-05-06T21:28:11.985 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: read_amp_bytes_per_bit: 0 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: format_version: 5 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: enable_index_compression: 1 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: block_align: 0 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: max_auto_readahead_size: 262144 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: prepopulate_block_cache: 0 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: initial_auto_readahead_size: 8192 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression: NoCompression 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T21:28:11.986 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.num_levels: 7 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T21:28:11.987 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T21:28:11.988 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T21:28:11.989 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.table_properties_collectors: 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.inplace_update_support: 0 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T21:28:11.990 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.bloom_locality: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.max_successive_merges: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.ttl: 2592000 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.enable_blob_files: false 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.min_blob_size: 0 2024-05-06T21:28:11.991 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi032/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12103, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 41af0929-26e0-4f22-9c84-6f8f66308b02 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030891729423, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-05-06T21:28:11.992 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030891739893, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 1081542, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12104, "largest_seqno": 12852, "table_properties": {"data_size": 1077538, "index_size": 2158, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 837, "raw_key_size": 7484, "raw_average_key_size": 23, "raw_value_size": 1070495, "raw_average_value_size": 3345, "num_data_blocks": 98, "num_entries": 320, "num_filter_entries": 320, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715030891, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "41af0929-26e0-4f22-9c84-6f8f66308b02", "db_session_id": "G3YP2VLA9BJW19WW19UY", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030891740064, "job": 1, "event": "recovery_finished"} 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi032/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559561994000 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: DB pointer 0x55956197e000 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ** DB Stats ** 2024-05-06T21:28:11.993 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ** Compaction Stats [default] ** 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: L0 1/0 1.03 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 217.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-05-06T21:28:11.994 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: L6 1/0 5.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Sum 2/0 6.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 217.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 217.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ** Compaction Stats [default] ** 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 217.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T21:28:11.995 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Cumulative compaction: 0.00 GB write, 42.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Interval compaction: 0.00 GB write, 42.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Block cache BinnedLRUCache@0x5595618a3090#2 capacity: 512.00 MB usage: 3.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.7e-05 secs_since: 0 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.91 KB,0.000172853%) IndexBlock(1,2.33 KB,0.000444055%) Misc(1,0.00 KB,0%) 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: starting mon.smithi032 rank 0 at public addrs [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] at bind addrs [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi032 fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: mon.smithi032@-1(???) e2 preinit fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: mon.smithi032@-1(???).mds e20 new map 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: mon.smithi032@-1(???).mds e20 print_map 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: e20 2024-05-06T21:28:11.996 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: legacy client fscid: 1 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Filesystem 'cephfs' (1) 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: fs_name cephfs 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: epoch 20 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: modified 2024-05-06T21:27:07.836937+0000 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: tableserver 0 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: root 0 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: session_timeout 60 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: session_autoclose 300 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: max_file_size 1099511627776 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: max_xattr_size 65536 2024-05-06T21:28:11.997 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: required_client_features {} 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: last_failure 0 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: last_failure_osd_epoch 47 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: max_mds 2 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: in 0,1 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: up {0=14486,1=24277} 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: failed 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: damaged 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: stopped 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: data_pools [3] 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: metadata_pool 2 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: inline_data disabled 2024-05-06T21:28:11.998 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: balancer 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: bal_rank_mask -1 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: standby_count_wanted 1 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: qdb_cluster leader: 0 members: 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: [mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: [mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: Standby daemons: 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: [mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout: [mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: mon.smithi032@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: mon.smithi032@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: mon.smithi032@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-06T21:28:11.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: mon.smithi032@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-06T21:28:12.000 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 ceph-mon[76650]: mon.smithi032@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-05-06T21:28:12.000 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 bash[76624]: 6db9bd569f47ffa7da1fb144ef9da907e3fa8daa2fd9ed1cb5c94f4f0630317a 2024-05-06T21:28:12.000 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:11 smithi032 systemd[1]: Started Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:28:13.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: pgmap v31: 65 pgs: 65 active+clean; 321 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 398 op/s 2024-05-06T21:28:13.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: mon.smithi032 calling monitor election 2024-05-06T21:28:13.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: mon.smithi032 is new leader, mons smithi032,smithi154 in quorum (ranks 0,1) 2024-05-06T21:28:13.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: monmap epoch 2 2024-05-06T21:28:13.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:28:13.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: last_changed 2024-05-06T21:19:23.294060+0000 2024-05-06T21:28:13.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: created 2024-05-06T21:16:38.421123+0000 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: min_mon_release 18 (reef) 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: election_strategy: 1 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: 0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.smithi032 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.smithi154 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: osdmap e49: 6 total, 6 up, 6 in 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: mgrmap e32: smithi032.ecoohh(active, since 58s), standbys: smithi154.kilvol 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: overall HEALTH_OK 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: from='mgr.14724 ' entity='' 2024-05-06T21:28:13.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:13 smithi032 ceph-mon[76650]: mgrmap e33: smithi032.ecoohh(active, since 58s), standbys: smithi154.kilvol 2024-05-06T21:28:13.594 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: pgmap v31: 65 pgs: 65 active+clean; 321 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 398 op/s 2024-05-06T21:28:13.594 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: mon.smithi032 calling monitor election 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: mon.smithi032 is new leader, mons smithi032,smithi154 in quorum (ranks 0,1) 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: monmap epoch 2 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: last_changed 2024-05-06T21:19:23.294060+0000 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: created 2024-05-06T21:16:38.421123+0000 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: min_mon_release 18 (reef) 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: election_strategy: 1 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: 0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.smithi032 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.smithi154 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: osdmap e49: 6 total, 6 up, 6 in 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: mgrmap e32: smithi032.ecoohh(active, since 58s), standbys: smithi154.kilvol 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: overall HEALTH_OK 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: from='mgr.14724 ' entity='' 2024-05-06T21:28:13.595 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:13 smithi154 ceph-mon[32880]: mgrmap e33: smithi032.ecoohh(active, since 58s), standbys: smithi154.kilvol 2024-05-06T21:28:16.718 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-05-06T21:28:16.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-06T21:28:17.002 DEBUG:teuthology.parallel:result is None 2024-05-06T21:28:17.003 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-06T21:28:20.615 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-06T21:28:20.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-05-06T21:28:20.651 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-05-06T21:28:20.651 DEBUG:teuthology.parallel:result is None 2024-05-06T21:28:20.900 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: Active manager daemon smithi032.ecoohh restarted 2024-05-06T21:28:20.900 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: Activating manager daemon smithi032.ecoohh 2024-05-06T21:28:20.900 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: osdmap e50: 6 total, 6 up, 6 in 2024-05-06T21:28:20.900 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: mgrmap e34: smithi032.ecoohh(active, starting, since 0.0056517s), standbys: smithi154.kilvol 2024-05-06T21:28:20.900 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:28:20.900 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi154.kilvol", "id": "smithi154.kilvol"}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:28:20.901 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:28:20.902 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:28:20.902 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:28:20.902 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:20 smithi154 ceph-mon[32880]: Manager daemon smithi032.ecoohh is now available 2024-05-06T21:28:20.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: Active manager daemon smithi032.ecoohh restarted 2024-05-06T21:28:20.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: Activating manager daemon smithi032.ecoohh 2024-05-06T21:28:20.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: osdmap e50: 6 total, 6 up, 6 in 2024-05-06T21:28:20.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: mgrmap e34: smithi032.ecoohh(active, starting, since 0.0056517s), standbys: smithi154.kilvol 2024-05-06T21:28:20.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi032.ecoohh", "id": "smithi032.ecoohh"}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr metadata", "who": "smithi154.kilvol", "id": "smithi154.kilvol"}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:28:20.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:28:20.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T21:28:20.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T21:28:20.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T21:28:20.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:20 smithi032 ceph-mon[76650]: Manager daemon smithi032.ecoohh is now available 2024-05-06T21:28:21.927 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:28:21.927 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:28:21.928 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:28:21.928 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:28:21.928 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: Standby manager daemon smithi154.kilvol restarted 2024-05-06T21:28:21.928 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:28:21.928 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: from='mgr.? 172.21.15.154:0/1497147053' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:28:21.928 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: from='mgr.? 172.21.15.154:0/1497147053' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:28:21.928 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: from='mgr.? 172.21.15.154:0/1497147053' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:28:21.928 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: from='mgr.? 172.21.15.154:0/1497147053' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:28:21.928 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:21 smithi032 ceph-mon[76650]: mgrmap e35: smithi032.ecoohh(active, since 1.01371s), standbys: smithi154.kilvol 2024-05-06T21:28:21.937 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/mirror_snapshot_schedule"}]: dispatch 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi032.ecoohh/trash_purge_schedule"}]: dispatch 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: Standby manager daemon smithi154.kilvol restarted 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: Standby manager daemon smithi154.kilvol started 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/1497147053' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/crt"}]: dispatch 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/1497147053' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/1497147053' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi154.kilvol/key"}]: dispatch 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: from='mgr.? 172.21.15.154:0/1497147053' entity='mgr.smithi154.kilvol' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T21:28:21.938 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:21 smithi154 ceph-mon[32880]: mgrmap e35: smithi032.ecoohh(active, since 1.01371s), standbys: smithi154.kilvol 2024-05-06T21:28:22.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:22 smithi032 ceph-mon[76650]: [06/May/2024:21:28:21] ENGINE Bus STARTING 2024-05-06T21:28:22.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:22 smithi032 ceph-mon[76650]: [06/May/2024:21:28:21] ENGINE Serving on http://172.21.15.32:8765 2024-05-06T21:28:22.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:22 smithi032 ceph-mon[76650]: [06/May/2024:21:28:21] ENGINE Serving on https://172.21.15.32:7150 2024-05-06T21:28:22.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:22 smithi032 ceph-mon[76650]: [06/May/2024:21:28:21] ENGINE Bus STARTED 2024-05-06T21:28:22.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:22 smithi032 ceph-mon[76650]: pgmap v3: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:22.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:22 smithi154 ceph-mon[32880]: [06/May/2024:21:28:21] ENGINE Bus STARTING 2024-05-06T21:28:22.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:22 smithi154 ceph-mon[32880]: [06/May/2024:21:28:21] ENGINE Serving on http://172.21.15.32:8765 2024-05-06T21:28:22.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:22 smithi154 ceph-mon[32880]: [06/May/2024:21:28:21] ENGINE Serving on https://172.21.15.32:7150 2024-05-06T21:28:22.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:22 smithi154 ceph-mon[32880]: [06/May/2024:21:28:21] ENGINE Bus STARTED 2024-05-06T21:28:22.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:22 smithi154 ceph-mon[32880]: pgmap v3: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:23.802 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:23 smithi032 ceph-mon[76650]: pgmap v4: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:23.802 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:23 smithi032 ceph-mon[76650]: mgrmap e36: smithi032.ecoohh(active, since 2s), standbys: smithi154.kilvol 2024-05-06T21:28:24.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:23 smithi154 ceph-mon[32880]: pgmap v4: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:24.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:23 smithi154 ceph-mon[32880]: mgrmap e36: smithi032.ecoohh(active, since 2s), standbys: smithi154.kilvol 2024-05-06T21:28:25.303 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:25 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:25.303 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:25 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:25.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:25 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:25.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:25 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:26.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:26 smithi032 ceph-mon[76650]: pgmap v5: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:26.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:26 smithi032 ceph-mon[76650]: mgrmap e37: smithi032.ecoohh(active, since 4s), standbys: smithi154.kilvol 2024-05-06T21:28:26.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:26.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:26.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:26 smithi154 ceph-mon[32880]: pgmap v5: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:26.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:26 smithi154 ceph-mon[32880]: mgrmap e37: smithi032.ecoohh(active, since 4s), standbys: smithi154.kilvol 2024-05-06T21:28:26.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:26 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:26.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:26 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:27.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:27 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:27.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:27 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:27.641 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:27 smithi154 ceph-mon[32880]: pgmap v6: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:27.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:27 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:27.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:27 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:27.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:27 smithi032 ceph-mon[76650]: pgmap v6: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:28.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:28 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:28.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:28 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:28.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:28 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:28.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:28 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:28.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:28 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:28.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:28 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:28:29.011 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:28 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:29.011 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:28 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:29.011 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:28 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:29.011 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:28 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:29.011 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:28 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:29.011 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:28 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:28:29.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: Updating smithi032:/etc/ceph/ceph.conf 2024-05-06T21:28:29.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-06T21:28:29.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:28:29.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:28:29.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: pgmap v7: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-05-06T21:28:29.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:28:29.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:28:29.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:28:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:28:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:28:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:28:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: Updating smithi032:/etc/ceph/ceph.conf 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: pgmap v7: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: Updating smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: Updating smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:30.082 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:30.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:30.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:30.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:30.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:28:30.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:28:30.083 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:29 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T21:28:32.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:32 smithi154 ceph-mon[32880]: pgmap v8: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-05-06T21:28:32.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:32 smithi154 ceph-mon[32880]: Upgrade: Updating mon.smithi154 2024-05-06T21:28:32.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:32 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:32.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:32 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:28:32.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:32 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:28:32.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:32 smithi154 ceph-mon[32880]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:32.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:32 smithi154 ceph-mon[32880]: Deploying daemon mon.smithi154 on smithi154 2024-05-06T21:28:32.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:32 smithi032 ceph-mon[76650]: pgmap v8: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-05-06T21:28:32.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:32 smithi032 ceph-mon[76650]: Upgrade: Updating mon.smithi154 2024-05-06T21:28:32.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:32 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:32.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:32 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:28:32.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:32 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:28:32.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:32 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:32.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:32 smithi032 ceph-mon[76650]: Deploying daemon mon.smithi154 on smithi154 2024-05-06T21:28:33.276 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:33 smithi154 systemd[1]: Stopping Ceph mon.smithi154 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:28:33.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:33 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154[32874]: 2024-05-06T21:28:33.276+0000 7f1883514700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi154 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:28:33.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:33 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154[32874]: 2024-05-06T21:28:33.276+0000 7f1883514700 -1 mon.smithi154@1(peon) e2 *** Got Signal Terminated *** 2024-05-06T21:28:33.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:33 smithi154 podman[63458]: 2024-05-06 21:28:33.419914361 +0000 UTC m=+0.271538862 container died 8a37ef7f53f908f8bf98f76bf238a5723421c86071a2f43d7be5fb93ed3602ac (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-05-06T21:28:34.026 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:33 smithi154 podman[63458]: 2024-05-06 21:28:33.834870261 +0000 UTC m=+0.686494765 container cleanup 8a37ef7f53f908f8bf98f76bf238a5723421c86071a2f43d7be5fb93ed3602ac (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-05-06T21:28:34.027 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:33 smithi154 bash[63458]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154 2024-05-06T21:28:34.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 podman[63472]: 2024-05-06 21:28:34.028102315 +0000 UTC m=+0.606435948 container remove 8a37ef7f53f908f8bf98f76bf238a5723421c86071a2f43d7be5fb93ed3602ac (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2) 2024-05-06T21:28:34.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi154.service: Deactivated successfully. 2024-05-06T21:28:34.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 systemd[1]: Stopped Ceph mon.smithi154 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:28:34.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi154.service: Consumed 6.643s CPU time. 2024-05-06T21:28:34.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 systemd[1]: Starting Ceph mon.smithi154 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:28:34.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 podman[63602]: 2024-05-06 21:28:34.579275615 +0000 UTC m=+0.109618846 container create 88f330a92df2921a27f4a34198fdda2864150239453928c8a75e226c8dc4a75b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-06T21:28:34.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 podman[63602]: 2024-05-06 21:28:34.48812955 +0000 UTC m=+0.018472787 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:28:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 podman[63602]: 2024-05-06 21:28:34.806652366 +0000 UTC m=+0.336995598 container init 88f330a92df2921a27f4a34198fdda2864150239453928c8a75e226c8dc4a75b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-06T21:28:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 podman[63602]: 2024-05-06 21:28:34.809742064 +0000 UTC m=+0.340085291 container start 88f330a92df2921a27f4a34198fdda2864150239453928c8a75e226c8dc4a75b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:28:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T21:28:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev), process ceph-mon, pid 2 2024-05-06T21:28:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: pidfile_write: ignore empty --pid-file 2024-05-06T21:28:35.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: load: jerasure load: lrc 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: RocksDB version: 7.9.2 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Git sha 0 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Compile date 2024-05-02 20:02:22 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: DB SUMMARY 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: DB Session ID: AJHQ09SVE4B7XZSWW160 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: CURRENT file: CURRENT 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1395 Bytes 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi154/store.db dir, Total Num: 1, files: 000027.sst 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi154/store.db: 000025.log size: 4447416 ; 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.error_if_exists: 0 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.create_if_missing: 0 2024-05-06T21:28:35.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.paranoid_checks: 1 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.env: 0x5616c30bac60 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.info_log: 0x5616c4659980 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.statistics: (nil) 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.use_fsync: 0 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_log_file_size: 0 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T21:28:35.120 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.allow_fallocate: 1 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.use_direct_reads: 0 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.db_log_dir: 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.wal_dir: 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T21:28:35.121 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.write_buffer_manager: 0x5616c462c1e0 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.unordered_write: 0 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T21:28:35.122 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T21:28:35.123 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.row_cache: None 2024-05-06T21:28:35.123 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.wal_filter: None 2024-05-06T21:28:35.124 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T21:28:35.124 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T21:28:35.124 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.two_write_queues: 0 2024-05-06T21:28:35.124 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T21:28:35.124 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.wal_compression: 0 2024-05-06T21:28:35.124 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.atomic_flush: 0 2024-05-06T21:28:35.124 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T21:28:35.124 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.log_readahead_size: 0 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_background_jobs: 2 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_background_compactions: -1 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_subcompactions: 1 2024-05-06T21:28:35.125 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_open_files: -1 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_background_flushes: -1 2024-05-06T21:28:35.126 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Compression algorithms supported: 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: kZSTD supported: 0 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: kXpressCompression supported: 0 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: kZlibCompression supported: 1 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: kSnappyCompression supported: 1 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: kLZ4Compression supported: 1 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: kBZip2Compression supported: 0 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi154/store.db/MANIFEST-000010 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.merge_operator: 2024-05-06T21:28:35.127 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_filter: None 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5616c4659a80) 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: cache_index_and_filter_blocks: 1 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: pin_top_level_index_and_filter: 1 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: index_type: 0 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: data_block_index_type: 0 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: index_shortening: 1 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T21:28:35.128 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: checksum: 4 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: no_block_cache: 0 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_cache: 0x5616c465d090 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_cache_name: BinnedLRUCache 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_cache_options: 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: capacity : 536870912 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: num_shard_bits : 4 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: strict_capacity_limit : 0 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: high_pri_pool_ratio: 0.000 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_cache_compressed: (nil) 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: persistent_cache: (nil) 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_size: 4096 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_size_deviation: 10 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_restart_interval: 16 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: index_block_restart_interval: 1 2024-05-06T21:28:35.129 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: metadata_block_size: 4096 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: partition_filters: 0 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: use_delta_encoding: 1 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: filter_policy: bloomfilter 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: whole_key_filtering: 1 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: verify_compression: 0 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: read_amp_bytes_per_bit: 0 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: format_version: 5 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: enable_index_compression: 1 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: block_align: 0 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: max_auto_readahead_size: 262144 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: prepopulate_block_cache: 0 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: initial_auto_readahead_size: 8192 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T21:28:35.130 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression: NoCompression 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.num_levels: 7 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T21:28:35.131 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T21:28:35.132 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T21:28:35.133 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T21:28:35.134 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.table_properties_collectors: 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.inplace_update_support: 0 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.bloom_locality: 0 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.max_successive_merges: 0 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T21:28:35.135 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.ttl: 2592000 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.enable_blob_files: false 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.min_blob_size: 0 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T21:28:35.136 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi154/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12145, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9c3f6e81-7f76-418c-8040-903bef5d9c86 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030914839746, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030914850158, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2702160, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12150, "largest_seqno": 13426, "table_properties": {"data_size": 2696286, "index_size": 3511, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1349, "raw_key_size": 12101, "raw_average_key_size": 23, "raw_value_size": 2685002, "raw_average_value_size": 5203, "num_data_blocks": 162, "num_entries": 516, "num_filter_entries": 516, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715030914, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9c3f6e81-7f76-418c-8040-903bef5d9c86", "db_session_id": "AJHQ09SVE4B7XZSWW160", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715030914850285, "job": 1, "event": "recovery_finished"} 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi154/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5616c474e000 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: DB pointer 0x5616c4738000 2024-05-06T21:28:35.137 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ** DB Stats ** 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ** Compaction Stats [default] ** 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T21:28:35.138 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: L0 1/0 2.58 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 630.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: L6 1/0 5.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Sum 2/0 8.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 630.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 630.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ** Compaction Stats [default] ** 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 630.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T21:28:35.139 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Cumulative compaction: 0.00 GB write, 155.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Interval compaction: 0.00 GB write, 155.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Block cache BinnedLRUCache@0x5616c465d090#2 capacity: 512.00 MB usage: 5.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: starting mon.smithi154 rank 1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi154 fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: mon.smithi154@-1(???) e2 preinit fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:28:35.140 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: mon.smithi154@-1(???).mds e20 new map 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: mon.smithi154@-1(???).mds e20 print_map 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: e20 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: legacy client fscid: 1 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Filesystem 'cephfs' (1) 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: fs_name cephfs 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: epoch 20 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: modified 2024-05-06T21:27:07.836937+0000 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: tableserver 0 2024-05-06T21:28:35.141 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: root 0 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: session_timeout 60 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: session_autoclose 300 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: max_file_size 1099511627776 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: max_xattr_size 65536 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: required_client_features {} 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: last_failure 0 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: last_failure_osd_epoch 47 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: max_mds 2 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: in 0,1 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: up {0=14486,1=24277} 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: failed 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: damaged 2024-05-06T21:28:35.142 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: stopped 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: data_pools [3] 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: metadata_pool 2 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: inline_data disabled 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: balancer 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: bal_rank_mask -1 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: standby_count_wanted 1 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: qdb_cluster leader: 0 members: 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: [mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: [mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: Standby daemons: 2024-05-06T21:28:35.143 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: 2024-05-06T21:28:35.144 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: [mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:35.144 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout: [mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:35.144 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: mon.smithi154@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-05-06T21:28:35.144 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: mon.smithi154@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-05-06T21:28:35.144 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: mon.smithi154@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-05-06T21:28:35.144 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: mon.smithi154@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-05-06T21:28:35.144 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 ceph-mon[63622]: mon.smithi154@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-05-06T21:28:35.144 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 bash[63602]: 88f330a92df2921a27f4a34198fdda2864150239453928c8a75e226c8dc4a75b 2024-05-06T21:28:35.144 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:34 smithi154 systemd[1]: Started Ceph mon.smithi154 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:28:35.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:35 smithi154 ceph-mon[63622]: pgmap v9: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 9.3 KiB/s wr, 12 op/s 2024-05-06T21:28:35.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:35 smithi032 ceph-mon[76650]: pgmap v9: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 9.3 KiB/s wr, 12 op/s 2024-05-06T21:28:36.717 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:28:36.717 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:28:36.717 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: mon.smithi032 calling monitor election 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: mon.smithi154 calling monitor election 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: mon.smithi032 is new leader, mons smithi032,smithi154 in quorum (ranks 0,1) 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: monmap epoch 3 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: last_changed 2024-05-06T21:28:35.572154+0000 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: created 2024-05-06T21:16:38.421123+0000 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: min_mon_release 19 (squid) 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: election_strategy: 1 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: 0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.smithi032 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.smithi154 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: osdmap e50: 6 total, 6 up, 6 in 2024-05-06T21:28:36.718 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: mgrmap e37: smithi032.ecoohh(active, since 15s), standbys: smithi154.kilvol 2024-05-06T21:28:36.719 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: overall HEALTH_OK 2024-05-06T21:28:36.719 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:36.719 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:36.719 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:28:36.719 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:28:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi032"}]: dispatch 2024-05-06T21:28:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mon metadata", "id": "smithi154"}]: dispatch 2024-05-06T21:28:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: mon.smithi032 calling monitor election 2024-05-06T21:28:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: mon.smithi154 calling monitor election 2024-05-06T21:28:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: mon.smithi032 is new leader, mons smithi032,smithi154 in quorum (ranks 0,1) 2024-05-06T21:28:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: monmap epoch 3 2024-05-06T21:28:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: fsid d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:28:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: last_changed 2024-05-06T21:28:35.572154+0000 2024-05-06T21:28:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: created 2024-05-06T21:16:38.421123+0000 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: min_mon_release 19 (squid) 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: election_strategy: 1 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: 0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.smithi032 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.smithi154 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: osdmap e50: 6 total, 6 up, 6 in 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: mgrmap e37: smithi032.ecoohh(active, since 15s), standbys: smithi154.kilvol 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: overall HEALTH_OK 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:28:36.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:28:37.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:37 smithi154 ceph-mon[63622]: pgmap v11: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 8.5 KiB/s wr, 11 op/s 2024-05-06T21:28:37.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:37 smithi032 ceph-mon[76650]: pgmap v11: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 8.5 KiB/s wr, 11 op/s 2024-05-06T21:28:39.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.370+0000 7ffae4ea7700 1 -- 172.21.15.32:0/3160466361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae00ff140 msgr2=0x7ffae00ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:39.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.370+0000 7ffae4ea7700 1 --2- 172.21.15.32:0/3160466361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae00ff140 0x7ffae00ff550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009910 tx=0x7ffad0009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:39.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.370+0000 7ffae4ea7700 1 -- 172.21.15.32:0/3160466361 shutdown_connections 2024-05-06T21:28:39.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.370+0000 7ffae4ea7700 1 --2- 172.21.15.32:0/3160466361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae0100340 0x7ffae0100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.370+0000 7ffae4ea7700 1 --2- 172.21.15.32:0/3160466361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae00ff140 0x7ffae00ff550 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.370+0000 7ffae4ea7700 1 -- 172.21.15.32:0/3160466361 >> 172.21.15.32:0/3160466361 conn(0x7ffae00fa6d0 msgr2=0x7ffae00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.370+0000 7ffae4ea7700 1 -- 172.21.15.32:0/3160466361 shutdown_connections 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.370+0000 7ffae4ea7700 1 -- 172.21.15.32:0/3160466361 wait complete. 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.371+0000 7ffae4ea7700 1 Processor -- start 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.371+0000 7ffae4ea7700 1 -- start start 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.371+0000 7ffae4ea7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae00ff140 0x7ffae01030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.371+0000 7ffae4ea7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae0100340 0x7ffae0101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.371+0000 7ffae4ea7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae0101c60 con 0x7ffae0100340 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.371+0000 7ffae4ea7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae0101da0 con 0x7ffae00ff140 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.371+0000 7ffaddd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae0100340 0x7ffae0101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffaddd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae0100340 0x7ffae0101720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46392/0 (socket says 172.21.15.32:46392) 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffaddd9b700 1 -- 172.21.15.32:0/1202130678 learned_addr learned my addr 172.21.15.32:0/1202130678 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffade59c700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae00ff140 0x7ffae01030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffade59c700 1 -- 172.21.15.32:0/1202130678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae00ff140 msgr2=0x7ffae01030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-06T21:28:39.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffade59c700 1 -- 172.21.15.32:0/1202130678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae00ff140 msgr2=0x7ffae01030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffade59c700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae00ff140 0x7ffae01030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffade59c700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae00ff140 0x7ffae01030d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffaddd9b700 1 -- 172.21.15.32:0/1202130678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae00ff140 msgr2=0x7ffae01030d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffaddd9b700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae00ff140 0x7ffae01030d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffaddd9b700 1 -- 172.21.15.32:0/1202130678 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00095f0 con 0x7ffae0100340 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffaddd9b700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae0100340 0x7ffae0101720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffac800d8d0 tx=0x7ffac800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffad77fe700 1 -- 172.21.15.32:0/1202130678 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac8009940 con 0x7ffae0100340 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffad77fe700 1 -- 172.21.15.32:0/1202130678 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffac8010460 con 0x7ffae0100340 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae0102080 con 0x7ffae0100340 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffad77fe700 1 -- 172.21.15.32:0/1202130678 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac800f5f0 con 0x7ffae0100340 2024-05-06T21:28:39.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.372+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae019db10 con 0x7ffae0100340 2024-05-06T21:28:39.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.374+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae0107c90 con 0x7ffae0100340 2024-05-06T21:28:39.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.374+0000 7ffad77fe700 1 -- 172.21.15.32:0/1202130678 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ffac800f7e0 con 0x7ffae0100340 2024-05-06T21:28:39.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.375+0000 7ffad77fe700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffacc06e330 0x7ffacc0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:39.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.375+0000 7ffad77fe700 1 -- 172.21.15.32:0/1202130678 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ffac808e3d0 con 0x7ffae0100340 2024-05-06T21:28:39.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.375+0000 7ffade59c700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffacc06e330 0x7ffacc0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:39.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.375+0000 7ffade59c700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffacc06e330 0x7ffacc0707e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffad0006010 tx=0x7ffad000b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:39.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.380+0000 7ffad77fe700 1 -- 172.21.15.32:0/1202130678 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ffac805b030 con 0x7ffae0100340 2024-05-06T21:28:39.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.612+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffae00694c0 con 0x7ffacc06e330 2024-05-06T21:28:39.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.613+0000 7ffad77fe700 1 -- 172.21.15.32:0/1202130678 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ffae00694c0 con 0x7ffacc06e330 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffacc06e330 msgr2=0x7ffacc0707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffacc06e330 0x7ffacc0707e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffad0006010 tx=0x7ffad000b580 comp rx=0 tx=0).stop 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae0100340 msgr2=0x7ffae0101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae0100340 0x7ffae0101720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffac800d8d0 tx=0x7ffac800dc90 comp rx=0 tx=0).stop 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 shutdown_connections 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffacc06e330 0x7ffacc0707e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae00ff140 0x7ffae01030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 --2- 172.21.15.32:0/1202130678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffae0100340 0x7ffae0101720 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 >> 172.21.15.32:0/1202130678 conn(0x7ffae00fa6d0 msgr2=0x7ffae0068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 shutdown_connections 2024-05-06T21:28:39.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.616+0000 7ffae4ea7700 1 -- 172.21.15.32:0/1202130678 wait complete. 2024-05-06T21:28:39.626 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:28:39.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.726+0000 7f19800d8700 1 -- 172.21.15.32:0/1477425820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 msgr2=0x7f1978100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.726+0000 7f19800d8700 1 --2- 172.21.15.32:0/1477425820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 0x7f1978100840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1968009910 tx=0x7f1968009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.726+0000 7f19800d8700 1 -- 172.21.15.32:0/1477425820 shutdown_connections 2024-05-06T21:28:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.726+0000 7f19800d8700 1 --2- 172.21.15.32:0/1477425820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 0x7f1978100840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.726+0000 7f19800d8700 1 --2- 172.21.15.32:0/1477425820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 0x7f19780ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.726+0000 7f19800d8700 1 -- 172.21.15.32:0/1477425820 >> 172.21.15.32:0/1477425820 conn(0x7f19780fa780 msgr2=0x7f19780fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.726+0000 7f19800d8700 1 -- 172.21.15.32:0/1477425820 shutdown_connections 2024-05-06T21:28:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.726+0000 7f19800d8700 1 -- 172.21.15.32:0/1477425820 wait complete. 2024-05-06T21:28:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f19800d8700 1 Processor -- start 2024-05-06T21:28:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f19800d8700 1 -- start start 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f19800d8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 0x7f1978195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f19800d8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 0x7f1978195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f19800d8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19781965e0 con 0x7f19781003d0 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f19800d8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1978196720 con 0x7f19780ff130 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f197d673700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 0x7f1978195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f197d673700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 0x7f1978195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46424/0 (socket says 172.21.15.32:46424) 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f197d673700 1 -- 172.21.15.32:0/2066597733 learned_addr learned my addr 172.21.15.32:0/2066597733 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.727+0000 7f197de74700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 0x7f1978195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f197de74700 1 -- 172.21.15.32:0/2066597733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 msgr2=0x7f1978195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f197de74700 1 -- 172.21.15.32:0/2066597733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 msgr2=0x7f1978195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f197de74700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 0x7f1978195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-06T21:28:39.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f197de74700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 0x7f1978195a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f197d673700 1 -- 172.21.15.32:0/2066597733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 msgr2=0x7f1978195a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f197d673700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 0x7f1978195a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f197d673700 1 -- 172.21.15.32:0/2066597733 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19680095f0 con 0x7f19781003d0 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f197d673700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 0x7f1978195fc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1968006010 tx=0x7f196800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f196effd700 1 -- 172.21.15.32:0/2066597733 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f196801d070 con 0x7f19781003d0 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f196effd700 1 -- 172.21.15.32:0/2066597733 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f196800f460 con 0x7f19781003d0 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f196effd700 1 -- 172.21.15.32:0/2066597733 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1968017630 con 0x7f19781003d0 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197819b170 con 0x7f19781003d0 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.728+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197819b660 con 0x7f19781003d0 2024-05-06T21:28:39.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.729+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1978107c30 con 0x7f19781003d0 2024-05-06T21:28:39.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.730+0000 7f196effd700 1 -- 172.21.15.32:0/2066597733 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f1968003a60 con 0x7f19781003d0 2024-05-06T21:28:39.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.730+0000 7f196effd700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f196406e340 0x7f19640707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:39.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.730+0000 7f196effd700 1 -- 172.21.15.32:0/2066597733 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f196808f7b0 con 0x7f19781003d0 2024-05-06T21:28:39.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.730+0000 7f197de74700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f196406e340 0x7f19640707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:39.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.731+0000 7f197de74700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f196406e340 0x7f19640707f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1974005950 tx=0x7f19740058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:39.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.735+0000 7f196effd700 1 -- 172.21.15.32:0/2066597733 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f196805c520 con 0x7f19781003d0 2024-05-06T21:28:39.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.968+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1978068c50 con 0x7f196406e340 2024-05-06T21:28:39.968 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:39 smithi032 ceph-mon[76650]: pgmap v12: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 8.5 KiB/s wr, 11 op/s 2024-05-06T21:28:39.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:39 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:39.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:39 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:39.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.969+0000 7f196effd700 1 -- 172.21.15.32:0/2066597733 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1978068c50 con 0x7f196406e340 2024-05-06T21:28:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f196406e340 msgr2=0x7f19640707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f196406e340 0x7f19640707f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1974005950 tx=0x7f19740058e0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 msgr2=0x7f1978195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:39.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 0x7f1978195fc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1968006010 tx=0x7f196800be20 comp rx=0 tx=0).stop 2024-05-06T21:28:39.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 shutdown_connections 2024-05-06T21:28:39.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f196406e340 0x7f19640707f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19780ff130 0x7f1978195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 --2- 172.21.15.32:0/2066597733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19781003d0 0x7f1978195fc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:39.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 >> 172.21.15.32:0/2066597733 conn(0x7f19780fa780 msgr2=0x7f1978068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:39.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 shutdown_connections 2024-05-06T21:28:39.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:39.972+0000 7f19800d8700 1 -- 172.21.15.32:0/2066597733 wait complete. 2024-05-06T21:28:40.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.081+0000 7f9dc723b700 1 -- 172.21.15.32:0/1560260858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 msgr2=0x7f9dc0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.081+0000 7f9dc723b700 1 --2- 172.21.15.32:0/1560260858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 0x7f9dc0101890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009910 tx=0x7f9dac009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.081+0000 7f9dc723b700 1 -- 172.21.15.32:0/1560260858 shutdown_connections 2024-05-06T21:28:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.081+0000 7f9dc723b700 1 --2- 172.21.15.32:0/1560260858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 0x7f9dc0101890 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.081+0000 7f9dc723b700 1 --2- 172.21.15.32:0/1560260858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0100240 0x7f9dc0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.081+0000 7f9dc723b700 1 -- 172.21.15.32:0/1560260858 >> 172.21.15.32:0/1560260858 conn(0x7f9dc00fb7f0 msgr2=0x7f9dc00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.081+0000 7f9dc723b700 1 -- 172.21.15.32:0/1560260858 shutdown_connections 2024-05-06T21:28:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.081+0000 7f9dc723b700 1 -- 172.21.15.32:0/1560260858 wait complete. 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dc723b700 1 Processor -- start 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dc723b700 1 -- start start 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dc723b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0100240 0x7f9dc0195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dc723b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 0x7f9dc0195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dc723b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc01965f0 con 0x7f9dc0101440 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dc723b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc0196730 con 0x7f9dc0100240 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dbffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 0x7f9dc0195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dbffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 0x7f9dc0195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46448/0 (socket says 172.21.15.32:46448) 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dbffff700 1 -- 172.21.15.32:0/3734290411 learned_addr learned my addr 172.21.15.32:0/3734290411 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dc4fd7700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0100240 0x7f9dc0195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dbffff700 1 -- 172.21.15.32:0/3734290411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0100240 msgr2=0x7f9dc0195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dbffff700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0100240 0x7f9dc0195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dbffff700 1 -- 172.21.15.32:0/3734290411 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0095f0 con 0x7f9dc0101440 2024-05-06T21:28:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.082+0000 7f9dbffff700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 0x7f9dc0195fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9dac000c00 tx=0x7f9dac00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.083+0000 7f9dbdffb700 1 -- 172.21.15.32:0/3734290411 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dac01d070 con 0x7f9dc0101440 2024-05-06T21:28:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.083+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc019b180 con 0x7f9dc0101440 2024-05-06T21:28:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.083+0000 7f9dbdffb700 1 -- 172.21.15.32:0/3734290411 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9dac005dc0 con 0x7f9dc0101440 2024-05-06T21:28:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.083+0000 7f9dbdffb700 1 -- 172.21.15.32:0/3734290411 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dac0226a0 con 0x7f9dc0101440 2024-05-06T21:28:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.083+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc019b670 con 0x7f9dc0101440 2024-05-06T21:28:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.084+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc0108d90 con 0x7f9dc0101440 2024-05-06T21:28:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.084+0000 7f9dbdffb700 1 -- 172.21.15.32:0/3734290411 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f9dac0038f0 con 0x7f9dc0101440 2024-05-06T21:28:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.085+0000 7f9dbdffb700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9db006e330 0x7f9db00707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.085+0000 7f9dbdffb700 1 -- 172.21.15.32:0/3734290411 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9dac08f7c0 con 0x7f9dc0101440 2024-05-06T21:28:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.085+0000 7f9dc4fd7700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9db006e330 0x7f9db00707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.085+0000 7f9dc4fd7700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9db006e330 0x7f9db00707e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9dc01012a0 tx=0x7f9db4009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.090+0000 7f9dbdffb700 1 -- 172.21.15.32:0/3734290411 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9dac05c480 con 0x7f9dc0101440 2024-05-06T21:28:40.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:39 smithi154 ceph-mon[63622]: pgmap v12: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 8.5 KiB/s wr, 11 op/s 2024-05-06T21:28:40.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:39 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:40.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:39 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:40.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.311+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dc0105d90 con 0x7f9db006e330 2024-05-06T21:28:40.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.322+0000 7f9dbdffb700 1 -- 172.21.15.32:0/3734290411 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9dc0105d90 con 0x7f9db006e330 2024-05-06T21:28:40.322 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:28:40.322 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (8m) 13s ago 10m 24.6M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:28:40.322 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (10m) 13s ago 10m 7755k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:28:40.322 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (9m) 1s ago 9m 7704k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:28:40.322 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (10m) 13s ago 10m 6669k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (9m) 1s ago 9m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (8m) 13s ago 10m 85.6M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (4m) 13s ago 4m 14.4M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (4m) 13s ago 4m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (4m) 1s ago 4m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (4m) 1s ago 4m 16.3M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (98s) 13s ago 11m 472M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (52s) 1s ago 9m 448M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (29s) 13s ago 11m 28.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (5s) 1s ago 9m 24.8M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (10m) 13s ago 10m 15.9M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (9m) 1s ago 9m 16.7M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (8m) 13s ago 8m 214M 1217M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:28:40.323 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (8m) 13s ago 8m 241M 1217M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:28:40.324 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (7m) 13s ago 7m 195M 1217M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:28:40.324 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (7m) 1s ago 7m 277M 2240M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:28:40.324 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (6m) 1s ago 6m 248M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:28:40.324 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (6m) 1s ago 6m 236M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:28:40.324 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (59s) 13s ago 9m 53.3M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:28:40.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9db006e330 msgr2=0x7f9db00707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9db006e330 0x7f9db00707e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9dc01012a0 tx=0x7f9db4009260 comp rx=0 tx=0).stop 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 msgr2=0x7f9dc0195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 0x7f9dc0195fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9dac000c00 tx=0x7f9dac00f690 comp rx=0 tx=0).stop 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 shutdown_connections 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9db006e330 0x7f9db00707e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0100240 0x7f9dc0195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 --2- 172.21.15.32:0/3734290411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dc0101440 0x7f9dc0195fd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 >> 172.21.15.32:0/3734290411 conn(0x7f9dc00fb7f0 msgr2=0x7f9dc0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 shutdown_connections 2024-05-06T21:28:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.325+0000 7f9dc723b700 1 -- 172.21.15.32:0/3734290411 wait complete. 2024-05-06T21:28:40.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.433+0000 7f07f73f0700 1 -- 172.21.15.32:0/3583770287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f01036a0 msgr2=0x7f07f0105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.433+0000 7f07f73f0700 1 --2- 172.21.15.32:0/3583770287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f01036a0 0x7f07f0105a80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009910 tx=0x7f07ec009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:40.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.433+0000 7f07f73f0700 1 -- 172.21.15.32:0/3583770287 shutdown_connections 2024-05-06T21:28:40.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.433+0000 7f07f73f0700 1 --2- 172.21.15.32:0/3583770287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f01036a0 0x7f07f0105a80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.433+0000 7f07f73f0700 1 --2- 172.21.15.32:0/3583770287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07f0100d80 0x7f07f0103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.433+0000 7f07f73f0700 1 -- 172.21.15.32:0/3583770287 >> 172.21.15.32:0/3583770287 conn(0x7f07f00fa7a0 msgr2=0x7f07f00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:40.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.433+0000 7f07f73f0700 1 -- 172.21.15.32:0/3583770287 shutdown_connections 2024-05-06T21:28:40.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.433+0000 7f07f73f0700 1 -- 172.21.15.32:0/3583770287 wait complete. 2024-05-06T21:28:40.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f73f0700 1 Processor -- start 2024-05-06T21:28:40.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f73f0700 1 -- start start 2024-05-06T21:28:40.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f73f0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f0100d80 0x7f07f0195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:40.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f73f0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07f01036a0 0x7f07f0196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:40.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f73f0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0196920 con 0x7f07f0100d80 2024-05-06T21:28:40.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f73f0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0196a60 con 0x7f07f01036a0 2024-05-06T21:28:40.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f518c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f0100d80 0x7f07f0195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f518c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f0100d80 0x7f07f0195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46468/0 (socket says 172.21.15.32:46468) 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f518c700 1 -- 172.21.15.32:0/771377013 learned_addr learned my addr 172.21.15.32:0/771377013 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f498b700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07f01036a0 0x7f07f0196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f518c700 1 -- 172.21.15.32:0/771377013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07f01036a0 msgr2=0x7f07f0196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f518c700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07f01036a0 0x7f07f0196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f518c700 1 -- 172.21.15.32:0/771377013 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0095f0 con 0x7f07f0100d80 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f498b700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07f01036a0 0x7f07f0196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.434+0000 7f07f518c700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f0100d80 0x7f07f0195dc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f07e400e8f0 tx=0x7f07e400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.435+0000 7f07e27fc700 1 -- 172.21.15.32:0/771377013 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e4009790 con 0x7f07f0100d80 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.435+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f019b510 con 0x7f07f0100d80 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.435+0000 7f07e27fc700 1 -- 172.21.15.32:0/771377013 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07e400c810 con 0x7f07f0100d80 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.435+0000 7f07e27fc700 1 -- 172.21.15.32:0/771377013 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e40055b0 con 0x7f07f0100d80 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.435+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f019ba60 con 0x7f07f0100d80 2024-05-06T21:28:40.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.436+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f018fc00 con 0x7f07f0100d80 2024-05-06T21:28:40.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.436+0000 7f07e27fc700 1 -- 172.21.15.32:0/771377013 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f07e400c980 con 0x7f07f0100d80 2024-05-06T21:28:40.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.437+0000 7f07e27fc700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f07dc06e340 0x7f07dc0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:40.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.437+0000 7f07e27fc700 1 -- 172.21.15.32:0/771377013 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f07e4014070 con 0x7f07f0100d80 2024-05-06T21:28:40.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.437+0000 7f07f498b700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f07dc06e340 0x7f07dc0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:40.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.437+0000 7f07f498b700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f07dc06e340 0x7f07dc0707f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009fd0 tx=0x7f07ec005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:40.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.441+0000 7f07e27fc700 1 -- 172.21.15.32:0/771377013 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f07e405b2b0 con 0x7f07f0100d80 2024-05-06T21:28:40.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.748+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f07f002ce80 con 0x7f07f0100d80 2024-05-06T21:28:40.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.748+0000 7f07e27fc700 1 -- 172.21.15.32:0/771377013 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f07e405ae40 con 0x7f07f0100d80 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-05-06T21:28:40.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:28:40.750 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:28:40.750 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:28:40.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:28:40.750 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:28:40.750 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-05-06T21:28:40.750 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 4 2024-05-06T21:28:40.750 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:28:40.750 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:28:40.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f07dc06e340 msgr2=0x7f07dc0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f07dc06e340 0x7f07dc0707f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009fd0 tx=0x7f07ec005940 comp rx=0 tx=0).stop 2024-05-06T21:28:40.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f0100d80 msgr2=0x7f07f0195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f0100d80 0x7f07f0195dc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f07e400e8f0 tx=0x7f07e400ec00 comp rx=0 tx=0).stop 2024-05-06T21:28:40.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 shutdown_connections 2024-05-06T21:28:40.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f07dc06e340 0x7f07dc0707f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f0100d80 0x7f07f0195dc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 --2- 172.21.15.32:0/771377013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07f01036a0 0x7f07f0196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 >> 172.21.15.32:0/771377013 conn(0x7f07f00fa7a0 msgr2=0x7f07f00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:40.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 shutdown_connections 2024-05-06T21:28:40.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.751+0000 7f07f73f0700 1 -- 172.21.15.32:0/771377013 wait complete. 2024-05-06T21:28:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.861+0000 7f7b0eb51700 1 -- 172.21.15.32:0/2783630342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08100240 msgr2=0x7f7b08100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.861+0000 7f7b0eb51700 1 --2- 172.21.15.32:0/2783630342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08100240 0x7f7b08100650 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009910 tx=0x7f7afc009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.861+0000 7f7b0eb51700 1 -- 172.21.15.32:0/2783630342 shutdown_connections 2024-05-06T21:28:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.861+0000 7f7b0eb51700 1 --2- 172.21.15.32:0/2783630342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08101440 0x7f7b08101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.861+0000 7f7b0eb51700 1 --2- 172.21.15.32:0/2783630342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08100240 0x7f7b08100650 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.861+0000 7f7b0eb51700 1 -- 172.21.15.32:0/2783630342 >> 172.21.15.32:0/2783630342 conn(0x7f7b080fb7f0 msgr2=0x7f7b080fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.861+0000 7f7b0eb51700 1 -- 172.21.15.32:0/2783630342 shutdown_connections 2024-05-06T21:28:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.861+0000 7f7b0eb51700 1 -- 172.21.15.32:0/2783630342 wait complete. 2024-05-06T21:28:40.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b0eb51700 1 Processor -- start 2024-05-06T21:28:40.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b0eb51700 1 -- start start 2024-05-06T21:28:40.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b0eb51700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08100240 0x7f7b08195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:40.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b0eb51700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08101440 0x7f7b08196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:40.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b0eb51700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08196630 con 0x7f7b08101440 2024-05-06T21:28:40.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b0eb51700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08196770 con 0x7f7b08100240 2024-05-06T21:28:40.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08101440 0x7f7b08196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:40.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08101440 0x7f7b08196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46488/0 (socket says 172.21.15.32:46488) 2024-05-06T21:28:40.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b07fff700 1 -- 172.21.15.32:0/1847493119 learned_addr learned my addr 172.21.15.32:0/1847493119 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:40.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b0c8ed700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08100240 0x7f7b08195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:40.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b07fff700 1 -- 172.21.15.32:0/1847493119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08100240 msgr2=0x7f7b08195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:40.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b07fff700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08100240 0x7f7b08195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:40.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.862+0000 7f7b07fff700 1 -- 172.21.15.32:0/1847493119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc0095f0 con 0x7f7b08101440 2024-05-06T21:28:40.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.863+0000 7f7b07fff700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08101440 0x7f7b08196010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7af400d8d0 tx=0x7f7af400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:40.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.865+0000 7f7b05ffb700 1 -- 172.21.15.32:0/1847493119 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7af40098a0 con 0x7f7b08101440 2024-05-06T21:28:40.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.865+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0819b220 con 0x7f7b08101440 2024-05-06T21:28:40.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.865+0000 7f7b05ffb700 1 -- 172.21.15.32:0/1847493119 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7af4010460 con 0x7f7b08101440 2024-05-06T21:28:40.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.865+0000 7f7b05ffb700 1 -- 172.21.15.32:0/1847493119 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7af400f5f0 con 0x7f7b08101440 2024-05-06T21:28:40.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.865+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0819b770 con 0x7f7b08101440 2024-05-06T21:28:40.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.866+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b08108d90 con 0x7f7b08101440 2024-05-06T21:28:40.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.866+0000 7f7b05ffb700 1 -- 172.21.15.32:0/1847493119 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f7af4009a00 con 0x7f7b08101440 2024-05-06T21:28:40.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.867+0000 7f7b05ffb700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7af806e330 0x7f7af80707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:40.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.867+0000 7f7b05ffb700 1 -- 172.21.15.32:0/1847493119 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7af408e2b0 con 0x7f7b08101440 2024-05-06T21:28:40.867 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:40 smithi032 ceph-mon[76650]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:40.867 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:40 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:40.867 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:40 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:40.867 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:40 smithi032 ceph-mon[76650]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:40.867 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:40 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/771377013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:28:40.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.867+0000 7f7b0c8ed700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7af806e330 0x7f7af80707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:40.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.867+0000 7f7b0c8ed700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7af806e330 0x7f7af80707e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7afc006010 tx=0x7f7afc00b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:40.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:40.871+0000 7f7b05ffb700 1 -- 172.21.15.32:0/1847493119 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7af405aef0 con 0x7f7b08101440 2024-05-06T21:28:41.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:40 smithi154 ceph-mon[63622]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:41.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:40 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:41.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:40 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:41.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:40 smithi154 ceph-mon[63622]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:41.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:40 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/771377013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:28:41.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.133+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b08108f50 con 0x7f7b08101440 2024-05-06T21:28:41.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.133+0000 7f7b05ffb700 1 -- 172.21.15.32:0/1847493119 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f7af405aa80 con 0x7f7b08101440 2024-05-06T21:28:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:e20 2024-05-06T21:28:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:28:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:28:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:28:41.133 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:28:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:28:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 20 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:27:07.836937+0000 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:28:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 0 members: 2024-05-06T21:28:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:41.136 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:28:41.136 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:28:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:28:41.136 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:28:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.135+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7af806e330 msgr2=0x7f7af80707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.135+0000 7f7b0eb51700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7af806e330 0x7f7af80707e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7afc006010 tx=0x7f7afc00b560 comp rx=0 tx=0).stop 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.135+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08101440 msgr2=0x7f7b08196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.135+0000 7f7b0eb51700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08101440 0x7f7b08196010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7af400d8d0 tx=0x7f7af400dbe0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.136+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 shutdown_connections 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.136+0000 7f7b0eb51700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7af806e330 0x7f7af80707e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.136+0000 7f7b0eb51700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08100240 0x7f7b08195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.136+0000 7f7b0eb51700 1 --2- 172.21.15.32:0/1847493119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b08101440 0x7f7b08196010 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.136+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 >> 172.21.15.32:0/1847493119 conn(0x7f7b080fb7f0 msgr2=0x7f7b08104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.136+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 shutdown_connections 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.136+0000 7f7b0eb51700 1 -- 172.21.15.32:0/1847493119 wait complete. 2024-05-06T21:28:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 20 2024-05-06T21:28:41.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.245+0000 7f5b6512b700 1 -- 172.21.15.32:0/2303733107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 msgr2=0x7f5b60105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.245+0000 7f5b6512b700 1 --2- 172.21.15.32:0/2303733107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 0x7f5b60105a80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009910 tx=0x7f5b54009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:41.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.245+0000 7f5b6512b700 1 -- 172.21.15.32:0/2303733107 shutdown_connections 2024-05-06T21:28:41.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.245+0000 7f5b6512b700 1 --2- 172.21.15.32:0/2303733107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 0x7f5b60105a80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.245+0000 7f5b6512b700 1 --2- 172.21.15.32:0/2303733107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60100d80 0x7f5b60103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.245+0000 7f5b6512b700 1 -- 172.21.15.32:0/2303733107 >> 172.21.15.32:0/2303733107 conn(0x7f5b600fa7a0 msgr2=0x7f5b600fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:41.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.245+0000 7f5b6512b700 1 -- 172.21.15.32:0/2303733107 shutdown_connections 2024-05-06T21:28:41.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.245+0000 7f5b6512b700 1 -- 172.21.15.32:0/2303733107 wait complete. 2024-05-06T21:28:41.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.246+0000 7f5b6512b700 1 Processor -- start 2024-05-06T21:28:41.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.246+0000 7f5b6512b700 1 -- start start 2024-05-06T21:28:41.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b6512b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60100d80 0x7f5b60195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:41.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b6512b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 0x7f5b601963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:41.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b6512b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b601969e0 con 0x7f5b601036a0 2024-05-06T21:28:41.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b6512b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60196b20 con 0x7f5b60100d80 2024-05-06T21:28:41.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b5e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 0x7f5b601963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b5e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 0x7f5b601963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46494/0 (socket says 172.21.15.32:46494) 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b5e59c700 1 -- 172.21.15.32:0/21575199 learned_addr learned my addr 172.21.15.32:0/21575199 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b5ed9d700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60100d80 0x7f5b60195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b5e59c700 1 -- 172.21.15.32:0/21575199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60100d80 msgr2=0x7f5b60195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b5e59c700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60100d80 0x7f5b60195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b5e59c700 1 -- 172.21.15.32:0/21575199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b540095f0 con 0x7f5b601036a0 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b5e59c700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 0x7f5b601963c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400b5c0 tx=0x7f5b5400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b47fff700 1 -- 172.21.15.32:0/21575199 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b5401d070 con 0x7f5b601036a0 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.247+0000 7f5b47fff700 1 -- 172.21.15.32:0/21575199 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b54022470 con 0x7f5b601036a0 2024-05-06T21:28:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.248+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6019b570 con 0x7f5b601036a0 2024-05-06T21:28:41.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.248+0000 7f5b47fff700 1 -- 172.21.15.32:0/21575199 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b5400f690 con 0x7f5b601036a0 2024-05-06T21:28:41.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.248+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6019ba60 con 0x7f5b601036a0 2024-05-06T21:28:41.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.249+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6018fc80 con 0x7f5b601036a0 2024-05-06T21:28:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.249+0000 7f5b47fff700 1 -- 172.21.15.32:0/21575199 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f5b54004b70 con 0x7f5b601036a0 2024-05-06T21:28:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.250+0000 7f5b47fff700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5b4806e330 0x7f5b480707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.250+0000 7f5b47fff700 1 -- 172.21.15.32:0/21575199 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5b5408fb30 con 0x7f5b601036a0 2024-05-06T21:28:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.250+0000 7f5b5ed9d700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5b4806e330 0x7f5b480707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.250+0000 7f5b5ed9d700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5b4806e330 0x7f5b480707e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006fd0 tx=0x7f5b50008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.254+0000 7f5b47fff700 1 -- 172.21.15.32:0/21575199 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5b5405c820 con 0x7f5b601036a0 2024-05-06T21:28:41.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.487+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b6002ced0 con 0x7f5b4806e330 2024-05-06T21:28:41.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.489+0000 7f5b47fff700 1 -- 172.21.15.32:0/21575199 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f5b6002ced0 con 0x7f5b4806e330 2024-05-06T21:28:41.488 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:28:41.488 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "4/23 daemons upgraded", 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading mon daemons", 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:28:41.489 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:28:41.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5b4806e330 msgr2=0x7f5b480707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5b4806e330 0x7f5b480707e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006fd0 tx=0x7f5b50008040 comp rx=0 tx=0).stop 2024-05-06T21:28:41.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 msgr2=0x7f5b601963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 0x7f5b601963c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400b5c0 tx=0x7f5b5400be20 comp rx=0 tx=0).stop 2024-05-06T21:28:41.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 shutdown_connections 2024-05-06T21:28:41.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5b4806e330 0x7f5b480707e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60100d80 0x7f5b60195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 --2- 172.21.15.32:0/21575199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b601036a0 0x7f5b601963c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 >> 172.21.15.32:0/21575199 conn(0x7f5b600fa7a0 msgr2=0x7f5b600fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 shutdown_connections 2024-05-06T21:28:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.491+0000 7f5b6512b700 1 -- 172.21.15.32:0/21575199 wait complete. 2024-05-06T21:28:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.600+0000 7f0d08166700 1 -- 172.21.15.32:0/2579026153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 msgr2=0x7f0d00101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.600+0000 7f0d08166700 1 --2- 172.21.15.32:0/2579026153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 0x7f0d00101890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009910 tx=0x7f0cf4009c20 comp rx=0 tx=0).stop 2024-05-06T21:28:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.600+0000 7f0d08166700 1 -- 172.21.15.32:0/2579026153 shutdown_connections 2024-05-06T21:28:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.600+0000 7f0d08166700 1 --2- 172.21.15.32:0/2579026153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 0x7f0d00101890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.600+0000 7f0d08166700 1 --2- 172.21.15.32:0/2579026153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100240 0x7f0d00100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.600+0000 7f0d08166700 1 -- 172.21.15.32:0/2579026153 >> 172.21.15.32:0/2579026153 conn(0x7f0d000fb7f0 msgr2=0x7f0d000fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.600+0000 7f0d08166700 1 -- 172.21.15.32:0/2579026153 shutdown_connections 2024-05-06T21:28:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.600+0000 7f0d08166700 1 -- 172.21.15.32:0/2579026153 wait complete. 2024-05-06T21:28:41.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d08166700 1 Processor -- start 2024-05-06T21:28:41.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d08166700 1 -- start start 2024-05-06T21:28:41.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d08166700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100240 0x7f0d00195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:41.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d08166700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 0x7f0d00195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:41.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d08166700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00196610 con 0x7f0d00101440 2024-05-06T21:28:41.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d08166700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00196750 con 0x7f0d00100240 2024-05-06T21:28:41.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d05701700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 0x7f0d00195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d05701700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 0x7f0d00195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46500/0 (socket says 172.21.15.32:46500) 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d05701700 1 -- 172.21.15.32:0/4241974958 learned_addr learned my addr 172.21.15.32:0/4241974958 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d05f02700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100240 0x7f0d00195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d05701700 1 -- 172.21.15.32:0/4241974958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100240 msgr2=0x7f0d00195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.601+0000 7f0d05701700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100240 0x7f0d00195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.602+0000 7f0d05701700 1 -- 172.21.15.32:0/4241974958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40095f0 con 0x7f0d00101440 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.602+0000 7f0d05701700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 0x7f0d00195ff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4005b40 tx=0x7f0cf400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.602+0000 7f0cfeffd700 1 -- 172.21.15.32:0/4241974958 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf401d070 con 0x7f0d00101440 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.602+0000 7f0cfeffd700 1 -- 172.21.15.32:0/4241974958 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0cf400f460 con 0x7f0d00101440 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.602+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0019b1a0 con 0x7f0d00101440 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.602+0000 7f0cfeffd700 1 -- 172.21.15.32:0/4241974958 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf4021620 con 0x7f0d00101440 2024-05-06T21:28:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.602+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0019b690 con 0x7f0d00101440 2024-05-06T21:28:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.603+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d00108d90 con 0x7f0d00101440 2024-05-06T21:28:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.604+0000 7f0cfeffd700 1 -- 172.21.15.32:0/4241974958 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f0cf400fa40 con 0x7f0d00101440 2024-05-06T21:28:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.604+0000 7f0cfeffd700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0ce806e330 0x7f0ce80707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:28:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.604+0000 7f0cfeffd700 1 -- 172.21.15.32:0/4241974958 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0cf408f680 con 0x7f0d00101440 2024-05-06T21:28:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.604+0000 7f0d05f02700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0ce806e330 0x7f0ce80707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:28:41.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.605+0000 7f0d05f02700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0ce806e330 0x7f0ce80707e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d001012a0 tx=0x7f0cf00091c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:28:41.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.609+0000 7f0cfeffd700 1 -- 172.21.15.32:0/4241974958 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0cf405c2c0 con 0x7f0d00101440 2024-05-06T21:28:41.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.916+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0d0019bcd0 con 0x7f0d00101440 2024-05-06T21:28:41.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.916+0000 7f0cfeffd700 1 -- 172.21.15.32:0/4241974958 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0cf405be50 con 0x7f0d00101440 2024-05-06T21:28:41.916 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:28:41.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0ce806e330 msgr2=0x7f0ce80707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0ce806e330 0x7f0ce80707e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d001012a0 tx=0x7f0cf00091c0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 msgr2=0x7f0d00195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 0x7f0d00195ff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4005b40 tx=0x7f0cf400bd70 comp rx=0 tx=0).stop 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 shutdown_connections 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0ce806e330 0x7f0ce80707e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100240 0x7f0d00195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 --2- 172.21.15.32:0/4241974958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d00101440 0x7f0d00195ff0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 >> 172.21.15.32:0/4241974958 conn(0x7f0d000fb7f0 msgr2=0x7f0d00104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 shutdown_connections 2024-05-06T21:28:41.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:28:41.919+0000 7f0d08166700 1 -- 172.21.15.32:0/4241974958 wait complete. 2024-05-06T21:28:42.028 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:41 smithi154 ceph-mon[63622]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:42.028 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:41 smithi154 ceph-mon[63622]: pgmap v13: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:28:42.028 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:41 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1847493119' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:28:42.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:41 smithi032 ceph-mon[76650]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:42.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:41 smithi032 ceph-mon[76650]: pgmap v13: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:28:42.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:41 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1847493119' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:28:43.007 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:42 smithi154 ceph-mon[63622]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:43.008 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:42 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4241974958' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:28:43.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:42 smithi032 ceph-mon[76650]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:28:43.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:42 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4241974958' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:28:44.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: pgmap v14: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:28:44.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:44.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:44.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:44.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:28:44.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:44.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: Reconfiguring mon.smithi032 (monmap changed)... 2024-05-06T21:28:44.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:28:44.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:28:44.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:44.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:44 smithi154 ceph-mon[63622]: Reconfiguring daemon mon.smithi032 on smithi032 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: pgmap v14: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: Reconfiguring mon.smithi032 (monmap changed)... 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:28:44.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:44.474 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:44 smithi032 ceph-mon[76650]: Reconfiguring daemon mon.smithi032 on smithi032 2024-05-06T21:28:46.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:46 smithi154 ceph-mon[63622]: pgmap v15: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:46.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:46.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:46.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:46 smithi154 ceph-mon[63622]: Reconfiguring mgr.smithi032.ecoohh (monmap changed)... 2024-05-06T21:28:46.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi032.ecoohh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:28:46.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:28:46.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:46.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:46 smithi154 ceph-mon[63622]: Reconfiguring daemon mgr.smithi032.ecoohh on smithi032 2024-05-06T21:28:46.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:46 smithi032 ceph-mon[76650]: pgmap v15: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:46.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:46.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:46.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:46 smithi032 ceph-mon[76650]: Reconfiguring mgr.smithi032.ecoohh (monmap changed)... 2024-05-06T21:28:46.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi032.ecoohh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:28:46.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:28:46.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:46.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:46 smithi032 ceph-mon[76650]: Reconfiguring daemon mgr.smithi032.ecoohh on smithi032 2024-05-06T21:28:48.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: pgmap v16: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: Reconfiguring ceph-exporter.smithi032 (monmap changed)... 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: Unable to update caps for client.ceph-exporter.smithi032 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi032"}]: dispatch 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:48.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:48 smithi032 ceph-mon[76650]: Reconfiguring daemon ceph-exporter.smithi032 on smithi032 2024-05-06T21:28:48.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: pgmap v16: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:48.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:48.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:48.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: Reconfiguring ceph-exporter.smithi032 (monmap changed)... 2024-05-06T21:28:48.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:28:48.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:28:48.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-05-06T21:28:48.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: Unable to update caps for client.ceph-exporter.smithi032 2024-05-06T21:28:48.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi032"}]: dispatch 2024-05-06T21:28:48.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:48.368 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:48 smithi154 ceph-mon[63622]: Reconfiguring daemon ceph-exporter.smithi032 on smithi032 2024-05-06T21:28:49.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:49 smithi032 ceph-mon[76650]: pgmap v17: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:49.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:49.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:49.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:49 smithi032 ceph-mon[76650]: Reconfiguring crash.smithi032 (monmap changed)... 2024-05-06T21:28:49.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi032", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:28:49.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:49.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:49 smithi032 ceph-mon[76650]: Reconfiguring daemon crash.smithi032 on smithi032 2024-05-06T21:28:50.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:49 smithi154 ceph-mon[63622]: pgmap v17: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:50.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:50.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:50.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:49 smithi154 ceph-mon[63622]: Reconfiguring crash.smithi032 (monmap changed)... 2024-05-06T21:28:50.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi032", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:28:50.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:50.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:49 smithi154 ceph-mon[63622]: Reconfiguring daemon crash.smithi032 on smithi032 2024-05-06T21:28:50.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:28:50.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:50.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:50.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T21:28:50.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:51.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:28:51.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:51.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:51.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T21:28:51.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:51.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:51 smithi032 ceph-mon[76650]: pgmap v18: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:51.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:51 smithi032 ceph-mon[76650]: Reconfiguring osd.0 (monmap changed)... 2024-05-06T21:28:51.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:51 smithi032 ceph-mon[76650]: Reconfiguring daemon osd.0 on smithi032 2024-05-06T21:28:52.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:51 smithi154 ceph-mon[63622]: pgmap v18: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:52.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:51 smithi154 ceph-mon[63622]: Reconfiguring osd.0 (monmap changed)... 2024-05-06T21:28:52.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:51 smithi154 ceph-mon[63622]: Reconfiguring daemon osd.0 on smithi032 2024-05-06T21:28:53.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:53.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:53.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:53 smithi032 ceph-mon[76650]: Reconfiguring osd.1 (monmap changed)... 2024-05-06T21:28:53.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T21:28:53.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:53.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:53 smithi032 ceph-mon[76650]: Reconfiguring daemon osd.1 on smithi032 2024-05-06T21:28:53.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:53 smithi032 ceph-mon[76650]: pgmap v19: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:53.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:53.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:53.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:53 smithi154 ceph-mon[63622]: Reconfiguring osd.1 (monmap changed)... 2024-05-06T21:28:53.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T21:28:53.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:53.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:53 smithi154 ceph-mon[63622]: Reconfiguring daemon osd.1 on smithi032 2024-05-06T21:28:53.868 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:53 smithi154 ceph-mon[63622]: pgmap v19: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:55.296 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:55.296 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:55.296 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:55 smithi032 ceph-mon[76650]: Reconfiguring osd.2 (monmap changed)... 2024-05-06T21:28:55.296 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T21:28:55.296 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:55.297 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:55 smithi032 ceph-mon[76650]: Reconfiguring daemon osd.2 on smithi032 2024-05-06T21:28:55.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:55.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:55.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:55 smithi154 ceph-mon[63622]: Reconfiguring osd.2 (monmap changed)... 2024-05-06T21:28:55.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T21:28:55.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:55.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:55 smithi154 ceph-mon[63622]: Reconfiguring daemon osd.2 on smithi032 2024-05-06T21:28:56.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:56 smithi032 ceph-mon[76650]: pgmap v20: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:56.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:56.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:56.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.fpdhzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:28:56.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:56.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:56 smithi154 ceph-mon[63622]: pgmap v20: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:56.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:56.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:56.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.fpdhzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:28:56.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:57.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:57 smithi154 ceph-mon[63622]: Reconfiguring mds.cephfs.smithi032.fpdhzg (monmap changed)... 2024-05-06T21:28:57.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:57 smithi154 ceph-mon[63622]: Reconfiguring daemon mds.cephfs.smithi032.fpdhzg on smithi032 2024-05-06T21:28:57.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:57 smithi032 ceph-mon[76650]: Reconfiguring mds.cephfs.smithi032.fpdhzg (monmap changed)... 2024-05-06T21:28:57.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:57 smithi032 ceph-mon[76650]: Reconfiguring daemon mds.cephfs.smithi032.fpdhzg on smithi032 2024-05-06T21:28:58.460 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:58 smithi032 ceph-mon[76650]: pgmap v21: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:58.461 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:58 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:58.461 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:58 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:58.461 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:58 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.jbgmwi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:28:58.461 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:58 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:58.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:58 smithi154 ceph-mon[63622]: pgmap v21: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:28:58.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:58 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:58.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:58 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:28:58.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:58 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.jbgmwi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:28:58.541 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:58 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:28:59.463 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:59 smithi032 ceph-mon[76650]: Reconfiguring mds.cephfs.smithi032.jbgmwi (monmap changed)... 2024-05-06T21:28:59.464 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:28:59 smithi032 ceph-mon[76650]: Reconfiguring daemon mds.cephfs.smithi032.jbgmwi on smithi032 2024-05-06T21:28:59.467 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:59 smithi154 ceph-mon[63622]: Reconfiguring mds.cephfs.smithi032.jbgmwi (monmap changed)... 2024-05-06T21:28:59.467 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:28:59 smithi154 ceph-mon[63622]: Reconfiguring daemon mds.cephfs.smithi032.jbgmwi on smithi032 2024-05-06T21:29:00.467 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:00 smithi154 ceph-mon[63622]: pgmap v22: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:00.467 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:00.468 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:00.468 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:29:00.468 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:29:00.468 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-05-06T21:29:00.468 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi154"}]: dispatch 2024-05-06T21:29:00.468 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:00 smithi032 ceph-mon[76650]: pgmap v22: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:29:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:29:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-05-06T21:29:00.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi154"}]: dispatch 2024-05-06T21:29:00.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:01.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:01 smithi032 ceph-mon[76650]: Reconfiguring ceph-exporter.smithi154 (monmap changed)... 2024-05-06T21:29:01.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:01 smithi032 ceph-mon[76650]: Unable to update caps for client.ceph-exporter.smithi154 2024-05-06T21:29:01.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:01 smithi032 ceph-mon[76650]: Reconfiguring daemon ceph-exporter.smithi154 on smithi154 2024-05-06T21:29:01.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:01 smithi154 ceph-mon[63622]: Reconfiguring ceph-exporter.smithi154 (monmap changed)... 2024-05-06T21:29:01.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:01 smithi154 ceph-mon[63622]: Unable to update caps for client.ceph-exporter.smithi154 2024-05-06T21:29:01.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:01 smithi154 ceph-mon[63622]: Reconfiguring daemon ceph-exporter.smithi154 on smithi154 2024-05-06T21:29:02.314 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:02 smithi154 ceph-mon[63622]: pgmap v23: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:02.315 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:02.315 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:02.315 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi154", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:29:02.315 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:02.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:02 smithi032 ceph-mon[76650]: pgmap v23: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:02.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:02.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:02.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi154", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:29:02.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:03.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:03 smithi032 ceph-mon[76650]: Reconfiguring crash.smithi154 (monmap changed)... 2024-05-06T21:29:03.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:03 smithi032 ceph-mon[76650]: Reconfiguring daemon crash.smithi154 on smithi154 2024-05-06T21:29:03.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:03 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:03.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:03 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:03.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:03 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:29:03.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:03 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:29:03.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:03 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:03.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:03 smithi154 ceph-mon[63622]: Reconfiguring crash.smithi154 (monmap changed)... 2024-05-06T21:29:03.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:03 smithi154 ceph-mon[63622]: Reconfiguring daemon crash.smithi154 on smithi154 2024-05-06T21:29:03.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:03 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:03.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:03 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:03.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:03 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi154.kilvol", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T21:29:03.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:03 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T21:29:03.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:03 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:04.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:04 smithi154 ceph-mon[63622]: pgmap v24: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:04.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:04 smithi154 ceph-mon[63622]: Reconfiguring mgr.smithi154.kilvol (monmap changed)... 2024-05-06T21:29:04.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:04 smithi154 ceph-mon[63622]: Reconfiguring daemon mgr.smithi154.kilvol on smithi154 2024-05-06T21:29:04.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:04 smithi032 ceph-mon[76650]: pgmap v24: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:04.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:04 smithi032 ceph-mon[76650]: Reconfiguring mgr.smithi154.kilvol (monmap changed)... 2024-05-06T21:29:04.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:04 smithi032 ceph-mon[76650]: Reconfiguring daemon mgr.smithi154.kilvol on smithi154 2024-05-06T21:29:06.110 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:05 smithi154 ceph-mon[63622]: pgmap v25: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:06.111 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:06.111 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:06.111 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:05 smithi154 ceph-mon[63622]: Reconfiguring mon.smithi154 (monmap changed)... 2024-05-06T21:29:06.111 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:29:06.111 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:29:06.111 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:06.111 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:05 smithi154 ceph-mon[63622]: Reconfiguring daemon mon.smithi154 on smithi154 2024-05-06T21:29:06.111 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:29:06.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:05 smithi032 ceph-mon[76650]: pgmap v25: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:06.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:06.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:06.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:05 smithi032 ceph-mon[76650]: Reconfiguring mon.smithi154 (monmap changed)... 2024-05-06T21:29:06.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T21:29:06.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T21:29:06.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:06.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:05 smithi032 ceph-mon[76650]: Reconfiguring daemon mon.smithi154 on smithi154 2024-05-06T21:29:06.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:29:07.469 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:07 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:07.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:07 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:07.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:07 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:07.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:07 smithi032 ceph-mon[76650]: Reconfiguring osd.3 (monmap changed)... 2024-05-06T21:29:07.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:07 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T21:29:07.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:07 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:07.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:07 smithi032 ceph-mon[76650]: Reconfiguring daemon osd.3 on smithi154 2024-05-06T21:29:07.723 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:07 smithi032 ceph-mon[76650]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:07.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:07 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:07.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:07 smithi154 ceph-mon[63622]: Reconfiguring osd.3 (monmap changed)... 2024-05-06T21:29:07.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:07 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T21:29:07.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:07 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:07.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:07 smithi154 ceph-mon[63622]: Reconfiguring daemon osd.3 on smithi154 2024-05-06T21:29:07.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:07 smithi154 ceph-mon[63622]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:09.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:09.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:09.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:09 smithi154 ceph-mon[63622]: Reconfiguring osd.4 (monmap changed)... 2024-05-06T21:29:09.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T21:29:09.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:09.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:09 smithi154 ceph-mon[63622]: Reconfiguring daemon osd.4 on smithi154 2024-05-06T21:29:09.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:09.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:09.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:09 smithi032 ceph-mon[76650]: Reconfiguring osd.4 (monmap changed)... 2024-05-06T21:29:09.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T21:29:09.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:09.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:09 smithi032 ceph-mon[76650]: Reconfiguring daemon osd.4 on smithi154 2024-05-06T21:29:10.428 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:10 smithi154 ceph-mon[63622]: pgmap v27: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:10.428 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:10 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:10.428 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:10 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:10.428 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:10 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T21:29:10.428 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:10 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:10.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:10 smithi032 ceph-mon[76650]: pgmap v27: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:10.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:10 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:10.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:10 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:10.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:10 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T21:29:10.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:10 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:11.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:11 smithi032 ceph-mon[76650]: Reconfiguring osd.5 (monmap changed)... 2024-05-06T21:29:11.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:11 smithi032 ceph-mon[76650]: Reconfiguring daemon osd.5 on smithi154 2024-05-06T21:29:11.430 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:11 smithi154 ceph-mon[63622]: Reconfiguring osd.5 (monmap changed)... 2024-05-06T21:29:11.430 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:11 smithi154 ceph-mon[63622]: Reconfiguring daemon osd.5 on smithi154 2024-05-06T21:29:12.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.043+0000 7f21af22b700 1 -- 172.21.15.32:0/4145327501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8100140 msgr2=0x7f21a8100550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.043+0000 7f21af22b700 1 --2- 172.21.15.32:0/4145327501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8100140 0x7f21a8100550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2198009910 tx=0x7f2198009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:12.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.043+0000 7f21af22b700 1 -- 172.21.15.32:0/4145327501 shutdown_connections 2024-05-06T21:29:12.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.043+0000 7f21af22b700 1 --2- 172.21.15.32:0/4145327501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a8101340 0x7f21a8101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.043+0000 7f21af22b700 1 --2- 172.21.15.32:0/4145327501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8100140 0x7f21a8100550 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.043+0000 7f21af22b700 1 -- 172.21.15.32:0/4145327501 >> 172.21.15.32:0/4145327501 conn(0x7f21a80fb6b0 msgr2=0x7f21a80fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:12.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.044+0000 7f21af22b700 1 -- 172.21.15.32:0/4145327501 shutdown_connections 2024-05-06T21:29:12.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.044+0000 7f21af22b700 1 -- 172.21.15.32:0/4145327501 wait complete. 2024-05-06T21:29:12.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.044+0000 7f21af22b700 1 Processor -- start 2024-05-06T21:29:12.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.044+0000 7f21af22b700 1 -- start start 2024-05-06T21:29:12.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.044+0000 7f21af22b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a8100140 0x7f21a8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.044+0000 7f21af22b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8101340 0x7f21a8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.044+0000 7f21af22b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a8073680 con 0x7f21a8101340 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.044+0000 7f21af22b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80737c0 con 0x7f21a8100140 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8101340 0x7f21a8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8101340 0x7f21a8073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38286/0 (socket says 172.21.15.32:38286) 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a7fff700 1 -- 172.21.15.32:0/4192305435 learned_addr learned my addr 172.21.15.32:0/4192305435 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21acfc7700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a8100140 0x7f21a8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a7fff700 1 -- 172.21.15.32:0/4192305435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a8100140 msgr2=0x7f21a8074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a7fff700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a8100140 0x7f21a8074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a7fff700 1 -- 172.21.15.32:0/4192305435 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980095f0 con 0x7f21a8101340 2024-05-06T21:29:12.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a7fff700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8101340 0x7f21a8073140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f219000b4b0 tx=0x7f219000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:12.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a5ffb700 1 -- 172.21.15.32:0/4192305435 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2190011800 con 0x7f21a8101340 2024-05-06T21:29:12.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a5ffb700 1 -- 172.21.15.32:0/4192305435 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2190011e10 con 0x7f21a8101340 2024-05-06T21:29:12.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21a5ffb700 1 -- 172.21.15.32:0/4192305435 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f219000f2e0 con 0x7f21a8101340 2024-05-06T21:29:12.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.045+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a8073aa0 con 0x7f21a8101340 2024-05-06T21:29:12.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.046+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a819d9f0 con 0x7f21a8101340 2024-05-06T21:29:12.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.047+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a8108d10 con 0x7f21a8101340 2024-05-06T21:29:12.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.047+0000 7f21a5ffb700 1 -- 172.21.15.32:0/4192305435 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f2190010380 con 0x7f21a8101340 2024-05-06T21:29:12.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.048+0000 7f21a5ffb700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f219406e340 0x7f21940707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:12.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.048+0000 7f21acfc7700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f219406e340 0x7f21940707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:12.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.048+0000 7f21a5ffb700 1 -- 172.21.15.32:0/4192305435 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f219008dda0 con 0x7f21a8101340 2024-05-06T21:29:12.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.048+0000 7f21acfc7700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f219406e340 0x7f21940707f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2198005200 tx=0x7f219800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:12.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.053+0000 7f21a5ffb700 1 -- 172.21.15.32:0/4192305435 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f219005ab70 con 0x7f21a8101340 2024-05-06T21:29:12.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.287+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21a8105c90 con 0x7f219406e340 2024-05-06T21:29:12.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.288+0000 7f21a5ffb700 1 -- 172.21.15.32:0/4192305435 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f21a8105c90 con 0x7f219406e340 2024-05-06T21:29:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.290+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f219406e340 msgr2=0x7f21940707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.290+0000 7f21af22b700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f219406e340 0x7f21940707f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2198005200 tx=0x7f219800b540 comp rx=0 tx=0).stop 2024-05-06T21:29:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.290+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8101340 msgr2=0x7f21a8073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.290+0000 7f21af22b700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8101340 0x7f21a8073140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f219000b4b0 tx=0x7f219000b7c0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.290+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 shutdown_connections 2024-05-06T21:29:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.290+0000 7f21af22b700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f219406e340 0x7f21940707f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.291+0000 7f21af22b700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a8100140 0x7f21a8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.291+0000 7f21af22b700 1 --2- 172.21.15.32:0/4192305435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21a8101340 0x7f21a8073140 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.291+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 >> 172.21.15.32:0/4192305435 conn(0x7f21a80fb6b0 msgr2=0x7f21a8104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:12.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.291+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 shutdown_connections 2024-05-06T21:29:12.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.291+0000 7f21af22b700 1 -- 172.21.15.32:0/4192305435 wait complete. 2024-05-06T21:29:12.301 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:29:12.301 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:12 smithi032 ceph-mon[76650]: pgmap v28: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:12.301 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:12.301 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:12.301 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.rizdbu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:29:12.301 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:12.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:12 smithi154 ceph-mon[63622]: pgmap v28: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:12.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:12.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:12.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.rizdbu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:29:12.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:12.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.400+0000 7f11e3960700 1 -- 172.21.15.32:0/3247897140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc100cd0 msgr2=0x7f11dc1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.400+0000 7f11e3960700 1 --2- 172.21.15.32:0/3247897140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc100cd0 0x7f11dc1030b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009910 tx=0x7f11d8009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:12.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.400+0000 7f11e3960700 1 -- 172.21.15.32:0/3247897140 shutdown_connections 2024-05-06T21:29:12.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.400+0000 7f11e3960700 1 --2- 172.21.15.32:0/3247897140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11dc1035f0 0x7f11dc1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.400+0000 7f11e3960700 1 --2- 172.21.15.32:0/3247897140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc100cd0 0x7f11dc1030b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.400+0000 7f11e3960700 1 -- 172.21.15.32:0/3247897140 >> 172.21.15.32:0/3247897140 conn(0x7f11dc0fa6d0 msgr2=0x7f11dc0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:12.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.400+0000 7f11e3960700 1 -- 172.21.15.32:0/3247897140 shutdown_connections 2024-05-06T21:29:12.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.400+0000 7f11e3960700 1 -- 172.21.15.32:0/3247897140 wait complete. 2024-05-06T21:29:12.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.401+0000 7f11e3960700 1 Processor -- start 2024-05-06T21:29:12.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.401+0000 7f11e3960700 1 -- start start 2024-05-06T21:29:12.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.401+0000 7f11e3960700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11dc100cd0 0x7f11dc195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:12.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.401+0000 7f11e3960700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc1035f0 0x7f11dc195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:12.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.401+0000 7f11e3960700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc1965b0 con 0x7f11dc1035f0 2024-05-06T21:29:12.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.401+0000 7f11e3960700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc1966f0 con 0x7f11dc100cd0 2024-05-06T21:29:12.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.401+0000 7f11e0efb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc1035f0 0x7f11dc195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:12.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.401+0000 7f11e0efb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc1035f0 0x7f11dc195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38304/0 (socket says 172.21.15.32:38304) 2024-05-06T21:29:12.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.401+0000 7f11e0efb700 1 -- 172.21.15.32:0/1415644789 learned_addr learned my addr 172.21.15.32:0/1415644789 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11e16fc700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11dc100cd0 0x7f11dc195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11e0efb700 1 -- 172.21.15.32:0/1415644789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11dc100cd0 msgr2=0x7f11dc195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11e0efb700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11dc100cd0 0x7f11dc195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11e0efb700 1 -- 172.21.15.32:0/1415644789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80095f0 con 0x7f11dc1035f0 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11e0efb700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc1035f0 0x7f11dc195f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00c8a0 tx=0x7f11cc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11d27fc700 1 -- 172.21.15.32:0/1415644789 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc0078e0 con 0x7f11dc1035f0 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11d27fc700 1 -- 172.21.15.32:0/1415644789 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f11cc00f450 con 0x7f11dc1035f0 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11d27fc700 1 -- 172.21.15.32:0/1415644789 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc00e5e0 con 0x7f11dc1035f0 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc19b1a0 con 0x7f11dc1035f0 2024-05-06T21:29:12.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.402+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc19b6f0 con 0x7f11dc1035f0 2024-05-06T21:29:12.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.403+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc18fc60 con 0x7f11dc1035f0 2024-05-06T21:29:12.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.404+0000 7f11d27fc700 1 -- 172.21.15.32:0/1415644789 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f11cc00f5c0 con 0x7f11dc1035f0 2024-05-06T21:29:12.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.404+0000 7f11d27fc700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f11c806e340 0x7f11c80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:12.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.404+0000 7f11d27fc700 1 -- 172.21.15.32:0/1415644789 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f11cc08e3f0 con 0x7f11dc1035f0 2024-05-06T21:29:12.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.404+0000 7f11e16fc700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f11c806e340 0x7f11c80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:12.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.405+0000 7f11e16fc700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f11c806e340 0x7f11c80707f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b5c0 tx=0x7f11d80052a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:12.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.409+0000 7f11d27fc700 1 -- 172.21.15.32:0/1415644789 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f11cc05b030 con 0x7f11dc1035f0 2024-05-06T21:29:12.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.639+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11dc061190 con 0x7f11c806e340 2024-05-06T21:29:12.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.641+0000 7f11d27fc700 1 -- 172.21.15.32:0/1415644789 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f11dc061190 con 0x7f11c806e340 2024-05-06T21:29:12.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f11c806e340 msgr2=0x7f11c80707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f11c806e340 0x7f11c80707f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b5c0 tx=0x7f11d80052a0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc1035f0 msgr2=0x7f11dc195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc1035f0 0x7f11dc195f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00c8a0 tx=0x7f11cc00cbb0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 shutdown_connections 2024-05-06T21:29:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f11c806e340 0x7f11c80707f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11dc100cd0 0x7f11dc195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 --2- 172.21.15.32:0/1415644789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11dc1035f0 0x7f11dc195f90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 >> 172.21.15.32:0/1415644789 conn(0x7f11dc0fa6d0 msgr2=0x7f11dc0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 shutdown_connections 2024-05-06T21:29:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.643+0000 7f11e3960700 1 -- 172.21.15.32:0/1415644789 wait complete. 2024-05-06T21:29:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.752+0000 7f32bc74d700 1 -- 172.21.15.32:0/1465603300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 msgr2=0x7f32b4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.752+0000 7f32bc74d700 1 --2- 172.21.15.32:0/1465603300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 0x7f32b4100840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009910 tx=0x7f32a4009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.752+0000 7f32bc74d700 1 -- 172.21.15.32:0/1465603300 shutdown_connections 2024-05-06T21:29:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.752+0000 7f32bc74d700 1 --2- 172.21.15.32:0/1465603300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 0x7f32b4100840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.752+0000 7f32bc74d700 1 --2- 172.21.15.32:0/1465603300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40ff130 0x7f32b40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.752+0000 7f32bc74d700 1 -- 172.21.15.32:0/1465603300 >> 172.21.15.32:0/1465603300 conn(0x7f32b40fa780 msgr2=0x7f32b40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:12.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.752+0000 7f32bc74d700 1 -- 172.21.15.32:0/1465603300 shutdown_connections 2024-05-06T21:29:12.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.752+0000 7f32bc74d700 1 -- 172.21.15.32:0/1465603300 wait complete. 2024-05-06T21:29:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32bc74d700 1 Processor -- start 2024-05-06T21:29:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32bc74d700 1 -- start start 2024-05-06T21:29:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32bc74d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40ff130 0x7f32b40690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32bc74d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 0x7f32b419a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32bc74d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b419ae20 con 0x7f32b41003d0 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32bc74d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b419af60 con 0x7f32b40ff130 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32b9ce8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 0x7f32b419a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32ba4e9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40ff130 0x7f32b40690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32b9ce8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 0x7f32b419a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38326/0 (socket says 172.21.15.32:38326) 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.753+0000 7f32b9ce8700 1 -- 172.21.15.32:0/371454573 learned_addr learned my addr 172.21.15.32:0/371454573 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.754+0000 7f32b9ce8700 1 -- 172.21.15.32:0/371454573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40ff130 msgr2=0x7f32b40690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.754+0000 7f32b9ce8700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40ff130 0x7f32b40690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.754+0000 7f32b9ce8700 1 -- 172.21.15.32:0/371454573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a40095f0 con 0x7f32b41003d0 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.754+0000 7f32b9ce8700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 0x7f32b419a850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32a4006010 tx=0x7f32a400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.754+0000 7f32ab7fe700 1 -- 172.21.15.32:0/371454573 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a401d070 con 0x7f32b41003d0 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.754+0000 7f32ab7fe700 1 -- 172.21.15.32:0/371454573 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32a400f460 con 0x7f32b41003d0 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.754+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b419b1e0 con 0x7f32b41003d0 2024-05-06T21:29:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.754+0000 7f32ab7fe700 1 -- 172.21.15.32:0/371454573 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a4021640 con 0x7f32b41003d0 2024-05-06T21:29:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.754+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b419b6d0 con 0x7f32b41003d0 2024-05-06T21:29:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.755+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b4107c90 con 0x7f32b41003d0 2024-05-06T21:29:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.755+0000 7f32ab7fe700 1 -- 172.21.15.32:0/371454573 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f32a400f5d0 con 0x7f32b41003d0 2024-05-06T21:29:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.756+0000 7f32ab7fe700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32a006e340 0x7f32a00707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.756+0000 7f32ab7fe700 1 -- 172.21.15.32:0/371454573 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f32a408f660 con 0x7f32b41003d0 2024-05-06T21:29:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.756+0000 7f32ba4e9700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32a006e340 0x7f32a00707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.756+0000 7f32ba4e9700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32a006e340 0x7f32a00707f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009a10 tx=0x7f32b0009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.761+0000 7f32ab7fe700 1 -- 172.21.15.32:0/371454573 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f32a405c320 con 0x7f32b41003d0 2024-05-06T21:29:12.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.985+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f32b4104d20 con 0x7f32a006e340 2024-05-06T21:29:12.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.995+0000 7f32ab7fe700 1 -- 172.21.15.32:0/371454573 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f32b4104d20 con 0x7f32a006e340 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (9m) 46s ago 10m 24.6M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (11m) 46s ago 11m 7755k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (10m) 34s ago 10m 7704k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (11m) 46s ago 11m 6669k - 18.2.0 dc2bc1663786 24acd0735d91 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (10m) 34s ago 10m 6665k - 18.2.0 dc2bc1663786 b6ec39e4902e 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (9m) 46s ago 10m 85.6M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (5m) 46s ago 5m 14.4M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (5m) 46s ago 5m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (5m) 34s ago 5m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (5m) 34s ago 5m 16.3M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:29:12.995 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (2m) 46s ago 12m 472M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:29:12.996 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (84s) 34s ago 9m 448M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:29:12.996 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (61s) 46s ago 12m 28.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:29:12.996 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (38s) 34s ago 9m 24.8M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:29:12.996 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (11m) 46s ago 11m 15.9M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:29:12.996 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (9m) 34s ago 9m 16.7M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:29:12.996 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (9m) 46s ago 9m 214M 1217M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:29:12.997 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (8m) 46s ago 8m 241M 1217M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:29:12.997 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (8m) 46s ago 8m 195M 1217M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:29:12.997 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (7m) 34s ago 7m 277M 2240M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:29:12.997 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (7m) 34s ago 7m 248M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:29:12.997 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (6m) 34s ago 6m 236M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:29:12.997 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (92s) 46s ago 10m 53.3M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:29:12.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32a006e340 msgr2=0x7f32a00707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32a006e340 0x7f32a00707f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009a10 tx=0x7f32b0009190 comp rx=0 tx=0).stop 2024-05-06T21:29:12.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 msgr2=0x7f32b419a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:12.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 0x7f32b419a850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32a4006010 tx=0x7f32a400bd70 comp rx=0 tx=0).stop 2024-05-06T21:29:12.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 shutdown_connections 2024-05-06T21:29:12.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32a006e340 0x7f32a00707f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b40ff130 0x7f32b40690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 --2- 172.21.15.32:0/371454573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b41003d0 0x7f32b419a850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:12.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 >> 172.21.15.32:0/371454573 conn(0x7f32b40fa780 msgr2=0x7f32b4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:12.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 shutdown_connections 2024-05-06T21:29:12.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:12.998+0000 7f32bc74d700 1 -- 172.21.15.32:0/371454573 wait complete. 2024-05-06T21:29:13.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.107+0000 7f76aeff1700 1 -- 172.21.15.32:0/3343421134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a81003d0 msgr2=0x7f76a8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.107+0000 7f76aeff1700 1 --2- 172.21.15.32:0/3343421134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a81003d0 0x7f76a8100840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7694009910 tx=0x7f7694009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:13.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.107+0000 7f76aeff1700 1 -- 172.21.15.32:0/3343421134 shutdown_connections 2024-05-06T21:29:13.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.107+0000 7f76aeff1700 1 --2- 172.21.15.32:0/3343421134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a81003d0 0x7f76a8100840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.107+0000 7f76aeff1700 1 --2- 172.21.15.32:0/3343421134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a80ff130 0x7f76a80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.107+0000 7f76aeff1700 1 -- 172.21.15.32:0/3343421134 >> 172.21.15.32:0/3343421134 conn(0x7f76a80fa780 msgr2=0x7f76a80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.107+0000 7f76aeff1700 1 -- 172.21.15.32:0/3343421134 shutdown_connections 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.107+0000 7f76aeff1700 1 -- 172.21.15.32:0/3343421134 wait complete. 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76aeff1700 1 Processor -- start 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76aeff1700 1 -- start start 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76aeff1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a80ff130 0x7f76a80690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76aeff1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a81003d0 0x7f76a819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76aeff1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a819ad70 con 0x7f76a80ff130 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76aeff1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a819aee0 con 0x7f76a81003d0 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76acd8d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a80ff130 0x7f76a80690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76acd8d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a80ff130 0x7f76a80690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38346/0 (socket says 172.21.15.32:38346) 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76acd8d700 1 -- 172.21.15.32:0/1981992969 learned_addr learned my addr 172.21.15.32:0/1981992969 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76a7fff700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a81003d0 0x7f76a819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76acd8d700 1 -- 172.21.15.32:0/1981992969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a81003d0 msgr2=0x7f76a819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76acd8d700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a81003d0 0x7f76a819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.108+0000 7f76acd8d700 1 -- 172.21.15.32:0/1981992969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76940095f0 con 0x7f76a80ff130 2024-05-06T21:29:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.109+0000 7f76acd8d700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a80ff130 0x7f76a80690c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f769c00d900 tx=0x7f769c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.109+0000 7f76a5ffb700 1 -- 172.21.15.32:0/1981992969 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f769c0041f0 con 0x7f76a80ff130 2024-05-06T21:29:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.109+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a819b1c0 con 0x7f76a80ff130 2024-05-06T21:29:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.109+0000 7f76a5ffb700 1 -- 172.21.15.32:0/1981992969 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f769c004ce0 con 0x7f76a80ff130 2024-05-06T21:29:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.109+0000 7f76a5ffb700 1 -- 172.21.15.32:0/1981992969 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f769c00b750 con 0x7f76a80ff130 2024-05-06T21:29:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.109+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a819b6e0 con 0x7f76a80ff130 2024-05-06T21:29:13.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.110+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a8107c10 con 0x7f76a80ff130 2024-05-06T21:29:13.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.111+0000 7f76a5ffb700 1 -- 172.21.15.32:0/1981992969 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f769c004e50 con 0x7f76a80ff130 2024-05-06T21:29:13.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.111+0000 7f76a5ffb700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f769806e340 0x7f76980707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:13.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.111+0000 7f76a5ffb700 1 -- 172.21.15.32:0/1981992969 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f769c08e300 con 0x7f76a80ff130 2024-05-06T21:29:13.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.111+0000 7f76a7fff700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f769806e340 0x7f76980707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:13.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.112+0000 7f76a7fff700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f769806e340 0x7f76980707f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f769400b5c0 tx=0x7f7694005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:13.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.116+0000 7f76a5ffb700 1 -- 172.21.15.32:0/1981992969 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f769c05af40 con 0x7f76a80ff130 2024-05-06T21:29:13.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:13 smithi154 ceph-mon[63622]: Reconfiguring mds.cephfs.smithi154.rizdbu (monmap changed)... 2024-05-06T21:29:13.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:13 smithi154 ceph-mon[63622]: Reconfiguring daemon mds.cephfs.smithi154.rizdbu on smithi154 2024-05-06T21:29:13.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:13.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:13.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.xfmqxf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:29:13.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:13.396 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:13 smithi032 ceph-mon[76650]: Reconfiguring mds.cephfs.smithi154.rizdbu (monmap changed)... 2024-05-06T21:29:13.396 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:13 smithi032 ceph-mon[76650]: Reconfiguring daemon mds.cephfs.smithi154.rizdbu on smithi154 2024-05-06T21:29:13.396 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:13.396 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:13.397 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.xfmqxf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:29:13.397 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:13.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.421+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76a819bd20 con 0x7f76a80ff130 2024-05-06T21:29:13.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.422+0000 7f76a5ffb700 1 -- 172.21.15.32:0/1981992969 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f769c05aad0 con 0x7f76a80ff130 2024-05-06T21:29:13.421 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:29:13.421 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:29:13.421 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:29:13.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:29:13.421 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 4 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:29:13.422 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f769806e340 msgr2=0x7f76980707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f769806e340 0x7f76980707f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f769400b5c0 tx=0x7f7694005ee0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a80ff130 msgr2=0x7f76a80690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a80ff130 0x7f76a80690c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f769c00d900 tx=0x7f769c00dc10 comp rx=0 tx=0).stop 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 shutdown_connections 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f769806e340 0x7f76980707f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76a80ff130 0x7f76a80690c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 --2- 172.21.15.32:0/1981992969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a81003d0 0x7f76a819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 >> 172.21.15.32:0/1981992969 conn(0x7f76a80fa780 msgr2=0x7f76a8103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 shutdown_connections 2024-05-06T21:29:13.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.424+0000 7f76aeff1700 1 -- 172.21.15.32:0/1981992969 wait complete. 2024-05-06T21:29:13.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.533+0000 7ff35a9c0700 1 -- 172.21.15.32:0/3876609918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 msgr2=0x7ff354101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.533+0000 7ff35a9c0700 1 --2- 172.21.15.32:0/3876609918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 0x7ff354101890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff348009910 tx=0x7ff348009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:13.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.534+0000 7ff35a9c0700 1 -- 172.21.15.32:0/3876609918 shutdown_connections 2024-05-06T21:29:13.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.534+0000 7ff35a9c0700 1 --2- 172.21.15.32:0/3876609918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 0x7ff354101890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.534+0000 7ff35a9c0700 1 --2- 172.21.15.32:0/3876609918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff354100240 0x7ff354100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.534+0000 7ff35a9c0700 1 -- 172.21.15.32:0/3876609918 >> 172.21.15.32:0/3876609918 conn(0x7ff3540fb7f0 msgr2=0x7ff3540fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:13.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.534+0000 7ff35a9c0700 1 -- 172.21.15.32:0/3876609918 shutdown_connections 2024-05-06T21:29:13.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.534+0000 7ff35a9c0700 1 -- 172.21.15.32:0/3876609918 wait complete. 2024-05-06T21:29:13.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.534+0000 7ff35a9c0700 1 Processor -- start 2024-05-06T21:29:13.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.534+0000 7ff35a9c0700 1 -- start start 2024-05-06T21:29:13.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff35a9c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff354100240 0x7ff354195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff35a9c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 0x7ff354195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff35a9c0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3541965f0 con 0x7ff354101440 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff35a9c0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff354196730 con 0x7ff354100240 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff3537fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 0x7ff354195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff3537fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 0x7ff354195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38366/0 (socket says 172.21.15.32:38366) 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff3537fe700 1 -- 172.21.15.32:0/150342671 learned_addr learned my addr 172.21.15.32:0/150342671 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff353fff700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff354100240 0x7ff354195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff3537fe700 1 -- 172.21.15.32:0/150342671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff354100240 msgr2=0x7ff354195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff3537fe700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff354100240 0x7ff354195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff3537fe700 1 -- 172.21.15.32:0/150342671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3480095f0 con 0x7ff354101440 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff3537fe700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 0x7ff354195fd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff34800bd70 tx=0x7ff34800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff3517fa700 1 -- 172.21.15.32:0/150342671 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff34801d070 con 0x7ff354101440 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff3517fa700 1 -- 172.21.15.32:0/150342671 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff348022470 con 0x7ff354101440 2024-05-06T21:29:13.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.535+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35419b180 con 0x7ff354101440 2024-05-06T21:29:13.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.536+0000 7ff3517fa700 1 -- 172.21.15.32:0/150342671 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff34800f670 con 0x7ff354101440 2024-05-06T21:29:13.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.536+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35419b670 con 0x7ff354101440 2024-05-06T21:29:13.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.537+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff354108d90 con 0x7ff354101440 2024-05-06T21:29:13.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.537+0000 7ff3517fa700 1 -- 172.21.15.32:0/150342671 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff348022a50 con 0x7ff354101440 2024-05-06T21:29:13.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.538+0000 7ff3517fa700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff33c06e340 0x7ff33c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:13.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.538+0000 7ff3517fa700 1 -- 172.21.15.32:0/150342671 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff34808f890 con 0x7ff354101440 2024-05-06T21:29:13.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.538+0000 7ff353fff700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff33c06e340 0x7ff33c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:13.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.538+0000 7ff353fff700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff33c06e340 0x7ff33c0707f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3541012a0 tx=0x7ff34400bef0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:13.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.542+0000 7ff3517fa700 1 -- 172.21.15.32:0/150342671 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff34805c720 con 0x7ff354101440 2024-05-06T21:29:13.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.803+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff354108f50 con 0x7ff354101440 2024-05-06T21:29:13.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.803+0000 7ff3517fa700 1 -- 172.21.15.32:0/150342671 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1922 (secure 0 0 0) 0x7ff3480277a0 con 0x7ff354101440 2024-05-06T21:29:13.803 INFO:teuthology.orchestra.run.smithi032.stdout:e20 2024-05-06T21:29:13.803 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:29:13.803 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:29:13.803 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:29:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:29:13.803 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:29:13.803 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:29:13.803 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 20 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:27:07.836937+0000 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:29:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 0 members: 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:29:13.805 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:29:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:29:13.806 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:29:13.806 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:29:13.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.805+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff33c06e340 msgr2=0x7ff33c0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.805+0000 7ff35a9c0700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff33c06e340 0x7ff33c0707f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3541012a0 tx=0x7ff34400bef0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.805+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 msgr2=0x7ff354195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.805+0000 7ff35a9c0700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 0x7ff354195fd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff34800bd70 tx=0x7ff34800be50 comp rx=0 tx=0).stop 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.806+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 shutdown_connections 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.806+0000 7ff35a9c0700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff33c06e340 0x7ff33c0707f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.806+0000 7ff35a9c0700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff354100240 0x7ff354195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.806+0000 7ff35a9c0700 1 --2- 172.21.15.32:0/150342671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff354101440 0x7ff354195fd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.806+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 >> 172.21.15.32:0/150342671 conn(0x7ff3540fb7f0 msgr2=0x7ff354104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.806+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 shutdown_connections 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.806+0000 7ff35a9c0700 1 -- 172.21.15.32:0/150342671 wait complete. 2024-05-06T21:29:13.807 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 20 2024-05-06T21:29:13.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.918+0000 7fef56c5a700 1 -- 172.21.15.32:0/1315071726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50069230 msgr2=0x7fef50102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.918+0000 7fef56c5a700 1 --2- 172.21.15.32:0/1315071726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50069230 0x7fef50102e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fef44009910 tx=0x7fef44009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:13.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.918+0000 7fef56c5a700 1 -- 172.21.15.32:0/1315071726 shutdown_connections 2024-05-06T21:29:13.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.918+0000 7fef56c5a700 1 --2- 172.21.15.32:0/1315071726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef50103350 0x7fef50105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.918+0000 7fef56c5a700 1 --2- 172.21.15.32:0/1315071726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50069230 0x7fef50102e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.918+0000 7fef56c5a700 1 -- 172.21.15.32:0/1315071726 >> 172.21.15.32:0/1315071726 conn(0x7fef500fa780 msgr2=0x7fef500fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:13.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.918+0000 7fef56c5a700 1 -- 172.21.15.32:0/1315071726 shutdown_connections 2024-05-06T21:29:13.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.918+0000 7fef56c5a700 1 -- 172.21.15.32:0/1315071726 wait complete. 2024-05-06T21:29:13.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.918+0000 7fef56c5a700 1 Processor -- start 2024-05-06T21:29:13.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef56c5a700 1 -- start start 2024-05-06T21:29:13.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef56c5a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef50069230 0x7fef50195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:13.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef56c5a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50103350 0x7fef50195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:13.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef56c5a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef501965e0 con 0x7fef50103350 2024-05-06T21:29:13.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef56c5a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50196720 con 0x7fef50069230 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef4ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50103350 0x7fef50195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef4ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50103350 0x7fef50195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38382/0 (socket says 172.21.15.32:38382) 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef4ffff700 1 -- 172.21.15.32:0/3554802590 learned_addr learned my addr 172.21.15.32:0/3554802590 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef549f6700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef50069230 0x7fef50195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef4ffff700 1 -- 172.21.15.32:0/3554802590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef50069230 msgr2=0x7fef50195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef4ffff700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef50069230 0x7fef50195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef4ffff700 1 -- 172.21.15.32:0/3554802590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef440095f0 con 0x7fef50103350 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef4ffff700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50103350 0x7fef50195fc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00d8d0 tx=0x7fef3c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.919+0000 7fef4dffb700 1 -- 172.21.15.32:0/3554802590 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3c0098a0 con 0x7fef50103350 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.920+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5019b1d0 con 0x7fef50103350 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.920+0000 7fef4dffb700 1 -- 172.21.15.32:0/3554802590 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fef3c010460 con 0x7fef50103350 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.920+0000 7fef4dffb700 1 -- 172.21.15.32:0/3554802590 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3c00f5f0 con 0x7fef50103350 2024-05-06T21:29:13.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.920+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5019b720 con 0x7fef50103350 2024-05-06T21:29:13.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.921+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef50108cf0 con 0x7fef50103350 2024-05-06T21:29:13.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.921+0000 7fef4dffb700 1 -- 172.21.15.32:0/3554802590 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fef3c009a00 con 0x7fef50103350 2024-05-06T21:29:13.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.922+0000 7fef4dffb700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fef4006e340 0x7fef400707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:13.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.922+0000 7fef4dffb700 1 -- 172.21.15.32:0/3554802590 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fef3c08e2b0 con 0x7fef50103350 2024-05-06T21:29:13.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.922+0000 7fef549f6700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fef4006e340 0x7fef400707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:13.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.922+0000 7fef549f6700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fef4006e340 0x7fef400707f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fef44005090 tx=0x7fef4400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:13.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:13.926+0000 7fef4dffb700 1 -- 172.21.15.32:0/3554802590 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fef3c05aef0 con 0x7fef50103350 2024-05-06T21:29:14.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.160+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef50104010 con 0x7fef4006e340 2024-05-06T21:29:14.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.161+0000 7fef4dffb700 1 -- 172.21.15.32:0/3554802590 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fef50104010 con 0x7fef4006e340 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "4/23 daemons upgraded", 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading mon daemons", 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:29:14.161 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:29:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fef4006e340 msgr2=0x7fef400707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fef4006e340 0x7fef400707f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fef44005090 tx=0x7fef4400b540 comp rx=0 tx=0).stop 2024-05-06T21:29:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50103350 msgr2=0x7fef50195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50103350 0x7fef50195fc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00d8d0 tx=0x7fef3c00dbe0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 shutdown_connections 2024-05-06T21:29:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fef4006e340 0x7fef400707f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef50069230 0x7fef50195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 --2- 172.21.15.32:0/3554802590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef50103350 0x7fef50195fc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 >> 172.21.15.32:0/3554802590 conn(0x7fef500fa780 msgr2=0x7fef500fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 shutdown_connections 2024-05-06T21:29:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.164+0000 7fef56c5a700 1 -- 172.21.15.32:0/3554802590 wait complete. 2024-05-06T21:29:14.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.272+0000 7fd3d57b1700 1 -- 172.21.15.32:0/723503236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d01036a0 msgr2=0x7fd3d0105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:14.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.272+0000 7fd3d57b1700 1 --2- 172.21.15.32:0/723503236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d01036a0 0x7fd3d0105a80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009910 tx=0x7fd3c4009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:14.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.272+0000 7fd3d57b1700 1 -- 172.21.15.32:0/723503236 shutdown_connections 2024-05-06T21:29:14.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.272+0000 7fd3d57b1700 1 --2- 172.21.15.32:0/723503236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d01036a0 0x7fd3d0105a80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.272+0000 7fd3d57b1700 1 --2- 172.21.15.32:0/723503236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d0100d80 0x7fd3d0103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.272+0000 7fd3d57b1700 1 -- 172.21.15.32:0/723503236 >> 172.21.15.32:0/723503236 conn(0x7fd3d00fa7a0 msgr2=0x7fd3d00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:14.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.273+0000 7fd3d57b1700 1 -- 172.21.15.32:0/723503236 shutdown_connections 2024-05-06T21:29:14.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.273+0000 7fd3d57b1700 1 -- 172.21.15.32:0/723503236 wait complete. 2024-05-06T21:29:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.273+0000 7fd3d57b1700 1 Processor -- start 2024-05-06T21:29:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.273+0000 7fd3d57b1700 1 -- start start 2024-05-06T21:29:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3d57b1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d0100d80 0x7fd3d01006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3d57b1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d01036a0 0x7fd3d00fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3d57b1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00ff270 con 0x7fd3d0100d80 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3d57b1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00ff3b0 con 0x7fd3d01036a0 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3ceffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d0100d80 0x7fd3d01006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3ceffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d0100d80 0x7fd3d01006e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38400/0 (socket says 172.21.15.32:38400) 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3ceffd700 1 -- 172.21.15.32:0/1984403695 learned_addr learned my addr 172.21.15.32:0/1984403695 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3ce7fc700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d01036a0 0x7fd3d00fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3ceffd700 1 -- 172.21.15.32:0/1984403695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d01036a0 msgr2=0x7fd3d00fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3ceffd700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d01036a0 0x7fd3d00fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3ceffd700 1 -- 172.21.15.32:0/1984403695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40095f0 con 0x7fd3d0100d80 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3ce7fc700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d01036a0 0x7fd3d00fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3ceffd700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d0100d80 0x7fd3d01006e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c8f0 tx=0x7fd3c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3b7fff700 1 -- 172.21.15.32:0/1984403695 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c0007a50 con 0x7fd3d0100d80 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d00ff690 con 0x7fd3d0100d80 2024-05-06T21:29:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3b7fff700 1 -- 172.21.15.32:0/1984403695 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd3c0007bb0 con 0x7fd3d0100d80 2024-05-06T21:29:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.274+0000 7fd3b7fff700 1 -- 172.21.15.32:0/1984403695 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c0018630 con 0x7fd3d0100d80 2024-05-06T21:29:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.275+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d019de20 con 0x7fd3d0100d80 2024-05-06T21:29:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.276+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d018fc00 con 0x7fd3d0100d80 2024-05-06T21:29:14.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.276+0000 7fd3b7fff700 1 -- 172.21.15.32:0/1984403695 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fd3c0007d20 con 0x7fd3d0100d80 2024-05-06T21:29:14.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.277+0000 7fd3b7fff700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd3b806e340 0x7fd3b80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:14.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.277+0000 7fd3b7fff700 1 -- 172.21.15.32:0/1984403695 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd3c008e3d0 con 0x7fd3d0100d80 2024-05-06T21:29:14.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.277+0000 7fd3ce7fc700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd3b806e340 0x7fd3b80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:14.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.277+0000 7fd3ce7fc700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd3b806e340 0x7fd3b80707f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400b5c0 tx=0x7fd3c4005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:14.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.281+0000 7fd3b7fff700 1 -- 172.21.15.32:0/1984403695 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd3c005b010 con 0x7fd3d0100d80 2024-05-06T21:29:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:14 smithi154 ceph-mon[63622]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:14 smithi154 ceph-mon[63622]: pgmap v29: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:14 smithi154 ceph-mon[63622]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:14 smithi154 ceph-mon[63622]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:14 smithi154 ceph-mon[63622]: Reconfiguring mds.cephfs.smithi154.xfmqxf (monmap changed)... 2024-05-06T21:29:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:14 smithi154 ceph-mon[63622]: Reconfiguring daemon mds.cephfs.smithi154.xfmqxf on smithi154 2024-05-06T21:29:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:14 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1981992969' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:14 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/150342671' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:29:14.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:14 smithi032 ceph-mon[76650]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:14.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:14 smithi032 ceph-mon[76650]: pgmap v29: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:14.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:14 smithi032 ceph-mon[76650]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:14.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:14 smithi032 ceph-mon[76650]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:14.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:14 smithi032 ceph-mon[76650]: Reconfiguring mds.cephfs.smithi154.xfmqxf (monmap changed)... 2024-05-06T21:29:14.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:14 smithi032 ceph-mon[76650]: Reconfiguring daemon mds.cephfs.smithi154.xfmqxf on smithi154 2024-05-06T21:29:14.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:14 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1981992969' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:14.473 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:14 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/150342671' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:29:14.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.583+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd3d002ce20 con 0x7fd3d0100d80 2024-05-06T21:29:14.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.584+0000 7fd3b7fff700 1 -- 172.21.15.32:0/1984403695 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd3c005aba0 con 0x7fd3d0100d80 2024-05-06T21:29:14.583 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:29:14.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd3b806e340 msgr2=0x7fd3b80707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:14.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd3b806e340 0x7fd3b80707f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400b5c0 tx=0x7fd3c4005e20 comp rx=0 tx=0).stop 2024-05-06T21:29:14.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d0100d80 msgr2=0x7fd3d01006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:14.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d0100d80 0x7fd3d01006e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c8f0 tx=0x7fd3c000ccb0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 shutdown_connections 2024-05-06T21:29:14.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd3b806e340 0x7fd3b80707f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3d0100d80 0x7fd3d01006e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 --2- 172.21.15.32:0/1984403695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d01036a0 0x7fd3d00fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:14.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 >> 172.21.15.32:0/1984403695 conn(0x7fd3d00fa7a0 msgr2=0x7fd3d00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:14.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 shutdown_connections 2024-05-06T21:29:14.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:14.586+0000 7fd3d57b1700 1 -- 172.21.15.32:0/1984403695 wait complete. 2024-05-06T21:29:15.449 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1984403695' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi032"}]: dispatch 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi032"}]': finished 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi154"}]: dispatch 2024-05-06T21:29:15.450 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi154"}]': finished 2024-05-06T21:29:15.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:15.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1984403695' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:29:15.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:15.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:15.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:15.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:15.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:15.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:15.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi032"}]: dispatch 2024-05-06T21:29:15.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi032"}]': finished 2024-05-06T21:29:15.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi154"}]: dispatch 2024-05-06T21:29:15.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi154"}]': finished 2024-05-06T21:29:16.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:16 smithi032 ceph-mon[76650]: pgmap v30: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:16.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:16 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all mon 2024-05-06T21:29:16.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:16 smithi154 ceph-mon[63622]: pgmap v30: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:16.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:16 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all mon 2024-05-06T21:29:17.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:17 smithi154 ceph-mon[63622]: Upgrade: Updating crash.smithi032 (1/2) 2024-05-06T21:29:17.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:17 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:17.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:17 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi032", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:29:17.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:17 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:17.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:17 smithi154 ceph-mon[63622]: Deploying daemon crash.smithi032 on smithi032 2024-05-06T21:29:17.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:17 smithi154 ceph-mon[63622]: pgmap v31: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:17.698 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:17 smithi032 ceph-mon[76650]: Upgrade: Updating crash.smithi032 (1/2) 2024-05-06T21:29:17.698 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:17 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:17.698 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:17 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi032", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:29:17.698 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:17 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:17.698 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:17 smithi032 ceph-mon[76650]: Deploying daemon crash.smithi032 on smithi032 2024-05-06T21:29:17.698 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:17 smithi032 ceph-mon[76650]: pgmap v31: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:19.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:19 smithi032 ceph-mon[76650]: pgmap v32: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:20.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:19 smithi154 ceph-mon[63622]: pgmap v32: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:21.715 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:21.715 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:21.715 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:21 smithi032 ceph-mon[76650]: pgmap v33: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:21.716 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:29:21.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:21.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:21.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:21 smithi154 ceph-mon[63622]: pgmap v33: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:21.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:29:23.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:23 smithi154 ceph-mon[63622]: Upgrade: Updating crash.smithi154 (2/2) 2024-05-06T21:29:23.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:23 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:23.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:23 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi154", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:29:23.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:23 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:23.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:23 smithi154 ceph-mon[63622]: Deploying daemon crash.smithi154 on smithi154 2024-05-06T21:29:23.398 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:23 smithi032 ceph-mon[76650]: Upgrade: Updating crash.smithi154 (2/2) 2024-05-06T21:29:23.398 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:23 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:23.398 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:23 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi154", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-06T21:29:23.398 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:23 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:23.398 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:23 smithi032 ceph-mon[76650]: Deploying daemon crash.smithi154 on smithi154 2024-05-06T21:29:24.350 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:24 smithi154 ceph-mon[63622]: pgmap v34: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:24.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:24 smithi032 ceph-mon[76650]: pgmap v34: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:26.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:26 smithi154 ceph-mon[63622]: pgmap v35: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:26.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:26.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:26.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:26.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:26 smithi032 ceph-mon[76650]: pgmap v35: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:26.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:26.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:26.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:27.567 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:27 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:27.567 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:27 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:27.568 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:27 smithi154 ceph-mon[63622]: pgmap v36: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:27.844 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:27 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:27.844 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:27 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:27.844 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:27 smithi032 ceph-mon[76650]: pgmap v36: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:29.957 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:29 smithi032 ceph-mon[76650]: pgmap v37: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:29.958 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:29.958 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:30.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:29 smithi154 ceph-mon[63622]: pgmap v37: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:30.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:30.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:31.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:31 smithi154 ceph-mon[63622]: pgmap v38: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:31.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:31.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:31.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:31.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:31.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:31 smithi032 ceph-mon[76650]: pgmap v38: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:31.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:31.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:31.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:31.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:33.591 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:33.592 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:33.592 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:33 smithi154 ceph-mon[63622]: pgmap v39: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:33.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:33.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:33.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:33 smithi032 ceph-mon[76650]: pgmap v39: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:34.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:34 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:34.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:34 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:35.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:34 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:35.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:34 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:35.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:35 smithi032 ceph-mon[76650]: pgmap v40: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:35 smithi154 ceph-mon[63622]: pgmap v40: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:36.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:29:36.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:36.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:36.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:36.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all crash 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi032"}]: dispatch 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi032"}]': finished 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi154"}]: dispatch 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi154"}]': finished 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T21:29:36.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:36 smithi032 ceph-mon[76650]: Upgrade: osd.0 is safe to restart 2024-05-06T21:29:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:29:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:29:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all crash 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi032"}]: dispatch 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi032"}]': finished 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi154"}]: dispatch 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi154"}]': finished 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T21:29:37.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:36 smithi154 ceph-mon[63622]: Upgrade: osd.0 is safe to restart 2024-05-06T21:29:38.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:38 smithi154 ceph-mon[63622]: pgmap v41: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:38.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:38 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:38.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:38 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T21:29:38.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:38 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:38.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:38 smithi032 ceph-mon[76650]: pgmap v41: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:38.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:38 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:38.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:38 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T21:29:38.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:38 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:39.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:39 smithi154 ceph-mon[63622]: Upgrade: Updating osd.0 2024-05-06T21:29:39.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:39 smithi154 ceph-mon[63622]: Deploying daemon osd.0 on smithi032 2024-05-06T21:29:39.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:39 smithi032 ceph-mon[76650]: Upgrade: Updating osd.0 2024-05-06T21:29:39.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:39 smithi032 ceph-mon[76650]: Deploying daemon osd.0 on smithi032 2024-05-06T21:29:40.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:40 smithi032 ceph-mon[76650]: pgmap v42: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:40.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:40 smithi154 ceph-mon[63622]: pgmap v42: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:41.813 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:41 smithi032 systemd[1]: Stopping Ceph osd.0 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:29:42.118 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:41 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[42179]: 2024-05-06T21:29:41.813+0000 7f4cda79b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:29:42.118 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:41 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[42179]: 2024-05-06T21:29:41.813+0000 7f4cda79b700 -1 osd.0 50 *** Got signal Terminated *** 2024-05-06T21:29:42.118 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:41 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[42179]: 2024-05-06T21:29:41.813+0000 7f4cda79b700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:29:42.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:42 smithi032 ceph-mon[76650]: pgmap v43: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:42.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:42 smithi032 ceph-mon[76650]: osd.0 marked itself down and dead 2024-05-06T21:29:42.514 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:42 smithi154 ceph-mon[63622]: pgmap v43: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:42.514 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:42 smithi154 ceph-mon[63622]: osd.0 marked itself down and dead 2024-05-06T21:29:42.856 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:42 smithi032 podman[82554]: 2024-05-06 21:29:42.573260526 +0000 UTC m=+0.884273497 container died 258e137f3456556c4b2012fda1763aacf9c2f5d5ab25c8d2a9e649bebaa0d54b (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-06T21:29:43.107 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:43 smithi032 podman[82554]: 2024-05-06 21:29:43.106621009 +0000 UTC m=+1.417633979 container cleanup 258e137f3456556c4b2012fda1763aacf9c2f5d5ab25c8d2a9e649bebaa0d54b (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-06T21:29:43.107 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:43 smithi032 bash[82554]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0 2024-05-06T21:29:43.396 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:43 smithi032 ceph-mon[76650]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:29:43.396 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:43 smithi032 ceph-mon[76650]: osdmap e51: 6 total, 5 up, 6 in 2024-05-06T21:29:43.397 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:43 smithi032 ceph-mon[76650]: osdmap e52: 6 total, 5 up, 6 in 2024-05-06T21:29:43.397 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:43 smithi032 podman[82573]: 2024-05-06 21:29:43.358197767 +0000 UTC m=+0.780531145 container remove 258e137f3456556c4b2012fda1763aacf9c2f5d5ab25c8d2a9e649bebaa0d54b (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=HEAD, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux ) 2024-05-06T21:29:43.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:43 smithi154 ceph-mon[63622]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:29:43.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:43 smithi154 ceph-mon[63622]: osdmap e51: 6 total, 5 up, 6 in 2024-05-06T21:29:43.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:43 smithi154 ceph-mon[63622]: osdmap e52: 6 total, 5 up, 6 in 2024-05-06T21:29:44.112 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:43 smithi032 podman[82660]: 2024-05-06 21:29:43.697248098 +0000 UTC m=+0.018866509 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:29:44.112 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:43 smithi032 podman[82660]: 2024-05-06 21:29:43.844835334 +0000 UTC m=+0.166453771 container create d15335b1332fb2ecf5e2441bfb04b444cefc07b5b9b5c41428f7604816245803 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-06T21:29:44.112 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:44 smithi032 podman[82660]: 2024-05-06 21:29:44.038905278 +0000 UTC m=+0.360523685 container init d15335b1332fb2ecf5e2441bfb04b444cefc07b5b9b5c41428f7604816245803 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:29:44.112 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:44 smithi032 podman[82660]: 2024-05-06 21:29:44.04233163 +0000 UTC m=+0.363950035 container start d15335b1332fb2ecf5e2441bfb04b444cefc07b5b9b5c41428f7604816245803 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-05-06T21:29:44.112 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:44 smithi032 podman[82660]: 2024-05-06 21:29:44.113769334 +0000 UTC m=+0.435387735 container attach d15335b1332fb2ecf5e2441bfb04b444cefc07b5b9b5c41428f7604816245803 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T21:29:44.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:44 smithi032 ceph-mon[76650]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:44.472 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:44 smithi032 podman[82660]: 2024-05-06 21:29:44.354381797 +0000 UTC m=+0.676000186 container died d15335b1332fb2ecf5e2441bfb04b444cefc07b5b9b5c41428f7604816245803 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-06T21:29:44.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:44 smithi154 ceph-mon[63622]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:44.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.702+0000 7f5c20331700 1 -- 172.21.15.32:0/1138874393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18100240 msgr2=0x7f5c18100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:44.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.702+0000 7f5c20331700 1 --2- 172.21.15.32:0/1138874393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18100240 0x7f5c18100650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009910 tx=0x7f5c14009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:44.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.702+0000 7f5c20331700 1 -- 172.21.15.32:0/1138874393 shutdown_connections 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.702+0000 7f5c20331700 1 --2- 172.21.15.32:0/1138874393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18101440 0x7f5c18101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.702+0000 7f5c20331700 1 --2- 172.21.15.32:0/1138874393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18100240 0x7f5c18100650 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.702+0000 7f5c20331700 1 -- 172.21.15.32:0/1138874393 >> 172.21.15.32:0/1138874393 conn(0x7f5c180fb7f0 msgr2=0x7f5c180fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.702+0000 7f5c20331700 1 -- 172.21.15.32:0/1138874393 shutdown_connections 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.702+0000 7f5c20331700 1 -- 172.21.15.32:0/1138874393 wait complete. 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c20331700 1 Processor -- start 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c20331700 1 -- start start 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c20331700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18100240 0x7f5c18195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c20331700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18101440 0x7f5c18196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c20331700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18196630 con 0x7f5c18101440 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c20331700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18196770 con 0x7f5c18100240 2024-05-06T21:29:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c1d8cc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18101440 0x7f5c18196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c1d8cc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18101440 0x7f5c18196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43874/0 (socket says 172.21.15.32:43874) 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c1d8cc700 1 -- 172.21.15.32:0/849591622 learned_addr learned my addr 172.21.15.32:0/849591622 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c1e0cd700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18100240 0x7f5c18195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c1d8cc700 1 -- 172.21.15.32:0/849591622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18100240 msgr2=0x7f5c18195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c1d8cc700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18100240 0x7f5c18195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c1d8cc700 1 -- 172.21.15.32:0/849591622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c140095f0 con 0x7f5c18101440 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.703+0000 7f5c1d8cc700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18101440 0x7f5c18196010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800d900 tx=0x7f5c0800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.704+0000 7f5c0f7fe700 1 -- 172.21.15.32:0/849591622 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c080041f0 con 0x7f5c18101440 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.704+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1819b220 con 0x7f5c18101440 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.704+0000 7f5c0f7fe700 1 -- 172.21.15.32:0/849591622 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c08004ce0 con 0x7f5c18101440 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.704+0000 7f5c0f7fe700 1 -- 172.21.15.32:0/849591622 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c0800b750 con 0x7f5c18101440 2024-05-06T21:29:44.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.704+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1819b770 con 0x7f5c18101440 2024-05-06T21:29:44.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.705+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c18108d90 con 0x7f5c18101440 2024-05-06T21:29:44.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.705+0000 7f5c0f7fe700 1 -- 172.21.15.32:0/849591622 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f5c08004e50 con 0x7f5c18101440 2024-05-06T21:29:44.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.706+0000 7f5c0f7fe700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5c0406e340 0x7f5c040707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:44.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.706+0000 7f5c0f7fe700 1 -- 172.21.15.32:0/849591622 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5c0808e1a0 con 0x7f5c18101440 2024-05-06T21:29:44.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.706+0000 7f5c1e0cd700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5c0406e340 0x7f5c040707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:44.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.706+0000 7f5c1e0cd700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5c0406e340 0x7f5c040707f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5c14006010 tx=0x7f5c1400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:44.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.711+0000 7f5c0f7fe700 1 -- 172.21.15.32:0/849591622 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5c0805ae60 con 0x7f5c18101440 2024-05-06T21:29:44.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.945+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c18105d90 con 0x7f5c0406e340 2024-05-06T21:29:44.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.947+0000 7f5c0f7fe700 1 -- 172.21.15.32:0/849591622 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5c18105d90 con 0x7f5c0406e340 2024-05-06T21:29:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5c0406e340 msgr2=0x7f5c040707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5c0406e340 0x7f5c040707f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5c14006010 tx=0x7f5c1400b540 comp rx=0 tx=0).stop 2024-05-06T21:29:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18101440 msgr2=0x7f5c18196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18101440 0x7f5c18196010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800d900 tx=0x7f5c0800dc10 comp rx=0 tx=0).stop 2024-05-06T21:29:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 shutdown_connections 2024-05-06T21:29:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5c0406e340 0x7f5c040707f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18100240 0x7f5c18195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 --2- 172.21.15.32:0/849591622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c18101440 0x7f5c18196010 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 >> 172.21.15.32:0/849591622 conn(0x7f5c180fb7f0 msgr2=0x7f5c18104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 shutdown_connections 2024-05-06T21:29:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:44.949+0000 7f5c20331700 1 -- 172.21.15.32:0/849591622 wait complete. 2024-05-06T21:29:44.959 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:29:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.060+0000 7fca713c9700 1 -- 172.21.15.32:0/4005619409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c101440 msgr2=0x7fca6c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.060+0000 7fca713c9700 1 --2- 172.21.15.32:0/4005619409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c101440 0x7fca6c101890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca54009910 tx=0x7fca54009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.060+0000 7fca713c9700 1 -- 172.21.15.32:0/4005619409 shutdown_connections 2024-05-06T21:29:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.060+0000 7fca713c9700 1 --2- 172.21.15.32:0/4005619409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c101440 0x7fca6c101890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.060+0000 7fca713c9700 1 --2- 172.21.15.32:0/4005619409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca6c100240 0x7fca6c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.060+0000 7fca713c9700 1 -- 172.21.15.32:0/4005619409 >> 172.21.15.32:0/4005619409 conn(0x7fca6c0fb7f0 msgr2=0x7fca6c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.060+0000 7fca713c9700 1 -- 172.21.15.32:0/4005619409 shutdown_connections 2024-05-06T21:29:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.060+0000 7fca713c9700 1 -- 172.21.15.32:0/4005619409 wait complete. 2024-05-06T21:29:45.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca713c9700 1 Processor -- start 2024-05-06T21:29:45.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca713c9700 1 -- start start 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca713c9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c100240 0x7fca6c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca713c9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca6c101440 0x7fca6c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca713c9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c196610 con 0x7fca6c100240 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca713c9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c196750 con 0x7fca6c101440 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca6affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c100240 0x7fca6c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca6affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c100240 0x7fca6c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43880/0 (socket says 172.21.15.32:43880) 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca6affd700 1 -- 172.21.15.32:0/178844601 learned_addr learned my addr 172.21.15.32:0/178844601 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca63fff700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca6c101440 0x7fca6c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca6affd700 1 -- 172.21.15.32:0/178844601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca6c101440 msgr2=0x7fca6c195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca6affd700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca6c101440 0x7fca6c195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca6affd700 1 -- 172.21.15.32:0/178844601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540095f0 con 0x7fca6c100240 2024-05-06T21:29:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca63fff700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca6c101440 0x7fca6c195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:29:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.061+0000 7fca6affd700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c100240 0x7fca6c195ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00e8f0 tx=0x7fca5c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.062+0000 7fca68ff9700 1 -- 172.21.15.32:0/178844601 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca5c009790 con 0x7fca6c100240 2024-05-06T21:29:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.062+0000 7fca68ff9700 1 -- 172.21.15.32:0/178844601 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca5c0044d0 con 0x7fca6c100240 2024-05-06T21:29:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.062+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c19b200 con 0x7fca6c100240 2024-05-06T21:29:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.062+0000 7fca68ff9700 1 -- 172.21.15.32:0/178844601 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca5c003da0 con 0x7fca6c100240 2024-05-06T21:29:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.062+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c19b750 con 0x7fca6c100240 2024-05-06T21:29:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.063+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c108d90 con 0x7fca6c100240 2024-05-06T21:29:45.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.063+0000 7fca68ff9700 1 -- 172.21.15.32:0/178844601 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fca5c00cba0 con 0x7fca6c100240 2024-05-06T21:29:45.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.064+0000 7fca68ff9700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fca5806e330 0x7fca580707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:45.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.064+0000 7fca68ff9700 1 -- 172.21.15.32:0/178844601 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fca5c014070 con 0x7fca6c100240 2024-05-06T21:29:45.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.064+0000 7fca63fff700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fca5806e330 0x7fca580707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:45.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.065+0000 7fca63fff700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fca5806e330 0x7fca580707e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fca54000c00 tx=0x7fca54009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:45.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.070+0000 7fca68ff9700 1 -- 172.21.15.32:0/178844601 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fca5c05b420 con 0x7fca6c100240 2024-05-06T21:29:45.222 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:45 smithi032 podman[82686]: 2024-05-06 21:29:45.065089782 +0000 UTC m=+0.703175680 container remove d15335b1332fb2ecf5e2441bfb04b444cefc07b5b9b5c41428f7604816245803 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-06T21:29:45.222 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:45 smithi032 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.0.service: Deactivated successfully. 2024-05-06T21:29:45.222 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:45 smithi032 systemd[1]: Stopped Ceph osd.0 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:29:45.222 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:45 smithi032 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.0.service: Consumed 57.292s CPU time. 2024-05-06T21:29:45.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.317+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca6c19b3c0 con 0x7fca5806e330 2024-05-06T21:29:45.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.318+0000 7fca68ff9700 1 -- 172.21.15.32:0/178844601 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fca6c19b3c0 con 0x7fca5806e330 2024-05-06T21:29:45.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.320+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fca5806e330 msgr2=0x7fca580707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.320+0000 7fca713c9700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fca5806e330 0x7fca580707e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fca54000c00 tx=0x7fca54009f70 comp rx=0 tx=0).stop 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.320+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c100240 msgr2=0x7fca6c195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.320+0000 7fca713c9700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c100240 0x7fca6c195ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00e8f0 tx=0x7fca5c00ecb0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.320+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 shutdown_connections 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.320+0000 7fca713c9700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fca5806e330 0x7fca580707e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.320+0000 7fca713c9700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca6c100240 0x7fca6c195ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.320+0000 7fca713c9700 1 --2- 172.21.15.32:0/178844601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca6c101440 0x7fca6c195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.320+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 >> 172.21.15.32:0/178844601 conn(0x7fca6c0fb7f0 msgr2=0x7fca6c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.321+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 shutdown_connections 2024-05-06T21:29:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.321+0000 7fca713c9700 1 -- 172.21.15.32:0/178844601 wait complete. 2024-05-06T21:29:45.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.445+0000 7fe26a9f3700 1 -- 172.21.15.32:0/1280698087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 msgr2=0x7fe264105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.445+0000 7fe26a9f3700 1 --2- 172.21.15.32:0/1280698087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 0x7fe264105a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009910 tx=0x7fe24c009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:45.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.445+0000 7fe26a9f3700 1 -- 172.21.15.32:0/1280698087 shutdown_connections 2024-05-06T21:29:45.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.445+0000 7fe26a9f3700 1 --2- 172.21.15.32:0/1280698087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 0x7fe264105a60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.445+0000 7fe26a9f3700 1 --2- 172.21.15.32:0/1280698087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264100d60 0x7fe264103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.445+0000 7fe26a9f3700 1 -- 172.21.15.32:0/1280698087 >> 172.21.15.32:0/1280698087 conn(0x7fe2640fa780 msgr2=0x7fe2640fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:45.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.445+0000 7fe26a9f3700 1 -- 172.21.15.32:0/1280698087 shutdown_connections 2024-05-06T21:29:45.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.445+0000 7fe26a9f3700 1 -- 172.21.15.32:0/1280698087 wait complete. 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.446+0000 7fe26a9f3700 1 Processor -- start 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.446+0000 7fe26a9f3700 1 -- start start 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe26a9f3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264100d60 0x7fe264195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe26a9f3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 0x7fe264196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe26a9f3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264196640 con 0x7fe264103680 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe26a9f3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264196780 con 0x7fe264100d60 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 0x7fe264196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 0x7fe264196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43898/0 (socket says 172.21.15.32:43898) 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe25bfff700 1 -- 172.21.15.32:0/704627749 learned_addr learned my addr 172.21.15.32:0/704627749 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe263fff700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264100d60 0x7fe264195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe25bfff700 1 -- 172.21.15.32:0/704627749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264100d60 msgr2=0x7fe264195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe25bfff700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264100d60 0x7fe264195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe25bfff700 1 -- 172.21.15.32:0/704627749 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c0095f0 con 0x7fe264103680 2024-05-06T21:29:45.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.447+0000 7fe25bfff700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 0x7fe264196020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe24c006010 tx=0x7fe24c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:45.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.448+0000 7fe261ffb700 1 -- 172.21.15.32:0/704627749 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe24c01d070 con 0x7fe264103680 2024-05-06T21:29:45.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.448+0000 7fe261ffb700 1 -- 172.21.15.32:0/704627749 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe24c00f460 con 0x7fe264103680 2024-05-06T21:29:45.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.448+0000 7fe261ffb700 1 -- 172.21.15.32:0/704627749 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe24c021640 con 0x7fe264103680 2024-05-06T21:29:45.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.448+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26419b1d0 con 0x7fe264103680 2024-05-06T21:29:45.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.448+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26419b6c0 con 0x7fe264103680 2024-05-06T21:29:45.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.449+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26418fbe0 con 0x7fe264103680 2024-05-06T21:29:45.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.450+0000 7fe261ffb700 1 -- 172.21.15.32:0/704627749 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fe24c00fab0 con 0x7fe264103680 2024-05-06T21:29:45.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.450+0000 7fe261ffb700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe25006e340 0x7fe2500707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:45.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.450+0000 7fe261ffb700 1 -- 172.21.15.32:0/704627749 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe24c08f5c0 con 0x7fe264103680 2024-05-06T21:29:45.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.450+0000 7fe263fff700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe25006e340 0x7fe2500707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:45.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.451+0000 7fe263fff700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe25006e340 0x7fe2500707f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe264069000 tx=0x7fe2540073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:45.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.456+0000 7fe261ffb700 1 -- 172.21.15.32:0/704627749 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe24c05c280 con 0x7fe264103680 2024-05-06T21:29:45.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.677+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe264061190 con 0x7fe25006e340 2024-05-06T21:29:45.676 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:45 smithi032 systemd[1]: Starting Ceph osd.0 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:29:45.676 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:45 smithi032 podman[82837]: 2024-05-06 21:29:45.446069756 +0000 UTC m=+0.019691436 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:29:45.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.688+0000 7fe261ffb700 1 -- 172.21.15.32:0/704627749 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fe264061190 con 0x7fe25006e340 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (9m) 14s ago 11m 24.6M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (11m) 14s ago 11m 7889k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (10m) 16s ago 10m 7772k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (25s) 14s ago 11m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (20s) 16s ago 10m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (9m) 14s ago 11m 86.5M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (5m) 14s ago 5m 14.9M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (5m) 14s ago 5m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (5m) 16s ago 5m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (5m) 16s ago 5m 16.7M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:29:45.687 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (2m) 14s ago 12m 496M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (117s) 16s ago 10m 449M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (94s) 14s ago 13m 41.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (71s) 16s ago 10m 35.3M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (11m) 14s ago 11m 15.4M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (10m) 16s ago 10m 17.1M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (9m) 14s ago 9m 217M 1217M 18.2.0 dc2bc1663786 258e137f3456 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (9m) 14s ago 9m 242M 1217M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (8m) 14s ago 8m 196M 1217M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (8m) 16s ago 8m 277M 2240M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (7m) 16s ago 7m 248M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (7m) 16s ago 7m 236M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:29:45.688 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (2m) 14s ago 10m 62.5M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:29:45.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe25006e340 msgr2=0x7fe2500707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe25006e340 0x7fe2500707f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe264069000 tx=0x7fe2540073d0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 msgr2=0x7fe264196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 0x7fe264196020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe24c006010 tx=0x7fe24c00bd70 comp rx=0 tx=0).stop 2024-05-06T21:29:45.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 shutdown_connections 2024-05-06T21:29:45.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe25006e340 0x7fe2500707f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264100d60 0x7fe264195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 --2- 172.21.15.32:0/704627749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe264103680 0x7fe264196020 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 >> 172.21.15.32:0/704627749 conn(0x7fe2640fa780 msgr2=0x7fe2640fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:45.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 shutdown_connections 2024-05-06T21:29:45.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.690+0000 7fe26a9f3700 1 -- 172.21.15.32:0/704627749 wait complete. 2024-05-06T21:29:45.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.800+0000 7fad9d6e7700 1 -- 172.21.15.32:0/1848797377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 msgr2=0x7fad980ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.800+0000 7fad9d6e7700 1 --2- 172.21.15.32:0/1848797377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 0x7fad980ff580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad88009910 tx=0x7fad88009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:45.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.800+0000 7fad9d6e7700 1 -- 172.21.15.32:0/1848797377 shutdown_connections 2024-05-06T21:29:45.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.800+0000 7fad9d6e7700 1 --2- 172.21.15.32:0/1848797377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad98100370 0x7fad981007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.800+0000 7fad9d6e7700 1 --2- 172.21.15.32:0/1848797377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 0x7fad980ff580 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.800+0000 7fad9d6e7700 1 -- 172.21.15.32:0/1848797377 >> 172.21.15.32:0/1848797377 conn(0x7fad980fa700 msgr2=0x7fad980fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:45.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.800+0000 7fad9d6e7700 1 -- 172.21.15.32:0/1848797377 shutdown_connections 2024-05-06T21:29:45.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.800+0000 7fad9d6e7700 1 -- 172.21.15.32:0/1848797377 wait complete. 2024-05-06T21:29:45.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.801+0000 7fad9d6e7700 1 Processor -- start 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.801+0000 7fad9d6e7700 1 -- start start 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.801+0000 7fad9d6e7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 0x7fad98103100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.801+0000 7fad9d6e7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad98100370 0x7fad98101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.801+0000 7fad9d6e7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad98101c90 con 0x7fad980ff170 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.801+0000 7fad9d6e7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad98101dd0 con 0x7fad98100370 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad96ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 0x7fad98103100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad96ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 0x7fad98103100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43922/0 (socket says 172.21.15.32:43922) 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad96ffd700 1 -- 172.21.15.32:0/976248971 learned_addr learned my addr 172.21.15.32:0/976248971 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad967fc700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad98100370 0x7fad98101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad96ffd700 1 -- 172.21.15.32:0/976248971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad98100370 msgr2=0x7fad98101750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:45.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad96ffd700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad98100370 0x7fad98101750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:45.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad96ffd700 1 -- 172.21.15.32:0/976248971 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad880095f0 con 0x7fad980ff170 2024-05-06T21:29:45.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad96ffd700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 0x7fad98103100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad880092e0 tx=0x7fad8800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:45.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad7ffff700 1 -- 172.21.15.32:0/976248971 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad8801d070 con 0x7fad980ff170 2024-05-06T21:29:45.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad7ffff700 1 -- 172.21.15.32:0/976248971 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fad8800f460 con 0x7fad980ff170 2024-05-06T21:29:45.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad98102050 con 0x7fad980ff170 2024-05-06T21:29:45.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad7ffff700 1 -- 172.21.15.32:0/976248971 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad88017630 con 0x7fad980ff170 2024-05-06T21:29:45.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.802+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad98102540 con 0x7fad980ff170 2024-05-06T21:29:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.803+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad98107cc0 con 0x7fad980ff170 2024-05-06T21:29:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.804+0000 7fad7ffff700 1 -- 172.21.15.32:0/976248971 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fad8800f5d0 con 0x7fad980ff170 2024-05-06T21:29:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.805+0000 7fad7ffff700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad8006e340 0x7fad800707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.805+0000 7fad967fc700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad8006e340 0x7fad800707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.805+0000 7fad7ffff700 1 -- 172.21.15.32:0/976248971 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fad8808f7c0 con 0x7fad980ff170 2024-05-06T21:29:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.805+0000 7fad967fc700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad8006e340 0x7fad800707f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad8c005950 tx=0x7fad8c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:45.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:45.810+0000 7fad7ffff700 1 -- 172.21.15.32:0/976248971 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fad8805c3e0 con 0x7fad980ff170 2024-05-06T21:29:45.930 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:45 smithi032 podman[82837]: 2024-05-06 21:29:45.786353511 +0000 UTC m=+0.359975155 container create dfdbe953a692614eea5c0ca744f50a46291490bdcb80a7880e318f80ec32d5f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.license=GPLv2) 2024-05-06T21:29:46.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.135+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fad9819dfc0 con 0x7fad980ff170 2024-05-06T21:29:46.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.135+0000 7fad7ffff700 1 -- 172.21.15.32:0/976248971 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+687 (secure 0 0 0) 0x7fad8800f880 con 0x7fad980ff170 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:29:46.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:29:46.136 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:29:46.136 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-05-06T21:29:46.136 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 4 2024-05-06T21:29:46.136 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:29:46.136 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.137+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad8006e340 msgr2=0x7fad800707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.137+0000 7fad9d6e7700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad8006e340 0x7fad800707f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad8c005950 tx=0x7fad8c00b410 comp rx=0 tx=0).stop 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.137+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 msgr2=0x7fad98103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.137+0000 7fad9d6e7700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 0x7fad98103100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad880092e0 tx=0x7fad8800bd70 comp rx=0 tx=0).stop 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.137+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 shutdown_connections 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.138+0000 7fad9d6e7700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad8006e340 0x7fad800707f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.138+0000 7fad9d6e7700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad980ff170 0x7fad98103100 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.138+0000 7fad9d6e7700 1 --2- 172.21.15.32:0/976248971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad98100370 0x7fad98101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.138+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 >> 172.21.15.32:0/976248971 conn(0x7fad980fa700 msgr2=0x7fad98068e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.138+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 shutdown_connections 2024-05-06T21:29:46.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.138+0000 7fad9d6e7700 1 -- 172.21.15.32:0/976248971 wait complete. 2024-05-06T21:29:46.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:46 smithi032 ceph-mon[76650]: pgmap v47: 65 pgs: 9 stale+active+clean, 56 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:46.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:46 smithi032 ceph-mon[76650]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:46.222 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 podman[82837]: 2024-05-06 21:29:46.056296091 +0000 UTC m=+0.629917736 container init dfdbe953a692614eea5c0ca744f50a46291490bdcb80a7880e318f80ec32d5f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:29:46.222 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 podman[82837]: 2024-05-06 21:29:46.061141001 +0000 UTC m=+0.634762652 container start dfdbe953a692614eea5c0ca744f50a46291490bdcb80a7880e318f80ec32d5f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-06T21:29:46.222 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 podman[82837]: 2024-05-06 21:29:46.13962254 +0000 UTC m=+0.713244198 container attach dfdbe953a692614eea5c0ca744f50a46291490bdcb80a7880e318f80ec32d5f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-06T21:29:46.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.249+0000 7f7096c66700 1 -- 172.21.15.32:0/1386679312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 msgr2=0x7f7090103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.249+0000 7f7096c66700 1 --2- 172.21.15.32:0/1386679312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 0x7f7090103140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7084009910 tx=0x7f7084009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:46.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.249+0000 7f7096c66700 1 -- 172.21.15.32:0/1386679312 shutdown_connections 2024-05-06T21:29:46.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.249+0000 7f7096c66700 1 --2- 172.21.15.32:0/1386679312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7090103680 0x7f7090105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.249+0000 7f7096c66700 1 --2- 172.21.15.32:0/1386679312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 0x7f7090103140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.249+0000 7f7096c66700 1 -- 172.21.15.32:0/1386679312 >> 172.21.15.32:0/1386679312 conn(0x7f70900fa780 msgr2=0x7f70900fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:46.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.249+0000 7f7096c66700 1 -- 172.21.15.32:0/1386679312 shutdown_connections 2024-05-06T21:29:46.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.249+0000 7f7096c66700 1 -- 172.21.15.32:0/1386679312 wait complete. 2024-05-06T21:29:46.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.250+0000 7f7096c66700 1 Processor -- start 2024-05-06T21:29:46.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.250+0000 7f7096c66700 1 -- start start 2024-05-06T21:29:46.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.250+0000 7f7096c66700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 0x7f7090195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:46.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7096c66700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7090103680 0x7f7090195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:46.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7096c66700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090196610 con 0x7f7090100d60 2024-05-06T21:29:46.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7096c66700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090196750 con 0x7f7090103680 2024-05-06T21:29:46.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7094a02700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 0x7f7090195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7094a02700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 0x7f7090195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43950/0 (socket says 172.21.15.32:43950) 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7094a02700 1 -- 172.21.15.32:0/1076913258 learned_addr learned my addr 172.21.15.32:0/1076913258 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f708ffff700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7090103680 0x7f7090195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7094a02700 1 -- 172.21.15.32:0/1076913258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7090103680 msgr2=0x7f7090195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7094a02700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7090103680 0x7f7090195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7094a02700 1 -- 172.21.15.32:0/1076913258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840095f0 con 0x7f7090100d60 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f708ffff700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7090103680 0x7f7090195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f7094a02700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 0x7f7090195ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f708400bda0 tx=0x7f708400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.251+0000 7f708dffb700 1 -- 172.21.15.32:0/1076913258 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f708401d070 con 0x7f7090100d60 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.252+0000 7f708dffb700 1 -- 172.21.15.32:0/1076913258 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f708400f460 con 0x7f7090100d60 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.252+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709019b1a0 con 0x7f7090100d60 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.252+0000 7f708dffb700 1 -- 172.21.15.32:0/1076913258 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7084021640 con 0x7f7090100d60 2024-05-06T21:29:46.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.252+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709019b690 con 0x7f7090100d60 2024-05-06T21:29:46.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.253+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709018fbc0 con 0x7f7090100d60 2024-05-06T21:29:46.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.253+0000 7f708dffb700 1 -- 172.21.15.32:0/1076913258 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f708400fa00 con 0x7f7090100d60 2024-05-06T21:29:46.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.254+0000 7f708dffb700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f708006e340 0x7f70800707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:46.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.254+0000 7f708dffb700 1 -- 172.21.15.32:0/1076913258 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f708408f630 con 0x7f7090100d60 2024-05-06T21:29:46.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.254+0000 7f708ffff700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f708006e340 0x7f70800707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:46.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.254+0000 7f708ffff700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f708006e340 0x7f70800707f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f707c005950 tx=0x7f707c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:46.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.258+0000 7f708dffb700 1 -- 172.21.15.32:0/1076913258 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f708405c270 con 0x7f7090100d60 2024-05-06T21:29:46.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.527+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f709002cc30 con 0x7f7090100d60 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.528+0000 7f708dffb700 1 -- 172.21.15.32:0/1076913258 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f708405be00 con 0x7f7090100d60 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stdout:e20 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 20 2024-05-06T21:29:46.527 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:27:07.836937+0000 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:29:46.528 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 0 members: 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:29:46.530 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:29:46.530 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:29:46.530 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:29:46.530 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f708006e340 msgr2=0x7f70800707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f708006e340 0x7f70800707f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f707c005950 tx=0x7f707c0058e0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 msgr2=0x7f7090195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 0x7f7090195ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f708400bda0 tx=0x7f708400be80 comp rx=0 tx=0).stop 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 shutdown_connections 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f708006e340 0x7f70800707f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7090100d60 0x7f7090195ab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 --2- 172.21.15.32:0/1076913258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7090103680 0x7f7090195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 >> 172.21.15.32:0/1076913258 conn(0x7f70900fa780 msgr2=0x7f70900fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 shutdown_connections 2024-05-06T21:29:46.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.531+0000 7f7096c66700 1 -- 172.21.15.32:0/1076913258 wait complete. 2024-05-06T21:29:46.532 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 20 2024-05-06T21:29:46.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:46 smithi154 ceph-mon[63622]: pgmap v47: 65 pgs: 9 stale+active+clean, 56 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:46.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:46 smithi154 ceph-mon[63622]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.649+0000 7fe28b3ee700 1 -- 172.21.15.32:0/977137875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 msgr2=0x7fe2840ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.649+0000 7fe28b3ee700 1 --2- 172.21.15.32:0/977137875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 0x7fe2840ff540 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe280009910 tx=0x7fe280009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.649+0000 7fe28b3ee700 1 -- 172.21.15.32:0/977137875 shutdown_connections 2024-05-06T21:29:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.649+0000 7fe28b3ee700 1 --2- 172.21.15.32:0/977137875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2841003d0 0x7fe284100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.649+0000 7fe28b3ee700 1 --2- 172.21.15.32:0/977137875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 0x7fe2840ff540 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.649+0000 7fe28b3ee700 1 -- 172.21.15.32:0/977137875 >> 172.21.15.32:0/977137875 conn(0x7fe2840fa780 msgr2=0x7fe2840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.649+0000 7fe28b3ee700 1 -- 172.21.15.32:0/977137875 shutdown_connections 2024-05-06T21:29:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.649+0000 7fe28b3ee700 1 -- 172.21.15.32:0/977137875 wait complete. 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28b3ee700 1 Processor -- start 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28b3ee700 1 -- start start 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28b3ee700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 0x7fe2840690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28b3ee700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2841003d0 0x7fe28419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28b3ee700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28419ade0 con 0x7fe2840ff130 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28b3ee700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28419af20 con 0x7fe2841003d0 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28918a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 0x7fe2840690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28918a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 0x7fe2840690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43980/0 (socket says 172.21.15.32:43980) 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28918a700 1 -- 172.21.15.32:0/2224247222 learned_addr learned my addr 172.21.15.32:0/2224247222 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe288989700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2841003d0 0x7fe28419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.650+0000 7fe28918a700 1 -- 172.21.15.32:0/2224247222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2841003d0 msgr2=0x7fe28419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.651+0000 7fe28918a700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2841003d0 0x7fe28419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.651+0000 7fe28918a700 1 -- 172.21.15.32:0/2224247222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800095f0 con 0x7fe2840ff130 2024-05-06T21:29:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.651+0000 7fe28918a700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 0x7fe2840690a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe280006010 tx=0x7fe28000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.651+0000 7fe27a7fc700 1 -- 172.21.15.32:0/2224247222 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe28001d070 con 0x7fe2840ff130 2024-05-06T21:29:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.651+0000 7fe27a7fc700 1 -- 172.21.15.32:0/2224247222 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe28000f460 con 0x7fe2840ff130 2024-05-06T21:29:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.651+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28419b1a0 con 0x7fe2840ff130 2024-05-06T21:29:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.651+0000 7fe27a7fc700 1 -- 172.21.15.32:0/2224247222 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe280017630 con 0x7fe2840ff130 2024-05-06T21:29:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.651+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28419b690 con 0x7fe2840ff130 2024-05-06T21:29:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.652+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe284107c10 con 0x7fe2840ff130 2024-05-06T21:29:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.652+0000 7fe27a7fc700 1 -- 172.21.15.32:0/2224247222 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fe280003a60 con 0x7fe2840ff130 2024-05-06T21:29:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.653+0000 7fe27a7fc700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe27006e340 0x7fe2700707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.653+0000 7fe27a7fc700 1 -- 172.21.15.32:0/2224247222 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe28008f7f0 con 0x7fe2840ff130 2024-05-06T21:29:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.653+0000 7fe288989700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe27006e340 0x7fe2700707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.653+0000 7fe288989700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe27006e340 0x7fe2700707f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe274005950 tx=0x7fe2740058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:46.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.657+0000 7fe27a7fc700 1 -- 172.21.15.32:0/2224247222 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe28005c4b0 con 0x7fe2840ff130 2024-05-06T21:29:46.858 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate[82895]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate[82895]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 bash[82837]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 bash[82837]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 bash[82837]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 bash[82837]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 bash[82837]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 bash[82837]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 bash[82837]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate[82895]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate[82895]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate[82895]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-06T21:29:46.859 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate[82895]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T21:29:46.860 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate[82895]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-06T21:29:46.860 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:46 smithi032 podman[82837]: 2024-05-06 21:29:46.567149189 +0000 UTC m=+1.140770844 container died dfdbe953a692614eea5c0ca744f50a46291490bdcb80a7880e318f80ec32d5f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-06T21:29:46.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.894+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe284104d20 con 0x7fe27006e340 2024-05-06T21:29:46.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.896+0000 7fe27a7fc700 1 -- 172.21.15.32:0/2224247222 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe284104d20 con 0x7fe27006e340 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "6/23 daemons upgraded", 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T21:29:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:29:46.896 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:29:46.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe27006e340 msgr2=0x7fe2700707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe27006e340 0x7fe2700707f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe274005950 tx=0x7fe2740058e0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 msgr2=0x7fe2840690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:46.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 0x7fe2840690a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe280006010 tx=0x7fe28000be20 comp rx=0 tx=0).stop 2024-05-06T21:29:46.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 shutdown_connections 2024-05-06T21:29:46.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe27006e340 0x7fe2700707f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2840ff130 0x7fe2840690a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 --2- 172.21.15.32:0/2224247222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2841003d0 0x7fe28419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:46.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 >> 172.21.15.32:0/2224247222 conn(0x7fe2840fa780 msgr2=0x7fe284103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:46.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 shutdown_connections 2024-05-06T21:29:46.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:46.898+0000 7fe28b3ee700 1 -- 172.21.15.32:0/2224247222 wait complete. 2024-05-06T21:29:47.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.007+0000 7f55d8e18700 1 -- 172.21.15.32:0/2694051106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 msgr2=0x7f55d4100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:47.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.007+0000 7f55d8e18700 1 --2- 172.21.15.32:0/2694051106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 0x7f55d4100860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009910 tx=0x7f55c8009c20 comp rx=0 tx=0).stop 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.007+0000 7f55d8e18700 1 -- 172.21.15.32:0/2694051106 shutdown_connections 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.007+0000 7f55d8e18700 1 --2- 172.21.15.32:0/2694051106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 0x7f55d4100860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.007+0000 7f55d8e18700 1 --2- 172.21.15.32:0/2694051106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55d40ff150 0x7f55d40ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.007+0000 7f55d8e18700 1 -- 172.21.15.32:0/2694051106 >> 172.21.15.32:0/2694051106 conn(0x7f55d40fa7a0 msgr2=0x7f55d40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.008+0000 7f55d8e18700 1 -- 172.21.15.32:0/2694051106 shutdown_connections 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.008+0000 7f55d8e18700 1 -- 172.21.15.32:0/2694051106 wait complete. 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.008+0000 7f55d8e18700 1 Processor -- start 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.008+0000 7f55d8e18700 1 -- start start 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.008+0000 7f55d8e18700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55d40ff150 0x7f55d4195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.008+0000 7f55d8e18700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 0x7f55d41962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d8e18700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4196910 con 0x7f55d41003f0 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d8e18700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4196a50 con 0x7f55d40ff150 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d1d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 0x7f55d41962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d1d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 0x7f55d41962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43990/0 (socket says 172.21.15.32:43990) 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d1d9b700 1 -- 172.21.15.32:0/1438338074 learned_addr learned my addr 172.21.15.32:0/1438338074 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d259c700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55d40ff150 0x7f55d4195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d1d9b700 1 -- 172.21.15.32:0/1438338074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55d40ff150 msgr2=0x7f55d4195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d1d9b700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55d40ff150 0x7f55d4195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d1d9b700 1 -- 172.21.15.32:0/1438338074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c80095f0 con 0x7f55d41003f0 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55d1d9b700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 0x7f55d41962f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f55c8006010 tx=0x7f55c800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55c37fe700 1 -- 172.21.15.32:0/1438338074 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c801d070 con 0x7f55d41003f0 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55c37fe700 1 -- 172.21.15.32:0/1438338074 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f55c800f460 con 0x7f55d41003f0 2024-05-06T21:29:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.009+0000 7f55c37fe700 1 -- 172.21.15.32:0/1438338074 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c8021640 con 0x7f55d41003f0 2024-05-06T21:29:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.010+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d419b4a0 con 0x7f55d41003f0 2024-05-06T21:29:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.010+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d419b990 con 0x7f55d41003f0 2024-05-06T21:29:47.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.011+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d4068ab0 con 0x7f55d41003f0 2024-05-06T21:29:47.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.011+0000 7f55c37fe700 1 -- 172.21.15.32:0/1438338074 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f55c800fab0 con 0x7f55d41003f0 2024-05-06T21:29:47.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.011+0000 7f55c37fe700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f55bc06e340 0x7f55bc0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:29:47.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.012+0000 7f55c37fe700 1 -- 172.21.15.32:0/1438338074 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f55c808f5c0 con 0x7f55d41003f0 2024-05-06T21:29:47.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.012+0000 7f55d259c700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f55bc06e340 0x7f55bc0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:29:47.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.012+0000 7f55d259c700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f55bc06e340 0x7f55bc0707f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55c4005950 tx=0x7f55c400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:29:47.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.016+0000 7f55c37fe700 1 -- 172.21.15.32:0/1438338074 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f55c805c280 con 0x7f55d41003f0 2024-05-06T21:29:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.331+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f55d419bc00 con 0x7f55d41003f0 2024-05-06T21:29:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.332+0000 7f55c37fe700 1 -- 172.21.15.32:0/1438338074 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f55c805be10 con 0x7f55d41003f0 2024-05-06T21:29:47.331 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_WARN 1 osds down 2024-05-06T21:29:47.331 INFO:teuthology.orchestra.run.smithi032.stdout:[WRN] OSD_DOWN: 1 osds down 2024-05-06T21:29:47.331 INFO:teuthology.orchestra.run.smithi032.stdout: osd.0 (root=default,host=smithi032) is down 2024-05-06T21:29:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f55bc06e340 msgr2=0x7f55bc0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f55bc06e340 0x7f55bc0707f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55c4005950 tx=0x7f55c400b410 comp rx=0 tx=0).stop 2024-05-06T21:29:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 msgr2=0x7f55d41962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:29:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 0x7f55d41962f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f55c8006010 tx=0x7f55c800bd70 comp rx=0 tx=0).stop 2024-05-06T21:29:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 shutdown_connections 2024-05-06T21:29:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f55bc06e340 0x7f55bc0707f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55d40ff150 0x7f55d4195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 --2- 172.21.15.32:0/1438338074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d41003f0 0x7f55d41962f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:29:47.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 >> 172.21.15.32:0/1438338074 conn(0x7f55d40fa7a0 msgr2=0x7f55d4103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:29:47.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 shutdown_connections 2024-05-06T21:29:47.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:29:47.335+0000 7f55d8e18700 1 -- 172.21.15.32:0/1438338074 wait complete. 2024-05-06T21:29:47.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:47 smithi032 ceph-mon[76650]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:47.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:47 smithi032 ceph-mon[76650]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:47.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:47 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/976248971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:47.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:47 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1076913258' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:29:47.472 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:47 smithi032 podman[83054]: 2024-05-06 21:29:47.312006619 +0000 UTC m=+0.739004206 container remove dfdbe953a692614eea5c0ca744f50a46291490bdcb80a7880e318f80ec32d5f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-activate, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430) 2024-05-06T21:29:47.563 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:47 smithi154 ceph-mon[63622]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:47.563 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:47 smithi154 ceph-mon[63622]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:47.563 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:47 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/976248971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:47.563 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:47 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1076913258' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:29:47.796 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:47 smithi032 podman[83164]: 2024-05-06 21:29:47.432716102 +0000 UTC m=+0.018729094 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:29:47.796 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:47 smithi032 podman[83164]: 2024-05-06 21:29:47.554809583 +0000 UTC m=+0.140822559 container create d318ebed8be1d4592248135c049ff54e3062e20932aa67d8c210c8567c9aa78f (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T21:29:47.796 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:47 smithi032 podman[83164]: 2024-05-06 21:29:47.773857816 +0000 UTC m=+0.359870797 container init d318ebed8be1d4592248135c049ff54e3062e20932aa67d8c210c8567c9aa78f (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-05-06T21:29:47.796 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:47 smithi032 podman[83164]: 2024-05-06 21:29:47.777233864 +0000 UTC m=+0.363246845 container start d318ebed8be1d4592248135c049ff54e3062e20932aa67d8c210c8567c9aa78f (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T21:29:47.796 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:47 smithi032 ceph-osd[83183]: -- 172.21.15.32:0/1943527374 <== mon.0 v2:172.21.15.32:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56399b59b680 con 0x56399b565000 2024-05-06T21:29:48.136 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:47 smithi032 bash[83164]: d318ebed8be1d4592248135c049ff54e3062e20932aa67d8c210c8567c9aa78f 2024-05-06T21:29:48.136 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:47 smithi032 systemd[1]: Started Ceph osd.0 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:29:48.471 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:48 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[83179]: 2024-05-06T21:29:48.314+0000 7fcec18ad7c0 -1 Falling back to public interface 2024-05-06T21:29:48.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:48 smithi032 ceph-mon[76650]: pgmap v48: 65 pgs: 9 stale+active+clean, 56 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:48.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:48 smithi032 ceph-mon[76650]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:48.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:48 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1438338074' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:29:48.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:48.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:48.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:48 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:48.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:48 smithi154 ceph-mon[63622]: pgmap v48: 65 pgs: 9 stale+active+clean, 56 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:29:48.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:48 smithi154 ceph-mon[63622]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:29:48.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:48 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1438338074' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:29:48.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:48.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:48.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:48 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:49.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:49 smithi032 ceph-mon[76650]: Health check failed: Degraded data redundancy: 71/366 objects degraded (19.399%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T21:29:49.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:49 smithi154 ceph-mon[63622]: Health check failed: Degraded data redundancy: 71/366 objects degraded (19.399%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T21:29:50.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:50 smithi032 ceph-mon[76650]: pgmap v49: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2024-05-06T21:29:50.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:50 smithi154 ceph-mon[63622]: pgmap v49: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2024-05-06T21:29:51.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:51 smithi032 ceph-mon[76650]: pgmap v50: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2024-05-06T21:29:51.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:51.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:29:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:51 smithi154 ceph-mon[63622]: pgmap v50: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2024-05-06T21:29:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:52.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:29:52.471 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:52 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[83179]: 2024-05-06T21:29:52.275+0000 7fcec18ad7c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-05-06T21:29:53.221 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:52 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[83179]: 2024-05-06T21:29:52.750+0000 7fcec18ad7c0 -1 osd.0 50 log_to_monitors true 2024-05-06T21:29:53.972 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:29:53 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[83179]: 2024-05-06T21:29:53.712+0000 7fceb2d04700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:29:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:53 smithi032 ceph-mon[76650]: pgmap v51: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 614 B/s wr, 0 op/s; 71/366 objects degraded (19.399%) 2024-05-06T21:29:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:53 smithi032 ceph-mon[76650]: mgrmap e38: smithi032.ecoohh(active, since 92s), standbys: smithi154.kilvol 2024-05-06T21:29:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:53 smithi032 ceph-mon[76650]: from='osd.0 [v2:172.21.15.32:6802/2472907178,v1:172.21.15.32:6803/2472907178]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T21:29:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:53 smithi154 ceph-mon[63622]: pgmap v51: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 614 B/s wr, 0 op/s; 71/366 objects degraded (19.399%) 2024-05-06T21:29:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:53 smithi154 ceph-mon[63622]: mgrmap e38: smithi032.ecoohh(active, since 92s), standbys: smithi154.kilvol 2024-05-06T21:29:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:53 smithi154 ceph-mon[63622]: from='osd.0 [v2:172.21.15.32:6802/2472907178,v1:172.21.15.32:6803/2472907178]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T21:29:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:54.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:54 smithi032 ceph-mon[76650]: from='osd.0 [v2:172.21.15.32:6802/2472907178,v1:172.21.15.32:6803/2472907178]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T21:29:54.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:54 smithi032 ceph-mon[76650]: osdmap e53: 6 total, 5 up, 6 in 2024-05-06T21:29:54.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:54 smithi032 ceph-mon[76650]: from='osd.0 [v2:172.21.15.32:6802/2472907178,v1:172.21.15.32:6803/2472907178]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:29:54.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:54.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:55.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:54 smithi154 ceph-mon[63622]: from='osd.0 [v2:172.21.15.32:6802/2472907178,v1:172.21.15.32:6803/2472907178]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T21:29:55.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:54 smithi154 ceph-mon[63622]: osdmap e53: 6 total, 5 up, 6 in 2024-05-06T21:29:55.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:54 smithi154 ceph-mon[63622]: from='osd.0 [v2:172.21.15.32:6802/2472907178,v1:172.21.15.32:6803/2472907178]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:29:55.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:55.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:55.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:55 smithi032 ceph-mon[76650]: pgmap v53: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 614 B/s wr, 0 op/s; 71/366 objects degraded (19.399%) 2024-05-06T21:29:55.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:55 smithi032 ceph-mon[76650]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:29:55.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:55 smithi032 ceph-mon[76650]: osd.0 [v2:172.21.15.32:6802/2472907178,v1:172.21.15.32:6803/2472907178] boot 2024-05-06T21:29:55.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:55 smithi032 ceph-mon[76650]: osdmap e54: 6 total, 6 up, 6 in 2024-05-06T21:29:55.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:29:56.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:55 smithi154 ceph-mon[63622]: pgmap v53: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 614 B/s wr, 0 op/s; 71/366 objects degraded (19.399%) 2024-05-06T21:29:56.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:55 smithi154 ceph-mon[63622]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:29:56.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:55 smithi154 ceph-mon[63622]: osd.0 [v2:172.21.15.32:6802/2472907178,v1:172.21.15.32:6803/2472907178] boot 2024-05-06T21:29:56.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:55 smithi154 ceph-mon[63622]: osdmap e54: 6 total, 6 up, 6 in 2024-05-06T21:29:56.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T21:29:56.941 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:56 smithi032 ceph-mon[76650]: osdmap e55: 6 total, 6 up, 6 in 2024-05-06T21:29:57.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:56 smithi154 ceph-mon[63622]: osdmap e55: 6 total, 6 up, 6 in 2024-05-06T21:29:57.964 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:57 smithi032 ceph-mon[76650]: pgmap v56: 65 pgs: 15 active+undersized+degraded, 13 active+undersized, 37 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s; 55/366 objects degraded (15.027%); 46 B/s, 0 objects/s recovering 2024-05-06T21:29:57.964 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:57 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 55/366 objects degraded (15.027%), 15 pgs degraded (PG_DEGRADED) 2024-05-06T21:29:58.018 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:57 smithi154 ceph-mon[63622]: pgmap v56: 65 pgs: 15 active+undersized+degraded, 13 active+undersized, 37 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s; 55/366 objects degraded (15.027%); 46 B/s, 0 objects/s recovering 2024-05-06T21:29:58.018 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:57 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 55/366 objects degraded (15.027%), 15 pgs degraded (PG_DEGRADED) 2024-05-06T21:29:59.307 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T21:29:59.308 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:29:59 smithi154 ceph-mon[63622]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-05-06T21:29:59.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:59.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:59.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:29:59.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:29:59.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:29:59.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:29:59.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:59.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:59.341 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:29:59.342 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T21:29:59.342 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T21:29:59.342 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:29:59 smithi032 ceph-mon[76650]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-05-06T21:30:00.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:00 smithi154 ceph-mon[63622]: pgmap v57: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 13/366 objects degraded (3.552%); 46 B/s, 0 objects/s recovering 2024-05-06T21:30:00.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:00 smithi154 ceph-mon[63622]: Health detail: HEALTH_WARN Degraded data redundancy: 13/366 objects degraded (3.552%), 3 pgs degraded 2024-05-06T21:30:00.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:00 smithi154 ceph-mon[63622]: [WRN] PG_DEGRADED: Degraded data redundancy: 13/366 objects degraded (3.552%), 3 pgs degraded 2024-05-06T21:30:00.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:00 smithi154 ceph-mon[63622]: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-05-06T21:30:00.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:00 smithi154 ceph-mon[63622]: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-05-06T21:30:00.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:00 smithi154 ceph-mon[63622]: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-05-06T21:30:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:00 smithi032 ceph-mon[76650]: pgmap v57: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 13/366 objects degraded (3.552%); 46 B/s, 0 objects/s recovering 2024-05-06T21:30:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:00 smithi032 ceph-mon[76650]: Health detail: HEALTH_WARN Degraded data redundancy: 13/366 objects degraded (3.552%), 3 pgs degraded 2024-05-06T21:30:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:00 smithi032 ceph-mon[76650]: [WRN] PG_DEGRADED: Degraded data redundancy: 13/366 objects degraded (3.552%), 3 pgs degraded 2024-05-06T21:30:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:00 smithi032 ceph-mon[76650]: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-05-06T21:30:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:00 smithi032 ceph-mon[76650]: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-05-06T21:30:00.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:00 smithi032 ceph-mon[76650]: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-05-06T21:30:01.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:01 smithi154 ceph-mon[63622]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/366 objects degraded (3.552%), 3 pgs degraded) 2024-05-06T21:30:01.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:01 smithi154 ceph-mon[63622]: Cluster is now healthy 2024-05-06T21:30:01.409 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:01 smithi032 ceph-mon[76650]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/366 objects degraded (3.552%), 3 pgs degraded) 2024-05-06T21:30:01.409 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:01 smithi032 ceph-mon[76650]: Cluster is now healthy 2024-05-06T21:30:02.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:02 smithi154 ceph-mon[63622]: pgmap v58: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 81 B/s, 0 objects/s recovering 2024-05-06T21:30:02.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:02 smithi032 ceph-mon[76650]: pgmap v58: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 81 B/s, 0 objects/s recovering 2024-05-06T21:30:04.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:04 smithi154 ceph-mon[63622]: pgmap v59: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 70 B/s, 0 objects/s recovering 2024-05-06T21:30:04.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:04 smithi032 ceph-mon[76650]: pgmap v59: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 70 B/s, 0 objects/s recovering 2024-05-06T21:30:06.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:06 smithi032 ceph-mon[76650]: pgmap v60: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 56 B/s, 0 objects/s recovering 2024-05-06T21:30:06.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:06.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:30:06.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:06.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:06 smithi154 ceph-mon[63622]: pgmap v60: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 56 B/s, 0 objects/s recovering 2024-05-06T21:30:06.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:06.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:30:06.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:08.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:08 smithi154 ceph-mon[63622]: pgmap v61: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51 B/s, 0 objects/s recovering 2024-05-06T21:30:08.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:08 smithi032 ceph-mon[76650]: pgmap v61: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51 B/s, 0 objects/s recovering 2024-05-06T21:30:10.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:10 smithi154 ceph-mon[63622]: pgmap v62: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2024-05-06T21:30:10.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:10 smithi032 ceph-mon[76650]: pgmap v62: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2024-05-06T21:30:12.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:12 smithi154 ceph-mon[63622]: pgmap v63: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2024-05-06T21:30:12.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:12 smithi032 ceph-mon[76650]: pgmap v63: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2024-05-06T21:30:14.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:14 smithi154 ceph-mon[63622]: pgmap v64: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:14 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T21:30:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:14 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T21:30:14.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:14 smithi154 ceph-mon[63622]: Upgrade: osd.1 is safe to restart 2024-05-06T21:30:14.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:14 smithi032 ceph-mon[76650]: pgmap v64: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:14.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:14 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T21:30:14.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:14 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T21:30:14.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:14 smithi032 ceph-mon[76650]: Upgrade: osd.1 is safe to restart 2024-05-06T21:30:16.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:15 smithi032 ceph-mon[76650]: pgmap v65: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:16.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:15 smithi032 ceph-mon[76650]: Upgrade: Updating osd.1 2024-05-06T21:30:16.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:16.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T21:30:16.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:30:16.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:15 smithi032 ceph-mon[76650]: Deploying daemon osd.1 on smithi032 2024-05-06T21:30:16.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:15 smithi154 ceph-mon[63622]: pgmap v65: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:16.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:15 smithi154 ceph-mon[63622]: Upgrade: Updating osd.1 2024-05-06T21:30:16.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:16.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T21:30:16.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:30:16.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:15 smithi154 ceph-mon[63622]: Deploying daemon osd.1 on smithi032 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.449+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3969212210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0781036c0 msgr2=0x7fe078105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.449+0000 7fe07cd3d700 1 --2- 172.21.15.32:0/3969212210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0781036c0 0x7fe078105aa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009910 tx=0x7fe06c009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.449+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3969212210 shutdown_connections 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.449+0000 7fe07cd3d700 1 --2- 172.21.15.32:0/3969212210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0781036c0 0x7fe078105aa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.449+0000 7fe07cd3d700 1 --2- 172.21.15.32:0/3969212210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe078100da0 0x7fe078103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.449+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3969212210 >> 172.21.15.32:0/3969212210 conn(0x7fe0780fa700 msgr2=0x7fe0780fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.449+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3969212210 shutdown_connections 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.449+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3969212210 wait complete. 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.450+0000 7fe07cd3d700 1 Processor -- start 2024-05-06T21:30:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.450+0000 7fe07cd3d700 1 -- start start 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.450+0000 7fe07cd3d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe078100da0 0x7fe078195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.450+0000 7fe07cd3d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0781036c0 0x7fe078196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.450+0000 7fe07cd3d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078196640 con 0x7fe078100da0 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.450+0000 7fe07cd3d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078196780 con 0x7fe0781036c0 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.450+0000 7fe07659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe078100da0 0x7fe078195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.450+0000 7fe07659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe078100da0 0x7fe078195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56072/0 (socket says 172.21.15.32:56072) 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.450+0000 7fe07659c700 1 -- 172.21.15.32:0/3715675037 learned_addr learned my addr 172.21.15.32:0/3715675037 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe075d9b700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0781036c0 0x7fe078196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe07659c700 1 -- 172.21.15.32:0/3715675037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0781036c0 msgr2=0x7fe078196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe07659c700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0781036c0 0x7fe078196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe07659c700 1 -- 172.21.15.32:0/3715675037 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c0095f0 con 0x7fe078100da0 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe07659c700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe078100da0 0x7fe078195ae0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d8d0 tx=0x7fe06800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe0677fe700 1 -- 172.21.15.32:0/3715675037 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0680098a0 con 0x7fe078100da0 2024-05-06T21:30:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe0677fe700 1 -- 172.21.15.32:0/3715675037 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe068010460 con 0x7fe078100da0 2024-05-06T21:30:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07819b230 con 0x7fe078100da0 2024-05-06T21:30:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe0677fe700 1 -- 172.21.15.32:0/3715675037 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06800f5f0 con 0x7fe078100da0 2024-05-06T21:30:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.451+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07819b780 con 0x7fe078100da0 2024-05-06T21:30:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.453+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07818fc70 con 0x7fe078100da0 2024-05-06T21:30:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.453+0000 7fe0677fe700 1 -- 172.21.15.32:0/3715675037 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe068009a00 con 0x7fe078100da0 2024-05-06T21:30:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.453+0000 7fe0677fe700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe06006e200 0x7fe0600706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.453+0000 7fe0677fe700 1 -- 172.21.15.32:0/3715675037 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe06808e000 con 0x7fe078100da0 2024-05-06T21:30:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.454+0000 7fe075d9b700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe06006e200 0x7fe0600706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.454+0000 7fe075d9b700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe06006e200 0x7fe0600706b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe06c006010 tx=0x7fe06c00b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:17.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.458+0000 7fe0677fe700 1 -- 172.21.15.32:0/3715675037 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe06805ae60 con 0x7fe078100da0 2024-05-06T21:30:17.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.699+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe078061190 con 0x7fe06006e200 2024-05-06T21:30:17.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.701+0000 7fe0677fe700 1 -- 172.21.15.32:0/3715675037 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe078061190 con 0x7fe06006e200 2024-05-06T21:30:17.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe06006e200 msgr2=0x7fe0600706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:17.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe06006e200 0x7fe0600706b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe06c006010 tx=0x7fe06c00b560 comp rx=0 tx=0).stop 2024-05-06T21:30:17.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe078100da0 msgr2=0x7fe078195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:17.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe078100da0 0x7fe078195ae0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d8d0 tx=0x7fe06800dbe0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 shutdown_connections 2024-05-06T21:30:17.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe06006e200 0x7fe0600706b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe078100da0 0x7fe078195ae0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 --2- 172.21.15.32:0/3715675037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0781036c0 0x7fe078196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 >> 172.21.15.32:0/3715675037 conn(0x7fe0780fa700 msgr2=0x7fe0780fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:17.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 shutdown_connections 2024-05-06T21:30:17.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.703+0000 7fe07cd3d700 1 -- 172.21.15.32:0/3715675037 wait complete. 2024-05-06T21:30:17.712 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.813+0000 7f3fb0724700 1 -- 172.21.15.32:0/2297363706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa81003d0 msgr2=0x7f3fa8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.813+0000 7f3fb0724700 1 --2- 172.21.15.32:0/2297363706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa81003d0 0x7f3fa8100840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009910 tx=0x7f3fa4009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.813+0000 7f3fb0724700 1 -- 172.21.15.32:0/2297363706 shutdown_connections 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.813+0000 7f3fb0724700 1 --2- 172.21.15.32:0/2297363706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa81003d0 0x7f3fa8100840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.813+0000 7f3fb0724700 1 --2- 172.21.15.32:0/2297363706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa80ff130 0x7f3fa80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.813+0000 7f3fb0724700 1 -- 172.21.15.32:0/2297363706 >> 172.21.15.32:0/2297363706 conn(0x7f3fa80fa780 msgr2=0x7f3fa80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.813+0000 7f3fb0724700 1 -- 172.21.15.32:0/2297363706 shutdown_connections 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.813+0000 7f3fb0724700 1 -- 172.21.15.32:0/2297363706 wait complete. 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fb0724700 1 Processor -- start 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fb0724700 1 -- start start 2024-05-06T21:30:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fb0724700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa80ff130 0x7f3fa8197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fb0724700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa81003d0 0x7f3fa81981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fb0724700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa81987b0 con 0x7f3fa80ff130 2024-05-06T21:30:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fb0724700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa8198920 con 0x7f3fa81003d0 2024-05-06T21:30:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fae4c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa80ff130 0x7f3fa8197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fae4c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa80ff130 0x7f3fa8197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56084/0 (socket says 172.21.15.32:56084) 2024-05-06T21:30:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fae4c0700 1 -- 172.21.15.32:0/3779775127 learned_addr learned my addr 172.21.15.32:0/3779775127 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.814+0000 7f3fadcbf700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa81003d0 0x7f3fa81981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.815+0000 7f3fae4c0700 1 -- 172.21.15.32:0/3779775127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa81003d0 msgr2=0x7f3fa81981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.815+0000 7f3fae4c0700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa81003d0 0x7f3fa81981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.815+0000 7f3fae4c0700 1 -- 172.21.15.32:0/3779775127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40095f0 con 0x7f3fa80ff130 2024-05-06T21:30:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.815+0000 7f3fae4c0700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa80ff130 0x7f3fa8197c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00d8d0 tx=0x7f3f9c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.815+0000 7f3f9b7fe700 1 -- 172.21.15.32:0/3779775127 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f9c0098a0 con 0x7f3fa80ff130 2024-05-06T21:30:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.815+0000 7f3f9b7fe700 1 -- 172.21.15.32:0/3779775127 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f9c010460 con 0x7f3fa80ff130 2024-05-06T21:30:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.815+0000 7f3f9b7fe700 1 -- 172.21.15.32:0/3779775127 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f9c00f5f0 con 0x7f3fa80ff130 2024-05-06T21:30:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.815+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa819d3b0 con 0x7f3fa80ff130 2024-05-06T21:30:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.815+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa819d8d0 con 0x7f3fa80ff130 2024-05-06T21:30:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.816+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa8107c10 con 0x7f3fa80ff130 2024-05-06T21:30:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.817+0000 7f3f9b7fe700 1 -- 172.21.15.32:0/3779775127 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3f9c009a00 con 0x7f3fa80ff130 2024-05-06T21:30:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.817+0000 7f3f9b7fe700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3f9406e200 0x7f3f940706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:17.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.817+0000 7f3f9b7fe700 1 -- 172.21.15.32:0/3779775127 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3f9c08e020 con 0x7f3fa80ff130 2024-05-06T21:30:17.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.817+0000 7f3fadcbf700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3f9406e200 0x7f3f940706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:17.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.818+0000 7f3fadcbf700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3f9406e200 0x7f3f940706b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400b5c0 tx=0x7f3fa4005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:17.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:17.822+0000 7f3f9b7fe700 1 -- 172.21.15.32:0/3779775127 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3f9c057350 con 0x7f3fa80ff130 2024-05-06T21:30:18.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.057+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fa8068c50 con 0x7f3f9406e200 2024-05-06T21:30:18.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.058+0000 7f3f9b7fe700 1 -- 172.21.15.32:0/3779775127 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3fa8068c50 con 0x7f3f9406e200 2024-05-06T21:30:18.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3f9406e200 msgr2=0x7f3f940706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3f9406e200 0x7f3f940706b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400b5c0 tx=0x7f3fa4005ee0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa80ff130 msgr2=0x7f3fa8197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa80ff130 0x7f3fa8197c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00d8d0 tx=0x7f3f9c00dbe0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 shutdown_connections 2024-05-06T21:30:18.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3f9406e200 0x7f3f940706b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa80ff130 0x7f3fa8197c70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 --2- 172.21.15.32:0/3779775127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa81003d0 0x7f3fa81981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 >> 172.21.15.32:0/3779775127 conn(0x7f3fa80fa780 msgr2=0x7f3fa8068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 shutdown_connections 2024-05-06T21:30:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.060+0000 7f3fb0724700 1 -- 172.21.15.32:0/3779775127 wait complete. 2024-05-06T21:30:18.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:17 smithi154 ceph-mon[63622]: pgmap v66: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:18.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.168+0000 7f9032582700 1 -- 172.21.15.32:0/1842517994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0fe8c0 msgr2=0x7f902c0fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.168+0000 7f9032582700 1 --2- 172.21.15.32:0/1842517994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0fe8c0 0x7f902c0fecd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f901c009910 tx=0x7f901c009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:18.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.169+0000 7f9032582700 1 -- 172.21.15.32:0/1842517994 shutdown_connections 2024-05-06T21:30:18.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.169+0000 7f9032582700 1 --2- 172.21.15.32:0/1842517994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0ffb60 0x7f902c0fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.169+0000 7f9032582700 1 --2- 172.21.15.32:0/1842517994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0fe8c0 0x7f902c0fecd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.169+0000 7f9032582700 1 -- 172.21.15.32:0/1842517994 >> 172.21.15.32:0/1842517994 conn(0x7f902c0f9f10 msgr2=0x7f902c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:18.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.169+0000 7f9032582700 1 -- 172.21.15.32:0/1842517994 shutdown_connections 2024-05-06T21:30:18.168 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:17 smithi032 ceph-mon[76650]: pgmap v66: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:18.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.169+0000 7f9032582700 1 -- 172.21.15.32:0/1842517994 wait complete. 2024-05-06T21:30:18.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.169+0000 7f9032582700 1 Processor -- start 2024-05-06T21:30:18.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.169+0000 7f9032582700 1 -- start start 2024-05-06T21:30:18.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f9032582700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0fe8c0 0x7f902c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:18.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f9032582700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ffb60 0x7f902c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:18.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f9032582700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c1965a0 con 0x7f902c0ffb60 2024-05-06T21:30:18.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f9032582700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c1966e0 con 0x7f902c0fe8c0 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f902b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ffb60 0x7f902c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f902b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ffb60 0x7f902c196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56110/0 (socket says 172.21.15.32:56110) 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f902b7fe700 1 -- 172.21.15.32:0/2041103929 learned_addr learned my addr 172.21.15.32:0/2041103929 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f902bfff700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0fe8c0 0x7f902c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f902b7fe700 1 -- 172.21.15.32:0/2041103929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0fe8c0 msgr2=0x7f902c195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f902b7fe700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0fe8c0 0x7f902c195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f902b7fe700 1 -- 172.21.15.32:0/2041103929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c0095f0 con 0x7f902c0ffb60 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f902bfff700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0fe8c0 0x7f902c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.170+0000 7f902b7fe700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ffb60 0x7f902c196010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f902000c930 tx=0x7f902000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.171+0000 7f90297fa700 1 -- 172.21.15.32:0/2041103929 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9020007ad0 con 0x7f902c0ffb60 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.171+0000 7f90297fa700 1 -- 172.21.15.32:0/2041103929 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9020007c30 con 0x7f902c0ffb60 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.171+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c19b1a0 con 0x7f902c0ffb60 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.171+0000 7f90297fa700 1 -- 172.21.15.32:0/2041103929 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9020018630 con 0x7f902c0ffb60 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.171+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c19b6c0 con 0x7f902c0ffb60 2024-05-06T21:30:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.172+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c107c30 con 0x7f902c0ffb60 2024-05-06T21:30:18.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.172+0000 7f90297fa700 1 -- 172.21.15.32:0/2041103929 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f902000f450 con 0x7f902c0ffb60 2024-05-06T21:30:18.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.173+0000 7f90297fa700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:18.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.173+0000 7f90297fa700 1 -- 172.21.15.32:0/2041103929 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f902008e340 con 0x7f902c0ffb60 2024-05-06T21:30:18.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.173+0000 7f902bfff700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:18.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.173+0000 7f902bfff700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f901c00b5c0 tx=0x7f901c005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:18.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.178+0000 7f90297fa700 1 -- 172.21.15.32:0/2041103929 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f902005b1a0 con 0x7f902c0ffb60 2024-05-06T21:30:18.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.398+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f902c1056b0 con 0x7f901406e200 2024-05-06T21:30:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.409+0000 7f90297fa700 1 -- 172.21.15.32:0/2041103929 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f902c1056b0 con 0x7f901406e200 2024-05-06T21:30:18.408 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:30:18.408 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (10m) 24s ago 11m 24.2M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:30:18.408 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (12m) 24s ago 12m 7914k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:30:18.408 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (11m) 48s ago 11m 7772k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:30:18.408 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (58s) 24s ago 12m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:30:18.408 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (52s) 48s ago 11m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:30:18.408 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (10m) 24s ago 11m 86.5M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:30:18.408 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (6m) 24s ago 6m 15.1M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:30:18.408 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (6m) 24s ago 6m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (6m) 48s ago 6m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (6m) 48s ago 6m 16.7M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (3m) 24s ago 13m 498M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (2m) 48s ago 10m 449M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (2m) 24s ago 13m 42.9M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (103s) 48s ago 10m 35.3M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (12m) 24s ago 12m 15.5M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (11m) 48s ago 11m 17.1M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (30s) 24s ago 10m 12.7M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (9m) 24s ago 9m 242M 1217M 18.2.0 dc2bc1663786 a14b367bc170 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (9m) 24s ago 9m 197M 1217M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (8m) 48s ago 8m 277M 2240M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:30:18.409 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (8m) 48s ago 8m 248M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:30:18.410 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (7m) 48s ago 7m 236M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:30:18.410 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (2m) 24s ago 11m 64.7M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:30:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 msgr2=0x7f90140706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f901c00b5c0 tx=0x7f901c005960 comp rx=0 tx=0).stop 2024-05-06T21:30:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ffb60 msgr2=0x7f902c196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ffb60 0x7f902c196010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f902000c930 tx=0x7f902000ccf0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 shutdown_connections 2024-05-06T21:30:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0fe8c0 0x7f902c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 --2- 172.21.15.32:0/2041103929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ffb60 0x7f902c196010 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 >> 172.21.15.32:0/2041103929 conn(0x7f902c0f9f10 msgr2=0x7f902c104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 shutdown_connections 2024-05-06T21:30:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.412+0000 7f9032582700 1 -- 172.21.15.32:0/2041103929 wait complete. 2024-05-06T21:30:18.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.521+0000 7f0335bc1700 1 -- 172.21.15.32:0/3175872462 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 msgr2=0x7f0330101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.521+0000 7f0335bc1700 1 --2- 172.21.15.32:0/3175872462 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 0x7f0330101890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0324009910 tx=0x7f0324009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:18.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.521+0000 7f0335bc1700 1 -- 172.21.15.32:0/3175872462 shutdown_connections 2024-05-06T21:30:18.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.521+0000 7f0335bc1700 1 --2- 172.21.15.32:0/3175872462 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 0x7f0330101890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.521+0000 7f0335bc1700 1 --2- 172.21.15.32:0/3175872462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0330100240 0x7f0330100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.521+0000 7f0335bc1700 1 -- 172.21.15.32:0/3175872462 >> 172.21.15.32:0/3175872462 conn(0x7f03300fb7f0 msgr2=0x7f03300fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:18.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.521+0000 7f0335bc1700 1 -- 172.21.15.32:0/3175872462 shutdown_connections 2024-05-06T21:30:18.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.521+0000 7f0335bc1700 1 -- 172.21.15.32:0/3175872462 wait complete. 2024-05-06T21:30:18.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.522+0000 7f0335bc1700 1 Processor -- start 2024-05-06T21:30:18.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.522+0000 7f0335bc1700 1 -- start start 2024-05-06T21:30:18.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f0335bc1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0330100240 0x7f0330195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:18.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f0335bc1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 0x7f0330195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:18.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f0335bc1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330196560 con 0x7f0330101440 2024-05-06T21:30:18.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f0335bc1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03301966a0 con 0x7f0330100240 2024-05-06T21:30:18.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 0x7f0330195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 0x7f0330195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56130/0 (socket says 172.21.15.32:56130) 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032effd700 1 -- 172.21.15.32:0/2837618126 learned_addr learned my addr 172.21.15.32:0/2837618126 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032f7fe700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0330100240 0x7f0330195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032effd700 1 -- 172.21.15.32:0/2837618126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0330100240 msgr2=0x7f0330195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032effd700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0330100240 0x7f0330195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032effd700 1 -- 172.21.15.32:0/2837618126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03240095f0 con 0x7f0330101440 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032effd700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 0x7f0330195fd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f032400bd70 tx=0x7f032400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032cff9700 1 -- 172.21.15.32:0/2837618126 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f032401d070 con 0x7f0330101440 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032cff9700 1 -- 172.21.15.32:0/2837618126 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0324022470 con 0x7f0330101440 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f032cff9700 1 -- 172.21.15.32:0/2837618126 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f032400f670 con 0x7f0330101440 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.523+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033019b100 con 0x7f0330101440 2024-05-06T21:30:18.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.524+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033019b5c0 con 0x7f0330101440 2024-05-06T21:30:18.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.525+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0330108d90 con 0x7f0330101440 2024-05-06T21:30:18.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.525+0000 7f032cff9700 1 -- 172.21.15.32:0/2837618126 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0324022a50 con 0x7f0330101440 2024-05-06T21:30:18.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.526+0000 7f032cff9700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f031806e200 0x7f03180706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:18.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.526+0000 7f032cff9700 1 -- 172.21.15.32:0/2837618126 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f032408f7b0 con 0x7f0330101440 2024-05-06T21:30:18.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.526+0000 7f032f7fe700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f031806e200 0x7f03180706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:18.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.526+0000 7f032f7fe700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f031806e200 0x7f03180706b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0320005fd0 tx=0x7f0320005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:18.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.530+0000 7f032cff9700 1 -- 172.21.15.32:0/2837618126 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f032405c6c0 con 0x7f0330101440 2024-05-06T21:30:18.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.848+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0330108f80 con 0x7f0330101440 2024-05-06T21:30:18.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.848+0000 7f032cff9700 1 -- 172.21.15.32:0/2837618126 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f032405c250 con 0x7f0330101440 2024-05-06T21:30:18.847 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 1 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:30:18.848 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:30:18.849 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-05-06T21:30:18.849 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 5 2024-05-06T21:30:18.849 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:30:18.849 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:30:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.851+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f031806e200 msgr2=0x7f03180706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.851+0000 7f0335bc1700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f031806e200 0x7f03180706b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0320005fd0 tx=0x7f0320005e50 comp rx=0 tx=0).stop 2024-05-06T21:30:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.851+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 msgr2=0x7f0330195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.851+0000 7f0335bc1700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 0x7f0330195fd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f032400bd70 tx=0x7f032400be50 comp rx=0 tx=0).stop 2024-05-06T21:30:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.851+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 shutdown_connections 2024-05-06T21:30:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.851+0000 7f0335bc1700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f031806e200 0x7f03180706b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.851+0000 7f0335bc1700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0330100240 0x7f0330195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.851+0000 7f0335bc1700 1 --2- 172.21.15.32:0/2837618126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0330101440 0x7f0330195fd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.851+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 >> 172.21.15.32:0/2837618126 conn(0x7f03300fb7f0 msgr2=0x7f0330104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:18.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.852+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 shutdown_connections 2024-05-06T21:30:18.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.852+0000 7f0335bc1700 1 -- 172.21.15.32:0/2837618126 wait complete. 2024-05-06T21:30:18.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.968+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/1914847905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c101450 msgr2=0x7f2b9c1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.968+0000 7f2ba3cc1700 1 --2- 172.21.15.32:0/1914847905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c101450 0x7f2b9c1018a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009910 tx=0x7f2b98009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:18.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.968+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/1914847905 shutdown_connections 2024-05-06T21:30:18.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.968+0000 7f2ba3cc1700 1 --2- 172.21.15.32:0/1914847905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c101450 0x7f2b9c1018a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.968+0000 7f2ba3cc1700 1 --2- 172.21.15.32:0/1914847905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9c100250 0x7f2b9c100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.968+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/1914847905 >> 172.21.15.32:0/1914847905 conn(0x7f2b9c0fb7e0 msgr2=0x7f2b9c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:18.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.968+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/1914847905 shutdown_connections 2024-05-06T21:30:18.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.968+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/1914847905 wait complete. 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba3cc1700 1 Processor -- start 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba3cc1700 1 -- start start 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba3cc1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c100250 0x7f2b9c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba3cc1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9c101450 0x7f2b9c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba3cc1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c073680 con 0x7f2b9c100250 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba3cc1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0737c0 con 0x7f2b9c101450 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba1a5d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c100250 0x7f2b9c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba1a5d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c100250 0x7f2b9c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56154/0 (socket says 172.21.15.32:56154) 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba1a5d700 1 -- 172.21.15.32:0/4080972340 learned_addr learned my addr 172.21.15.32:0/4080972340 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.969+0000 7f2ba125c700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9c101450 0x7f2b9c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.970+0000 7f2ba1a5d700 1 -- 172.21.15.32:0/4080972340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9c101450 msgr2=0x7f2b9c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:18.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.970+0000 7f2ba1a5d700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9c101450 0x7f2b9c073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:18.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.970+0000 7f2ba1a5d700 1 -- 172.21.15.32:0/4080972340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980095f0 con 0x7f2b9c100250 2024-05-06T21:30:18.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.970+0000 7f2ba1a5d700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c100250 0x7f2b9c074af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400ada0 tx=0x7f2b9400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:18.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.970+0000 7f2b92ffd700 1 -- 172.21.15.32:0/4080972340 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b9400f070 con 0x7f2b9c100250 2024-05-06T21:30:18.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.970+0000 7f2b92ffd700 1 -- 172.21.15.32:0/4080972340 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2b9400ae90 con 0x7f2b9c100250 2024-05-06T21:30:18.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.970+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9c073aa0 con 0x7f2b9c100250 2024-05-06T21:30:18.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.970+0000 7f2b92ffd700 1 -- 172.21.15.32:0/4080972340 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b940083f0 con 0x7f2b9c100250 2024-05-06T21:30:18.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.970+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c19db00 con 0x7f2b9c100250 2024-05-06T21:30:18.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.971+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9c108da0 con 0x7f2b9c100250 2024-05-06T21:30:18.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.973+0000 7f2b92ffd700 1 -- 172.21.15.32:0/4080972340 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2b9400cad0 con 0x7f2b9c100250 2024-05-06T21:30:18.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.973+0000 7f2b92ffd700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b8806e200 0x7f2b880706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:18.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.973+0000 7f2b92ffd700 1 -- 172.21.15.32:0/4080972340 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2b9408da90 con 0x7f2b9c100250 2024-05-06T21:30:18.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.973+0000 7f2ba125c700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b8806e200 0x7f2b880706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:18.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.974+0000 7f2ba125c700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b8806e200 0x7f2b880706b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b98006010 tx=0x7f2b9800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:18.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:18.978+0000 7f2b92ffd700 1 -- 172.21.15.32:0/4080972340 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2b9405a8f0 con 0x7f2b9c100250 2024-05-06T21:30:19.085 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:18 smithi032 systemd[1]: Stopping Ceph osd.1 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:30:19.085 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:18 smithi032 ceph-mon[76650]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:19.085 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:18 smithi032 ceph-mon[76650]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:19.086 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:18 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2837618126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.241+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2b9c19e300 con 0x7f2b9c100250 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.241+0000 7f2b92ffd700 1 -- 172.21.15.32:0/4080972340 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f2b9405a480 con 0x7f2b9c100250 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stdout:e20 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:30:19.240 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 20 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:27:07.836937+0000 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:30:19.241 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 0 members: 2024-05-06T21:30:19.242 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:30:19.243 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:30:19.243 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:30:19.243 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:30:19.243 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:30:19.243 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:30:19.243 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:30:19.243 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b8806e200 msgr2=0x7f2b880706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b8806e200 0x7f2b880706b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b98006010 tx=0x7f2b9800b540 comp rx=0 tx=0).stop 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c100250 msgr2=0x7f2b9c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c100250 0x7f2b9c074af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400ada0 tx=0x7f2b9400c330 comp rx=0 tx=0).stop 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 shutdown_connections 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b8806e200 0x7f2b880706b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9c100250 0x7f2b9c074af0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 --2- 172.21.15.32:0/4080972340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9c101450 0x7f2b9c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 >> 172.21.15.32:0/4080972340 conn(0x7f2b9c0fb7e0 msgr2=0x7f2b9c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 shutdown_connections 2024-05-06T21:30:19.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.243+0000 7f2ba3cc1700 1 -- 172.21.15.32:0/4080972340 wait complete. 2024-05-06T21:30:19.245 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 20 2024-05-06T21:30:19.352 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:19 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[47798]: 2024-05-06T21:30:19.086+0000 7fc7f704c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:30:19.352 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:19 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[47798]: 2024-05-06T21:30:19.086+0000 7fc7f704c700 -1 osd.1 55 *** Got signal Terminated *** 2024-05-06T21:30:19.353 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:19 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[47798]: 2024-05-06T21:30:19.086+0000 7fc7f704c700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:30:19.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.353+0000 7f54ca23a700 1 -- 172.21.15.32:0/4224456804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 msgr2=0x7f54c40fef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:19.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.353+0000 7f54ca23a700 1 --2- 172.21.15.32:0/4224456804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 0x7f54c40fef80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009910 tx=0x7f54b4009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:19.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.353+0000 7f54ca23a700 1 -- 172.21.15.32:0/4224456804 shutdown_connections 2024-05-06T21:30:19.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.353+0000 7f54ca23a700 1 --2- 172.21.15.32:0/4224456804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40ff4c0 0x7f54c40ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.353+0000 7f54ca23a700 1 --2- 172.21.15.32:0/4224456804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 0x7f54c40fef80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.353+0000 7f54ca23a700 1 -- 172.21.15.32:0/4224456804 >> 172.21.15.32:0/4224456804 conn(0x7f54c40fa7a0 msgr2=0x7f54c40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.354+0000 7f54ca23a700 1 -- 172.21.15.32:0/4224456804 shutdown_connections 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.354+0000 7f54ca23a700 1 -- 172.21.15.32:0/4224456804 wait complete. 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.354+0000 7f54ca23a700 1 Processor -- start 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.354+0000 7f54ca23a700 1 -- start start 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54ca23a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 0x7f54c4198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54ca23a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40ff4c0 0x7f54c4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54ca23a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4198b80 con 0x7f54c40feb70 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54ca23a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4198cc0 con 0x7f54c40ff4c0 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54c37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 0x7f54c4198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54c37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 0x7f54c4198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56178/0 (socket says 172.21.15.32:56178) 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54c37fe700 1 -- 172.21.15.32:0/325001260 learned_addr learned my addr 172.21.15.32:0/325001260 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54c2ffd700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40ff4c0 0x7f54c4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:19.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54c37fe700 1 -- 172.21.15.32:0/325001260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40ff4c0 msgr2=0x7f54c4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:19.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54c37fe700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40ff4c0 0x7f54c4198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54c37fe700 1 -- 172.21.15.32:0/325001260 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40095f0 con 0x7f54c40feb70 2024-05-06T21:30:19.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.355+0000 7f54c37fe700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 0x7f54c4198020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f54b400bda0 tx=0x7f54b400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:19.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.356+0000 7f54c0ff9700 1 -- 172.21.15.32:0/325001260 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b401d070 con 0x7f54c40feb70 2024-05-06T21:30:19.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.356+0000 7f54c0ff9700 1 -- 172.21.15.32:0/325001260 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f54b4004c50 con 0x7f54c40feb70 2024-05-06T21:30:19.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.356+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c419d710 con 0x7f54c40feb70 2024-05-06T21:30:19.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.356+0000 7f54c0ff9700 1 -- 172.21.15.32:0/325001260 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b400f690 con 0x7f54c40feb70 2024-05-06T21:30:19.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.356+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c419dc00 con 0x7f54c40feb70 2024-05-06T21:30:19.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.357+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c4068ab0 con 0x7f54c40feb70 2024-05-06T21:30:19.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.357+0000 7f54c0ff9700 1 -- 172.21.15.32:0/325001260 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f54b400f7f0 con 0x7f54c40feb70 2024-05-06T21:30:19.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.358+0000 7f54c0ff9700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54ac06e200 0x7f54ac0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:19.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.358+0000 7f54c0ff9700 1 -- 172.21.15.32:0/325001260 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f54b408f850 con 0x7f54c40feb70 2024-05-06T21:30:19.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.358+0000 7f54c2ffd700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54ac06e200 0x7f54ac0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:19.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.359+0000 7f54c2ffd700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54ac06e200 0x7f54ac0706b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54b8005950 tx=0x7f54b8005eb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:19.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.364+0000 7f54c0ff9700 1 -- 172.21.15.32:0/325001260 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f54b405c730 con 0x7f54c40feb70 2024-05-06T21:30:19.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:18 smithi154 ceph-mon[63622]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:19.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:18 smithi154 ceph-mon[63622]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:19.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:18 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2837618126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:19.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.595+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54c41089e0 con 0x7f54ac06e200 2024-05-06T21:30:19.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.597+0000 7f54c0ff9700 1 -- 172.21.15.32:0/325001260 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f54c41089e0 con 0x7f54ac06e200 2024-05-06T21:30:19.595 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:30:19.595 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:30:19.595 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:30:19.595 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:30:19.595 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:30:19.595 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:30:19.596 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:30:19.596 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:30:19.596 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:30:19.596 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "7/23 daemons upgraded", 2024-05-06T21:30:19.596 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T21:30:19.596 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:30:19.596 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:30:19.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54ac06e200 msgr2=0x7f54ac0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:19.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54ac06e200 0x7f54ac0706b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54b8005950 tx=0x7f54b8005eb0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 msgr2=0x7f54c4198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:19.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 0x7f54c4198020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f54b400bda0 tx=0x7f54b400be80 comp rx=0 tx=0).stop 2024-05-06T21:30:19.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 shutdown_connections 2024-05-06T21:30:19.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54ac06e200 0x7f54ac0706b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c40feb70 0x7f54c4198020 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 --2- 172.21.15.32:0/325001260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40ff4c0 0x7f54c4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 >> 172.21.15.32:0/325001260 conn(0x7f54c40fa7a0 msgr2=0x7f54c4107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:19.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 shutdown_connections 2024-05-06T21:30:19.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.599+0000 7f54ca23a700 1 -- 172.21.15.32:0/325001260 wait complete. 2024-05-06T21:30:19.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.707+0000 7f8def236700 1 -- 172.21.15.32:0/1464107582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 msgr2=0x7f8de8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:19.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.707+0000 7f8def236700 1 --2- 172.21.15.32:0/1464107582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 0x7f8de8100650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009910 tx=0x7f8ddc009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:19.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.707+0000 7f8def236700 1 -- 172.21.15.32:0/1464107582 shutdown_connections 2024-05-06T21:30:19.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.707+0000 7f8def236700 1 --2- 172.21.15.32:0/1464107582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de8101440 0x7f8de8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.707+0000 7f8def236700 1 --2- 172.21.15.32:0/1464107582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 0x7f8de8100650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.707+0000 7f8def236700 1 -- 172.21.15.32:0/1464107582 >> 172.21.15.32:0/1464107582 conn(0x7f8de80fb7f0 msgr2=0x7f8de80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:19.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.707+0000 7f8def236700 1 -- 172.21.15.32:0/1464107582 shutdown_connections 2024-05-06T21:30:19.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.707+0000 7f8def236700 1 -- 172.21.15.32:0/1464107582 wait complete. 2024-05-06T21:30:19.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.708+0000 7f8def236700 1 Processor -- start 2024-05-06T21:30:19.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.708+0000 7f8def236700 1 -- start start 2024-05-06T21:30:19.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.708+0000 7f8def236700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 0x7f8de8197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.708+0000 7f8def236700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de8101440 0x7f8de81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.708+0000 7f8def236700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de81987f0 con 0x7f8de8100240 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.708+0000 7f8def236700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de8198960 con 0x7f8de8101440 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8decfd2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 0x7f8de8197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8decfd2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 0x7f8de8197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56202/0 (socket says 172.21.15.32:56202) 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8decfd2700 1 -- 172.21.15.32:0/4028489069 learned_addr learned my addr 172.21.15.32:0/4028489069 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8de7fff700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de8101440 0x7f8de81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8decfd2700 1 -- 172.21.15.32:0/4028489069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de8101440 msgr2=0x7f8de81981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8decfd2700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de8101440 0x7f8de81981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8decfd2700 1 -- 172.21.15.32:0/4028489069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0095f0 con 0x7f8de8100240 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8de7fff700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de8101440 0x7f8de81981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8decfd2700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 0x7f8de8197cb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00bda0 tx=0x7f8ddc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:19.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8de5ffb700 1 -- 172.21.15.32:0/4028489069 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ddc01d070 con 0x7f8de8100240 2024-05-06T21:30:19.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8de5ffb700 1 -- 172.21.15.32:0/4028489069 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8ddc00f460 con 0x7f8de8100240 2024-05-06T21:30:19.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de819d390 con 0x7f8de8100240 2024-05-06T21:30:19.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.709+0000 7f8de5ffb700 1 -- 172.21.15.32:0/4028489069 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ddc021640 con 0x7f8de8100240 2024-05-06T21:30:19.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.710+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de819d880 con 0x7f8de8100240 2024-05-06T21:30:19.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.711+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de8105520 con 0x7f8de8100240 2024-05-06T21:30:19.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.712+0000 7f8de5ffb700 1 -- 172.21.15.32:0/4028489069 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8ddc00fa00 con 0x7f8de8100240 2024-05-06T21:30:19.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.713+0000 7f8de5ffb700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8dd806e250 0x7f8dd8070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:19.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.713+0000 7f8de5ffb700 1 -- 172.21.15.32:0/4028489069 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f8ddc08f440 con 0x7f8de8100240 2024-05-06T21:30:19.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.713+0000 7f8de7fff700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8dd806e250 0x7f8dd8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:19.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.713+0000 7f8de7fff700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8dd806e250 0x7f8dd8070700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4005950 tx=0x7f8dd40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:19.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:19.718+0000 7f8de5ffb700 1 -- 172.21.15.32:0/4028489069 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8ddc0586d0 con 0x7f8de8100240 2024-05-06T21:30:19.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:19 smithi032 ceph-mon[76650]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:19.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:19 smithi032 ceph-mon[76650]: pgmap v67: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:19.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:19 smithi032 ceph-mon[76650]: osd.1 marked itself down and dead 2024-05-06T21:30:19.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:19 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4080972340' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:30:20.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.028+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8de802cc30 con 0x7f8de8100240 2024-05-06T21:30:20.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.028+0000 7f8de5ffb700 1 -- 172.21.15.32:0/4028489069 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f8ddc05bd90 con 0x7f8de8100240 2024-05-06T21:30:20.027 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_WARN 1 osds down 2024-05-06T21:30:20.027 INFO:teuthology.orchestra.run.smithi032.stdout:[WRN] OSD_DOWN: 1 osds down 2024-05-06T21:30:20.027 INFO:teuthology.orchestra.run.smithi032.stdout: osd.1 (root=default,host=smithi032) is down 2024-05-06T21:30:20.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8dd806e250 msgr2=0x7f8dd8070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:20.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8dd806e250 0x7f8dd8070700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4005950 tx=0x7f8dd40058e0 comp rx=0 tx=0).stop 2024-05-06T21:30:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 msgr2=0x7f8de8197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 0x7f8de8197cb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00bda0 tx=0x7f8ddc00be80 comp rx=0 tx=0).stop 2024-05-06T21:30:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 shutdown_connections 2024-05-06T21:30:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8dd806e250 0x7f8dd8070700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8de8100240 0x7f8de8197cb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 --2- 172.21.15.32:0/4028489069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de8101440 0x7f8de81981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 >> 172.21.15.32:0/4028489069 conn(0x7f8de80fb7f0 msgr2=0x7f8de8102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 shutdown_connections 2024-05-06T21:30:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:20.031+0000 7f8def236700 1 -- 172.21.15.32:0/4028489069 wait complete. 2024-05-06T21:30:20.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:19 smithi154 ceph-mon[63622]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:20.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:19 smithi154 ceph-mon[63622]: pgmap v67: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:20.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:19 smithi154 ceph-mon[63622]: osd.1 marked itself down and dead 2024-05-06T21:30:20.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:19 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4080972340' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:30:20.786 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:20 smithi032 podman[85983]: 2024-05-06 21:30:20.501975877 +0000 UTC m=+1.545213308 container died a14b367bc17044ef10c4b40e5eec015fa2ce7a39103df5f4e30ba6f05b4541bb (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1) 2024-05-06T21:30:21.152 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:20 smithi032 podman[85983]: 2024-05-06 21:30:20.887042892 +0000 UTC m=+1.930280322 container cleanup a14b367bc17044ef10c4b40e5eec015fa2ce7a39103df5f4e30ba6f05b4541bb (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-05-06T21:30:21.152 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:20 smithi032 bash[85983]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: osdmap e56: 6 total, 5 up, 6 in 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4028489069' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 2]}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 5, 3, 2]}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 1]}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [4, 2]}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [3, 1]}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 1]}]: dispatch 2024-05-06T21:30:21.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]: dispatch 2024-05-06T21:30:21.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:21.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:30:21.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:21.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:30:21.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: osdmap e56: 6 total, 5 up, 6 in 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4028489069' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 2]}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 5, 3, 2]}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 1]}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [4, 2]}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [3, 1]}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 1]}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]: dispatch 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:21.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:30:21.471 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:21 smithi032 podman[86068]: 2024-05-06 21:30:21.154855502 +0000 UTC m=+0.651329075 container remove a14b367bc17044ef10c4b40e5eec015fa2ce7a39103df5f4e30ba6f05b4541bb (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, ceph=True) 2024-05-06T21:30:21.781 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:21 smithi032 podman[86158]: 2024-05-06 21:30:21.382298778 +0000 UTC m=+0.018638215 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:30:21.781 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:21 smithi032 podman[86158]: 2024-05-06 21:30:21.48937002 +0000 UTC m=+0.125709487 container create 8286d39083e8b8896e7c3f2dbdaaf284a8fe55df49eda102d1de733d4f51a42b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux ) 2024-05-06T21:30:21.781 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:21 smithi032 podman[86158]: 2024-05-06 21:30:21.783922673 +0000 UTC m=+0.420262114 container init 8286d39083e8b8896e7c3f2dbdaaf284a8fe55df49eda102d1de733d4f51a42b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430) 2024-05-06T21:30:22.092 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:21 smithi032 podman[86158]: 2024-05-06 21:30:21.787564432 +0000 UTC m=+0.423903861 container start 8286d39083e8b8896e7c3f2dbdaaf284a8fe55df49eda102d1de733d4f51a42b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-06T21:30:22.092 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:21 smithi032 podman[86158]: 2024-05-06 21:30:21.867396485 +0000 UTC m=+0.503735917 container attach 8286d39083e8b8896e7c3f2dbdaaf284a8fe55df49eda102d1de733d4f51a42b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:30:22.092 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: pgmap v69: 65 pgs: 12 stale+active+clean, 53 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:22.092 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 2]}]': finished 2024-05-06T21:30:22.092 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2024-05-06T21:30:22.092 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 5, 3, 2]}]': finished 2024-05-06T21:30:22.092 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]': finished 2024-05-06T21:30:22.092 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 1]}]': finished 2024-05-06T21:30:22.092 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [4, 2]}]': finished 2024-05-06T21:30:22.093 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [3, 1]}]': finished 2024-05-06T21:30:22.093 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 1]}]': finished 2024-05-06T21:30:22.093 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]': finished 2024-05-06T21:30:22.093 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: osdmap e57: 6 total, 5 up, 6 in 2024-05-06T21:30:22.093 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:21 smithi032 ceph-mon[76650]: osdmap e58: 6 total, 5 up, 6 in 2024-05-06T21:30:22.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: pgmap v69: 65 pgs: 12 stale+active+clean, 53 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:22.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 2]}]': finished 2024-05-06T21:30:22.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2024-05-06T21:30:22.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 5, 3, 2]}]': finished 2024-05-06T21:30:22.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]': finished 2024-05-06T21:30:22.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 1]}]': finished 2024-05-06T21:30:22.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [4, 2]}]': finished 2024-05-06T21:30:22.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [3, 1]}]': finished 2024-05-06T21:30:22.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 1]}]': finished 2024-05-06T21:30:22.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]': finished 2024-05-06T21:30:22.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: osdmap e57: 6 total, 5 up, 6 in 2024-05-06T21:30:22.367 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:21 smithi154 ceph-mon[63622]: osdmap e58: 6 total, 5 up, 6 in 2024-05-06T21:30:22.435 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:22 smithi032 podman[86158]: 2024-05-06 21:30:22.094571234 +0000 UTC m=+0.730910671 container died 8286d39083e8b8896e7c3f2dbdaaf284a8fe55df49eda102d1de733d4f51a42b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-06T21:30:23.052 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:22 smithi032 podman[86184]: 2024-05-06 21:30:22.746355863 +0000 UTC m=+0.646063637 container remove 8286d39083e8b8896e7c3f2dbdaaf284a8fe55df49eda102d1de733d4f51a42b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:30:23.052 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:22 smithi032 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.1.service: Deactivated successfully. 2024-05-06T21:30:23.052 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:22 smithi032 systemd[1]: Stopped Ceph osd.1 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:30:23.052 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:22 smithi032 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.1.service: Consumed 1min 4.045s CPU time. 2024-05-06T21:30:23.320 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:23 smithi032 systemd[1]: Starting Ceph osd.1 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:30:23.320 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:23 smithi032 podman[86287]: 2024-05-06 21:30:23.188350935 +0000 UTC m=+0.020260871 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:30:23.320 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:23 smithi032 podman[86287]: 2024-05-06 21:30:23.322465026 +0000 UTC m=+0.154374939 container create 16ff53f857a27852fc98146fc8d703ed7e7a333126a34947abe9f8d6c5ed50c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-06T21:30:23.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:23 smithi032 ceph-mon[76650]: pgmap v72: 65 pgs: 4 unknown, 2 peering, 12 active+undersized+degraded, 3 stale+active+clean, 14 active+undersized, 30 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41/342 objects degraded (11.988%) 2024-05-06T21:30:23.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:23 smithi032 ceph-mon[76650]: osdmap e59: 6 total, 5 up, 6 in 2024-05-06T21:30:23.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:23 smithi032 ceph-mon[76650]: Health check failed: Degraded data redundancy: 41/342 objects degraded (11.988%), 12 pgs degraded (PG_DEGRADED) 2024-05-06T21:30:23.972 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:23 smithi032 podman[86287]: 2024-05-06 21:30:23.58423933 +0000 UTC m=+0.416149254 container init 16ff53f857a27852fc98146fc8d703ed7e7a333126a34947abe9f8d6c5ed50c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-06T21:30:23.972 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:23 smithi032 podman[86287]: 2024-05-06 21:30:23.589485069 +0000 UTC m=+0.421394985 container start 16ff53f857a27852fc98146fc8d703ed7e7a333126a34947abe9f8d6c5ed50c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-06T21:30:23.972 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:23 smithi032 podman[86287]: 2024-05-06 21:30:23.700845429 +0000 UTC m=+0.532755348 container attach 16ff53f857a27852fc98146fc8d703ed7e7a333126a34947abe9f8d6c5ed50c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-06T21:30:24.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:23 smithi154 ceph-mon[63622]: pgmap v72: 65 pgs: 4 unknown, 2 peering, 12 active+undersized+degraded, 3 stale+active+clean, 14 active+undersized, 30 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41/342 objects degraded (11.988%) 2024-05-06T21:30:24.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:23 smithi154 ceph-mon[63622]: osdmap e59: 6 total, 5 up, 6 in 2024-05-06T21:30:24.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:23 smithi154 ceph-mon[63622]: Health check failed: Degraded data redundancy: 41/342 objects degraded (11.988%), 12 pgs degraded (PG_DEGRADED) 2024-05-06T21:30:24.471 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate[86301]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate[86301]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 bash[86287]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 bash[86287]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 bash[86287]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 bash[86287]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 bash[86287]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 bash[86287]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 bash[86287]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate[86301]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate[86301]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate[86301]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate[86301]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T21:30:24.472 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate[86301]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-06T21:30:24.473 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:24 smithi032 podman[86287]: 2024-05-06 21:30:24.137673038 +0000 UTC m=+0.969582968 container died 16ff53f857a27852fc98146fc8d703ed7e7a333126a34947abe9f8d6c5ed50c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0) 2024-05-06T21:30:25.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:24 smithi154 ceph-mon[63622]: osdmap e60: 6 total, 5 up, 6 in 2024-05-06T21:30:25.153 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:24 smithi032 ceph-mon[76650]: osdmap e60: 6 total, 5 up, 6 in 2024-05-06T21:30:25.421 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:25 smithi032 podman[86426]: 2024-05-06 21:30:25.164186049 +0000 UTC m=+1.020486649 container remove 16ff53f857a27852fc98146fc8d703ed7e7a333126a34947abe9f8d6c5ed50c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-06T21:30:25.421 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:25 smithi032 podman[86485]: 2024-05-06 21:30:25.28834241 +0000 UTC m=+0.018966817 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:30:25.421 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:25 smithi032 podman[86485]: 2024-05-06 21:30:25.423514449 +0000 UTC m=+0.154138855 container create 00a59b6189e52acadf0029424fc7f8150b03a6c908c40b9abd28b68843e61220 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS) 2024-05-06T21:30:25.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:25 smithi032 ceph-mon[76650]: pgmap v75: 65 pgs: 1 active+clean+remapped, 27 active+clean, 1 active+recovery_wait+undersized+remapped, 16 active+undersized, 2 active+undersized+remapped, 14 active+undersized+degraded, 2 peering, 2 unknown; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 719/366 objects misplaced (196.448%); 7.0 MiB/s, 1 objects/s recovering 2024-05-06T21:30:25.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:25 smithi032 ceph-mon[76650]: osdmap e61: 6 total, 5 up, 6 in 2024-05-06T21:30:25.971 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:25 smithi032 podman[86485]: 2024-05-06 21:30:25.684758406 +0000 UTC m=+0.415382815 container init 00a59b6189e52acadf0029424fc7f8150b03a6c908c40b9abd28b68843e61220 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-06T21:30:25.972 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:25 smithi032 podman[86485]: 2024-05-06 21:30:25.688383202 +0000 UTC m=+0.419007612 container start 00a59b6189e52acadf0029424fc7f8150b03a6c908c40b9abd28b68843e61220 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T21:30:25.972 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:25 smithi032 ceph-osd[86513]: -- 172.21.15.32:0/3503579445 <== mon.0 v2:172.21.15.32:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557a94423680 con 0x557a943ed000 2024-05-06T21:30:25.972 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:25 smithi032 bash[86485]: 00a59b6189e52acadf0029424fc7f8150b03a6c908c40b9abd28b68843e61220 2024-05-06T21:30:25.972 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:25 smithi032 systemd[1]: Started Ceph osd.1 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:30:26.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:25 smithi154 ceph-mon[63622]: pgmap v75: 65 pgs: 1 active+clean+remapped, 27 active+clean, 1 active+recovery_wait+undersized+remapped, 16 active+undersized, 2 active+undersized+remapped, 14 active+undersized+degraded, 2 peering, 2 unknown; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 719/366 objects misplaced (196.448%); 7.0 MiB/s, 1 objects/s recovering 2024-05-06T21:30:26.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:25 smithi154 ceph-mon[63622]: osdmap e61: 6 total, 5 up, 6 in 2024-05-06T21:30:26.661 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:26 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[86504]: 2024-05-06T21:30:26.236+0000 7f9e7d25d7c0 -1 Falling back to public interface 2024-05-06T21:30:26.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:26 smithi032 ceph-mon[76650]: osdmap e62: 6 total, 5 up, 6 in 2024-05-06T21:30:26.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:26.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:26.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:30:27.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:26 smithi154 ceph-mon[63622]: osdmap e62: 6 total, 5 up, 6 in 2024-05-06T21:30:27.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:27.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:27.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:30:28.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:27 smithi154 ceph-mon[63622]: pgmap v78: 65 pgs: 5 active+clean+remapped, 27 active+clean, 1 active+recovery_wait+undersized+remapped, 16 active+undersized, 14 active+undersized+degraded, 1 peering, 1 unknown; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 7.1 MiB/s wr, 172 op/s; 48/366 objects degraded (13.115%); 722/366 objects misplaced (197.268%); 8.0 MiB/s, 2 objects/s recovering 2024-05-06T21:30:28.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:27 smithi154 ceph-mon[63622]: osdmap e63: 6 total, 5 up, 6 in 2024-05-06T21:30:28.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:27 smithi032 ceph-mon[76650]: pgmap v78: 65 pgs: 5 active+clean+remapped, 27 active+clean, 1 active+recovery_wait+undersized+remapped, 16 active+undersized, 14 active+undersized+degraded, 1 peering, 1 unknown; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 7.1 MiB/s wr, 172 op/s; 48/366 objects degraded (13.115%); 722/366 objects misplaced (197.268%); 8.0 MiB/s, 2 objects/s recovering 2024-05-06T21:30:28.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:27 smithi032 ceph-mon[76650]: osdmap e63: 6 total, 5 up, 6 in 2024-05-06T21:30:30.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:29 smithi154 ceph-mon[63622]: pgmap v80: 65 pgs: 7 active+clean+remapped, 27 active+clean, 1 active+recovery_wait+undersized+remapped, 16 active+undersized, 14 active+undersized+degraded; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 727/366 objects misplaced (198.634%); 844 KiB/s, 147 objects/s recovering 2024-05-06T21:30:30.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:29 smithi032 ceph-mon[76650]: pgmap v80: 65 pgs: 7 active+clean+remapped, 27 active+clean, 1 active+recovery_wait+undersized+remapped, 16 active+undersized, 14 active+undersized+degraded; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 727/366 objects misplaced (198.634%); 844 KiB/s, 147 objects/s recovering 2024-05-06T21:30:30.872 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:30 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[86504]: 2024-05-06T21:30:30.813+0000 7f9e7d25d7c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-05-06T21:30:31.710 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:31 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[86504]: 2024-05-06T21:30:31.376+0000 7f9e7d25d7c0 -1 osd.1 55 log_to_monitors true 2024-05-06T21:30:31.971 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:30:31 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[86504]: 2024-05-06T21:30:31.817+0000 7f9e6e6b4700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:30:31.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:31 smithi032 ceph-mon[76650]: pgmap v81: 65 pgs: 8 active+clean+remapped, 27 active+clean, 16 active+undersized, 14 active+undersized+degraded; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 16/366 objects misplaced (4.372%); 683 KiB/s, 238 objects/s recovering 2024-05-06T21:30:31.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:31 smithi032 ceph-mon[76650]: from='osd.1 [v2:172.21.15.32:6810/2235618236,v1:172.21.15.32:6811/2235618236]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T21:30:31.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:31.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:31.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:31 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 48/366 objects degraded (13.115%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T21:30:32.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:31 smithi154 ceph-mon[63622]: pgmap v81: 65 pgs: 8 active+clean+remapped, 27 active+clean, 16 active+undersized, 14 active+undersized+degraded; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 16/366 objects misplaced (4.372%); 683 KiB/s, 238 objects/s recovering 2024-05-06T21:30:32.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:31 smithi154 ceph-mon[63622]: from='osd.1 [v2:172.21.15.32:6810/2235618236,v1:172.21.15.32:6811/2235618236]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T21:30:32.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:32.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:32.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:31 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 48/366 objects degraded (13.115%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T21:30:33.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:32 smithi154 ceph-mon[63622]: from='osd.1 [v2:172.21.15.32:6810/2235618236,v1:172.21.15.32:6811/2235618236]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T21:30:33.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:32 smithi154 ceph-mon[63622]: osdmap e64: 6 total, 5 up, 6 in 2024-05-06T21:30:33.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:32 smithi154 ceph-mon[63622]: from='osd.1 [v2:172.21.15.32:6810/2235618236,v1:172.21.15.32:6811/2235618236]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:30:33.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:32 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:33.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:32 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:33.208 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:32 smithi032 ceph-mon[76650]: from='osd.1 [v2:172.21.15.32:6810/2235618236,v1:172.21.15.32:6811/2235618236]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T21:30:33.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:32 smithi032 ceph-mon[76650]: osdmap e64: 6 total, 5 up, 6 in 2024-05-06T21:30:33.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:32 smithi032 ceph-mon[76650]: from='osd.1 [v2:172.21.15.32:6810/2235618236,v1:172.21.15.32:6811/2235618236]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:30:33.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:32 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:33.209 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:32 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:34.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:33 smithi154 ceph-mon[63622]: pgmap v83: 65 pgs: 8 active+clean+remapped, 27 active+clean, 16 active+undersized, 14 active+undersized+degraded; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 16/366 objects misplaced (4.372%); 598 KiB/s, 208 objects/s recovering 2024-05-06T21:30:34.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:33 smithi154 ceph-mon[63622]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:30:34.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:33 smithi154 ceph-mon[63622]: osd.1 [v2:172.21.15.32:6810/2235618236,v1:172.21.15.32:6811/2235618236] boot 2024-05-06T21:30:34.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:33 smithi154 ceph-mon[63622]: osdmap e65: 6 total, 6 up, 6 in 2024-05-06T21:30:34.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:30:34.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:33 smithi154 ceph-mon[63622]: osdmap e66: 6 total, 6 up, 6 in 2024-05-06T21:30:34.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:33 smithi032 ceph-mon[76650]: pgmap v83: 65 pgs: 8 active+clean+remapped, 27 active+clean, 16 active+undersized, 14 active+undersized+degraded; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 16/366 objects misplaced (4.372%); 598 KiB/s, 208 objects/s recovering 2024-05-06T21:30:34.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:33 smithi032 ceph-mon[76650]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:30:34.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:33 smithi032 ceph-mon[76650]: osd.1 [v2:172.21.15.32:6810/2235618236,v1:172.21.15.32:6811/2235618236] boot 2024-05-06T21:30:34.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:33 smithi032 ceph-mon[76650]: osdmap e65: 6 total, 6 up, 6 in 2024-05-06T21:30:34.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T21:30:34.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:33 smithi032 ceph-mon[76650]: osdmap e66: 6 total, 6 up, 6 in 2024-05-06T21:30:35.941 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:35 smithi032 ceph-mon[76650]: pgmap v86: 65 pgs: 2 remapped+peering, 2 peering, 6 active+clean+remapped, 27 active+clean, 14 active+undersized, 14 active+undersized+degraded; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 16/366 objects misplaced (4.372%); 0 B/s, 118 objects/s recovering 2024-05-06T21:30:35.941 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:35 smithi032 ceph-mon[76650]: osdmap e67: 6 total, 6 up, 6 in 2024-05-06T21:30:35.942 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:35.942 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:30:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:35 smithi154 ceph-mon[63622]: pgmap v86: 65 pgs: 2 remapped+peering, 2 peering, 6 active+clean+remapped, 27 active+clean, 14 active+undersized, 14 active+undersized+degraded; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%); 16/366 objects misplaced (4.372%); 0 B/s, 118 objects/s recovering 2024-05-06T21:30:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:35 smithi154 ceph-mon[63622]: osdmap e67: 6 total, 6 up, 6 in 2024-05-06T21:30:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:30:37.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: osdmap e68: 6 total, 6 up, 6 in 2024-05-06T21:30:37.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:37.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:37.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-05-06T21:30:37.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:36 smithi154 ceph-mon[63622]: osdmap e69: 6 total, 6 up, 6 in 2024-05-06T21:30:37.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: osdmap e68: 6 total, 6 up, 6 in 2024-05-06T21:30:37.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-05-06T21:30:37.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:36 smithi032 ceph-mon[76650]: osdmap e69: 6 total, 6 up, 6 in 2024-05-06T21:30:38.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:37 smithi154 ceph-mon[63622]: pgmap v89: 65 pgs: 2 remapped+peering, 2 peering, 2 active+clean+remapped, 47 active+clean, 1 active+recovering+undersized+remapped, 4 active+undersized, 7 active+undersized+degraded; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23/366 objects degraded (6.284%); 8/366 objects misplaced (2.186%); 0 B/s, 100 objects/s recovering 2024-05-06T21:30:38.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:37 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 23/366 objects degraded (6.284%), 7 pgs degraded (PG_DEGRADED) 2024-05-06T21:30:38.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:37 smithi154 ceph-mon[63622]: osdmap e70: 6 total, 6 up, 6 in 2024-05-06T21:30:38.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:37 smithi032 ceph-mon[76650]: pgmap v89: 65 pgs: 2 remapped+peering, 2 peering, 2 active+clean+remapped, 47 active+clean, 1 active+recovering+undersized+remapped, 4 active+undersized, 7 active+undersized+degraded; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23/366 objects degraded (6.284%); 8/366 objects misplaced (2.186%); 0 B/s, 100 objects/s recovering 2024-05-06T21:30:38.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:37 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 23/366 objects degraded (6.284%), 7 pgs degraded (PG_DEGRADED) 2024-05-06T21:30:38.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:37 smithi032 ceph-mon[76650]: osdmap e70: 6 total, 6 up, 6 in 2024-05-06T21:30:40.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:39 smithi154 ceph-mon[63622]: pgmap v92: 65 pgs: 3 peering, 61 active+clean, 1 active+recovering+undersized+remapped; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 272 objects/s recovering 2024-05-06T21:30:40.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:39 smithi154 ceph-mon[63622]: osdmap e71: 6 total, 6 up, 6 in 2024-05-06T21:30:40.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:39 smithi154 ceph-mon[63622]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/366 objects degraded (6.284%), 7 pgs degraded) 2024-05-06T21:30:40.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:39 smithi154 ceph-mon[63622]: Cluster is now healthy 2024-05-06T21:30:40.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:39 smithi032 ceph-mon[76650]: pgmap v92: 65 pgs: 3 peering, 61 active+clean, 1 active+recovering+undersized+remapped; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 272 objects/s recovering 2024-05-06T21:30:40.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:39 smithi032 ceph-mon[76650]: osdmap e71: 6 total, 6 up, 6 in 2024-05-06T21:30:40.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:39 smithi032 ceph-mon[76650]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/366 objects degraded (6.284%), 7 pgs degraded) 2024-05-06T21:30:40.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:39 smithi032 ceph-mon[76650]: Cluster is now healthy 2024-05-06T21:30:42.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:41 smithi154 ceph-mon[63622]: pgmap v94: 65 pgs: 1 peering, 63 active+clean, 1 active+recovering+undersized+remapped; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 226 objects/s recovering 2024-05-06T21:30:42.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:41 smithi032 ceph-mon[76650]: pgmap v94: 65 pgs: 1 peering, 63 active+clean, 1 active+recovering+undersized+remapped; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 226 objects/s recovering 2024-05-06T21:30:44.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:43 smithi154 ceph-mon[63622]: pgmap v95: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 163 objects/s recovering 2024-05-06T21:30:44.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:43 smithi032 ceph-mon[76650]: pgmap v95: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 163 objects/s recovering 2024-05-06T21:30:46.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:45 smithi154 ceph-mon[63622]: pgmap v96: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 124 objects/s recovering 2024-05-06T21:30:46.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:45 smithi032 ceph-mon[76650]: pgmap v96: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 124 objects/s recovering 2024-05-06T21:30:48.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:47 smithi154 ceph-mon[63622]: pgmap v97: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 33 objects/s recovering 2024-05-06T21:30:48.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:47 smithi032 ceph-mon[76650]: pgmap v97: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 33 objects/s recovering 2024-05-06T21:30:50.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:49 smithi154 ceph-mon[63622]: pgmap v98: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 29 objects/s recovering 2024-05-06T21:30:50.156 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:49 smithi032 ceph-mon[76650]: pgmap v98: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 29 objects/s recovering 2024-05-06T21:30:50.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.158+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/499112444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58103650 msgr2=0x7f1f58105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.158+0000 7f1f5cf6a700 1 --2- 172.21.15.32:0/499112444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58103650 0x7f1f58105a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009910 tx=0x7f1f4c009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:50.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.158+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/499112444 shutdown_connections 2024-05-06T21:30:50.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.158+0000 7f1f5cf6a700 1 --2- 172.21.15.32:0/499112444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58103650 0x7f1f58105a30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.158+0000 7f1f5cf6a700 1 --2- 172.21.15.32:0/499112444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f58100d30 0x7f1f58103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.158+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/499112444 >> 172.21.15.32:0/499112444 conn(0x7f1f580fa6d0 msgr2=0x7f1f580fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:50.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.158+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/499112444 shutdown_connections 2024-05-06T21:30:50.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.158+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/499112444 wait complete. 2024-05-06T21:30:50.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.159+0000 7f1f5cf6a700 1 Processor -- start 2024-05-06T21:30:50.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.159+0000 7f1f5cf6a700 1 -- start start 2024-05-06T21:30:50.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.159+0000 7f1f5cf6a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58100d30 0x7f1f58100690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.159+0000 7f1f5cf6a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f58103650 0x7f1f580fece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.159+0000 7f1f5cf6a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580ff220 con 0x7f1f58100d30 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.159+0000 7f1f5cf6a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580ff360 con 0x7f1f58103650 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.159+0000 7f1f5659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58100d30 0x7f1f58100690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.159+0000 7f1f5659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58100d30 0x7f1f58100690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53382/0 (socket says 172.21.15.32:53382) 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.159+0000 7f1f5659c700 1 -- 172.21.15.32:0/1034434215 learned_addr learned my addr 172.21.15.32:0/1034434215 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f55d9b700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f58103650 0x7f1f580fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f5659c700 1 -- 172.21.15.32:0/1034434215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f58103650 msgr2=0x7f1f580fece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f5659c700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f58103650 0x7f1f580fece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f5659c700 1 -- 172.21.15.32:0/1034434215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0095f0 con 0x7f1f58100d30 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f55d9b700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f58103650 0x7f1f580fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:30:50.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f5659c700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58100d30 0x7f1f58100690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800d8d0 tx=0x7f1f4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:50.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f477fe700 1 -- 172.21.15.32:0/1034434215 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f48009940 con 0x7f1f58100d30 2024-05-06T21:30:50.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f477fe700 1 -- 172.21.15.32:0/1034434215 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1f48010460 con 0x7f1f58100d30 2024-05-06T21:30:50.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f477fe700 1 -- 172.21.15.32:0/1034434215 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f4800f5f0 con 0x7f1f58100d30 2024-05-06T21:30:50.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f580ff640 con 0x7f1f58100d30 2024-05-06T21:30:50.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.160+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5819db00 con 0x7f1f58100d30 2024-05-06T21:30:50.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.161+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5818fc60 con 0x7f1f58100d30 2024-05-06T21:30:50.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.162+0000 7f1f477fe700 1 -- 172.21.15.32:0/1034434215 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1f480105d0 con 0x7f1f58100d30 2024-05-06T21:30:50.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.162+0000 7f1f477fe700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1f4006e200 0x7f1f400706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:50.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.163+0000 7f1f477fe700 1 -- 172.21.15.32:0/1034434215 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f1f4808e250 con 0x7f1f58100d30 2024-05-06T21:30:50.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.163+0000 7f1f55d9b700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1f4006e200 0x7f1f400706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:50.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.163+0000 7f1f55d9b700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1f4006e200 0x7f1f400706b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c006010 tx=0x7f1f4c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:50.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.167+0000 7f1f477fe700 1 -- 172.21.15.32:0/1034434215 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f1f4805afa0 con 0x7f1f58100d30 2024-05-06T21:30:50.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.401+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f58061190 con 0x7f1f4006e200 2024-05-06T21:30:50.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.403+0000 7f1f477fe700 1 -- 172.21.15.32:0/1034434215 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1f58061190 con 0x7f1f4006e200 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1f4006e200 msgr2=0x7f1f400706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1f4006e200 0x7f1f400706b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c006010 tx=0x7f1f4c00b540 comp rx=0 tx=0).stop 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58100d30 msgr2=0x7f1f58100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58100d30 0x7f1f58100690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800d8d0 tx=0x7f1f4800dc90 comp rx=0 tx=0).stop 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 shutdown_connections 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1f4006e200 0x7f1f400706b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f58100d30 0x7f1f58100690 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 --2- 172.21.15.32:0/1034434215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f58103650 0x7f1f580fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 >> 172.21.15.32:0/1034434215 conn(0x7f1f580fa6d0 msgr2=0x7f1f580fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:50.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 shutdown_connections 2024-05-06T21:30:50.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.405+0000 7f1f5cf6a700 1 -- 172.21.15.32:0/1034434215 wait complete. 2024-05-06T21:30:50.414 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:30:50.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.514+0000 7f6357112700 1 -- 172.21.15.32:0/3377547992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 msgr2=0x7f6350101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.514+0000 7f6357112700 1 --2- 172.21.15.32:0/3377547992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 0x7f6350101890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f633c009910 tx=0x7f633c009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:50.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.514+0000 7f6357112700 1 -- 172.21.15.32:0/3377547992 shutdown_connections 2024-05-06T21:30:50.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.514+0000 7f6357112700 1 --2- 172.21.15.32:0/3377547992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 0x7f6350101890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.514+0000 7f6357112700 1 --2- 172.21.15.32:0/3377547992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6350100240 0x7f6350100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.514+0000 7f6357112700 1 -- 172.21.15.32:0/3377547992 >> 172.21.15.32:0/3377547992 conn(0x7f63500fb7f0 msgr2=0x7f63500fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.514+0000 7f6357112700 1 -- 172.21.15.32:0/3377547992 shutdown_connections 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.514+0000 7f6357112700 1 -- 172.21.15.32:0/3377547992 wait complete. 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f6357112700 1 Processor -- start 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f6357112700 1 -- start start 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f6357112700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6350100240 0x7f6350074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f6357112700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 0x7f6350073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f6357112700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6350073680 con 0x7f6350101440 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f6357112700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63500737c0 con 0x7f6350100240 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f634ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 0x7f6350073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f634ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 0x7f6350073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53400/0 (socket says 172.21.15.32:53400) 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f634ffff700 1 -- 172.21.15.32:0/2985577109 learned_addr learned my addr 172.21.15.32:0/2985577109 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f6354eae700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6350100240 0x7f6350074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:50.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f634ffff700 1 -- 172.21.15.32:0/2985577109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6350100240 msgr2=0x7f6350074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f634ffff700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6350100240 0x7f6350074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.515+0000 7f634ffff700 1 -- 172.21.15.32:0/2985577109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0095f0 con 0x7f6350101440 2024-05-06T21:30:50.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.516+0000 7f634ffff700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 0x7f6350073140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f633c005b40 tx=0x7f633c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:50.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.516+0000 7f634dffb700 1 -- 172.21.15.32:0/2985577109 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f633c01d070 con 0x7f6350101440 2024-05-06T21:30:50.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.516+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6350073a40 con 0x7f6350101440 2024-05-06T21:30:50.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.516+0000 7f634dffb700 1 -- 172.21.15.32:0/2985577109 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f633c022470 con 0x7f6350101440 2024-05-06T21:30:50.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.516+0000 7f634dffb700 1 -- 172.21.15.32:0/2985577109 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f633c00f690 con 0x7f6350101440 2024-05-06T21:30:50.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.516+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6350073f30 con 0x7f6350101440 2024-05-06T21:30:50.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.517+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6350108d90 con 0x7f6350101440 2024-05-06T21:30:50.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.518+0000 7f634dffb700 1 -- 172.21.15.32:0/2985577109 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f633c0225e0 con 0x7f6350101440 2024-05-06T21:30:50.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.518+0000 7f634dffb700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f634006e200 0x7f63400706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:50.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.518+0000 7f6354eae700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f634006e200 0x7f63400706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:50.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.518+0000 7f634dffb700 1 -- 172.21.15.32:0/2985577109 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f633c08fa40 con 0x7f6350101440 2024-05-06T21:30:50.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.519+0000 7f6354eae700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f634006e200 0x7f63400706b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6344005fd0 tx=0x7f6344005dd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:50.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.523+0000 7f634dffb700 1 -- 172.21.15.32:0/2985577109 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f633c05c810 con 0x7f6350101440 2024-05-06T21:30:50.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.758+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f635019df70 con 0x7f634006e200 2024-05-06T21:30:50.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.760+0000 7f634dffb700 1 -- 172.21.15.32:0/2985577109 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f635019df70 con 0x7f634006e200 2024-05-06T21:30:50.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f634006e200 msgr2=0x7f63400706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f634006e200 0x7f63400706b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6344005fd0 tx=0x7f6344005dd0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 msgr2=0x7f6350073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 0x7f6350073140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f633c005b40 tx=0x7f633c00be20 comp rx=0 tx=0).stop 2024-05-06T21:30:50.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 shutdown_connections 2024-05-06T21:30:50.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f634006e200 0x7f63400706b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6350100240 0x7f6350074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 --2- 172.21.15.32:0/2985577109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6350101440 0x7f6350073140 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 >> 172.21.15.32:0/2985577109 conn(0x7f63500fb7f0 msgr2=0x7f6350104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:50.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 shutdown_connections 2024-05-06T21:30:50.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.762+0000 7f6357112700 1 -- 172.21.15.32:0/2985577109 wait complete. 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.872+0000 7f2330642700 1 -- 172.21.15.32:0/1801489924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 msgr2=0x7f23280ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.872+0000 7f2330642700 1 --2- 172.21.15.32:0/1801489924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 0x7f23280ff540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f231c009910 tx=0x7f231c009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.872+0000 7f2330642700 1 -- 172.21.15.32:0/1801489924 shutdown_connections 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.872+0000 7f2330642700 1 --2- 172.21.15.32:0/1801489924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23281003d0 0x7f2328100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.872+0000 7f2330642700 1 --2- 172.21.15.32:0/1801489924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 0x7f23280ff540 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.872+0000 7f2330642700 1 -- 172.21.15.32:0/1801489924 >> 172.21.15.32:0/1801489924 conn(0x7f23280fa780 msgr2=0x7f23280fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.872+0000 7f2330642700 1 -- 172.21.15.32:0/1801489924 shutdown_connections 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.872+0000 7f2330642700 1 -- 172.21.15.32:0/1801489924 wait complete. 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.873+0000 7f2330642700 1 Processor -- start 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.873+0000 7f2330642700 1 -- start start 2024-05-06T21:30:50.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.873+0000 7f2330642700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 0x7f2328109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.873+0000 7f2330642700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23281003d0 0x7f2328107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.873+0000 7f2330642700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2328107ff0 con 0x7f23280ff130 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.873+0000 7f2330642700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2328108130 con 0x7f23281003d0 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.873+0000 7f232e3de700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 0x7f2328109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.873+0000 7f232e3de700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 0x7f2328109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53422/0 (socket says 172.21.15.32:53422) 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.873+0000 7f232e3de700 1 -- 172.21.15.32:0/404392558 learned_addr learned my addr 172.21.15.32:0/404392558 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f232dbdd700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23281003d0 0x7f2328107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f232e3de700 1 -- 172.21.15.32:0/404392558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23281003d0 msgr2=0x7f2328107ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f232e3de700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23281003d0 0x7f2328107ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f232e3de700 1 -- 172.21.15.32:0/404392558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0095f0 con 0x7f23280ff130 2024-05-06T21:30:50.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f232e3de700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 0x7f2328109460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f231c006010 tx=0x7f231c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f231b7fe700 1 -- 172.21.15.32:0/404392558 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231c01d070 con 0x7f23280ff130 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23281083b0 con 0x7f23280ff130 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f231b7fe700 1 -- 172.21.15.32:0/404392558 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f231c00f460 con 0x7f23280ff130 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f231b7fe700 1 -- 172.21.15.32:0/404392558 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231c021640 con 0x7f23280ff130 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.874+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23281088a0 con 0x7f23280ff130 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.875+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2328068860 con 0x7f23280ff130 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.876+0000 7f231b7fe700 1 -- 172.21.15.32:0/404392558 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f231c00fab0 con 0x7f23280ff130 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.876+0000 7f231b7fe700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f231406e200 0x7f23140706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.876+0000 7f231b7fe700 1 -- 172.21.15.32:0/404392558 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f231c08f6b0 con 0x7f23280ff130 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.876+0000 7f232dbdd700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f231406e200 0x7f23140706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:50.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.877+0000 7f232dbdd700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f231406e200 0x7f23140706b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2324005fd0 tx=0x7f232400a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:50.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:50.881+0000 7f231b7fe700 1 -- 172.21.15.32:0/404392558 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f231c05c400 con 0x7f23280ff130 2024-05-06T21:30:51.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.103+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f232819df30 con 0x7f231406e200 2024-05-06T21:30:51.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.115+0000 7f231b7fe700 1 -- 172.21.15.32:0/404392558 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f232819df30 con 0x7f231406e200 2024-05-06T21:30:51.113 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:30:51.113 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (11m) 19s ago 12m 24.2M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:30:51.113 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (12m) 19s ago 12m 8136k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:30:51.113 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (11m) 81s ago 11m 7772k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (91s) 19s ago 12m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (85s) 81s ago 11m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (10m) 19s ago 12m 85.1M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (6m) 19s ago 6m 15.4M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (6m) 19s ago 6m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (6m) 81s ago 6m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (6m) 81s ago 6m 16.7M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (3m) 19s ago 13m 503M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (3m) 81s ago 11m 449M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (2m) 19s ago 14m 44.8M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (2m) 81s ago 11m 35.3M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (12m) 19s ago 12m 16.4M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (11m) 81s ago 11m 17.1M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:30:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (63s) 19s ago 10m 129M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:30:51.115 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (25s) 19s ago 10m 15.0M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:30:51.115 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (9m) 19s ago 9m 204M 1217M 18.2.0 dc2bc1663786 194461702b20 2024-05-06T21:30:51.115 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (9m) 81s ago 9m 277M 2240M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:30:51.115 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (8m) 81s ago 8m 248M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:30:51.115 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (8m) 81s ago 8m 236M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:30:51.115 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (3m) 19s ago 12m 66.9M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f231406e200 msgr2=0x7f23140706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f231406e200 0x7f23140706b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2324005fd0 tx=0x7f232400a560 comp rx=0 tx=0).stop 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 msgr2=0x7f2328109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 0x7f2328109460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f231c006010 tx=0x7f231c00be20 comp rx=0 tx=0).stop 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 shutdown_connections 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f231406e200 0x7f23140706b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23280ff130 0x7f2328109460 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 --2- 172.21.15.32:0/404392558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23281003d0 0x7f2328107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 >> 172.21.15.32:0/404392558 conn(0x7f23280fa780 msgr2=0x7f23280fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 shutdown_connections 2024-05-06T21:30:51.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.117+0000 7f2330642700 1 -- 172.21.15.32:0/404392558 wait complete. 2024-05-06T21:30:51.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.227+0000 7fe774d3c700 1 -- 172.21.15.32:0/3902115401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 msgr2=0x7fe7701018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.227+0000 7fe774d3c700 1 --2- 172.21.15.32:0/3902115401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 0x7fe7701018a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe758009910 tx=0x7fe758009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:51.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.227+0000 7fe774d3c700 1 -- 172.21.15.32:0/3902115401 shutdown_connections 2024-05-06T21:30:51.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.227+0000 7fe774d3c700 1 --2- 172.21.15.32:0/3902115401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 0x7fe7701018a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.227+0000 7fe774d3c700 1 --2- 172.21.15.32:0/3902115401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe770100250 0x7fe770100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.227+0000 7fe774d3c700 1 -- 172.21.15.32:0/3902115401 >> 172.21.15.32:0/3902115401 conn(0x7fe7700fb7e0 msgr2=0x7fe7700fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:51.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.227+0000 7fe774d3c700 1 -- 172.21.15.32:0/3902115401 shutdown_connections 2024-05-06T21:30:51.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.227+0000 7fe774d3c700 1 -- 172.21.15.32:0/3902115401 wait complete. 2024-05-06T21:30:51.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe774d3c700 1 Processor -- start 2024-05-06T21:30:51.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe774d3c700 1 -- start start 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe774d3c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe770100250 0x7fe770195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe774d3c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 0x7fe770195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe774d3c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe770196600 con 0x7fe770101450 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe774d3c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe770196740 con 0x7fe770100250 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe76dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 0x7fe770195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe76dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 0x7fe770195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53426/0 (socket says 172.21.15.32:53426) 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe76dd9b700 1 -- 172.21.15.32:0/2799450315 learned_addr learned my addr 172.21.15.32:0/2799450315 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe76e59c700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe770100250 0x7fe770195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe76dd9b700 1 -- 172.21.15.32:0/2799450315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe770100250 msgr2=0x7fe770195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe76dd9b700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe770100250 0x7fe770195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.228+0000 7fe76dd9b700 1 -- 172.21.15.32:0/2799450315 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7580095f0 con 0x7fe770101450 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.229+0000 7fe76dd9b700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 0x7fe770195fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe758000c00 tx=0x7fe75800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:51.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.229+0000 7fe7677fe700 1 -- 172.21.15.32:0/2799450315 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe75801d070 con 0x7fe770101450 2024-05-06T21:30:51.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.229+0000 7fe7677fe700 1 -- 172.21.15.32:0/2799450315 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe758005dc0 con 0x7fe770101450 2024-05-06T21:30:51.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.229+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77019b190 con 0x7fe770101450 2024-05-06T21:30:51.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.229+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77019b680 con 0x7fe770101450 2024-05-06T21:30:51.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.229+0000 7fe7677fe700 1 -- 172.21.15.32:0/2799450315 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7580226a0 con 0x7fe770101450 2024-05-06T21:30:51.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.230+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe750005320 con 0x7fe770101450 2024-05-06T21:30:51.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.231+0000 7fe7677fe700 1 -- 172.21.15.32:0/2799450315 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe75800fba0 con 0x7fe770101450 2024-05-06T21:30:51.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.231+0000 7fe7677fe700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe75c06e200 0x7fe75c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:51.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.232+0000 7fe7677fe700 1 -- 172.21.15.32:0/2799450315 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fe75808f6b0 con 0x7fe770101450 2024-05-06T21:30:51.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.232+0000 7fe76e59c700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe75c06e200 0x7fe75c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:51.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.232+0000 7fe76e59c700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe75c06e200 0x7fe75c0706b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7701012b0 tx=0x7fe76000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:51.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.237+0000 7fe7677fe700 1 -- 172.21.15.32:0/2799450315 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe75805c480 con 0x7fe770101450 2024-05-06T21:30:51.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.545+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe750006200 con 0x7fe770101450 2024-05-06T21:30:51.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.546+0000 7fe7677fe700 1 -- 172.21.15.32:0/2799450315 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fe75805c010 con 0x7fe770101450 2024-05-06T21:30:51.544 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:30:51.544 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:30:51.545 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-05-06T21:30:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:30:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:30:51.546 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:30:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe75c06e200 msgr2=0x7fe75c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe75c06e200 0x7fe75c0706b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7701012b0 tx=0x7fe76000b040 comp rx=0 tx=0).stop 2024-05-06T21:30:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 msgr2=0x7fe770195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 0x7fe770195fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe758000c00 tx=0x7fe75800f740 comp rx=0 tx=0).stop 2024-05-06T21:30:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 shutdown_connections 2024-05-06T21:30:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe75c06e200 0x7fe75c0706b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe770100250 0x7fe770195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 --2- 172.21.15.32:0/2799450315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe770101450 0x7fe770195fe0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 >> 172.21.15.32:0/2799450315 conn(0x7fe7700fb7e0 msgr2=0x7fe770104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:51.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 shutdown_connections 2024-05-06T21:30:51.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.550+0000 7fe774d3c700 1 -- 172.21.15.32:0/2799450315 wait complete. 2024-05-06T21:30:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.667+0000 7f07086de700 1 -- 172.21.15.32:0/1741216200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700100240 msgr2=0x7f0700100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.667+0000 7f07086de700 1 --2- 172.21.15.32:0/1741216200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700100240 0x7f0700100650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06fc009910 tx=0x7f06fc009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:51.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.667+0000 7f07086de700 1 -- 172.21.15.32:0/1741216200 shutdown_connections 2024-05-06T21:30:51.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.667+0000 7f07086de700 1 --2- 172.21.15.32:0/1741216200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0700101440 0x7f0700101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.667+0000 7f07086de700 1 --2- 172.21.15.32:0/1741216200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700100240 0x7f0700100650 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.667+0000 7f07086de700 1 -- 172.21.15.32:0/1741216200 >> 172.21.15.32:0/1741216200 conn(0x7f07000fb7f0 msgr2=0x7f07000fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:51.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.667+0000 7f07086de700 1 -- 172.21.15.32:0/1741216200 shutdown_connections 2024-05-06T21:30:51.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.667+0000 7f07086de700 1 -- 172.21.15.32:0/1741216200 wait complete. 2024-05-06T21:30:51.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.668+0000 7f07086de700 1 Processor -- start 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.668+0000 7f07086de700 1 -- start start 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.668+0000 7f07086de700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0700100240 0x7f0700195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.668+0000 7f07086de700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700101440 0x7f0700196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.668+0000 7f07086de700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0700196630 con 0x7f0700101440 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.668+0000 7f07086de700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0700196770 con 0x7f0700100240 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.668+0000 7f0705c79700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700101440 0x7f0700196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.668+0000 7f0705c79700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700101440 0x7f0700196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36912/0 (socket says 172.21.15.32:36912) 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.668+0000 7f0705c79700 1 -- 172.21.15.32:0/3174263414 learned_addr learned my addr 172.21.15.32:0/3174263414 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f070647a700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0700100240 0x7f0700195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f0705c79700 1 -- 172.21.15.32:0/3174263414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0700100240 msgr2=0x7f0700195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f0705c79700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0700100240 0x7f0700195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f0705c79700 1 -- 172.21.15.32:0/3174263414 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0095f0 con 0x7f0700101440 2024-05-06T21:30:51.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f0705c79700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700101440 0x7f0700196010 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06f000d8d0 tx=0x7f06f000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:51.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f06f77fe700 1 -- 172.21.15.32:0/3174263414 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f00098a0 con 0x7f0700101440 2024-05-06T21:30:51.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f06f77fe700 1 -- 172.21.15.32:0/3174263414 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06f0010460 con 0x7f0700101440 2024-05-06T21:30:51.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f06f77fe700 1 -- 172.21.15.32:0/3174263414 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f000f5f0 con 0x7f0700101440 2024-05-06T21:30:51.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070019b220 con 0x7f0700101440 2024-05-06T21:30:51.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.669+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070019b770 con 0x7f0700101440 2024-05-06T21:30:51.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.671+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0700108d90 con 0x7f0700101440 2024-05-06T21:30:51.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.671+0000 7f06f77fe700 1 -- 172.21.15.32:0/3174263414 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f06f0009a00 con 0x7f0700101440 2024-05-06T21:30:51.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.672+0000 7f06f77fe700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06ec06e200 0x7f06ec0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:51.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.672+0000 7f06f77fe700 1 -- 172.21.15.32:0/3174263414 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f06f008e130 con 0x7f0700101440 2024-05-06T21:30:51.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.672+0000 7f070647a700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06ec06e200 0x7f06ec0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:51.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.672+0000 7f070647a700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06ec06e200 0x7f06ec0706b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06fc006010 tx=0x7f06fc00b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:51.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.677+0000 7f06f77fe700 1 -- 172.21.15.32:0/3174263414 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f06f005ae80 con 0x7f0700101440 2024-05-06T21:30:51.822 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: pgmap v99: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 24 objects/s recovering 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: Upgrade: osd.2 is safe to restart 2024-05-06T21:30:51.823 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:51 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2799450315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:51.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.949+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0700108f50 con 0x7f0700101440 2024-05-06T21:30:51.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.950+0000 7f06f77fe700 1 -- 172.21.15.32:0/3174263414 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f06f005aa10 con 0x7f0700101440 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:e20 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 20 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:27:07.836937+0000 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:30:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:30:51.950 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 0 members: 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:30:51.951 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:30:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06ec06e200 msgr2=0x7f06ec0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06ec06e200 0x7f06ec0706b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06fc006010 tx=0x7f06fc00b560 comp rx=0 tx=0).stop 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700101440 msgr2=0x7f0700196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700101440 0x7f0700196010 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06f000d8d0 tx=0x7f06f000dbe0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 shutdown_connections 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06ec06e200 0x7f06ec0706b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0700100240 0x7f0700195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 --2- 172.21.15.32:0/3174263414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0700101440 0x7f0700196010 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 >> 172.21.15.32:0/3174263414 conn(0x7f07000fb7f0 msgr2=0x7f0700104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 shutdown_connections 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:51.953+0000 7f07086de700 1 -- 172.21.15.32:0/3174263414 wait complete. 2024-05-06T21:30:51.953 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 20 2024-05-06T21:30:52.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.073+0000 7ff6e788a700 1 -- 172.21.15.32:0/3708772847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 msgr2=0x7ff6e00ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:52.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.073+0000 7ff6e788a700 1 --2- 172.21.15.32:0/3708772847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 0x7ff6e00ff550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009910 tx=0x7ff6dc009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:52.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.073+0000 7ff6e788a700 1 -- 172.21.15.32:0/3708772847 shutdown_connections 2024-05-06T21:30:52.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.073+0000 7ff6e788a700 1 --2- 172.21.15.32:0/3708772847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6e0100340 0x7ff6e0100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.073+0000 7ff6e788a700 1 --2- 172.21.15.32:0/3708772847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 0x7ff6e00ff550 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.073+0000 7ff6e788a700 1 -- 172.21.15.32:0/3708772847 >> 172.21.15.32:0/3708772847 conn(0x7ff6e00fa6d0 msgr2=0x7ff6e00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:52.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.073+0000 7ff6e788a700 1 -- 172.21.15.32:0/3708772847 shutdown_connections 2024-05-06T21:30:52.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.073+0000 7ff6e788a700 1 -- 172.21.15.32:0/3708772847 wait complete. 2024-05-06T21:30:52.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e788a700 1 Processor -- start 2024-05-06T21:30:52.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e788a700 1 -- start start 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e788a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 0x7ff6e0195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e788a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6e0100340 0x7ff6e0196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e788a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0196630 con 0x7ff6e00ff140 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e788a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0196770 con 0x7ff6e0100340 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e5626700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 0x7ff6e0195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e5626700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 0x7ff6e0195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36936/0 (socket says 172.21.15.32:36936) 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e5626700 1 -- 172.21.15.32:0/1586581774 learned_addr learned my addr 172.21.15.32:0/1586581774 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.074+0000 7ff6e4e25700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6e0100340 0x7ff6e0196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.075+0000 7ff6e5626700 1 -- 172.21.15.32:0/1586581774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6e0100340 msgr2=0x7ff6e0196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.075+0000 7ff6e5626700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6e0100340 0x7ff6e0196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.075+0000 7ff6e5626700 1 -- 172.21.15.32:0/1586581774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc0095f0 con 0x7ff6e00ff140 2024-05-06T21:30:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.075+0000 7ff6e5626700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 0x7ff6e0195ad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000c00 tx=0x7ff6dc00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:52.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.075+0000 7ff6d67fc700 1 -- 172.21.15.32:0/1586581774 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6dc01d070 con 0x7ff6e00ff140 2024-05-06T21:30:52.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.075+0000 7ff6d67fc700 1 -- 172.21.15.32:0/1586581774 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff6dc005dc0 con 0x7ff6e00ff140 2024-05-06T21:30:52.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.075+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e019b1c0 con 0x7ff6e00ff140 2024-05-06T21:30:52.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.075+0000 7ff6d67fc700 1 -- 172.21.15.32:0/1586581774 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6dc0226a0 con 0x7ff6e00ff140 2024-05-06T21:30:52.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.075+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e019b6b0 con 0x7ff6e00ff140 2024-05-06T21:30:52.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.076+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e0107cb0 con 0x7ff6e00ff140 2024-05-06T21:30:52.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.077+0000 7ff6d67fc700 1 -- 172.21.15.32:0/1586581774 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff6dc003910 con 0x7ff6e00ff140 2024-05-06T21:30:52.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.077+0000 7ff6d67fc700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff6cc06e200 0x7ff6cc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:52.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.077+0000 7ff6d67fc700 1 -- 172.21.15.32:0/1586581774 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6769+0+0 (secure 0 0 0) 0x7ff6dc08f770 con 0x7ff6e00ff140 2024-05-06T21:30:52.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.077+0000 7ff6e4e25700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff6cc06e200 0x7ff6cc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:52.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.078+0000 7ff6e4e25700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff6cc06e200 0x7ff6cc0706b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009bf0 tx=0x7ff6d0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:52.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.082+0000 7ff6d67fc700 1 -- 172.21.15.32:0/1586581774 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff6dc05c540 con 0x7ff6e00ff140 2024-05-06T21:30:52.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: pgmap v99: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 24 objects/s recovering 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: Upgrade: osd.2 is safe to restart 2024-05-06T21:30:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:51 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2799450315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:30:52.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.321+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6e0069540 con 0x7ff6cc06e200 2024-05-06T21:30:52.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.322+0000 7ff6d67fc700 1 -- 172.21.15.32:0/1586581774 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff6e0069540 con 0x7ff6cc06e200 2024-05-06T21:30:52.320 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "8/23 daemons upgraded", 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:30:52.321 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.324+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff6cc06e200 msgr2=0x7ff6cc0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.324+0000 7ff6e788a700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff6cc06e200 0x7ff6cc0706b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009bf0 tx=0x7ff6d0009260 comp rx=0 tx=0).stop 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.324+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 msgr2=0x7ff6e0195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.324+0000 7ff6e788a700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 0x7ff6e0195ad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000c00 tx=0x7ff6dc00f740 comp rx=0 tx=0).stop 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.325+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 shutdown_connections 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.325+0000 7ff6e788a700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff6cc06e200 0x7ff6cc0706b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.325+0000 7ff6e788a700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6e00ff140 0x7ff6e0195ad0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.325+0000 7ff6e788a700 1 --2- 172.21.15.32:0/1586581774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6e0100340 0x7ff6e0196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.325+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 >> 172.21.15.32:0/1586581774 conn(0x7ff6e00fa6d0 msgr2=0x7ff6e0068e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:52.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.325+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 shutdown_connections 2024-05-06T21:30:52.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.325+0000 7ff6e788a700 1 -- 172.21.15.32:0/1586581774 wait complete. 2024-05-06T21:30:52.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2364163552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 msgr2=0x7fa4d00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:52.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 --2- 172.21.15.32:0/2364163552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 0x7fa4d00ff540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009910 tx=0x7fa4c4009c20 comp rx=0 tx=0).stop 2024-05-06T21:30:52.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2364163552 shutdown_connections 2024-05-06T21:30:52.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 --2- 172.21.15.32:0/2364163552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d01003d0 0x7fa4d0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 --2- 172.21.15.32:0/2364163552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 0x7fa4d00ff540 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2364163552 >> 172.21.15.32:0/2364163552 conn(0x7fa4d00fa780 msgr2=0x7fa4d00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:52.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2364163552 shutdown_connections 2024-05-06T21:30:52.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2364163552 wait complete. 2024-05-06T21:30:52.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 Processor -- start 2024-05-06T21:30:52.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.434+0000 7fa4d6a9b700 1 -- start start 2024-05-06T21:30:52.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d6a9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 0x7fa4d01949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d6a9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d01003d0 0x7fa4d0194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d6a9b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0195480 con 0x7fa4d00ff130 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d6a9b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01955c0 con 0x7fa4d01003d0 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d4837700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 0x7fa4d01949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d4837700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 0x7fa4d01949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36964/0 (socket says 172.21.15.32:36964) 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d4837700 1 -- 172.21.15.32:0/2403153708 learned_addr learned my addr 172.21.15.32:0/2403153708 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4cffff700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d01003d0 0x7fa4d0194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d4837700 1 -- 172.21.15.32:0/2403153708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d01003d0 msgr2=0x7fa4d0194ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d4837700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d01003d0 0x7fa4d0194ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d4837700 1 -- 172.21.15.32:0/2403153708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40095f0 con 0x7fa4d00ff130 2024-05-06T21:30:52.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d4837700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 0x7fa4d01949b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4005b40 tx=0x7fa4c400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:52.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4cdffb700 1 -- 172.21.15.32:0/2403153708 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c401f070 con 0x7fa4d00ff130 2024-05-06T21:30:52.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d0068540 con 0x7fa4d00ff130 2024-05-06T21:30:52.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4cdffb700 1 -- 172.21.15.32:0/2403153708 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4c4019610 con 0x7fa4d00ff130 2024-05-06T21:30:52.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.435+0000 7fa4cdffb700 1 -- 172.21.15.32:0/2403153708 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c40247c0 con 0x7fa4d00ff130 2024-05-06T21:30:52.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.436+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d0068a00 con 0x7fa4d00ff130 2024-05-06T21:30:52.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.437+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d0107c10 con 0x7fa4d00ff130 2024-05-06T21:30:52.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.437+0000 7fa4cdffb700 1 -- 172.21.15.32:0/2403153708 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa4c4019780 con 0x7fa4d00ff130 2024-05-06T21:30:52.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.438+0000 7fa4cdffb700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa4c006e200 0x7fa4c00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:30:52.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.438+0000 7fa4cdffb700 1 -- 172.21.15.32:0/2403153708 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fa4c4091c90 con 0x7fa4d00ff130 2024-05-06T21:30:52.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.438+0000 7fa4cffff700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa4c006e200 0x7fa4c00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:30:52.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.438+0000 7fa4cffff700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa4c006e200 0x7fa4c00706b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc005ea0 tx=0x7fa4bc005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:30:52.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.442+0000 7fa4cdffb700 1 -- 172.21.15.32:0/2403153708 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa4c405e9e0 con 0x7fa4d00ff130 2024-05-06T21:30:52.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.746+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa4d0107e00 con 0x7fa4d00ff130 2024-05-06T21:30:52.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.746+0000 7fa4cdffb700 1 -- 172.21.15.32:0/2403153708 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa4c405e570 con 0x7fa4d00ff130 2024-05-06T21:30:52.745 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa4c006e200 msgr2=0x7fa4c00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa4c006e200 0x7fa4c00706b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc005ea0 tx=0x7fa4bc005e30 comp rx=0 tx=0).stop 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 msgr2=0x7fa4d01949b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 0x7fa4d01949b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4005b40 tx=0x7fa4c400be20 comp rx=0 tx=0).stop 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 shutdown_connections 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa4c006e200 0x7fa4c00706b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00ff130 0x7fa4d01949b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 --2- 172.21.15.32:0/2403153708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d01003d0 0x7fa4d0194ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 >> 172.21.15.32:0/2403153708 conn(0x7fa4d00fa780 msgr2=0x7fa4d0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 shutdown_connections 2024-05-06T21:30:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:30:52.748+0000 7fa4d6a9b700 1 -- 172.21.15.32:0/2403153708 wait complete. 2024-05-06T21:30:52.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:52 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3174263414' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:30:53.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:52 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3174263414' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:30:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:53 smithi032 ceph-mon[76650]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:53 smithi032 ceph-mon[76650]: pgmap v100: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 24 objects/s recovering 2024-05-06T21:30:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:53 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2403153708' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:30:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:53 smithi032 ceph-mon[76650]: Upgrade: Updating osd.2 2024-05-06T21:30:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T21:30:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:30:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:53 smithi032 ceph-mon[76650]: Deploying daemon osd.2 on smithi032 2024-05-06T21:30:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:53 smithi154 ceph-mon[63622]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:30:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:53 smithi154 ceph-mon[63622]: pgmap v100: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 24 objects/s recovering 2024-05-06T21:30:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:53 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2403153708' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:30:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:53 smithi154 ceph-mon[63622]: Upgrade: Updating osd.2 2024-05-06T21:30:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:30:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T21:30:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:30:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:53 smithi154 ceph-mon[63622]: Deploying daemon osd.2 on smithi032 2024-05-06T21:30:55.957 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:55 smithi032 ceph-mon[76650]: pgmap v101: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:56.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:55 smithi154 ceph-mon[63622]: pgmap v101: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:56.613 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:56 smithi032 systemd[1]: Stopping Ceph osd.2 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:30:56.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:56 smithi032 ceph-mon[76650]: osd.2 marked itself down and dead 2024-05-06T21:30:56.971 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:56 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[53260]: 2024-05-06T21:30:56.614+0000 7f4730577700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:30:56.971 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:56 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[53260]: 2024-05-06T21:30:56.614+0000 7f4730577700 -1 osd.2 71 *** Got signal Terminated *** 2024-05-06T21:30:56.971 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:56 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[53260]: 2024-05-06T21:30:56.614+0000 7f4730577700 -1 osd.2 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:30:57.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:56 smithi154 ceph-mon[63622]: osd.2 marked itself down and dead 2024-05-06T21:30:57.412 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:57 smithi032 podman[89340]: 2024-05-06 21:30:57.1349946 +0000 UTC m=+0.631442349 container died 194461702b206dda980bf31f5e6bc7d37183cf7e8be712df2ce48845ba6c7921 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-06T21:30:57.688 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:57 smithi032 podman[89340]: 2024-05-06 21:30:57.514379821 +0000 UTC m=+1.010827568 container cleanup 194461702b206dda980bf31f5e6bc7d37183cf7e8be712df2ce48845ba6c7921 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-06T21:30:57.688 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:57 smithi032 bash[89340]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2 2024-05-06T21:30:57.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:57 smithi032 ceph-mon[76650]: pgmap v102: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:57.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:57 smithi032 ceph-mon[76650]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:30:57.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:57 smithi032 ceph-mon[76650]: osdmap e72: 6 total, 5 up, 6 in 2024-05-06T21:30:57.971 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:57 smithi032 podman[89358]: 2024-05-06 21:30:57.81655182 +0000 UTC m=+0.675466712 container remove 194461702b206dda980bf31f5e6bc7d37183cf7e8be712df2ce48845ba6c7921 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-06T21:30:58.016 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:57 smithi154 ceph-mon[63622]: pgmap v102: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:58.017 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:57 smithi154 ceph-mon[63622]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:30:58.017 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:57 smithi154 ceph-mon[63622]: osdmap e72: 6 total, 5 up, 6 in 2024-05-06T21:30:58.459 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:58 smithi032 podman[89448]: 2024-05-06 21:30:58.037597809 +0000 UTC m=+0.018891225 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:30:58.459 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:58 smithi032 podman[89448]: 2024-05-06 21:30:58.167594227 +0000 UTC m=+0.148887672 container create c4c31e1715d8c7895426eae1649c53e0b8d15470831bd838735990ca0abcc544 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:30:58.459 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:58 smithi032 podman[89448]: 2024-05-06 21:30:58.378386423 +0000 UTC m=+0.359679831 container init c4c31e1715d8c7895426eae1649c53e0b8d15470831bd838735990ca0abcc544 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-06T21:30:58.459 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:58 smithi032 podman[89448]: 2024-05-06 21:30:58.382039406 +0000 UTC m=+0.363332810 container start c4c31e1715d8c7895426eae1649c53e0b8d15470831bd838735990ca0abcc544 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-06T21:30:58.459 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:58 smithi032 podman[89448]: 2024-05-06 21:30:58.46169916 +0000 UTC m=+0.442992559 container attach c4c31e1715d8c7895426eae1649c53e0b8d15470831bd838735990ca0abcc544 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux ) 2024-05-06T21:30:58.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:58 smithi032 ceph-mon[76650]: osdmap e73: 6 total, 5 up, 6 in 2024-05-06T21:30:58.721 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:58 smithi032 podman[89448]: 2024-05-06 21:30:58.690317131 +0000 UTC m=+0.671610539 container died c4c31e1715d8c7895426eae1649c53e0b8d15470831bd838735990ca0abcc544 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-05-06T21:30:59.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:58 smithi154 ceph-mon[63622]: osdmap e73: 6 total, 5 up, 6 in 2024-05-06T21:30:59.471 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:59 smithi032 podman[89474]: 2024-05-06 21:30:59.332817475 +0000 UTC m=+0.636775945 container remove c4c31e1715d8c7895426eae1649c53e0b8d15470831bd838735990ca0abcc544 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-06T21:30:59.471 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:59 smithi032 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.2.service: Deactivated successfully. 2024-05-06T21:30:59.471 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:59 smithi032 systemd[1]: Stopped Ceph osd.2 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:30:59.471 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:59 smithi032 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.2.service: Consumed 53.183s CPU time. 2024-05-06T21:30:59.848 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:59 smithi032 ceph-mon[76650]: pgmap v105: 65 pgs: 11 peering, 5 stale+active+clean, 49 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:30:59.848 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:30:59 smithi032 ceph-mon[76650]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-05-06T21:30:59.848 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:59 smithi032 systemd[1]: Starting Ceph osd.2 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:30:59.848 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:59 smithi032 podman[89576]: 2024-05-06 21:30:59.710528853 +0000 UTC m=+0.019012354 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:30:59.848 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:30:59 smithi032 podman[89576]: 2024-05-06 21:30:59.85055655 +0000 UTC m=+0.159040031 container create af9565d56478607ca81bee4d64c329bf6656b3ee0832ccdaa701171c85363476 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-06T21:31:00.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:59 smithi154 ceph-mon[63622]: pgmap v105: 65 pgs: 11 peering, 5 stale+active+clean, 49 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:00.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:30:59 smithi154 ceph-mon[63622]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-05-06T21:31:00.471 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 podman[89576]: 2024-05-06 21:31:00.10339246 +0000 UTC m=+0.411875943 container init af9565d56478607ca81bee4d64c329bf6656b3ee0832ccdaa701171c85363476 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, ceph=True, io.buildah.version=1.33.5) 2024-05-06T21:31:00.471 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 podman[89576]: 2024-05-06 21:31:00.106887584 +0000 UTC m=+0.415371071 container start af9565d56478607ca81bee4d64c329bf6656b3ee0832ccdaa701171c85363476 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-06T21:31:00.471 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 podman[89576]: 2024-05-06 21:31:00.186529096 +0000 UTC m=+0.495012599 container attach af9565d56478607ca81bee4d64c329bf6656b3ee0832ccdaa701171c85363476 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-05-06T21:31:00.937 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:00 smithi032 ceph-mon[76650]: Health check failed: Degraded data redundancy: 11/366 objects degraded (3.005%), 3 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:00.938 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate[89591]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-06T21:31:00.938 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate[89591]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T21:31:00.938 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 bash[89576]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-06T21:31:00.938 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 bash[89576]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T21:31:00.938 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 bash[89576]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T21:31:00.938 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 bash[89576]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T21:31:00.938 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 bash[89576]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-05-06T21:31:00.938 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 bash[89576]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-06T21:31:00.938 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 bash[89576]: --> ceph-volume raw activate successful for osd ID: 2 2024-05-06T21:31:00.939 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate[89591]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T21:31:00.939 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate[89591]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T21:31:00.939 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate[89591]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-05-06T21:31:00.939 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate[89591]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-06T21:31:00.939 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate[89591]: --> ceph-volume raw activate successful for osd ID: 2 2024-05-06T21:31:00.939 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:00 smithi032 podman[89576]: 2024-05-06 21:31:00.597881849 +0000 UTC m=+0.906365323 container died af9565d56478607ca81bee4d64c329bf6656b3ee0832ccdaa701171c85363476 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:31:01.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:00 smithi154 ceph-mon[63622]: Health check failed: Degraded data redundancy: 11/366 objects degraded (3.005%), 3 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:01.627 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:01 smithi032 podman[89714]: 2024-05-06 21:31:01.274648861 +0000 UTC m=+0.671170391 container remove af9565d56478607ca81bee4d64c329bf6656b3ee0832ccdaa701171c85363476 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-activate, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-06T21:31:01.627 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:01 smithi032 podman[89778]: 2024-05-06 21:31:01.403305025 +0000 UTC m=+0.018916021 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:31:01.627 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:01 smithi032 podman[89778]: 2024-05-06 21:31:01.517579049 +0000 UTC m=+0.133190026 container create 96de1dd57d1352f18c368217cef96190e99b5011e56a9eedc610bd8435aaf5f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=) 2024-05-06T21:31:02.055 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:01 smithi032 ceph-mon[76650]: pgmap v106: 65 pgs: 4 active+undersized, 3 active+undersized+degraded, 11 peering, 2 stale+active+clean, 45 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 11/366 objects degraded (3.005%) 2024-05-06T21:31:02.055 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:01 smithi032 podman[89778]: 2024-05-06 21:31:01.770228389 +0000 UTC m=+0.385839378 container init 96de1dd57d1352f18c368217cef96190e99b5011e56a9eedc610bd8435aaf5f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True) 2024-05-06T21:31:02.055 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:01 smithi032 podman[89778]: 2024-05-06 21:31:01.774242579 +0000 UTC m=+0.389853556 container start 96de1dd57d1352f18c368217cef96190e99b5011e56a9eedc610bd8435aaf5f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:31:02.055 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:01 smithi032 ceph-osd[89797]: -- 172.21.15.32:0/179302223 <== mon.0 v2:172.21.15.32:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625cd509680 con 0x5625cd4d2c00 2024-05-06T21:31:02.055 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:01 smithi032 bash[89778]: 96de1dd57d1352f18c368217cef96190e99b5011e56a9eedc610bd8435aaf5f7 2024-05-06T21:31:02.055 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:01 smithi032 systemd[1]: Started Ceph osd.2 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:31:02.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:01 smithi154 ceph-mon[63622]: pgmap v106: 65 pgs: 4 active+undersized, 3 active+undersized+degraded, 11 peering, 2 stale+active+clean, 45 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 11/366 objects degraded (3.005%) 2024-05-06T21:31:02.721 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:02 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[89793]: 2024-05-06T21:31:02.315+0000 7f9b5875d7c0 -1 Falling back to public interface 2024-05-06T21:31:03.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:03.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:03.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:31:03.303 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:03.303 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:03.303 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:31:04.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:03 smithi032 ceph-mon[76650]: pgmap v107: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:04.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:03 smithi032 ceph-mon[76650]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2024-05-06T21:31:04.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:03 smithi032 ceph-mon[76650]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:31:04.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:03 smithi154 ceph-mon[63622]: pgmap v107: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:04.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:03 smithi154 ceph-mon[63622]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2024-05-06T21:31:04.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:03 smithi154 ceph-mon[63622]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:31:05.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:05 smithi032 ceph-mon[76650]: pgmap v108: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:05.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:05.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:31:06.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:05 smithi154 ceph-mon[63622]: pgmap v108: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:06.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:06.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:31:06.470 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:06 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[89793]: 2024-05-06T21:31:06.269+0000 7f9b5875d7c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-05-06T21:31:06.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:06 smithi032 ceph-mon[76650]: from='osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T21:31:06.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:06 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 56/366 objects degraded (15.301%), 16 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:06.971 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:06 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[89793]: 2024-05-06T21:31:06.719+0000 7f9b5875d7c0 -1 osd.2 71 log_to_monitors true 2024-05-06T21:31:07.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:06 smithi154 ceph-mon[63622]: from='osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T21:31:07.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:06 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 56/366 objects degraded (15.301%), 16 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:07.970 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:31:07 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[89793]: 2024-05-06T21:31:07.714+0000 7f9b45bac700 -1 osd.2 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:31:07.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:07 smithi032 ceph-mon[76650]: pgmap v109: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:07.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:07 smithi032 ceph-mon[76650]: from='osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T21:31:07.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:07 smithi032 ceph-mon[76650]: osdmap e74: 6 total, 5 up, 6 in 2024-05-06T21:31:07.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:07 smithi032 ceph-mon[76650]: from='osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:31:07.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:07 smithi032 ceph-mon[76650]: from='osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767]' entity='osd.2' 2024-05-06T21:31:07.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:07 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:07.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:07 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:08.350 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:07 smithi154 ceph-mon[63622]: pgmap v109: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:08.350 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:07 smithi154 ceph-mon[63622]: from='osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T21:31:08.350 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:07 smithi154 ceph-mon[63622]: osdmap e74: 6 total, 5 up, 6 in 2024-05-06T21:31:08.350 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:07 smithi154 ceph-mon[63622]: from='osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2024-05-06T21:31:08.350 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:07 smithi154 ceph-mon[63622]: from='osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767]' entity='osd.2' 2024-05-06T21:31:08.350 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:07 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:08.350 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:07 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:09.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:08 smithi032 ceph-mon[76650]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:31:09.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:08 smithi032 ceph-mon[76650]: osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767] boot 2024-05-06T21:31:09.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:08 smithi032 ceph-mon[76650]: osdmap e75: 6 total, 6 up, 6 in 2024-05-06T21:31:09.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:08 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:31:09.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:08 smithi154 ceph-mon[63622]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:31:09.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:08 smithi154 ceph-mon[63622]: osd.2 [v2:172.21.15.32:6818/3106482767,v1:172.21.15.32:6819/3106482767] boot 2024-05-06T21:31:09.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:08 smithi154 ceph-mon[63622]: osdmap e75: 6 total, 6 up, 6 in 2024-05-06T21:31:09.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:08 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T21:31:10.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:09 smithi032 ceph-mon[76650]: pgmap v111: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:10.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:10.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:10.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:09 smithi032 ceph-mon[76650]: osdmap e76: 6 total, 6 up, 6 in 2024-05-06T21:31:10.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:09 smithi154 ceph-mon[63622]: pgmap v111: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:10.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:10.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:10.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:09 smithi154 ceph-mon[63622]: osdmap e76: 6 total, 6 up, 6 in 2024-05-06T21:31:12.168 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:11 smithi032 ceph-mon[76650]: pgmap v114: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:12.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:11 smithi154 ceph-mon[63622]: pgmap v114: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2024-05-06T21:31:13.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:13.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:13.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:31:13.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:31:13.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:13.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: pgmap v115: 65 pgs: 3 active+undersized, 1 active+undersized+degraded, 61 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6/366 objects degraded (1.639%); 4.0 MiB/s, 0 objects/s recovering 2024-05-06T21:31:13.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:31:13.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:13.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:13.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:13.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T21:31:13.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T21:31:13.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-05-06T21:31:13.722 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:13 smithi032 ceph-mon[76650]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: pgmap v115: 65 pgs: 3 active+undersized, 1 active+undersized+degraded, 61 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6/366 objects degraded (1.639%); 4.0 MiB/s, 0 objects/s recovering 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:13.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T21:31:13.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T21:31:13.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-05-06T21:31:13.867 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:13 smithi154 ceph-mon[63622]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:31:14.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:14 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 6/366 objects degraded (1.639%), 1 pg degraded (PG_DEGRADED) 2024-05-06T21:31:14.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:14 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 6/366 objects degraded (1.639%), 1 pg degraded (PG_DEGRADED) 2024-05-06T21:31:15.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:15 smithi154 ceph-mon[63622]: pgmap v116: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s, 0 objects/s recovering 2024-05-06T21:31:15.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:15 smithi032 ceph-mon[76650]: pgmap v116: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s, 0 objects/s recovering 2024-05-06T21:31:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:16 smithi154 ceph-mon[63622]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/366 objects degraded (1.639%), 1 pg degraded) 2024-05-06T21:31:16.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:16 smithi154 ceph-mon[63622]: Cluster is now healthy 2024-05-06T21:31:16.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:16 smithi032 ceph-mon[76650]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/366 objects degraded (1.639%), 1 pg degraded) 2024-05-06T21:31:16.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:16 smithi032 ceph-mon[76650]: Cluster is now healthy 2024-05-06T21:31:17.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:17 smithi154 ceph-mon[63622]: pgmap v117: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s, 0 objects/s recovering 2024-05-06T21:31:17.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:17 smithi032 ceph-mon[76650]: pgmap v117: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s, 0 objects/s recovering 2024-05-06T21:31:19.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:19 smithi032 ceph-mon[76650]: pgmap v118: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s, 0 objects/s recovering 2024-05-06T21:31:20.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:19 smithi154 ceph-mon[63622]: pgmap v118: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s, 0 objects/s recovering 2024-05-06T21:31:21.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:21 smithi032 ceph-mon[76650]: pgmap v119: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s, 0 objects/s recovering 2024-05-06T21:31:21.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:21.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:31:21.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:22.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:21 smithi154 ceph-mon[63622]: pgmap v119: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s, 0 objects/s recovering 2024-05-06T21:31:22.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:22.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:31:22.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:22.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.873+0000 7fab219e7700 1 -- 172.21.15.32:0/1761752669 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c1014e0 msgr2=0x7fab1c101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:22.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.873+0000 7fab219e7700 1 --2- 172.21.15.32:0/1761752669 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c1014e0 0x7fab1c101950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab04009910 tx=0x7fab04009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.873+0000 7fab219e7700 1 -- 172.21.15.32:0/1761752669 shutdown_connections 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.873+0000 7fab219e7700 1 --2- 172.21.15.32:0/1761752669 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c1014e0 0x7fab1c101950 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.873+0000 7fab219e7700 1 --2- 172.21.15.32:0/1761752669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab1c100240 0x7fab1c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.873+0000 7fab219e7700 1 -- 172.21.15.32:0/1761752669 >> 172.21.15.32:0/1761752669 conn(0x7fab1c0fb890 msgr2=0x7fab1c0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.873+0000 7fab219e7700 1 -- 172.21.15.32:0/1761752669 shutdown_connections 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.873+0000 7fab219e7700 1 -- 172.21.15.32:0/1761752669 wait complete. 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab219e7700 1 Processor -- start 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab219e7700 1 -- start start 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab219e7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c100240 0x7fab1c197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab219e7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab1c1014e0 0x7fab1c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab219e7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c1987d0 con 0x7fab1c100240 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab219e7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c198940 con 0x7fab1c1014e0 2024-05-06T21:31:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab1affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c100240 0x7fab1c197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab1affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c100240 0x7fab1c197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40734/0 (socket says 172.21.15.32:40734) 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab1affd700 1 -- 172.21.15.32:0/3814030145 learned_addr learned my addr 172.21.15.32:0/3814030145 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.874+0000 7fab127fc700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab1c1014e0 0x7fab1c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.875+0000 7fab1affd700 1 -- 172.21.15.32:0/3814030145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab1c1014e0 msgr2=0x7fab1c1981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.875+0000 7fab1affd700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab1c1014e0 0x7fab1c1981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.875+0000 7fab1affd700 1 -- 172.21.15.32:0/3814030145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040095f0 con 0x7fab1c100240 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.875+0000 7fab1affd700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c100240 0x7fab1c197c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0060b0 tx=0x7fab0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.875+0000 7fab209e5700 1 -- 172.21.15.32:0/3814030145 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab0c00dda0 con 0x7fab1c100240 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.875+0000 7fab209e5700 1 -- 172.21.15.32:0/3814030145 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab0c00f040 con 0x7fab1c100240 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.875+0000 7fab209e5700 1 -- 172.21.15.32:0/3814030145 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab0c014790 con 0x7fab1c100240 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.875+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c19d3d0 con 0x7fab1c100240 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.875+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c19d920 con 0x7fab1c100240 2024-05-06T21:31:22.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.876+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c1055c0 con 0x7fab1c100240 2024-05-06T21:31:22.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.877+0000 7fab209e5700 1 -- 172.21.15.32:0/3814030145 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fab0c0148f0 con 0x7fab1c100240 2024-05-06T21:31:22.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.877+0000 7fab209e5700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab0806e200 0x7fab080706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:22.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.877+0000 7fab209e5700 1 -- 172.21.15.32:0/3814030145 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fab0c08dc00 con 0x7fab1c100240 2024-05-06T21:31:22.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.877+0000 7fab127fc700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab0806e200 0x7fab080706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:22.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.878+0000 7fab127fc700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab0806e200 0x7fab080706b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab1c1991a0 tx=0x7fab04005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:22.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:22.882+0000 7fab209e5700 1 -- 172.21.15.32:0/3814030145 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fab0c093020 con 0x7fab1c100240 2024-05-06T21:31:23.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.114+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab1c061190 con 0x7fab0806e200 2024-05-06T21:31:23.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.115+0000 7fab209e5700 1 -- 172.21.15.32:0/3814030145 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fab1c061190 con 0x7fab0806e200 2024-05-06T21:31:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab0806e200 msgr2=0x7fab080706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab0806e200 0x7fab080706b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab1c1991a0 tx=0x7fab04005a90 comp rx=0 tx=0).stop 2024-05-06T21:31:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c100240 msgr2=0x7fab1c197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c100240 0x7fab1c197c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0060b0 tx=0x7fab0c00d3b0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 shutdown_connections 2024-05-06T21:31:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab0806e200 0x7fab080706b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c100240 0x7fab1c197c90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 --2- 172.21.15.32:0/3814030145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab1c1014e0 0x7fab1c1981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 >> 172.21.15.32:0/3814030145 conn(0x7fab1c0fb890 msgr2=0x7fab1c102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:23.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 shutdown_connections 2024-05-06T21:31:23.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.119+0000 7fab219e7700 1 -- 172.21.15.32:0/3814030145 wait complete. 2024-05-06T21:31:23.128 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:31:23.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.232+0000 7f8a7e16c700 1 -- 172.21.15.32:0/2716092920 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a780ff140 msgr2=0x7f8a780ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.232+0000 7f8a7e16c700 1 --2- 172.21.15.32:0/2716092920 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a780ff140 0x7f8a780ff550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009910 tx=0x7f8a68009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:23.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.232+0000 7f8a7e16c700 1 -- 172.21.15.32:0/2716092920 shutdown_connections 2024-05-06T21:31:23.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.232+0000 7f8a7e16c700 1 --2- 172.21.15.32:0/2716092920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a78100340 0x7f8a78100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.232+0000 7f8a7e16c700 1 --2- 172.21.15.32:0/2716092920 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a780ff140 0x7f8a780ff550 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.232+0000 7f8a7e16c700 1 -- 172.21.15.32:0/2716092920 >> 172.21.15.32:0/2716092920 conn(0x7f8a780fa6d0 msgr2=0x7f8a780fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.232+0000 7f8a7e16c700 1 -- 172.21.15.32:0/2716092920 shutdown_connections 2024-05-06T21:31:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.232+0000 7f8a7e16c700 1 -- 172.21.15.32:0/2716092920 wait complete. 2024-05-06T21:31:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.232+0000 7f8a7e16c700 1 Processor -- start 2024-05-06T21:31:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a7e16c700 1 -- start start 2024-05-06T21:31:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a7e16c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a780ff140 0x7f8a781030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a7e16c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a78100340 0x7f8a78101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a7e16c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78101c60 con 0x7f8a78100340 2024-05-06T21:31:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a7e16c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78101da0 con 0x7f8a780ff140 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a76ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a78100340 0x7f8a78101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a76ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a78100340 0x7f8a78101720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40750/0 (socket says 172.21.15.32:40750) 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a76ffd700 1 -- 172.21.15.32:0/3519750079 learned_addr learned my addr 172.21.15.32:0/3519750079 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a777fe700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a780ff140 0x7f8a781030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a76ffd700 1 -- 172.21.15.32:0/3519750079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a780ff140 msgr2=0x7f8a781030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a76ffd700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a780ff140 0x7f8a781030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.233+0000 7f8a76ffd700 1 -- 172.21.15.32:0/3519750079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a680095f0 con 0x7f8a78100340 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.234+0000 7f8a76ffd700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a78100340 0x7f8a78101720 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00d900 tx=0x7f8a6c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.234+0000 7f8a74ff9700 1 -- 172.21.15.32:0/3519750079 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6c004a00 con 0x7f8a78100340 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.234+0000 7f8a74ff9700 1 -- 172.21.15.32:0/3519750079 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8a6c0054d0 con 0x7f8a78100340 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.234+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a78102080 con 0x7f8a78100340 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.234+0000 7f8a74ff9700 1 -- 172.21.15.32:0/3519750079 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6c009d00 con 0x7f8a78100340 2024-05-06T21:31:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.234+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7819db10 con 0x7f8a78100340 2024-05-06T21:31:23.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.235+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a78107cb0 con 0x7f8a78100340 2024-05-06T21:31:23.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.235+0000 7f8a74ff9700 1 -- 172.21.15.32:0/3519750079 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8a6c010460 con 0x7f8a78100340 2024-05-06T21:31:23.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.236+0000 7f8a74ff9700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8a6006e200 0x7f8a600706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:23.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.236+0000 7f8a74ff9700 1 -- 172.21.15.32:0/3519750079 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f8a6c08e1b0 con 0x7f8a78100340 2024-05-06T21:31:23.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.236+0000 7f8a777fe700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8a6006e200 0x7f8a600706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:23.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.236+0000 7f8a777fe700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8a6006e200 0x7f8a600706b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a68006010 tx=0x7f8a6800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:23.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.241+0000 7f8a74ff9700 1 -- 172.21.15.32:0/3519750079 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8a6c05b050 con 0x7f8a78100340 2024-05-06T21:31:23.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.475+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a780694e0 con 0x7f8a6006e200 2024-05-06T21:31:23.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.476+0000 7f8a74ff9700 1 -- 172.21.15.32:0/3519750079 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8a780694e0 con 0x7f8a6006e200 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8a6006e200 msgr2=0x7f8a600706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8a6006e200 0x7f8a600706b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a68006010 tx=0x7f8a6800b540 comp rx=0 tx=0).stop 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a78100340 msgr2=0x7f8a78101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a78100340 0x7f8a78101720 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00d900 tx=0x7f8a6c00dc10 comp rx=0 tx=0).stop 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 shutdown_connections 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8a6006e200 0x7f8a600706b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a780ff140 0x7f8a781030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 --2- 172.21.15.32:0/3519750079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a78100340 0x7f8a78101720 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 >> 172.21.15.32:0/3519750079 conn(0x7f8a780fa6d0 msgr2=0x7f8a78068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 shutdown_connections 2024-05-06T21:31:23.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.479+0000 7f8a7e16c700 1 -- 172.21.15.32:0/3519750079 wait complete. 2024-05-06T21:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.591+0000 7f6f20f4d700 1 -- 172.21.15.32:0/904057039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c100350 msgr2=0x7f6f1c1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.591+0000 7f6f20f4d700 1 --2- 172.21.15.32:0/904057039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c100350 0x7f6f1c1007a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009910 tx=0x7f6f0c009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.592+0000 7f6f20f4d700 1 -- 172.21.15.32:0/904057039 shutdown_connections 2024-05-06T21:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.592+0000 7f6f20f4d700 1 --2- 172.21.15.32:0/904057039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c100350 0x7f6f1c1007a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.592+0000 7f6f20f4d700 1 --2- 172.21.15.32:0/904057039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1c0ff150 0x7f6f1c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.592+0000 7f6f20f4d700 1 -- 172.21.15.32:0/904057039 >> 172.21.15.32:0/904057039 conn(0x7f6f1c0fa700 msgr2=0x7f6f1c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.592+0000 7f6f20f4d700 1 -- 172.21.15.32:0/904057039 shutdown_connections 2024-05-06T21:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.592+0000 7f6f20f4d700 1 -- 172.21.15.32:0/904057039 wait complete. 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.592+0000 7f6f20f4d700 1 Processor -- start 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f20f4d700 1 -- start start 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f20f4d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c0ff150 0x7f6f1c1030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f20f4d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1c100350 0x7f6f1c101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f20f4d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c101c70 con 0x7f6f1c0ff150 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f20f4d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c101db0 con 0x7f6f1c100350 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f1a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c0ff150 0x7f6f1c1030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f1a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c0ff150 0x7f6f1c1030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40766/0 (socket says 172.21.15.32:40766) 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f1a59c700 1 -- 172.21.15.32:0/2033764663 learned_addr learned my addr 172.21.15.32:0/2033764663 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f19d9b700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1c100350 0x7f6f1c101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:23.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f1a59c700 1 -- 172.21.15.32:0/2033764663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1c100350 msgr2=0x7f6f1c101730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f1a59c700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1c100350 0x7f6f1c101730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.593+0000 7f6f1a59c700 1 -- 172.21.15.32:0/2033764663 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c0095f0 con 0x7f6f1c0ff150 2024-05-06T21:31:23.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.594+0000 7f6f1a59c700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c0ff150 0x7f6f1c1030e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000b480 tx=0x7f6f1000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:23.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.594+0000 7f6f0b7fe700 1 -- 172.21.15.32:0/2033764663 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f100118c0 con 0x7f6f1c0ff150 2024-05-06T21:31:23.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.594+0000 7f6f0b7fe700 1 -- 172.21.15.32:0/2033764663 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f10010380 con 0x7f6f1c0ff150 2024-05-06T21:31:23.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.594+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c102090 con 0x7f6f1c0ff150 2024-05-06T21:31:23.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.594+0000 7f6f0b7fe700 1 -- 172.21.15.32:0/2033764663 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f1000f4f0 con 0x7f6f1c0ff150 2024-05-06T21:31:23.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.594+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1c19dbc0 con 0x7f6f1c0ff150 2024-05-06T21:31:23.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.595+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1c107d40 con 0x7f6f1c0ff150 2024-05-06T21:31:23.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.595+0000 7f6f0b7fe700 1 -- 172.21.15.32:0/2033764663 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6f100104f0 con 0x7f6f1c0ff150 2024-05-06T21:31:23.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.596+0000 7f6f0b7fe700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6f0406e200 0x7f6f040706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:23.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.596+0000 7f6f0b7fe700 1 -- 172.21.15.32:0/2033764663 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f6f1008dea0 con 0x7f6f1c0ff150 2024-05-06T21:31:23.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.596+0000 7f6f19d9b700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6f0406e200 0x7f6f040706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:23.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.597+0000 7f6f19d9b700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6f0406e200 0x7f6f040706b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0059d0 tx=0x7f6f0c005920 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:23.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.601+0000 7f6f0b7fe700 1 -- 172.21.15.32:0/2033764663 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f6f1005abf0 con 0x7f6f1c0ff150 2024-05-06T21:31:23.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.827+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f1c0694e0 con 0x7f6f0406e200 2024-05-06T21:31:23.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.839+0000 7f6f0b7fe700 1 -- 172.21.15.32:0/2033764663 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f6f1c0694e0 con 0x7f6f0406e200 2024-05-06T21:31:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:31:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (11m) 16s ago 13m 24.2M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:31:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (13m) 16s ago 13m 8426k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:31:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (12m) 114s ago 12m 7772k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:31:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (2m) 16s ago 13m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:31:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (118s) 114s ago 12m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:31:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (11m) 16s ago 12m 86.4M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (7m) 16s ago 7m 15.6M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (7m) 16s ago 7m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (7m) 114s ago 7m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (7m) 114s ago 7m 16.7M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (4m) 16s ago 14m 504M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (3m) 114s ago 12m 449M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (3m) 16s ago 14m 46.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (2m) 114s ago 12m 35.3M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (13m) 16s ago 13m 16.3M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (12m) 114s ago 12m 17.1M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (96s) 16s ago 11m 157M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (58s) 16s ago 10m 133M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (22s) 16s ago 10m 12.1M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:31:23.838 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (9m) 114s ago 9m 277M 2240M 18.2.0 dc2bc1663786 dc6e074b0154 2024-05-06T21:31:23.839 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (9m) 114s ago 9m 248M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:31:23.841 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (9m) 114s ago 9m 236M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:31:23.841 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (3m) 16s ago 12m 69.1M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:31:23.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6f0406e200 msgr2=0x7f6f040706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6f0406e200 0x7f6f040706b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0059d0 tx=0x7f6f0c005920 comp rx=0 tx=0).stop 2024-05-06T21:31:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c0ff150 msgr2=0x7f6f1c1030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c0ff150 0x7f6f1c1030e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000b480 tx=0x7f6f1000b840 comp rx=0 tx=0).stop 2024-05-06T21:31:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 shutdown_connections 2024-05-06T21:31:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6f0406e200 0x7f6f040706b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f1c0ff150 0x7f6f1c1030e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 --2- 172.21.15.32:0/2033764663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1c100350 0x7f6f1c101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 >> 172.21.15.32:0/2033764663 conn(0x7f6f1c0fa700 msgr2=0x7f6f1c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 shutdown_connections 2024-05-06T21:31:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.841+0000 7f6f20f4d700 1 -- 172.21.15.32:0/2033764663 wait complete. 2024-05-06T21:31:23.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:23 smithi154 ceph-mon[63622]: pgmap v120: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s, 0 objects/s recovering 2024-05-06T21:31:23.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:23 smithi154 ceph-mon[63622]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:23.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.950+0000 7f91ec547700 1 -- 172.21.15.32:0/547144717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e40ff150 msgr2=0x7f91e40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.950+0000 7f91ec547700 1 --2- 172.21.15.32:0/547144717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e40ff150 0x7f91e40ff560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009910 tx=0x7f91e0009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:23.948 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:23 smithi032 ceph-mon[76650]: pgmap v120: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s, 0 objects/s recovering 2024-05-06T21:31:23.948 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:23 smithi032 ceph-mon[76650]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:23.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.950+0000 7f91ec547700 1 -- 172.21.15.32:0/547144717 shutdown_connections 2024-05-06T21:31:23.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.950+0000 7f91ec547700 1 --2- 172.21.15.32:0/547144717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e4100350 0x7f91e41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.950+0000 7f91ec547700 1 --2- 172.21.15.32:0/547144717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e40ff150 0x7f91e40ff560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.950+0000 7f91ec547700 1 -- 172.21.15.32:0/547144717 >> 172.21.15.32:0/547144717 conn(0x7f91e40fa700 msgr2=0x7f91e40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.950+0000 7f91ec547700 1 -- 172.21.15.32:0/547144717 shutdown_connections 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.950+0000 7f91ec547700 1 -- 172.21.15.32:0/547144717 wait complete. 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91ec547700 1 Processor -- start 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91ec547700 1 -- start start 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91ec547700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e40ff150 0x7f91e4195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91ec547700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e4100350 0x7f91e4196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91ec547700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e4196620 con 0x7f91e4100350 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91ec547700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e4196760 con 0x7f91e40ff150 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91e9ae2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e4100350 0x7f91e4196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91e9ae2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e4100350 0x7f91e4196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40792/0 (socket says 172.21.15.32:40792) 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91e9ae2700 1 -- 172.21.15.32:0/1172199677 learned_addr learned my addr 172.21.15.32:0/1172199677 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:23.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.951+0000 7f91ea2e3700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e40ff150 0x7f91e4195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:23.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.952+0000 7f91e9ae2700 1 -- 172.21.15.32:0/1172199677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e40ff150 msgr2=0x7f91e4195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:23.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.952+0000 7f91e9ae2700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e40ff150 0x7f91e4195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:23.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.952+0000 7f91e9ae2700 1 -- 172.21.15.32:0/1172199677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00095f0 con 0x7f91e4100350 2024-05-06T21:31:23.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.952+0000 7f91e9ae2700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e4100350 0x7f91e4196000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c8a0 tx=0x7f91d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:23.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.952+0000 7f91d77fe700 1 -- 172.21.15.32:0/1172199677 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d800cea0 con 0x7f91e4100350 2024-05-06T21:31:23.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.952+0000 7f91d77fe700 1 -- 172.21.15.32:0/1172199677 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f91d8004830 con 0x7f91e4100350 2024-05-06T21:31:23.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.952+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e419b210 con 0x7f91e4100350 2024-05-06T21:31:23.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.952+0000 7f91d77fe700 1 -- 172.21.15.32:0/1172199677 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d80055b0 con 0x7f91e4100350 2024-05-06T21:31:23.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.952+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e419b710 con 0x7f91e4100350 2024-05-06T21:31:23.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.953+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e4107ca0 con 0x7f91e4100350 2024-05-06T21:31:23.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.954+0000 7f91d77fe700 1 -- 172.21.15.32:0/1172199677 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f91d8007ad0 con 0x7f91e4100350 2024-05-06T21:31:23.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.954+0000 7f91d77fe700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d006e200 0x7f91d00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:23.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.954+0000 7f91d77fe700 1 -- 172.21.15.32:0/1172199677 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f91d808e010 con 0x7f91e4100350 2024-05-06T21:31:23.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.954+0000 7f91ea2e3700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d006e200 0x7f91d00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:23.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.955+0000 7f91ea2e3700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d006e200 0x7f91d00706b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91e0006010 tx=0x7f91e000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:23.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:23.959+0000 7f91d77fe700 1 -- 172.21.15.32:0/1172199677 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f91d805ad60 con 0x7f91e4100350 2024-05-06T21:31:24.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.263+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f91e4107e60 con 0x7f91e4100350 2024-05-06T21:31:24.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.263+0000 7f91d77fe700 1 -- 172.21.15.32:0/1172199677 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f91d805a8f0 con 0x7f91e4100350 2024-05-06T21:31:24.261 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:31:24.261 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:31:24.261 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:31:24.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:31:24.261 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 3 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 7 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:31:24.262 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:31:24.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d006e200 msgr2=0x7f91d00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:24.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d006e200 0x7f91d00706b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91e0006010 tx=0x7f91e000b540 comp rx=0 tx=0).stop 2024-05-06T21:31:24.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e4100350 msgr2=0x7f91e4196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:24.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e4100350 0x7f91e4196000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c8a0 tx=0x7f91d800cc60 comp rx=0 tx=0).stop 2024-05-06T21:31:24.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 shutdown_connections 2024-05-06T21:31:24.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d006e200 0x7f91d00706b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e40ff150 0x7f91e4195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 --2- 172.21.15.32:0/1172199677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e4100350 0x7f91e4196000 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 >> 172.21.15.32:0/1172199677 conn(0x7f91e40fa700 msgr2=0x7f91e4068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:24.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 shutdown_connections 2024-05-06T21:31:24.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.265+0000 7f91ec547700 1 -- 172.21.15.32:0/1172199677 wait complete. 2024-05-06T21:31:24.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.375+0000 7ff9833e6700 1 -- 172.21.15.32:0/571382058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 msgr2=0x7ff97c0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:24.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.375+0000 7ff9833e6700 1 --2- 172.21.15.32:0/571382058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 0x7ff97c0731e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff978009940 tx=0x7ff978009c50 comp rx=0 tx=0).stop 2024-05-06T21:31:24.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.375+0000 7ff9833e6700 1 -- 172.21.15.32:0/571382058 shutdown_connections 2024-05-06T21:31:24.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.375+0000 7ff9833e6700 1 --2- 172.21.15.32:0/571382058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c0737b0 0x7ff97c073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.375+0000 7ff9833e6700 1 --2- 172.21.15.32:0/571382058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 0x7ff97c0731e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.375+0000 7ff9833e6700 1 -- 172.21.15.32:0/571382058 >> 172.21.15.32:0/571382058 conn(0x7ff97c0fb7f0 msgr2=0x7ff97c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:24.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.375+0000 7ff9833e6700 1 -- 172.21.15.32:0/571382058 shutdown_connections 2024-05-06T21:31:24.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.375+0000 7ff9833e6700 1 -- 172.21.15.32:0/571382058 wait complete. 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff9833e6700 1 Processor -- start 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff9833e6700 1 -- start start 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff9833e6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c0737b0 0x7ff97c197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff9833e6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 0x7ff97c1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff9833e6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c198730 con 0x7ff97c074d80 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff9833e6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c1988a0 con 0x7ff97c0737b0 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff980981700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 0x7ff97c1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff980981700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 0x7ff97c1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40810/0 (socket says 172.21.15.32:40810) 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff980981700 1 -- 172.21.15.32:0/1545957629 learned_addr learned my addr 172.21.15.32:0/1545957629 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff981182700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c0737b0 0x7ff97c197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff980981700 1 -- 172.21.15.32:0/1545957629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c0737b0 msgr2=0x7ff97c197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.376+0000 7ff980981700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c0737b0 0x7ff97c197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.377+0000 7ff980981700 1 -- 172.21.15.32:0/1545957629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9780095f0 con 0x7ff97c074d80 2024-05-06T21:31:24.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.377+0000 7ff980981700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 0x7ff97c1981c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c930 tx=0x7ff96c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:24.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.377+0000 7ff9727fc700 1 -- 172.21.15.32:0/1545957629 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff96c007ad0 con 0x7ff97c074d80 2024-05-06T21:31:24.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.377+0000 7ff9727fc700 1 -- 172.21.15.32:0/1545957629 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff96c00ce80 con 0x7ff97c074d80 2024-05-06T21:31:24.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.377+0000 7ff9727fc700 1 -- 172.21.15.32:0/1545957629 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff96c018630 con 0x7ff97c074d80 2024-05-06T21:31:24.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.377+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c19d340 con 0x7ff97c074d80 2024-05-06T21:31:24.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.377+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c19d840 con 0x7ff97c074d80 2024-05-06T21:31:24.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.378+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c10af80 con 0x7ff97c074d80 2024-05-06T21:31:24.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.379+0000 7ff9727fc700 1 -- 172.21.15.32:0/1545957629 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff96c007c30 con 0x7ff97c074d80 2024-05-06T21:31:24.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.379+0000 7ff9727fc700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff96806e200 0x7ff9680706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:24.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.380+0000 7ff9727fc700 1 -- 172.21.15.32:0/1545957629 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6769+0+0 (secure 0 0 0) 0x7ff96c08e240 con 0x7ff97c074d80 2024-05-06T21:31:24.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.380+0000 7ff981182700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff96806e200 0x7ff9680706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:24.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.380+0000 7ff981182700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff96806e200 0x7ff9680706b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff978006010 tx=0x7ff97800ba60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:24.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.384+0000 7ff9727fc700 1 -- 172.21.15.32:0/1545957629 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff96c057460 con 0x7ff97c074d80 2024-05-06T21:31:24.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.653+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff97c10b140 con 0x7ff97c074d80 2024-05-06T21:31:24.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.653+0000 7ff9727fc700 1 -- 172.21.15.32:0/1545957629 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1903 (secure 0 0 0) 0x7ff96c05ab20 con 0x7ff97c074d80 2024-05-06T21:31:24.651 INFO:teuthology.orchestra.run.smithi032.stdout:e22 2024-05-06T21:31:24.651 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:31:24.652 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:31:24.652 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:31:24.652 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:31:24.652 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:31:24.652 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:31:24.652 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 22 2024-05-06T21:31:24.652 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:31:11.981773+0000 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:31:24.653 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 14486 members: 24277,14486 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:31:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:31:24.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:31:24.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:31:24.655 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:31:24.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:31:24.655 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:31:24.655 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.656+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff96806e200 msgr2=0x7ff9680706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.656+0000 7ff9833e6700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff96806e200 0x7ff9680706b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff978006010 tx=0x7ff97800ba60 comp rx=0 tx=0).stop 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.656+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 msgr2=0x7ff97c1981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.656+0000 7ff9833e6700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 0x7ff97c1981c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c930 tx=0x7ff96c00cc40 comp rx=0 tx=0).stop 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.657+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 shutdown_connections 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.657+0000 7ff9833e6700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff96806e200 0x7ff9680706b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.657+0000 7ff9833e6700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c0737b0 0x7ff97c197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.657+0000 7ff9833e6700 1 --2- 172.21.15.32:0/1545957629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff97c074d80 0x7ff97c1981c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.657+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 >> 172.21.15.32:0/1545957629 conn(0x7ff97c0fb7f0 msgr2=0x7ff97c106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.657+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 shutdown_connections 2024-05-06T21:31:24.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.657+0000 7ff9833e6700 1 -- 172.21.15.32:0/1545957629 wait complete. 2024-05-06T21:31:24.657 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 22 2024-05-06T21:31:24.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 -- 172.21.15.32:0/2516436903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 msgr2=0x7f5f94101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 --2- 172.21.15.32:0/2516436903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 0x7f5f94101890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009910 tx=0x7f5f84009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 -- 172.21.15.32:0/2516436903 shutdown_connections 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 --2- 172.21.15.32:0/2516436903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 0x7f5f94101890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 --2- 172.21.15.32:0/2516436903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f94100240 0x7f5f94100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 -- 172.21.15.32:0/2516436903 >> 172.21.15.32:0/2516436903 conn(0x7f5f940fb7f0 msgr2=0x7f5f940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 -- 172.21.15.32:0/2516436903 shutdown_connections 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 -- 172.21.15.32:0/2516436903 wait complete. 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 Processor -- start 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.768+0000 7f5f9c578700 1 -- start start 2024-05-06T21:31:24.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f9c578700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f94100240 0x7f5f94195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f9c578700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 0x7f5f94195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f9c578700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f941965f0 con 0x7f5f94101440 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f9c578700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f94196730 con 0x7f5f94100240 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f99b13700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 0x7f5f94195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f99b13700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 0x7f5f94195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40822/0 (socket says 172.21.15.32:40822) 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f99b13700 1 -- 172.21.15.32:0/1019203321 learned_addr learned my addr 172.21.15.32:0/1019203321 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f9a314700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f94100240 0x7f5f94195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f99b13700 1 -- 172.21.15.32:0/1019203321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f94100240 msgr2=0x7f5f94195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f99b13700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f94100240 0x7f5f94195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f99b13700 1 -- 172.21.15.32:0/1019203321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840095f0 con 0x7f5f94101440 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f99b13700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 0x7f5f94195fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006010 tx=0x7f5f8400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:24.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f8b7fe700 1 -- 172.21.15.32:0/1019203321 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f8401d070 con 0x7f5f94101440 2024-05-06T21:31:24.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.769+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9419b180 con 0x7f5f94101440 2024-05-06T21:31:24.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.770+0000 7f5f8b7fe700 1 -- 172.21.15.32:0/1019203321 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f8400f460 con 0x7f5f94101440 2024-05-06T21:31:24.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.770+0000 7f5f8b7fe700 1 -- 172.21.15.32:0/1019203321 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f84021640 con 0x7f5f94101440 2024-05-06T21:31:24.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.770+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9419b670 con 0x7f5f94101440 2024-05-06T21:31:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.770+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f94108d90 con 0x7f5f94101440 2024-05-06T21:31:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.771+0000 7f5f8b7fe700 1 -- 172.21.15.32:0/1019203321 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5f8400fab0 con 0x7f5f94101440 2024-05-06T21:31:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.771+0000 7f5f8b7fe700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5f8006e200 0x7f5f800706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.772+0000 7f5f8b7fe700 1 -- 172.21.15.32:0/1019203321 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f5f8408f440 con 0x7f5f94101440 2024-05-06T21:31:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.772+0000 7f5f9a314700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5f8006e200 0x7f5f800706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.772+0000 7f5f9a314700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5f8006e200 0x7f5f800706b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5f941012a0 tx=0x7f5f9000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:24.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:24.776+0000 7f5f8b7fe700 1 -- 172.21.15.32:0/1019203321 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5f8405c210 con 0x7f5f94101440 2024-05-06T21:31:24.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:24 smithi032 ceph-mon[76650]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:24.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:24 smithi032 ceph-mon[76650]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:24.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:24 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1172199677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:24.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:24 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1545957629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:31:25.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.008+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f94105d90 con 0x7f5f8006e200 2024-05-06T21:31:25.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.009+0000 7f5f8b7fe700 1 -- 172.21.15.32:0/1019203321 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5f94105d90 con 0x7f5f8006e200 2024-05-06T21:31:25.007 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:31:25.007 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "9/23 daemons upgraded", 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:31:25.008 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5f8006e200 msgr2=0x7f5f800706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5f8006e200 0x7f5f800706b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5f941012a0 tx=0x7f5f9000b410 comp rx=0 tx=0).stop 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 msgr2=0x7f5f94195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 0x7f5f94195fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006010 tx=0x7f5f8400bd70 comp rx=0 tx=0).stop 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 shutdown_connections 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5f8006e200 0x7f5f800706b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f94100240 0x7f5f94195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 --2- 172.21.15.32:0/1019203321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f94101440 0x7f5f94195fd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 >> 172.21.15.32:0/1019203321 conn(0x7f5f940fb7f0 msgr2=0x7f5f94104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 shutdown_connections 2024-05-06T21:31:25.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.012+0000 7f5f9c578700 1 -- 172.21.15.32:0/1019203321 wait complete. 2024-05-06T21:31:25.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:24 smithi154 ceph-mon[63622]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:25.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:24 smithi154 ceph-mon[63622]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:25.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:24 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1172199677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:25.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:24 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1545957629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:31:25.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.120+0000 7f91f436c700 1 -- 172.21.15.32:0/2491211861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec0ff150 msgr2=0x7f91ec0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:25.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.120+0000 7f91f436c700 1 --2- 172.21.15.32:0/2491211861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec0ff150 0x7f91ec0ff560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009910 tx=0x7f91e8009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:25.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.120+0000 7f91f436c700 1 -- 172.21.15.32:0/2491211861 shutdown_connections 2024-05-06T21:31:25.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.120+0000 7f91f436c700 1 --2- 172.21.15.32:0/2491211861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ec1003f0 0x7f91ec100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:25.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.120+0000 7f91f436c700 1 --2- 172.21.15.32:0/2491211861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec0ff150 0x7f91ec0ff560 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:25.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.120+0000 7f91f436c700 1 -- 172.21.15.32:0/2491211861 >> 172.21.15.32:0/2491211861 conn(0x7f91ec0fa7a0 msgr2=0x7f91ec0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:25.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.120+0000 7f91f436c700 1 -- 172.21.15.32:0/2491211861 shutdown_connections 2024-05-06T21:31:25.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.120+0000 7f91f436c700 1 -- 172.21.15.32:0/2491211861 wait complete. 2024-05-06T21:31:25.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.120+0000 7f91f436c700 1 Processor -- start 2024-05-06T21:31:25.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f436c700 1 -- start start 2024-05-06T21:31:25.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f436c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ec0ff150 0x7f91ec069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:25.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f436c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec1003f0 0x7f91ec19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:25.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f436c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec19b120 con 0x7f91ec1003f0 2024-05-06T21:31:25.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f436c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec19b260 con 0x7f91ec0ff150 2024-05-06T21:31:25.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f1907700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec1003f0 0x7f91ec19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:25.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f1907700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec1003f0 0x7f91ec19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40834/0 (socket says 172.21.15.32:40834) 2024-05-06T21:31:25.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f1907700 1 -- 172.21.15.32:0/2954470835 learned_addr learned my addr 172.21.15.32:0/2954470835 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f2108700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ec0ff150 0x7f91ec069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f1907700 1 -- 172.21.15.32:0/2954470835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ec0ff150 msgr2=0x7f91ec069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f1907700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ec0ff150 0x7f91ec069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f1907700 1 -- 172.21.15.32:0/2954470835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80095f0 con 0x7f91ec1003f0 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f2108700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ec0ff150 0x7f91ec069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.121+0000 7f91f1907700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec1003f0 0x7f91ec19ab50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91e000d8d0 tx=0x7f91e000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.122+0000 7f91df7fe700 1 -- 172.21.15.32:0/2954470835 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e0009940 con 0x7f91ec1003f0 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.122+0000 7f91df7fe700 1 -- 172.21.15.32:0/2954470835 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f91e0010460 con 0x7f91ec1003f0 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.122+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ec19b540 con 0x7f91ec1003f0 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.122+0000 7f91df7fe700 1 -- 172.21.15.32:0/2954470835 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e000f5d0 con 0x7f91ec1003f0 2024-05-06T21:31:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.122+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec19ba90 con 0x7f91ec1003f0 2024-05-06T21:31:25.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.123+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec068ab0 con 0x7f91ec1003f0 2024-05-06T21:31:25.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.123+0000 7f91df7fe700 1 -- 172.21.15.32:0/2954470835 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f91e00105d0 con 0x7f91ec1003f0 2024-05-06T21:31:25.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.124+0000 7f91df7fe700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d806e200 0x7f91d80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:25.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.124+0000 7f91df7fe700 1 -- 172.21.15.32:0/2954470835 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f91e008e130 con 0x7f91ec1003f0 2024-05-06T21:31:25.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.124+0000 7f91f2108700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d806e200 0x7f91d80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:25.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.124+0000 7f91f2108700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d806e200 0x7f91d80706b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91e8006010 tx=0x7f91e800b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:25.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.129+0000 7f91df7fe700 1 -- 172.21.15.32:0/2954470835 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f91e005af00 con 0x7f91ec1003f0 2024-05-06T21:31:25.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.426+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f91ec19bd00 con 0x7f91ec1003f0 2024-05-06T21:31:25.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.426+0000 7f91df7fe700 1 -- 172.21.15.32:0/2954470835 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f91e005aa90 con 0x7f91ec1003f0 2024-05-06T21:31:25.424 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d806e200 msgr2=0x7f91d80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d806e200 0x7f91d80706b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91e8006010 tx=0x7f91e800b580 comp rx=0 tx=0).stop 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec1003f0 msgr2=0x7f91ec19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec1003f0 0x7f91ec19ab50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91e000d8d0 tx=0x7f91e000dc90 comp rx=0 tx=0).stop 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 shutdown_connections 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f91d806e200 0x7f91d80706b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ec0ff150 0x7f91ec069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 --2- 172.21.15.32:0/2954470835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91ec1003f0 0x7f91ec19ab50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 >> 172.21.15.32:0/2954470835 conn(0x7f91ec0fa7a0 msgr2=0x7f91ec1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 shutdown_connections 2024-05-06T21:31:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:25.429+0000 7f91f436c700 1 -- 172.21.15.32:0/2954470835 wait complete. 2024-05-06T21:31:25.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:25 smithi032 ceph-mon[76650]: pgmap v121: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:25.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:25 smithi032 ceph-mon[76650]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:25.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:25 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2954470835' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:31:26.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:25 smithi154 ceph-mon[63622]: pgmap v121: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:26.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:25 smithi154 ceph-mon[63622]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:26.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:25 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2954470835' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:31:27.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:27 smithi032 ceph-mon[76650]: pgmap v122: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:28.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:27 smithi154 ceph-mon[63622]: pgmap v122: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:28.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:28 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T21:31:28.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:28 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T21:31:28.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:28 smithi154 ceph-mon[63622]: Upgrade: osd.3 is safe to restart 2024-05-06T21:31:28.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:28 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T21:31:28.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:28 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T21:31:28.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:28 smithi032 ceph-mon[76650]: Upgrade: osd.3 is safe to restart 2024-05-06T21:31:29.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:29 smithi032 ceph-mon[76650]: pgmap v123: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:29.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:29.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T21:31:29.975 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:31:30.024 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:29 smithi154 ceph-mon[63622]: pgmap v123: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:30.025 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:30.025 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T21:31:30.025 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:31:30.967 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:30 smithi154 ceph-mon[63622]: Upgrade: Updating osd.3 2024-05-06T21:31:30.967 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:30 smithi154 ceph-mon[63622]: Deploying daemon osd.3 on smithi154 2024-05-06T21:31:30.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:30 smithi032 ceph-mon[76650]: Upgrade: Updating osd.3 2024-05-06T21:31:30.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:30 smithi032 ceph-mon[76650]: Deploying daemon osd.3 on smithi154 2024-05-06T21:31:31.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:31 smithi154 ceph-mon[63622]: pgmap v124: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:31.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:31 smithi032 ceph-mon[76650]: pgmap v124: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:32.615 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:32 smithi154 systemd[1]: Stopping Ceph osd.3 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:31:33.115 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:32 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[38981]: 2024-05-06T21:31:32.745+0000 7f2cd7c26700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:31:33.115 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:32 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[38981]: 2024-05-06T21:31:32.745+0000 7f2cd7c26700 -1 osd.3 76 *** Got signal Terminated *** 2024-05-06T21:31:33.115 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:32 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[38981]: 2024-05-06T21:31:32.745+0000 7f2cd7c26700 -1 osd.3 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:31:33.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:33 smithi154 ceph-mon[63622]: pgmap v125: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:33.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:33 smithi154 ceph-mon[63622]: osd.3 marked itself down and dead 2024-05-06T21:31:33.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:33 smithi032 ceph-mon[76650]: pgmap v125: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:33.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:33 smithi032 ceph-mon[76650]: osd.3 marked itself down and dead 2024-05-06T21:31:34.345 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:34 smithi154 podman[68406]: 2024-05-06 21:31:34.081290762 +0000 UTC m=+1.457823576 container died dc6e074b0154a1ac255f36a7464bf56255d4d856a6ce04430e9f96cf5d362f6f (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, RELEASE=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1) 2024-05-06T21:31:34.615 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:34 smithi154 podman[68406]: 2024-05-06 21:31:34.505457351 +0000 UTC m=+1.881990205 container cleanup dc6e074b0154a1ac255f36a7464bf56255d4d856a6ce04430e9f96cf5d362f6f (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux ) 2024-05-06T21:31:34.615 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:34 smithi154 bash[68406]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3 2024-05-06T21:31:34.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:34 smithi032 ceph-mon[76650]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:31:34.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:34 smithi032 ceph-mon[76650]: osdmap e77: 6 total, 5 up, 6 in 2024-05-06T21:31:35.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:34 smithi154 ceph-mon[63622]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:31:35.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:34 smithi154 ceph-mon[63622]: osdmap e77: 6 total, 5 up, 6 in 2024-05-06T21:31:35.116 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:34 smithi154 podman[68434]: 2024-05-06 21:31:34.715122631 +0000 UTC m=+0.637989770 container remove dc6e074b0154a1ac255f36a7464bf56255d4d856a6ce04430e9f96cf5d362f6f (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-06T21:31:35.440 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:35 smithi154 podman[68525]: 2024-05-06 21:31:35.042749789 +0000 UTC m=+0.017994682 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:31:35.440 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:35 smithi154 podman[68525]: 2024-05-06 21:31:35.149647224 +0000 UTC m=+0.124892098 container create cf209a32da8ec73807e0e0a218669e863f2085806a49a6f79824a2dfcfb0e1dc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, ceph=True, GIT_BRANCH=HEAD) 2024-05-06T21:31:35.440 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:35 smithi154 podman[68525]: 2024-05-06 21:31:35.360322492 +0000 UTC m=+0.335567366 container init cf209a32da8ec73807e0e0a218669e863f2085806a49a6f79824a2dfcfb0e1dc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430) 2024-05-06T21:31:35.441 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:35 smithi154 podman[68525]: 2024-05-06 21:31:35.363715306 +0000 UTC m=+0.338960180 container start cf209a32da8ec73807e0e0a218669e863f2085806a49a6f79824a2dfcfb0e1dc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-06T21:31:35.441 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:35 smithi154 podman[68525]: 2024-05-06 21:31:35.443619827 +0000 UTC m=+0.418864718 container attach cf209a32da8ec73807e0e0a218669e863f2085806a49a6f79824a2dfcfb0e1dc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, ceph=True, GIT_BRANCH=HEAD) 2024-05-06T21:31:35.717 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:35 smithi154 podman[68525]: 2024-05-06 21:31:35.665648752 +0000 UTC m=+0.640893631 container died cf209a32da8ec73807e0e0a218669e863f2085806a49a6f79824a2dfcfb0e1dc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, ceph=True, org.label-schema.vendor=CentOS) 2024-05-06T21:31:35.968 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:35 smithi154 ceph-mon[63622]: pgmap v127: 65 pgs: 11 stale+active+clean, 54 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:35.968 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:35 smithi154 ceph-mon[63622]: osdmap e78: 6 total, 5 up, 6 in 2024-05-06T21:31:35.968 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:35.969 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:31:35.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:35 smithi032 ceph-mon[76650]: pgmap v127: 65 pgs: 11 stale+active+clean, 54 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:35.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:35 smithi032 ceph-mon[76650]: osdmap e78: 6 total, 5 up, 6 in 2024-05-06T21:31:35.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:35.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:31:36.615 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:36 smithi154 podman[68551]: 2024-05-06 21:31:36.272965058 +0000 UTC m=+0.601316300 container remove cf209a32da8ec73807e0e0a218669e863f2085806a49a6f79824a2dfcfb0e1dc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T21:31:36.616 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:36 smithi154 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.3.service: Deactivated successfully. 2024-05-06T21:31:36.616 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:36 smithi154 systemd[1]: Stopped Ceph osd.3 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:31:36.616 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:36 smithi154 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.3.service: Consumed 1min 11.815s CPU time. 2024-05-06T21:31:36.616 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:36 smithi154 systemd[1]: Starting Ceph osd.3 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:31:37.057 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:36 smithi154 ceph-mon[63622]: Health check failed: Degraded data redundancy: 38/366 objects degraded (10.383%), 8 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:37.057 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:36 smithi154 podman[68648]: 2024-05-06 21:31:36.625946297 +0000 UTC m=+0.018983179 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:31:37.057 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:36 smithi154 podman[68648]: 2024-05-06 21:31:36.724221652 +0000 UTC m=+0.117258523 container create 7f7cb47c844b6db43d721484be769ed5027a6ac5345f0adc51e6a8973737346b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-06T21:31:37.057 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:36 smithi154 podman[68648]: 2024-05-06 21:31:36.960441563 +0000 UTC m=+0.353478446 container init 7f7cb47c844b6db43d721484be769ed5027a6ac5345f0adc51e6a8973737346b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T21:31:37.057 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:36 smithi154 podman[68648]: 2024-05-06 21:31:36.964027235 +0000 UTC m=+0.357064110 container start 7f7cb47c844b6db43d721484be769ed5027a6ac5345f0adc51e6a8973737346b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-06T21:31:37.057 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 podman[68648]: 2024-05-06 21:31:37.060226227 +0000 UTC m=+0.453263114 container attach 7f7cb47c844b6db43d721484be769ed5027a6ac5345f0adc51e6a8973737346b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T21:31:37.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:36 smithi032 ceph-mon[76650]: Health check failed: Degraded data redundancy: 38/366 objects degraded (10.383%), 8 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:37.724 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate[68663]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T21:31:37.724 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate[68663]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T21:31:37.724 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 bash[68648]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T21:31:37.724 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 bash[68648]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T21:31:37.724 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 bash[68648]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T21:31:37.724 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 bash[68648]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T21:31:37.724 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 bash[68648]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-05-06T21:31:37.724 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 bash[68648]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T21:31:37.725 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 bash[68648]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-06T21:31:37.725 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate[68663]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T21:31:37.725 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate[68663]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T21:31:37.725 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate[68663]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-05-06T21:31:37.725 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate[68663]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T21:31:37.725 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate[68663]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-06T21:31:37.725 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 podman[68648]: 2024-05-06 21:31:37.439256945 +0000 UTC m=+0.832293827 container died 7f7cb47c844b6db43d721484be769ed5027a6ac5345f0adc51e6a8973737346b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-06T21:31:37.978 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:37 smithi154 ceph-mon[63622]: pgmap v129: 65 pgs: 8 active+undersized, 8 active+undersized+degraded, 3 stale+active+clean, 46 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/366 objects degraded (10.383%) 2024-05-06T21:31:38.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:37 smithi032 ceph-mon[76650]: pgmap v129: 65 pgs: 8 active+undersized, 8 active+undersized+degraded, 3 stale+active+clean, 46 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/366 objects degraded (10.383%) 2024-05-06T21:31:38.292 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:37 smithi154 podman[68782]: 2024-05-06 21:31:37.981113536 +0000 UTC m=+0.536039869 container remove 7f7cb47c844b6db43d721484be769ed5027a6ac5345f0adc51e6a8973737346b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T21:31:38.292 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:38 smithi154 podman[68844]: 2024-05-06 21:31:38.10078085 +0000 UTC m=+0.018308312 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:31:38.292 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:38 smithi154 podman[68844]: 2024-05-06 21:31:38.198399755 +0000 UTC m=+0.115927201 container create 5cc938cf75ad15dcb00ecd076fa8a658246949f8a2d0a4070ab56b7f4e394ccc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430) 2024-05-06T21:31:38.615 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:38 smithi154 podman[68844]: 2024-05-06 21:31:38.403879204 +0000 UTC m=+0.321406650 container init 5cc938cf75ad15dcb00ecd076fa8a658246949f8a2d0a4070ab56b7f4e394ccc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5) 2024-05-06T21:31:38.616 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:38 smithi154 podman[68844]: 2024-05-06 21:31:38.406976434 +0000 UTC m=+0.324503883 container start 5cc938cf75ad15dcb00ecd076fa8a658246949f8a2d0a4070ab56b7f4e394ccc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-06T21:31:38.616 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:38 smithi154 ceph-osd[68863]: -- 172.21.15.154:0/594505951 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5611ea941680 con 0x5611ea90b000 2024-05-06T21:31:38.616 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:38 smithi154 bash[68844]: 5cc938cf75ad15dcb00ecd076fa8a658246949f8a2d0a4070ab56b7f4e394ccc 2024-05-06T21:31:38.616 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:38 smithi154 systemd[1]: Started Ceph osd.3 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:31:39.365 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:38 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:31:38.959+0000 7fbe8c0567c0 -1 Falling back to public interface 2024-05-06T21:31:39.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:39 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:39.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:39 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:39.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:39 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:31:39.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:39 smithi154 ceph-mon[63622]: pgmap v130: 65 pgs: 13 active+undersized, 15 active+undersized+degraded, 1 stale+active+clean, 36 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/366 objects degraded (15.574%) 2024-05-06T21:31:39.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:39 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:39.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:39 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:39.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:39 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:31:39.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:39 smithi032 ceph-mon[76650]: pgmap v130: 65 pgs: 13 active+undersized, 15 active+undersized+degraded, 1 stale+active+clean, 36 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/366 objects degraded (15.574%) 2024-05-06T21:31:41.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:41 smithi032 ceph-mon[76650]: pgmap v131: 65 pgs: 16 active+undersized, 17 active+undersized+degraded, 32 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/366 objects degraded (17.213%) 2024-05-06T21:31:41.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:41 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:41.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:41 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:42.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:41 smithi154 ceph-mon[63622]: pgmap v131: 65 pgs: 16 active+undersized, 17 active+undersized+degraded, 32 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/366 objects degraded (17.213%) 2024-05-06T21:31:42.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:41 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:42.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:41 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:42.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:42 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 63/366 objects degraded (17.213%), 17 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:43.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:42 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 63/366 objects degraded (17.213%), 17 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:43.761 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:43 smithi154 ceph-mon[63622]: pgmap v132: 65 pgs: 16 active+undersized, 17 active+undersized+degraded, 32 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/366 objects degraded (17.213%) 2024-05-06T21:31:43.762 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:43 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:43.762 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:43 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:43.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:43 smithi032 ceph-mon[76650]: pgmap v132: 65 pgs: 16 active+undersized, 17 active+undersized+degraded, 32 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/366 objects degraded (17.213%) 2024-05-06T21:31:43.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:43 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:43.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:43 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:44.115 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:43 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:31:43.834+0000 7fbe8c0567c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-05-06T21:31:44.615 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:44 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:31:44.350+0000 7fbe8c0567c0 -1 osd.3 76 log_to_monitors true 2024-05-06T21:31:44.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:44 smithi032 ceph-mon[76650]: from='osd.3 [v2:172.21.15.154:6800/4072948236,v1:172.21.15.154:6801/4072948236]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T21:31:44.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:44 smithi032 ceph-mon[76650]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T21:31:45.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:44 smithi154 ceph-mon[63622]: from='osd.3 [v2:172.21.15.154:6800/4072948236,v1:172.21.15.154:6801/4072948236]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T21:31:45.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:44 smithi154 ceph-mon[63622]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T21:31:45.115 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:31:44 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:31:44.737+0000 7fbe7d4ad700 -1 osd.3 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:31:45.999 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:45 smithi032 ceph-mon[76650]: pgmap v133: 65 pgs: 16 active+undersized, 17 active+undersized+degraded, 32 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/366 objects degraded (17.213%) 2024-05-06T21:31:46.000 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:45 smithi032 ceph-mon[76650]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T21:31:46.000 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:45 smithi032 ceph-mon[76650]: from='osd.3 [v2:172.21.15.154:6800/4072948236,v1:172.21.15.154:6801/4072948236]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:31:46.000 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:45 smithi032 ceph-mon[76650]: osdmap e79: 6 total, 5 up, 6 in 2024-05-06T21:31:46.000 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:45 smithi032 ceph-mon[76650]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:31:46.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:45 smithi154 ceph-mon[63622]: pgmap v133: 65 pgs: 16 active+undersized, 17 active+undersized+degraded, 32 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/366 objects degraded (17.213%) 2024-05-06T21:31:46.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:45 smithi154 ceph-mon[63622]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T21:31:46.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:45 smithi154 ceph-mon[63622]: from='osd.3 [v2:172.21.15.154:6800/4072948236,v1:172.21.15.154:6801/4072948236]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:31:46.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:45 smithi154 ceph-mon[63622]: osdmap e79: 6 total, 5 up, 6 in 2024-05-06T21:31:46.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:45 smithi154 ceph-mon[63622]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:31:47.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:31:47.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: osd.3 [v2:172.21.15.154:6800/4072948236,v1:172.21.15.154:6801/4072948236] boot 2024-05-06T21:31:47.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: osdmap e80: 6 total, 6 up, 6 in 2024-05-06T21:31:47.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:31:47.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:47.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:47.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:31:47.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:31:47.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:47.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:31:47.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:47.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:47.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:47.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T21:31:47.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T21:31:47.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-05-06T21:31:47.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:46 smithi154 ceph-mon[63622]: osdmap e81: 6 total, 6 up, 6 in 2024-05-06T21:31:47.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:31:47.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: osd.3 [v2:172.21.15.154:6800/4072948236,v1:172.21.15.154:6801/4072948236] boot 2024-05-06T21:31:47.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: osdmap e80: 6 total, 6 up, 6 in 2024-05-06T21:31:47.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T21:31:47.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:47.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:47.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-05-06T21:31:47.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:46 smithi032 ceph-mon[76650]: osdmap e81: 6 total, 6 up, 6 in 2024-05-06T21:31:47.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:47 smithi032 ceph-mon[76650]: pgmap v136: 65 pgs: 8 peering, 11 active+undersized, 14 active+undersized+degraded, 32 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 52/366 objects degraded (14.208%) 2024-05-06T21:31:47.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:47 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 52/366 objects degraded (14.208%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:48.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:47 smithi154 ceph-mon[63622]: pgmap v136: 65 pgs: 8 peering, 11 active+undersized, 14 active+undersized+degraded, 32 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 52/366 objects degraded (14.208%) 2024-05-06T21:31:48.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:47 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 52/366 objects degraded (14.208%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T21:31:50.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:49 smithi154 ceph-mon[63622]: pgmap v138: 65 pgs: 8 peering, 7 active+undersized, 8 active+undersized+degraded, 42 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/366 objects degraded (9.836%) 2024-05-06T21:31:50.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:49 smithi032 ceph-mon[76650]: pgmap v138: 65 pgs: 8 peering, 7 active+undersized, 8 active+undersized+degraded, 42 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/366 objects degraded (9.836%) 2024-05-06T21:31:51.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:51 smithi032 ceph-mon[76650]: pgmap v139: 65 pgs: 8 peering, 57 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:51.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:51.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:31:51.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:51 smithi032 ceph-mon[76650]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/366 objects degraded (9.836%), 8 pgs degraded) 2024-05-06T21:31:51.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:51 smithi032 ceph-mon[76650]: Cluster is now healthy 2024-05-06T21:31:52.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:51 smithi154 ceph-mon[63622]: pgmap v139: 65 pgs: 8 peering, 57 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:52.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:31:52.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:31:52.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:51 smithi154 ceph-mon[63622]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/366 objects degraded (9.836%), 8 pgs degraded) 2024-05-06T21:31:52.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:51 smithi154 ceph-mon[63622]: Cluster is now healthy 2024-05-06T21:31:53.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:53 smithi032 ceph-mon[76650]: pgmap v140: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:54.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:53 smithi154 ceph-mon[63622]: pgmap v140: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.553+0000 7f5517c53700 1 -- 172.21.15.32:0/1971625652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100fe500 msgr2=0x7f55100fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.553+0000 7f5517c53700 1 --2- 172.21.15.32:0/1971625652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100fe500 0x7f55100fe910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f550c009910 tx=0x7f550c009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.553+0000 7f5517c53700 1 -- 172.21.15.32:0/1971625652 shutdown_connections 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.553+0000 7f5517c53700 1 --2- 172.21.15.32:0/1971625652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55100ff270 0x7f55100ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.553+0000 7f5517c53700 1 --2- 172.21.15.32:0/1971625652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100fe500 0x7f55100fe910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.553+0000 7f5517c53700 1 -- 172.21.15.32:0/1971625652 >> 172.21.15.32:0/1971625652 conn(0x7f55100f9e50 msgr2=0x7f55100fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.553+0000 7f5517c53700 1 -- 172.21.15.32:0/1971625652 shutdown_connections 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.553+0000 7f5517c53700 1 -- 172.21.15.32:0/1971625652 wait complete. 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f5517c53700 1 Processor -- start 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f5517c53700 1 -- start start 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f5517c53700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55100fe500 0x7f5510197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f5517c53700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100ff270 0x7f55101981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f5517c53700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5510198760 con 0x7f55100ff270 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f5517c53700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101988d0 con 0x7f55100fe500 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f55151ee700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100ff270 0x7f55101981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f55151ee700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100ff270 0x7f55101981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56820/0 (socket says 172.21.15.32:56820) 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f55151ee700 1 -- 172.21.15.32:0/1537155735 learned_addr learned my addr 172.21.15.32:0/1537155735 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f55159ef700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55100fe500 0x7f5510197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f55151ee700 1 -- 172.21.15.32:0/1537155735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55100fe500 msgr2=0x7f5510197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f55151ee700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55100fe500 0x7f5510197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.554+0000 7f55151ee700 1 -- 172.21.15.32:0/1537155735 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0095f0 con 0x7f55100ff270 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.555+0000 7f55151ee700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100ff270 0x7f55101981f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f550000c930 tx=0x7f550000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.555+0000 7f5506ffd700 1 -- 172.21.15.32:0/1537155735 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5500007ad0 con 0x7f55100ff270 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.555+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551019d370 con 0x7f55100ff270 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.555+0000 7f5506ffd700 1 -- 172.21.15.32:0/1537155735 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f550000ce80 con 0x7f55100ff270 2024-05-06T21:31:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.555+0000 7f5506ffd700 1 -- 172.21.15.32:0/1537155735 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5500018630 con 0x7f55100ff270 2024-05-06T21:31:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.555+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551019d8c0 con 0x7f55100ff270 2024-05-06T21:31:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.556+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551010af90 con 0x7f55100ff270 2024-05-06T21:31:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.557+0000 7f5506ffd700 1 -- 172.21.15.32:0/1537155735 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5500007c30 con 0x7f55100ff270 2024-05-06T21:31:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.557+0000 7f5506ffd700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54fc06e200 0x7f54fc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.557+0000 7f5506ffd700 1 -- 172.21.15.32:0/1537155735 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f550008e240 con 0x7f55100ff270 2024-05-06T21:31:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.557+0000 7f55159ef700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54fc06e200 0x7f54fc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.558+0000 7f55159ef700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54fc06e200 0x7f54fc0706b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f550c006010 tx=0x7f550c0052a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:55.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.562+0000 7f5506ffd700 1 -- 172.21.15.32:0/1537155735 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5500057460 con 0x7f55100ff270 2024-05-06T21:31:55.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.798+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5510109020 con 0x7f54fc06e200 2024-05-06T21:31:55.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.800+0000 7f5506ffd700 1 -- 172.21.15.32:0/1537155735 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5510109020 con 0x7f54fc06e200 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54fc06e200 msgr2=0x7f54fc0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54fc06e200 0x7f54fc0706b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f550c006010 tx=0x7f550c0052a0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100ff270 msgr2=0x7f55101981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100ff270 0x7f55101981f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f550000c930 tx=0x7f550000cc40 comp rx=0 tx=0).stop 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 shutdown_connections 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f54fc06e200 0x7f54fc0706b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55100fe500 0x7f5510197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 --2- 172.21.15.32:0/1537155735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55100ff270 0x7f55101981f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 >> 172.21.15.32:0/1537155735 conn(0x7f55100f9e50 msgr2=0x7f5510107900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 shutdown_connections 2024-05-06T21:31:55.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.802+0000 7f5517c53700 1 -- 172.21.15.32:0/1537155735 wait complete. 2024-05-06T21:31:55.810 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:31:55.810 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:55 smithi032 ceph-mon[76650]: pgmap v141: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.911+0000 7f634d771700 1 -- 172.21.15.32:0/3595677301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348101820 msgr2=0x7f6348101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.911+0000 7f634d771700 1 --2- 172.21.15.32:0/3595677301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348101820 0x7f6348101c30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6338009910 tx=0x7f6338009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.911+0000 7f634d771700 1 -- 172.21.15.32:0/3595677301 shutdown_connections 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.911+0000 7f634d771700 1 --2- 172.21.15.32:0/3595677301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6348102200 0x7f63480fe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.911+0000 7f634d771700 1 --2- 172.21.15.32:0/3595677301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348101820 0x7f6348101c30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.911+0000 7f634d771700 1 -- 172.21.15.32:0/3595677301 >> 172.21.15.32:0/3595677301 conn(0x7f63480f9e50 msgr2=0x7f63480fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.911+0000 7f634d771700 1 -- 172.21.15.32:0/3595677301 shutdown_connections 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.911+0000 7f634d771700 1 -- 172.21.15.32:0/3595677301 wait complete. 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.912+0000 7f634d771700 1 Processor -- start 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.912+0000 7f634d771700 1 -- start start 2024-05-06T21:31:55.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.912+0000 7f634d771700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6348101820 0x7f6348195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.912+0000 7f634d771700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348102200 0x7f6348196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.912+0000 7f634d771700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63481965d0 con 0x7f6348102200 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.912+0000 7f634d771700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6348196710 con 0x7f6348101820 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.912+0000 7f63467fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348102200 0x7f6348196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.912+0000 7f63467fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348102200 0x7f6348196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56824/0 (socket says 172.21.15.32:56824) 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.912+0000 7f63467fc700 1 -- 172.21.15.32:0/43511952 learned_addr learned my addr 172.21.15.32:0/43511952 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f6346ffd700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6348101820 0x7f6348195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f63467fc700 1 -- 172.21.15.32:0/43511952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6348101820 msgr2=0x7f6348195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f63467fc700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6348101820 0x7f6348195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f63467fc700 1 -- 172.21.15.32:0/43511952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380095f0 con 0x7f6348102200 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f63467fc700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348102200 0x7f6348196040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f633c00c960 tx=0x7f633c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f632ffff700 1 -- 172.21.15.32:0/43511952 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f633c007a70 con 0x7f6348102200 2024-05-06T21:31:55.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f632ffff700 1 -- 172.21.15.32:0/43511952 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f633c007bd0 con 0x7f6348102200 2024-05-06T21:31:55.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634819b1d0 con 0x7f6348102200 2024-05-06T21:31:55.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f632ffff700 1 -- 172.21.15.32:0/43511952 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f633c018630 con 0x7f6348102200 2024-05-06T21:31:55.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.913+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634819b6f0 con 0x7f6348102200 2024-05-06T21:31:55.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.914+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6348108db0 con 0x7f6348102200 2024-05-06T21:31:55.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.914+0000 7f632ffff700 1 -- 172.21.15.32:0/43511952 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f633c00fa90 con 0x7f6348102200 2024-05-06T21:31:55.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.915+0000 7f632ffff700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f633006e200 0x7f63300706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:55.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.915+0000 7f632ffff700 1 -- 172.21.15.32:0/43511952 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f633c08e290 con 0x7f6348102200 2024-05-06T21:31:55.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.915+0000 7f6346ffd700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f633006e200 0x7f63300706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:55.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.916+0000 7f6346ffd700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f633006e200 0x7f63300706b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6338006010 tx=0x7f6338005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:55.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:55.920+0000 7f632ffff700 1 -- 172.21.15.32:0/43511952 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f633c05ad50 con 0x7f6348102200 2024-05-06T21:31:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:55 smithi154 ceph-mon[63622]: pgmap v141: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:56.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.152+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6348105f10 con 0x7f633006e200 2024-05-06T21:31:56.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.153+0000 7f632ffff700 1 -- 172.21.15.32:0/43511952 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6348105f10 con 0x7f633006e200 2024-05-06T21:31:56.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.155+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f633006e200 msgr2=0x7f63300706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.155+0000 7f634d771700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f633006e200 0x7f63300706b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6338006010 tx=0x7f6338005960 comp rx=0 tx=0).stop 2024-05-06T21:31:56.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.155+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348102200 msgr2=0x7f6348196040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.155+0000 7f634d771700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348102200 0x7f6348196040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f633c00c960 tx=0x7f633c00cd20 comp rx=0 tx=0).stop 2024-05-06T21:31:56.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.155+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 shutdown_connections 2024-05-06T21:31:56.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.155+0000 7f634d771700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f633006e200 0x7f63300706b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.155+0000 7f634d771700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6348101820 0x7f6348195b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.155+0000 7f634d771700 1 --2- 172.21.15.32:0/43511952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6348102200 0x7f6348196040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.155+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 >> 172.21.15.32:0/43511952 conn(0x7f63480f9e50 msgr2=0x7f63481047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:56.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.156+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 shutdown_connections 2024-05-06T21:31:56.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.156+0000 7f634d771700 1 -- 172.21.15.32:0/43511952 wait complete. 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.264+0000 7f12cf4b2700 1 -- 172.21.15.32:0/2569364674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8103680 msgr2=0x7f12c8105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.264+0000 7f12cf4b2700 1 --2- 172.21.15.32:0/2569364674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8103680 0x7f12c8105a60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009910 tx=0x7f12bc009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.264+0000 7f12cf4b2700 1 -- 172.21.15.32:0/2569364674 shutdown_connections 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.264+0000 7f12cf4b2700 1 --2- 172.21.15.32:0/2569364674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8103680 0x7f12c8105a60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.264+0000 7f12cf4b2700 1 --2- 172.21.15.32:0/2569364674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c8100d60 0x7f12c8103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.264+0000 7f12cf4b2700 1 -- 172.21.15.32:0/2569364674 >> 172.21.15.32:0/2569364674 conn(0x7f12c80fa780 msgr2=0x7f12c80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.264+0000 7f12cf4b2700 1 -- 172.21.15.32:0/2569364674 shutdown_connections 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.264+0000 7f12cf4b2700 1 -- 172.21.15.32:0/2569364674 wait complete. 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cf4b2700 1 Processor -- start 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cf4b2700 1 -- start start 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cf4b2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8100d60 0x7f12c81006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cf4b2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c8103680 0x7f12c80fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cf4b2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80ff250 con 0x7f12c8100d60 2024-05-06T21:31:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cf4b2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80ff390 con 0x7f12c8103680 2024-05-06T21:31:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cd24e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8100d60 0x7f12c81006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cd24e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8100d60 0x7f12c81006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56840/0 (socket says 172.21.15.32:56840) 2024-05-06T21:31:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cd24e700 1 -- 172.21.15.32:0/3751918023 learned_addr learned my addr 172.21.15.32:0/3751918023 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cd24e700 1 -- 172.21.15.32:0/3751918023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c8103680 msgr2=0x7f12c80fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cd24e700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c8103680 0x7f12c80fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.265+0000 7f12cd24e700 1 -- 172.21.15.32:0/3751918023 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0095f0 con 0x7f12c8100d60 2024-05-06T21:31:56.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.266+0000 7f12cd24e700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8100d60 0x7f12c81006c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f12b800ada0 tx=0x7f12b800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:56.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.266+0000 7f12c67fc700 1 -- 172.21.15.32:0/3751918023 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b800f070 con 0x7f12c8100d60 2024-05-06T21:31:56.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.266+0000 7f12c67fc700 1 -- 172.21.15.32:0/3751918023 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f12b8007bc0 con 0x7f12c8100d60 2024-05-06T21:31:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.266+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c80ff670 con 0x7f12c8100d60 2024-05-06T21:31:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.266+0000 7f12c67fc700 1 -- 172.21.15.32:0/3751918023 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b8005630 con 0x7f12c8100d60 2024-05-06T21:31:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.266+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c819dad0 con 0x7f12c8100d60 2024-05-06T21:31:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.267+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c818fbe0 con 0x7f12c8100d60 2024-05-06T21:31:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.267+0000 7f12c67fc700 1 -- 172.21.15.32:0/3751918023 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f12b80058a0 con 0x7f12c8100d60 2024-05-06T21:31:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.268+0000 7f12c67fc700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f12b006e200 0x7f12b00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.268+0000 7f12c67fc700 1 -- 172.21.15.32:0/3751918023 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f12b808dbc0 con 0x7f12c8100d60 2024-05-06T21:31:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.268+0000 7f12cca4d700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f12b006e200 0x7f12b00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:56.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.268+0000 7f12cca4d700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f12b006e200 0x7f12b00706b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f12bc005090 tx=0x7f12bc005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:56.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.273+0000 7f12c67fc700 1 -- 172.21.15.32:0/3751918023 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f12b805a910 con 0x7f12c8100d60 2024-05-06T21:31:56.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.495+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f12c8061190 con 0x7f12b006e200 2024-05-06T21:31:56.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.505+0000 7f12c67fc700 1 -- 172.21.15.32:0/3751918023 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f12c8061190 con 0x7f12b006e200 2024-05-06T21:31:56.503 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:31:56.503 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (12m) 48s ago 13m 24.2M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:31:56.503 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (13m) 48s ago 13m 8426k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:31:56.503 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (12m) 14s ago 12m 7994k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:31:56.503 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (2m) 48s ago 13m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:31:56.503 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (2m) 14s ago 12m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (11m) 48s ago 13m 86.4M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (8m) 48s ago 8m 15.6M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (7m) 48s ago 7m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (7m) 14s ago 7m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (7m) 14s ago 7m 17.6M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (4m) 48s ago 15m 504M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (4m) 14s ago 12m 450M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (3m) 48s ago 15m 46.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (3m) 14s ago 12m 37.7M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (13m) 48s ago 13m 16.3M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (12m) 14s ago 12m 16.5M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:31:56.504 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (2m) 48s ago 11m 157M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:31:56.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (91s) 48s ago 11m 133M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:31:56.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (55s) 48s ago 10m 12.1M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:31:56.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (18s) 14s ago 10m 13.0M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:31:56.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (9m) 14s ago 9m 276M 2240M 18.2.0 dc2bc1663786 33193f54fa96 2024-05-06T21:31:56.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (9m) 14s ago 9m 261M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:31:56.505 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (4m) 48s ago 13m 69.1M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f12b006e200 msgr2=0x7f12b00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f12b006e200 0x7f12b00706b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f12bc005090 tx=0x7f12bc005fb0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8100d60 msgr2=0x7f12c81006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8100d60 0x7f12c81006c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f12b800ada0 tx=0x7f12b800c330 comp rx=0 tx=0).stop 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 shutdown_connections 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f12b006e200 0x7f12b00706b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c8100d60 0x7f12c81006c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 --2- 172.21.15.32:0/3751918023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c8103680 0x7f12c80fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 >> 172.21.15.32:0/3751918023 conn(0x7f12c80fa780 msgr2=0x7f12c80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 shutdown_connections 2024-05-06T21:31:56.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.508+0000 7f12cf4b2700 1 -- 172.21.15.32:0/3751918023 wait complete. 2024-05-06T21:31:56.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.615+0000 7fbbddfc5700 1 -- 172.21.15.32:0/1908199268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 msgr2=0x7fbbd8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.615+0000 7fbbddfc5700 1 --2- 172.21.15.32:0/1908199268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 0x7fbbd8100650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009910 tx=0x7fbbc8009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.615+0000 7fbbddfc5700 1 -- 172.21.15.32:0/1908199268 shutdown_connections 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.615+0000 7fbbddfc5700 1 --2- 172.21.15.32:0/1908199268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbd8101440 0x7fbbd8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.615+0000 7fbbddfc5700 1 --2- 172.21.15.32:0/1908199268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 0x7fbbd8100650 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.615+0000 7fbbddfc5700 1 -- 172.21.15.32:0/1908199268 >> 172.21.15.32:0/1908199268 conn(0x7fbbd80fb7f0 msgr2=0x7fbbd80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.615+0000 7fbbddfc5700 1 -- 172.21.15.32:0/1908199268 shutdown_connections 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.615+0000 7fbbddfc5700 1 -- 172.21.15.32:0/1908199268 wait complete. 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.616+0000 7fbbddfc5700 1 Processor -- start 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.616+0000 7fbbddfc5700 1 -- start start 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.616+0000 7fbbddfc5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 0x7fbbd8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.616+0000 7fbbddfc5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbd8101440 0x7fbbd8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.616+0000 7fbbddfc5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8073680 con 0x7fbbd8100240 2024-05-06T21:31:56.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.616+0000 7fbbddfc5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80737c0 con 0x7fbbd8101440 2024-05-06T21:31:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 0x7fbbd8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 0x7fbbd8074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56868/0 (socket says 172.21.15.32:56868) 2024-05-06T21:31:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd77fe700 1 -- 172.21.15.32:0/377601982 learned_addr learned my addr 172.21.15.32:0/377601982 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd6ffd700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbd8101440 0x7fbbd8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd77fe700 1 -- 172.21.15.32:0/377601982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbd8101440 msgr2=0x7fbbd8073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd77fe700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbd8101440 0x7fbbd8073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd77fe700 1 -- 172.21.15.32:0/377601982 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80095f0 con 0x7fbbd8100240 2024-05-06T21:31:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd77fe700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 0x7fbbd8074af0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800bda0 tx=0x7fbbc800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:56.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd4ff9700 1 -- 172.21.15.32:0/377601982 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbc801d070 con 0x7fbbd8100240 2024-05-06T21:31:56.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd8073a40 con 0x7fbbd8100240 2024-05-06T21:31:56.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd4ff9700 1 -- 172.21.15.32:0/377601982 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbbc8004c50 con 0x7fbbd8100240 2024-05-06T21:31:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbd4ff9700 1 -- 172.21.15.32:0/377601982 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbc800f690 con 0x7fbbd8100240 2024-05-06T21:31:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.617+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd8073f30 con 0x7fbbd8100240 2024-05-06T21:31:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.618+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd8108e10 con 0x7fbbd8100240 2024-05-06T21:31:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.619+0000 7fbbd4ff9700 1 -- 172.21.15.32:0/377601982 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbbc80229b0 con 0x7fbbd8100240 2024-05-06T21:31:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.619+0000 7fbbd4ff9700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbc006e200 0x7fbbc00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.620+0000 7fbbd6ffd700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbc006e200 0x7fbbc00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.620+0000 7fbbd4ff9700 1 -- 172.21.15.32:0/377601982 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fbbc808f990 con 0x7fbbd8100240 2024-05-06T21:31:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.620+0000 7fbbd6ffd700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbc006e200 0x7fbbc00706b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc006fd0 tx=0x7fbbcc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:56.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.624+0000 7fbbd4ff9700 1 -- 172.21.15.32:0/377601982 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fbbc805c790 con 0x7fbbd8100240 2024-05-06T21:31:56.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.926+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbbd819dfe0 con 0x7fbbd8100240 2024-05-06T21:31:56.924 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:56 smithi032 ceph-mon[76650]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:56.924 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:56 smithi032 ceph-mon[76650]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:56.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.926+0000 7fbbd4ff9700 1 -- 172.21.15.32:0/377601982 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fbbc805c320 con 0x7fbbd8100240 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 4 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:31:56.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:31:56.926 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:31:56.926 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-05-06T21:31:56.926 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 8 2024-05-06T21:31:56.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:31:56.926 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:31:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.929+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbc006e200 msgr2=0x7fbbc00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.929+0000 7fbbddfc5700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbc006e200 0x7fbbc00706b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc006fd0 tx=0x7fbbcc008040 comp rx=0 tx=0).stop 2024-05-06T21:31:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.929+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 msgr2=0x7fbbd8074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.929+0000 7fbbddfc5700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 0x7fbbd8074af0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800bda0 tx=0x7fbbc800be80 comp rx=0 tx=0).stop 2024-05-06T21:31:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.929+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 shutdown_connections 2024-05-06T21:31:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.929+0000 7fbbddfc5700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbc006e200 0x7fbbc00706b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.929+0000 7fbbddfc5700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd8100240 0x7fbbd8074af0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.929+0000 7fbbddfc5700 1 --2- 172.21.15.32:0/377601982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbd8101440 0x7fbbd8073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.929+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 >> 172.21.15.32:0/377601982 conn(0x7fbbd80fb7f0 msgr2=0x7fbbd8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:56.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.930+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 shutdown_connections 2024-05-06T21:31:56.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:56.930+0000 7fbbddfc5700 1 -- 172.21.15.32:0/377601982 wait complete. 2024-05-06T21:31:57.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.038+0000 7ff2d36a0700 1 -- 172.21.15.32:0/1444981927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 msgr2=0x7ff2cc0fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.038+0000 7ff2d36a0700 1 --2- 172.21.15.32:0/1444981927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 0x7ff2cc0fe2e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009910 tx=0x7ff2c8009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:57.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.038+0000 7ff2d36a0700 1 -- 172.21.15.32:0/1444981927 shutdown_connections 2024-05-06T21:31:57.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.038+0000 7ff2d36a0700 1 --2- 172.21.15.32:0/1444981927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 0x7ff2cc0fe2e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.038+0000 7ff2d36a0700 1 --2- 172.21.15.32:0/1444981927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc101840 0x7ff2cc101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.038+0000 7ff2d36a0700 1 -- 172.21.15.32:0/1444981927 >> 172.21.15.32:0/1444981927 conn(0x7ff2cc0f9e50 msgr2=0x7ff2cc0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:57.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.039+0000 7ff2d36a0700 1 -- 172.21.15.32:0/1444981927 shutdown_connections 2024-05-06T21:31:57.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.039+0000 7ff2d36a0700 1 -- 172.21.15.32:0/1444981927 wait complete. 2024-05-06T21:31:57.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.039+0000 7ff2d36a0700 1 Processor -- start 2024-05-06T21:31:57.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.039+0000 7ff2d36a0700 1 -- start start 2024-05-06T21:31:57.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.039+0000 7ff2d36a0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc101840 0x7ff2cc195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.039+0000 7ff2d36a0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 0x7ff2cc1960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.039+0000 7ff2d36a0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc1966f0 con 0x7ff2cc102220 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.039+0000 7ff2d36a0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc196830 con 0x7ff2cc101840 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2d0c3b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 0x7ff2cc1960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2d0c3b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 0x7ff2cc1960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56872/0 (socket says 172.21.15.32:56872) 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2d0c3b700 1 -- 172.21.15.32:0/2111412484 learned_addr learned my addr 172.21.15.32:0/2111412484 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2d143c700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc101840 0x7ff2cc195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2d0c3b700 1 -- 172.21.15.32:0/2111412484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc101840 msgr2=0x7ff2cc195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2d0c3b700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc101840 0x7ff2cc195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2d0c3b700 1 -- 172.21.15.32:0/2111412484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c80095f0 con 0x7ff2cc102220 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2d0c3b700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 0x7ff2cc1960d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800bda0 tx=0x7ff2c800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2be7fc700 1 -- 172.21.15.32:0/2111412484 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c801d070 con 0x7ff2cc102220 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2be7fc700 1 -- 172.21.15.32:0/2111412484 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff2c8004c50 con 0x7ff2cc102220 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc19b280 con 0x7ff2cc102220 2024-05-06T21:31:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.040+0000 7ff2be7fc700 1 -- 172.21.15.32:0/2111412484 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c800f690 con 0x7ff2cc102220 2024-05-06T21:31:57.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.041+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc19b770 con 0x7ff2cc102220 2024-05-06T21:31:57.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.042+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc108e40 con 0x7ff2cc102220 2024-05-06T21:31:57.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.042+0000 7ff2be7fc700 1 -- 172.21.15.32:0/2111412484 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff2c800f900 con 0x7ff2cc102220 2024-05-06T21:31:57.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.042+0000 7ff2be7fc700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff2b806e200 0x7ff2b80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:57.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.043+0000 7ff2be7fc700 1 -- 172.21.15.32:0/2111412484 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6769+0+0 (secure 0 0 0) 0x7ff2c808fa80 con 0x7ff2cc102220 2024-05-06T21:31:57.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.043+0000 7ff2d143c700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff2b806e200 0x7ff2b80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:57.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.043+0000 7ff2d143c700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff2b806e200 0x7ff2b80706b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0006fd0 tx=0x7ff2c0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:57.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.047+0000 7ff2be7fc700 1 -- 172.21.15.32:0/2111412484 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff2c805c7d0 con 0x7ff2cc102220 2024-05-06T21:31:57.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:56 smithi154 ceph-mon[63622]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:57.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:56 smithi154 ceph-mon[63622]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:57.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.306+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff2cc109000 con 0x7ff2cc102220 2024-05-06T21:31:57.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.307+0000 7ff2be7fc700 1 -- 172.21.15.32:0/2111412484 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1903 (secure 0 0 0) 0x7ff2c805c360 con 0x7ff2cc102220 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:e22 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 22 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:31:11.981773+0000 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:31:57.305 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:31:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 14486 members: 24277,14486 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:31:57.307 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:31:57.308 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:31:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff2b806e200 msgr2=0x7ff2b80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff2b806e200 0x7ff2b80706b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0006fd0 tx=0x7ff2c0008040 comp rx=0 tx=0).stop 2024-05-06T21:31:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 msgr2=0x7ff2cc1960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 0x7ff2cc1960d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800bda0 tx=0x7ff2c800be80 comp rx=0 tx=0).stop 2024-05-06T21:31:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 shutdown_connections 2024-05-06T21:31:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff2b806e200 0x7ff2b80706b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc101840 0x7ff2cc195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 --2- 172.21.15.32:0/2111412484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2cc102220 0x7ff2cc1960d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 >> 172.21.15.32:0/2111412484 conn(0x7ff2cc0f9e50 msgr2=0x7ff2cc104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 shutdown_connections 2024-05-06T21:31:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.309+0000 7ff2d36a0700 1 -- 172.21.15.32:0/2111412484 wait complete. 2024-05-06T21:31:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 22 2024-05-06T21:31:57.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 -- 172.21.15.32:0/615574659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 msgr2=0x7f71540fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 --2- 172.21.15.32:0/615574659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 0x7f71540fecd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7150009910 tx=0x7f7150009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:57.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 -- 172.21.15.32:0/615574659 shutdown_connections 2024-05-06T21:31:57.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 --2- 172.21.15.32:0/615574659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71540ffb60 0x7f71540fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 --2- 172.21.15.32:0/615574659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 0x7f71540fecd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 -- 172.21.15.32:0/615574659 >> 172.21.15.32:0/615574659 conn(0x7f71540f9f10 msgr2=0x7f71540fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 -- 172.21.15.32:0/615574659 shutdown_connections 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 -- 172.21.15.32:0/615574659 wait complete. 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 Processor -- start 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.419+0000 7f715c121700 1 -- start start 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f715c121700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 0x7f7154195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f715c121700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71540ffb60 0x7f7154196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f715c121700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71541965d0 con 0x7f71540fe8c0 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f715c121700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7154196710 con 0x7f71540ffb60 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f7159ebd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 0x7f7154195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f7159ebd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 0x7f7154195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56882/0 (socket says 172.21.15.32:56882) 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f7159ebd700 1 -- 172.21.15.32:0/362271341 learned_addr learned my addr 172.21.15.32:0/362271341 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:57.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f71596bc700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71540ffb60 0x7f7154196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f7159ebd700 1 -- 172.21.15.32:0/362271341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71540ffb60 msgr2=0x7f7154196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f7159ebd700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71540ffb60 0x7f7154196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f7159ebd700 1 -- 172.21.15.32:0/362271341 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71500095f0 con 0x7f71540fe8c0 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f71596bc700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71540ffb60 0x7f7154196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f7159ebd700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 0x7f7154195b00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f715000bd70 tx=0x7f715000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f714affd700 1 -- 172.21.15.32:0/362271341 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715001d070 con 0x7f71540fe8c0 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715419b170 con 0x7f71540fe8c0 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f714affd700 1 -- 172.21.15.32:0/362271341 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7150022470 con 0x7f71540fe8c0 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f714affd700 1 -- 172.21.15.32:0/362271341 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715000f670 con 0x7f71540fe8c0 2024-05-06T21:31:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.420+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715419b630 con 0x7f71540fe8c0 2024-05-06T21:31:57.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.421+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715418fa10 con 0x7f71540fe8c0 2024-05-06T21:31:57.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.422+0000 7f714affd700 1 -- 172.21.15.32:0/362271341 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7150022a50 con 0x7f71540fe8c0 2024-05-06T21:31:57.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.423+0000 7f714affd700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f714006e200 0x7f71400706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:57.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.423+0000 7f714affd700 1 -- 172.21.15.32:0/362271341 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f715008f8c0 con 0x7f71540fe8c0 2024-05-06T21:31:57.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.423+0000 7f71596bc700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f714006e200 0x7f71400706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:57.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.423+0000 7f71596bc700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f714006e200 0x7f71400706b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7144005fd0 tx=0x7f7144005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:57.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.427+0000 7f714affd700 1 -- 172.21.15.32:0/362271341 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f715005c6c0 con 0x7f71540fe8c0 2024-05-06T21:31:57.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.660+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7154061190 con 0x7f714006e200 2024-05-06T21:31:57.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.661+0000 7f714affd700 1 -- 172.21.15.32:0/362271341 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7154061190 con 0x7f714006e200 2024-05-06T21:31:57.659 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:31:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:31:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:31:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:31:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:31:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:31:57.659 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:31:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:31:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:31:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "10/23 daemons upgraded", 2024-05-06T21:31:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T21:31:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:31:57.660 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:31:57.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f714006e200 msgr2=0x7f71400706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f714006e200 0x7f71400706b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7144005fd0 tx=0x7f7144005e20 comp rx=0 tx=0).stop 2024-05-06T21:31:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 msgr2=0x7f7154195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 0x7f7154195b00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f715000bd70 tx=0x7f715000be50 comp rx=0 tx=0).stop 2024-05-06T21:31:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 shutdown_connections 2024-05-06T21:31:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f714006e200 0x7f71400706b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71540fe8c0 0x7f7154195b00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 --2- 172.21.15.32:0/362271341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71540ffb60 0x7f7154196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 >> 172.21.15.32:0/362271341 conn(0x7f71540f9f10 msgr2=0x7f7154102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 shutdown_connections 2024-05-06T21:31:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.664+0000 7f715c121700 1 -- 172.21.15.32:0/362271341 wait complete. 2024-05-06T21:31:57.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.782+0000 7f766bfe7700 1 -- 172.21.15.32:0/1614003637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 msgr2=0x7f76640ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.782+0000 7f766bfe7700 1 --2- 172.21.15.32:0/1614003637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 0x7f76640ff910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7654009910 tx=0x7f7654009c20 comp rx=0 tx=0).stop 2024-05-06T21:31:57.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.782+0000 7f766bfe7700 1 -- 172.21.15.32:0/1614003637 shutdown_connections 2024-05-06T21:31:57.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.782+0000 7f766bfe7700 1 --2- 172.21.15.32:0/1614003637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 0x7f76640ff910 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.782+0000 7f766bfe7700 1 --2- 172.21.15.32:0/1614003637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76640feb50 0x7f76640fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.782+0000 7f766bfe7700 1 -- 172.21.15.32:0/1614003637 >> 172.21.15.32:0/1614003637 conn(0x7f76640fa780 msgr2=0x7f76640fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:57.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.782+0000 7f766bfe7700 1 -- 172.21.15.32:0/1614003637 shutdown_connections 2024-05-06T21:31:57.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.782+0000 7f766bfe7700 1 -- 172.21.15.32:0/1614003637 wait complete. 2024-05-06T21:31:57.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f766bfe7700 1 Processor -- start 2024-05-06T21:31:57.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f766bfe7700 1 -- start start 2024-05-06T21:31:57.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f766bfe7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76640feb50 0x7f7664197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:57.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f766bfe7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 0x7f7664198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:57.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f766bfe7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7664198840 con 0x7f76640ff4a0 2024-05-06T21:31:57.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f766bfe7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766419d250 con 0x7f76640feb50 2024-05-06T21:31:57.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f7669582700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 0x7f7664198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:57.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f7669582700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 0x7f7664198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56906/0 (socket says 172.21.15.32:56906) 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f7669582700 1 -- 172.21.15.32:0/4007580365 learned_addr learned my addr 172.21.15.32:0/4007580365 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.783+0000 7f7669d83700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76640feb50 0x7f7664197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.784+0000 7f7669582700 1 -- 172.21.15.32:0/4007580365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76640feb50 msgr2=0x7f7664197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.784+0000 7f7669582700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76640feb50 0x7f7664197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.784+0000 7f7669582700 1 -- 172.21.15.32:0/4007580365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76540095f0 con 0x7f76640ff4a0 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.784+0000 7f7669582700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 0x7f7664198220 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f765400b5c0 tx=0x7f765400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.784+0000 7f765affd700 1 -- 172.21.15.32:0/4007580365 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f765401d070 con 0x7f76640ff4a0 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.784+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766419d3f0 con 0x7f76640ff4a0 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.784+0000 7f765affd700 1 -- 172.21.15.32:0/4007580365 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f765400f460 con 0x7f76640ff4a0 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.784+0000 7f765affd700 1 -- 172.21.15.32:0/4007580365 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7654021640 con 0x7f76640ff4a0 2024-05-06T21:31:57.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.784+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766419d8b0 con 0x7f76640ff4a0 2024-05-06T21:31:57.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.785+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766410aef0 con 0x7f76640ff4a0 2024-05-06T21:31:57.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.786+0000 7f765affd700 1 -- 172.21.15.32:0/4007580365 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7654003a60 con 0x7f76640ff4a0 2024-05-06T21:31:57.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.786+0000 7f765affd700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f765006e200 0x7f76500706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:31:57.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.786+0000 7f765affd700 1 -- 172.21.15.32:0/4007580365 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f765408f600 con 0x7f76640ff4a0 2024-05-06T21:31:57.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.786+0000 7f7669d83700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f765006e200 0x7f76500706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:31:57.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.787+0000 7f7669d83700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f765006e200 0x7f76500706b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7660005950 tx=0x7f76600058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:31:57.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:57.791+0000 7f765affd700 1 -- 172.21.15.32:0/4007580365 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7654058820 con 0x7f76640ff4a0 2024-05-06T21:31:57.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:57 smithi032 ceph-mon[76650]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:57.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:57 smithi032 ceph-mon[76650]: pgmap v142: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:57.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:57 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/377601982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:57.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:57 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2111412484' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:31:58.016 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:57 smithi154 ceph-mon[63622]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:58.017 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:57 smithi154 ceph-mon[63622]: pgmap v142: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:31:58.017 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:57 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/377601982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:31:58.017 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:57 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2111412484' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:31:58.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.090+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f766410b0b0 con 0x7f76640ff4a0 2024-05-06T21:31:58.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.091+0000 7f765affd700 1 -- 172.21.15.32:0/4007580365 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f765405bee0 con 0x7f76640ff4a0 2024-05-06T21:31:58.088 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f765006e200 msgr2=0x7f76500706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f765006e200 0x7f76500706b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7660005950 tx=0x7f76600058e0 comp rx=0 tx=0).stop 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 msgr2=0x7f7664198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 0x7f7664198220 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f765400b5c0 tx=0x7f765400be20 comp rx=0 tx=0).stop 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 shutdown_connections 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f765006e200 0x7f76500706b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76640feb50 0x7f7664197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 --2- 172.21.15.32:0/4007580365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76640ff4a0 0x7f7664198220 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 >> 172.21.15.32:0/4007580365 conn(0x7f76640fa780 msgr2=0x7f7664107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 shutdown_connections 2024-05-06T21:31:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:31:58.093+0000 7f766bfe7700 1 -- 172.21.15.32:0/4007580365 wait complete. 2024-05-06T21:31:58.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:58 smithi032 ceph-mon[76650]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:58.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:58 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4007580365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:31:59.034 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:58 smithi154 ceph-mon[63622]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:31:59.034 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:58 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4007580365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:31:59.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:31:59 smithi032 ceph-mon[76650]: pgmap v143: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:00.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:31:59 smithi154 ceph-mon[63622]: pgmap v143: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:01.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:01 smithi154 ceph-mon[63622]: pgmap v144: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:01.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:01 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:01.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:01 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T21:32:01.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:01 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T21:32:01.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:01 smithi154 ceph-mon[63622]: Upgrade: osd.4 is safe to restart 2024-05-06T21:32:01.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:01 smithi032 ceph-mon[76650]: pgmap v144: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:01.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:01 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:01.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:01 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T21:32:01.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:01 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T21:32:01.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:01 smithi032 ceph-mon[76650]: Upgrade: osd.4 is safe to restart 2024-05-06T21:32:03.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:03 smithi032 ceph-mon[76650]: Upgrade: Updating osd.4 2024-05-06T21:32:03.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:03 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:03.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:03 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T21:32:03.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:03 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:03.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:03 smithi032 ceph-mon[76650]: Deploying daemon osd.4 on smithi154 2024-05-06T21:32:03.721 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:03 smithi032 ceph-mon[76650]: pgmap v145: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:03.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:03 smithi154 ceph-mon[63622]: Upgrade: Updating osd.4 2024-05-06T21:32:03.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:03 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:03.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:03 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T21:32:03.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:03 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:03.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:03 smithi154 ceph-mon[63622]: Deploying daemon osd.4 on smithi154 2024-05-06T21:32:03.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:03 smithi154 ceph-mon[63622]: pgmap v145: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:05.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:05 smithi154 ceph-mon[63622]: pgmap v146: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:05.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:05.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:32:05.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:05 smithi154 systemd[1]: Stopping Ceph osd.4 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:32:05.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:05 smithi032 ceph-mon[76650]: pgmap v146: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:05.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:05.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:32:06.365 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:05 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[43600]: 2024-05-06T21:32:05.936+0000 7f4600510700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:32:06.365 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:05 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[43600]: 2024-05-06T21:32:05.936+0000 7f4600510700 -1 osd.4 81 *** Got signal Terminated *** 2024-05-06T21:32:06.365 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:05 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[43600]: 2024-05-06T21:32:05.936+0000 7f4600510700 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:32:06.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:06 smithi032 ceph-mon[76650]: osd.4 marked itself down and dead 2024-05-06T21:32:07.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:06 smithi154 ceph-mon[63622]: osd.4 marked itself down and dead 2024-05-06T21:32:07.574 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:07 smithi154 podman[71274]: 2024-05-06 21:32:07.256495822 +0000 UTC m=+1.432352524 container died 33193f54fa9678549e972ca86374860a6eb038b2665499d8c9e824fb8e0f6395 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, RELEASE=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, GIT_CLEAN=True, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-06T21:32:07.574 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:07 smithi154 podman[71274]: 2024-05-06 21:32:07.578105038 +0000 UTC m=+1.753961735 container cleanup 33193f54fa9678549e972ca86374860a6eb038b2665499d8c9e824fb8e0f6395 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, GIT_CLEAN=True) 2024-05-06T21:32:07.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:07 smithi154 ceph-mon[63622]: pgmap v147: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:07.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:07 smithi154 ceph-mon[63622]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:32:07.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:07 smithi154 ceph-mon[63622]: osdmap e82: 6 total, 5 up, 6 in 2024-05-06T21:32:07.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:07 smithi154 bash[71274]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4 2024-05-06T21:32:07.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:07 smithi154 podman[71293]: 2024-05-06 21:32:07.804568797 +0000 UTC m=+0.543008996 container remove 33193f54fa9678549e972ca86374860a6eb038b2665499d8c9e824fb8e0f6395 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-05-06T21:32:07.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:07 smithi032 ceph-mon[76650]: pgmap v147: 65 pgs: 65 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:07.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:07 smithi032 ceph-mon[76650]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:32:07.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:07 smithi032 ceph-mon[76650]: osdmap e82: 6 total, 5 up, 6 in 2024-05-06T21:32:08.513 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:08 smithi154 podman[71380]: 2024-05-06 21:32:08.133868814 +0000 UTC m=+0.018355873 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:32:08.513 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:08 smithi154 podman[71380]: 2024-05-06 21:32:08.238714437 +0000 UTC m=+0.123201518 container create ced9cd9e7508c597ba5a2fda61e0cd29bef08a001e2d7dfdb7304deb28c7f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:32:08.513 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:08 smithi154 podman[71380]: 2024-05-06 21:32:08.457907002 +0000 UTC m=+0.342394042 container init ced9cd9e7508c597ba5a2fda61e0cd29bef08a001e2d7dfdb7304deb28c7f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-06T21:32:08.513 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:08 smithi154 podman[71380]: 2024-05-06 21:32:08.461481808 +0000 UTC m=+0.345968858 container start ced9cd9e7508c597ba5a2fda61e0cd29bef08a001e2d7dfdb7304deb28c7f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:32:08.513 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:08 smithi154 podman[71380]: 2024-05-06 21:32:08.516095215 +0000 UTC m=+0.400582255 container attach ced9cd9e7508c597ba5a2fda61e0cd29bef08a001e2d7dfdb7304deb28c7f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240430) 2024-05-06T21:32:08.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:08 smithi154 ceph-mon[63622]: osdmap e83: 6 total, 5 up, 6 in 2024-05-06T21:32:08.865 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:08 smithi154 podman[71380]: 2024-05-06 21:32:08.751982931 +0000 UTC m=+0.636469983 container died ced9cd9e7508c597ba5a2fda61e0cd29bef08a001e2d7dfdb7304deb28c7f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.build-date=20240430, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T21:32:08.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:08 smithi032 ceph-mon[76650]: osdmap e83: 6 total, 5 up, 6 in 2024-05-06T21:32:09.718 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:09 smithi154 podman[71406]: 2024-05-06 21:32:09.420320236 +0000 UTC m=+0.658609189 container remove ced9cd9e7508c597ba5a2fda61e0cd29bef08a001e2d7dfdb7304deb28c7f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-05-06T21:32:09.719 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:09 smithi154 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.4.service: Deactivated successfully. 2024-05-06T21:32:09.719 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:09 smithi154 systemd[1]: Stopped Ceph osd.4 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:32:09.719 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:09 smithi154 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.4.service: Consumed 1min 2.021s CPU time. 2024-05-06T21:32:09.719 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:09 smithi154 systemd[1]: Starting Ceph osd.4 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:32:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:09 smithi032 ceph-mon[76650]: pgmap v150: 65 pgs: 12 peering, 4 stale+active+clean, 49 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:09 smithi032 ceph-mon[76650]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-06T21:32:09.992 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:09 smithi154 ceph-mon[63622]: pgmap v150: 65 pgs: 12 peering, 4 stale+active+clean, 49 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:09.992 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:09 smithi154 ceph-mon[63622]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-06T21:32:09.993 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:09 smithi154 podman[71515]: 2024-05-06 21:32:09.769326421 +0000 UTC m=+0.018676253 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:32:09.993 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:09 smithi154 podman[71515]: 2024-05-06 21:32:09.871677379 +0000 UTC m=+0.121027234 container create 6f41267c3aed3f9b6267d47b04ea51fe06d3df639bf93fb0e75f6412c768bf74 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-05-06T21:32:10.365 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 podman[71515]: 2024-05-06 21:32:10.116261545 +0000 UTC m=+0.365611362 container init 6f41267c3aed3f9b6267d47b04ea51fe06d3df639bf93fb0e75f6412c768bf74 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-06T21:32:10.365 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 podman[71515]: 2024-05-06 21:32:10.119903332 +0000 UTC m=+0.369253146 container start 6f41267c3aed3f9b6267d47b04ea51fe06d3df639bf93fb0e75f6412c768bf74 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-06T21:32:10.365 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 podman[71515]: 2024-05-06 21:32:10.190958399 +0000 UTC m=+0.440308226 container attach 6f41267c3aed3f9b6267d47b04ea51fe06d3df639bf93fb0e75f6412c768bf74 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-06T21:32:10.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:10 smithi154 ceph-mon[63622]: Health check failed: Degraded data redundancy: 41/366 objects degraded (11.202%), 9 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:10.865 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate[71530]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T21:32:10.865 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate[71530]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T21:32:10.865 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 bash[71515]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 bash[71515]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 bash[71515]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 bash[71515]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 bash[71515]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 bash[71515]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 bash[71515]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate[71530]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate[71530]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate[71530]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate[71530]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate[71530]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-06T21:32:10.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:10 smithi154 podman[71515]: 2024-05-06 21:32:10.598886662 +0000 UTC m=+0.848236486 container died 6f41267c3aed3f9b6267d47b04ea51fe06d3df639bf93fb0e75f6412c768bf74 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5) 2024-05-06T21:32:11.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:10 smithi032 ceph-mon[76650]: Health check failed: Degraded data redundancy: 41/366 objects degraded (11.202%), 9 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:11.527 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:11 smithi154 podman[71660]: 2024-05-06 21:32:11.195088502 +0000 UTC m=+0.589664256 container remove 6f41267c3aed3f9b6267d47b04ea51fe06d3df639bf93fb0e75f6412c768bf74 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240430, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5) 2024-05-06T21:32:11.527 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:11 smithi154 podman[71723]: 2024-05-06 21:32:11.313406969 +0000 UTC m=+0.019200189 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:32:11.527 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:11 smithi154 podman[71723]: 2024-05-06 21:32:11.420897256 +0000 UTC m=+0.126690447 container create 75a59e4cc4c7288177cb552ec5872aac7aef6292d5739cdd3e2a6cc064808cae (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-05-06T21:32:11.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:11 smithi154 ceph-mon[63622]: pgmap v151: 65 pgs: 7 active+undersized, 9 active+undersized+degraded, 12 peering, 1 stale+active+clean, 36 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/366 objects degraded (11.202%) 2024-05-06T21:32:11.865 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:11 smithi154 podman[71723]: 2024-05-06 21:32:11.631868642 +0000 UTC m=+0.337661833 container init 75a59e4cc4c7288177cb552ec5872aac7aef6292d5739cdd3e2a6cc064808cae (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T21:32:11.865 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:11 smithi154 podman[71723]: 2024-05-06 21:32:11.635105653 +0000 UTC m=+0.340898846 container start 75a59e4cc4c7288177cb552ec5872aac7aef6292d5739cdd3e2a6cc064808cae (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-06T21:32:11.865 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:11 smithi154 ceph-osd[71742]: -- 172.21.15.154:0/3436612006 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572257b9680 con 0x557225782c00 2024-05-06T21:32:11.865 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:11 smithi154 bash[71723]: 75a59e4cc4c7288177cb552ec5872aac7aef6292d5739cdd3e2a6cc064808cae 2024-05-06T21:32:11.866 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:11 smithi154 systemd[1]: Started Ceph osd.4 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:32:12.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:11 smithi032 ceph-mon[76650]: pgmap v151: 65 pgs: 7 active+undersized, 9 active+undersized+degraded, 12 peering, 1 stale+active+clean, 36 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/366 objects degraded (11.202%) 2024-05-06T21:32:12.600 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:12 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:32:12.173+0000 7fbaeafe57c0 -1 Falling back to public interface 2024-05-06T21:32:12.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:12.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:12.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:13.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:13.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:13.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:14.078 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:13 smithi154 ceph-mon[63622]: pgmap v152: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:14.078 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:13 smithi154 ceph-mon[63622]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-06T21:32:14.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:13 smithi032 ceph-mon[76650]: pgmap v152: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:14.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:13 smithi032 ceph-mon[76650]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-06T21:32:16.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:15 smithi154 ceph-mon[63622]: pgmap v153: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:16.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:16.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:16.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:15 smithi032 ceph-mon[76650]: pgmap v153: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:16.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:16.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:16.942 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:16 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:32:16.784+0000 7fbaeafe57c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-05-06T21:32:17.296 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:17.296 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:17.296 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:16 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 62/366 objects degraded (16.940%), 16 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:17.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:17.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:17.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:16 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 62/366 objects degraded (16.940%), 16 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:17.615 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:17 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:32:17.298+0000 7fbaeafe57c0 -1 osd.4 81 log_to_monitors true 2024-05-06T21:32:18.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:18 smithi032 ceph-mon[76650]: pgmap v154: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:18.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:18 smithi032 ceph-mon[76650]: from='osd.4 [v2:172.21.15.154:6808/3787543137,v1:172.21.15.154:6809/3787543137]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T21:32:18.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:18 smithi032 ceph-mon[76650]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T21:32:18.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:18 smithi154 ceph-mon[63622]: pgmap v154: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:18.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:18 smithi154 ceph-mon[63622]: from='osd.4 [v2:172.21.15.154:6808/3787543137,v1:172.21.15.154:6809/3787543137]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T21:32:18.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:18 smithi154 ceph-mon[63622]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T21:32:19.073 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:32:18 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:32:18.825+0000 7fbad8434700 -1 osd.4 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:32:19.073 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:19 smithi154 ceph-mon[63622]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T21:32:19.073 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:19 smithi154 ceph-mon[63622]: osdmap e84: 6 total, 5 up, 6 in 2024-05-06T21:32:19.073 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:19 smithi154 ceph-mon[63622]: from='osd.4 [v2:172.21.15.154:6808/3787543137,v1:172.21.15.154:6809/3787543137]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:32:19.073 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:19 smithi154 ceph-mon[63622]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:32:19.074 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:19 smithi154 ceph-mon[63622]: from='osd.4 ' entity='osd.4' 2024-05-06T21:32:19.333 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:19 smithi032 ceph-mon[76650]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T21:32:19.333 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:19 smithi032 ceph-mon[76650]: osdmap e84: 6 total, 5 up, 6 in 2024-05-06T21:32:19.333 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:19 smithi032 ceph-mon[76650]: from='osd.4 [v2:172.21.15.154:6808/3787543137,v1:172.21.15.154:6809/3787543137]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:32:19.333 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:19 smithi032 ceph-mon[76650]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:32:19.333 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:19 smithi032 ceph-mon[76650]: from='osd.4 ' entity='osd.4' 2024-05-06T21:32:20.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: pgmap v156: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: osd.4 [v2:172.21.15.154:6808/3787543137,v1:172.21.15.154:6809/3787543137] boot 2024-05-06T21:32:20.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: osdmap e85: 6 total, 6 up, 6 in 2024-05-06T21:32:20.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:32:20.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: pgmap v156: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:20.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:20.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:20.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:20.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:32:20.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:20.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:20.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:20.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:20.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:20.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T21:32:20.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:32:20.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: osd.4 [v2:172.21.15.154:6808/3787543137,v1:172.21.15.154:6809/3787543137] boot 2024-05-06T21:32:20.617 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: osdmap e85: 6 total, 6 up, 6 in 2024-05-06T21:32:20.618 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T21:32:21.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:21 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T21:32:21.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:21 smithi032 ceph-mon[76650]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-05-06T21:32:21.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:21.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:32:21.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:21 smithi032 ceph-mon[76650]: osdmap e86: 6 total, 6 up, 6 in 2024-05-06T21:32:21.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:21 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T21:32:21.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:21 smithi154 ceph-mon[63622]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-05-06T21:32:21.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:21.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:32:21.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:21 smithi154 ceph-mon[63622]: osdmap e86: 6 total, 6 up, 6 in 2024-05-06T21:32:22.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:22 smithi032 ceph-mon[76650]: pgmap v158: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:22.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:22 smithi154 ceph-mon[63622]: pgmap v158: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2024-05-06T21:32:23.371 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:23 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 43/366 objects degraded (11.749%), 10 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:23.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:23 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 43/366 objects degraded (11.749%), 10 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:24.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:24 smithi154 ceph-mon[63622]: pgmap v160: 65 pgs: 9 active+undersized, 10 active+undersized+degraded, 46 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/366 objects degraded (11.749%) 2024-05-06T21:32:24.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:24 smithi032 ceph-mon[76650]: pgmap v160: 65 pgs: 9 active+undersized, 10 active+undersized+degraded, 46 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/366 objects degraded (11.749%) 2024-05-06T21:32:26.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:26 smithi154 ceph-mon[63622]: pgmap v161: 65 pgs: 3 active+undersized, 5 active+undersized+degraded, 57 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 26/366 objects degraded (7.104%) 2024-05-06T21:32:26.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:26 smithi032 ceph-mon[76650]: pgmap v161: 65 pgs: 3 active+undersized, 5 active+undersized+degraded, 57 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 26/366 objects degraded (7.104%) 2024-05-06T21:32:27.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:27 smithi154 ceph-mon[63622]: pgmap v162: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:27.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:27 smithi154 ceph-mon[63622]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/366 objects degraded (7.104%), 5 pgs degraded) 2024-05-06T21:32:27.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:27 smithi154 ceph-mon[63622]: Cluster is now healthy 2024-05-06T21:32:27.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:27 smithi032 ceph-mon[76650]: pgmap v162: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:27.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:27 smithi032 ceph-mon[76650]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/366 objects degraded (7.104%), 5 pgs degraded) 2024-05-06T21:32:27.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:27 smithi032 ceph-mon[76650]: Cluster is now healthy 2024-05-06T21:32:28.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.210+0000 7f253cae2700 1 -- 172.21.15.32:0/4160341926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2538103330 msgr2=0x7f25381057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.210+0000 7f253cae2700 1 --2- 172.21.15.32:0/4160341926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2538103330 0x7f25381057b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2528009910 tx=0x7f2528009c20 comp rx=0 tx=0).stop 2024-05-06T21:32:28.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.211+0000 7f253cae2700 1 -- 172.21.15.32:0/4160341926 shutdown_connections 2024-05-06T21:32:28.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.211+0000 7f253cae2700 1 --2- 172.21.15.32:0/4160341926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2538103330 0x7f25381057b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.211+0000 7f253cae2700 1 --2- 172.21.15.32:0/4160341926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2538069b00 0x7f2538102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.211+0000 7f253cae2700 1 -- 172.21.15.32:0/4160341926 >> 172.21.15.32:0/4160341926 conn(0x7f25380fa7a0 msgr2=0x7f25380fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:28.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.211+0000 7f253cae2700 1 -- 172.21.15.32:0/4160341926 shutdown_connections 2024-05-06T21:32:28.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.211+0000 7f253cae2700 1 -- 172.21.15.32:0/4160341926 wait complete. 2024-05-06T21:32:28.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.211+0000 7f253cae2700 1 Processor -- start 2024-05-06T21:32:28.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.211+0000 7f253cae2700 1 -- start start 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f253cae2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2538103330 0x7f2538100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f253cae2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25380fed90 0x7f25380ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f253cae2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25380ff740 con 0x7f25380fed90 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f253cae2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25380ff8b0 con 0x7f2538103330 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f2535d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25380fed90 0x7f25380ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f2535d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25380fed90 0x7f25380ff200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59490/0 (socket says 172.21.15.32:59490) 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f2535d9b700 1 -- 172.21.15.32:0/2464232833 learned_addr learned my addr 172.21.15.32:0/2464232833 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f253659c700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2538103330 0x7f2538100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f2535d9b700 1 -- 172.21.15.32:0/2464232833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2538103330 msgr2=0x7f2538100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f2535d9b700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2538103330 0x7f2538100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f2535d9b700 1 -- 172.21.15.32:0/2464232833 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25280095f0 con 0x7f25380fed90 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.212+0000 7f2535d9b700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25380fed90 0x7f25380ff200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2528000c00 tx=0x7f252800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:28.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.213+0000 7f252f7fe700 1 -- 172.21.15.32:0/2464232833 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252801d070 con 0x7f25380fed90 2024-05-06T21:32:28.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.213+0000 7f252f7fe700 1 -- 172.21.15.32:0/2464232833 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2528005dc0 con 0x7f25380fed90 2024-05-06T21:32:28.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.213+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25380ffb30 con 0x7f25380fed90 2024-05-06T21:32:28.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.213+0000 7f252f7fe700 1 -- 172.21.15.32:0/2464232833 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25280226a0 con 0x7f25380fed90 2024-05-06T21:32:28.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.213+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253819e020 con 0x7f25380fed90 2024-05-06T21:32:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.214+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253818fc10 con 0x7f25380fed90 2024-05-06T21:32:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.215+0000 7f252f7fe700 1 -- 172.21.15.32:0/2464232833 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f25280038f0 con 0x7f25380fed90 2024-05-06T21:32:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.215+0000 7f252f7fe700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f252406e200 0x7f25240706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.215+0000 7f252f7fe700 1 -- 172.21.15.32:0/2464232833 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f252808f9b0 con 0x7f25380fed90 2024-05-06T21:32:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.215+0000 7f253659c700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f252406e200 0x7f25240706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.216+0000 7f253659c700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f252406e200 0x7f25240706b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2538069830 tx=0x7f2520009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:28.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.219+0000 7f252f7fe700 1 -- 172.21.15.32:0/2464232833 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f252805c820 con 0x7f25380fed90 2024-05-06T21:32:28.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.452+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2538061190 con 0x7f252406e200 2024-05-06T21:32:28.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.453+0000 7f252f7fe700 1 -- 172.21.15.32:0/2464232833 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2538061190 con 0x7f252406e200 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.455+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f252406e200 msgr2=0x7f25240706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.455+0000 7f253cae2700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f252406e200 0x7f25240706b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2538069830 tx=0x7f2520009260 comp rx=0 tx=0).stop 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.455+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25380fed90 msgr2=0x7f25380ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.455+0000 7f253cae2700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25380fed90 0x7f25380ff200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2528000c00 tx=0x7f252800f690 comp rx=0 tx=0).stop 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.455+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 shutdown_connections 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.455+0000 7f253cae2700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f252406e200 0x7f25240706b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.455+0000 7f253cae2700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2538103330 0x7f2538100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.455+0000 7f253cae2700 1 --2- 172.21.15.32:0/2464232833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25380fed90 0x7f25380ff200 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.455+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 >> 172.21.15.32:0/2464232833 conn(0x7f25380fa7a0 msgr2=0x7f25380fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.456+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 shutdown_connections 2024-05-06T21:32:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.456+0000 7f253cae2700 1 -- 172.21.15.32:0/2464232833 wait complete. 2024-05-06T21:32:28.463 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:32:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.565+0000 7f0444aa5700 1 -- 172.21.15.32:0/3280210836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440102200 msgr2=0x7f04400fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.565+0000 7f0444aa5700 1 --2- 172.21.15.32:0/3280210836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440102200 0x7f04400fe2e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0434009910 tx=0x7f0434009c20 comp rx=0 tx=0).stop 2024-05-06T21:32:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.566+0000 7f0444aa5700 1 -- 172.21.15.32:0/3280210836 shutdown_connections 2024-05-06T21:32:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.566+0000 7f0444aa5700 1 --2- 172.21.15.32:0/3280210836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440102200 0x7f04400fe2e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.566+0000 7f0444aa5700 1 --2- 172.21.15.32:0/3280210836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0440101820 0x7f0440101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.566+0000 7f0444aa5700 1 -- 172.21.15.32:0/3280210836 >> 172.21.15.32:0/3280210836 conn(0x7f04400f9e50 msgr2=0x7f04400fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.566+0000 7f0444aa5700 1 -- 172.21.15.32:0/3280210836 shutdown_connections 2024-05-06T21:32:28.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.566+0000 7f0444aa5700 1 -- 172.21.15.32:0/3280210836 wait complete. 2024-05-06T21:32:28.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.566+0000 7f0444aa5700 1 Processor -- start 2024-05-06T21:32:28.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.566+0000 7f0444aa5700 1 -- start start 2024-05-06T21:32:28.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f0444aa5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440101820 0x7f0440100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:28.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f0444aa5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0440102200 0x7f04400ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f0444aa5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04400ffab0 con 0x7f0440101820 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f0444aa5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04400ffbf0 con 0x7f0440102200 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f043e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440101820 0x7f0440100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f043e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440101820 0x7f0440100f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59498/0 (socket says 172.21.15.32:59498) 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f043e59c700 1 -- 172.21.15.32:0/149867237 learned_addr learned my addr 172.21.15.32:0/149867237 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f043dd9b700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0440102200 0x7f04400ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f043e59c700 1 -- 172.21.15.32:0/149867237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0440102200 msgr2=0x7f04400ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f043e59c700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0440102200 0x7f04400ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f043e59c700 1 -- 172.21.15.32:0/149867237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340095f0 con 0x7f0440101820 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f043e59c700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440101820 0x7f0440100f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f043000d900 tx=0x7f043000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f042f7fe700 1 -- 172.21.15.32:0/149867237 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04300041f0 con 0x7f0440101820 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f042f7fe700 1 -- 172.21.15.32:0/149867237 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0430004350 con 0x7f0440101820 2024-05-06T21:32:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.567+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04400ffed0 con 0x7f0440101820 2024-05-06T21:32:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.568+0000 7f042f7fe700 1 -- 172.21.15.32:0/149867237 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0430003da0 con 0x7f0440101820 2024-05-06T21:32:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.568+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044019db40 con 0x7f0440101820 2024-05-06T21:32:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.568+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0440108d90 con 0x7f0440101820 2024-05-06T21:32:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.569+0000 7f042f7fe700 1 -- 172.21.15.32:0/149867237 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0430009730 con 0x7f0440101820 2024-05-06T21:32:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.569+0000 7f042f7fe700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f042806e200 0x7f04280706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.570+0000 7f042f7fe700 1 -- 172.21.15.32:0/149867237 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f043008e2d0 con 0x7f0440101820 2024-05-06T21:32:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.570+0000 7f043dd9b700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f042806e200 0x7f04280706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.570+0000 7f043dd9b700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f042806e200 0x7f04280706b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0434006010 tx=0x7f043400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:28.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.574+0000 7f042f7fe700 1 -- 172.21.15.32:0/149867237 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f043005b0a0 con 0x7f0440101820 2024-05-06T21:32:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.806+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f044019e0f0 con 0x7f042806e200 2024-05-06T21:32:28.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.807+0000 7f042f7fe700 1 -- 172.21.15.32:0/149867237 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f044019e0f0 con 0x7f042806e200 2024-05-06T21:32:28.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f042806e200 msgr2=0x7f04280706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f042806e200 0x7f04280706b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0434006010 tx=0x7f043400b540 comp rx=0 tx=0).stop 2024-05-06T21:32:28.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440101820 msgr2=0x7f0440100f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440101820 0x7f0440100f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f043000d900 tx=0x7f043000dcc0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 shutdown_connections 2024-05-06T21:32:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f042806e200 0x7f04280706b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440101820 0x7f0440100f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 --2- 172.21.15.32:0/149867237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0440102200 0x7f04400ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 >> 172.21.15.32:0/149867237 conn(0x7f04400f9e50 msgr2=0x7f04401047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 shutdown_connections 2024-05-06T21:32:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.809+0000 7f0444aa5700 1 -- 172.21.15.32:0/149867237 wait complete. 2024-05-06T21:32:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.919+0000 7f021fa3e700 1 -- 172.21.15.32:0/2124976936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 msgr2=0x7f0218100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.919+0000 7f021fa3e700 1 --2- 172.21.15.32:0/2124976936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 0x7f0218100860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f020c009990 tx=0x7f020c009ca0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.919+0000 7f021fa3e700 1 -- 172.21.15.32:0/2124976936 shutdown_connections 2024-05-06T21:32:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.919+0000 7f021fa3e700 1 --2- 172.21.15.32:0/2124976936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 0x7f0218100860 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.920+0000 7f021fa3e700 1 --2- 172.21.15.32:0/2124976936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02180ff150 0x7f02180ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.920+0000 7f021fa3e700 1 -- 172.21.15.32:0/2124976936 >> 172.21.15.32:0/2124976936 conn(0x7f02180fa7a0 msgr2=0x7f02180fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:28.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.920+0000 7f021fa3e700 1 -- 172.21.15.32:0/2124976936 shutdown_connections 2024-05-06T21:32:28.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.920+0000 7f021fa3e700 1 -- 172.21.15.32:0/2124976936 wait complete. 2024-05-06T21:32:28.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.920+0000 7f021fa3e700 1 Processor -- start 2024-05-06T21:32:28.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.920+0000 7f021fa3e700 1 -- start start 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021fa3e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02180ff150 0x7f0218197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021fa3e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 0x7f02181984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021fa3e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0218198b10 con 0x7f02181003f0 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021fa3e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0218198c50 con 0x7f02180ff150 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021cfd9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 0x7f02181984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021cfd9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 0x7f02181984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59524/0 (socket says 172.21.15.32:59524) 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021cfd9700 1 -- 172.21.15.32:0/3633030040 learned_addr learned my addr 172.21.15.32:0/3633030040 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021d7da700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02180ff150 0x7f0218197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021cfd9700 1 -- 172.21.15.32:0/3633030040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02180ff150 msgr2=0x7f0218197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021cfd9700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02180ff150 0x7f0218197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021cfd9700 1 -- 172.21.15.32:0/3633030040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0095f0 con 0x7f02181003f0 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021cfd9700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 0x7f02181984f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f020c005950 tx=0x7f020c0049b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f020a7fc700 1 -- 172.21.15.32:0/3633030040 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020c005640 con 0x7f02181003f0 2024-05-06T21:32:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f020a7fc700 1 -- 172.21.15.32:0/3633030040 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f020c0052e0 con 0x7f02181003f0 2024-05-06T21:32:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021819d6a0 con 0x7f02181003f0 2024-05-06T21:32:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.921+0000 7f020a7fc700 1 -- 172.21.15.32:0/3633030040 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020c010440 con 0x7f02181003f0 2024-05-06T21:32:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.922+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021819dbf0 con 0x7f02181003f0 2024-05-06T21:32:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.922+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0218068ab0 con 0x7f02181003f0 2024-05-06T21:32:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.923+0000 7f020a7fc700 1 -- 172.21.15.32:0/3633030040 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f020c003710 con 0x7f02181003f0 2024-05-06T21:32:28.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.923+0000 7f020a7fc700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f020406e200 0x7f02040706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:28.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.924+0000 7f020a7fc700 1 -- 172.21.15.32:0/3633030040 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f020c090740 con 0x7f02181003f0 2024-05-06T21:32:28.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.924+0000 7f021d7da700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f020406e200 0x7f02040706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:28.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.924+0000 7f021d7da700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f020406e200 0x7f02040706b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0214005950 tx=0x7f02140058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:28.928+0000 7f020a7fc700 1 -- 172.21.15.32:0/3633030040 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f020c05d510 con 0x7f02181003f0 2024-05-06T21:32:29.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.148+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0218104ee0 con 0x7f020406e200 2024-05-06T21:32:29.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.159+0000 7f020a7fc700 1 -- 172.21.15.32:0/3633030040 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0218104ee0 con 0x7f020406e200 2024-05-06T21:32:29.158 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:32:29.158 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (12m) 81s ago 14m 24.2M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:32:29.158 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (14m) 81s ago 14m 8426k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:32:29.158 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (13m) 14s ago 13m 8224k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:32:29.158 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (3m) 81s ago 14m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:32:29.158 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (3m) 14s ago 13m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:32:29.158 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (12m) 81s ago 13m 86.4M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (8m) 81s ago 8m 15.6M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (8m) 81s ago 8m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (8m) 14s ago 8m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (8m) 14s ago 8m 17.8M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (5m) 81s ago 15m 504M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (4m) 14s ago 13m 450M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (4m) 81s ago 15m 46.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (3m) 14s ago 13m 39.1M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (14m) 81s ago 14m 16.3M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (13m) 14s ago 13m 17.3M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (2m) 81s ago 12m 157M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (2m) 81s ago 11m 133M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:32:29.159 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (87s) 81s ago 11m 12.1M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:32:29.160 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (51s) 14s ago 10m 91.4M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:32:29.160 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (17s) 14s ago 10m 12.7M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:32:29.160 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (10m) 14s ago 10m 261M 2240M 18.2.0 dc2bc1663786 c85dfa965f88 2024-05-06T21:32:29.160 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (4m) 81s ago 13m 69.1M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:32:29.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.161+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f020406e200 msgr2=0x7f02040706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.161+0000 7f021fa3e700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f020406e200 0x7f02040706b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0214005950 tx=0x7f02140058e0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.161+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 msgr2=0x7f02181984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.161+0000 7f021fa3e700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 0x7f02181984f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f020c005950 tx=0x7f020c0049b0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.161+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 shutdown_connections 2024-05-06T21:32:29.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.161+0000 7f021fa3e700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f020406e200 0x7f02040706b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.161+0000 7f021fa3e700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02180ff150 0x7f0218197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.161+0000 7f021fa3e700 1 --2- 172.21.15.32:0/3633030040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02181003f0 0x7f02181984f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.161+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 >> 172.21.15.32:0/3633030040 conn(0x7f02180fa7a0 msgr2=0x7f0218103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:29.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.162+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 shutdown_connections 2024-05-06T21:32:29.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.162+0000 7f021fa3e700 1 -- 172.21.15.32:0/3633030040 wait complete. 2024-05-06T21:32:29.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.268+0000 7f91a13d1700 1 -- 172.21.15.32:0/3547373178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 msgr2=0x7f919c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.268+0000 7f91a13d1700 1 --2- 172.21.15.32:0/3547373178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 0x7f919c100650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f918c009910 tx=0x7f918c009c20 comp rx=0 tx=0).stop 2024-05-06T21:32:29.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.268+0000 7f91a13d1700 1 -- 172.21.15.32:0/3547373178 shutdown_connections 2024-05-06T21:32:29.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.269+0000 7f91a13d1700 1 --2- 172.21.15.32:0/3547373178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919c101440 0x7f919c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.269+0000 7f91a13d1700 1 --2- 172.21.15.32:0/3547373178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 0x7f919c100650 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.269+0000 7f91a13d1700 1 -- 172.21.15.32:0/3547373178 >> 172.21.15.32:0/3547373178 conn(0x7f919c0fb7f0 msgr2=0x7f919c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.269+0000 7f91a13d1700 1 -- 172.21.15.32:0/3547373178 shutdown_connections 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.269+0000 7f91a13d1700 1 -- 172.21.15.32:0/3547373178 wait complete. 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.269+0000 7f91a13d1700 1 Processor -- start 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.269+0000 7f91a13d1700 1 -- start start 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f91a13d1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 0x7f919c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f91a13d1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919c101440 0x7f919c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f91a13d1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c073680 con 0x7f919c100240 2024-05-06T21:32:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f91a13d1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0737c0 con 0x7f919c101440 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f919affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 0x7f919c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f919affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 0x7f919c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59544/0 (socket says 172.21.15.32:59544) 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f919affd700 1 -- 172.21.15.32:0/137152007 learned_addr learned my addr 172.21.15.32:0/137152007 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f919a7fc700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919c101440 0x7f919c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f919affd700 1 -- 172.21.15.32:0/137152007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919c101440 msgr2=0x7f919c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f919affd700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919c101440 0x7f919c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f919affd700 1 -- 172.21.15.32:0/137152007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c0095f0 con 0x7f919c100240 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f919affd700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 0x7f919c074af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f918c00bda0 tx=0x7f918c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.270+0000 7f9193fff700 1 -- 172.21.15.32:0/137152007 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f918c01d070 con 0x7f919c100240 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.271+0000 7f9193fff700 1 -- 172.21.15.32:0/137152007 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f918c004c50 con 0x7f919c100240 2024-05-06T21:32:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.271+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c073a40 con 0x7f919c100240 2024-05-06T21:32:29.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.271+0000 7f9193fff700 1 -- 172.21.15.32:0/137152007 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f918c00f690 con 0x7f919c100240 2024-05-06T21:32:29.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.271+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c073f30 con 0x7f919c100240 2024-05-06T21:32:29.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.272+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c108e10 con 0x7f919c100240 2024-05-06T21:32:29.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.272+0000 7f9193fff700 1 -- 172.21.15.32:0/137152007 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f918c00f810 con 0x7f919c100240 2024-05-06T21:32:29.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.273+0000 7f9193fff700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f918806e200 0x7f91880706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:29.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.273+0000 7f9193fff700 1 -- 172.21.15.32:0/137152007 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f918c08fa00 con 0x7f919c100240 2024-05-06T21:32:29.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.273+0000 7f919a7fc700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f918806e200 0x7f91880706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:29.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.273+0000 7f919a7fc700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f918806e200 0x7f91880706b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9184006fd0 tx=0x7f9184008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:29.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.277+0000 7f9193fff700 1 -- 172.21.15.32:0/137152007 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f918c05c7d0 con 0x7f919c100240 2024-05-06T21:32:29.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.580+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f919c19dfe0 con 0x7f919c100240 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.580+0000 7f9193fff700 1 -- 172.21.15.32:0/137152007 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f918c05c360 con 0x7f919c100240 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:32:29.578 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 5 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 9 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:32:29.579 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:32:29.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.582+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f918806e200 msgr2=0x7f91880706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.582+0000 7f91a13d1700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f918806e200 0x7f91880706b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9184006fd0 tx=0x7f9184008040 comp rx=0 tx=0).stop 2024-05-06T21:32:29.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.582+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 msgr2=0x7f919c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.582+0000 7f91a13d1700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 0x7f919c074af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f918c00bda0 tx=0x7f918c00be80 comp rx=0 tx=0).stop 2024-05-06T21:32:29.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.583+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 shutdown_connections 2024-05-06T21:32:29.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.583+0000 7f91a13d1700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f918806e200 0x7f91880706b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.583+0000 7f91a13d1700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f919c100240 0x7f919c074af0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.583+0000 7f91a13d1700 1 --2- 172.21.15.32:0/137152007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919c101440 0x7f919c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.583+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 >> 172.21.15.32:0/137152007 conn(0x7f919c0fb7f0 msgr2=0x7f919c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:29.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.583+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 shutdown_connections 2024-05-06T21:32:29.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.583+0000 7f91a13d1700 1 -- 172.21.15.32:0/137152007 wait complete. 2024-05-06T21:32:29.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.691+0000 7f1506ced700 1 -- 172.21.15.32:0/2914229336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500069ae0 msgr2=0x7f1500102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.691+0000 7f1506ced700 1 --2- 172.21.15.32:0/2914229336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500069ae0 0x7f1500102e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009910 tx=0x7f14f4009c20 comp rx=0 tx=0).stop 2024-05-06T21:32:29.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.691+0000 7f1506ced700 1 -- 172.21.15.32:0/2914229336 shutdown_connections 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.691+0000 7f1506ced700 1 --2- 172.21.15.32:0/2914229336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1500103350 0x7f15001057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.691+0000 7f1506ced700 1 --2- 172.21.15.32:0/2914229336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500069ae0 0x7f1500102e10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.691+0000 7f1506ced700 1 -- 172.21.15.32:0/2914229336 >> 172.21.15.32:0/2914229336 conn(0x7f15000fa7a0 msgr2=0x7f15000fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.691+0000 7f1506ced700 1 -- 172.21.15.32:0/2914229336 shutdown_connections 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.691+0000 7f1506ced700 1 -- 172.21.15.32:0/2914229336 wait complete. 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f1506ced700 1 Processor -- start 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f1506ced700 1 -- start start 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f1506ced700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1500069ae0 0x7f1500100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f1506ced700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500103350 0x7f15000fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f1506ced700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15000ff2f0 con 0x7f1500103350 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f1506ced700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15000ff430 con 0x7f1500069ae0 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f14fffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500103350 0x7f15000fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f14fffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500103350 0x7f15000fedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59560/0 (socket says 172.21.15.32:59560) 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f14fffff700 1 -- 172.21.15.32:0/334204206 learned_addr learned my addr 172.21.15.32:0/334204206 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f14fffff700 1 -- 172.21.15.32:0/334204206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1500069ae0 msgr2=0x7f1500100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f1504a89700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1500069ae0 0x7f1500100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f14fffff700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1500069ae0 0x7f1500100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f14fffff700 1 -- 172.21.15.32:0/334204206 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40095f0 con 0x7f1500103350 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.692+0000 7f1504a89700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1500069ae0 0x7f1500100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.693+0000 7f14fffff700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500103350 0x7f15000fedb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00c930 tx=0x7f14ec00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.693+0000 7f14fdffb700 1 -- 172.21.15.32:0/334204206 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ec007ad0 con 0x7f1500103350 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.693+0000 7f14fdffb700 1 -- 172.21.15.32:0/334204206 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f14ec007c30 con 0x7f1500103350 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.693+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15000ff710 con 0x7f1500103350 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.693+0000 7f14fdffb700 1 -- 172.21.15.32:0/334204206 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ec018630 con 0x7f1500103350 2024-05-06T21:32:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.693+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150019dea0 con 0x7f1500103350 2024-05-06T21:32:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.694+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150018fbf0 con 0x7f1500103350 2024-05-06T21:32:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.694+0000 7f14fdffb700 1 -- 172.21.15.32:0/334204206 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f14ec00f450 con 0x7f1500103350 2024-05-06T21:32:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.695+0000 7f14fdffb700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f14f006e200 0x7f14f00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.695+0000 7f14fdffb700 1 -- 172.21.15.32:0/334204206 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f14ec08e4f0 con 0x7f1500103350 2024-05-06T21:32:29.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.695+0000 7f1504a89700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f14f006e200 0x7f14f00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:29.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.695+0000 7f1504a89700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f14f006e200 0x7f14f00706b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14f40059d0 tx=0x7f14f4005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:29.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.699+0000 7f14fdffb700 1 -- 172.21.15.32:0/334204206 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f14ec05b1a0 con 0x7f1500103350 2024-05-06T21:32:29.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.960+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f150002cd30 con 0x7f1500103350 2024-05-06T21:32:29.958 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:29 smithi032 ceph-mon[76650]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:32:29.958 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:29 smithi032 ceph-mon[76650]: pgmap v163: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:29.958 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:29 smithi032 ceph-mon[76650]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:32:29.958 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:29 smithi032 ceph-mon[76650]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:32:29.958 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:29 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/137152007' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:29.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.960+0000 7f14fdffb700 1 -- 172.21.15.32:0/334204206 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1903 (secure 0 0 0) 0x7f14ec05ad30 con 0x7f1500103350 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:e22 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 22 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:31:11.981773+0000 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:32:29.959 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:32:29.960 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 14486 members: 24277,14486 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:32:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:32:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f14f006e200 msgr2=0x7f14f00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f14f006e200 0x7f14f00706b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14f40059d0 tx=0x7f14f4005960 comp rx=0 tx=0).stop 2024-05-06T21:32:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500103350 msgr2=0x7f15000fedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500103350 0x7f15000fedb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00c930 tx=0x7f14ec00ccf0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 shutdown_connections 2024-05-06T21:32:29.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f14f006e200 0x7f14f00706b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1500069ae0 0x7f1500100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 --2- 172.21.15.32:0/334204206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1500103350 0x7f15000fedb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:29.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 >> 172.21.15.32:0/334204206 conn(0x7f15000fa7a0 msgr2=0x7f15000fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:29.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 shutdown_connections 2024-05-06T21:32:29.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:29.963+0000 7f1506ced700 1 -- 172.21.15.32:0/334204206 wait complete. 2024-05-06T21:32:29.963 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 22 2024-05-06T21:32:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 -- 172.21.15.32:0/3546143178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 msgr2=0x7f330c1051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 --2- 172.21.15.32:0/3546143178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 0x7f330c1051f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009910 tx=0x7f32f4009c20 comp rx=0 tx=0).stop 2024-05-06T21:32:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 -- 172.21.15.32:0/3546143178 shutdown_connections 2024-05-06T21:32:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 --2- 172.21.15.32:0/3546143178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c105730 0x7f330c107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 --2- 172.21.15.32:0/3546143178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 0x7f330c1051f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 -- 172.21.15.32:0/3546143178 >> 172.21.15.32:0/3546143178 conn(0x7f330c0fa780 msgr2=0x7f330c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 -- 172.21.15.32:0/3546143178 shutdown_connections 2024-05-06T21:32:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 -- 172.21.15.32:0/3546143178 wait complete. 2024-05-06T21:32:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 Processor -- start 2024-05-06T21:32:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.073+0000 7f3311d1c700 1 -- start start 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f3311d1c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 0x7f330c197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f3311d1c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c105730 0x7f330c198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f3311d1c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c198880 con 0x7f330c069250 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f3311d1c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c19d290 con 0x7f330c105730 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f330b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 0x7f330c197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f330b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 0x7f330c197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59584/0 (socket says 172.21.15.32:59584) 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f330b7fe700 1 -- 172.21.15.32:0/1463938737 learned_addr learned my addr 172.21.15.32:0/1463938737 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f330affd700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c105730 0x7f330c198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f330b7fe700 1 -- 172.21.15.32:0/1463938737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c105730 msgr2=0x7f330c198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f330b7fe700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c105730 0x7f330c198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f330b7fe700 1 -- 172.21.15.32:0/1463938737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f40095f0 con 0x7f330c069250 2024-05-06T21:32:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f330b7fe700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 0x7f330c197d20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32f400bd70 tx=0x7f32f400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.074+0000 7f3308ff9700 1 -- 172.21.15.32:0/1463938737 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f401d070 con 0x7f330c069250 2024-05-06T21:32:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.075+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c19d430 con 0x7f330c069250 2024-05-06T21:32:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.075+0000 7f3308ff9700 1 -- 172.21.15.32:0/1463938737 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32f4005dc0 con 0x7f330c069250 2024-05-06T21:32:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.075+0000 7f3308ff9700 1 -- 172.21.15.32:0/1463938737 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f4021410 con 0x7f330c069250 2024-05-06T21:32:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.075+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c19d8f0 con 0x7f330c069250 2024-05-06T21:32:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.076+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c191dd0 con 0x7f330c069250 2024-05-06T21:32:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.076+0000 7f3308ff9700 1 -- 172.21.15.32:0/1463938737 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f32f400f7b0 con 0x7f330c069250 2024-05-06T21:32:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.077+0000 7f3308ff9700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32f806e200 0x7f32f80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.077+0000 7f3308ff9700 1 -- 172.21.15.32:0/1463938737 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f32f408f500 con 0x7f330c069250 2024-05-06T21:32:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.077+0000 7f330affd700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32f806e200 0x7f32f80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.077+0000 7f330affd700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32f806e200 0x7f32f80706b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32fc005950 tx=0x7f32fc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:30.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.081+0000 7f3308ff9700 1 -- 172.21.15.32:0/1463938737 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f32f4058720 con 0x7f330c069250 2024-05-06T21:32:30.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:29 smithi154 ceph-mon[63622]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:32:30.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:29 smithi154 ceph-mon[63622]: pgmap v163: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:30.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:29 smithi154 ceph-mon[63622]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:32:30.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:29 smithi154 ceph-mon[63622]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:32:30.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:29 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/137152007' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:30.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.311+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f330c061190 con 0x7f32f806e200 2024-05-06T21:32:30.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.312+0000 7f3308ff9700 1 -- 172.21.15.32:0/1463938737 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f330c061190 con 0x7f32f806e200 2024-05-06T21:32:30.309 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:32:30.309 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:32:30.309 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:32:30.309 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:32:30.310 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:32:30.310 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:32:30.310 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:32:30.310 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:32:30.310 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:32:30.310 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "11/23 daemons upgraded", 2024-05-06T21:32:30.310 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T21:32:30.310 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:32:30.310 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32f806e200 msgr2=0x7f32f80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32f806e200 0x7f32f80706b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32fc005950 tx=0x7f32fc00b410 comp rx=0 tx=0).stop 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 msgr2=0x7f330c197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 0x7f330c197d20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32f400bd70 tx=0x7f32f400bda0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 shutdown_connections 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f32f806e200 0x7f32f80706b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f330c069250 0x7f330c197d20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 --2- 172.21.15.32:0/1463938737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c105730 0x7f330c198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 >> 172.21.15.32:0/1463938737 conn(0x7f330c0fa780 msgr2=0x7f330c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 shutdown_connections 2024-05-06T21:32:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.314+0000 7f3311d1c700 1 -- 172.21.15.32:0/1463938737 wait complete. 2024-05-06T21:32:30.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.423+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/2367297720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc0ff150 msgr2=0x7fc7cc0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:30.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.423+0000 7fc7d0e6c700 1 --2- 172.21.15.32:0/2367297720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc0ff150 0x7fc7cc0ff560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009910 tx=0x7fc7bc009c20 comp rx=0 tx=0).stop 2024-05-06T21:32:30.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.424+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/2367297720 shutdown_connections 2024-05-06T21:32:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.424+0000 7fc7d0e6c700 1 --2- 172.21.15.32:0/2367297720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7cc1003f0 0x7fc7cc100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.424+0000 7fc7d0e6c700 1 --2- 172.21.15.32:0/2367297720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc0ff150 0x7fc7cc0ff560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.424+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/2367297720 >> 172.21.15.32:0/2367297720 conn(0x7fc7cc0fa7a0 msgr2=0x7fc7cc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.424+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/2367297720 shutdown_connections 2024-05-06T21:32:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.424+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/2367297720 wait complete. 2024-05-06T21:32:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.424+0000 7fc7d0e6c700 1 Processor -- start 2024-05-06T21:32:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.424+0000 7fc7d0e6c700 1 -- start start 2024-05-06T21:32:30.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7d0e6c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7cc0ff150 0x7fc7cc195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7d0e6c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc1003f0 0x7fc7cc196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7d0e6c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc196970 con 0x7fc7cc1003f0 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7d0e6c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc196ab0 con 0x7fc7cc0ff150 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7c9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc1003f0 0x7fc7cc196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7c9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc1003f0 0x7fc7cc196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59592/0 (socket says 172.21.15.32:59592) 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7c9d9b700 1 -- 172.21.15.32:0/4168173239 learned_addr learned my addr 172.21.15.32:0/4168173239 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7ca59c700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7cc0ff150 0x7fc7cc195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7c9d9b700 1 -- 172.21.15.32:0/4168173239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7cc0ff150 msgr2=0x7fc7cc195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7c9d9b700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7cc0ff150 0x7fc7cc195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7c9d9b700 1 -- 172.21.15.32:0/4168173239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc0095f0 con 0x7fc7cc1003f0 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7c9d9b700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc1003f0 0x7fc7cc196350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400e920 tx=0x7fc7b400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7c37fe700 1 -- 172.21.15.32:0/4168173239 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7b400c9d0 con 0x7fc7cc1003f0 2024-05-06T21:32:30.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7c37fe700 1 -- 172.21.15.32:0/4168173239 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc7b4010430 con 0x7fc7cc1003f0 2024-05-06T21:32:30.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.425+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc19b560 con 0x7fc7cc1003f0 2024-05-06T21:32:30.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.426+0000 7fc7c37fe700 1 -- 172.21.15.32:0/4168173239 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7b4018650 con 0x7fc7cc1003f0 2024-05-06T21:32:30.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.426+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc19bab0 con 0x7fc7cc1003f0 2024-05-06T21:32:30.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.427+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc068ab0 con 0x7fc7cc1003f0 2024-05-06T21:32:30.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.427+0000 7fc7c37fe700 1 -- 172.21.15.32:0/4168173239 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc7b40105a0 con 0x7fc7cc1003f0 2024-05-06T21:32:30.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.428+0000 7fc7c37fe700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc7b806e200 0x7fc7b80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:32:30.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.428+0000 7fc7c37fe700 1 -- 172.21.15.32:0/4168173239 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fc7b4014070 con 0x7fc7cc1003f0 2024-05-06T21:32:30.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.428+0000 7fc7ca59c700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc7b806e200 0x7fc7b80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:32:30.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.428+0000 7fc7ca59c700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc7b806e200 0x7fc7b80706b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009fd0 tx=0x7fc7bc005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:32:30.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.432+0000 7fc7c37fe700 1 -- 172.21.15.32:0/4168173239 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc7b4053740 con 0x7fc7cc1003f0 2024-05-06T21:32:30.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.738+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc7cc19bde0 con 0x7fc7cc1003f0 2024-05-06T21:32:30.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.738+0000 7fc7c37fe700 1 -- 172.21.15.32:0/4168173239 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc7b405b1e0 con 0x7fc7cc1003f0 2024-05-06T21:32:30.736 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:32:30.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc7b806e200 msgr2=0x7fc7b80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:30.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc7b806e200 0x7fc7b80706b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009fd0 tx=0x7fc7bc005940 comp rx=0 tx=0).stop 2024-05-06T21:32:30.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc1003f0 msgr2=0x7fc7cc196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:32:30.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc1003f0 0x7fc7cc196350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400e920 tx=0x7fc7b400ec30 comp rx=0 tx=0).stop 2024-05-06T21:32:30.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 shutdown_connections 2024-05-06T21:32:30.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc7b806e200 0x7fc7b80706b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7cc0ff150 0x7fc7cc195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 --2- 172.21.15.32:0/4168173239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7cc1003f0 0x7fc7cc196350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:32:30.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 >> 172.21.15.32:0/4168173239 conn(0x7fc7cc0fa7a0 msgr2=0x7fc7cc068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:32:30.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 shutdown_connections 2024-05-06T21:32:30.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:32:30.741+0000 7fc7d0e6c700 1 -- 172.21.15.32:0/4168173239 wait complete. 2024-05-06T21:32:30.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:30 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/334204206' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:32:31.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:30 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/334204206' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:32:31.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:31 smithi032 ceph-mon[76650]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:32:31.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:31 smithi032 ceph-mon[76650]: pgmap v164: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:31.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:31 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4168173239' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:32:32.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:31 smithi154 ceph-mon[63622]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:32:32.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:31 smithi154 ceph-mon[63622]: pgmap v164: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:32.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:31 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4168173239' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:32:33.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:33 smithi032 ceph-mon[76650]: pgmap v165: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:34.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:33 smithi154 ceph-mon[63622]: pgmap v165: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:34.979 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:34 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T21:32:35.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:34 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T21:32:35.982 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:35 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T21:32:35.983 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:35 smithi154 ceph-mon[63622]: Upgrade: osd.5 is safe to restart 2024-05-06T21:32:35.983 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:35 smithi154 ceph-mon[63622]: pgmap v166: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:35.983 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:35.983 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:32:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:35 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T21:32:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:35 smithi032 ceph-mon[76650]: Upgrade: osd.5 is safe to restart 2024-05-06T21:32:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:35 smithi032 ceph-mon[76650]: pgmap v166: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:32:36.839 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:36.839 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:36 smithi154 ceph-mon[63622]: Upgrade: Updating osd.5 2024-05-06T21:32:36.839 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:36.839 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T21:32:36.839 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:36.840 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:36 smithi154 ceph-mon[63622]: Deploying daemon osd.5 on smithi154 2024-05-06T21:32:37.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:37.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:36 smithi032 ceph-mon[76650]: Upgrade: Updating osd.5 2024-05-06T21:32:37.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:37.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T21:32:37.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:37.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:36 smithi032 ceph-mon[76650]: Deploying daemon osd.5 on smithi154 2024-05-06T21:32:38.081 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:37 smithi154 ceph-mon[63622]: pgmap v167: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:38.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:37 smithi032 ceph-mon[76650]: pgmap v167: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:39.365 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:39 smithi154 systemd[1]: Stopping Ceph osd.5 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:32:39.365 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:39 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[48279]: 2024-05-06T21:32:39.299+0000 7f33775b6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:32:39.365 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:39 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[48279]: 2024-05-06T21:32:39.299+0000 7f33775b6700 -1 osd.5 86 *** Got signal Terminated *** 2024-05-06T21:32:39.365 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:39 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[48279]: 2024-05-06T21:32:39.299+0000 7f33775b6700 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:32:40.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:39 smithi032 ceph-mon[76650]: pgmap v168: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:40.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:39 smithi032 ceph-mon[76650]: osd.5 marked itself down and dead 2024-05-06T21:32:40.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:39 smithi154 ceph-mon[63622]: pgmap v168: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:40.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:39 smithi154 ceph-mon[63622]: osd.5 marked itself down and dead 2024-05-06T21:32:40.722 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:40 smithi154 podman[74199]: 2024-05-06 21:32:40.455223864 +0000 UTC m=+1.258940770 container died c85dfa965f889b798962a3f05f9453e63f16974d6bb930296c6fb03b3fd89c4e (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, RELEASE=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0) 2024-05-06T21:32:41.105 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:40 smithi154 ceph-mon[63622]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:32:41.105 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:40 smithi154 ceph-mon[63622]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-05-06T21:32:41.106 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:40 smithi154 ceph-mon[63622]: osdmap e87: 6 total, 5 up, 6 in 2024-05-06T21:32:41.106 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:40 smithi154 podman[74199]: 2024-05-06 21:32:40.824315666 +0000 UTC m=+1.628032568 container cleanup c85dfa965f889b798962a3f05f9453e63f16974d6bb930296c6fb03b3fd89c4e (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, io.buildah.version=1.29.1) 2024-05-06T21:32:41.106 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:40 smithi154 bash[74199]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5 2024-05-06T21:32:41.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:40 smithi032 ceph-mon[76650]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T21:32:41.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:40 smithi032 ceph-mon[76650]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-05-06T21:32:41.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:40 smithi032 ceph-mon[76650]: osdmap e87: 6 total, 5 up, 6 in 2024-05-06T21:32:41.364 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:41 smithi154 podman[74216]: 2024-05-06 21:32:41.109174688 +0000 UTC m=+0.651286726 container remove c85dfa965f889b798962a3f05f9453e63f16974d6bb930296c6fb03b3fd89c4e (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.build-date=20231212) 2024-05-06T21:32:41.709 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:41 smithi154 podman[74308]: 2024-05-06 21:32:41.312773747 +0000 UTC m=+0.018697908 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:32:41.709 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:41 smithi154 podman[74308]: 2024-05-06 21:32:41.4099359 +0000 UTC m=+0.115860062 container create 88cb863626f4322084cd1873d8384b67285c8b9203a03de8064fcf5c402a8514 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0) 2024-05-06T21:32:41.709 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:41 smithi154 podman[74308]: 2024-05-06 21:32:41.612564059 +0000 UTC m=+0.318488220 container init 88cb863626f4322084cd1873d8384b67285c8b9203a03de8064fcf5c402a8514 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-06T21:32:41.709 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:41 smithi154 podman[74308]: 2024-05-06 21:32:41.61599985 +0000 UTC m=+0.321924016 container start 88cb863626f4322084cd1873d8384b67285c8b9203a03de8064fcf5c402a8514 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:32:41.709 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:41 smithi154 podman[74308]: 2024-05-06 21:32:41.712527683 +0000 UTC m=+0.418451856 container attach 88cb863626f4322084cd1873d8384b67285c8b9203a03de8064fcf5c402a8514 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-06T21:32:42.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:41 smithi154 ceph-mon[63622]: pgmap v170: 65 pgs: 13 stale+active+clean, 52 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:42.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:41 smithi154 ceph-mon[63622]: osdmap e88: 6 total, 5 up, 6 in 2024-05-06T21:32:42.115 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:41 smithi154 podman[74308]: 2024-05-06 21:32:41.906178294 +0000 UTC m=+0.612102458 container died 88cb863626f4322084cd1873d8384b67285c8b9203a03de8064fcf5c402a8514 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-06T21:32:42.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:41 smithi032 ceph-mon[76650]: pgmap v170: 65 pgs: 13 stale+active+clean, 52 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:32:42.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:41 smithi032 ceph-mon[76650]: osdmap e88: 6 total, 5 up, 6 in 2024-05-06T21:32:42.865 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:42 smithi154 podman[74334]: 2024-05-06 21:32:42.566832924 +0000 UTC m=+0.655010494 container remove 88cb863626f4322084cd1873d8384b67285c8b9203a03de8064fcf5c402a8514 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-06T21:32:42.865 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:42 smithi154 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.5.service: Deactivated successfully. 2024-05-06T21:32:42.865 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:42 smithi154 systemd[1]: Stopped Ceph osd.5 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:32:42.865 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:42 smithi154 systemd[1]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.5.service: Consumed 1min 1.646s CPU time. 2024-05-06T21:32:42.865 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:42 smithi154 systemd[1]: Starting Ceph osd.5 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:32:43.250 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:42 smithi154 ceph-mon[63622]: Health check failed: Degraded data redundancy: 23/366 objects degraded (6.284%), 7 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:43.251 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 podman[74437]: 2024-05-06 21:32:42.925230321 +0000 UTC m=+0.025112708 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:32:43.251 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 podman[74437]: 2024-05-06 21:32:43.135113327 +0000 UTC m=+0.234995755 container create 4934d6ad392ed1ab5725423b2c8293a612b441eae9c945cfd06a66ed1b0bd497 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-06T21:32:43.394 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:42 smithi032 ceph-mon[76650]: Health check failed: Degraded data redundancy: 23/366 objects degraded (6.284%), 7 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:43.615 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 podman[74437]: 2024-05-06 21:32:43.387757835 +0000 UTC m=+0.487640229 container init 4934d6ad392ed1ab5725423b2c8293a612b441eae9c945cfd06a66ed1b0bd497 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, ceph=True) 2024-05-06T21:32:43.615 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 podman[74437]: 2024-05-06 21:32:43.391118302 +0000 UTC m=+0.491000691 container start 4934d6ad392ed1ab5725423b2c8293a612b441eae9c945cfd06a66ed1b0bd497 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T21:32:43.615 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 podman[74437]: 2024-05-06 21:32:43.462612386 +0000 UTC m=+0.562494789 container attach 4934d6ad392ed1ab5725423b2c8293a612b441eae9c945cfd06a66ed1b0bd497 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=) 2024-05-06T21:32:44.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:43 smithi154 ceph-mon[63622]: pgmap v172: 65 pgs: 4 active+undersized, 7 active+undersized+degraded, 9 stale+active+clean, 45 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23/366 objects degraded (6.284%) 2024-05-06T21:32:44.115 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate[74452]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T21:32:44.115 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate[74452]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T21:32:44.115 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate[74452]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T21:32:44.115 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 bash[74437]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T21:32:44.115 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 bash[74437]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T21:32:44.115 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 bash[74437]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T21:32:44.115 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 bash[74437]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T21:32:44.116 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 bash[74437]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-05-06T21:32:44.116 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 bash[74437]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T21:32:44.116 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 bash[74437]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-06T21:32:44.116 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate[74452]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T21:32:44.116 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate[74452]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-05-06T21:32:44.116 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate[74452]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T21:32:44.116 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate[74452]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-06T21:32:44.116 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:43 smithi154 podman[74437]: 2024-05-06 21:32:43.86392488 +0000 UTC m=+0.963807273 container died 4934d6ad392ed1ab5725423b2c8293a612b441eae9c945cfd06a66ed1b0bd497 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:32:44.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:43 smithi032 ceph-mon[76650]: pgmap v172: 65 pgs: 4 active+undersized, 7 active+undersized+degraded, 9 stale+active+clean, 45 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23/366 objects degraded (6.284%) 2024-05-06T21:32:45.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:44 smithi154 podman[74572]: 2024-05-06 21:32:44.758732741 +0000 UTC m=+0.888811191 container remove 4934d6ad392ed1ab5725423b2c8293a612b441eae9c945cfd06a66ed1b0bd497 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T21:32:45.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:44 smithi154 podman[74639]: 2024-05-06 21:32:44.976346643 +0000 UTC m=+0.115642466 container create 8b513e97a420166ee5eed3d968ffa7e746e14a5e82efc9e0b24a838bcd0cf38e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:32:45.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:44 smithi154 podman[74639]: 2024-05-06 21:32:44.880147916 +0000 UTC m=+0.019443710 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:32:45.615 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:45 smithi154 podman[74639]: 2024-05-06 21:32:45.186882292 +0000 UTC m=+0.326178073 container init 8b513e97a420166ee5eed3d968ffa7e746e14a5e82efc9e0b24a838bcd0cf38e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-05-06T21:32:45.615 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:45 smithi154 podman[74639]: 2024-05-06 21:32:45.190187533 +0000 UTC m=+0.329483315 container start 8b513e97a420166ee5eed3d968ffa7e746e14a5e82efc9e0b24a838bcd0cf38e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-06T21:32:45.615 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:45 smithi154 ceph-osd[74658]: -- 172.21.15.154:0/1116484098 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561626275680 con 0x56162623f000 2024-05-06T21:32:45.615 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:45 smithi154 bash[74639]: 8b513e97a420166ee5eed3d968ffa7e746e14a5e82efc9e0b24a838bcd0cf38e 2024-05-06T21:32:45.615 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:45 smithi154 systemd[1]: Started Ceph osd.5 for d155ff30-0bed-11ef-bc97-c7b262605968. 2024-05-06T21:32:45.992 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:45 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:32:45.736+0000 7f38507237c0 -1 Falling back to public interface 2024-05-06T21:32:46.264 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:45 smithi154 ceph-mon[63622]: pgmap v173: 65 pgs: 11 active+undersized, 10 active+undersized+degraded, 3 stale+active+clean, 41 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/366 objects degraded (8.470%) 2024-05-06T21:32:46.264 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:46.264 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:46.264 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:46.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:45 smithi032 ceph-mon[76650]: pgmap v173: 65 pgs: 11 active+undersized, 10 active+undersized+degraded, 3 stale+active+clean, 41 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/366 objects degraded (8.470%) 2024-05-06T21:32:46.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:46.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:46.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:48.270 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:47 smithi032 ceph-mon[76650]: pgmap v174: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/366 objects degraded (15.847%) 2024-05-06T21:32:48.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:47 smithi154 ceph-mon[63622]: pgmap v174: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/366 objects degraded (15.847%) 2024-05-06T21:32:49.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:49.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:49.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:49 smithi154 ceph-mon[63622]: pgmap v175: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/366 objects degraded (15.847%) 2024-05-06T21:32:49.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:49.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:49.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:49 smithi032 ceph-mon[76650]: pgmap v175: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/366 objects degraded (15.847%) 2024-05-06T21:32:50.414 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:50 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:32:50.187+0000 7f38507237c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-05-06T21:32:50.700 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:50.700 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:50.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:50.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:51.114 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:50 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:32:50.703+0000 7f38507237c0 -1 osd.5 86 log_to_monitors true 2024-05-06T21:32:51.831 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:32:51 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:32:51.704+0000 7f3841b7a700 -1 osd.5 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T21:32:51.831 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:51 smithi154 ceph-mon[63622]: pgmap v176: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/366 objects degraded (15.847%) 2024-05-06T21:32:51.831 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:51.831 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:32:51.831 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:51 smithi154 ceph-mon[63622]: from='osd.5 [v2:172.21.15.154:6816/2230951688,v1:172.21.15.154:6817/2230951688]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T21:32:51.831 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:51 smithi154 ceph-mon[63622]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T21:32:51.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:51 smithi032 ceph-mon[76650]: pgmap v176: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/366 objects degraded (15.847%) 2024-05-06T21:32:51.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:51.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:32:51.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:51 smithi032 ceph-mon[76650]: from='osd.5 [v2:172.21.15.154:6816/2230951688,v1:172.21.15.154:6817/2230951688]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T21:32:51.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:51 smithi032 ceph-mon[76650]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T21:32:52.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:52 smithi154 ceph-mon[63622]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T21:32:52.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:52 smithi154 ceph-mon[63622]: osdmap e89: 6 total, 5 up, 6 in 2024-05-06T21:32:52.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:52 smithi154 ceph-mon[63622]: from='osd.5 [v2:172.21.15.154:6816/2230951688,v1:172.21.15.154:6817/2230951688]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:32:52.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:52 smithi154 ceph-mon[63622]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:32:52.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:52 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 58/366 objects degraded (15.847%), 15 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:52.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:52 smithi032 ceph-mon[76650]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T21:32:52.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:52 smithi032 ceph-mon[76650]: osdmap e89: 6 total, 5 up, 6 in 2024-05-06T21:32:52.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:52 smithi032 ceph-mon[76650]: from='osd.5 [v2:172.21.15.154:6816/2230951688,v1:172.21.15.154:6817/2230951688]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:32:52.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:52 smithi032 ceph-mon[76650]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-06T21:32:52.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:52 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 58/366 objects degraded (15.847%), 15 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: pgmap v178: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/366 objects degraded (15.847%) 2024-05-06T21:32:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:32:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: osd.5 [v2:172.21.15.154:6816/2230951688,v1:172.21.15.154:6817/2230951688] boot 2024-05-06T21:32:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: osdmap e90: 6 total, 6 up, 6 in 2024-05-06T21:32:53.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all osd 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-06T21:32:53.972 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: Upgrade: Setting require_osd_release to 19 squid 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-06T21:32:53.973 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-05-06T21:32:53.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-05-06T21:32:53.974 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:53 smithi032 ceph-mon[76650]: osdmap e91: 6 total, 6 up, 6 in 2024-05-06T21:32:54.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: pgmap v178: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/366 objects degraded (15.847%) 2024-05-06T21:32:54.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T21:32:54.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: osd.5 [v2:172.21.15.154:6816/2230951688,v1:172.21.15.154:6817/2230951688] boot 2024-05-06T21:32:54.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: osdmap e90: 6 total, 6 up, 6 in 2024-05-06T21:32:54.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all osd 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:54.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: Upgrade: Setting require_osd_release to 19 squid 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-05-06T21:32:54.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-05-06T21:32:54.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:53 smithi154 ceph-mon[63622]: osdmap e91: 6 total, 6 up, 6 in 2024-05-06T21:32:54.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:54 smithi032 ceph-mon[76650]: Upgrade: Scaling down filesystem cephfs 2024-05-06T21:32:54.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:54.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-05-06T21:32:55.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:54 smithi154 ceph-mon[63622]: Upgrade: Scaling down filesystem cephfs 2024-05-06T21:32:55.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:55.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-05-06T21:32:55.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: pgmap v181: 65 pgs: 3 peering, 12 active+undersized, 13 active+undersized+degraded, 37 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/366 objects degraded (14.754%) 2024-05-06T21:32:55.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-05-06T21:32:55.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: stopping daemon mds.cephfs.smithi154.rizdbu 2024-05-06T21:32:55.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:32:55.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:stopping} 2 up:standby 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:55.971 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:55 smithi032 ceph-mon[76650]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-05-06T21:32:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: pgmap v181: 65 pgs: 3 peering, 12 active+undersized, 13 active+undersized+degraded, 37 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/366 objects degraded (14.754%) 2024-05-06T21:32:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-05-06T21:32:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: stopping daemon mds.cephfs.smithi154.rizdbu 2024-05-06T21:32:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:active} 2 up:standby 2024-05-06T21:32:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:stopping} 2 up:standby 2024-05-06T21:32:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:32:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:32:56.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:32:56.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:32:56.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:56.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:56.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:56.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:32:56.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:55 smithi154 ceph-mon[63622]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-05-06T21:32:57.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:57 smithi032 ceph-mon[76650]: pgmap v182: 65 pgs: 3 peering, 11 active+undersized, 9 active+undersized+degraded, 42 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/366 objects degraded (8.470%) 2024-05-06T21:32:57.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:57 smithi032 ceph-mon[76650]: Health check update: Degraded data redundancy: 31/366 objects degraded (8.470%), 9 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:58.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:57 smithi154 ceph-mon[63622]: pgmap v182: 65 pgs: 3 peering, 11 active+undersized, 9 active+undersized+degraded, 42 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/366 objects degraded (8.470%) 2024-05-06T21:32:58.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:57 smithi154 ceph-mon[63622]: Health check update: Degraded data redundancy: 31/366 objects degraded (8.470%), 9 pgs degraded (PG_DEGRADED) 2024-05-06T21:32:59.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:58 smithi154 ceph-mon[63622]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/366 objects degraded (8.470%), 9 pgs degraded) 2024-05-06T21:32:59.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:58 smithi154 ceph-mon[63622]: Cluster is now healthy 2024-05-06T21:32:59.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:58 smithi032 ceph-mon[76650]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/366 objects degraded (8.470%), 9 pgs degraded) 2024-05-06T21:32:59.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:58 smithi032 ceph-mon[76650]: Cluster is now healthy 2024-05-06T21:33:00.033 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:32:59 smithi154 ceph-mon[63622]: pgmap v183: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:33:00.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:32:59 smithi032 ceph-mon[76650]: pgmap v183: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-05-06T21:33:00.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.867+0000 7fa4a1711700 1 -- 172.21.15.32:0/1376310810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c1003d0 msgr2=0x7fa49c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:00.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.867+0000 7fa4a1711700 1 --2- 172.21.15.32:0/1376310810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c1003d0 0x7fa49c100840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa490009910 tx=0x7fa490009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:00.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.867+0000 7fa4a1711700 1 -- 172.21.15.32:0/1376310810 shutdown_connections 2024-05-06T21:33:00.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.867+0000 7fa4a1711700 1 --2- 172.21.15.32:0/1376310810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c1003d0 0x7fa49c100840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:00.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.867+0000 7fa4a1711700 1 --2- 172.21.15.32:0/1376310810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa49c0ff130 0x7fa49c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:00.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.867+0000 7fa4a1711700 1 -- 172.21.15.32:0/1376310810 >> 172.21.15.32:0/1376310810 conn(0x7fa49c0fa780 msgr2=0x7fa49c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:00.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.868+0000 7fa4a1711700 1 -- 172.21.15.32:0/1376310810 shutdown_connections 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.868+0000 7fa4a1711700 1 -- 172.21.15.32:0/1376310810 wait complete. 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.868+0000 7fa4a1711700 1 Processor -- start 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.868+0000 7fa4a1711700 1 -- start start 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa4a1711700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c0ff130 0x7fa49c197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa4a1711700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa49c1003d0 0x7fa49c1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa4a1711700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1987b0 con 0x7fa49c0ff130 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa4a1711700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c198920 con 0x7fa49c1003d0 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa49affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c0ff130 0x7fa49c197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa49affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c0ff130 0x7fa49c197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56170/0 (socket says 172.21.15.32:56170) 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa49affd700 1 -- 172.21.15.32:0/3262771810 learned_addr learned my addr 172.21.15.32:0/3262771810 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa49a7fc700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa49c1003d0 0x7fa49c1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa49affd700 1 -- 172.21.15.32:0/3262771810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa49c1003d0 msgr2=0x7fa49c1981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa49affd700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa49c1003d0 0x7fa49c1981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:00.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa49affd700 1 -- 172.21.15.32:0/3262771810 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900095f0 con 0x7fa49c0ff130 2024-05-06T21:33:00.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa49a7fc700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa49c1003d0 0x7fa49c1981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:33:00.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.869+0000 7fa49affd700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c0ff130 0x7fa49c197c70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00e920 tx=0x7fa48c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:00.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.870+0000 7fa483fff700 1 -- 172.21.15.32:0/3262771810 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa48c00c9d0 con 0x7fa49c0ff130 2024-05-06T21:33:00.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.870+0000 7fa483fff700 1 -- 172.21.15.32:0/3262771810 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa48c010430 con 0x7fa49c0ff130 2024-05-06T21:33:00.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.870+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c19d3b0 con 0x7fa49c0ff130 2024-05-06T21:33:00.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.870+0000 7fa483fff700 1 -- 172.21.15.32:0/3262771810 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa48c018650 con 0x7fa49c0ff130 2024-05-06T21:33:00.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.870+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c19d8d0 con 0x7fa49c0ff130 2024-05-06T21:33:00.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.871+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c107c10 con 0x7fa49c0ff130 2024-05-06T21:33:00.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.871+0000 7fa483fff700 1 -- 172.21.15.32:0/3262771810 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa48c0105a0 con 0x7fa49c0ff130 2024-05-06T21:33:00.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.872+0000 7fa483fff700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa48406e200 0x7fa4840706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:00.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.872+0000 7fa483fff700 1 -- 172.21.15.32:0/3262771810 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fa48c014070 con 0x7fa49c0ff130 2024-05-06T21:33:00.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.872+0000 7fa49a7fc700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa48406e200 0x7fa4840706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:00.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.872+0000 7fa49a7fc700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa48406e200 0x7fa4840706b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa49000b6f0 tx=0x7fa490005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:00.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:00.877+0000 7fa483fff700 1 -- 172.21.15.32:0/3262771810 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa48c053740 con 0x7fa49c0ff130 2024-05-06T21:33:01.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.110+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa49c068c50 con 0x7fa48406e200 2024-05-06T21:33:01.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.111+0000 7fa483fff700 1 -- 172.21.15.32:0/3262771810 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa49c068c50 con 0x7fa48406e200 2024-05-06T21:33:01.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa48406e200 msgr2=0x7fa4840706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa48406e200 0x7fa4840706b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa49000b6f0 tx=0x7fa490005a90 comp rx=0 tx=0).stop 2024-05-06T21:33:01.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c0ff130 msgr2=0x7fa49c197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c0ff130 0x7fa49c197c70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00e920 tx=0x7fa48c00ec30 comp rx=0 tx=0).stop 2024-05-06T21:33:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 shutdown_connections 2024-05-06T21:33:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa48406e200 0x7fa4840706b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa49c0ff130 0x7fa49c197c70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 --2- 172.21.15.32:0/3262771810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa49c1003d0 0x7fa49c1981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 >> 172.21.15.32:0/3262771810 conn(0x7fa49c0fa780 msgr2=0x7fa49c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 shutdown_connections 2024-05-06T21:33:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.114+0000 7fa4a1711700 1 -- 172.21.15.32:0/3262771810 wait complete. 2024-05-06T21:33:01.121 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:33:01.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.223+0000 7fbbcde24700 1 -- 172.21.15.32:0/1295836252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 msgr2=0x7fbbc8100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.223+0000 7fbbcde24700 1 --2- 172.21.15.32:0/1295836252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 0x7fbbc8100790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009910 tx=0x7fbbb0009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:01.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.223+0000 7fbbcde24700 1 -- 172.21.15.32:0/1295836252 shutdown_connections 2024-05-06T21:33:01.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.223+0000 7fbbcde24700 1 --2- 172.21.15.32:0/1295836252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 0x7fbbc8100790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.223+0000 7fbbcde24700 1 --2- 172.21.15.32:0/1295836252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc80ff140 0x7fbbc80ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.223+0000 7fbbcde24700 1 -- 172.21.15.32:0/1295836252 >> 172.21.15.32:0/1295836252 conn(0x7fbbc80fa6d0 msgr2=0x7fbbc80fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:01.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.223+0000 7fbbcde24700 1 -- 172.21.15.32:0/1295836252 shutdown_connections 2024-05-06T21:33:01.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.223+0000 7fbbcde24700 1 -- 172.21.15.32:0/1295836252 wait complete. 2024-05-06T21:33:01.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbcde24700 1 Processor -- start 2024-05-06T21:33:01.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbcde24700 1 -- start start 2024-05-06T21:33:01.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbcde24700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc80ff140 0x7fbbc8194990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:01.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbcde24700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 0x7fbbc8194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:01.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbcde24700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc81954f0 con 0x7fbbc8100340 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbcde24700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc8195630 con 0x7fbbc80ff140 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbc6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 0x7fbbc8194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbc6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 0x7fbbc8194ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56184/0 (socket says 172.21.15.32:56184) 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbc6ffd700 1 -- 172.21.15.32:0/2514343303 learned_addr learned my addr 172.21.15.32:0/2514343303 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.224+0000 7fbbc77fe700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc80ff140 0x7fbbc8194990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.225+0000 7fbbc6ffd700 1 -- 172.21.15.32:0/2514343303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc80ff140 msgr2=0x7fbbc8194990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.225+0000 7fbbc6ffd700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc80ff140 0x7fbbc8194990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.225+0000 7fbbc6ffd700 1 -- 172.21.15.32:0/2514343303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00095f0 con 0x7fbbc8100340 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.225+0000 7fbbc6ffd700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 0x7fbbc8194ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000b5c0 tx=0x7fbbb000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.225+0000 7fbbc4ff9700 1 -- 172.21.15.32:0/2514343303 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb001f070 con 0x7fbbc8100340 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.225+0000 7fbbc4ff9700 1 -- 172.21.15.32:0/2514343303 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbbb0019610 con 0x7fbbc8100340 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.225+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc8068dd0 con 0x7fbbc8100340 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.225+0000 7fbbc4ff9700 1 -- 172.21.15.32:0/2514343303 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb000f690 con 0x7fbbc8100340 2024-05-06T21:33:01.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.225+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc80692c0 con 0x7fbbc8100340 2024-05-06T21:33:01.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.226+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc8107c90 con 0x7fbbc8100340 2024-05-06T21:33:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.227+0000 7fbbc4ff9700 1 -- 172.21.15.32:0/2514343303 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbbb0019780 con 0x7fbbc8100340 2024-05-06T21:33:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.227+0000 7fbbc4ff9700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbb406e200 0x7fbbb40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.227+0000 7fbbc4ff9700 1 -- 172.21.15.32:0/2514343303 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fbbb0091610 con 0x7fbbc8100340 2024-05-06T21:33:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.227+0000 7fbbc77fe700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbb406e200 0x7fbbb40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.228+0000 7fbbc77fe700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbb406e200 0x7fbbb40706b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbbc81001a0 tx=0x7fbbb8007400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:01.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.232+0000 7fbbc4ff9700 1 -- 172.21.15.32:0/2514343303 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fbbb005e410 con 0x7fbbc8100340 2024-05-06T21:33:01.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.465+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbc8104c90 con 0x7fbbb406e200 2024-05-06T21:33:01.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.467+0000 7fbbc4ff9700 1 -- 172.21.15.32:0/2514343303 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbbc8104c90 con 0x7fbbb406e200 2024-05-06T21:33:01.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.469+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbb406e200 msgr2=0x7fbbb40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.469+0000 7fbbcde24700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbb406e200 0x7fbbb40706b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbbc81001a0 tx=0x7fbbb8007400 comp rx=0 tx=0).stop 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.469+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 msgr2=0x7fbbc8194ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.469+0000 7fbbcde24700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 0x7fbbc8194ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000b5c0 tx=0x7fbbb000bd70 comp rx=0 tx=0).stop 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.469+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 shutdown_connections 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.469+0000 7fbbcde24700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fbbb406e200 0x7fbbb40706b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.469+0000 7fbbcde24700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc80ff140 0x7fbbc8194990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.469+0000 7fbbcde24700 1 --2- 172.21.15.32:0/2514343303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc8100340 0x7fbbc8194ed0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.469+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 >> 172.21.15.32:0/2514343303 conn(0x7fbbc80fa6d0 msgr2=0x7fbbc8103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.470+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 shutdown_connections 2024-05-06T21:33:01.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.470+0000 7fbbcde24700 1 -- 172.21.15.32:0/2514343303 wait complete. 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.578+0000 7f2bc05cb700 1 -- 172.21.15.32:0/2747734797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb80ff150 msgr2=0x7f2bb80ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.578+0000 7f2bc05cb700 1 --2- 172.21.15.32:0/2747734797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb80ff150 0x7f2bb80ff560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009910 tx=0x7f2bb4009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.578+0000 7f2bc05cb700 1 -- 172.21.15.32:0/2747734797 shutdown_connections 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.578+0000 7f2bc05cb700 1 --2- 172.21.15.32:0/2747734797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb81003f0 0x7f2bb8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.578+0000 7f2bc05cb700 1 --2- 172.21.15.32:0/2747734797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb80ff150 0x7f2bb80ff560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.578+0000 7f2bc05cb700 1 -- 172.21.15.32:0/2747734797 >> 172.21.15.32:0/2747734797 conn(0x7f2bb80fa7a0 msgr2=0x7f2bb80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.578+0000 7f2bc05cb700 1 -- 172.21.15.32:0/2747734797 shutdown_connections 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.578+0000 7f2bc05cb700 1 -- 172.21.15.32:0/2747734797 wait complete. 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.579+0000 7f2bc05cb700 1 Processor -- start 2024-05-06T21:33:01.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.579+0000 7f2bc05cb700 1 -- start start 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.579+0000 7f2bc05cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb80ff150 0x7f2bb8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.579+0000 7f2bc05cb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb81003f0 0x7f2bb819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.579+0000 7f2bc05cb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb819b120 con 0x7f2bb81003f0 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.579+0000 7f2bc05cb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb819b260 con 0x7f2bb80ff150 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.579+0000 7f2bbdb66700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb81003f0 0x7f2bb819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.579+0000 7f2bbdb66700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb81003f0 0x7f2bb819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56208/0 (socket says 172.21.15.32:56208) 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.579+0000 7f2bbdb66700 1 -- 172.21.15.32:0/128972049 learned_addr learned my addr 172.21.15.32:0/128972049 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bbe367700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb80ff150 0x7f2bb8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bbdb66700 1 -- 172.21.15.32:0/128972049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb80ff150 msgr2=0x7f2bb8069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bbdb66700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb80ff150 0x7f2bb8069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bbdb66700 1 -- 172.21.15.32:0/128972049 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40095f0 con 0x7f2bb81003f0 2024-05-06T21:33:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bbdb66700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb81003f0 0x7f2bb819ab50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00e920 tx=0x7f2bac00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bab7fe700 1 -- 172.21.15.32:0/128972049 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bac009790 con 0x7f2bb81003f0 2024-05-06T21:33:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bab7fe700 1 -- 172.21.15.32:0/128972049 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2bac00cba0 con 0x7f2bb81003f0 2024-05-06T21:33:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb819b540 con 0x7f2bb81003f0 2024-05-06T21:33:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bab7fe700 1 -- 172.21.15.32:0/128972049 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bac0186e0 con 0x7f2bb81003f0 2024-05-06T21:33:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.580+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb819ba90 con 0x7f2bb81003f0 2024-05-06T21:33:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.581+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb8068ab0 con 0x7f2bb81003f0 2024-05-06T21:33:01.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.582+0000 7f2bab7fe700 1 -- 172.21.15.32:0/128972049 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2bac00cd10 con 0x7f2bb81003f0 2024-05-06T21:33:01.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.582+0000 7f2bab7fe700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2ba406e200 0x7f2ba40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:01.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.582+0000 7f2bab7fe700 1 -- 172.21.15.32:0/128972049 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f2bac014070 con 0x7f2bb81003f0 2024-05-06T21:33:01.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.582+0000 7f2bbe367700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2ba406e200 0x7f2ba40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:01.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.583+0000 7f2bbe367700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2ba406e200 0x7f2ba40706b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40059d0 tx=0x7f2bb4005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.587+0000 7f2bab7fe700 1 -- 172.21.15.32:0/128972049 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2bac053740 con 0x7f2bb81003f0 2024-05-06T21:33:01.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.813+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bb8104e20 con 0x7f2ba406e200 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.824+0000 7f2bab7fe700 1 -- 172.21.15.32:0/128972049 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f2bb8104e20 con 0x7f2ba406e200 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (13m) 113s ago 14m 24.2M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (14m) 113s ago 14m 8426k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (13m) 13s ago 13m 8472k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (3m) 113s ago 14m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (3m) 13s ago 13m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (13m) 113s ago 14m 86.4M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (9m) 113s ago 9m 15.6M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (9m) 113s ago 8m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:33:01.821 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (9m) 13s ago 9m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (8m) 13s ago 8m 18.0M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (6m) 113s ago 16m 504M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (5m) 13s ago 13m 451M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (4m) 113s ago 16m 46.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (4m) 13s ago 13m 40.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (14m) 113s ago 14m 16.3M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (13m) 13s ago 13m 16.7M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (3m) 113s ago 12m 157M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (2m) 113s ago 12m 133M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (2m) 113s ago 11m 12.1M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (83s) 13s ago 11m 93.2M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (50s) 13s ago 11m 97.6M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (16s) 13s ago 10m 12.3M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 8b513e97a420 2024-05-06T21:33:01.822 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (5m) 113s ago 14m 69.1M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:33:01.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2ba406e200 msgr2=0x7f2ba40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2ba406e200 0x7f2ba40706b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40059d0 tx=0x7f2bb4005940 comp rx=0 tx=0).stop 2024-05-06T21:33:01.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb81003f0 msgr2=0x7f2bb819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb81003f0 0x7f2bb819ab50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00e920 tx=0x7f2bac00ece0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 shutdown_connections 2024-05-06T21:33:01.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2ba406e200 0x7f2ba40706b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb80ff150 0x7f2bb8069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 --2- 172.21.15.32:0/128972049 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb81003f0 0x7f2bb819ab50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 >> 172.21.15.32:0/128972049 conn(0x7f2bb80fa7a0 msgr2=0x7f2bb81036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 shutdown_connections 2024-05-06T21:33:01.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.826+0000 7f2bc05cb700 1 -- 172.21.15.32:0/128972049 wait complete. 2024-05-06T21:33:01.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.933+0000 7f80fa10d700 1 -- 172.21.15.32:0/4157734749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 msgr2=0x7f80f4105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.933+0000 7f80fa10d700 1 --2- 172.21.15.32:0/4157734749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 0x7f80f4105a80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009910 tx=0x7f80e8009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.933+0000 7f80fa10d700 1 -- 172.21.15.32:0/4157734749 shutdown_connections 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.933+0000 7f80fa10d700 1 --2- 172.21.15.32:0/4157734749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 0x7f80f4105a80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.933+0000 7f80fa10d700 1 --2- 172.21.15.32:0/4157734749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f4100d80 0x7f80f4103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.933+0000 7f80fa10d700 1 -- 172.21.15.32:0/4157734749 >> 172.21.15.32:0/4157734749 conn(0x7f80f40fa7a0 msgr2=0x7f80f40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.933+0000 7f80fa10d700 1 -- 172.21.15.32:0/4157734749 shutdown_connections 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.933+0000 7f80fa10d700 1 -- 172.21.15.32:0/4157734749 wait complete. 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.934+0000 7f80fa10d700 1 Processor -- start 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.934+0000 7f80fa10d700 1 -- start start 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.934+0000 7f80fa10d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f4100d80 0x7f80f4195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.934+0000 7f80fa10d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 0x7f80f4196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.934+0000 7f80fa10d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4196920 con 0x7f80f41036a0 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.934+0000 7f80fa10d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4196a60 con 0x7f80f4100d80 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.934+0000 7f80f2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 0x7f80f4196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:01.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.934+0000 7f80f2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 0x7f80f4196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50256/0 (socket says 172.21.15.32:50256) 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.934+0000 7f80f2ffd700 1 -- 172.21.15.32:0/757663670 learned_addr learned my addr 172.21.15.32:0/757663670 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80f37fe700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f4100d80 0x7f80f4195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80f2ffd700 1 -- 172.21.15.32:0/757663670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f4100d80 msgr2=0x7f80f4195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80f2ffd700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f4100d80 0x7f80f4195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80f2ffd700 1 -- 172.21.15.32:0/757663670 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80095f0 con 0x7f80f41036a0 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80f37fe700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f4100d80 0x7f80f4195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80f2ffd700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 0x7f80f4196300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000c00 tx=0x7f80e800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80f0ff9700 1 -- 172.21.15.32:0/757663670 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e801d070 con 0x7f80f41036a0 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f419b4b0 con 0x7f80f41036a0 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80f0ff9700 1 -- 172.21.15.32:0/757663670 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f80e8005dc0 con 0x7f80f41036a0 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80f0ff9700 1 -- 172.21.15.32:0/757663670 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e80226a0 con 0x7f80f41036a0 2024-05-06T21:33:01.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.935+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f419b9a0 con 0x7f80f41036a0 2024-05-06T21:33:01.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.936+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f418fc00 con 0x7f80f41036a0 2024-05-06T21:33:01.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.937+0000 7f80f0ff9700 1 -- 172.21.15.32:0/757663670 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f80e8003680 con 0x7f80f41036a0 2024-05-06T21:33:01.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.937+0000 7f80f0ff9700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80dc06e200 0x7f80dc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:01.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.937+0000 7f80f0ff9700 1 -- 172.21.15.32:0/757663670 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f80e808f800 con 0x7f80f41036a0 2024-05-06T21:33:01.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.937+0000 7f80f37fe700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80dc06e200 0x7f80dc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:01.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.938+0000 7f80f37fe700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80dc06e200 0x7f80dc0706b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80f4069890 tx=0x7f80e4009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:01.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:01.942+0000 7f80f0ff9700 1 -- 172.21.15.32:0/757663670 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f80e805c550 con 0x7f80f41036a0 2024-05-06T21:33:02.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:01 smithi154 ceph-mon[63622]: pgmap v184: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s wr, 1 op/s 2024-05-06T21:33:02.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:01 smithi154 ceph-mon[63622]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:02.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:01 smithi032 ceph-mon[76650]: pgmap v184: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s wr, 1 op/s 2024-05-06T21:33:02.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:01 smithi032 ceph-mon[76650]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:02.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.251+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80f4068ab0 con 0x7f80f41036a0 2024-05-06T21:33:02.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.251+0000 7f80f0ff9700 1 -- 172.21.15.32:0/757663670 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+701 (secure 0 0 0) 0x7f80e800fba0 con 0x7f80f41036a0 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:33:02.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:33:02.250 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:33:02.250 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:33:02.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:33:02.250 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:33:02.250 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-05-06T21:33:02.250 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 10 2024-05-06T21:33:02.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:33:02.250 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:33:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80dc06e200 msgr2=0x7f80dc0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80dc06e200 0x7f80dc0706b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80f4069890 tx=0x7f80e4009260 comp rx=0 tx=0).stop 2024-05-06T21:33:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 msgr2=0x7f80f4196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 0x7f80f4196300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000c00 tx=0x7f80e800f740 comp rx=0 tx=0).stop 2024-05-06T21:33:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 shutdown_connections 2024-05-06T21:33:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80dc06e200 0x7f80dc0706b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f4100d80 0x7f80f4195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 --2- 172.21.15.32:0/757663670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80f41036a0 0x7f80f4196300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 >> 172.21.15.32:0/757663670 conn(0x7f80f40fa7a0 msgr2=0x7f80f40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:02.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 shutdown_connections 2024-05-06T21:33:02.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.254+0000 7f80fa10d700 1 -- 172.21.15.32:0/757663670 wait complete. 2024-05-06T21:33:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.362+0000 7f9759893700 1 -- 172.21.15.32:0/2175807169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 msgr2=0x7f9754105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.362+0000 7f9759893700 1 --2- 172.21.15.32:0/2175807169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 0x7f9754105a80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f973c009910 tx=0x7f973c009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:02.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.362+0000 7f9759893700 1 -- 172.21.15.32:0/2175807169 shutdown_connections 2024-05-06T21:33:02.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.362+0000 7f9759893700 1 --2- 172.21.15.32:0/2175807169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 0x7f9754105a80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.362+0000 7f9759893700 1 --2- 172.21.15.32:0/2175807169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9754100d80 0x7f9754103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.362+0000 7f9759893700 1 -- 172.21.15.32:0/2175807169 >> 172.21.15.32:0/2175807169 conn(0x7f97540fa7a0 msgr2=0x7f97540fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:02.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.362+0000 7f9759893700 1 -- 172.21.15.32:0/2175807169 shutdown_connections 2024-05-06T21:33:02.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.362+0000 7f9759893700 1 -- 172.21.15.32:0/2175807169 wait complete. 2024-05-06T21:33:02.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.363+0000 7f9759893700 1 Processor -- start 2024-05-06T21:33:02.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.363+0000 7f9759893700 1 -- start start 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.363+0000 7f9759893700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9754100d80 0x7f9754195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.363+0000 7f9759893700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 0x7f9754196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.363+0000 7f9759893700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9754196920 con 0x7f97541036a0 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.363+0000 7f9759893700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9754196a60 con 0x7f9754100d80 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.363+0000 7f97527fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 0x7f9754196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.363+0000 7f97527fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 0x7f9754196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50264/0 (socket says 172.21.15.32:50264) 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.363+0000 7f97527fc700 1 -- 172.21.15.32:0/238330906 learned_addr learned my addr 172.21.15.32:0/238330906 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f9752ffd700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9754100d80 0x7f9754195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f97527fc700 1 -- 172.21.15.32:0/238330906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9754100d80 msgr2=0x7f9754195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f97527fc700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9754100d80 0x7f9754195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f97527fc700 1 -- 172.21.15.32:0/238330906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0095f0 con 0x7f97541036a0 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f97527fc700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 0x7f9754196300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f973c000c00 tx=0x7f973c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f9758891700 1 -- 172.21.15.32:0/238330906 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973c01d070 con 0x7f97541036a0 2024-05-06T21:33:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f9758891700 1 -- 172.21.15.32:0/238330906 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f973c005dc0 con 0x7f97541036a0 2024-05-06T21:33:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f9758891700 1 -- 172.21.15.32:0/238330906 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973c0226a0 con 0x7f97541036a0 2024-05-06T21:33:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975419b4b0 con 0x7f97541036a0 2024-05-06T21:33:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.364+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975419b9a0 con 0x7f97541036a0 2024-05-06T21:33:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.365+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975418fc00 con 0x7f97541036a0 2024-05-06T21:33:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.366+0000 7f9758891700 1 -- 172.21.15.32:0/238330906 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f973c003680 con 0x7f97541036a0 2024-05-06T21:33:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.366+0000 7f9758891700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f974006e200 0x7f97400706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.366+0000 7f9758891700 1 -- 172.21.15.32:0/238330906 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f973c08f7a0 con 0x7f97541036a0 2024-05-06T21:33:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.366+0000 7f9752ffd700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f974006e200 0x7f97400706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.367+0000 7f9752ffd700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f974006e200 0x7f97400706b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9754069890 tx=0x7f9744009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.372+0000 7f9758891700 1 -- 172.21.15.32:0/238330906 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f973c05c4f0 con 0x7f97541036a0 2024-05-06T21:33:02.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.631+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9754068ab0 con 0x7f97541036a0 2024-05-06T21:33:02.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.631+0000 7f9758891700 1 -- 172.21.15.32:0/238330906 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1899 (secure 0 0 0) 0x7f973c003930 con 0x7f97541036a0 2024-05-06T21:33:02.628 INFO:teuthology.orchestra.run.smithi032.stdout:e24 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 24 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:32:54.719550+0000 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:33:02.629 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 1 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486,1=24277} 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:33:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 14486 members: 14486 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{1:24277} state up:stopping seq 4 join_fscid=1 addr [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:33:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:33:02.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.633+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f974006e200 msgr2=0x7f97400706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.633+0000 7f9759893700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f974006e200 0x7f97400706b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9754069890 tx=0x7f9744009260 comp rx=0 tx=0).stop 2024-05-06T21:33:02.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.634+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 msgr2=0x7f9754196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.634+0000 7f9759893700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 0x7f9754196300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f973c000c00 tx=0x7f973c00f740 comp rx=0 tx=0).stop 2024-05-06T21:33:02.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.634+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 shutdown_connections 2024-05-06T21:33:02.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.634+0000 7f9759893700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f974006e200 0x7f97400706b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.634+0000 7f9759893700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9754100d80 0x7f9754195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.634+0000 7f9759893700 1 --2- 172.21.15.32:0/238330906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97541036a0 0x7f9754196300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.634+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 >> 172.21.15.32:0/238330906 conn(0x7f97540fa7a0 msgr2=0x7f97540fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:02.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.634+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 shutdown_connections 2024-05-06T21:33:02.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.634+0000 7f9759893700 1 -- 172.21.15.32:0/238330906 wait complete. 2024-05-06T21:33:02.633 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 24 2024-05-06T21:33:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.744+0000 7ffb9744d700 1 -- 172.21.15.32:0/54083279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90101440 msgr2=0x7ffb90101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.744+0000 7ffb9744d700 1 --2- 172.21.15.32:0/54083279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90101440 0x7ffb90101890 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009910 tx=0x7ffb80009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.744+0000 7ffb9744d700 1 -- 172.21.15.32:0/54083279 shutdown_connections 2024-05-06T21:33:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.744+0000 7ffb9744d700 1 --2- 172.21.15.32:0/54083279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90101440 0x7ffb90101890 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.744+0000 7ffb9744d700 1 --2- 172.21.15.32:0/54083279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb90100240 0x7ffb90100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.744+0000 7ffb9744d700 1 -- 172.21.15.32:0/54083279 >> 172.21.15.32:0/54083279 conn(0x7ffb900fb7f0 msgr2=0x7ffb900fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.744+0000 7ffb9744d700 1 -- 172.21.15.32:0/54083279 shutdown_connections 2024-05-06T21:33:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.744+0000 7ffb9744d700 1 -- 172.21.15.32:0/54083279 wait complete. 2024-05-06T21:33:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb9744d700 1 Processor -- start 2024-05-06T21:33:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb9744d700 1 -- start start 2024-05-06T21:33:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb9744d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90100240 0x7ffb90195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb9744d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb90101440 0x7ffb90195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb9744d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90196610 con 0x7ffb90100240 2024-05-06T21:33:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb9744d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90196750 con 0x7ffb90101440 2024-05-06T21:33:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb951e9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90100240 0x7ffb90195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb951e9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90100240 0x7ffb90195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50282/0 (socket says 172.21.15.32:50282) 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb951e9700 1 -- 172.21.15.32:0/4137967079 learned_addr learned my addr 172.21.15.32:0/4137967079 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb951e9700 1 -- 172.21.15.32:0/4137967079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb90101440 msgr2=0x7ffb90195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb951e9700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb90101440 0x7ffb90195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.745+0000 7ffb951e9700 1 -- 172.21.15.32:0/4137967079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800095f0 con 0x7ffb90100240 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.746+0000 7ffb951e9700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90100240 0x7ffb90195ab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00d900 tx=0x7ffb8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.746+0000 7ffb867fc700 1 -- 172.21.15.32:0/4137967079 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb8c0041f0 con 0x7ffb90100240 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.746+0000 7ffb867fc700 1 -- 172.21.15.32:0/4137967079 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb8c004350 con 0x7ffb90100240 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.746+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9019b200 con 0x7ffb90100240 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.746+0000 7ffb867fc700 1 -- 172.21.15.32:0/4137967079 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb8c003da0 con 0x7ffb90100240 2024-05-06T21:33:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.746+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9019b750 con 0x7ffb90100240 2024-05-06T21:33:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.747+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb90108d90 con 0x7ffb90100240 2024-05-06T21:33:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.748+0000 7ffb867fc700 1 -- 172.21.15.32:0/4137967079 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ffb8c009730 con 0x7ffb90100240 2024-05-06T21:33:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.748+0000 7ffb867fc700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffb7c06e200 0x7ffb7c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.748+0000 7ffb867fc700 1 -- 172.21.15.32:0/4137967079 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7ffb8c08e3a0 con 0x7ffb90100240 2024-05-06T21:33:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.748+0000 7ffb949e8700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffb7c06e200 0x7ffb7c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.749+0000 7ffb949e8700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffb7c06e200 0x7ffb7c0706b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000b5c0 tx=0x7ffb80005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:02.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.753+0000 7ffb867fc700 1 -- 172.21.15.32:0/4137967079 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ffb8c05b0f0 con 0x7ffb90100240 2024-05-06T21:33:02.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:02 smithi032 ceph-mon[76650]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:02.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:02 smithi032 ceph-mon[76650]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:02.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:02 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/757663670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:02.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:02 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/238330906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:33:02.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.994+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb90105d90 con 0x7ffb7c06e200 2024-05-06T21:33:02.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.995+0000 7ffb867fc700 1 -- 172.21.15.32:0/4137967079 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffb90105d90 con 0x7ffb7c06e200 2024-05-06T21:33:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:33:02.992 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:33:02.992 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:33:02.992 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:33:02.992 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:33:02.993 INFO:teuthology.orchestra.run.smithi032.stdout: "osd", 2024-05-06T21:33:02.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:33:02.993 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:33:02.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:33:02.993 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:33:02.993 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "12/23 daemons upgraded", 2024-05-06T21:33:02.993 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T21:33:02.994 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:33:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:33:02.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffb7c06e200 msgr2=0x7ffb7c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffb7c06e200 0x7ffb7c0706b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000b5c0 tx=0x7ffb80005960 comp rx=0 tx=0).stop 2024-05-06T21:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90100240 msgr2=0x7ffb90195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90100240 0x7ffb90195ab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00d900 tx=0x7ffb8c00dcc0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 shutdown_connections 2024-05-06T21:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ffb7c06e200 0x7ffb7c0706b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb90100240 0x7ffb90195ab0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 --2- 172.21.15.32:0/4137967079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb90101440 0x7ffb90195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 >> 172.21.15.32:0/4137967079 conn(0x7ffb900fb7f0 msgr2=0x7ffb90104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 shutdown_connections 2024-05-06T21:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:02.997+0000 7ffb9744d700 1 -- 172.21.15.32:0/4137967079 wait complete. 2024-05-06T21:33:03.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.106+0000 7ff88c81d700 1 -- 172.21.15.32:0/3929239221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888103330 msgr2=0x7ff8881057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:03.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.106+0000 7ff88c81d700 1 --2- 172.21.15.32:0/3929239221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888103330 0x7ff8881057b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff870009910 tx=0x7ff870009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:03.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.106+0000 7ff88c81d700 1 -- 172.21.15.32:0/3929239221 shutdown_connections 2024-05-06T21:33:03.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.106+0000 7ff88c81d700 1 --2- 172.21.15.32:0/3929239221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888103330 0x7ff8881057b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:03.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.106+0000 7ff88c81d700 1 --2- 172.21.15.32:0/3929239221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff888069b00 0x7ff888102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:03.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.106+0000 7ff88c81d700 1 -- 172.21.15.32:0/3929239221 >> 172.21.15.32:0/3929239221 conn(0x7ff8880fa7a0 msgr2=0x7ff8880fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:03.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.106+0000 7ff88c81d700 1 -- 172.21.15.32:0/3929239221 shutdown_connections 2024-05-06T21:33:03.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.106+0000 7ff88c81d700 1 -- 172.21.15.32:0/3929239221 wait complete. 2024-05-06T21:33:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff88c81d700 1 Processor -- start 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff88c81d700 1 -- start start 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff88c81d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff888103330 0x7ff888198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff88c81d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888198580 0x7ff88819d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff88c81d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888198a80 con 0x7ff888198580 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff88c81d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888198bf0 con 0x7ff888103330 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff885d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888198580 0x7ff88819d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff885d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888198580 0x7ff88819d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50308/0 (socket says 172.21.15.32:50308) 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff885d9b700 1 -- 172.21.15.32:0/3168357034 learned_addr learned my addr 172.21.15.32:0/3168357034 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff88659c700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff888103330 0x7ff888198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff885d9b700 1 -- 172.21.15.32:0/3168357034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff888103330 msgr2=0x7ff888198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff885d9b700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff888103330 0x7ff888198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff885d9b700 1 -- 172.21.15.32:0/3168357034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700095f0 con 0x7ff888198580 2024-05-06T21:33:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.107+0000 7ff885d9b700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888198580 0x7ff88819d5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff870006010 tx=0x7ff87000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:03.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.108+0000 7ff87f7fe700 1 -- 172.21.15.32:0/3168357034 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87001d070 con 0x7ff888198580 2024-05-06T21:33:03.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.108+0000 7ff87f7fe700 1 -- 172.21.15.32:0/3168357034 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff87000f460 con 0x7ff888198580 2024-05-06T21:33:03.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.108+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88819dae0 con 0x7ff888198580 2024-05-06T21:33:03.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.108+0000 7ff87f7fe700 1 -- 172.21.15.32:0/3168357034 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff870021640 con 0x7ff888198580 2024-05-06T21:33:03.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.108+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88819dfa0 con 0x7ff888198580 2024-05-06T21:33:03.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.109+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff888068ab0 con 0x7ff888198580 2024-05-06T21:33:03.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.109+0000 7ff87f7fe700 1 -- 172.21.15.32:0/3168357034 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff87000fab0 con 0x7ff888198580 2024-05-06T21:33:03.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.110+0000 7ff87f7fe700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff87406e200 0x7ff8740706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:03.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.110+0000 7ff87f7fe700 1 -- 172.21.15.32:0/3168357034 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7ff87008f520 con 0x7ff888198580 2024-05-06T21:33:03.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.110+0000 7ff88659c700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff87406e200 0x7ff8740706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:03.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.111+0000 7ff88659c700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff87406e200 0x7ff8740706b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff878005950 tx=0x7ff87800a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:03.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.115+0000 7ff87f7fe700 1 -- 172.21.15.32:0/3168357034 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff87005c2f0 con 0x7ff888198580 2024-05-06T21:33:03.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:02 smithi154 ceph-mon[63622]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:03.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:02 smithi154 ceph-mon[63622]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:03.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:02 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/757663670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:03.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:02 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/238330906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:33:03.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.418+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff88819e280 con 0x7ff888198580 2024-05-06T21:33:03.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.418+0000 7ff87f7fe700 1 -- 172.21.15.32:0/3168357034 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff87005be80 con 0x7ff888198580 2024-05-06T21:33:03.415 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:33:03.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.420+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff87406e200 msgr2=0x7ff8740706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:03.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.420+0000 7ff88c81d700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff87406e200 0x7ff8740706b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff878005950 tx=0x7ff87800a300 comp rx=0 tx=0).stop 2024-05-06T21:33:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.420+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888198580 msgr2=0x7ff88819d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.420+0000 7ff88c81d700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888198580 0x7ff88819d5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff870006010 tx=0x7ff87000bd70 comp rx=0 tx=0).stop 2024-05-06T21:33:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.420+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 shutdown_connections 2024-05-06T21:33:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.420+0000 7ff88c81d700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff87406e200 0x7ff8740706b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.420+0000 7ff88c81d700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff888103330 0x7ff888198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.420+0000 7ff88c81d700 1 --2- 172.21.15.32:0/3168357034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff888198580 0x7ff88819d5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.420+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 >> 172.21.15.32:0/3168357034 conn(0x7ff8880fa7a0 msgr2=0x7ff8880febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.421+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 shutdown_connections 2024-05-06T21:33:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:03.421+0000 7ff88c81d700 1 -- 172.21.15.32:0/3168357034 wait complete. 2024-05-06T21:33:04.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:03 smithi154 ceph-mon[63622]: pgmap v185: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-06T21:33:04.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:03 smithi154 ceph-mon[63622]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:stopping} 2 up:standby 2024-05-06T21:33:04.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:03 smithi154 ceph-mon[63622]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:04.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:03 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3168357034' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:33:04.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:03 smithi032 ceph-mon[76650]: pgmap v185: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-06T21:33:04.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:03 smithi032 ceph-mon[76650]: fsmap cephfs:2 {0=cephfs.smithi032.jbgmwi=up:active,1=cephfs.smithi154.rizdbu=up:stopping} 2 up:standby 2024-05-06T21:33:04.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:03 smithi032 ceph-mon[76650]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:04.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:03 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3168357034' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:33:06.045 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: pgmap v186: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s wr, 2 op/s 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-05-06T21:33:06.046 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:06.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:33:06.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: pgmap v186: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s wr, 2 op/s 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:06.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:06.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-05-06T21:33:06.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:06.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:33:06.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:08.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:07 smithi154 ceph-mon[63622]: pgmap v187: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s wr, 1 op/s 2024-05-06T21:33:08.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:07 smithi032 ceph-mon[76650]: pgmap v187: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s wr, 1 op/s 2024-05-06T21:33:09.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:09 smithi154 ceph-mon[63622]: pgmap v188: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 5.6 KiB/s wr, 2 op/s 2024-05-06T21:33:10.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:09 smithi032 ceph-mon[76650]: pgmap v188: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 5.6 KiB/s wr, 2 op/s 2024-05-06T21:33:12.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:11 smithi154 ceph-mon[63622]: pgmap v189: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 6.1 KiB/s wr, 3 op/s 2024-05-06T21:33:12.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:11 smithi032 ceph-mon[76650]: pgmap v189: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 6.1 KiB/s wr, 3 op/s 2024-05-06T21:33:14.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:13 smithi154 ceph-mon[63622]: pgmap v190: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-05-06T21:33:14.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:13 smithi032 ceph-mon[76650]: pgmap v190: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-05-06T21:33:16.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:15 smithi154 ceph-mon[63622]: pgmap v191: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 3.0 KiB/s wr, 2 op/s 2024-05-06T21:33:16.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:16.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:16.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:16.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:16.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:15 smithi032 ceph-mon[76650]: pgmap v191: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 3.0 KiB/s wr, 2 op/s 2024-05-06T21:33:16.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:16.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:16.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:16.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:17.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:17.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:17.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:17.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:17.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:17.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:16 smithi154 ceph-mon[63622]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-05-06T21:33:17.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:17.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:17.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:17.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:17.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:17.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:16 smithi032 ceph-mon[76650]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-05-06T21:33:18.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:17 smithi154 ceph-mon[63622]: pgmap v192: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-06T21:33:18.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:17 smithi032 ceph-mon[76650]: pgmap v192: 65 pgs: 65 active+clean; 314 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 1.7 KiB/s wr, 3 op/s 2024-05-06T21:33:20.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:19 smithi154 ceph-mon[63622]: pgmap v193: 65 pgs: 65 active+clean; 302 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 2.3 KiB/s wr, 6 op/s 2024-05-06T21:33:20.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:19 smithi032 ceph-mon[76650]: pgmap v193: 65 pgs: 65 active+clean; 302 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 2.3 KiB/s wr, 6 op/s 2024-05-06T21:33:21.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:33:21.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:33:22.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:21 smithi154 ceph-mon[63622]: pgmap v194: 65 pgs: 65 active+clean; 270 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 KiB/s wr, 6 op/s 2024-05-06T21:33:22.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:21 smithi032 ceph-mon[76650]: pgmap v194: 65 pgs: 65 active+clean; 270 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 KiB/s wr, 6 op/s 2024-05-06T21:33:23.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:23 smithi032 ceph-mon[76650]: pgmap v195: 65 pgs: 65 active+clean; 174 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-06T21:33:24.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:23 smithi154 ceph-mon[63622]: pgmap v195: 65 pgs: 65 active+clean; 174 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-06T21:33:26.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:25 smithi154 ceph-mon[63622]: pgmap v196: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 8 op/s 2024-05-06T21:33:26.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:25 smithi032 ceph-mon[76650]: pgmap v196: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 8 op/s 2024-05-06T21:33:27.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:27.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:27.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:27.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:27.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:27.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:27.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:27.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:27.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:27.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:26 smithi154 ceph-mon[63622]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-05-06T21:33:27.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:27.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:27.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:27.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:27.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:27.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:27.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:27.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:27.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:27.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:26 smithi032 ceph-mon[76650]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-05-06T21:33:28.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:27 smithi032 ceph-mon[76650]: pgmap v197: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-05-06T21:33:28.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:27 smithi032 ceph-mon[76650]: daemon mds.cephfs.smithi154.rizdbu finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-05-06T21:33:28.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:27 smithi154 ceph-mon[63622]: pgmap v197: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-05-06T21:33:28.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:27 smithi154 ceph-mon[63622]: daemon mds.cephfs.smithi154.rizdbu finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-05-06T21:33:29.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:28 smithi032 ceph-mon[76650]: mds.1 [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] down:stopped 2024-05-06T21:33:29.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:28 smithi032 ceph-mon[76650]: fsmap cephfs:1 {0=cephfs.smithi032.jbgmwi=up:active} 2 up:standby 2024-05-06T21:33:29.265 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:28 smithi154 ceph-mon[63622]: mds.1 [v2:172.21.15.154:6824/345804530,v1:172.21.15.154:6825/345804530] down:stopped 2024-05-06T21:33:29.266 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:28 smithi154 ceph-mon[63622]: fsmap cephfs:1 {0=cephfs.smithi032.jbgmwi=up:active} 2 up:standby 2024-05-06T21:33:30.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:29 smithi154 ceph-mon[63622]: pgmap v198: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 6 op/s 2024-05-06T21:33:30.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:29 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.154:6824/1058144183,v1:172.21.15.154:6825/1058144183] up:boot 2024-05-06T21:33:30.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:29 smithi154 ceph-mon[63622]: fsmap cephfs:1 {0=cephfs.smithi032.jbgmwi=up:active} 3 up:standby 2024-05-06T21:33:30.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:33:30.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:29 smithi032 ceph-mon[76650]: pgmap v198: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 6 op/s 2024-05-06T21:33:30.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:29 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.154:6824/1058144183,v1:172.21.15.154:6825/1058144183] up:boot 2024-05-06T21:33:30.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:29 smithi032 ceph-mon[76650]: fsmap cephfs:1 {0=cephfs.smithi032.jbgmwi=up:active} 3 up:standby 2024-05-06T21:33:30.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:33:32.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:31 smithi032 ceph-mon[76650]: pgmap v199: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-05-06T21:33:32.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:31 smithi154 ceph-mon[63622]: pgmap v199: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-05-06T21:33:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.545+0000 7f07b342b700 1 -- 172.21.15.32:0/1415139206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 msgr2=0x7f07ac101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.545+0000 7f07b342b700 1 --2- 172.21.15.32:0/1415139206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 0x7f07ac101890 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07a0009910 tx=0x7f07a0009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.545+0000 7f07b342b700 1 -- 172.21.15.32:0/1415139206 shutdown_connections 2024-05-06T21:33:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.545+0000 7f07b342b700 1 --2- 172.21.15.32:0/1415139206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 0x7f07ac101890 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.545+0000 7f07b342b700 1 --2- 172.21.15.32:0/1415139206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac100240 0x7f07ac100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.545+0000 7f07b342b700 1 -- 172.21.15.32:0/1415139206 >> 172.21.15.32:0/1415139206 conn(0x7f07ac0fb7f0 msgr2=0x7f07ac0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.545+0000 7f07b342b700 1 -- 172.21.15.32:0/1415139206 shutdown_connections 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.545+0000 7f07b342b700 1 -- 172.21.15.32:0/1415139206 wait complete. 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.545+0000 7f07b342b700 1 Processor -- start 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b342b700 1 -- start start 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b342b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac100240 0x7f07ac195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b342b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 0x7f07ac195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b342b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac196580 con 0x7f07ac101440 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b342b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac1966c0 con 0x7f07ac100240 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b09c6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 0x7f07ac195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b09c6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 0x7f07ac195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49572/0 (socket says 172.21.15.32:49572) 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b09c6700 1 -- 172.21.15.32:0/1439747050 learned_addr learned my addr 172.21.15.32:0/1439747050 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b11c7700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac100240 0x7f07ac195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b09c6700 1 -- 172.21.15.32:0/1439747050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac100240 msgr2=0x7f07ac195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b09c6700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac100240 0x7f07ac195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b09c6700 1 -- 172.21.15.32:0/1439747050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a00095f0 con 0x7f07ac101440 2024-05-06T21:33:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.546+0000 7f07b09c6700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 0x7f07ac195f60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006010 tx=0x7f07a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.547+0000 7f07aa7fc700 1 -- 172.21.15.32:0/1439747050 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07a001d070 con 0x7f07ac101440 2024-05-06T21:33:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.547+0000 7f07aa7fc700 1 -- 172.21.15.32:0/1439747050 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07a000f460 con 0x7f07ac101440 2024-05-06T21:33:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.547+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac19b110 con 0x7f07ac101440 2024-05-06T21:33:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.547+0000 7f07aa7fc700 1 -- 172.21.15.32:0/1439747050 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07a0017630 con 0x7f07ac101440 2024-05-06T21:33:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.547+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac19b600 con 0x7f07ac101440 2024-05-06T21:33:33.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.548+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ac108d90 con 0x7f07ac101440 2024-05-06T21:33:33.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.548+0000 7f07aa7fc700 1 -- 172.21.15.32:0/1439747050 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f07a0003a60 con 0x7f07ac101440 2024-05-06T21:33:33.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.549+0000 7f07aa7fc700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f079406e200 0x7f07940706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:33.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.549+0000 7f07aa7fc700 1 -- 172.21.15.32:0/1439747050 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f07a008f660 con 0x7f07ac101440 2024-05-06T21:33:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.549+0000 7f07b11c7700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f079406e200 0x7f07940706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.550+0000 7f07b11c7700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f079406e200 0x7f07940706b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f07ac1012a0 tx=0x7f079c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:33.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.554+0000 7f07aa7fc700 1 -- 172.21.15.32:0/1439747050 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f07a005c430 con 0x7f07ac101440 2024-05-06T21:33:33.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.793+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07ac105d90 con 0x7f079406e200 2024-05-06T21:33:33.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.795+0000 7f07aa7fc700 1 -- 172.21.15.32:0/1439747050 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f07ac105d90 con 0x7f079406e200 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.797+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f079406e200 msgr2=0x7f07940706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.797+0000 7f07b342b700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f079406e200 0x7f07940706b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f07ac1012a0 tx=0x7f079c009040 comp rx=0 tx=0).stop 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.797+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 msgr2=0x7f07ac195f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.797+0000 7f07b342b700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 0x7f07ac195f60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006010 tx=0x7f07a000be20 comp rx=0 tx=0).stop 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.798+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 shutdown_connections 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.798+0000 7f07b342b700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f079406e200 0x7f07940706b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.798+0000 7f07b342b700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac100240 0x7f07ac195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.798+0000 7f07b342b700 1 --2- 172.21.15.32:0/1439747050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07ac101440 0x7f07ac195f60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.798+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 >> 172.21.15.32:0/1439747050 conn(0x7f07ac0fb7f0 msgr2=0x7f07ac104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.798+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 shutdown_connections 2024-05-06T21:33:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.798+0000 7f07b342b700 1 -- 172.21.15.32:0/1439747050 wait complete. 2024-05-06T21:33:33.808 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:33:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.915+0000 7fc99eb1a700 1 -- 172.21.15.32:0/992629575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9980ff150 msgr2=0x7fc9980ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.915+0000 7fc99eb1a700 1 --2- 172.21.15.32:0/992629575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9980ff150 0x7fc9980ff560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc988009910 tx=0x7fc988009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.915+0000 7fc99eb1a700 1 -- 172.21.15.32:0/992629575 shutdown_connections 2024-05-06T21:33:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.915+0000 7fc99eb1a700 1 --2- 172.21.15.32:0/992629575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9981003f0 0x7fc998100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.915+0000 7fc99eb1a700 1 --2- 172.21.15.32:0/992629575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9980ff150 0x7fc9980ff560 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.915+0000 7fc99eb1a700 1 -- 172.21.15.32:0/992629575 >> 172.21.15.32:0/992629575 conn(0x7fc9980fa7a0 msgr2=0x7fc9980fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.915+0000 7fc99eb1a700 1 -- 172.21.15.32:0/992629575 shutdown_connections 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.915+0000 7fc99eb1a700 1 -- 172.21.15.32:0/992629575 wait complete. 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc99eb1a700 1 Processor -- start 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc99eb1a700 1 -- start start 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc99eb1a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980ff150 0x7fc998069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc99eb1a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9981003f0 0x7fc99819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc99eb1a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99819b180 con 0x7fc9981003f0 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc99eb1a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99819b2c0 con 0x7fc9980ff150 2024-05-06T21:33:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc997fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9981003f0 0x7fc99819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc997fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9981003f0 0x7fc99819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49588/0 (socket says 172.21.15.32:49588) 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc997fff700 1 -- 172.21.15.32:0/2849674843 learned_addr learned my addr 172.21.15.32:0/2849674843 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc99c8b6700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980ff150 0x7fc998069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc997fff700 1 -- 172.21.15.32:0/2849674843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980ff150 msgr2=0x7fc998069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc997fff700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980ff150 0x7fc998069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc997fff700 1 -- 172.21.15.32:0/2849674843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9880095f0 con 0x7fc9981003f0 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc99c8b6700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980ff150 0x7fc998069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.916+0000 7fc997fff700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9981003f0 0x7fc99819abb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00b4b0 tx=0x7fc98c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.917+0000 7fc995ffb700 1 -- 172.21.15.32:0/2849674843 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc98c011800 con 0x7fc9981003f0 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.917+0000 7fc995ffb700 1 -- 172.21.15.32:0/2849674843 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc98c011e10 con 0x7fc9981003f0 2024-05-06T21:33:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.917+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99819b5a0 con 0x7fc9981003f0 2024-05-06T21:33:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.917+0000 7fc995ffb700 1 -- 172.21.15.32:0/2849674843 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc98c00f2e0 con 0x7fc9981003f0 2024-05-06T21:33:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.917+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99819baf0 con 0x7fc9981003f0 2024-05-06T21:33:33.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.918+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc998068ab0 con 0x7fc9981003f0 2024-05-06T21:33:33.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.918+0000 7fc995ffb700 1 -- 172.21.15.32:0/2849674843 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc98c010380 con 0x7fc9981003f0 2024-05-06T21:33:33.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.919+0000 7fc995ffb700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc98006e200 0x7fc9800706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:33.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.919+0000 7fc995ffb700 1 -- 172.21.15.32:0/2849674843 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fc98c08dda0 con 0x7fc9981003f0 2024-05-06T21:33:33.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.919+0000 7fc99c8b6700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc98006e200 0x7fc9800706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:33.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.919+0000 7fc99c8b6700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc98006e200 0x7fc9800706b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc98800b5c0 tx=0x7fc988005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:33.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:33.923+0000 7fc995ffb700 1 -- 172.21.15.32:0/2849674843 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc98c05ab70 con 0x7fc9981003f0 2024-05-06T21:33:34.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.153+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc998104e00 con 0x7fc98006e200 2024-05-06T21:33:34.150 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:33 smithi032 ceph-mon[76650]: pgmap v200: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-05-06T21:33:34.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.154+0000 7fc995ffb700 1 -- 172.21.15.32:0/2849674843 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc998104e00 con 0x7fc98006e200 2024-05-06T21:33:34.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc98006e200 msgr2=0x7fc9800706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc98006e200 0x7fc9800706b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc98800b5c0 tx=0x7fc988005e20 comp rx=0 tx=0).stop 2024-05-06T21:33:34.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9981003f0 msgr2=0x7fc99819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9981003f0 0x7fc99819abb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00b4b0 tx=0x7fc98c00b870 comp rx=0 tx=0).stop 2024-05-06T21:33:34.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 shutdown_connections 2024-05-06T21:33:34.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc98006e200 0x7fc9800706b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980ff150 0x7fc998069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 --2- 172.21.15.32:0/2849674843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9981003f0 0x7fc99819abb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 >> 172.21.15.32:0/2849674843 conn(0x7fc9980fa7a0 msgr2=0x7fc9981036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:34.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 shutdown_connections 2024-05-06T21:33:34.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.156+0000 7fc99eb1a700 1 -- 172.21.15.32:0/2849674843 wait complete. 2024-05-06T21:33:34.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.264+0000 7f619dea6700 1 -- 172.21.15.32:0/3031251588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198073730 msgr2=0x7f6198073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.264+0000 7f619dea6700 1 --2- 172.21.15.32:0/3031251588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198073730 0x7f6198073ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f618c009910 tx=0x7f618c009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:34.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.264+0000 7f619dea6700 1 -- 172.21.15.32:0/3031251588 shutdown_connections 2024-05-06T21:33:34.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.264+0000 7f619dea6700 1 --2- 172.21.15.32:0/3031251588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198073730 0x7f6198073ba0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.264+0000 7f619dea6700 1 --2- 172.21.15.32:0/3031251588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6198074d00 0x7f6198073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.264+0000 7f619dea6700 1 -- 172.21.15.32:0/3031251588 >> 172.21.15.32:0/3031251588 conn(0x7f61980fb7f0 msgr2=0x7f61980fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:34.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.265+0000 7f619dea6700 1 -- 172.21.15.32:0/3031251588 shutdown_connections 2024-05-06T21:33:34.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.265+0000 7f619dea6700 1 -- 172.21.15.32:0/3031251588 wait complete. 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.265+0000 7f619dea6700 1 Processor -- start 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.265+0000 7f619dea6700 1 -- start start 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f619dea6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6198073730 0x7f6198197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f619dea6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198074d00 0x7f6198198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f619dea6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981988a0 con 0x7f6198074d00 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f619dea6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981989e0 con 0x7f6198073730 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6196ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198074d00 0x7f6198198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6196ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198074d00 0x7f6198198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49592/0 (socket says 172.21.15.32:49592) 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6196ffd700 1 -- 172.21.15.32:0/3158661304 learned_addr learned my addr 172.21.15.32:0/3158661304 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f61977fe700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6198073730 0x7f6198197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6196ffd700 1 -- 172.21.15.32:0/3158661304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6198073730 msgr2=0x7f6198197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6196ffd700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6198073730 0x7f6198197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6196ffd700 1 -- 172.21.15.32:0/3158661304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0095f0 con 0x7f6198074d00 2024-05-06T21:33:34.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6196ffd700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198074d00 0x7f6198198280 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f618c006010 tx=0x7f618c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:34.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6194ff9700 1 -- 172.21.15.32:0/3158661304 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f618c01d070 con 0x7f6198074d00 2024-05-06T21:33:34.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6194ff9700 1 -- 172.21.15.32:0/3158661304 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f618c00f460 con 0x7f6198074d00 2024-05-06T21:33:34.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619819d430 con 0x7f6198074d00 2024-05-06T21:33:34.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f6194ff9700 1 -- 172.21.15.32:0/3158661304 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f618c021640 con 0x7f6198074d00 2024-05-06T21:33:34.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.266+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619819d920 con 0x7f6198074d00 2024-05-06T21:33:34.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.267+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619810aff0 con 0x7f6198074d00 2024-05-06T21:33:34.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.268+0000 7f6194ff9700 1 -- 172.21.15.32:0/3158661304 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f618c00fab0 con 0x7f6198074d00 2024-05-06T21:33:34.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.268+0000 7f6194ff9700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f618006e200 0x7f61800706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:34.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.268+0000 7f6194ff9700 1 -- 172.21.15.32:0/3158661304 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f618c08f6e0 con 0x7f6198074d00 2024-05-06T21:33:34.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.268+0000 7f61977fe700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f618006e200 0x7f61800706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:34.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.269+0000 7f61977fe700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f618006e200 0x7f61800706b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6188006fd0 tx=0x7f6188008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:34.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.273+0000 7f6194ff9700 1 -- 172.21.15.32:0/3158661304 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f618c05c4b0 con 0x7f6198074d00 2024-05-06T21:33:34.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:33 smithi154 ceph-mon[63622]: pgmap v200: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-05-06T21:33:34.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.496+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f61981077c0 con 0x7f618006e200 2024-05-06T21:33:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.507+0000 7f6194ff9700 1 -- 172.21.15.32:0/3158661304 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f61981077c0 con 0x7f618006e200 2024-05-06T21:33:34.504 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:33:34.504 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (13m) 2m ago 15m 24.2M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:33:34.504 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (15m) 2m ago 15m 8426k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:33:34.504 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (14m) 46s ago 14m 8472k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:33:34.504 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (4m) 2m ago 15m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (4m) 46s ago 14m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (13m) 2m ago 14m 86.4M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (9m) 2m ago 9m 15.6M - 18.2.0 dc2bc1663786 cd588e62c48c 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (9m) 2m ago 9m 126M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (9m) 46s ago 9m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (9m) 46s ago 9m 18.0M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (6m) 2m ago 16m 504M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (5m) 46s ago 14m 451M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (5m) 2m ago 16m 46.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (5m) 46s ago 14m 40.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (15m) 2m ago 15m 16.3M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (14m) 46s ago 14m 16.7M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (3m) 2m ago 13m 157M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (3m) 2m ago 12m 133M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:33:34.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (2m) 2m ago 12m 12.1M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:33:34.506 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (116s) 46s ago 12m 93.2M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:33:34.506 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (83s) 46s ago 11m 97.6M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:33:34.506 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (49s) 46s ago 11m 12.3M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 8b513e97a420 2024-05-06T21:33:34.506 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (5m) 2m ago 14m 69.1M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:33:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f618006e200 msgr2=0x7f61800706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f618006e200 0x7f61800706b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6188006fd0 tx=0x7f6188008040 comp rx=0 tx=0).stop 2024-05-06T21:33:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198074d00 msgr2=0x7f6198198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198074d00 0x7f6198198280 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f618c006010 tx=0x7f618c00be20 comp rx=0 tx=0).stop 2024-05-06T21:33:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 shutdown_connections 2024-05-06T21:33:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f618006e200 0x7f61800706b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6198073730 0x7f6198197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 --2- 172.21.15.32:0/3158661304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6198074d00 0x7f6198198280 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 >> 172.21.15.32:0/3158661304 conn(0x7f61980fb7f0 msgr2=0x7f61981060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 shutdown_connections 2024-05-06T21:33:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.510+0000 7f619dea6700 1 -- 172.21.15.32:0/3158661304 wait complete. 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 -- 172.21.15.32:0/3495040009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 msgr2=0x7fb178105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 --2- 172.21.15.32:0/3495040009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 0x7fb178105a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb168009910 tx=0x7fb168009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 -- 172.21.15.32:0/3495040009 shutdown_connections 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 --2- 172.21.15.32:0/3495040009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 0x7fb178105a80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 --2- 172.21.15.32:0/3495040009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb178100d80 0x7fb178103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 -- 172.21.15.32:0/3495040009 >> 172.21.15.32:0/3495040009 conn(0x7fb1780fa7a0 msgr2=0x7fb1780fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 -- 172.21.15.32:0/3495040009 shutdown_connections 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 -- 172.21.15.32:0/3495040009 wait complete. 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 Processor -- start 2024-05-06T21:33:34.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.618+0000 7fb180156700 1 -- start start 2024-05-06T21:33:34.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb180156700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb178100d80 0x7fb1781006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb180156700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 0x7fb1780fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb180156700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780ff270 con 0x7fb1781036a0 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb180156700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780ff3b0 con 0x7fb178100d80 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb17d6f1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 0x7fb1780fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb17d6f1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 0x7fb1780fed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49622/0 (socket says 172.21.15.32:49622) 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb17d6f1700 1 -- 172.21.15.32:0/1184004152 learned_addr learned my addr 172.21.15.32:0/1184004152 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb17def2700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb178100d80 0x7fb1781006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb17d6f1700 1 -- 172.21.15.32:0/1184004152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb178100d80 msgr2=0x7fb1781006e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb17d6f1700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb178100d80 0x7fb1781006e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb17d6f1700 1 -- 172.21.15.32:0/1184004152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680095f0 con 0x7fb1781036a0 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb17d6f1700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 0x7fb1780fed30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb168000c00 tx=0x7fb16800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb16effd700 1 -- 172.21.15.32:0/1184004152 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb16801d070 con 0x7fb1781036a0 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb16effd700 1 -- 172.21.15.32:0/1184004152 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb168005dc0 con 0x7fb1781036a0 2024-05-06T21:33:34.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1780ff630 con 0x7fb1781036a0 2024-05-06T21:33:34.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.619+0000 7fb16effd700 1 -- 172.21.15.32:0/1184004152 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1680226a0 con 0x7fb1781036a0 2024-05-06T21:33:34.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.620+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1780ffb20 con 0x7fb1781036a0 2024-05-06T21:33:34.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.621+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17818fc00 con 0x7fb1781036a0 2024-05-06T21:33:34.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.621+0000 7fb16effd700 1 -- 172.21.15.32:0/1184004152 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb1680038f0 con 0x7fb1781036a0 2024-05-06T21:33:34.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.621+0000 7fb16effd700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb16406e200 0x7fb1640706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:34.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.622+0000 7fb16effd700 1 -- 172.21.15.32:0/1184004152 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fb16808f770 con 0x7fb1781036a0 2024-05-06T21:33:34.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.622+0000 7fb17def2700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb16406e200 0x7fb1640706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:34.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.622+0000 7fb17def2700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb16406e200 0x7fb1640706b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb178069890 tx=0x7fb174009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:34.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.626+0000 7fb16effd700 1 -- 172.21.15.32:0/1184004152 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb16805c4c0 con 0x7fb1781036a0 2024-05-06T21:33:34.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.935+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb178068ab0 con 0x7fb1781036a0 2024-05-06T21:33:34.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.936+0000 7fb16effd700 1 -- 172.21.15.32:0/1184004152 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+701 (secure 0 0 0) 0x7fb168003680 con 0x7fb1781036a0 2024-05-06T21:33:34.933 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:33:34.933 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:33:34.933 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:33:34.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-05-06T21:33:34.934 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 10 2024-05-06T21:33:34.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:33:34.935 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:33:34.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb16406e200 msgr2=0x7fb1640706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb16406e200 0x7fb1640706b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb178069890 tx=0x7fb174009260 comp rx=0 tx=0).stop 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 msgr2=0x7fb1780fed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 0x7fb1780fed30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb168000c00 tx=0x7fb16800f690 comp rx=0 tx=0).stop 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 shutdown_connections 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb16406e200 0x7fb1640706b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb178100d80 0x7fb1781006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 --2- 172.21.15.32:0/1184004152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1781036a0 0x7fb1780fed30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 >> 172.21.15.32:0/1184004152 conn(0x7fb1780fa7a0 msgr2=0x7fb1780fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.938+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 shutdown_connections 2024-05-06T21:33:34.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:34.939+0000 7fb180156700 1 -- 172.21.15.32:0/1184004152 wait complete. 2024-05-06T21:33:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.047+0000 7fe406bea700 1 -- 172.21.15.32:0/626146556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4001003f0 msgr2=0x7fe400100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.047+0000 7fe406bea700 1 --2- 172.21.15.32:0/626146556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4001003f0 0x7fe400100860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009910 tx=0x7fe3ec009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.047+0000 7fe406bea700 1 -- 172.21.15.32:0/626146556 shutdown_connections 2024-05-06T21:33:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.047+0000 7fe406bea700 1 --2- 172.21.15.32:0/626146556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4001003f0 0x7fe400100860 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.047+0000 7fe406bea700 1 --2- 172.21.15.32:0/626146556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4000ff150 0x7fe4000ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.047+0000 7fe406bea700 1 -- 172.21.15.32:0/626146556 >> 172.21.15.32:0/626146556 conn(0x7fe4000fa7a0 msgr2=0x7fe4000fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.048+0000 7fe406bea700 1 -- 172.21.15.32:0/626146556 shutdown_connections 2024-05-06T21:33:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.048+0000 7fe406bea700 1 -- 172.21.15.32:0/626146556 wait complete. 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.048+0000 7fe406bea700 1 Processor -- start 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.048+0000 7fe406bea700 1 -- start start 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.048+0000 7fe406bea700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4000ff150 0x7fe400069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe406bea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4001003f0 0x7fe40019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe406bea700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40019b160 con 0x7fe4000ff150 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe406bea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40019b2a0 con 0x7fe4001003f0 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe404986700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4000ff150 0x7fe400069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe404986700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4000ff150 0x7fe400069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49640/0 (socket says 172.21.15.32:49640) 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe404986700 1 -- 172.21.15.32:0/927895678 learned_addr learned my addr 172.21.15.32:0/927895678 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe3fffff700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4001003f0 0x7fe40019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe404986700 1 -- 172.21.15.32:0/927895678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4001003f0 msgr2=0x7fe40019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe404986700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4001003f0 0x7fe40019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe404986700 1 -- 172.21.15.32:0/927895678 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec0095f0 con 0x7fe4000ff150 2024-05-06T21:33:35.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe404986700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4000ff150 0x7fe400069930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400b4b0 tx=0x7fe3f400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:35.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe3fdffb700 1 -- 172.21.15.32:0/927895678 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3f4011800 con 0x7fe4000ff150 2024-05-06T21:33:35.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe3fdffb700 1 -- 172.21.15.32:0/927895678 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe3f4011e10 con 0x7fe4000ff150 2024-05-06T21:33:35.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40019b580 con 0x7fe4000ff150 2024-05-06T21:33:35.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.049+0000 7fe3fdffb700 1 -- 172.21.15.32:0/927895678 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3f400f2e0 con 0x7fe4000ff150 2024-05-06T21:33:35.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.050+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40019bad0 con 0x7fe4000ff150 2024-05-06T21:33:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.050+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe400068ab0 con 0x7fe4000ff150 2024-05-06T21:33:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.051+0000 7fe3fdffb700 1 -- 172.21.15.32:0/927895678 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe3f4010380 con 0x7fe4000ff150 2024-05-06T21:33:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.051+0000 7fe3fdffb700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe3f006e200 0x7fe3f00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.052+0000 7fe3fdffb700 1 -- 172.21.15.32:0/927895678 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fe3f408de20 con 0x7fe4000ff150 2024-05-06T21:33:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.052+0000 7fe3fffff700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe3f006e200 0x7fe3f00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.052+0000 7fe3fffff700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe3f006e200 0x7fe3f00706b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe400069eb0 tx=0x7fe3ec00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:35.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.056+0000 7fe3fdffb700 1 -- 172.21.15.32:0/927895678 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe3f405ab10 con 0x7fe4000ff150 2024-05-06T21:33:35.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:34 smithi032 ceph-mon[76650]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:35.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:34 smithi032 ceph-mon[76650]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:35.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.316+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe40019c290 con 0x7fe4000ff150 2024-05-06T21:33:35.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.317+0000 7fe3fdffb700 1 -- 172.21.15.32:0/927895678 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1892 (secure 0 0 0) 0x7fe3f4015780 con 0x7fe4000ff150 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout:e27 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 26 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:33:35.314 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:33:27.312354+0000 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 47 2024-05-06T21:33:35.315 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 1 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:in 0 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=14486} 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 1 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 14486 members: 14486 2024-05-06T21:33:35.316 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.32:6828/1302339589,v1:172.21.15.32:6829/1302339589] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:33:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:33:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:33:35.317 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:33:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:33:35.317 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:14494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/2817324625,v1:172.21.15.32:6827/2817324625] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:33:35.317 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:33:35.317 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{-1:44297} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6824/1058144183,v1:172.21.15.154:6825/1058144183] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:33:35.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe3f006e200 msgr2=0x7fe3f00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe3f006e200 0x7fe3f00706b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe400069eb0 tx=0x7fe3ec00b540 comp rx=0 tx=0).stop 2024-05-06T21:33:35.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4000ff150 msgr2=0x7fe400069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4000ff150 0x7fe400069930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400b4b0 tx=0x7fe3f400b7c0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 shutdown_connections 2024-05-06T21:33:35.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe3f006e200 0x7fe3f00706b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4000ff150 0x7fe400069930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 --2- 172.21.15.32:0/927895678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4001003f0 0x7fe40019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 >> 172.21.15.32:0/927895678 conn(0x7fe4000fa7a0 msgr2=0x7fe400103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:35.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 shutdown_connections 2024-05-06T21:33:35.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.319+0000 7fe406bea700 1 -- 172.21.15.32:0/927895678 wait complete. 2024-05-06T21:33:35.319 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 27 2024-05-06T21:33:35.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:34 smithi154 ceph-mon[63622]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:35.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:34 smithi154 ceph-mon[63622]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.434+0000 7fad5d1e4700 1 -- 172.21.15.32:0/4260983726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58100240 msgr2=0x7fad58100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.434+0000 7fad5d1e4700 1 --2- 172.21.15.32:0/4260983726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58100240 0x7fad58100650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad4800b0a0 tx=0x7fad4800b3b0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.434+0000 7fad5d1e4700 1 -- 172.21.15.32:0/4260983726 shutdown_connections 2024-05-06T21:33:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.434+0000 7fad5d1e4700 1 --2- 172.21.15.32:0/4260983726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad58101440 0x7fad58101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.434+0000 7fad5d1e4700 1 --2- 172.21.15.32:0/4260983726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58100240 0x7fad58100650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.434+0000 7fad5d1e4700 1 -- 172.21.15.32:0/4260983726 >> 172.21.15.32:0/4260983726 conn(0x7fad580fb7f0 msgr2=0x7fad580fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.434+0000 7fad5d1e4700 1 -- 172.21.15.32:0/4260983726 shutdown_connections 2024-05-06T21:33:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.434+0000 7fad5d1e4700 1 -- 172.21.15.32:0/4260983726 wait complete. 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5d1e4700 1 Processor -- start 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5d1e4700 1 -- start start 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5d1e4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad58100240 0x7fad58074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5d1e4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58101440 0x7fad58073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5d1e4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58073680 con 0x7fad58101440 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5d1e4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580737c0 con 0x7fad58100240 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58101440 0x7fad58073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58101440 0x7fad58073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49648/0 (socket says 172.21.15.32:49648) 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5659c700 1 -- 172.21.15.32:0/133869892 learned_addr learned my addr 172.21.15.32:0/133869892 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad56d9d700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad58100240 0x7fad58074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5659c700 1 -- 172.21.15.32:0/133869892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad58100240 msgr2=0x7fad58074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.435+0000 7fad5659c700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad58100240 0x7fad58074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.436+0000 7fad5659c700 1 -- 172.21.15.32:0/133869892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48009d00 con 0x7fad58101440 2024-05-06T21:33:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.436+0000 7fad5659c700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58101440 0x7fad58073140 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00d8d0 tx=0x7fad4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:35.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.436+0000 7fad3ffff700 1 -- 172.21.15.32:0/133869892 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad4c009940 con 0x7fad58101440 2024-05-06T21:33:35.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.436+0000 7fad3ffff700 1 -- 172.21.15.32:0/133869892 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fad4c010460 con 0x7fad58101440 2024-05-06T21:33:35.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.436+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad58073aa0 con 0x7fad58101440 2024-05-06T21:33:35.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.436+0000 7fad3ffff700 1 -- 172.21.15.32:0/133869892 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad4c00f5f0 con 0x7fad58101440 2024-05-06T21:33:35.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.436+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5819db30 con 0x7fad58101440 2024-05-06T21:33:35.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.437+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58108d90 con 0x7fad58101440 2024-05-06T21:33:35.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.437+0000 7fad3ffff700 1 -- 172.21.15.32:0/133869892 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fad4c0105d0 con 0x7fad58101440 2024-05-06T21:33:35.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.438+0000 7fad3ffff700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad4006e200 0x7fad400706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:35.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.438+0000 7fad3ffff700 1 -- 172.21.15.32:0/133869892 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7fad4c08e220 con 0x7fad58101440 2024-05-06T21:33:35.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.438+0000 7fad56d9d700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad4006e200 0x7fad400706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:35.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.438+0000 7fad56d9d700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad4006e200 0x7fad400706b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad48000f80 tx=0x7fad480061f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:35.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.443+0000 7fad3ffff700 1 -- 172.21.15.32:0/133869892 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fad4c05af70 con 0x7fad58101440 2024-05-06T21:33:35.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.673+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad58105d90 con 0x7fad4006e200 2024-05-06T21:33:35.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.674+0000 7fad3ffff700 1 -- 172.21.15.32:0/133869892 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fad58105d90 con 0x7fad4006e200 2024-05-06T21:33:35.671 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:33:35.671 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:33:35.671 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:33:35.671 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:33:35.671 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:33:35.671 INFO:teuthology.orchestra.run.smithi032.stdout: "osd", 2024-05-06T21:33:35.672 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:33:35.672 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:33:35.672 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:33:35.672 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:33:35.672 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "12/23 daemons upgraded", 2024-05-06T21:33:35.672 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T21:33:35.672 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:33:35.672 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad4006e200 msgr2=0x7fad400706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad4006e200 0x7fad400706b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad48000f80 tx=0x7fad480061f0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58101440 msgr2=0x7fad58073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58101440 0x7fad58073140 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00d8d0 tx=0x7fad4c00dc90 comp rx=0 tx=0).stop 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 shutdown_connections 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fad4006e200 0x7fad400706b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad58100240 0x7fad58074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 --2- 172.21.15.32:0/133869892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad58101440 0x7fad58073140 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 >> 172.21.15.32:0/133869892 conn(0x7fad580fb7f0 msgr2=0x7fad58104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:35.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 shutdown_connections 2024-05-06T21:33:35.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.677+0000 7fad5d1e4700 1 -- 172.21.15.32:0/133869892 wait complete. 2024-05-06T21:33:35.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.787+0000 7f51eb805700 1 -- 172.21.15.32:0/4176461088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 msgr2=0x7f51e4101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.787+0000 7f51eb805700 1 --2- 172.21.15.32:0/4176461088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 0x7f51e4101c50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f51e0009910 tx=0x7f51e0009c20 comp rx=0 tx=0).stop 2024-05-06T21:33:35.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.787+0000 7f51eb805700 1 -- 172.21.15.32:0/4176461088 shutdown_connections 2024-05-06T21:33:35.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.787+0000 7f51eb805700 1 --2- 172.21.15.32:0/4176461088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51e4102220 0x7f51e40fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.787+0000 7f51eb805700 1 --2- 172.21.15.32:0/4176461088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 0x7f51e4101c50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.787+0000 7f51eb805700 1 -- 172.21.15.32:0/4176461088 >> 172.21.15.32:0/4176461088 conn(0x7f51e40f9e70 msgr2=0x7f51e40fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:35.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.787+0000 7f51eb805700 1 -- 172.21.15.32:0/4176461088 shutdown_connections 2024-05-06T21:33:35.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.787+0000 7f51eb805700 1 -- 172.21.15.32:0/4176461088 wait complete. 2024-05-06T21:33:35.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.788+0000 7f51eb805700 1 Processor -- start 2024-05-06T21:33:35.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.788+0000 7f51eb805700 1 -- start start 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.788+0000 7f51eb805700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 0x7f51e4100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.788+0000 7f51eb805700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51e4102220 0x7f51e40ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.788+0000 7f51eb805700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40ffad0 con 0x7f51e4101840 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.788+0000 7f51eb805700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40ffc10 con 0x7f51e4102220 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.788+0000 7f51e95a1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 0x7f51e4100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.788+0000 7f51e95a1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 0x7f51e4100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49672/0 (socket says 172.21.15.32:49672) 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.788+0000 7f51e95a1700 1 -- 172.21.15.32:0/3038433502 learned_addr learned my addr 172.21.15.32:0/3038433502 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51e8da0700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51e4102220 0x7f51e40ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51e95a1700 1 -- 172.21.15.32:0/3038433502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51e4102220 msgr2=0x7f51e40ff590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51e95a1700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51e4102220 0x7f51e40ff590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51e95a1700 1 -- 172.21.15.32:0/3038433502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00095f0 con 0x7f51e4101840 2024-05-06T21:33:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51e8da0700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51e4102220 0x7f51e40ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:33:35.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51e95a1700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 0x7f51e4100f40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f51e000bda0 tx=0x7f51e000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:35.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51d67fc700 1 -- 172.21.15.32:0/3038433502 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51e001d070 con 0x7f51e4101840 2024-05-06T21:33:35.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51d67fc700 1 -- 172.21.15.32:0/3038433502 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f51e0004c50 con 0x7f51e4101840 2024-05-06T21:33:35.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e40ffe90 con 0x7f51e4101840 2024-05-06T21:33:35.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51d67fc700 1 -- 172.21.15.32:0/3038433502 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51e000f690 con 0x7f51e4101840 2024-05-06T21:33:35.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.789+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e4100380 con 0x7f51e4101840 2024-05-06T21:33:35.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.790+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e4108dd0 con 0x7f51e4101840 2024-05-06T21:33:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.791+0000 7f51d67fc700 1 -- 172.21.15.32:0/3038433502 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f51e0004dc0 con 0x7f51e4101840 2024-05-06T21:33:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.791+0000 7f51d67fc700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f51d006e200 0x7f51d00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:33:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.791+0000 7f51d67fc700 1 -- 172.21.15.32:0/3038433502 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f51e008f930 con 0x7f51e4101840 2024-05-06T21:33:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.791+0000 7f51e8da0700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f51d006e200 0x7f51d00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:33:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.792+0000 7f51e8da0700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f51d006e200 0x7f51d00706b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f51d8005fd0 tx=0x7f51d8005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:33:35.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:35.796+0000 7f51d67fc700 1 -- 172.21.15.32:0/3038433502 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f51e005c740 con 0x7f51e4101840 2024-05-06T21:33:36.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.101+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f51e419e280 con 0x7f51e4101840 2024-05-06T21:33:36.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.102+0000 7f51d67fc700 1 -- 172.21.15.32:0/3038433502 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f51e005c2d0 con 0x7f51e4101840 2024-05-06T21:33:36.099 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:33:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f51d006e200 msgr2=0x7f51d00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f51d006e200 0x7f51d00706b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f51d8005fd0 tx=0x7f51d8005e20 comp rx=0 tx=0).stop 2024-05-06T21:33:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 msgr2=0x7f51e4100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:33:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 0x7f51e4100f40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f51e000bda0 tx=0x7f51e000be80 comp rx=0 tx=0).stop 2024-05-06T21:33:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 shutdown_connections 2024-05-06T21:33:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f51d006e200 0x7f51d00706b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51e4101840 0x7f51e4100f40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:36.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 --2- 172.21.15.32:0/3038433502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51e4102220 0x7f51e40ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:33:36.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 >> 172.21.15.32:0/3038433502 conn(0x7f51e40f9e70 msgr2=0x7f51e4104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:33:36.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 shutdown_connections 2024-05-06T21:33:36.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:33:36.104+0000 7f51eb805700 1 -- 172.21.15.32:0/3038433502 wait complete. 2024-05-06T21:33:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:35 smithi032 ceph-mon[76650]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:35 smithi032 ceph-mon[76650]: pgmap v201: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-06T21:33:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:35 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1184004152' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:35 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/927895678' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:33:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:33:36.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:35 smithi154 ceph-mon[63622]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:36.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:35 smithi154 ceph-mon[63622]: pgmap v201: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-06T21:33:36.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:35 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1184004152' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:36.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:35 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/927895678' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:33:36.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:33:37.086 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3038433502' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi032.fpdhzg"]}]: dispatch 2024-05-06T21:33:37.087 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:36 smithi032 ceph-mon[76650]: Upgrade: It appears safe to stop mds.cephfs.smithi032.fpdhzg 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3038433502' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:37.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:37.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi032.fpdhzg"]}]: dispatch 2024-05-06T21:33:37.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:36 smithi154 ceph-mon[63622]: Upgrade: It appears safe to stop mds.cephfs.smithi032.fpdhzg 2024-05-06T21:33:38.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:38 smithi032 ceph-mon[76650]: pgmap v202: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-06T21:33:38.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:38 smithi154 ceph-mon[63622]: pgmap v202: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-06T21:33:39.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:39 smithi032 ceph-mon[76650]: Upgrade: Updating mds.cephfs.smithi032.fpdhzg 2024-05-06T21:33:39.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:39 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:39.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:39 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.fpdhzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:33:39.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:39 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:39.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:39 smithi032 ceph-mon[76650]: Deploying daemon mds.cephfs.smithi032.fpdhzg on smithi032 2024-05-06T21:33:39.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:39 smithi154 ceph-mon[63622]: Upgrade: Updating mds.cephfs.smithi032.fpdhzg 2024-05-06T21:33:39.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:39 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:39.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:39 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.fpdhzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:33:39.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:39 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:39.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:39 smithi154 ceph-mon[63622]: Deploying daemon mds.cephfs.smithi032.fpdhzg on smithi032 2024-05-06T21:33:40.192 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:40 smithi032 ceph-mon[76650]: pgmap v203: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-06T21:33:40.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:40 smithi154 ceph-mon[63622]: pgmap v203: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-06T21:33:42.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:42 smithi154 ceph-mon[63622]: pgmap v204: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:42.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:42 smithi154 ceph-mon[63622]: osdmap e92: 6 total, 6 up, 6 in 2024-05-06T21:33:42.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:42 smithi154 ceph-mon[63622]: fsmap cephfs:1 {0=cephfs.smithi032.jbgmwi=up:active} 2 up:standby 2024-05-06T21:33:42.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:42 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:33:42.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:42 smithi032 ceph-mon[76650]: pgmap v204: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:42.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:42 smithi032 ceph-mon[76650]: osdmap e92: 6 total, 6 up, 6 in 2024-05-06T21:33:42.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:42 smithi032 ceph-mon[76650]: fsmap cephfs:1 {0=cephfs.smithi032.jbgmwi=up:active} 2 up:standby 2024-05-06T21:33:42.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:42 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:33:44.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:44 smithi032 ceph-mon[76650]: pgmap v206: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:44.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:44 smithi154 ceph-mon[63622]: pgmap v206: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:45.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:45.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:45.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:45.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:45 smithi032 ceph-mon[76650]: pgmap v207: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:45.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:45 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] up:boot 2024-05-06T21:33:45.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:45 smithi032 ceph-mon[76650]: fsmap cephfs:1 {0=cephfs.smithi032.jbgmwi=up:active} 3 up:standby 2024-05-06T21:33:45.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:33:45.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:45.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:45.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:45.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:45 smithi154 ceph-mon[63622]: pgmap v207: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:45.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:45 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] up:boot 2024-05-06T21:33:45.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:45 smithi154 ceph-mon[63622]: fsmap cephfs:1 {0=cephfs.smithi032.jbgmwi=up:active} 3 up:standby 2024-05-06T21:33:45.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:33:48.009 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:47 smithi032 ceph-mon[76650]: pgmap v208: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:48.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:47 smithi154 ceph-mon[63622]: pgmap v208: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:50.050 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:49 smithi154 ceph-mon[63622]: pgmap v209: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:50.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:49 smithi032 ceph-mon[76650]: pgmap v209: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:51.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:51.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:51.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:33:51.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:51.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:51.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:33:52.232 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:52 smithi032 ceph-mon[76650]: pgmap v210: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:52.232 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:52.232 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:52 smithi154 ceph-mon[63622]: pgmap v210: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:54.305 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:54 smithi032 ceph-mon[76650]: pgmap v211: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:54.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:54 smithi154 ceph-mon[63622]: pgmap v211: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: pgmap v212: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: Detected new or changed devices on smithi032 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:56.154 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:56.155 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:56.155 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:56.155 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi032.jbgmwi"]}]: dispatch 2024-05-06T21:33:56.155 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:56 smithi032 ceph-mon[76650]: Upgrade: It appears safe to stop mds.cephfs.smithi032.jbgmwi 2024-05-06T21:33:56.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: pgmap v212: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: Detected new or changed devices on smithi032 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:33:56.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi032.jbgmwi"]}]: dispatch 2024-05-06T21:33:56.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:56 smithi154 ceph-mon[63622]: Upgrade: It appears safe to stop mds.cephfs.smithi032.jbgmwi 2024-05-06T21:33:58.157 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:57 smithi032 ceph-mon[76650]: pgmap v213: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:58.157 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:57 smithi032 ceph-mon[76650]: Upgrade: Updating mds.cephfs.smithi032.jbgmwi 2024-05-06T21:33:58.157 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:57 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:58.157 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:57 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.jbgmwi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:33:58.157 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:57 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:58.158 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:57 smithi032 ceph-mon[76650]: Deploying daemon mds.cephfs.smithi032.jbgmwi on smithi032 2024-05-06T21:33:58.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:57 smithi154 ceph-mon[63622]: pgmap v213: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:33:58.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:57 smithi154 ceph-mon[63622]: Upgrade: Updating mds.cephfs.smithi032.jbgmwi 2024-05-06T21:33:58.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:57 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:33:58.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:57 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi032.jbgmwi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:33:58.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:57 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:33:58.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:57 smithi154 ceph-mon[63622]: Deploying daemon mds.cephfs.smithi032.jbgmwi on smithi032 2024-05-06T21:33:59.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:59 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032[76641]: 2024-05-06T21:33:59.176+0000 7f60c6d55700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T21:34:00.156 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:59 smithi154 ceph-mon[63622]: pgmap v214: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:00.156 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:59 smithi154 ceph-mon[63622]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-06T21:34:00.157 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:59 smithi154 ceph-mon[63622]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T21:34:00.157 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:59 smithi154 ceph-mon[63622]: osdmap e93: 6 total, 6 up, 6 in 2024-05-06T21:34:00.157 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:59 smithi154 ceph-mon[63622]: Standby daemon mds.cephfs.smithi154.xfmqxf assigned to filesystem cephfs as rank 0 2024-05-06T21:34:00.157 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:59 smithi154 ceph-mon[63622]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-06T21:34:00.157 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:59 smithi154 ceph-mon[63622]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-06T21:34:00.157 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:33:59 smithi154 ceph-mon[63622]: fsmap cephfs:1/1 {0=cephfs.smithi154.xfmqxf=up:replay} 2 up:standby 2024-05-06T21:34:00.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:59 smithi032 ceph-mon[76650]: pgmap v214: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:00.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:59 smithi032 ceph-mon[76650]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-06T21:34:00.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:59 smithi032 ceph-mon[76650]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T21:34:00.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:59 smithi032 ceph-mon[76650]: osdmap e93: 6 total, 6 up, 6 in 2024-05-06T21:34:00.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:59 smithi032 ceph-mon[76650]: Standby daemon mds.cephfs.smithi154.xfmqxf assigned to filesystem cephfs as rank 0 2024-05-06T21:34:00.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:59 smithi032 ceph-mon[76650]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-06T21:34:00.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:59 smithi032 ceph-mon[76650]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-06T21:34:00.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:33:59 smithi032 ceph-mon[76650]: fsmap cephfs:1/1 {0=cephfs.smithi154.xfmqxf=up:replay} 2 up:standby 2024-05-06T21:34:02.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:01 smithi032 ceph-mon[76650]: pgmap v216: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-05-06T21:34:02.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:01 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:34:02.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:01 smithi154 ceph-mon[63622]: pgmap v216: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-05-06T21:34:02.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:01 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:34:04.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:03 smithi032 ceph-mon[76650]: pgmap v217: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-05-06T21:34:04.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:03 smithi154 ceph-mon[63622]: pgmap v217: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-05-06T21:34:06.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:05 smithi032 ceph-mon[76650]: pgmap v218: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2024-05-06T21:34:06.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:06.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.226+0000 7f6792f51700 1 -- 172.21.15.32:0/1007704211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c0ff150 msgr2=0x7f678c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.226+0000 7f6792f51700 1 --2- 172.21.15.32:0/1007704211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c0ff150 0x7f678c0ff560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6780009910 tx=0x7f6780009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.226+0000 7f6792f51700 1 -- 172.21.15.32:0/1007704211 shutdown_connections 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.226+0000 7f6792f51700 1 --2- 172.21.15.32:0/1007704211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c1003f0 0x7f678c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.226+0000 7f6792f51700 1 --2- 172.21.15.32:0/1007704211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c0ff150 0x7f678c0ff560 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.226+0000 7f6792f51700 1 -- 172.21.15.32:0/1007704211 >> 172.21.15.32:0/1007704211 conn(0x7f678c0fa7a0 msgr2=0x7f678c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.226+0000 7f6792f51700 1 -- 172.21.15.32:0/1007704211 shutdown_connections 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.226+0000 7f6792f51700 1 -- 172.21.15.32:0/1007704211 wait complete. 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f6792f51700 1 Processor -- start 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f6792f51700 1 -- start start 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f6792f51700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c0ff150 0x7f678c195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f6792f51700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c1003f0 0x7f678c196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:06.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f6792f51700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c196970 con 0x7f678c1003f0 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f6792f51700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c196ab0 con 0x7f678c0ff150 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f678bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c1003f0 0x7f678c196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f678bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c1003f0 0x7f678c196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57696/0 (socket says 172.21.15.32:57696) 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f678bfff700 1 -- 172.21.15.32:0/3213311602 learned_addr learned my addr 172.21.15.32:0/3213311602 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f6790ced700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c0ff150 0x7f678c195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f678bfff700 1 -- 172.21.15.32:0/3213311602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c0ff150 msgr2=0x7f678c195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f678bfff700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c0ff150 0x7f678c195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.227+0000 7f678bfff700 1 -- 172.21.15.32:0/3213311602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800095f0 con 0x7f678c1003f0 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.228+0000 7f678bfff700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c1003f0 0x7f678c196350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f677800d8d0 tx=0x7f677800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.228+0000 7f6789ffb700 1 -- 172.21.15.32:0/3213311602 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67780098a0 con 0x7f678c1003f0 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.228+0000 7f6789ffb700 1 -- 172.21.15.32:0/3213311602 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6778010460 con 0x7f678c1003f0 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.228+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c19b560 con 0x7f678c1003f0 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.228+0000 7f6789ffb700 1 -- 172.21.15.32:0/3213311602 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f677800f5f0 con 0x7f678c1003f0 2024-05-06T21:34:06.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.228+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c19bab0 con 0x7f678c1003f0 2024-05-06T21:34:06.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.229+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c068ab0 con 0x7f678c1003f0 2024-05-06T21:34:06.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.230+0000 7f6789ffb700 1 -- 172.21.15.32:0/3213311602 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6778009a00 con 0x7f678c1003f0 2024-05-06T21:34:06.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.230+0000 7f6789ffb700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f677c06e200 0x7f677c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:06.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.230+0000 7f6789ffb700 1 -- 172.21.15.32:0/3213311602 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f677808e180 con 0x7f678c1003f0 2024-05-06T21:34:06.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.230+0000 7f6790ced700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f677c06e200 0x7f677c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:06.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.231+0000 7f6790ced700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f677c06e200 0x7f677c0706b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6780006010 tx=0x7f678000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:06.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.235+0000 7f6789ffb700 1 -- 172.21.15.32:0/3213311602 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f677805ae80 con 0x7f678c1003f0 2024-05-06T21:34:06.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:05 smithi154 ceph-mon[63622]: pgmap v218: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2024-05-06T21:34:06.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:06.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:34:06.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.475+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f678c0694e0 con 0x7f677c06e200 2024-05-06T21:34:06.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.476+0000 7f6789ffb700 1 -- 172.21.15.32:0/3213311602 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f678c0694e0 con 0x7f677c06e200 2024-05-06T21:34:06.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.478+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f677c06e200 msgr2=0x7f677c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.478+0000 7f6792f51700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f677c06e200 0x7f677c0706b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6780006010 tx=0x7f678000b560 comp rx=0 tx=0).stop 2024-05-06T21:34:06.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.478+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c1003f0 msgr2=0x7f678c196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.478+0000 7f6792f51700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c1003f0 0x7f678c196350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f677800d8d0 tx=0x7f677800dbe0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.479+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 shutdown_connections 2024-05-06T21:34:06.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.479+0000 7f6792f51700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f677c06e200 0x7f677c0706b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.479+0000 7f6792f51700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c0ff150 0x7f678c195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.479+0000 7f6792f51700 1 --2- 172.21.15.32:0/3213311602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f678c1003f0 0x7f678c196350 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.479+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 >> 172.21.15.32:0/3213311602 conn(0x7f678c0fa7a0 msgr2=0x7f678c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:06.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.479+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 shutdown_connections 2024-05-06T21:34:06.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.479+0000 7f6792f51700 1 -- 172.21.15.32:0/3213311602 wait complete. 2024-05-06T21:34:06.488 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:34:06.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.593+0000 7f435ff89700 1 -- 172.21.15.32:0/2680218318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 msgr2=0x7f4358100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.593+0000 7f435ff89700 1 --2- 172.21.15.32:0/2680218318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 0x7f4358100860 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4348009910 tx=0x7f4348009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:06.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.594+0000 7f435ff89700 1 -- 172.21.15.32:0/2680218318 shutdown_connections 2024-05-06T21:34:06.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.594+0000 7f435ff89700 1 --2- 172.21.15.32:0/2680218318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 0x7f4358100860 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.594+0000 7f435ff89700 1 --2- 172.21.15.32:0/2680218318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43580ff150 0x7f43580ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.594+0000 7f435ff89700 1 -- 172.21.15.32:0/2680218318 >> 172.21.15.32:0/2680218318 conn(0x7f43580fa7a0 msgr2=0x7f43580fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:06.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.594+0000 7f435ff89700 1 -- 172.21.15.32:0/2680218318 shutdown_connections 2024-05-06T21:34:06.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.594+0000 7f435ff89700 1 -- 172.21.15.32:0/2680218318 wait complete. 2024-05-06T21:34:06.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.594+0000 7f435ff89700 1 Processor -- start 2024-05-06T21:34:06.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.594+0000 7f435ff89700 1 -- start start 2024-05-06T21:34:06.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435ff89700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43580ff150 0x7f4358195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:06.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435ff89700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 0x7f4358196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:06.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435ff89700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358196920 con 0x7f43581003f0 2024-05-06T21:34:06.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435ff89700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358196a60 con 0x7f43580ff150 2024-05-06T21:34:06.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435d524700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 0x7f4358196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435d524700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 0x7f4358196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57700/0 (socket says 172.21.15.32:57700) 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435d524700 1 -- 172.21.15.32:0/3132328373 learned_addr learned my addr 172.21.15.32:0/3132328373 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435dd25700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43580ff150 0x7f4358195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435d524700 1 -- 172.21.15.32:0/3132328373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43580ff150 msgr2=0x7f4358195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435d524700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43580ff150 0x7f4358195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435d524700 1 -- 172.21.15.32:0/3132328373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43480095f0 con 0x7f43581003f0 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435d524700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 0x7f4358196300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4348006010 tx=0x7f434800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f434effd700 1 -- 172.21.15.32:0/3132328373 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434801d070 con 0x7f43581003f0 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f434effd700 1 -- 172.21.15.32:0/3132328373 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f434800f460 con 0x7f43581003f0 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f434effd700 1 -- 172.21.15.32:0/3132328373 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4348021640 con 0x7f43581003f0 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.595+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435819b4b0 con 0x7f43581003f0 2024-05-06T21:34:06.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.596+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435819b950 con 0x7f43581003f0 2024-05-06T21:34:06.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.596+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358068ab0 con 0x7f43581003f0 2024-05-06T21:34:06.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.597+0000 7f434effd700 1 -- 172.21.15.32:0/3132328373 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f434800fab0 con 0x7f43581003f0 2024-05-06T21:34:06.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.598+0000 7f434effd700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f434406e200 0x7f43440706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:06.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.598+0000 7f435dd25700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f434406e200 0x7f43440706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:06.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.598+0000 7f434effd700 1 -- 172.21.15.32:0/3132328373 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f434808f600 con 0x7f43581003f0 2024-05-06T21:34:06.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.598+0000 7f435dd25700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f434406e200 0x7f43440706b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4354005950 tx=0x7f435400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:06.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.602+0000 7f434effd700 1 -- 172.21.15.32:0/3132328373 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f434805c260 con 0x7f43581003f0 2024-05-06T21:34:06.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.844+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43580694e0 con 0x7f434406e200 2024-05-06T21:34:06.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.846+0000 7f434effd700 1 -- 172.21.15.32:0/3132328373 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f43580694e0 con 0x7f434406e200 2024-05-06T21:34:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.848+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f434406e200 msgr2=0x7f43440706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.848+0000 7f435ff89700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f434406e200 0x7f43440706b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4354005950 tx=0x7f435400b410 comp rx=0 tx=0).stop 2024-05-06T21:34:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.848+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 msgr2=0x7f4358196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.848+0000 7f435ff89700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 0x7f4358196300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4348006010 tx=0x7f434800bd70 comp rx=0 tx=0).stop 2024-05-06T21:34:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.848+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 shutdown_connections 2024-05-06T21:34:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.848+0000 7f435ff89700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f434406e200 0x7f43440706b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.848+0000 7f435ff89700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43580ff150 0x7f4358195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.848+0000 7f435ff89700 1 --2- 172.21.15.32:0/3132328373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43581003f0 0x7f4358196300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.848+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 >> 172.21.15.32:0/3132328373 conn(0x7f43580fa7a0 msgr2=0x7f4358068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:06.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.849+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 shutdown_connections 2024-05-06T21:34:06.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.849+0000 7f435ff89700 1 -- 172.21.15.32:0/3132328373 wait complete. 2024-05-06T21:34:06.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 -- 172.21.15.32:0/802303843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc1014e0 msgr2=0x7feddc101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 --2- 172.21.15.32:0/802303843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc1014e0 0x7feddc101950 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009910 tx=0x7fedd0009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:06.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 -- 172.21.15.32:0/802303843 shutdown_connections 2024-05-06T21:34:06.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 --2- 172.21.15.32:0/802303843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc1014e0 0x7feddc101950 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 --2- 172.21.15.32:0/802303843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc100240 0x7feddc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 -- 172.21.15.32:0/802303843 >> 172.21.15.32:0/802303843 conn(0x7feddc0fb890 msgr2=0x7feddc0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:06.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 -- 172.21.15.32:0/802303843 shutdown_connections 2024-05-06T21:34:06.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 -- 172.21.15.32:0/802303843 wait complete. 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 Processor -- start 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.973+0000 7fede4488700 1 -- start start 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede4488700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc100240 0x7feddc195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede4488700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc1014e0 0x7feddc195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede4488700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc1965f0 con 0x7feddc100240 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede4488700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc196730 con 0x7feddc1014e0 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede2224700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc100240 0x7feddc195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede2224700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc100240 0x7feddc195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57714/0 (socket says 172.21.15.32:57714) 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede2224700 1 -- 172.21.15.32:0/2169606486 learned_addr learned my addr 172.21.15.32:0/2169606486 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede1a23700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc1014e0 0x7feddc195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede2224700 1 -- 172.21.15.32:0/2169606486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc1014e0 msgr2=0x7feddc195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede2224700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc1014e0 0x7feddc195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede2224700 1 -- 172.21.15.32:0/2169606486 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd00095f0 con 0x7feddc100240 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fede2224700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc100240 0x7feddc195a90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fedd800d8d0 tx=0x7fedd800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.974+0000 7fedcf7fe700 1 -- 172.21.15.32:0/2169606486 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedd8009940 con 0x7feddc100240 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.975+0000 7fedcf7fe700 1 -- 172.21.15.32:0/2169606486 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fedd8010460 con 0x7feddc100240 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.975+0000 7fede4488700 1 -- 172.21.15.32:0/2169606486 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc19b1e0 con 0x7feddc100240 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.975+0000 7fedcf7fe700 1 -- 172.21.15.32:0/2169606486 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedd800f5f0 con 0x7feddc100240 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.975+0000 7fede4488700 1 -- 172.21.15.32:0/2169606486 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc19b730 con 0x7feddc100240 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.976+0000 7fedcd7fa700 1 -- 172.21.15.32:0/2169606486 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc108d20 con 0x7feddc100240 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.977+0000 7fedcf7fe700 1 -- 172.21.15.32:0/2169606486 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fedd80105d0 con 0x7feddc100240 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.977+0000 7fedcf7fe700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fedc806e200 0x7fedc80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.978+0000 7fedcf7fe700 1 -- 172.21.15.32:0/2169606486 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fedd808e2a0 con 0x7feddc100240 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.978+0000 7fede1a23700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fedc806e200 0x7fedc80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:06.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.978+0000 7fede1a23700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fedc806e200 0x7fedc80706b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fedd0005b40 tx=0x7fedd0005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:06.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:06.983+0000 7fedcf7fe700 1 -- 172.21.15.32:0/2169606486 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fedd805afa0 con 0x7feddc100240 2024-05-06T21:34:07.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.222+0000 7fedcd7fa700 1 -- 172.21.15.32:0/2169606486 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feddc108eb0 con 0x7fedc806e200 2024-05-06T21:34:07.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.235+0000 7fedcf7fe700 1 -- 172.21.15.32:0/2169606486 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7feddc108eb0 con 0x7fedc806e200 2024-05-06T21:34:07.231 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:34:07.231 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (14m) 17s ago 15m 24.4M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:34:07.231 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (16m) 17s ago 16m 8912k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (15m) 78s ago 14m 8472k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (4m) 17s ago 16m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (4m) 78s ago 14m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (14m) 17s ago 15m 87.0M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (23s) 17s ago 10m 13.6M - 19.0.0-2497-gf273489c 3b8ac54a9a71 6cd9ab5eb234 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (10m) 17s ago 10m 125M - 18.2.0 dc2bc1663786 d4003f3d6373 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (10m) 78s ago 10m 121M - 18.2.0 dc2bc1663786 59ea69852538 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (10m) 78s ago 10m 18.0M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (7m) 17s ago 17m 508M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (6m) 78s ago 14m 451M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (5m) 17s ago 17m 49.6M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (5m) 78s ago 14m 40.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (15m) 17s ago 15m 16.3M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (14m) 78s ago 14m 16.7M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:34:07.232 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (4m) 17s ago 13m 162M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:34:07.233 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (3m) 17s ago 13m 118M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:34:07.233 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (3m) 17s ago 12m 95.1M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:34:07.233 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (2m) 78s ago 12m 93.2M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:34:07.233 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (115s) 78s ago 12m 97.6M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:34:07.233 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (82s) 78s ago 11m 12.3M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 8b513e97a420 2024-05-06T21:34:07.233 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (6m) 17s ago 15m 69.2M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:34:07.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 -- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fedc806e200 msgr2=0x7fedc80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:07.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fedc806e200 0x7fedc80706b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fedd0005b40 tx=0x7fedd0005a90 comp rx=0 tx=0).stop 2024-05-06T21:34:07.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 -- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc100240 msgr2=0x7feddc195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:07.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc100240 0x7feddc195a90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fedd800d8d0 tx=0x7fedd800dc90 comp rx=0 tx=0).stop 2024-05-06T21:34:07.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 -- 172.21.15.32:0/2169606486 shutdown_connections 2024-05-06T21:34:07.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fedc806e200 0x7fedc80706b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc100240 0x7feddc195a90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 --2- 172.21.15.32:0/2169606486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc1014e0 0x7feddc195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 -- 172.21.15.32:0/2169606486 >> 172.21.15.32:0/2169606486 conn(0x7feddc0fb890 msgr2=0x7feddc104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:07.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 -- 172.21.15.32:0/2169606486 shutdown_connections 2024-05-06T21:34:07.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.238+0000 7fedcd7fa700 1 -- 172.21.15.32:0/2169606486 wait complete. 2024-05-06T21:34:07.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.347+0000 7f903272a700 1 -- 172.21.15.32:0/1370502969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 msgr2=0x7f902c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:07.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.347+0000 7f903272a700 1 --2- 172.21.15.32:0/1370502969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 0x7f902c0ff540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f901c009910 tx=0x7f901c009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:07.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.347+0000 7f903272a700 1 -- 172.21.15.32:0/1370502969 shutdown_connections 2024-05-06T21:34:07.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.347+0000 7f903272a700 1 --2- 172.21.15.32:0/1370502969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c1003d0 0x7f902c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.347+0000 7f903272a700 1 --2- 172.21.15.32:0/1370502969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 0x7f902c0ff540 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.347+0000 7f903272a700 1 -- 172.21.15.32:0/1370502969 >> 172.21.15.32:0/1370502969 conn(0x7f902c0fa780 msgr2=0x7f902c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:07.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.347+0000 7f903272a700 1 -- 172.21.15.32:0/1370502969 shutdown_connections 2024-05-06T21:34:07.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.347+0000 7f903272a700 1 -- 172.21.15.32:0/1370502969 wait complete. 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f903272a700 1 Processor -- start 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f903272a700 1 -- start start 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f903272a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 0x7f902c195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f903272a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c1003d0 0x7f902c195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f903272a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c196600 con 0x7f902c0ff130 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f903272a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c196740 con 0x7f902c1003d0 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f902bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 0x7f902c195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f902bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 0x7f902c195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57728/0 (socket says 172.21.15.32:57728) 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f902bfff700 1 -- 172.21.15.32:0/1465588936 learned_addr learned my addr 172.21.15.32:0/1465588936 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.348+0000 7f902b7fe700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c1003d0 0x7f902c195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.349+0000 7f902bfff700 1 -- 172.21.15.32:0/1465588936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c1003d0 msgr2=0x7f902c195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.349+0000 7f902bfff700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c1003d0 0x7f902c195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.349+0000 7f902bfff700 1 -- 172.21.15.32:0/1465588936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c0095f0 con 0x7f902c0ff130 2024-05-06T21:34:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.349+0000 7f902bfff700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 0x7f902c195aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f901c006010 tx=0x7f901c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.349+0000 7f90297fa700 1 -- 172.21.15.32:0/1465588936 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f901c01d070 con 0x7f902c0ff130 2024-05-06T21:34:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.349+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c19b190 con 0x7f902c0ff130 2024-05-06T21:34:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.349+0000 7f90297fa700 1 -- 172.21.15.32:0/1465588936 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f901c00f460 con 0x7f902c0ff130 2024-05-06T21:34:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.349+0000 7f90297fa700 1 -- 172.21.15.32:0/1465588936 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f901c021640 con 0x7f902c0ff130 2024-05-06T21:34:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.349+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c19b680 con 0x7f902c0ff130 2024-05-06T21:34:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.350+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c107c30 con 0x7f902c0ff130 2024-05-06T21:34:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.351+0000 7f90297fa700 1 -- 172.21.15.32:0/1465588936 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f901c00fab0 con 0x7f902c0ff130 2024-05-06T21:34:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.351+0000 7f90297fa700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.351+0000 7f90297fa700 1 -- 172.21.15.32:0/1465588936 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f901c08f550 con 0x7f902c0ff130 2024-05-06T21:34:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.351+0000 7f902b7fe700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.352+0000 7f902b7fe700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9020004630 tx=0x7f902000b3c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:07.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.356+0000 7f90297fa700 1 -- 172.21.15.32:0/1465588936 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f901c05c250 con 0x7f902c0ff130 2024-05-06T21:34:07.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.658+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f902c107e20 con 0x7f902c0ff130 2024-05-06T21:34:07.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.659+0000 7f90297fa700 1 -- 172.21.15.32:0/1465588936 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f901c00f5d0 con 0x7f902c0ff130 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 1 2024-05-06T21:34:07.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:34:07.657 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:34:07.657 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-05-06T21:34:07.657 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 11 2024-05-06T21:34:07.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:34:07.657 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:34:07.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 msgr2=0x7f90140706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9020004630 tx=0x7f902000b3c0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 msgr2=0x7f902c195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 0x7f902c195aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f901c006010 tx=0x7f901c00bd70 comp rx=0 tx=0).stop 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 shutdown_connections 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f901406e200 0x7f90140706b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c0ff130 0x7f902c195aa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 --2- 172.21.15.32:0/1465588936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c1003d0 0x7f902c195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 >> 172.21.15.32:0/1465588936 conn(0x7f902c0fa780 msgr2=0x7f902c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 shutdown_connections 2024-05-06T21:34:07.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.661+0000 7f903272a700 1 -- 172.21.15.32:0/1465588936 wait complete. 2024-05-06T21:34:07.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.781+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2476563175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac0ff660 msgr2=0x7f7fac0ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:07.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.781+0000 7f7fb3dfe700 1 --2- 172.21.15.32:0/2476563175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac0ff660 0x7f7fac0ffa70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009910 tx=0x7f7fa8009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:07.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.781+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2476563175 shutdown_connections 2024-05-06T21:34:07.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.781+0000 7f7fb3dfe700 1 --2- 172.21.15.32:0/2476563175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac100380 0x7f7fac1007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.781+0000 7f7fb3dfe700 1 --2- 172.21.15.32:0/2476563175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac0ff660 0x7f7fac0ffa70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.781+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2476563175 >> 172.21.15.32:0/2476563175 conn(0x7f7fac0f9e50 msgr2=0x7f7fac0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:07.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.781+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2476563175 shutdown_connections 2024-05-06T21:34:07.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.781+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2476563175 wait complete. 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb3dfe700 1 Processor -- start 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb3dfe700 1 -- start start 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb3dfe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac0ff660 0x7f7fac197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb3dfe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac100380 0x7f7fac198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb3dfe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac198850 con 0x7f7fac100380 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb3dfe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac19d260 con 0x7f7fac0ff660 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb1399700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac100380 0x7f7fac198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb1399700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac100380 0x7f7fac198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57766/0 (socket says 172.21.15.32:57766) 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb1399700 1 -- 172.21.15.32:0/2633193418 learned_addr learned my addr 172.21.15.32:0/2633193418 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:07.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.782+0000 7f7fb1b9a700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac0ff660 0x7f7fac197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:07.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.783+0000 7f7fb1399700 1 -- 172.21.15.32:0/2633193418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac0ff660 msgr2=0x7f7fac197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:07.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.783+0000 7f7fb1399700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac0ff660 0x7f7fac197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:07.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.783+0000 7f7fb1399700 1 -- 172.21.15.32:0/2633193418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80095f0 con 0x7f7fac100380 2024-05-06T21:34:07.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.783+0000 7f7fb1399700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac100380 0x7f7fac198230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c8f0 tx=0x7f7f9c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:07.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.783+0000 7f7fa2ffd700 1 -- 172.21.15.32:0/2633193418 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f9c0078e0 con 0x7f7fac100380 2024-05-06T21:34:07.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.783+0000 7f7fa2ffd700 1 -- 172.21.15.32:0/2633193418 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f9c00f450 con 0x7f7fac100380 2024-05-06T21:34:07.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.783+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac19d460 con 0x7f7fac100380 2024-05-06T21:34:07.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.783+0000 7f7fa2ffd700 1 -- 172.21.15.32:0/2633193418 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f9c018610 con 0x7f7fac100380 2024-05-06T21:34:07.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.783+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac19d980 con 0x7f7fac100380 2024-05-06T21:34:07.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.785+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac107cb0 con 0x7f7fac100380 2024-05-06T21:34:07.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.785+0000 7f7fa2ffd700 1 -- 172.21.15.32:0/2633193418 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7f9c00f5c0 con 0x7f7fac100380 2024-05-06T21:34:07.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.785+0000 7f7fa2ffd700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7f9806e200 0x7f7f980706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:07.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.785+0000 7f7fa2ffd700 1 -- 172.21.15.32:0/2633193418 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f7f9c08e150 con 0x7f7fac100380 2024-05-06T21:34:07.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.786+0000 7f7fb1b9a700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7f9806e200 0x7f7f980706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:07.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.786+0000 7f7fb1b9a700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7f9806e200 0x7f7f980706b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009fd0 tx=0x7f7fa800b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:07.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:07.790+0000 7f7fa2ffd700 1 -- 172.21.15.32:0/2633193418 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7f9c057320 con 0x7f7fac100380 2024-05-06T21:34:08.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.068+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7fac107e70 con 0x7f7fac100380 2024-05-06T21:34:08.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.069+0000 7f7fa2ffd700 1 -- 172.21.15.32:0/2633193418 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1885 (secure 0 0 0) 0x7f7f9c05a9e0 con 0x7f7fac100380 2024-05-06T21:34:08.065 INFO:teuthology.orchestra.run.smithi032.stdout:e33 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 33 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:34:06.909308+0000 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:34:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 93 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 1 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:in 0 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=24285} 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:34:08.067 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 1 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 0 members: 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{0:24285} state up:rejoin seq 153 join_fscid=1 addr [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{-1:34432} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:34:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{-1:44297} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6824/1058144183,v1:172.21.15.154:6825/1058144183] compat {c=[1],r=[1],i=[7ff]}] 2024-05-06T21:34:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7f9806e200 msgr2=0x7f7f980706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7f9806e200 0x7f7f980706b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009fd0 tx=0x7f7fa800b560 comp rx=0 tx=0).stop 2024-05-06T21:34:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac100380 msgr2=0x7f7fac198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac100380 0x7f7fac198230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c8f0 tx=0x7f7f9c00cc00 comp rx=0 tx=0).stop 2024-05-06T21:34:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 shutdown_connections 2024-05-06T21:34:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7f9806e200 0x7f7f980706b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac0ff660 0x7f7fac197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 --2- 172.21.15.32:0/2633193418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac100380 0x7f7fac198230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 >> 172.21.15.32:0/2633193418 conn(0x7f7fac0f9e50 msgr2=0x7f7fac0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 shutdown_connections 2024-05-06T21:34:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.071+0000 7f7fb3dfe700 1 -- 172.21.15.32:0/2633193418 wait complete. 2024-05-06T21:34:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 33 2024-05-06T21:34:08.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.184+0000 7f22e3754700 1 -- 172.21.15.32:0/443483370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22dc0ff150 msgr2=0x7f22dc0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.184+0000 7f22e3754700 1 --2- 172.21.15.32:0/443483370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22dc0ff150 0x7f22dc0ff560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009910 tx=0x7f22d0009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:08.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.184+0000 7f22e3754700 1 -- 172.21.15.32:0/443483370 shutdown_connections 2024-05-06T21:34:08.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.184+0000 7f22e3754700 1 --2- 172.21.15.32:0/443483370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc1003f0 0x7f22dc100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.184+0000 7f22e3754700 1 --2- 172.21.15.32:0/443483370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22dc0ff150 0x7f22dc0ff560 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.184+0000 7f22e3754700 1 -- 172.21.15.32:0/443483370 >> 172.21.15.32:0/443483370 conn(0x7f22dc0fa7a0 msgr2=0x7f22dc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:08.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.184+0000 7f22e3754700 1 -- 172.21.15.32:0/443483370 shutdown_connections 2024-05-06T21:34:08.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.184+0000 7f22e3754700 1 -- 172.21.15.32:0/443483370 wait complete. 2024-05-06T21:34:08.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:08.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: pgmap v219: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-06T21:34:08.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:08.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: reconnect by client.24325 v1:192.168.0.1:0/3805930735 after 0.000999974 2024-05-06T21:34:08.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: reconnect by client.14532 v1:192.168.0.1:0/718525170 after 0.000999974 2024-05-06T21:34:08.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:reconnect 2024-05-06T21:34:08.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: fsmap cephfs:1/1 {0=cephfs.smithi154.xfmqxf=up:reconnect} 2 up:standby 2024-05-06T21:34:08.182 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:08.183 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1465588936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:08.183 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:08.183 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:08.183 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:07 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.185+0000 7f22e3754700 1 Processor -- start 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.185+0000 7f22e3754700 1 -- start start 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.185+0000 7f22e3754700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ff150 0x7f22dc069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.185+0000 7f22e3754700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22dc1003f0 0x7f22dc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.185+0000 7f22e3754700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc19b120 con 0x7f22dc1003f0 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.185+0000 7f22e3754700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc19b260 con 0x7f22dc0ff150 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e14f0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ff150 0x7f22dc069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e0cef700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22dc1003f0 0x7f22dc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e14f0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ff150 0x7f22dc069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.32:40648/0 (socket says 172.21.15.32:40648) 2024-05-06T21:34:08.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e14f0700 1 -- 172.21.15.32:0/1834208627 learned_addr learned my addr 172.21.15.32:0/1834208627 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e14f0700 1 -- 172.21.15.32:0/1834208627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22dc1003f0 msgr2=0x7f22dc19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e14f0700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22dc1003f0 0x7f22dc19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e14f0700 1 -- 172.21.15.32:0/1834208627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d00095f0 con 0x7f22dc0ff150 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e14f0700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ff150 0x7f22dc069930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22d0005090 tx=0x7f22d000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22ce7fc700 1 -- 172.21.15.32:0/1834208627 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22d001d070 con 0x7f22dc0ff150 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22ce7fc700 1 -- 172.21.15.32:0/1834208627 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f22d000f460 con 0x7f22dc0ff150 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc19b4e0 con 0x7f22dc0ff150 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22ce7fc700 1 -- 172.21.15.32:0/1834208627 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22d0017610 con 0x7f22dc0ff150 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.186+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc19b9d0 con 0x7f22dc0ff150 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.187+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc068ab0 con 0x7f22dc0ff150 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.188+0000 7f22ce7fc700 1 -- 172.21.15.32:0/1834208627 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f22d000f5d0 con 0x7f22dc0ff150 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.188+0000 7f22ce7fc700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f22c806e200 0x7f22c80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.189+0000 7f22ce7fc700 1 -- 172.21.15.32:0/1834208627 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f22d008f890 con 0x7f22dc0ff150 2024-05-06T21:34:08.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.189+0000 7f22e0cef700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f22c806e200 0x7f22c80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:08.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.189+0000 7f22e0cef700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f22c806e200 0x7f22c80706b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f22dc069eb0 tx=0x7f22d80073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:08.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.193+0000 7f22ce7fc700 1 -- 172.21.15.32:0/1834208627 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f22d005c4f0 con 0x7f22dc0ff150 2024-05-06T21:34:08.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:08.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: pgmap v219: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-06T21:34:08.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:08.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: reconnect by client.24325 v1:192.168.0.1:0/3805930735 after 0.000999974 2024-05-06T21:34:08.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: reconnect by client.14532 v1:192.168.0.1:0/718525170 after 0.000999974 2024-05-06T21:34:08.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:reconnect 2024-05-06T21:34:08.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: fsmap cephfs:1/1 {0=cephfs.smithi154.xfmqxf=up:reconnect} 2 up:standby 2024-05-06T21:34:08.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:08.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1465588936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:08.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:08.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:08.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:07 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:08.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.445+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22dc104e20 con 0x7f22c806e200 2024-05-06T21:34:08.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.447+0000 7f22ce7fc700 1 -- 172.21.15.32:0/1834208627 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f22dc104e20 con 0x7f22c806e200 2024-05-06T21:34:08.444 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:34:08.444 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:34:08.444 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:34:08.444 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:34:08.444 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:34:08.444 INFO:teuthology.orchestra.run.smithi032.stdout: "osd", 2024-05-06T21:34:08.444 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:34:08.444 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:34:08.445 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:34:08.445 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:34:08.445 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "13/23 daemons upgraded", 2024-05-06T21:34:08.445 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading mds daemons", 2024-05-06T21:34:08.445 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:34:08.445 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:34:08.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f22c806e200 msgr2=0x7f22c80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f22c806e200 0x7f22c80706b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f22dc069eb0 tx=0x7f22d80073d0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ff150 msgr2=0x7f22dc069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ff150 0x7f22dc069930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22d0005090 tx=0x7f22d000bd70 comp rx=0 tx=0).stop 2024-05-06T21:34:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 shutdown_connections 2024-05-06T21:34:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f22c806e200 0x7f22c80706b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ff150 0x7f22dc069930 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 --2- 172.21.15.32:0/1834208627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22dc1003f0 0x7f22dc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 >> 172.21.15.32:0/1834208627 conn(0x7f22dc0fa7a0 msgr2=0x7f22dc1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 shutdown_connections 2024-05-06T21:34:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.450+0000 7f22e3754700 1 -- 172.21.15.32:0/1834208627 wait complete. 2024-05-06T21:34:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.565+0000 7f80dabb6700 1 -- 172.21.15.32:0/1095215446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 msgr2=0x7f80d4105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.565+0000 7f80dabb6700 1 --2- 172.21.15.32:0/1095215446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 0x7f80d4105a60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009910 tx=0x7f80c0009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.565+0000 7f80dabb6700 1 -- 172.21.15.32:0/1095215446 shutdown_connections 2024-05-06T21:34:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.565+0000 7f80dabb6700 1 --2- 172.21.15.32:0/1095215446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 0x7f80d4105a60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.565+0000 7f80dabb6700 1 --2- 172.21.15.32:0/1095215446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80d4100d60 0x7f80d4103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.565+0000 7f80dabb6700 1 -- 172.21.15.32:0/1095215446 >> 172.21.15.32:0/1095215446 conn(0x7f80d40fa780 msgr2=0x7f80d40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.565+0000 7f80dabb6700 1 -- 172.21.15.32:0/1095215446 shutdown_connections 2024-05-06T21:34:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.565+0000 7f80dabb6700 1 -- 172.21.15.32:0/1095215446 wait complete. 2024-05-06T21:34:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80dabb6700 1 Processor -- start 2024-05-06T21:34:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80dabb6700 1 -- start start 2024-05-06T21:34:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80dabb6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80d4100d60 0x7f80d41006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80dabb6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 0x7f80d40fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80dabb6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d40ff250 con 0x7f80d4103680 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80dabb6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d40ff390 con 0x7f80d4100d60 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80d3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 0x7f80d40fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80d3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 0x7f80d40fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57798/0 (socket says 172.21.15.32:57798) 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80d3fff700 1 -- 172.21.15.32:0/1366118449 learned_addr learned my addr 172.21.15.32:0/1366118449 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80d8952700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80d4100d60 0x7f80d41006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80d3fff700 1 -- 172.21.15.32:0/1366118449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80d4100d60 msgr2=0x7f80d41006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80d3fff700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80d4100d60 0x7f80d41006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.566+0000 7f80d3fff700 1 -- 172.21.15.32:0/1366118449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00095f0 con 0x7f80d4103680 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.567+0000 7f80d8952700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80d4100d60 0x7f80d41006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.567+0000 7f80d3fff700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 0x7f80d40fed10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f80c0006010 tx=0x7f80c000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.567+0000 7f80d1ffb700 1 -- 172.21.15.32:0/1366118449 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c001d070 con 0x7f80d4103680 2024-05-06T21:34:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.567+0000 7f80d1ffb700 1 -- 172.21.15.32:0/1366118449 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f80c000f460 con 0x7f80d4103680 2024-05-06T21:34:08.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.567+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d40ff610 con 0x7f80d4103680 2024-05-06T21:34:08.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.567+0000 7f80d1ffb700 1 -- 172.21.15.32:0/1366118449 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c0021640 con 0x7f80d4103680 2024-05-06T21:34:08.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.567+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d40ffb00 con 0x7f80d4103680 2024-05-06T21:34:08.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.568+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d418fc60 con 0x7f80d4103680 2024-05-06T21:34:08.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.569+0000 7f80d1ffb700 1 -- 172.21.15.32:0/1366118449 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f80c000fab0 con 0x7f80d4103680 2024-05-06T21:34:08.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.569+0000 7f80d1ffb700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80c406e200 0x7f80c40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:08.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.569+0000 7f80d1ffb700 1 -- 172.21.15.32:0/1366118449 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f80c008f7b0 con 0x7f80d4103680 2024-05-06T21:34:08.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.569+0000 7f80d8952700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80c406e200 0x7f80c40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:08.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.570+0000 7f80d8952700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80c406e200 0x7f80c40706b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f80d4069000 tx=0x7f80c8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:08.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.574+0000 7f80d1ffb700 1 -- 172.21.15.32:0/1366118449 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f80c005c4b0 con 0x7f80d4103680 2024-05-06T21:34:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.880+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f80d4061960 con 0x7f80d4103680 2024-05-06T21:34:08.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.881+0000 7f80d1ffb700 1 -- 172.21.15.32:0/1366118449 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f80c005c040 con 0x7f80d4103680 2024-05-06T21:34:08.877 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_WARN 1 filesystem is degraded 2024-05-06T21:34:08.877 INFO:teuthology.orchestra.run.smithi032.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-05-06T21:34:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: fs cephfs is degraded 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.883+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80c406e200 msgr2=0x7f80c40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.883+0000 7f80dabb6700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80c406e200 0x7f80c40706b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f80d4069000 tx=0x7f80c8008040 comp rx=0 tx=0).stop 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.883+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 msgr2=0x7f80d40fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.883+0000 7f80dabb6700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 0x7f80d40fed10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f80c0006010 tx=0x7f80c000be20 comp rx=0 tx=0).stop 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.883+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 shutdown_connections 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.883+0000 7f80dabb6700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f80c406e200 0x7f80c40706b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.883+0000 7f80dabb6700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80d4100d60 0x7f80d41006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.883+0000 7f80dabb6700 1 --2- 172.21.15.32:0/1366118449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80d4103680 0x7f80d40fed10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.883+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 >> 172.21.15.32:0/1366118449 conn(0x7f80d40fa780 msgr2=0x7f80d40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.884+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 shutdown_connections 2024-05-06T21:34:08.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:08.884+0000 7f80dabb6700 1 -- 172.21.15.32:0/1366118449 wait complete. 2024-05-06T21:34:08.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:08 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:rejoin 2024-05-06T21:34:08.980 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:08 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] up:boot 2024-05-06T21:34:08.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:08 smithi032 ceph-mon[76650]: fsmap cephfs:1/1 {0=cephfs.smithi154.xfmqxf=up:rejoin} 3 up:standby 2024-05-06T21:34:08.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:08 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:34:08.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:08 smithi032 ceph-mon[76650]: daemon mds.cephfs.smithi154.xfmqxf is now active in filesystem cephfs as rank 0 2024-05-06T21:34:08.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:08 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2633193418' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:34:08.981 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:08 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1366118449' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:34:09.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:08 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:rejoin 2024-05-06T21:34:09.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:08 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] up:boot 2024-05-06T21:34:09.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:08 smithi154 ceph-mon[63622]: fsmap cephfs:1/1 {0=cephfs.smithi154.xfmqxf=up:rejoin} 3 up:standby 2024-05-06T21:34:09.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:08 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:34:09.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:08 smithi154 ceph-mon[63622]: daemon mds.cephfs.smithi154.xfmqxf is now active in filesystem cephfs as rank 0 2024-05-06T21:34:09.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:08 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2633193418' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:34:09.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:08 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1366118449' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:34:10.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:09 smithi032 ceph-mon[76650]: from='client.44335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:10.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:09 smithi032 ceph-mon[76650]: pgmap v220: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-06T21:34:10.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:09 smithi032 ceph-mon[76650]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-06T21:34:10.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:09 smithi032 ceph-mon[76650]: Cluster is now healthy 2024-05-06T21:34:10.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:09 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:active 2024-05-06T21:34:10.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:09 smithi032 ceph-mon[76650]: fsmap cephfs:1 {0=cephfs.smithi154.xfmqxf=up:active} 3 up:standby 2024-05-06T21:34:10.283 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:09 smithi154 ceph-mon[63622]: from='client.44335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:10.283 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:09 smithi154 ceph-mon[63622]: pgmap v220: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-06T21:34:10.284 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:09 smithi154 ceph-mon[63622]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-06T21:34:10.284 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:09 smithi154 ceph-mon[63622]: Cluster is now healthy 2024-05-06T21:34:10.284 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:09 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.154:6826/2609692046,v1:172.21.15.154:6827/2609692046] up:active 2024-05-06T21:34:10.284 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:09 smithi154 ceph-mon[63622]: fsmap cephfs:1 {0=cephfs.smithi154.xfmqxf=up:active} 3 up:standby 2024-05-06T21:34:12.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:11 smithi032 ceph-mon[76650]: pgmap v221: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 88 B/s wr, 5 op/s 2024-05-06T21:34:12.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:11 smithi154 ceph-mon[63622]: pgmap v221: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 88 B/s wr, 5 op/s 2024-05-06T21:34:14.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:14 smithi154 ceph-mon[63622]: pgmap v222: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 14 KiB/s wr, 10 op/s 2024-05-06T21:34:14.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:14 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:14.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:14 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:14.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:14 smithi032 ceph-mon[76650]: pgmap v222: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 14 KiB/s wr, 10 op/s 2024-05-06T21:34:14.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:14 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:14.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:14 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:15.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:15.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:15 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:15.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:15 smithi154 ceph-mon[63622]: pgmap v223: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 8.2 MiB/s rd, 14 KiB/s wr, 9 op/s 2024-05-06T21:34:15.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:15.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:15 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:15.720 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:15 smithi032 ceph-mon[76650]: pgmap v223: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 8.2 MiB/s rd, 14 KiB/s wr, 9 op/s 2024-05-06T21:34:17.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:17 smithi032 ceph-mon[76650]: pgmap v224: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-06T21:34:18.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:17 smithi154 ceph-mon[63622]: pgmap v224: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-06T21:34:19.292 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:19.292 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:19.292 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:19.292 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:34:19.292 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:19.293 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:19.293 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:19.293 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:19.293 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:19.293 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:19.293 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi154.rizdbu"]}]: dispatch 2024-05-06T21:34:19.293 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:19 smithi032 ceph-mon[76650]: Upgrade: It appears safe to stop mds.cephfs.smithi154.rizdbu 2024-05-06T21:34:19.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:19.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:19.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:19.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:34:19.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:19.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:19.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:19.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:19.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:19.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:19.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi154.rizdbu"]}]: dispatch 2024-05-06T21:34:19.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:19 smithi154 ceph-mon[63622]: Upgrade: It appears safe to stop mds.cephfs.smithi154.rizdbu 2024-05-06T21:34:20.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:20 smithi154 ceph-mon[63622]: pgmap v225: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-06T21:34:20.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:20.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.rizdbu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:34:20.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:20.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:20 smithi032 ceph-mon[76650]: pgmap v225: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-06T21:34:20.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:20.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.rizdbu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:34:20.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:21.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:21 smithi154 ceph-mon[63622]: Upgrade: Updating mds.cephfs.smithi154.rizdbu 2024-05-06T21:34:21.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:21 smithi154 ceph-mon[63622]: Deploying daemon mds.cephfs.smithi154.rizdbu on smithi154 2024-05-06T21:34:21.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:21.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:34:21.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:21 smithi032 ceph-mon[76650]: Upgrade: Updating mds.cephfs.smithi154.rizdbu 2024-05-06T21:34:21.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:21 smithi032 ceph-mon[76650]: Deploying daemon mds.cephfs.smithi154.rizdbu on smithi154 2024-05-06T21:34:21.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:21.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:34:22.151 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:22 smithi154 ceph-mon[63622]: pgmap v226: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-06T21:34:22.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:22 smithi032 ceph-mon[76650]: pgmap v226: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-06T21:34:24.260 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:24 smithi154 ceph-mon[63622]: pgmap v227: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 4.4 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-06T21:34:24.260 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:24 smithi154 ceph-mon[63622]: osdmap e94: 6 total, 6 up, 6 in 2024-05-06T21:34:24.260 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:24 smithi154 ceph-mon[63622]: fsmap cephfs:1 {0=cephfs.smithi154.xfmqxf=up:active} 2 up:standby 2024-05-06T21:34:24.261 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:24 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:34:24.345 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:24 smithi032 ceph-mon[76650]: pgmap v227: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 4.4 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-06T21:34:24.345 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:24 smithi032 ceph-mon[76650]: osdmap e94: 6 total, 6 up, 6 in 2024-05-06T21:34:24.345 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:24 smithi032 ceph-mon[76650]: fsmap cephfs:1 {0=cephfs.smithi154.xfmqxf=up:active} 2 up:standby 2024-05-06T21:34:24.345 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:24 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:34:26.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:26 smithi154 ceph-mon[63622]: pgmap v229: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:26.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:26.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:26.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:26 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:26.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:26 smithi032 ceph-mon[76650]: pgmap v229: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:26.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:26.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:26.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:26 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:27.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:27 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.154:6824/171743146,v1:172.21.15.154:6825/171743146] up:boot 2024-05-06T21:34:27.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:27 smithi154 ceph-mon[63622]: fsmap cephfs:1 {0=cephfs.smithi154.xfmqxf=up:active} 3 up:standby 2024-05-06T21:34:27.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:27 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:34:27.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:27 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.154:6824/171743146,v1:172.21.15.154:6825/171743146] up:boot 2024-05-06T21:34:27.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:27 smithi032 ceph-mon[76650]: fsmap cephfs:1 {0=cephfs.smithi154.xfmqxf=up:active} 3 up:standby 2024-05-06T21:34:27.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:27 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:34:28.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:28 smithi154 ceph-mon[63622]: pgmap v230: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:28.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:28 smithi032 ceph-mon[76650]: pgmap v230: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:30.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:29 smithi154 ceph-mon[63622]: pgmap v231: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:30.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:30.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:30.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:29 smithi032 ceph-mon[76650]: pgmap v231: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:30.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:30.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:31.086 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:30 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:31.086 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:30 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:31.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:30 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:31.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:30 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:32.103 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:31 smithi154 ceph-mon[63622]: pgmap v232: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:32.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:31 smithi032 ceph-mon[76650]: pgmap v232: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:34.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: pgmap v233: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:34.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:34.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:34.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:34.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:34:34.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:34.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:34.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:34.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:34.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:34.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:34.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:33 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi154.xfmqxf"]}]: dispatch 2024-05-06T21:34:34.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: pgmap v233: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:34.366 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:33 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi154.xfmqxf"]}]: dispatch 2024-05-06T21:34:35.073 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:34 smithi154 ceph-mon[63622]: Detected new or changed devices on smithi154 2024-05-06T21:34:35.073 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:34 smithi154 ceph-mon[63622]: Upgrade: It appears safe to stop mds.cephfs.smithi154.xfmqxf 2024-05-06T21:34:35.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:34 smithi032 ceph-mon[76650]: Detected new or changed devices on smithi154 2024-05-06T21:34:35.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:34 smithi032 ceph-mon[76650]: Upgrade: It appears safe to stop mds.cephfs.smithi154.xfmqxf 2024-05-06T21:34:36.173 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:35 smithi154 ceph-mon[63622]: pgmap v234: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:36.173 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:36.173 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.xfmqxf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:34:36.173 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:36.174 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:34:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:35 smithi032 ceph-mon[76650]: pgmap v234: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi154.xfmqxf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-06T21:34:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:34:37.147 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:36 smithi154 ceph-mon[63622]: Upgrade: Updating mds.cephfs.smithi154.xfmqxf 2024-05-06T21:34:37.147 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:36 smithi154 ceph-mon[63622]: Deploying daemon mds.cephfs.smithi154.xfmqxf on smithi154 2024-05-06T21:34:37.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:36 smithi032 ceph-mon[76650]: Upgrade: Updating mds.cephfs.smithi154.xfmqxf 2024-05-06T21:34:37.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:36 smithi032 ceph-mon[76650]: Deploying daemon mds.cephfs.smithi154.xfmqxf on smithi154 2024-05-06T21:34:37.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:37 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032[76641]: 2024-05-06T21:34:37.439+0000 7f60c6d55700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T21:34:38.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:37 smithi032 ceph-mon[76650]: pgmap v235: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:38.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:37 smithi032 ceph-mon[76650]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-06T21:34:38.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:37 smithi032 ceph-mon[76650]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T21:34:38.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:37 smithi032 ceph-mon[76650]: osdmap e95: 6 total, 6 up, 6 in 2024-05-06T21:34:38.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:37 smithi032 ceph-mon[76650]: Standby daemon mds.cephfs.smithi032.fpdhzg assigned to filesystem cephfs as rank 0 2024-05-06T21:34:38.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:37 smithi032 ceph-mon[76650]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-06T21:34:38.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:37 smithi032 ceph-mon[76650]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-06T21:34:38.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:37 smithi032 ceph-mon[76650]: fsmap cephfs:1/1 {0=cephfs.smithi032.fpdhzg=up:replay} 2 up:standby 2024-05-06T21:34:38.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:37 smithi154 ceph-mon[63622]: pgmap v235: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:34:38.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:37 smithi154 ceph-mon[63622]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-06T21:34:38.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:37 smithi154 ceph-mon[63622]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-06T21:34:38.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:37 smithi154 ceph-mon[63622]: osdmap e95: 6 total, 6 up, 6 in 2024-05-06T21:34:38.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:37 smithi154 ceph-mon[63622]: Standby daemon mds.cephfs.smithi032.fpdhzg assigned to filesystem cephfs as rank 0 2024-05-06T21:34:38.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:37 smithi154 ceph-mon[63622]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-06T21:34:38.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:37 smithi154 ceph-mon[63622]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-06T21:34:38.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:37 smithi154 ceph-mon[63622]: fsmap cephfs:1/1 {0=cephfs.smithi032.fpdhzg=up:replay} 2 up:standby 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.000+0000 7f84c80a3700 1 -- 172.21.15.32:0/2837602682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0103350 msgr2=0x7f84c0105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.000+0000 7f84c80a3700 1 --2- 172.21.15.32:0/2837602682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0103350 0x7f84c0105790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009910 tx=0x7f84b0009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.000+0000 7f84c80a3700 1 -- 172.21.15.32:0/2837602682 shutdown_connections 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.000+0000 7f84c80a3700 1 --2- 172.21.15.32:0/2837602682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0103350 0x7f84c0105790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.000+0000 7f84c80a3700 1 --2- 172.21.15.32:0/2837602682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0069230 0x7f84c0102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.000+0000 7f84c80a3700 1 -- 172.21.15.32:0/2837602682 >> 172.21.15.32:0/2837602682 conn(0x7f84c00fa780 msgr2=0x7f84c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.000+0000 7f84c80a3700 1 -- 172.21.15.32:0/2837602682 shutdown_connections 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.000+0000 7f84c80a3700 1 -- 172.21.15.32:0/2837602682 wait complete. 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c80a3700 1 Processor -- start 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c80a3700 1 -- start start 2024-05-06T21:34:38.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c80a3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0069230 0x7f84c0195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c80a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0103350 0x7f84c0196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c80a3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c0196680 con 0x7f84c0069230 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c80a3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c01967c0 con 0x7f84c0103350 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c5e3f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0069230 0x7f84c0195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c5e3f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0069230 0x7f84c0195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43334/0 (socket says 172.21.15.32:43334) 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c5e3f700 1 -- 172.21.15.32:0/1036036029 learned_addr learned my addr 172.21.15.32:0/1036036029 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c5e3f700 1 -- 172.21.15.32:0/1036036029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0103350 msgr2=0x7f84c0196060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.001+0000 7f84c5e3f700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0103350 0x7f84c0196060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.002+0000 7f84c5e3f700 1 -- 172.21.15.32:0/1036036029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00095f0 con 0x7f84c0069230 2024-05-06T21:34:38.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.002+0000 7f84c5e3f700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0069230 0x7f84c0195b20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b4a0 tx=0x7f84bc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:39.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.002+0000 7f84b6ffd700 1 -- 172.21.15.32:0/1036036029 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84bc011800 con 0x7f84c0069230 2024-05-06T21:34:39.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.002+0000 7f84b6ffd700 1 -- 172.21.15.32:0/1036036029 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84bc011e10 con 0x7f84c0069230 2024-05-06T21:34:39.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.002+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c019b270 con 0x7f84c0069230 2024-05-06T21:34:39.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.002+0000 7f84b6ffd700 1 -- 172.21.15.32:0/1036036029 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84bc00f2e0 con 0x7f84c0069230 2024-05-06T21:34:39.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.002+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c019b7c0 con 0x7f84c0069230 2024-05-06T21:34:39.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.003+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c018fc70 con 0x7f84c0069230 2024-05-06T21:34:39.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.005+0000 7f84b6ffd700 1 -- 172.21.15.32:0/1036036029 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f84bc010380 con 0x7f84c0069230 2024-05-06T21:34:39.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.005+0000 7f84b6ffd700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f84ac06e200 0x7f84ac0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:39.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.005+0000 7f84b6ffd700 1 -- 172.21.15.32:0/1036036029 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f84bc08e350 con 0x7f84c0069230 2024-05-06T21:34:39.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.005+0000 7f84c563e700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f84ac06e200 0x7f84ac0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:39.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.006+0000 7f84c563e700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f84ac06e200 0x7f84ac0706b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84b0005090 tx=0x7f84b0000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:39.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.013+0000 7f84b6ffd700 1 -- 172.21.15.32:0/1036036029 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f84bc05b120 con 0x7f84c0069230 2024-05-06T21:34:39.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.249+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84c0061190 con 0x7f84ac06e200 2024-05-06T21:34:39.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.251+0000 7f84b6ffd700 1 -- 172.21.15.32:0/1036036029 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f84c0061190 con 0x7f84ac06e200 2024-05-06T21:34:39.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f84ac06e200 msgr2=0x7f84ac0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:39.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f84ac06e200 0x7f84ac0706b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84b0005090 tx=0x7f84b0000bc0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0069230 msgr2=0x7f84c0195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:39.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0069230 0x7f84c0195b20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b4a0 tx=0x7f84bc00b860 comp rx=0 tx=0).stop 2024-05-06T21:34:39.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 shutdown_connections 2024-05-06T21:34:39.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f84ac06e200 0x7f84ac0706b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c0069230 0x7f84c0195b20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 --2- 172.21.15.32:0/1036036029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c0103350 0x7f84c0196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 >> 172.21.15.32:0/1036036029 conn(0x7f84c00fa780 msgr2=0x7f84c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:39.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 shutdown_connections 2024-05-06T21:34:39.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.253+0000 7f84c80a3700 1 -- 172.21.15.32:0/1036036029 wait complete. 2024-05-06T21:34:39.260 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:34:39.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.364+0000 7ff179b6e700 1 -- 172.21.15.32:0/918160665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174069250 msgr2=0x7ff174102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:39.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.364+0000 7ff179b6e700 1 --2- 172.21.15.32:0/918160665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174069250 0x7ff174102df0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff164009910 tx=0x7ff164009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:39.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.364+0000 7ff179b6e700 1 -- 172.21.15.32:0/918160665 shutdown_connections 2024-05-06T21:34:39.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.364+0000 7ff179b6e700 1 --2- 172.21.15.32:0/918160665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff174103330 0x7ff174105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.364+0000 7ff179b6e700 1 --2- 172.21.15.32:0/918160665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174069250 0x7ff174102df0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.364+0000 7ff179b6e700 1 -- 172.21.15.32:0/918160665 >> 172.21.15.32:0/918160665 conn(0x7ff1740fa780 msgr2=0x7ff1740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:39.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.364+0000 7ff179b6e700 1 -- 172.21.15.32:0/918160665 shutdown_connections 2024-05-06T21:34:39.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.364+0000 7ff179b6e700 1 -- 172.21.15.32:0/918160665 wait complete. 2024-05-06T21:34:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.365+0000 7ff179b6e700 1 Processor -- start 2024-05-06T21:34:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.365+0000 7ff179b6e700 1 -- start start 2024-05-06T21:34:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff179b6e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff174069250 0x7ff174100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff179b6e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174103330 0x7ff1740fed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:39.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff179b6e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740ff2d0 con 0x7ff174103330 2024-05-06T21:34:39.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff179b6e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740ff410 con 0x7ff174069250 2024-05-06T21:34:39.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff172ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174103330 0x7ff1740fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:39.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff172ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174103330 0x7ff1740fed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43356/0 (socket says 172.21.15.32:43356) 2024-05-06T21:34:39.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff172ffd700 1 -- 172.21.15.32:0/1128838647 learned_addr learned my addr 172.21.15.32:0/1128838647 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:39.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff1737fe700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff174069250 0x7ff174100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff172ffd700 1 -- 172.21.15.32:0/1128838647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff174069250 msgr2=0x7ff174100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff172ffd700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff174069250 0x7ff174100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.366+0000 7ff172ffd700 1 -- 172.21.15.32:0/1128838647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1640095f0 con 0x7ff174103330 2024-05-06T21:34:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.367+0000 7ff172ffd700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174103330 0x7ff1740fed90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c930 tx=0x7ff16800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.367+0000 7ff170ff9700 1 -- 172.21.15.32:0/1128838647 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff168007ad0 con 0x7ff174103330 2024-05-06T21:34:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.367+0000 7ff170ff9700 1 -- 172.21.15.32:0/1128838647 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff16800ce80 con 0x7ff174103330 2024-05-06T21:34:39.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.367+0000 7ff170ff9700 1 -- 172.21.15.32:0/1128838647 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff168018630 con 0x7ff174103330 2024-05-06T21:34:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.367+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1740ff6f0 con 0x7ff174103330 2024-05-06T21:34:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.367+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1740ffbf0 con 0x7ff174103330 2024-05-06T21:34:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.369+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17418fbd0 con 0x7ff174103330 2024-05-06T21:34:39.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.369+0000 7ff170ff9700 1 -- 172.21.15.32:0/1128838647 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff168007c30 con 0x7ff174103330 2024-05-06T21:34:39.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.370+0000 7ff170ff9700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff15c06e200 0x7ff15c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:39.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.370+0000 7ff170ff9700 1 -- 172.21.15.32:0/1128838647 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7ff16808e2e0 con 0x7ff174103330 2024-05-06T21:34:39.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.370+0000 7ff1737fe700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff15c06e200 0x7ff15c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:39.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.371+0000 7ff1737fe700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff15c06e200 0x7ff15c0706b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff164005090 tx=0x7ff16400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:39.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.375+0000 7ff170ff9700 1 -- 172.21.15.32:0/1128838647 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff16805af90 con 0x7ff174103330 2024-05-06T21:34:39.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.657+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff174061190 con 0x7ff15c06e200 2024-05-06T21:34:39.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.659+0000 7ff170ff9700 1 -- 172.21.15.32:0/1128838647 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff174061190 con 0x7ff15c06e200 2024-05-06T21:34:39.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff15c06e200 msgr2=0x7ff15c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:39.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff15c06e200 0x7ff15c0706b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff164005090 tx=0x7ff16400b540 comp rx=0 tx=0).stop 2024-05-06T21:34:39.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174103330 msgr2=0x7ff1740fed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:39.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174103330 0x7ff1740fed90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c930 tx=0x7ff16800cc40 comp rx=0 tx=0).stop 2024-05-06T21:34:39.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 shutdown_connections 2024-05-06T21:34:39.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff15c06e200 0x7ff15c0706b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff174069250 0x7ff174100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 --2- 172.21.15.32:0/1128838647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff174103330 0x7ff1740fed90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 >> 172.21.15.32:0/1128838647 conn(0x7ff1740fa780 msgr2=0x7ff1740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:39.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 shutdown_connections 2024-05-06T21:34:39.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.661+0000 7ff179b6e700 1 -- 172.21.15.32:0/1128838647 wait complete. 2024-05-06T21:34:39.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.773+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/3450883415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c41003d0 msgr2=0x7fd6c4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:39.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.773+0000 7fd6cb6cb700 1 --2- 172.21.15.32:0/3450883415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c41003d0 0x7fd6c4100840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009910 tx=0x7fd6b4009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:39.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.773+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/3450883415 shutdown_connections 2024-05-06T21:34:39.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.773+0000 7fd6cb6cb700 1 --2- 172.21.15.32:0/3450883415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c41003d0 0x7fd6c4100840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.773+0000 7fd6cb6cb700 1 --2- 172.21.15.32:0/3450883415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6c40ff130 0x7fd6c40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.773+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/3450883415 >> 172.21.15.32:0/3450883415 conn(0x7fd6c40fa780 msgr2=0x7fd6c40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:39.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.773+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/3450883415 shutdown_connections 2024-05-06T21:34:39.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.773+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/3450883415 wait complete. 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6cb6cb700 1 Processor -- start 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6cb6cb700 1 -- start start 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6cb6cb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c40ff130 0x7fd6c4195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6cb6cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6c41003d0 0x7fd6c4195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6cb6cb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c41965c0 con 0x7fd6c40ff130 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6cb6cb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4196700 con 0x7fd6c41003d0 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6c8c66700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6c41003d0 0x7fd6c4195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6c9467700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c40ff130 0x7fd6c4195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6c8c66700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6c41003d0 0x7fd6c4195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.32:35172/0 (socket says 172.21.15.32:35172) 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.774+0000 7fd6c8c66700 1 -- 172.21.15.32:0/150532270 learned_addr learned my addr 172.21.15.32:0/150532270 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.775+0000 7fd6c8c66700 1 -- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c40ff130 msgr2=0x7fd6c4195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.775+0000 7fd6c8c66700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c40ff130 0x7fd6c4195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:39.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.775+0000 7fd6c8c66700 1 -- 172.21.15.32:0/150532270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40095f0 con 0x7fd6c41003d0 2024-05-06T21:34:39.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.775+0000 7fd6c9467700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c40ff130 0x7fd6c4195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-06T21:34:39.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.775+0000 7fd6c8c66700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6c41003d0 0x7fd6c4195fa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4005b40 tx=0x7fd6b400bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:39.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.775+0000 7fd6ba7fc700 1 -- 172.21.15.32:0/150532270 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6b401d070 con 0x7fd6c41003d0 2024-05-06T21:34:39.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.775+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c419b150 con 0x7fd6c41003d0 2024-05-06T21:34:39.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.776+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c419b640 con 0x7fd6c41003d0 2024-05-06T21:34:39.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.776+0000 7fd6ba7fc700 1 -- 172.21.15.32:0/150532270 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6b4022470 con 0x7fd6c41003d0 2024-05-06T21:34:39.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.776+0000 7fd6ba7fc700 1 -- 172.21.15.32:0/150532270 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6b400f690 con 0x7fd6c41003d0 2024-05-06T21:34:39.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.777+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c4107c10 con 0x7fd6c41003d0 2024-05-06T21:34:39.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.778+0000 7fd6ba7fc700 1 -- 172.21.15.32:0/150532270 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd6b4022a10 con 0x7fd6c41003d0 2024-05-06T21:34:39.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.778+0000 7fd6ba7fc700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd6b006e200 0x7fd6b00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:39.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.778+0000 7fd6ba7fc700 1 -- 172.21.15.32:0/150532270 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fd6b408f850 con 0x7fd6c41003d0 2024-05-06T21:34:39.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.778+0000 7fd6c9467700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd6b006e200 0x7fd6b00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:39.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.779+0000 7fd6c9467700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd6b006e200 0x7fd6b00706b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0005950 tx=0x7fd6c000a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:39.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:39.790+0000 7fd6ba7fc700 1 -- 172.21.15.32:0/150532270 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd6b405c5d0 con 0x7fd6c41003d0 2024-05-06T21:34:40.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.032+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6c4068c50 con 0x7fd6b006e200 2024-05-06T21:34:40.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:39 smithi032 ceph-mon[76650]: pgmap v237: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-05-06T21:34:40.029 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:39 smithi032 ceph-mon[76650]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:40.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.052+0000 7fd6ba7fc700 1 -- 172.21.15.32:0/150532270 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fd6c4068c50 con 0x7fd6b006e200 2024-05-06T21:34:40.048 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:34:40.048 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (14m) 26s ago 16m 24.4M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (16m) 26s ago 16m 8942k - 18.2.0 dc2bc1663786 ab554770661d 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (15m) 11s ago 15m 8896k - 18.2.0 dc2bc1663786 a8dacc925363 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (5m) 26s ago 16m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (5m) 11s ago 15m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (14m) 26s ago 16m 87.2M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (55s) 26s ago 10m 15.8M - 19.0.0-2497-gf273489c 3b8ac54a9a71 6cd9ab5eb234 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (32s) 26s ago 10m 14.7M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5c54ca7e9a32 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (14s) 11s ago 10m 12.5M - 19.0.0-2497-gf273489c 3b8ac54a9a71 df23e8b47eff 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (10m) 11s ago 10m 68.0M - 18.2.0 dc2bc1663786 63acf3253418 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (7m) 26s ago 17m 509M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (6m) 11s ago 15m 451M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (6m) 26s ago 17m 51.9M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (6m) 11s ago 15m 43.3M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (16m) 26s ago 16m 16.3M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:34:40.049 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (15m) 11s ago 15m 16.9M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:34:40.050 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (4m) 26s ago 14m 165M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:34:40.050 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (4m) 26s ago 14m 123M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:34:40.050 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (3m) 26s ago 13m 99.0M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:34:40.050 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (3m) 11s ago 13m 104M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:34:40.050 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (2m) 11s ago 12m 103M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:34:40.050 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (115s) 11s ago 12m 100M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 8b513e97a420 2024-05-06T21:34:40.050 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (6m) 26s ago 15m 69.2M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.055+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd6b006e200 msgr2=0x7fd6b00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.055+0000 7fd6cb6cb700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd6b006e200 0x7fd6b00706b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0005950 tx=0x7fd6c000a300 comp rx=0 tx=0).stop 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.056+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6c41003d0 msgr2=0x7fd6c4195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.056+0000 7fd6cb6cb700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6c41003d0 0x7fd6c4195fa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4005b40 tx=0x7fd6b400bd70 comp rx=0 tx=0).stop 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.056+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 shutdown_connections 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.056+0000 7fd6cb6cb700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd6b006e200 0x7fd6b00706b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.056+0000 7fd6cb6cb700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c40ff130 0x7fd6c4195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.056+0000 7fd6cb6cb700 1 --2- 172.21.15.32:0/150532270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6c41003d0 0x7fd6c4195fa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.056+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 >> 172.21.15.32:0/150532270 conn(0x7fd6c40fa780 msgr2=0x7fd6c4068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.056+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 shutdown_connections 2024-05-06T21:34:40.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.056+0000 7fd6cb6cb700 1 -- 172.21.15.32:0/150532270 wait complete. 2024-05-06T21:34:40.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.165+0000 7f6ff7b82700 1 -- 172.21.15.32:0/3505351520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0100d60 msgr2=0x7f6ff0103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.165+0000 7f6ff7b82700 1 --2- 172.21.15.32:0/3505351520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0100d60 0x7f6ff0103140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009910 tx=0x7f6fec009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:40.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.165+0000 7f6ff7b82700 1 -- 172.21.15.32:0/3505351520 shutdown_connections 2024-05-06T21:34:40.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.165+0000 7f6ff7b82700 1 --2- 172.21.15.32:0/3505351520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ff0103680 0x7f6ff0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.165+0000 7f6ff7b82700 1 --2- 172.21.15.32:0/3505351520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0100d60 0x7f6ff0103140 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.165+0000 7f6ff7b82700 1 -- 172.21.15.32:0/3505351520 >> 172.21.15.32:0/3505351520 conn(0x7f6ff00fa780 msgr2=0x7f6ff00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:40.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.166+0000 7f6ff7b82700 1 -- 172.21.15.32:0/3505351520 shutdown_connections 2024-05-06T21:34:40.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.166+0000 7f6ff7b82700 1 -- 172.21.15.32:0/3505351520 wait complete. 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.166+0000 7f6ff7b82700 1 Processor -- start 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.166+0000 7f6ff7b82700 1 -- start start 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.166+0000 7f6ff7b82700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ff0100d60 0x7f6ff0197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.166+0000 7f6ff7b82700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0103680 0x7f6ff0198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.166+0000 7f6ff7b82700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0198890 con 0x7f6ff0103680 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.166+0000 7f6ff7b82700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff01989d0 con 0x7f6ff0100d60 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6ff511d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0103680 0x7f6ff0198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6ff511d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0103680 0x7f6ff0198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43392/0 (socket says 172.21.15.32:43392) 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6ff511d700 1 -- 172.21.15.32:0/2882716828 learned_addr learned my addr 172.21.15.32:0/2882716828 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6ff591e700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ff0100d60 0x7f6ff0197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6ff511d700 1 -- 172.21.15.32:0/2882716828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ff0100d60 msgr2=0x7f6ff0197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6ff511d700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ff0100d60 0x7f6ff0197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6ff511d700 1 -- 172.21.15.32:0/2882716828 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0095f0 con 0x7f6ff0103680 2024-05-06T21:34:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6ff591e700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ff0100d60 0x7f6ff0197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:34:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6ff511d700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0103680 0x7f6ff0198270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000b4b0 tx=0x7f6fe000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.167+0000 7f6fe6ffd700 1 -- 172.21.15.32:0/2882716828 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe0011800 con 0x7f6ff0103680 2024-05-06T21:34:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.168+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff019d480 con 0x7f6ff0103680 2024-05-06T21:34:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.168+0000 7f6fe6ffd700 1 -- 172.21.15.32:0/2882716828 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6fe0011e10 con 0x7f6ff0103680 2024-05-06T21:34:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.168+0000 7f6fe6ffd700 1 -- 172.21.15.32:0/2882716828 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe000f2e0 con 0x7f6ff0103680 2024-05-06T21:34:40.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.168+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff019d9d0 con 0x7f6ff0103680 2024-05-06T21:34:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.169+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff00fc340 con 0x7f6ff0103680 2024-05-06T21:34:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.169+0000 7f6fe6ffd700 1 -- 172.21.15.32:0/2882716828 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6fe0010380 con 0x7f6ff0103680 2024-05-06T21:34:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.170+0000 7f6fe6ffd700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6fdc06e200 0x7f6fdc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.170+0000 7f6fe6ffd700 1 -- 172.21.15.32:0/2882716828 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f6fe008de50 con 0x7f6ff0103680 2024-05-06T21:34:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.170+0000 7f6ff591e700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6fdc06e200 0x7f6fdc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.170+0000 7f6ff591e700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6fdc06e200 0x7f6fdc0706b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6fec006010 tx=0x7f6fec005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:40.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.179+0000 7f6fe6ffd700 1 -- 172.21.15.32:0/2882716828 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f6fe005ab80 con 0x7f6ff0103680 2024-05-06T21:34:40.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:39 smithi154 ceph-mon[63622]: pgmap v237: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-05-06T21:34:40.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:39 smithi154 ceph-mon[63622]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.490+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ff0061960 con 0x7f6ff0103680 2024-05-06T21:34:40.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.491+0000 7f6fe6ffd700 1 -- 172.21.15.32:0/2882716828 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f6fe0015280 con 0x7f6ff0103680 2024-05-06T21:34:40.487 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:34:40.487 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:34:40.487 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:34:40.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:34:40.487 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 3 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 13 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:34:40.488 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.493+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6fdc06e200 msgr2=0x7f6fdc0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.493+0000 7f6ff7b82700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6fdc06e200 0x7f6fdc0706b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6fec006010 tx=0x7f6fec005ab0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.493+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0103680 msgr2=0x7f6ff0198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.493+0000 7f6ff7b82700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0103680 0x7f6ff0198270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000b4b0 tx=0x7f6fe000b870 comp rx=0 tx=0).stop 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.494+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 shutdown_connections 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.494+0000 7f6ff7b82700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6fdc06e200 0x7f6fdc0706b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.494+0000 7f6ff7b82700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ff0100d60 0x7f6ff0197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.494+0000 7f6ff7b82700 1 --2- 172.21.15.32:0/2882716828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ff0103680 0x7f6ff0198270 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.494+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 >> 172.21.15.32:0/2882716828 conn(0x7f6ff00fa780 msgr2=0x7f6ff0100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.494+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 shutdown_connections 2024-05-06T21:34:40.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.494+0000 7f6ff7b82700 1 -- 172.21.15.32:0/2882716828 wait complete. 2024-05-06T21:34:40.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.607+0000 7fdd2cae6700 1 -- 172.21.15.32:0/1230404574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 msgr2=0x7fdd28105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.607+0000 7fdd2cae6700 1 --2- 172.21.15.32:0/1230404574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 0x7fdd28105790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009910 tx=0x7fdd1c009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:40.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.607+0000 7fdd2cae6700 1 -- 172.21.15.32:0/1230404574 shutdown_connections 2024-05-06T21:34:40.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.607+0000 7fdd2cae6700 1 --2- 172.21.15.32:0/1230404574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 0x7fdd28105790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.607+0000 7fdd2cae6700 1 --2- 172.21.15.32:0/1230404574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd28069270 0x7fdd28102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.607+0000 7fdd2cae6700 1 -- 172.21.15.32:0/1230404574 >> 172.21.15.32:0/1230404574 conn(0x7fdd280fa780 msgr2=0x7fdd280fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:40.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.607+0000 7fdd2cae6700 1 -- 172.21.15.32:0/1230404574 shutdown_connections 2024-05-06T21:34:40.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.607+0000 7fdd2cae6700 1 -- 172.21.15.32:0/1230404574 wait complete. 2024-05-06T21:34:40.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.608+0000 7fdd2cae6700 1 Processor -- start 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.608+0000 7fdd2cae6700 1 -- start start 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.608+0000 7fdd2cae6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 0x7fdd28195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.608+0000 7fdd2cae6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd281960a0 0x7fdd2819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.608+0000 7fdd2cae6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd281965a0 con 0x7fdd28103310 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.608+0000 7fdd2cae6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28196710 con 0x7fdd281960a0 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.608+0000 7fdd2659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 0x7fdd28195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.608+0000 7fdd2659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 0x7fdd28195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43414/0 (socket says 172.21.15.32:43414) 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.608+0000 7fdd2659c700 1 -- 172.21.15.32:0/2696926057 learned_addr learned my addr 172.21.15.32:0/2696926057 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd25d9b700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd281960a0 0x7fdd2819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd2659c700 1 -- 172.21.15.32:0/2696926057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd281960a0 msgr2=0x7fdd2819b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd2659c700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd281960a0 0x7fdd2819b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd2659c700 1 -- 172.21.15.32:0/2696926057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0095f0 con 0x7fdd28103310 2024-05-06T21:34:40.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd2659c700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 0x7fdd28195b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800b480 tx=0x7fdd1800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:40.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd177fe700 1 -- 172.21.15.32:0/2696926057 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd180118c0 con 0x7fdd28103310 2024-05-06T21:34:40.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd177fe700 1 -- 172.21.15.32:0/2696926057 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd18010380 con 0x7fdd28103310 2024-05-06T21:34:40.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd177fe700 1 -- 172.21.15.32:0/2696926057 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd1800f510 con 0x7fdd28103310 2024-05-06T21:34:40.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2819b6b0 con 0x7fdd28103310 2024-05-06T21:34:40.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.609+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2819bb80 con 0x7fdd28103310 2024-05-06T21:34:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.611+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2818fc70 con 0x7fdd28103310 2024-05-06T21:34:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.611+0000 7fdd177fe700 1 -- 172.21.15.32:0/2696926057 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdd180104f0 con 0x7fdd28103310 2024-05-06T21:34:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.612+0000 7fdd177fe700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdd1006e200 0x7fdd100706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.612+0000 7fdd177fe700 1 -- 172.21.15.32:0/2696926057 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fdd1808dfc0 con 0x7fdd28103310 2024-05-06T21:34:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.612+0000 7fdd25d9b700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdd1006e200 0x7fdd100706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.612+0000 7fdd25d9b700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdd1006e200 0x7fdd100706b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0059d0 tx=0x7fdd1c005920 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:40.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.616+0000 7fdd177fe700 1 -- 172.21.15.32:0/2696926057 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fdd1805abd0 con 0x7fdd28103310 2024-05-06T21:34:40.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.943+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd28069270 con 0x7fdd28103310 2024-05-06T21:34:40.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.944+0000 7fdd177fe700 1 -- 172.21.15.32:0/2696926057 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1748 (secure 0 0 0) 0x7fdd1805a760 con 0x7fdd28103310 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:e38 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 38 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:34:37.445186+0000 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:34:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 95 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 1 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:in 0 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=34432} 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:34:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 1 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 0 members: 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{0:34432} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:34:40.943 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:34:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{-1:34452} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:34:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6824/171743146,v1:172.21.15.154:6825/171743146] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.946+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdd1006e200 msgr2=0x7fdd100706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.946+0000 7fdd2cae6700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdd1006e200 0x7fdd100706b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0059d0 tx=0x7fdd1c005920 comp rx=0 tx=0).stop 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.946+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 msgr2=0x7fdd28195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.946+0000 7fdd2cae6700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 0x7fdd28195b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800b480 tx=0x7fdd1800b840 comp rx=0 tx=0).stop 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.946+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 shutdown_connections 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.946+0000 7fdd2cae6700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdd1006e200 0x7fdd100706b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.946+0000 7fdd2cae6700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd28103310 0x7fdd28195b60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.946+0000 7fdd2cae6700 1 --2- 172.21.15.32:0/2696926057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd281960a0 0x7fdd2819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.946+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 >> 172.21.15.32:0/2696926057 conn(0x7fdd280fa780 msgr2=0x7fdd280fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.947+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 shutdown_connections 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:40.947+0000 7fdd2cae6700 1 -- 172.21.15.32:0/2696926057 wait complete. 2024-05-06T21:34:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 38 2024-05-06T21:34:41.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.059+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/3816202170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 msgr2=0x7fdb54100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:41.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.059+0000 7fdb5bcc3700 1 --2- 172.21.15.32:0/3816202170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 0x7fdb54100840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009910 tx=0x7fdb44009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:41.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.059+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/3816202170 shutdown_connections 2024-05-06T21:34:41.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.059+0000 7fdb5bcc3700 1 --2- 172.21.15.32:0/3816202170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 0x7fdb54100840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.059+0000 7fdb5bcc3700 1 --2- 172.21.15.32:0/3816202170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb540ff130 0x7fdb540ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.059+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/3816202170 >> 172.21.15.32:0/3816202170 conn(0x7fdb540fa780 msgr2=0x7fdb540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:41.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.059+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/3816202170 shutdown_connections 2024-05-06T21:34:41.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.059+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/3816202170 wait complete. 2024-05-06T21:34:41.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5bcc3700 1 Processor -- start 2024-05-06T21:34:41.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5bcc3700 1 -- start start 2024-05-06T21:34:41.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5bcc3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb540ff130 0x7fdb54197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:41.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5bcc3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 0x7fdb54198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:41.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5bcc3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54198890 con 0x7fdb541003d0 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5bcc3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5419d2a0 con 0x7fdb540ff130 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5925e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 0x7fdb54198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5925e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 0x7fdb54198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43428/0 (socket says 172.21.15.32:43428) 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5925e700 1 -- 172.21.15.32:0/2413811390 learned_addr learned my addr 172.21.15.32:0/2413811390 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5925e700 1 -- 172.21.15.32:0/2413811390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb540ff130 msgr2=0x7fdb54197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb59a5f700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb540ff130 0x7fdb54197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5925e700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb540ff130 0x7fdb54197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb5925e700 1 -- 172.21.15.32:0/2413811390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440095f0 con 0x7fdb541003d0 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.060+0000 7fdb59a5f700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb540ff130 0x7fdb54197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.061+0000 7fdb5925e700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 0x7fdb54198270 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400bd70 tx=0x7fdb4400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:41.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.061+0000 7fdb4affd700 1 -- 172.21.15.32:0/2413811390 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb4401d070 con 0x7fdb541003d0 2024-05-06T21:34:41.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.061+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5419d440 con 0x7fdb541003d0 2024-05-06T21:34:41.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.061+0000 7fdb4affd700 1 -- 172.21.15.32:0/2413811390 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdb44022470 con 0x7fdb541003d0 2024-05-06T21:34:41.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.061+0000 7fdb4affd700 1 -- 172.21.15.32:0/2413811390 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb4400f650 con 0x7fdb541003d0 2024-05-06T21:34:41.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.061+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5419d900 con 0x7fdb541003d0 2024-05-06T21:34:41.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.062+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb54107cb0 con 0x7fdb541003d0 2024-05-06T21:34:41.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.063+0000 7fdb4affd700 1 -- 172.21.15.32:0/2413811390 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdb44004b10 con 0x7fdb541003d0 2024-05-06T21:34:41.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.063+0000 7fdb4affd700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdb4006e200 0x7fdb400706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:41.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.063+0000 7fdb4affd700 1 -- 172.21.15.32:0/2413811390 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fdb4408f980 con 0x7fdb541003d0 2024-05-06T21:34:41.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.063+0000 7fdb59a5f700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdb4006e200 0x7fdb400706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:41.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.064+0000 7fdb59a5f700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdb4006e200 0x7fdb400706b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb50006fd0 tx=0x7fdb50008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:41.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.068+0000 7fdb4affd700 1 -- 172.21.15.32:0/2413811390 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fdb44058c30 con 0x7fdb541003d0 2024-05-06T21:34:41.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:40 smithi032 ceph-mon[76650]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:41.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:40 smithi032 ceph-mon[76650]: from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:41.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:40 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2882716828' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:41.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.307+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb54068c50 con 0x7fdb4006e200 2024-05-06T21:34:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.308+0000 7fdb4affd700 1 -- 172.21.15.32:0/2413811390 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdb54068c50 con 0x7fdb4006e200 2024-05-06T21:34:41.304 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:34:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "osd", 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "15/23 daemons upgraded", 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading mds daemons", 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:34:41.305 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:34:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdb4006e200 msgr2=0x7fdb400706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdb4006e200 0x7fdb400706b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb50006fd0 tx=0x7fdb50008040 comp rx=0 tx=0).stop 2024-05-06T21:34:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 msgr2=0x7fdb54198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 0x7fdb54198270 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400bd70 tx=0x7fdb4400be50 comp rx=0 tx=0).stop 2024-05-06T21:34:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 shutdown_connections 2024-05-06T21:34:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdb4006e200 0x7fdb400706b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb540ff130 0x7fdb54197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 --2- 172.21.15.32:0/2413811390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb541003d0 0x7fdb54198270 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 >> 172.21.15.32:0/2413811390 conn(0x7fdb540fa780 msgr2=0x7fdb54068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:41.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 shutdown_connections 2024-05-06T21:34:41.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.312+0000 7fdb5bcc3700 1 -- 172.21.15.32:0/2413811390 wait complete. 2024-05-06T21:34:41.351 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:40 smithi154 ceph-mon[63622]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:41.351 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:40 smithi154 ceph-mon[63622]: from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:41.351 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:40 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2882716828' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:41.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.422+0000 7f89414a8700 1 -- 172.21.15.32:0/2780596834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c100340 msgr2=0x7f893c100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:41.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.422+0000 7f89414a8700 1 --2- 172.21.15.32:0/2780596834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c100340 0x7f893c100790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8930009910 tx=0x7f8930009c20 comp rx=0 tx=0).stop 2024-05-06T21:34:41.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.422+0000 7f89414a8700 1 -- 172.21.15.32:0/2780596834 shutdown_connections 2024-05-06T21:34:41.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.422+0000 7f89414a8700 1 --2- 172.21.15.32:0/2780596834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c100340 0x7f893c100790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.422+0000 7f89414a8700 1 --2- 172.21.15.32:0/2780596834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f893c0ff140 0x7f893c0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.422+0000 7f89414a8700 1 -- 172.21.15.32:0/2780596834 >> 172.21.15.32:0/2780596834 conn(0x7f893c0fa6d0 msgr2=0x7f893c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:41.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.422+0000 7f89414a8700 1 -- 172.21.15.32:0/2780596834 shutdown_connections 2024-05-06T21:34:41.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.422+0000 7f89414a8700 1 -- 172.21.15.32:0/2780596834 wait complete. 2024-05-06T21:34:41.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.423+0000 7f89414a8700 1 Processor -- start 2024-05-06T21:34:41.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.423+0000 7f89414a8700 1 -- start start 2024-05-06T21:34:41.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.423+0000 7f89414a8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c0ff140 0x7f893c1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:41.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.423+0000 7f89414a8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f893c100340 0x7f893c101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:41.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.423+0000 7f89414a8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c101c60 con 0x7f893c0ff140 2024-05-06T21:34:41.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.423+0000 7f89414a8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c101da0 con 0x7f893c100340 2024-05-06T21:34:41.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.423+0000 7f893affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c0ff140 0x7f893c1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:41.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.423+0000 7f893affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c0ff140 0x7f893c1030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43440/0 (socket says 172.21.15.32:43440) 2024-05-06T21:34:41.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.423+0000 7f893affd700 1 -- 172.21.15.32:0/2968345004 learned_addr learned my addr 172.21.15.32:0/2968345004 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:34:41.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f893a7fc700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f893c100340 0x7f893c101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:41.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f893affd700 1 -- 172.21.15.32:0/2968345004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f893c100340 msgr2=0x7f893c101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:41.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f893affd700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f893c100340 0x7f893c101720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f893affd700 1 -- 172.21.15.32:0/2968345004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300095f0 con 0x7f893c0ff140 2024-05-06T21:34:41.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f893affd700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c0ff140 0x7f893c1030d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c8f0 tx=0x7f892c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:41.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f8923fff700 1 -- 172.21.15.32:0/2968345004 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f892c0078e0 con 0x7f893c0ff140 2024-05-06T21:34:41.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f8923fff700 1 -- 172.21.15.32:0/2968345004 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f892c00f450 con 0x7f893c0ff140 2024-05-06T21:34:41.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c102080 con 0x7f893c0ff140 2024-05-06T21:34:41.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f8923fff700 1 -- 172.21.15.32:0/2968345004 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f892c018610 con 0x7f893c0ff140 2024-05-06T21:34:41.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.424+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c19daf0 con 0x7f893c0ff140 2024-05-06T21:34:41.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.426+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c107c90 con 0x7f893c0ff140 2024-05-06T21:34:41.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.427+0000 7f8923fff700 1 -- 172.21.15.32:0/2968345004 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f892c00f5c0 con 0x7f893c0ff140 2024-05-06T21:34:41.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.428+0000 7f8923fff700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f892406e200 0x7f89240706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:34:41.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.428+0000 7f8923fff700 1 -- 172.21.15.32:0/2968345004 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f892c08e260 con 0x7f893c0ff140 2024-05-06T21:34:41.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.428+0000 7f893a7fc700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f892406e200 0x7f89240706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:34:41.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.428+0000 7f893a7fc700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f892406e200 0x7f89240706b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8930006010 tx=0x7f893000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:34:41.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.432+0000 7f8923fff700 1 -- 172.21.15.32:0/2968345004 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f892c05ae70 con 0x7f893c0ff140 2024-05-06T21:34:41.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.736+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f893c19e0a0 con 0x7f893c0ff140 2024-05-06T21:34:41.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.736+0000 7f8923fff700 1 -- 172.21.15.32:0/2968345004 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f892c05aa00 con 0x7f893c0ff140 2024-05-06T21:34:41.732 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_WARN 1 filesystem is degraded 2024-05-06T21:34:41.732 INFO:teuthology.orchestra.run.smithi032.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-05-06T21:34:41.733 INFO:teuthology.orchestra.run.smithi032.stdout: fs cephfs is degraded 2024-05-06T21:34:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.738+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f892406e200 msgr2=0x7f89240706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.738+0000 7f89414a8700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f892406e200 0x7f89240706b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8930006010 tx=0x7f893000b540 comp rx=0 tx=0).stop 2024-05-06T21:34:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.738+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c0ff140 msgr2=0x7f893c1030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:34:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.738+0000 7f89414a8700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c0ff140 0x7f893c1030d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c8f0 tx=0x7f892c00cc00 comp rx=0 tx=0).stop 2024-05-06T21:34:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.739+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 shutdown_connections 2024-05-06T21:34:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.739+0000 7f89414a8700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f892406e200 0x7f89240706b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.739+0000 7f89414a8700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f893c0ff140 0x7f893c1030d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.739+0000 7f89414a8700 1 --2- 172.21.15.32:0/2968345004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f893c100340 0x7f893c101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:34:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.739+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 >> 172.21.15.32:0/2968345004 conn(0x7f893c0fa6d0 msgr2=0x7f893c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:34:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.739+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 shutdown_connections 2024-05-06T21:34:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:34:41.739+0000 7f89414a8700 1 -- 172.21.15.32:0/2968345004 wait complete. 2024-05-06T21:34:42.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:41 smithi032 ceph-mon[76650]: pgmap v238: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-05-06T21:34:42.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:41 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2696926057' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:34:42.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:41 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2968345004' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:34:42.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:41 smithi154 ceph-mon[63622]: pgmap v238: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-05-06T21:34:42.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:41 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2696926057' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:34:42.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:41 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2968345004' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:34:43.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:42 smithi032 ceph-mon[76650]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:43.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:42 smithi154 ceph-mon[63622]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:34:44.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:43 smithi032 ceph-mon[76650]: pgmap v239: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-05-06T21:34:44.360 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:43 smithi154 ceph-mon[63622]: pgmap v239: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-05-06T21:34:46.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:45 smithi032 ceph-mon[76650]: pgmap v240: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-06T21:34:46.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:45 smithi032 ceph-mon[76650]: reconnect by client.14532 v1:192.168.0.1:0/718525170 after 0 2024-05-06T21:34:46.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:45 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] up:reconnect 2024-05-06T21:34:46.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:45 smithi032 ceph-mon[76650]: fsmap cephfs:1/1 {0=cephfs.smithi032.fpdhzg=up:reconnect} 2 up:standby 2024-05-06T21:34:46.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:45 smithi032 ceph-mon[76650]: reconnect by client.24325 v1:192.168.0.1:0/3805930735 after 0.00399992 2024-05-06T21:34:46.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:46.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:46.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:45 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:46.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:45 smithi154 ceph-mon[63622]: pgmap v240: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-06T21:34:46.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:45 smithi154 ceph-mon[63622]: reconnect by client.14532 v1:192.168.0.1:0/718525170 after 0 2024-05-06T21:34:46.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:45 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] up:reconnect 2024-05-06T21:34:46.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:45 smithi154 ceph-mon[63622]: fsmap cephfs:1/1 {0=cephfs.smithi032.fpdhzg=up:reconnect} 2 up:standby 2024-05-06T21:34:46.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:45 smithi154 ceph-mon[63622]: reconnect by client.24325 v1:192.168.0.1:0/3805930735 after 0.00399992 2024-05-06T21:34:46.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:46.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:46.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:45 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:47.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:46 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] up:rejoin 2024-05-06T21:34:47.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:46 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.154:6826/3609095923,v1:172.21.15.154:6827/3609095923] up:boot 2024-05-06T21:34:47.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:46 smithi032 ceph-mon[76650]: fsmap cephfs:1/1 {0=cephfs.smithi032.fpdhzg=up:rejoin} 3 up:standby 2024-05-06T21:34:47.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:46 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:34:47.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:46 smithi032 ceph-mon[76650]: daemon mds.cephfs.smithi032.fpdhzg is now active in filesystem cephfs as rank 0 2024-05-06T21:34:47.221 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:46 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] up:rejoin 2024-05-06T21:34:47.221 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:46 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.154:6826/3609095923,v1:172.21.15.154:6827/3609095923] up:boot 2024-05-06T21:34:47.221 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:46 smithi154 ceph-mon[63622]: fsmap cephfs:1/1 {0=cephfs.smithi032.fpdhzg=up:rejoin} 3 up:standby 2024-05-06T21:34:47.221 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:46 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:34:47.221 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:46 smithi154 ceph-mon[63622]: daemon mds.cephfs.smithi032.fpdhzg is now active in filesystem cephfs as rank 0 2024-05-06T21:34:48.005 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:47 smithi154 ceph-mon[63622]: pgmap v241: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-06T21:34:48.005 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:47 smithi154 ceph-mon[63622]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-06T21:34:48.006 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:47 smithi154 ceph-mon[63622]: Cluster is now healthy 2024-05-06T21:34:48.006 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:47 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] up:active 2024-05-06T21:34:48.006 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:47 smithi154 ceph-mon[63622]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 3 up:standby 2024-05-06T21:34:48.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:47 smithi032 ceph-mon[76650]: pgmap v241: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-06T21:34:48.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:47 smithi032 ceph-mon[76650]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-06T21:34:48.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:47 smithi032 ceph-mon[76650]: Cluster is now healthy 2024-05-06T21:34:48.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:47 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] up:active 2024-05-06T21:34:48.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:47 smithi032 ceph-mon[76650]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 3 up:standby 2024-05-06T21:34:49.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:49 smithi032 ceph-mon[76650]: pgmap v242: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 90 B/s wr, 6 op/s 2024-05-06T21:34:49.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:49.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:50.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:49 smithi154 ceph-mon[63622]: pgmap v242: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 90 B/s wr, 6 op/s 2024-05-06T21:34:50.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:50.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:51.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:51.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:51.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:34:51.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:51.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:51.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:34:52.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:51 smithi154 ceph-mon[63622]: pgmap v243: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-05-06T21:34:52.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:51 smithi032 ceph-mon[76650]: pgmap v243: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-05-06T21:34:54.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: pgmap v244: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:34:54.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi032.fpdhzg"}]': finished 2024-05-06T21:34:54.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:34:54.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi032.jbgmwi"}]': finished 2024-05-06T21:34:54.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:34:54.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi154.rizdbu"}]': finished 2024-05-06T21:34:54.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:34:54.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi154.xfmqxf"}]': finished 2024-05-06T21:34:54.616 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:54 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-05-06T21:34:54.705 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: pgmap v244: 65 pgs: 65 active+clean; 174 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-05-06T21:34:54.705 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:54.705 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi032.fpdhzg"}]: dispatch 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi032.fpdhzg"}]': finished 2024-05-06T21:34:54.706 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi032.jbgmwi"}]: dispatch 2024-05-06T21:34:54.707 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi032.jbgmwi"}]': finished 2024-05-06T21:34:54.707 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi154.rizdbu"}]: dispatch 2024-05-06T21:34:54.707 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi154.rizdbu"}]': finished 2024-05-06T21:34:54.707 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi154.xfmqxf"}]: dispatch 2024-05-06T21:34:54.707 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi154.xfmqxf"}]': finished 2024-05-06T21:34:54.707 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:54 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all mds 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: daemon mds.cephfs.smithi032.jbgmwi assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: Cluster is now healthy 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 3 up:standby 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi032.jbgmwi=up:starting} 2 up:standby 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:55.330 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:55.331 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: daemon mds.cephfs.smithi032.jbgmwi is now active in filesystem cephfs as rank 1 2024-05-06T21:34:55.331 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:55.331 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:55.331 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:55.331 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:55 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all mds 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: daemon mds.cephfs.smithi032.jbgmwi assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: Cluster is now healthy 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: fsmap cephfs:1 {0=cephfs.smithi032.fpdhzg=up:active} 3 up:standby 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi032.jbgmwi=up:starting} 2 up:standby 2024-05-06T21:34:55.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:55.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:55.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: daemon mds.cephfs.smithi032.jbgmwi is now active in filesystem cephfs as rank 1 2024-05-06T21:34:55.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:55.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:55.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:55.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:55 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:34:56.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:56 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all rgw 2024-05-06T21:34:56.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:56 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all rbd-mirror 2024-05-06T21:34:56.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:56 smithi032 ceph-mon[76650]: pgmap v245: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 4.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-06T21:34:56.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:56 smithi032 ceph-mon[76650]: mds.? [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] up:active 2024-05-06T21:34:56.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:56 smithi032 ceph-mon[76650]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi032.jbgmwi=up:active} 2 up:standby 2024-05-06T21:34:56.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:56.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:34:56.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:56 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:56.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:56 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all rgw 2024-05-06T21:34:56.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:56 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all rbd-mirror 2024-05-06T21:34:56.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:56 smithi154 ceph-mon[63622]: pgmap v245: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 4.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-06T21:34:56.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:56 smithi154 ceph-mon[63622]: mds.? [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] up:active 2024-05-06T21:34:56.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:56 smithi154 ceph-mon[63622]: fsmap cephfs:2 {0=cephfs.smithi032.fpdhzg=up:active,1=cephfs.smithi032.jbgmwi=up:active} 2 up:standby 2024-05-06T21:34:56.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:34:56.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi032", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:34:56.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:56 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:34:57.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:57 smithi032 ceph-mon[76650]: Upgrade: Updating ceph-exporter.smithi032 (1/2) 2024-05-06T21:34:57.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:57 smithi032 ceph-mon[76650]: Deploying daemon ceph-exporter.smithi032 on smithi032 2024-05-06T21:34:57.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:57 smithi154 ceph-mon[63622]: Upgrade: Updating ceph-exporter.smithi032 (1/2) 2024-05-06T21:34:57.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:57 smithi154 ceph-mon[63622]: Deploying daemon ceph-exporter.smithi032 on smithi032 2024-05-06T21:34:58.338 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:34:58 smithi032 ceph-mon[76650]: pgmap v246: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-06T21:34:58.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:34:58 smithi154 ceph-mon[63622]: pgmap v246: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-06T21:35:00.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:00 smithi032 ceph-mon[76650]: pgmap v247: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-05-06T21:35:00.568 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:00 smithi154 ceph-mon[63622]: pgmap v247: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-05-06T21:35:01.564 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:01 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:01.565 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:01 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:01.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:01 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:01.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:01 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:02.530 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:02 smithi154 ceph-mon[63622]: pgmap v248: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-05-06T21:35:02.530 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:02.530 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:35:02.530 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:02 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:35:02.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:02 smithi032 ceph-mon[76650]: pgmap v248: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-05-06T21:35:02.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:02.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi154", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-05-06T21:35:02.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:02 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:35:03.469 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:03 smithi154 ceph-mon[63622]: Upgrade: Updating ceph-exporter.smithi154 (2/2) 2024-05-06T21:35:03.469 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:03 smithi154 ceph-mon[63622]: Deploying daemon ceph-exporter.smithi154 on smithi154 2024-05-06T21:35:03.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:03 smithi032 ceph-mon[76650]: Upgrade: Updating ceph-exporter.smithi154 (2/2) 2024-05-06T21:35:03.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:03 smithi032 ceph-mon[76650]: Deploying daemon ceph-exporter.smithi154 on smithi154 2024-05-06T21:35:04.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:04 smithi154 ceph-mon[63622]: pgmap v249: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 6.7 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-05-06T21:35:04.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:04 smithi032 ceph-mon[76650]: pgmap v249: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 6.7 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-05-06T21:35:06.534 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:06 smithi154 ceph-mon[63622]: pgmap v250: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-06T21:35:06.534 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:06.534 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:06.534 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:06.534 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:35:06.644 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:06 smithi032 ceph-mon[76650]: pgmap v250: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-06T21:35:06.644 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:06.644 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:06.644 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:06.644 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:35:08.362 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:08 smithi032 ceph-mon[76650]: pgmap v251: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-06T21:35:08.362 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:08 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:08.363 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:08 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:08.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:08 smithi154 ceph-mon[63622]: pgmap v251: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-06T21:35:08.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:08 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:08.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:08 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:10.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:10 smithi154 ceph-mon[63622]: pgmap v252: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-06T21:35:10.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:10 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:10.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:10 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:10.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:10 smithi032 ceph-mon[76650]: pgmap v252: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-06T21:35:10.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:10 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:10.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:10 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:11.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:11 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:11.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:11 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:11.631 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:11 smithi154 ceph-mon[63622]: pgmap v253: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 2 op/s 2024-05-06T21:35:11.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:11 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:11.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:11 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:11.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:11 smithi032 ceph-mon[76650]: pgmap v253: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 2 op/s 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.853+0000 7f6109840700 1 -- 172.21.15.32:0/4269066304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104100240 msgr2=0x7f6104100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.853+0000 7f6109840700 1 --2- 172.21.15.32:0/4269066304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104100240 0x7f6104100650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f60f400b0a0 tx=0x7f60f400b3b0 comp rx=0 tx=0).stop 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.853+0000 7f6109840700 1 -- 172.21.15.32:0/4269066304 shutdown_connections 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.853+0000 7f6109840700 1 --2- 172.21.15.32:0/4269066304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6104101440 0x7f6104101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.853+0000 7f6109840700 1 --2- 172.21.15.32:0/4269066304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104100240 0x7f6104100650 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.853+0000 7f6109840700 1 -- 172.21.15.32:0/4269066304 >> 172.21.15.32:0/4269066304 conn(0x7f61040fb7f0 msgr2=0x7f61040fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.853+0000 7f6109840700 1 -- 172.21.15.32:0/4269066304 shutdown_connections 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.853+0000 7f6109840700 1 -- 172.21.15.32:0/4269066304 wait complete. 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.853+0000 7f6109840700 1 Processor -- start 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f6109840700 1 -- start start 2024-05-06T21:35:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f6109840700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6104100240 0x7f6104197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f6109840700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104101440 0x7f6104198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f6109840700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6104198850 con 0x7f6104101440 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f6109840700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610419d260 con 0x7f6104100240 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f61027fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104101440 0x7f6104198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f61027fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104101440 0x7f6104198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43936/0 (socket says 172.21.15.32:43936) 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f61027fc700 1 -- 172.21.15.32:0/2968013789 learned_addr learned my addr 172.21.15.32:0/2968013789 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f6102ffd700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6104100240 0x7f6104197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f61027fc700 1 -- 172.21.15.32:0/2968013789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6104100240 msgr2=0x7f6104197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f61027fc700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6104100240 0x7f6104197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f61027fc700 1 -- 172.21.15.32:0/2968013789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f4009d00 con 0x7f6104101440 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.854+0000 7f61027fc700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104101440 0x7f6104198230 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f60f800d8d0 tx=0x7f60f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.855+0000 7f610883e700 1 -- 172.21.15.32:0/2968013789 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60f8009940 con 0x7f6104101440 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.855+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610419d460 con 0x7f6104101440 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.855+0000 7f610883e700 1 -- 172.21.15.32:0/2968013789 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60f8010460 con 0x7f6104101440 2024-05-06T21:35:11.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.855+0000 7f610883e700 1 -- 172.21.15.32:0/2968013789 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60f800f5f0 con 0x7f6104101440 2024-05-06T21:35:11.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.855+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610419d980 con 0x7f6104101440 2024-05-06T21:35:11.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.856+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6104105520 con 0x7f6104101440 2024-05-06T21:35:11.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.856+0000 7f610883e700 1 -- 172.21.15.32:0/2968013789 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f60f80105d0 con 0x7f6104101440 2024-05-06T21:35:11.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.857+0000 7f610883e700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f60ec06e200 0x7f60ec0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:11.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.857+0000 7f610883e700 1 -- 172.21.15.32:0/2968013789 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f60f808e1f0 con 0x7f6104101440 2024-05-06T21:35:11.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.857+0000 7f6102ffd700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f60ec06e200 0x7f60ec0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:11.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.858+0000 7f6102ffd700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f60ec06e200 0x7f60ec0706b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009fd0 tx=0x7f60f400b7f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:11.862+0000 7f610883e700 1 -- 172.21.15.32:0/2968013789 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f60f80573f0 con 0x7f6104101440 2024-05-06T21:35:12.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.107+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6104061190 con 0x7f60ec06e200 2024-05-06T21:35:12.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.108+0000 7f610883e700 1 -- 172.21.15.32:0/2968013789 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f6104061190 con 0x7f60ec06e200 2024-05-06T21:35:12.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f60ec06e200 msgr2=0x7f60ec0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f60ec06e200 0x7f60ec0706b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009fd0 tx=0x7f60f400b7f0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104101440 msgr2=0x7f6104198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104101440 0x7f6104198230 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f60f800d8d0 tx=0x7f60f800dc90 comp rx=0 tx=0).stop 2024-05-06T21:35:12.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 shutdown_connections 2024-05-06T21:35:12.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f60ec06e200 0x7f60ec0706b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6104100240 0x7f6104197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 --2- 172.21.15.32:0/2968013789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6104101440 0x7f6104198230 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 >> 172.21.15.32:0/2968013789 conn(0x7f61040fb7f0 msgr2=0x7f6104102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:12.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 shutdown_connections 2024-05-06T21:35:12.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.111+0000 7f6109840700 1 -- 172.21.15.32:0/2968013789 wait complete. 2024-05-06T21:35:12.118 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:35:12.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.221+0000 7f10aefbf700 1 -- 172.21.15.32:0/2386280785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a81003f0 msgr2=0x7f10a8100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.221+0000 7f10aefbf700 1 --2- 172.21.15.32:0/2386280785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a81003f0 0x7f10a8100860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f109c009910 tx=0x7f109c009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:12.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.221+0000 7f10aefbf700 1 -- 172.21.15.32:0/2386280785 shutdown_connections 2024-05-06T21:35:12.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.221+0000 7f10aefbf700 1 --2- 172.21.15.32:0/2386280785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a81003f0 0x7f10a8100860 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.221+0000 7f10aefbf700 1 --2- 172.21.15.32:0/2386280785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80ff150 0x7f10a80ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.221+0000 7f10aefbf700 1 -- 172.21.15.32:0/2386280785 >> 172.21.15.32:0/2386280785 conn(0x7f10a80fa7a0 msgr2=0x7f10a80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:12.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.221+0000 7f10aefbf700 1 -- 172.21.15.32:0/2386280785 shutdown_connections 2024-05-06T21:35:12.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.221+0000 7f10aefbf700 1 -- 172.21.15.32:0/2386280785 wait complete. 2024-05-06T21:35:12.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10aefbf700 1 Processor -- start 2024-05-06T21:35:12.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10aefbf700 1 -- start start 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10aefbf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a80ff150 0x7f10a8197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10aefbf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a81003f0 0x7f10a8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10aefbf700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8198b20 con 0x7f10a80ff150 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10aefbf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8198c60 con 0x7f10a81003f0 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10acd5b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a80ff150 0x7f10a8197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10acd5b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a80ff150 0x7f10a8197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43954/0 (socket says 172.21.15.32:43954) 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10acd5b700 1 -- 172.21.15.32:0/2428644762 learned_addr learned my addr 172.21.15.32:0/2428644762 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10a7fff700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a81003f0 0x7f10a8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10acd5b700 1 -- 172.21.15.32:0/2428644762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a81003f0 msgr2=0x7f10a8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.222+0000 7f10acd5b700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a81003f0 0x7f10a8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.223+0000 7f10acd5b700 1 -- 172.21.15.32:0/2428644762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c0095f0 con 0x7f10a80ff150 2024-05-06T21:35:12.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.223+0000 7f10a7fff700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a81003f0 0x7f10a8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:35:12.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.223+0000 7f10acd5b700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a80ff150 0x7f10a8197fc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f109800b4b0 tx=0x7f109800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:12.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.223+0000 7f10a5ffb700 1 -- 172.21.15.32:0/2428644762 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1098011800 con 0x7f10a80ff150 2024-05-06T21:35:12.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.223+0000 7f10a5ffb700 1 -- 172.21.15.32:0/2428644762 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1098011e10 con 0x7f10a80ff150 2024-05-06T21:35:12.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.223+0000 7f10a5ffb700 1 -- 172.21.15.32:0/2428644762 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f109800f2e0 con 0x7f10a80ff150 2024-05-06T21:35:12.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.223+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a819d710 con 0x7f10a80ff150 2024-05-06T21:35:12.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.223+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a819dc60 con 0x7f10a80ff150 2024-05-06T21:35:12.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.224+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a8068ab0 con 0x7f10a80ff150 2024-05-06T21:35:12.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.225+0000 7f10a5ffb700 1 -- 172.21.15.32:0/2428644762 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1098010380 con 0x7f10a80ff150 2024-05-06T21:35:12.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.225+0000 7f10a5ffb700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f109006e200 0x7f10900706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:12.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.225+0000 7f10a5ffb700 1 -- 172.21.15.32:0/2428644762 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f109808df30 con 0x7f10a80ff150 2024-05-06T21:35:12.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.225+0000 7f10a7fff700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f109006e200 0x7f10900706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:12.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.226+0000 7f10a7fff700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f109006e200 0x7f10900706b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f109c006010 tx=0x7f109c00b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:12.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.230+0000 7f10a5ffb700 1 -- 172.21.15.32:0/2428644762 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f10980c2740 con 0x7f10a80ff150 2024-05-06T21:35:12.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.462+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10a80694e0 con 0x7f109006e200 2024-05-06T21:35:12.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.463+0000 7f10a5ffb700 1 -- 172.21.15.32:0/2428644762 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f10a80694e0 con 0x7f109006e200 2024-05-06T21:35:12.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f109006e200 msgr2=0x7f10900706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f109006e200 0x7f10900706b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f109c006010 tx=0x7f109c00b580 comp rx=0 tx=0).stop 2024-05-06T21:35:12.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a80ff150 msgr2=0x7f10a8197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a80ff150 0x7f10a8197fc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f109800b4b0 tx=0x7f109800b870 comp rx=0 tx=0).stop 2024-05-06T21:35:12.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 shutdown_connections 2024-05-06T21:35:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f109006e200 0x7f10900706b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a80ff150 0x7f10a8197fc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 --2- 172.21.15.32:0/2428644762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a81003f0 0x7f10a8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 >> 172.21.15.32:0/2428644762 conn(0x7f10a80fa7a0 msgr2=0x7f10a8068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 shutdown_connections 2024-05-06T21:35:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.466+0000 7f10aefbf700 1 -- 172.21.15.32:0/2428644762 wait complete. 2024-05-06T21:35:12.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.582+0000 7f9f42365700 1 -- 172.21.15.32:0/1602650433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c101450 msgr2=0x7f9f3c1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.582+0000 7f9f42365700 1 --2- 172.21.15.32:0/1602650433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c101450 0x7f9f3c1018a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009910 tx=0x7f9f24009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:12.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.582+0000 7f9f42365700 1 -- 172.21.15.32:0/1602650433 shutdown_connections 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.582+0000 7f9f42365700 1 --2- 172.21.15.32:0/1602650433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c101450 0x7f9f3c1018a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.582+0000 7f9f42365700 1 --2- 172.21.15.32:0/1602650433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c100250 0x7f9f3c100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.582+0000 7f9f42365700 1 -- 172.21.15.32:0/1602650433 >> 172.21.15.32:0/1602650433 conn(0x7f9f3c0fb7e0 msgr2=0x7f9f3c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.582+0000 7f9f42365700 1 -- 172.21.15.32:0/1602650433 shutdown_connections 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.582+0000 7f9f42365700 1 -- 172.21.15.32:0/1602650433 wait complete. 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.583+0000 7f9f42365700 1 Processor -- start 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.583+0000 7f9f42365700 1 -- start start 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.583+0000 7f9f42365700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c100250 0x7f9f3c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.583+0000 7f9f42365700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c101450 0x7f9f3c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.583+0000 7f9f42365700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c073680 con 0x7f9f3c100250 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.583+0000 7f9f42365700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0737c0 con 0x7f9f3c101450 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.583+0000 7f9f3bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c100250 0x7f9f3c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:12.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.583+0000 7f9f3bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c100250 0x7f9f3c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43980/0 (socket says 172.21.15.32:43980) 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.583+0000 7f9f3bfff700 1 -- 172.21.15.32:0/2227733381 learned_addr learned my addr 172.21.15.32:0/2227733381 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f33fff700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c101450 0x7f9f3c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f3bfff700 1 -- 172.21.15.32:0/2227733381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c101450 msgr2=0x7f9f3c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f3bfff700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c101450 0x7f9f3c073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f3bfff700 1 -- 172.21.15.32:0/2227733381 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240095f0 con 0x7f9f3c100250 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f33fff700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c101450 0x7f9f3c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f3bfff700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c100250 0x7f9f3c074af0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00d900 tx=0x7f9f2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f39ffb700 1 -- 172.21.15.32:0/2227733381 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f2c0041f0 con 0x7f9f3c100250 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c073aa0 con 0x7f9f3c100250 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f39ffb700 1 -- 172.21.15.32:0/2227733381 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9f2c004350 con 0x7f9f3c100250 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f39ffb700 1 -- 172.21.15.32:0/2227733381 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f2c003da0 con 0x7f9f3c100250 2024-05-06T21:35:12.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.584+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c19db00 con 0x7f9f3c100250 2024-05-06T21:35:12.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.585+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c108da0 con 0x7f9f3c100250 2024-05-06T21:35:12.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.586+0000 7f9f39ffb700 1 -- 172.21.15.32:0/2227733381 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9f2c009730 con 0x7f9f3c100250 2024-05-06T21:35:12.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.586+0000 7f9f39ffb700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9f2806e200 0x7f9f280706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:12.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.586+0000 7f9f39ffb700 1 -- 172.21.15.32:0/2227733381 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f9f2c08e260 con 0x7f9f3c100250 2024-05-06T21:35:12.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.586+0000 7f9f33fff700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9f2806e200 0x7f9f280706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:12.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.587+0000 7f9f33fff700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9f2806e200 0x7f9f280706b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f24005b40 tx=0x7f9f24005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:12.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.591+0000 7f9f39ffb700 1 -- 172.21.15.32:0/2227733381 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9f2c05af10 con 0x7f9f3c100250 2024-05-06T21:35:12.682 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:12.682 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:12.682 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:12 smithi032 ceph-mon[76650]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:12.683 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:12.683 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:12 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:12.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.817+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f3c105da0 con 0x7f9f2806e200 2024-05-06T21:35:12.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.828+0000 7f9f39ffb700 1 -- 172.21.15.32:0/2227733381 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9f3c105da0 con 0x7f9f2806e200 2024-05-06T21:35:12.824 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (15m) 2s ago 16m 24.4M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (13s) 2s ago 17m 7365k - 19.0.0-2497-gf273489c 3b8ac54a9a71 e2228993e952 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (7s) 4s ago 16m 6945k - 19.0.0-2497-gf273489c 3b8ac54a9a71 dba77ef37133 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (5m) 2s ago 17m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (5m) 4s ago 16m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (15m) 2s ago 16m 86.1M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (88s) 2s ago 11m 70.2M - 19.0.0-2497-gf273489c 3b8ac54a9a71 6cd9ab5eb234 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (65s) 2s ago 11m 18.9M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5c54ca7e9a32 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (47s) 4s ago 11m 13.6M - 19.0.0-2497-gf273489c 3b8ac54a9a71 df23e8b47eff 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (27s) 4s ago 11m 15.9M - 19.0.0-2497-gf273489c 3b8ac54a9a71 12b4c06cf5bc 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (8m) 2s ago 18m 510M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (7m) 4s ago 15m 452M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (7m) 2s ago 18m 53.9M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:35:12.825 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (6m) 4s ago 15m 44.4M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:35:12.826 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (17m) 2s ago 17m 16.2M - 1.5.0 0da6a335fe13 dc398b95e59b 2024-05-06T21:35:12.826 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (15m) 4s ago 15m 16.7M - 1.5.0 0da6a335fe13 84eb51969e26 2024-05-06T21:35:12.826 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (5m) 2s ago 15m 167M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:35:12.826 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (4m) 2s ago 14m 125M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:35:12.826 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (4m) 2s ago 14m 101M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:35:12.826 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (3m) 4s ago 13m 106M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:35:12.826 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (3m) 4s ago 13m 104M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:35:12.826 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (2m) 4s ago 12m 100M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 8b513e97a420 2024-05-06T21:35:12.826 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (7m) 2s ago 16m 71.4M - 2.43.0 a07b618ecd1d c76404153109 2024-05-06T21:35:12.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9f2806e200 msgr2=0x7f9f280706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9f2806e200 0x7f9f280706b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f24005b40 tx=0x7f9f24005a90 comp rx=0 tx=0).stop 2024-05-06T21:35:12.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c100250 msgr2=0x7f9f3c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c100250 0x7f9f3c074af0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00d900 tx=0x7f9f2c00dcc0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 shutdown_connections 2024-05-06T21:35:12.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9f2806e200 0x7f9f280706b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3c100250 0x7f9f3c074af0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 --2- 172.21.15.32:0/2227733381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c101450 0x7f9f3c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 >> 172.21.15.32:0/2227733381 conn(0x7f9f3c0fb7e0 msgr2=0x7f9f3c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:12.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 shutdown_connections 2024-05-06T21:35:12.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.831+0000 7f9f42365700 1 -- 172.21.15.32:0/2227733381 wait complete. 2024-05-06T21:35:12.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:12.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:12.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:12 smithi154 ceph-mon[63622]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:12.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:12.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:12 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:12.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.939+0000 7f23c2c17700 1 -- 172.21.15.32:0/1706575423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 msgr2=0x7f23bc101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.939+0000 7f23c2c17700 1 --2- 172.21.15.32:0/1706575423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 0x7f23bc101890 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009910 tx=0x7f23ac009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:12.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.939+0000 7f23c2c17700 1 -- 172.21.15.32:0/1706575423 shutdown_connections 2024-05-06T21:35:12.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.939+0000 7f23c2c17700 1 --2- 172.21.15.32:0/1706575423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 0x7f23bc101890 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.939+0000 7f23c2c17700 1 --2- 172.21.15.32:0/1706575423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc100240 0x7f23bc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.939+0000 7f23c2c17700 1 -- 172.21.15.32:0/1706575423 >> 172.21.15.32:0/1706575423 conn(0x7f23bc0fb7f0 msgr2=0x7f23bc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:12.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.940+0000 7f23c2c17700 1 -- 172.21.15.32:0/1706575423 shutdown_connections 2024-05-06T21:35:12.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.940+0000 7f23c2c17700 1 -- 172.21.15.32:0/1706575423 wait complete. 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23c2c17700 1 Processor -- start 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23c2c17700 1 -- start start 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23c2c17700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc100240 0x7f23bc195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23c2c17700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 0x7f23bc1960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23c2c17700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc1966e0 con 0x7f23bc101440 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23c2c17700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc196820 con 0x7f23bc100240 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 0x7f23bc1960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 0x7f23bc1960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44000/0 (socket says 172.21.15.32:44000) 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23b3fff700 1 -- 172.21.15.32:0/1792782657 learned_addr learned my addr 172.21.15.32:0/1792782657 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23c09b3700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc100240 0x7f23bc195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:12.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23b3fff700 1 -- 172.21.15.32:0/1792782657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc100240 msgr2=0x7f23bc195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:12.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23b3fff700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc100240 0x7f23bc195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:12.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23b3fff700 1 -- 172.21.15.32:0/1792782657 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0095f0 con 0x7f23bc101440 2024-05-06T21:35:12.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.941+0000 7f23c09b3700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc100240 0x7f23bc195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:35:12.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.942+0000 7f23b3fff700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 0x7f23bc1960c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f23ac006010 tx=0x7f23ac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:12.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.942+0000 7f23b1ffb700 1 -- 172.21.15.32:0/1792782657 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23ac01d070 con 0x7f23bc101440 2024-05-06T21:35:12.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.942+0000 7f23b1ffb700 1 -- 172.21.15.32:0/1792782657 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23ac00f460 con 0x7f23bc101440 2024-05-06T21:35:12.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.942+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc19b270 con 0x7f23bc101440 2024-05-06T21:35:12.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.942+0000 7f23b1ffb700 1 -- 172.21.15.32:0/1792782657 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23ac021640 con 0x7f23bc101440 2024-05-06T21:35:12.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.942+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc19b760 con 0x7f23bc101440 2024-05-06T21:35:12.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.943+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc108e30 con 0x7f23bc101440 2024-05-06T21:35:12.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.944+0000 7f23b1ffb700 1 -- 172.21.15.32:0/1792782657 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f23ac00fab0 con 0x7f23bc101440 2024-05-06T21:35:12.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.944+0000 7f23b1ffb700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a406e200 0x7f23a40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:12.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.944+0000 7f23b1ffb700 1 -- 172.21.15.32:0/1792782657 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f23ac08f800 con 0x7f23bc101440 2024-05-06T21:35:12.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.944+0000 7f23c09b3700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a406e200 0x7f23a40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:12.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.945+0000 7f23c09b3700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a406e200 0x7f23a40706b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23bc1012a0 tx=0x7f23b8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:12.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:12.949+0000 7f23b1ffb700 1 -- 172.21.15.32:0/1792782657 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f23ac05c4b0 con 0x7f23bc101440 2024-05-06T21:35:13.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.251+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f23bc108ff0 con 0x7f23bc101440 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.252+0000 7f23b1ffb700 1 -- 172.21.15.32:0/1792782657 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f23ac05c040 con 0x7f23bc101440 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:35:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:35:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 4 2024-05-06T21:35:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:35:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:35:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 14 2024-05-06T21:35:13.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:35:13.249 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:35:13.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a406e200 msgr2=0x7f23a40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:13.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a406e200 0x7f23a40706b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23bc1012a0 tx=0x7f23b8008040 comp rx=0 tx=0).stop 2024-05-06T21:35:13.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 msgr2=0x7f23bc1960c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:13.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 0x7f23bc1960c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f23ac006010 tx=0x7f23ac00be20 comp rx=0 tx=0).stop 2024-05-06T21:35:13.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 shutdown_connections 2024-05-06T21:35:13.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a406e200 0x7f23a40706b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc100240 0x7f23bc195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 --2- 172.21.15.32:0/1792782657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc101440 0x7f23bc1960c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 >> 172.21.15.32:0/1792782657 conn(0x7f23bc0fb7f0 msgr2=0x7f23bc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:13.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 shutdown_connections 2024-05-06T21:35:13.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.254+0000 7f23c2c17700 1 -- 172.21.15.32:0/1792782657 wait complete. 2024-05-06T21:35:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.363+0000 7f23813b4700 1 -- 172.21.15.32:0/1502407317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 msgr2=0x7f237c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.363+0000 7f23813b4700 1 --2- 172.21.15.32:0/1502407317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 0x7f237c101890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2364009910 tx=0x7f2364009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.363+0000 7f23813b4700 1 -- 172.21.15.32:0/1502407317 shutdown_connections 2024-05-06T21:35:13.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.363+0000 7f23813b4700 1 --2- 172.21.15.32:0/1502407317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 0x7f237c101890 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.363+0000 7f23813b4700 1 --2- 172.21.15.32:0/1502407317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f237c100240 0x7f237c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.363+0000 7f23813b4700 1 -- 172.21.15.32:0/1502407317 >> 172.21.15.32:0/1502407317 conn(0x7f237c0fb7f0 msgr2=0x7f237c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:13.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.363+0000 7f23813b4700 1 -- 172.21.15.32:0/1502407317 shutdown_connections 2024-05-06T21:35:13.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.363+0000 7f23813b4700 1 -- 172.21.15.32:0/1502407317 wait complete. 2024-05-06T21:35:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.364+0000 7f23813b4700 1 Processor -- start 2024-05-06T21:35:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.364+0000 7f23813b4700 1 -- start start 2024-05-06T21:35:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.364+0000 7f23813b4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f237c100240 0x7f237c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.364+0000 7f23813b4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 0x7f237c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.364+0000 7f23813b4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c073680 con 0x7f237c101440 2024-05-06T21:35:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.364+0000 7f23813b4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c0737c0 con 0x7f237c100240 2024-05-06T21:35:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.364+0000 7f236a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 0x7f237c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f236a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 0x7f237c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44018/0 (socket says 172.21.15.32:44018) 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f236a7fc700 1 -- 172.21.15.32:0/2162711957 learned_addr learned my addr 172.21.15.32:0/2162711957 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f237affd700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f237c100240 0x7f237c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f236a7fc700 1 -- 172.21.15.32:0/2162711957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f237c100240 msgr2=0x7f237c074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f236a7fc700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f237c100240 0x7f237c074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f236a7fc700 1 -- 172.21.15.32:0/2162711957 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640095f0 con 0x7f237c101440 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f237affd700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f237c100240 0x7f237c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f236a7fc700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 0x7f237c073140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2364006010 tx=0x7f236400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f2378ff9700 1 -- 172.21.15.32:0/2162711957 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f236401d070 con 0x7f237c101440 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f2378ff9700 1 -- 172.21.15.32:0/2162711957 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f236400f460 con 0x7f237c101440 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f2378ff9700 1 -- 172.21.15.32:0/2162711957 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2364021640 con 0x7f237c101440 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c073a40 con 0x7f237c101440 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.365+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c073ee0 con 0x7f237c101440 2024-05-06T21:35:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.366+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c108d90 con 0x7f237c101440 2024-05-06T21:35:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.367+0000 7f2378ff9700 1 -- 172.21.15.32:0/2162711957 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f236400fab0 con 0x7f237c101440 2024-05-06T21:35:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.367+0000 7f2378ff9700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f235c06e200 0x7f235c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.368+0000 7f2378ff9700 1 -- 172.21.15.32:0/2162711957 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f236408f6d0 con 0x7f237c101440 2024-05-06T21:35:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.368+0000 7f237affd700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f235c06e200 0x7f235c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.368+0000 7f237affd700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f235c06e200 0x7f235c0706b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f237c1012a0 tx=0x7f236c0076a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:13.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.372+0000 7f2378ff9700 1 -- 172.21.15.32:0/2162711957 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f236405c400 con 0x7f237c101440 2024-05-06T21:35:13.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.671+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f237c19e1d0 con 0x7f237c101440 2024-05-06T21:35:13.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.672+0000 7f2378ff9700 1 -- 172.21.15.32:0/2162711957 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1951 (secure 0 0 0) 0x7f236405bf90 con 0x7f237c101440 2024-05-06T21:35:13.668 INFO:teuthology.orchestra.run.smithi032.stdout:e44 2024-05-06T21:35:13.668 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 44 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:34:55.428791+0000 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:35:13.669 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 95 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=34432,1=34452} 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:35:13.670 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 34432 members: 34432,34452 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{0:34432} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{1:34452} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6824/171743146,v1:172.21.15.154:6825/171743146] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:35:13.671 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:44353} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6826/3609095923,v1:172.21.15.154:6827/3609095923] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:35:13.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f235c06e200 msgr2=0x7f235c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:13.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f235c06e200 0x7f235c0706b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f237c1012a0 tx=0x7f236c0076a0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 msgr2=0x7f237c073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:13.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 0x7f237c073140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2364006010 tx=0x7f236400be20 comp rx=0 tx=0).stop 2024-05-06T21:35:13.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 shutdown_connections 2024-05-06T21:35:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f235c06e200 0x7f235c0706b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f237c100240 0x7f237c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 --2- 172.21.15.32:0/2162711957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f237c101440 0x7f237c073140 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 >> 172.21.15.32:0/2162711957 conn(0x7f237c0fb7f0 msgr2=0x7f237c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 shutdown_connections 2024-05-06T21:35:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.674+0000 7f23813b4700 1 -- 172.21.15.32:0/2162711957 wait complete. 2024-05-06T21:35:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 44 2024-05-06T21:35:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.788+0000 7fd0835ac700 1 -- 172.21.15.32:0/358891491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 msgr2=0x7fd07c0ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.788+0000 7fd0835ac700 1 --2- 172.21.15.32:0/358891491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 0x7fd07c0ff550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00b0a0 tx=0x7fd06c00b3b0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.788+0000 7fd0835ac700 1 -- 172.21.15.32:0/358891491 shutdown_connections 2024-05-06T21:35:13.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.788+0000 7fd0835ac700 1 --2- 172.21.15.32:0/358891491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd07c100340 0x7fd07c100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.788+0000 7fd0835ac700 1 --2- 172.21.15.32:0/358891491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 0x7fd07c0ff550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.788+0000 7fd0835ac700 1 -- 172.21.15.32:0/358891491 >> 172.21.15.32:0/358891491 conn(0x7fd07c0fa6d0 msgr2=0x7fd07c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:13.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.788+0000 7fd0835ac700 1 -- 172.21.15.32:0/358891491 shutdown_connections 2024-05-06T21:35:13.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.788+0000 7fd0835ac700 1 -- 172.21.15.32:0/358891491 wait complete. 2024-05-06T21:35:13.785 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:13 smithi032 ceph-mon[76650]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:13.785 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:13 smithi032 ceph-mon[76650]: pgmap v254: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T21:35:13.785 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:13 smithi032 ceph-mon[76650]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:13.786 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:13 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1792782657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.789+0000 7fd0835ac700 1 Processor -- start 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.789+0000 7fd0835ac700 1 -- start start 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.789+0000 7fd0835ac700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 0x7fd07c1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.789+0000 7fd0835ac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd07c100340 0x7fd07c101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.789+0000 7fd0835ac700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c101c60 con 0x7fd07c0ff140 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.789+0000 7fd0835ac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c101da0 con 0x7fd07c100340 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.790+0000 7fd081348700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 0x7fd07c1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.790+0000 7fd081348700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 0x7fd07c1030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44042/0 (socket says 172.21.15.32:44042) 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.790+0000 7fd080b47700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd07c100340 0x7fd07c101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.790+0000 7fd081348700 1 -- 172.21.15.32:0/1958686041 learned_addr learned my addr 172.21.15.32:0/1958686041 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:13.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.790+0000 7fd081348700 1 -- 172.21.15.32:0/1958686041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd07c100340 msgr2=0x7fd07c101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:13.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.790+0000 7fd081348700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd07c100340 0x7fd07c101720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:13.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.790+0000 7fd081348700 1 -- 172.21.15.32:0/1958686041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c009d00 con 0x7fd07c0ff140 2024-05-06T21:35:13.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.790+0000 7fd081348700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 0x7fd07c1030d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0077b0 tx=0x7fd06c009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:13.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.791+0000 7fd07a7fc700 1 -- 172.21.15.32:0/1958686041 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06c00e040 con 0x7fd07c0ff140 2024-05-06T21:35:13.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.791+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07c102020 con 0x7fd07c0ff140 2024-05-06T21:35:13.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.791+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07c102510 con 0x7fd07c0ff140 2024-05-06T21:35:13.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.791+0000 7fd07a7fc700 1 -- 172.21.15.32:0/1958686041 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd06c003de0 con 0x7fd07c0ff140 2024-05-06T21:35:13.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.791+0000 7fd07a7fc700 1 -- 172.21.15.32:0/1958686041 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06c01d7f0 con 0x7fd07c0ff140 2024-05-06T21:35:13.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.792+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd068005320 con 0x7fd07c0ff140 2024-05-06T21:35:13.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.793+0000 7fd07a7fc700 1 -- 172.21.15.32:0/1958686041 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd06c01da30 con 0x7fd07c0ff140 2024-05-06T21:35:13.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.793+0000 7fd07a7fc700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd06406e200 0x7fd0640706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:13.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.793+0000 7fd07a7fc700 1 -- 172.21.15.32:0/1958686041 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fd06c08fcc0 con 0x7fd07c0ff140 2024-05-06T21:35:13.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.794+0000 7fd080b47700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd06406e200 0x7fd0640706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.794+0000 7fd080b47700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd06406e200 0x7fd0640706b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd070005950 tx=0x7fd07000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:13.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:13.799+0000 7fd07a7fc700 1 -- 172.21.15.32:0/1958686041 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd06c05c970 con 0x7fd07c0ff140 2024-05-06T21:35:13.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:13 smithi154 ceph-mon[63622]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:13.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:13 smithi154 ceph-mon[63622]: pgmap v254: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-06T21:35:13.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:13 smithi154 ceph-mon[63622]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:13.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:13 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1792782657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:14.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.036+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd068000bf0 con 0x7fd06406e200 2024-05-06T21:35:14.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.037+0000 7fd07a7fc700 1 -- 172.21.15.32:0/1958686041 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fd068000bf0 con 0x7fd06406e200 2024-05-06T21:35:14.033 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:35:14.033 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:35:14.033 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:35:14.033 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:35:14.033 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:35:14.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds", 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd", 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph-exporter", 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "18/23 daemons upgraded", 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:35:14.034 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:35:14.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.039+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd06406e200 msgr2=0x7fd0640706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.039+0000 7fd0835ac700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd06406e200 0x7fd0640706b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd070005950 tx=0x7fd07000b410 comp rx=0 tx=0).stop 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.039+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 msgr2=0x7fd07c1030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.039+0000 7fd0835ac700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 0x7fd07c1030d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0077b0 tx=0x7fd06c009760 comp rx=0 tx=0).stop 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.040+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 shutdown_connections 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.040+0000 7fd0835ac700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd06406e200 0x7fd0640706b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.040+0000 7fd0835ac700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd07c0ff140 0x7fd07c1030d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.040+0000 7fd0835ac700 1 --2- 172.21.15.32:0/1958686041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd07c100340 0x7fd07c101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.040+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 >> 172.21.15.32:0/1958686041 conn(0x7fd07c0fa6d0 msgr2=0x7fd07c068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.040+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 shutdown_connections 2024-05-06T21:35:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.040+0000 7fd0835ac700 1 -- 172.21.15.32:0/1958686041 wait complete. 2024-05-06T21:35:14.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.151+0000 7fb51ba25700 1 -- 172.21.15.32:0/98715098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140ff4a0 msgr2=0x7fb5140ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:14.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.151+0000 7fb51ba25700 1 --2- 172.21.15.32:0/98715098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140ff4a0 0x7fb5140ff910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb504009910 tx=0x7fb504009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:14.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.151+0000 7fb51ba25700 1 -- 172.21.15.32:0/98715098 shutdown_connections 2024-05-06T21:35:14.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.151+0000 7fb51ba25700 1 --2- 172.21.15.32:0/98715098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140ff4a0 0x7fb5140ff910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.151+0000 7fb51ba25700 1 --2- 172.21.15.32:0/98715098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5140feb50 0x7fb5140fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.151+0000 7fb51ba25700 1 -- 172.21.15.32:0/98715098 >> 172.21.15.32:0/98715098 conn(0x7fb5140fa780 msgr2=0x7fb5140fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:14.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.151+0000 7fb51ba25700 1 -- 172.21.15.32:0/98715098 shutdown_connections 2024-05-06T21:35:14.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.151+0000 7fb51ba25700 1 -- 172.21.15.32:0/98715098 wait complete. 2024-05-06T21:35:14.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.151+0000 7fb51ba25700 1 Processor -- start 2024-05-06T21:35:14.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb51ba25700 1 -- start start 2024-05-06T21:35:14.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb51ba25700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140feb50 0x7fb514197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:14.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb51ba25700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5140ff4a0 0x7fb514198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:14.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb51ba25700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514198840 con 0x7fb5140feb50 2024-05-06T21:35:14.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb51ba25700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51419d250 con 0x7fb5140ff4a0 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb5197c1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140feb50 0x7fb514197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb5197c1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140feb50 0x7fb514197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44054/0 (socket says 172.21.15.32:44054) 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb5197c1700 1 -- 172.21.15.32:0/1924515474 learned_addr learned my addr 172.21.15.32:0/1924515474 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb518fc0700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5140ff4a0 0x7fb514198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb5197c1700 1 -- 172.21.15.32:0/1924515474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5140ff4a0 msgr2=0x7fb514198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb5197c1700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5140ff4a0 0x7fb514198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb5197c1700 1 -- 172.21.15.32:0/1924515474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040095f0 con 0x7fb5140feb50 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb518fc0700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5140ff4a0 0x7fb514198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.152+0000 7fb5197c1700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140feb50 0x7fb514197ce0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb51000d900 tx=0x7fb51000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.153+0000 7fb50a7fc700 1 -- 172.21.15.32:0/1924515474 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5100041f0 con 0x7fb5140feb50 2024-05-06T21:35:14.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.153+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51419d450 con 0x7fb5140feb50 2024-05-06T21:35:14.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.153+0000 7fb50a7fc700 1 -- 172.21.15.32:0/1924515474 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb510004350 con 0x7fb5140feb50 2024-05-06T21:35:14.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.153+0000 7fb50a7fc700 1 -- 172.21.15.32:0/1924515474 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb510003da0 con 0x7fb5140feb50 2024-05-06T21:35:14.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.153+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51419d970 con 0x7fb5140feb50 2024-05-06T21:35:14.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.154+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51410aef0 con 0x7fb5140feb50 2024-05-06T21:35:14.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.154+0000 7fb50a7fc700 1 -- 172.21.15.32:0/1924515474 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb510009730 con 0x7fb5140feb50 2024-05-06T21:35:14.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.155+0000 7fb50a7fc700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb50006e200 0x7fb5000706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:14.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.155+0000 7fb50a7fc700 1 -- 172.21.15.32:0/1924515474 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fb51008e440 con 0x7fb5140feb50 2024-05-06T21:35:14.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.155+0000 7fb518fc0700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb50006e200 0x7fb5000706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:14.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.155+0000 7fb518fc0700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb50006e200 0x7fb5000706b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb504005b40 tx=0x7fb504005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:14.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.159+0000 7fb50a7fc700 1 -- 172.21.15.32:0/1924515474 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb5100575c0 con 0x7fb5140feb50 2024-05-06T21:35:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.472+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb51410b0b0 con 0x7fb5140feb50 2024-05-06T21:35:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.472+0000 7fb50a7fc700 1 -- 172.21.15.32:0/1924515474 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb51005ac80 con 0x7fb5140feb50 2024-05-06T21:35:14.468 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb50006e200 msgr2=0x7fb5000706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb50006e200 0x7fb5000706b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb504005b40 tx=0x7fb504005a90 comp rx=0 tx=0).stop 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140feb50 msgr2=0x7fb514197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140feb50 0x7fb514197ce0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb51000d900 tx=0x7fb51000dcc0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 shutdown_connections 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb50006e200 0x7fb5000706b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5140feb50 0x7fb514197ce0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 --2- 172.21.15.32:0/1924515474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5140ff4a0 0x7fb514198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 >> 172.21.15.32:0/1924515474 conn(0x7fb5140fa780 msgr2=0x7fb514107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 shutdown_connections 2024-05-06T21:35:14.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:14.475+0000 7fb51ba25700 1 -- 172.21.15.32:0/1924515474 wait complete. 2024-05-06T21:35:14.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:14 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2162711957' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:35:14.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:14 smithi032 ceph-mon[76650]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:14.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:14 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1924515474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:35:14.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:14 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2162711957' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:35:14.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:14 smithi154 ceph-mon[63622]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:14.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:14 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1924515474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:35:15.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:15 smithi154 ceph-mon[63622]: pgmap v255: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:15.968 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:15 smithi032 ceph-mon[76650]: pgmap v255: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:16.652 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.652 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.653 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all ceph-exporter 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi032"}]: dispatch 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi032"}]': finished 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi154"}]: dispatch 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi154"}]': finished 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all iscsi 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all nfs 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.654 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.655 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: Upgrade: Setting container_image for all nvmeof 2024-05-06T21:35:16.655 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:16 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all ceph-exporter 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi032"}]: dispatch 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi032"}]': finished 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi154"}]: dispatch 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi154"}]': finished 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all iscsi 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all nfs 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:16.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:16.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: Upgrade: Setting container_image for all nvmeof 2024-05-06T21:35:16.866 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:16 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:17.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:17 smithi032 ceph-mon[76650]: pgmap v256: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:17.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:17 smithi154 ceph-mon[63622]: pgmap v256: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:18.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:18 smithi154 ceph-mon[63622]: Upgrade: Updating node-exporter.smithi032 (1/2) 2024-05-06T21:35:18.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:18 smithi154 ceph-mon[63622]: Deploying daemon node-exporter.smithi032 on smithi032 2024-05-06T21:35:18.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:18 smithi032 ceph-mon[76650]: Upgrade: Updating node-exporter.smithi032 (1/2) 2024-05-06T21:35:18.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:18 smithi032 ceph-mon[76650]: Deploying daemon node-exporter.smithi032 on smithi032 2024-05-06T21:35:19.622 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:19 smithi032 ceph-mon[76650]: pgmap v257: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:19.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:19 smithi154 ceph-mon[63622]: pgmap v257: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:21.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:21.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:21.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:35:21.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:21 smithi154 ceph-mon[63622]: pgmap v258: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:21.693 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:21.693 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:21.693 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:35:21.693 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:21 smithi032 ceph-mon[76650]: pgmap v258: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:22.676 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:22 smithi032 ceph-mon[76650]: Upgrade: Updating node-exporter.smithi154 (2/2) 2024-05-06T21:35:22.677 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:22 smithi032 ceph-mon[76650]: Deploying daemon node-exporter.smithi154 on smithi154 2024-05-06T21:35:22.810 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:22 smithi154 ceph-mon[63622]: Upgrade: Updating node-exporter.smithi154 (2/2) 2024-05-06T21:35:22.810 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:22 smithi154 ceph-mon[63622]: Deploying daemon node-exporter.smithi154 on smithi154 2024-05-06T21:35:23.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:23 smithi154 ceph-mon[63622]: pgmap v259: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:23.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:23 smithi032 ceph-mon[76650]: pgmap v259: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:25.683 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:25 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:25.684 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:25 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:25.684 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:25 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:25.684 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:25 smithi032 ceph-mon[76650]: pgmap v260: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:25.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:25 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:25.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:25 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:25.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:25 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:25.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:25 smithi154 ceph-mon[63622]: pgmap v260: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:28.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:27 smithi154 ceph-mon[63622]: pgmap v261: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:28.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:27 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:28.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:27 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:28.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:27 smithi032 ceph-mon[76650]: pgmap v261: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:28.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:27 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:28.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:27 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:29.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:29.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:29.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:29.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:30.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:30 smithi154 ceph-mon[63622]: pgmap v262: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:30.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:30 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:30.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:30 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:30.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:30 smithi032 ceph-mon[76650]: pgmap v262: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:30.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:30 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:30.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:30 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:31.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:31.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:31.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:31 smithi154 ceph-mon[63622]: pgmap v263: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:31.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:31.865 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:31 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:31.968 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:31.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:31.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:31 smithi032 ceph-mon[76650]: pgmap v263: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:31.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:31.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:31 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:34.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:33 smithi154 ceph-mon[63622]: pgmap v264: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:34.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:33 smithi032 ceph-mon[76650]: pgmap v264: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.400 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.401 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:35 smithi032 ceph-mon[76650]: pgmap v265: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:35.804 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:35.804 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:35.804 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.805 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.806 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.806 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.806 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:35.806 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:35 smithi154 ceph-mon[63622]: pgmap v265: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:36.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:35:36.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:36 smithi032 ceph-mon[76650]: Upgrade: Updating prometheus.smithi032 2024-05-06T21:35:36.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:35:36.864 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:36 smithi154 ceph-mon[63622]: Upgrade: Updating prometheus.smithi032 2024-05-06T21:35:37.421 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:37 smithi032 ceph-mon[76650]: Deploying daemon prometheus.smithi032 on smithi032 2024-05-06T21:35:37.421 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:37 smithi032 ceph-mon[76650]: pgmap v266: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:37.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:37 smithi154 ceph-mon[63622]: Deploying daemon prometheus.smithi032 on smithi032 2024-05-06T21:35:37.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:37 smithi154 ceph-mon[63622]: pgmap v266: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:40.088 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:39 smithi154 ceph-mon[63622]: pgmap v267: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:40.171 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:39 smithi032 ceph-mon[76650]: pgmap v267: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:42.031 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:41 smithi032 ceph-mon[76650]: pgmap v268: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:42.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:41 smithi154 ceph-mon[63622]: pgmap v268: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:43.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:43 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:43.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:43 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:43.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:43 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:43.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:43 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:43.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:43 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:43.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:43 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:44.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:44 smithi154 ceph-mon[63622]: pgmap v269: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:44.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:44 smithi032 ceph-mon[76650]: pgmap v269: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:44.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.590+0000 7f5cd354c700 1 -- 172.21.15.32:0/2271740850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ccc0ff430 msgr2=0x7f5ccc0ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:44.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.590+0000 7f5cd354c700 1 --2- 172.21.15.32:0/2271740850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ccc0ff430 0x7f5ccc0ff8a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009910 tx=0x7f5cbc009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:44.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.590+0000 7f5cd354c700 1 -- 172.21.15.32:0/2271740850 shutdown_connections 2024-05-06T21:35:44.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.590+0000 7f5cd354c700 1 --2- 172.21.15.32:0/2271740850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ccc0ff430 0x7f5ccc0ff8a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:44.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.590+0000 7f5cd354c700 1 --2- 172.21.15.32:0/2271740850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ccc100730 0x7f5ccc100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:44.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.590+0000 7f5cd354c700 1 -- 172.21.15.32:0/2271740850 >> 172.21.15.32:0/2271740850 conn(0x7f5ccc0f9f10 msgr2=0x7f5ccc0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:44.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.591+0000 7f5cd354c700 1 -- 172.21.15.32:0/2271740850 shutdown_connections 2024-05-06T21:35:44.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.591+0000 7f5cd354c700 1 -- 172.21.15.32:0/2271740850 wait complete. 2024-05-06T21:35:44.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.591+0000 7f5cd354c700 1 Processor -- start 2024-05-06T21:35:44.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.591+0000 7f5cd354c700 1 -- start start 2024-05-06T21:35:44.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd354c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ccc0ff430 0x7f5ccc197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:44.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd354c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ccc100730 0x7f5ccc198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:44.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd354c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc198860 con 0x7f5ccc100730 2024-05-06T21:35:44.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd354c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc19d270 con 0x7f5ccc0ff430 2024-05-06T21:35:44.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd12e8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ccc0ff430 0x7f5ccc197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:44.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd12e8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ccc0ff430 0x7f5ccc197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.32:48972/0 (socket says 172.21.15.32:48972) 2024-05-06T21:35:44.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd12e8700 1 -- 172.21.15.32:0/803667231 learned_addr learned my addr 172.21.15.32:0/803667231 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:44.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd0ae7700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ccc100730 0x7f5ccc198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:44.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd12e8700 1 -- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ccc100730 msgr2=0x7f5ccc198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:44.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd12e8700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ccc100730 0x7f5ccc198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:44.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.592+0000 7f5cd12e8700 1 -- 172.21.15.32:0/803667231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc0095f0 con 0x7f5ccc0ff430 2024-05-06T21:35:44.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.593+0000 7f5cd12e8700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ccc0ff430 0x7f5ccc197d00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800d8d0 tx=0x7f5cc800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:44.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.593+0000 7f5cc27fc700 1 -- 172.21.15.32:0/803667231 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc8009940 con 0x7f5ccc0ff430 2024-05-06T21:35:44.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.593+0000 7f5cc27fc700 1 -- 172.21.15.32:0/803667231 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5cc8010460 con 0x7f5ccc0ff430 2024-05-06T21:35:44.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.593+0000 7f5cc27fc700 1 -- 172.21.15.32:0/803667231 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc800f5f0 con 0x7f5ccc0ff430 2024-05-06T21:35:44.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.593+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc19d470 con 0x7f5ccc0ff430 2024-05-06T21:35:44.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.593+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc19d990 con 0x7f5ccc0ff430 2024-05-06T21:35:44.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.594+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc107bf0 con 0x7f5ccc0ff430 2024-05-06T21:35:44.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.595+0000 7f5cc27fc700 1 -- 172.21.15.32:0/803667231 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5cc80105d0 con 0x7f5ccc0ff430 2024-05-06T21:35:44.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.595+0000 7f5cc27fc700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5cb806e200 0x7f5cb80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:44.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.595+0000 7f5cc27fc700 1 -- 172.21.15.32:0/803667231 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f5cc808e2d0 con 0x7f5ccc0ff430 2024-05-06T21:35:44.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.595+0000 7f5cd0ae7700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5cb806e200 0x7f5cb80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:44.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.596+0000 7f5cd0ae7700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5cb806e200 0x7f5cb80706b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc005b40 tx=0x7f5cbc005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:44.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.600+0000 7f5cc27fc700 1 -- 172.21.15.32:0/803667231 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5cc8057470 con 0x7f5ccc0ff430 2024-05-06T21:35:44.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.836+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ccc0fea30 con 0x7f5cb806e200 2024-05-06T21:35:44.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.838+0000 7f5cc27fc700 1 -- 172.21.15.32:0/803667231 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f5ccc0fea30 con 0x7f5cb806e200 2024-05-06T21:35:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.840+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5cb806e200 msgr2=0x7f5cb80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.840+0000 7f5cd354c700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5cb806e200 0x7f5cb80706b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc005b40 tx=0x7f5cbc005a90 comp rx=0 tx=0).stop 2024-05-06T21:35:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.840+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ccc0ff430 msgr2=0x7f5ccc197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.840+0000 7f5cd354c700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ccc0ff430 0x7f5ccc197d00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800d8d0 tx=0x7f5cc800dc90 comp rx=0 tx=0).stop 2024-05-06T21:35:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.840+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 shutdown_connections 2024-05-06T21:35:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.840+0000 7f5cd354c700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5cb806e200 0x7f5cb80706b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.840+0000 7f5cd354c700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ccc0ff430 0x7f5ccc197d00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.840+0000 7f5cd354c700 1 --2- 172.21.15.32:0/803667231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ccc100730 0x7f5ccc198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.840+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 >> 172.21.15.32:0/803667231 conn(0x7f5ccc0f9f10 msgr2=0x7f5ccc0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.841+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 shutdown_connections 2024-05-06T21:35:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.841+0000 7f5cd354c700 1 -- 172.21.15.32:0/803667231 wait complete. 2024-05-06T21:35:44.846 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:35:44.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.951+0000 7fcfd431d700 1 -- 172.21.15.32:0/2920026956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 msgr2=0x7fcfcc101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:44.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.951+0000 7fcfd431d700 1 --2- 172.21.15.32:0/2920026956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 0x7fcfcc101890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009910 tx=0x7fcfbc009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:44.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 -- 172.21.15.32:0/2920026956 shutdown_connections 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 --2- 172.21.15.32:0/2920026956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 0x7fcfcc101890 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 --2- 172.21.15.32:0/2920026956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc100240 0x7fcfcc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 -- 172.21.15.32:0/2920026956 >> 172.21.15.32:0/2920026956 conn(0x7fcfcc0fb7f0 msgr2=0x7fcfcc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 -- 172.21.15.32:0/2920026956 shutdown_connections 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 -- 172.21.15.32:0/2920026956 wait complete. 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 Processor -- start 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 -- start start 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc100240 0x7fcfcc195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 0x7fcfcc1960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc1966e0 con 0x7fcfcc101440 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.952+0000 7fcfd431d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc196820 con 0x7fcfcc100240 2024-05-06T21:35:44.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfd18b8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 0x7fcfcc1960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfd18b8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 0x7fcfcc1960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42202/0 (socket says 172.21.15.32:42202) 2024-05-06T21:35:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfd18b8700 1 -- 172.21.15.32:0/22608724 learned_addr learned my addr 172.21.15.32:0/22608724 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfd18b8700 1 -- 172.21.15.32:0/22608724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc100240 msgr2=0x7fcfcc195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfd18b8700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc100240 0x7fcfcc195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:44.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfd18b8700 1 -- 172.21.15.32:0/22608724 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc0095f0 con 0x7fcfcc101440 2024-05-06T21:35:44.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfd18b8700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 0x7fcfcc1960c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc006010 tx=0x7fcfbc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:44.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfc37fe700 1 -- 172.21.15.32:0/22608724 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfbc01d070 con 0x7fcfcc101440 2024-05-06T21:35:44.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfc37fe700 1 -- 172.21.15.32:0/22608724 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcfbc00f460 con 0x7fcfcc101440 2024-05-06T21:35:44.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc19b270 con 0x7fcfcc101440 2024-05-06T21:35:44.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfc37fe700 1 -- 172.21.15.32:0/22608724 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfbc021640 con 0x7fcfcc101440 2024-05-06T21:35:44.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.953+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc19b760 con 0x7fcfcc101440 2024-05-06T21:35:44.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.954+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc108e30 con 0x7fcfcc101440 2024-05-06T21:35:44.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.955+0000 7fcfc37fe700 1 -- 172.21.15.32:0/22608724 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcfbc00fab0 con 0x7fcfcc101440 2024-05-06T21:35:44.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.955+0000 7fcfc37fe700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcfb806e200 0x7fcfb80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:44.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.955+0000 7fcfc37fe700 1 -- 172.21.15.32:0/22608724 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fcfbc08f800 con 0x7fcfcc101440 2024-05-06T21:35:44.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.955+0000 7fcfd20b9700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcfb806e200 0x7fcfb80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:44.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.956+0000 7fcfd20b9700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcfb806e200 0x7fcfb80706b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc1012a0 tx=0x7fcfc8006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:44.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:44.960+0000 7fcfc37fe700 1 -- 172.21.15.32:0/22608724 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fcfbc05c4b0 con 0x7fcfcc101440 2024-05-06T21:35:45.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.209+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfcc19be00 con 0x7fcfb806e200 2024-05-06T21:35:45.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.211+0000 7fcfc37fe700 1 -- 172.21.15.32:0/22608724 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7fcfcc19be00 con 0x7fcfb806e200 2024-05-06T21:35:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcfb806e200 msgr2=0x7fcfb80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcfb806e200 0x7fcfb80706b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc1012a0 tx=0x7fcfc8006d20 comp rx=0 tx=0).stop 2024-05-06T21:35:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 msgr2=0x7fcfcc1960c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 0x7fcfcc1960c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc006010 tx=0x7fcfbc00be20 comp rx=0 tx=0).stop 2024-05-06T21:35:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 shutdown_connections 2024-05-06T21:35:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcfb806e200 0x7fcfb80706b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc100240 0x7fcfcc195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 --2- 172.21.15.32:0/22608724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfcc101440 0x7fcfcc1960c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 >> 172.21.15.32:0/22608724 conn(0x7fcfcc0fb7f0 msgr2=0x7fcfcc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:45.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 shutdown_connections 2024-05-06T21:35:45.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.213+0000 7fcfd431d700 1 -- 172.21.15.32:0/22608724 wait complete. 2024-05-06T21:35:45.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.322+0000 7f216ed40700 1 -- 172.21.15.32:0/1540910910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168069270 msgr2=0x7f2168102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:45.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.322+0000 7f216ed40700 1 --2- 172.21.15.32:0/1540910910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168069270 0x7f2168102dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f215c009910 tx=0x7f215c009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.322+0000 7f216ed40700 1 -- 172.21.15.32:0/1540910910 shutdown_connections 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.322+0000 7f216ed40700 1 --2- 172.21.15.32:0/1540910910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2168103310 0x7f2168105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.322+0000 7f216ed40700 1 --2- 172.21.15.32:0/1540910910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168069270 0x7f2168102dd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.322+0000 7f216ed40700 1 -- 172.21.15.32:0/1540910910 >> 172.21.15.32:0/1540910910 conn(0x7f21680fa780 msgr2=0x7f21680fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.322+0000 7f216ed40700 1 -- 172.21.15.32:0/1540910910 shutdown_connections 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.322+0000 7f216ed40700 1 -- 172.21.15.32:0/1540910910 wait complete. 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.322+0000 7f216ed40700 1 Processor -- start 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f216ed40700 1 -- start start 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f216ed40700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2168103310 0x7f2168195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f216ed40700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168196000 0x7f216819b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f216ed40700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168196500 con 0x7f2168196000 2024-05-06T21:35:45.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f216ed40700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168196670 con 0x7f2168103310 2024-05-06T21:35:45.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f2167fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168196000 0x7f216819b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:45.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f2167fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168196000 0x7f216819b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42214/0 (socket says 172.21.15.32:42214) 2024-05-06T21:35:45.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f2167fff700 1 -- 172.21.15.32:0/2294239734 learned_addr learned my addr 172.21.15.32:0/2294239734 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f2167fff700 1 -- 172.21.15.32:0/2294239734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2168103310 msgr2=0x7f2168195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f2167fff700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2168103310 0x7f2168195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f2167fff700 1 -- 172.21.15.32:0/2294239734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c0095f0 con 0x7f2168196000 2024-05-06T21:35:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f2167fff700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168196000 0x7f216819b070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f215400e920 tx=0x7f215400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.323+0000 7f2165ffb700 1 -- 172.21.15.32:0/2294239734 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2154009790 con 0x7f2168196000 2024-05-06T21:35:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.324+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216819b610 con 0x7f2168196000 2024-05-06T21:35:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.324+0000 7f2165ffb700 1 -- 172.21.15.32:0/2294239734 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f215400cba0 con 0x7f2168196000 2024-05-06T21:35:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.324+0000 7f2165ffb700 1 -- 172.21.15.32:0/2294239734 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2154018630 con 0x7f2168196000 2024-05-06T21:35:45.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.324+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216819bb30 con 0x7f2168196000 2024-05-06T21:35:45.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.325+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216818fbd0 con 0x7f2168196000 2024-05-06T21:35:45.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.325+0000 7f2165ffb700 1 -- 172.21.15.32:0/2294239734 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f215400cd10 con 0x7f2168196000 2024-05-06T21:35:45.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.326+0000 7f2165ffb700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f215806e200 0x7f21580706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:45.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.326+0000 7f2165ffb700 1 -- 172.21.15.32:0/2294239734 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f2154014070 con 0x7f2168196000 2024-05-06T21:35:45.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.326+0000 7f216cadc700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f215806e200 0x7f21580706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:45.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.326+0000 7f216cadc700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f215806e200 0x7f21580706b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f215c009fd0 tx=0x7f215c000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.331+0000 7f2165ffb700 1 -- 172.21.15.32:0/2294239734 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2154053740 con 0x7f2168196000 2024-05-06T21:35:45.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.558+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f216802cef0 con 0x7f215806e200 2024-05-06T21:35:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.569+0000 7f2165ffb700 1 -- 172.21.15.32:0/2294239734 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f216802cef0 con 0x7f215806e200 2024-05-06T21:35:45.565 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:35:45.565 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (15m) 16s ago 17m 24.4M - 0.25.0 c8568f914cd2 7b3b4c974e20 2024-05-06T21:35:45.565 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (45s) 16s ago 17m 7918k - 19.0.0-2497-gf273489c 3b8ac54a9a71 e2228993e952 2024-05-06T21:35:45.565 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (40s) 18s ago 16m 7532k - 19.0.0-2497-gf273489c 3b8ac54a9a71 dba77ef37133 2024-05-06T21:35:45.565 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (6m) 16s ago 17m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (6m) 18s ago 16m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (15m) 16s ago 17m 86.4M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (2m) 16s ago 11m 69.9M - 19.0.0-2497-gf273489c 3b8ac54a9a71 6cd9ab5eb234 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (98s) 16s ago 11m 19.2M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5c54ca7e9a32 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (80s) 18s ago 11m 13.7M - 19.0.0-2497-gf273489c 3b8ac54a9a71 df23e8b47eff 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (60s) 18s ago 11m 16.0M - 19.0.0-2497-gf273489c 3b8ac54a9a71 12b4c06cf5bc 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (8m) 16s ago 18m 511M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (7m) 18s ago 16m 452M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (7m) 16s ago 19m 54.9M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (7m) 18s ago 16m 45.6M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (25s) 16s ago 17m 7298k - 1.5.0 0da6a335fe13 2265cff718e2 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (21s) 18s ago 16m 3376k - 1.5.0 0da6a335fe13 4f95bf7624ed 2024-05-06T21:35:45.566 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (5m) 16s ago 15m 167M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:35:45.567 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (5m) 16s ago 15m 125M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:35:45.567 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (4m) 16s ago 14m 102M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:35:45.567 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (4m) 18s ago 14m 105M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:35:45.567 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (3m) 18s ago 13m 103M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:35:45.567 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (3m) 18s ago 13m 99.3M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 8b513e97a420 2024-05-06T21:35:45.567 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 starting - - - - 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f215806e200 msgr2=0x7f21580706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f215806e200 0x7f21580706b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f215c009fd0 tx=0x7f215c000bc0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168196000 msgr2=0x7f216819b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168196000 0x7f216819b070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f215400e920 tx=0x7f215400ece0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 shutdown_connections 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f215806e200 0x7f21580706b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2168103310 0x7f2168195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 --2- 172.21.15.32:0/2294239734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2168196000 0x7f216819b070 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 >> 172.21.15.32:0/2294239734 conn(0x7f21680fa780 msgr2=0x7f21680fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 shutdown_connections 2024-05-06T21:35:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.572+0000 7f216ed40700 1 -- 172.21.15.32:0/2294239734 wait complete. 2024-05-06T21:35:45.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.684+0000 7fe1d1859700 1 -- 172.21.15.32:0/4161147732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 msgr2=0x7fe1cc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:45.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.684+0000 7fe1d1859700 1 --2- 172.21.15.32:0/4161147732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 0x7fe1cc100650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009910 tx=0x7fe1bc009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:45.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.684+0000 7fe1d1859700 1 -- 172.21.15.32:0/4161147732 shutdown_connections 2024-05-06T21:35:45.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.684+0000 7fe1d1859700 1 --2- 172.21.15.32:0/4161147732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1cc1014e0 0x7fe1cc101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.684+0000 7fe1d1859700 1 --2- 172.21.15.32:0/4161147732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 0x7fe1cc100650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.684+0000 7fe1d1859700 1 -- 172.21.15.32:0/4161147732 >> 172.21.15.32:0/4161147732 conn(0x7fe1cc0fb890 msgr2=0x7fe1cc0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:45.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.684+0000 7fe1d1859700 1 -- 172.21.15.32:0/4161147732 shutdown_connections 2024-05-06T21:35:45.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.684+0000 7fe1d1859700 1 -- 172.21.15.32:0/4161147732 wait complete. 2024-05-06T21:35:45.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.685+0000 7fe1d1859700 1 Processor -- start 2024-05-06T21:35:45.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.685+0000 7fe1d1859700 1 -- start start 2024-05-06T21:35:45.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.685+0000 7fe1d1859700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 0x7fe1cc195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:45.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.685+0000 7fe1d1859700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1cc1014e0 0x7fe1cc195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.685+0000 7fe1d1859700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1965f0 con 0x7fe1cc100240 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.685+0000 7fe1d1859700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc196730 con 0x7fe1cc1014e0 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.685+0000 7fe1caffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 0x7fe1cc195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1caffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 0x7fe1cc195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42230/0 (socket says 172.21.15.32:42230) 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1caffd700 1 -- 172.21.15.32:0/441006915 learned_addr learned my addr 172.21.15.32:0/441006915 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1ca7fc700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1cc1014e0 0x7fe1cc195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1caffd700 1 -- 172.21.15.32:0/441006915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1cc1014e0 msgr2=0x7fe1cc195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1caffd700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1cc1014e0 0x7fe1cc195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1caffd700 1 -- 172.21.15.32:0/441006915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc0095f0 con 0x7fe1cc100240 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1caffd700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 0x7fe1cc195a90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc006010 tx=0x7fe1bc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1d0857700 1 -- 172.21.15.32:0/441006915 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1bc01d070 con 0x7fe1cc100240 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1d0857700 1 -- 172.21.15.32:0/441006915 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1bc00f460 con 0x7fe1cc100240 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc19b180 con 0x7fe1cc100240 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc19b670 con 0x7fe1cc100240 2024-05-06T21:35:45.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.686+0000 7fe1d0857700 1 -- 172.21.15.32:0/441006915 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1bc021640 con 0x7fe1cc100240 2024-05-06T21:35:45.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.687+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc108d20 con 0x7fe1cc100240 2024-05-06T21:35:45.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.688+0000 7fe1d0857700 1 -- 172.21.15.32:0/441006915 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe1bc00fab0 con 0x7fe1cc100240 2024-05-06T21:35:45.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.688+0000 7fe1d0857700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe1b806e200 0x7fe1b80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:45.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.689+0000 7fe1d0857700 1 -- 172.21.15.32:0/441006915 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fe1bc08f5a0 con 0x7fe1cc100240 2024-05-06T21:35:45.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.689+0000 7fe1ca7fc700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe1b806e200 0x7fe1b80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:45.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.689+0000 7fe1ca7fc700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe1b806e200 0x7fe1b80706b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4007be0 tx=0x7fe1b40073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:45.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:45.697+0000 7fe1d0857700 1 -- 172.21.15.32:0/441006915 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe1bc05c250 con 0x7fe1cc100240 2024-05-06T21:35:46.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.014+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe1cc19c080 con 0x7fe1cc100240 2024-05-06T21:35:46.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.014+0000 7fe1d0857700 1 -- 172.21.15.32:0/441006915 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fe1bc00f5d0 con 0x7fe1cc100240 2024-05-06T21:35:46.010 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:35:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:35:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:35:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:35:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:35:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:35:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:35:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:35:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:35:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:35:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:35:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 4 2024-05-06T21:35:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:35:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:35:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 14 2024-05-06T21:35:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:35:46.011 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:35:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.016+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe1b806e200 msgr2=0x7fe1b80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.016+0000 7fe1d1859700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe1b806e200 0x7fe1b80706b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4007be0 tx=0x7fe1b40073d0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.016+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 msgr2=0x7fe1cc195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.016+0000 7fe1d1859700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 0x7fe1cc195a90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc006010 tx=0x7fe1bc00bd70 comp rx=0 tx=0).stop 2024-05-06T21:35:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.016+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 shutdown_connections 2024-05-06T21:35:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.016+0000 7fe1d1859700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe1b806e200 0x7fe1b80706b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.016+0000 7fe1d1859700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1cc100240 0x7fe1cc195a90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.016+0000 7fe1d1859700 1 --2- 172.21.15.32:0/441006915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1cc1014e0 0x7fe1cc195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.016+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 >> 172.21.15.32:0/441006915 conn(0x7fe1cc0fb890 msgr2=0x7fe1cc104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.017+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 shutdown_connections 2024-05-06T21:35:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.017+0000 7fe1d1859700 1 -- 172.21.15.32:0/441006915 wait complete. 2024-05-06T21:35:46.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.125+0000 7f60629aa700 1 -- 172.21.15.32:0/1375858476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 msgr2=0x7f605c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.125+0000 7f60629aa700 1 --2- 172.21.15.32:0/1375858476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 0x7f605c100860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6044009910 tx=0x7f6044009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.125+0000 7f60629aa700 1 -- 172.21.15.32:0/1375858476 shutdown_connections 2024-05-06T21:35:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.125+0000 7f60629aa700 1 --2- 172.21.15.32:0/1375858476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 0x7f605c100860 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.125+0000 7f60629aa700 1 --2- 172.21.15.32:0/1375858476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0ff150 0x7f605c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.125+0000 7f60629aa700 1 -- 172.21.15.32:0/1375858476 >> 172.21.15.32:0/1375858476 conn(0x7f605c0fa7a0 msgr2=0x7f605c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.126+0000 7f60629aa700 1 -- 172.21.15.32:0/1375858476 shutdown_connections 2024-05-06T21:35:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.126+0000 7f60629aa700 1 -- 172.21.15.32:0/1375858476 wait complete. 2024-05-06T21:35:46.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.126+0000 7f60629aa700 1 Processor -- start 2024-05-06T21:35:46.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.126+0000 7f60629aa700 1 -- start start 2024-05-06T21:35:46.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.126+0000 7f60629aa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0ff150 0x7f605c195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:46.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.126+0000 7f60629aa700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 0x7f605c196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:46.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.126+0000 7f60629aa700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c196920 con 0x7f605c1003f0 2024-05-06T21:35:46.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.126+0000 7f60629aa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c196a60 con 0x7f605c0ff150 2024-05-06T21:35:46.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.126+0000 7f6053fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 0x7f605c196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:46.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f6053fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 0x7f605c196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42252/0 (socket says 172.21.15.32:42252) 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f6053fff700 1 -- 172.21.15.32:0/1868087453 learned_addr learned my addr 172.21.15.32:0/1868087453 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f605bfff700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0ff150 0x7f605c195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f6053fff700 1 -- 172.21.15.32:0/1868087453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0ff150 msgr2=0x7f605c195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f6053fff700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0ff150 0x7f605c195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f6053fff700 1 -- 172.21.15.32:0/1868087453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60440095f0 con 0x7f605c1003f0 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f6053fff700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 0x7f605c196300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f604400b5c0 tx=0x7f604400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f6059ffb700 1 -- 172.21.15.32:0/1868087453 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604401d070 con 0x7f605c1003f0 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f6059ffb700 1 -- 172.21.15.32:0/1868087453 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f604400f460 con 0x7f605c1003f0 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f6059ffb700 1 -- 172.21.15.32:0/1868087453 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6044021640 con 0x7f605c1003f0 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c19b4b0 con 0x7f605c1003f0 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.127+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c19b9a0 con 0x7f605c1003f0 2024-05-06T21:35:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.128+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c068ab0 con 0x7f605c1003f0 2024-05-06T21:35:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.129+0000 7f6059ffb700 1 -- 172.21.15.32:0/1868087453 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f604400fa60 con 0x7f605c1003f0 2024-05-06T21:35:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.129+0000 7f6059ffb700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f604806e200 0x7f60480706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.130+0000 7f605bfff700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f604806e200 0x7f60480706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.130+0000 7f6059ffb700 1 -- 172.21.15.32:0/1868087453 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f604408f460 con 0x7f605c1003f0 2024-05-06T21:35:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.130+0000 7f605bfff700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f604806e200 0x7f60480706b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f604c004630 tx=0x7f604c00b3c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:46.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.134+0000 7f6059ffb700 1 -- 172.21.15.32:0/1868087453 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f604405c190 con 0x7f605c1003f0 2024-05-06T21:35:46.352 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:46 smithi032 ceph-mon[76650]: pgmap v270: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:46.352 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:46 smithi032 ceph-mon[76650]: from='client.44377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:46.352 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:46 smithi032 ceph-mon[76650]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:46.352 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:46 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/441006915' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:46.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:46 smithi154 ceph-mon[63622]: pgmap v270: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:46.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:46 smithi154 ceph-mon[63622]: from='client.44377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:46.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:46 smithi154 ceph-mon[63622]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:46.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:46 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/441006915' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:46.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.397+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f605c19bc10 con 0x7f605c1003f0 2024-05-06T21:35:46.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.398+0000 7f6059ffb700 1 -- 172.21.15.32:0/1868087453 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1951 (secure 0 0 0) 0x7f604400f5d0 con 0x7f605c1003f0 2024-05-06T21:35:46.393 INFO:teuthology.orchestra.run.smithi032.stdout:e44 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 44 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:34:55.428791+0000 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:35:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 95 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=34432,1=34452} 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:35:46.395 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 34432 members: 34432,34452 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{0:34432} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{1:34452} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6824/171743146,v1:172.21.15.154:6825/171743146] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:35:46.396 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:44353} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6826/3609095923,v1:172.21.15.154:6827/3609095923] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:35:46.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f604806e200 msgr2=0x7f60480706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f604806e200 0x7f60480706b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f604c004630 tx=0x7f604c00b3c0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 msgr2=0x7f605c196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 0x7f605c196300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f604400b5c0 tx=0x7f604400bd70 comp rx=0 tx=0).stop 2024-05-06T21:35:46.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 shutdown_connections 2024-05-06T21:35:46.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f604806e200 0x7f60480706b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0ff150 0x7f605c195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 --2- 172.21.15.32:0/1868087453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f605c1003f0 0x7f605c196300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 >> 172.21.15.32:0/1868087453 conn(0x7f605c0fa7a0 msgr2=0x7f605c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:46.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 shutdown_connections 2024-05-06T21:35:46.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.401+0000 7f60629aa700 1 -- 172.21.15.32:0/1868087453 wait complete. 2024-05-06T21:35:46.398 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 44 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 -- 172.21.15.32:0/1122109935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36941010a0 msgr2=0x7f36940ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 --2- 172.21.15.32:0/1122109935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36941010a0 0x7f36940ff4b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3680009910 tx=0x7f3680009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 -- 172.21.15.32:0/1122109935 shutdown_connections 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 --2- 172.21.15.32:0/1122109935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36941010a0 0x7f36940ff4b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 --2- 172.21.15.32:0/1122109935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3694100750 0x7f3694100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 -- 172.21.15.32:0/1122109935 >> 172.21.15.32:0/1122109935 conn(0x7f36940f9f10 msgr2=0x7f36940fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 -- 172.21.15.32:0/1122109935 shutdown_connections 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 -- 172.21.15.32:0/1122109935 wait complete. 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 Processor -- start 2024-05-06T21:35:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.512+0000 7f369ae2a700 1 -- start start 2024-05-06T21:35:46.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f369ae2a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3694100750 0x7f36940feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:46.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f369ae2a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36941010a0 0x7f369419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:46.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f369ae2a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369419ae90 con 0x7f3694100750 2024-05-06T21:35:46.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f369ae2a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369419afd0 con 0x7f36941010a0 2024-05-06T21:35:46.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3698bc6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3694100750 0x7f36940feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:46.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3698bc6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3694100750 0x7f36940feea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42272/0 (socket says 172.21.15.32:42272) 2024-05-06T21:35:46.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3698bc6700 1 -- 172.21.15.32:0/1374052302 learned_addr learned my addr 172.21.15.32:0/1374052302 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3693fff700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36941010a0 0x7f369419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3698bc6700 1 -- 172.21.15.32:0/1374052302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36941010a0 msgr2=0x7f369419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3698bc6700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36941010a0 0x7f369419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3698bc6700 1 -- 172.21.15.32:0/1374052302 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800095f0 con 0x7f3694100750 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3698bc6700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3694100750 0x7f36940feea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f368800b480 tx=0x7f368800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3691ffb700 1 -- 172.21.15.32:0/1374052302 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3688011800 con 0x7f3694100750 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.513+0000 7f3691ffb700 1 -- 172.21.15.32:0/1374052302 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3688011e10 con 0x7f3694100750 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.514+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369419b2b0 con 0x7f3694100750 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.514+0000 7f3691ffb700 1 -- 172.21.15.32:0/1374052302 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f368800f2e0 con 0x7f3694100750 2024-05-06T21:35:46.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.514+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369419b7d0 con 0x7f3694100750 2024-05-06T21:35:46.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.515+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3694107ca0 con 0x7f3694100750 2024-05-06T21:35:46.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.515+0000 7f3691ffb700 1 -- 172.21.15.32:0/1374052302 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3688010380 con 0x7f3694100750 2024-05-06T21:35:46.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.516+0000 7f3691ffb700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f368406e200 0x7f36840706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:46.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.516+0000 7f3691ffb700 1 -- 172.21.15.32:0/1374052302 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f368808de40 con 0x7f3694100750 2024-05-06T21:35:46.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.516+0000 7f3693fff700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f368406e200 0x7f36840706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:46.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.516+0000 7f3693fff700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f368406e200 0x7f36840706b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f368000b5c0 tx=0x7f36800052a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:46.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.520+0000 7f3691ffb700 1 -- 172.21.15.32:0/1374052302 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f368805aaf0 con 0x7f3694100750 2024-05-06T21:35:46.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.758+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3694104db0 con 0x7f368406e200 2024-05-06T21:35:46.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.760+0000 7f3691ffb700 1 -- 172.21.15.32:0/1374052302 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f3694104db0 con 0x7f368406e200 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mds", 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "osd", 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph-exporter", 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:35:46.756 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:35:46.757 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "18/23 daemons upgraded", 2024-05-06T21:35:46.757 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading prometheus daemons", 2024-05-06T21:35:46.757 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:35:46.757 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:35:46.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f368406e200 msgr2=0x7f36840706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f368406e200 0x7f36840706b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f368000b5c0 tx=0x7f36800052a0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3694100750 msgr2=0x7f36940feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3694100750 0x7f36940feea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f368800b480 tx=0x7f368800b790 comp rx=0 tx=0).stop 2024-05-06T21:35:46.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 shutdown_connections 2024-05-06T21:35:46.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f368406e200 0x7f36840706b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3694100750 0x7f36940feea0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 --2- 172.21.15.32:0/1374052302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36941010a0 0x7f369419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 >> 172.21.15.32:0/1374052302 conn(0x7f36940f9f10 msgr2=0x7f3694103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:46.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.762+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 shutdown_connections 2024-05-06T21:35:46.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.763+0000 7f369ae2a700 1 -- 172.21.15.32:0/1374052302 wait complete. 2024-05-06T21:35:46.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.888+0000 7f450d723700 1 -- 172.21.15.32:0/567298798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45081003d0 msgr2=0x7f4508100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.888+0000 7f450d723700 1 --2- 172.21.15.32:0/567298798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45081003d0 0x7f4508100840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009910 tx=0x7f44f0009c20 comp rx=0 tx=0).stop 2024-05-06T21:35:46.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.888+0000 7f450d723700 1 -- 172.21.15.32:0/567298798 shutdown_connections 2024-05-06T21:35:46.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.888+0000 7f450d723700 1 --2- 172.21.15.32:0/567298798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45081003d0 0x7f4508100840 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.888+0000 7f450d723700 1 --2- 172.21.15.32:0/567298798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45080ff130 0x7f45080ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.888+0000 7f450d723700 1 -- 172.21.15.32:0/567298798 >> 172.21.15.32:0/567298798 conn(0x7f45080fa780 msgr2=0x7f45080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:46.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.888+0000 7f450d723700 1 -- 172.21.15.32:0/567298798 shutdown_connections 2024-05-06T21:35:46.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.888+0000 7f450d723700 1 -- 172.21.15.32:0/567298798 wait complete. 2024-05-06T21:35:46.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f450d723700 1 Processor -- start 2024-05-06T21:35:46.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f450d723700 1 -- start start 2024-05-06T21:35:46.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f450d723700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45080ff130 0x7f4508195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:46.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f450d723700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45081003d0 0x7f4508195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:46.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f450d723700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508196530 con 0x7f45080ff130 2024-05-06T21:35:46.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f450d723700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508196670 con 0x7f45081003d0 2024-05-06T21:35:46.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f4506ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45080ff130 0x7f4508195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f4506ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45080ff130 0x7f4508195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42296/0 (socket says 172.21.15.32:42296) 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f4506ffd700 1 -- 172.21.15.32:0/1632953295 learned_addr learned my addr 172.21.15.32:0/1632953295 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.889+0000 7f44fe7fc700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45081003d0 0x7f4508195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f4506ffd700 1 -- 172.21.15.32:0/1632953295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45081003d0 msgr2=0x7f4508195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f4506ffd700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45081003d0 0x7f4508195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f4506ffd700 1 -- 172.21.15.32:0/1632953295 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f00095f0 con 0x7f45080ff130 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f44fe7fc700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45081003d0 0x7f4508195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f4506ffd700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45080ff130 0x7f4508195a60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c930 tx=0x7f44f800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f4504ff9700 1 -- 172.21.15.32:0/1632953295 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f8007ad0 con 0x7f45080ff130 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450819b130 con 0x7f45080ff130 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f4504ff9700 1 -- 172.21.15.32:0/1632953295 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44f8007c30 con 0x7f45080ff130 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f4504ff9700 1 -- 172.21.15.32:0/1632953295 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f8018630 con 0x7f45080ff130 2024-05-06T21:35:46.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.890+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450819b650 con 0x7f45080ff130 2024-05-06T21:35:46.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.891+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4508107c10 con 0x7f45080ff130 2024-05-06T21:35:46.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.892+0000 7f4504ff9700 1 -- 172.21.15.32:0/1632953295 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f44f800f450 con 0x7f45080ff130 2024-05-06T21:35:46.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.892+0000 7f4504ff9700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f44f406e200 0x7f44f40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:35:46.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.892+0000 7f4504ff9700 1 -- 172.21.15.32:0/1632953295 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f44f808e4e0 con 0x7f45080ff130 2024-05-06T21:35:46.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.892+0000 7f44fe7fc700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f44f406e200 0x7f44f40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:35:46.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.893+0000 7f44fe7fc700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f44f406e200 0x7f44f40706b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f44f000b5c0 tx=0x7f44f0005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:35:46.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:46.897+0000 7f4504ff9700 1 -- 172.21.15.32:0/1632953295 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f44f805b240 con 0x7f45080ff130 2024-05-06T21:35:47.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.211+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4508107dd0 con 0x7f45080ff130 2024-05-06T21:35:47.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.212+0000 7f4504ff9700 1 -- 172.21.15.32:0/1632953295 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f44f805add0 con 0x7f45080ff130 2024-05-06T21:35:47.207 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:35:47.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f44f406e200 msgr2=0x7f44f40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f44f406e200 0x7f44f40706b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f44f000b5c0 tx=0x7f44f0005960 comp rx=0 tx=0).stop 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45080ff130 msgr2=0x7f4508195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45080ff130 0x7f4508195a60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c930 tx=0x7f44f800ccf0 comp rx=0 tx=0).stop 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 shutdown_connections 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f44f406e200 0x7f44f40706b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45080ff130 0x7f4508195a60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 --2- 172.21.15.32:0/1632953295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45081003d0 0x7f4508195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 >> 172.21.15.32:0/1632953295 conn(0x7f45080fa780 msgr2=0x7f4508068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 shutdown_connections 2024-05-06T21:35:47.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:35:47.214+0000 7f450d723700 1 -- 172.21.15.32:0/1632953295 wait complete. 2024-05-06T21:35:47.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:47 smithi032 ceph-mon[76650]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:47.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:47 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1868087453' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:35:47.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:47 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:47.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:47 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:47.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:47 smithi154 ceph-mon[63622]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:47.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:47 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1868087453' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:35:47.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:47 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:47.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:47 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:48.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:48 smithi032 ceph-mon[76650]: pgmap v271: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:48.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:48 smithi032 ceph-mon[76650]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:48.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:48 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1632953295' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:35:48.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:48 smithi154 ceph-mon[63622]: pgmap v271: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:48.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:48 smithi154 ceph-mon[63622]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:35:48.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:48 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1632953295' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:35:49.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:49.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:49 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:49.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:49.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:49 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:50.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:50 smithi032 ceph-mon[76650]: pgmap v272: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:50.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:50 smithi154 ceph-mon[63622]: pgmap v272: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:51.300 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:51 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:35:51.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:51 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:35:52.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: pgmap v273: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:52.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:52.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:52.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:35:52.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:35:52.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:52.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:35:52.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:52.470 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.471 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.472 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:52 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: pgmap v273: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.614 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:52.615 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:52 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:35:53.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:53 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:35:53.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:53 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T21:35:54.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:54 smithi032 ceph-mon[76650]: pgmap v274: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:54.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:54 smithi154 ceph-mon[63622]: pgmap v274: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:55.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:55 smithi032 ceph-mon[76650]: Upgrade: Updating alertmanager.smithi032 2024-05-06T21:35:55.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:55 smithi032 ceph-mon[76650]: Deploying daemon alertmanager.smithi032 on smithi032 2024-05-06T21:35:55.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:55 smithi154 ceph-mon[63622]: Upgrade: Updating alertmanager.smithi032 2024-05-06T21:35:55.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:55 smithi154 ceph-mon[63622]: Deploying daemon alertmanager.smithi032 on smithi032 2024-05-06T21:35:56.303 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:56 smithi032 ceph-mon[76650]: pgmap v275: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:56.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:56 smithi154 ceph-mon[63622]: pgmap v275: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:58.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:35:58 smithi032 ceph-mon[76650]: pgmap v276: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:35:58.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:35:58 smithi154 ceph-mon[63622]: pgmap v276: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:00.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:00 smithi032 ceph-mon[76650]: pgmap v277: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:00.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:00.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:00.469 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:00 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:00.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:00 smithi154 ceph-mon[63622]: pgmap v277: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:00.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:00.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:00.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:00 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:02.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:02 smithi032 ceph-mon[76650]: pgmap v278: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:02.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:02 smithi154 ceph-mon[63622]: pgmap v278: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:04.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:04 smithi032 ceph-mon[76650]: pgmap v279: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:04.613 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:04 smithi154 ceph-mon[63622]: pgmap v279: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:05.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:05.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:05.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:05 smithi154 ceph-mon[63622]: pgmap v280: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:05.882 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:05.882 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:05.882 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:05 smithi032 ceph-mon[76650]: pgmap v280: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:06.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:06.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:06.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:06 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:36:06.968 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:06.968 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:06.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:06 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:36:07.857 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:07 smithi032 ceph-mon[76650]: pgmap v281: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:08.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:07 smithi154 ceph-mon[63622]: pgmap v281: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:09.968 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: pgmap v282: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.969 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:09.970 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:09 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: pgmap v282: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:10.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:10.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:10.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:09 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:11.102 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:10 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T21:36:11.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:10 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T21:36:12.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:11 smithi154 ceph-mon[63622]: pgmap v283: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:12.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:11 smithi154 ceph-mon[63622]: Upgrade: Updating grafana.smithi032 2024-05-06T21:36:12.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:11 smithi154 ceph-mon[63622]: Deploying daemon grafana.smithi032 on smithi032 2024-05-06T21:36:12.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:11 smithi032 ceph-mon[76650]: pgmap v283: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:12.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:11 smithi032 ceph-mon[76650]: Upgrade: Updating grafana.smithi032 2024-05-06T21:36:12.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:11 smithi032 ceph-mon[76650]: Deploying daemon grafana.smithi032 on smithi032 2024-05-06T21:36:14.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:13 smithi154 ceph-mon[63622]: pgmap v284: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:14.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:13 smithi032 ceph-mon[76650]: pgmap v284: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:16.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:15 smithi154 ceph-mon[63622]: pgmap v285: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:16.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:15 smithi032 ceph-mon[76650]: pgmap v285: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:17.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.327+0000 7fd690387700 1 -- 172.21.15.32:0/3284663140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd688069270 msgr2=0x7fd688102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:17.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.327+0000 7fd690387700 1 --2- 172.21.15.32:0/3284663140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd688069270 0x7fd688102dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd684009910 tx=0x7fd684009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:17.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.327+0000 7fd690387700 1 -- 172.21.15.32:0/3284663140 shutdown_connections 2024-05-06T21:36:17.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.327+0000 7fd690387700 1 --2- 172.21.15.32:0/3284663140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd688103310 0x7fd688105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.327+0000 7fd690387700 1 --2- 172.21.15.32:0/3284663140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd688069270 0x7fd688102dd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.327+0000 7fd690387700 1 -- 172.21.15.32:0/3284663140 >> 172.21.15.32:0/3284663140 conn(0x7fd6880fa780 msgr2=0x7fd6880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:17.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.327+0000 7fd690387700 1 -- 172.21.15.32:0/3284663140 shutdown_connections 2024-05-06T21:36:17.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.327+0000 7fd690387700 1 -- 172.21.15.32:0/3284663140 wait complete. 2024-05-06T21:36:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd690387700 1 Processor -- start 2024-05-06T21:36:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd690387700 1 -- start start 2024-05-06T21:36:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd690387700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd688103310 0x7fd688195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd690387700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6881960c0 0x7fd68819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd690387700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881965c0 con 0x7fd6881960c0 2024-05-06T21:36:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd690387700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd688196730 con 0x7fd688103310 2024-05-06T21:36:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd68d922700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6881960c0 0x7fd68819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd68d922700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6881960c0 0x7fd68819b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56456/0 (socket says 172.21.15.32:56456) 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd68d922700 1 -- 172.21.15.32:0/1386837030 learned_addr learned my addr 172.21.15.32:0/1386837030 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.328+0000 7fd68e123700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd688103310 0x7fd688195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.329+0000 7fd68d922700 1 -- 172.21.15.32:0/1386837030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd688103310 msgr2=0x7fd688195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.329+0000 7fd68d922700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd688103310 0x7fd688195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.329+0000 7fd68d922700 1 -- 172.21.15.32:0/1386837030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6840095f0 con 0x7fd6881960c0 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.329+0000 7fd68d922700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6881960c0 0x7fd68819b130 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00b4b0 tx=0x7fd67c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.329+0000 7fd67b7fe700 1 -- 172.21.15.32:0/1386837030 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd67c011800 con 0x7fd6881960c0 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.329+0000 7fd67b7fe700 1 -- 172.21.15.32:0/1386837030 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd67c011e10 con 0x7fd6881960c0 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.329+0000 7fd67b7fe700 1 -- 172.21.15.32:0/1386837030 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd67c00f2e0 con 0x7fd6881960c0 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.329+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68819b6d0 con 0x7fd6881960c0 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.329+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68819bbf0 con 0x7fd6881960c0 2024-05-06T21:36:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.330+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68818fc50 con 0x7fd6881960c0 2024-05-06T21:36:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.331+0000 7fd67b7fe700 1 -- 172.21.15.32:0/1386837030 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd67c010380 con 0x7fd6881960c0 2024-05-06T21:36:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.331+0000 7fd67b7fe700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd67406e200 0x7fd6740706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.331+0000 7fd68e123700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd67406e200 0x7fd6740706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.331+0000 7fd67b7fe700 1 -- 172.21.15.32:0/1386837030 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fd67c08de70 con 0x7fd6881960c0 2024-05-06T21:36:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.332+0000 7fd68e123700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd67406e200 0x7fd6740706b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd684006010 tx=0x7fd68400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:17.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.336+0000 7fd67b7fe700 1 -- 172.21.15.32:0/1386837030 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd67c05ab00 con 0x7fd6881960c0 2024-05-06T21:36:17.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.568+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd68802ceb0 con 0x7fd67406e200 2024-05-06T21:36:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.569+0000 7fd67b7fe700 1 -- 172.21.15.32:0/1386837030 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7fd68802ceb0 con 0x7fd67406e200 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd67406e200 msgr2=0x7fd6740706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd67406e200 0x7fd6740706b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd684006010 tx=0x7fd68400b540 comp rx=0 tx=0).stop 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6881960c0 msgr2=0x7fd68819b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6881960c0 0x7fd68819b130 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00b4b0 tx=0x7fd67c00b7c0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 shutdown_connections 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd67406e200 0x7fd6740706b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd688103310 0x7fd688195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 --2- 172.21.15.32:0/1386837030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6881960c0 0x7fd68819b130 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 >> 172.21.15.32:0/1386837030 conn(0x7fd6880fa780 msgr2=0x7fd6880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 shutdown_connections 2024-05-06T21:36:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.571+0000 7fd690387700 1 -- 172.21.15.32:0/1386837030 wait complete. 2024-05-06T21:36:17.577 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:36:17.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.681+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3404192507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 msgr2=0x7f7a540ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.681+0000 7f7a58b8e700 1 --2- 172.21.15.32:0/3404192507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 0x7f7a540ff560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009910 tx=0x7f7a44009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.681+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3404192507 shutdown_connections 2024-05-06T21:36:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.681+0000 7f7a58b8e700 1 --2- 172.21.15.32:0/3404192507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a54100350 0x7f7a541007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.681+0000 7f7a58b8e700 1 --2- 172.21.15.32:0/3404192507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 0x7f7a540ff560 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.681+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3404192507 >> 172.21.15.32:0/3404192507 conn(0x7f7a540fa700 msgr2=0x7f7a540fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.681+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3404192507 shutdown_connections 2024-05-06T21:36:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.681+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3404192507 wait complete. 2024-05-06T21:36:17.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a58b8e700 1 Processor -- start 2024-05-06T21:36:17.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a58b8e700 1 -- start start 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a58b8e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 0x7f7a54195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a58b8e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a54100350 0x7f7a54196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a58b8e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54196640 con 0x7f7a540ff150 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a58b8e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54196780 con 0x7f7a54100350 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a5259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 0x7f7a54195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a5259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 0x7f7a54195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56472/0 (socket says 172.21.15.32:56472) 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a5259c700 1 -- 172.21.15.32:0/3766674222 learned_addr learned my addr 172.21.15.32:0/3766674222 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a51d9b700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a54100350 0x7f7a54196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.682+0000 7f7a5259c700 1 -- 172.21.15.32:0/3766674222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a54100350 msgr2=0x7f7a54196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.683+0000 7f7a5259c700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a54100350 0x7f7a54196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.683+0000 7f7a5259c700 1 -- 172.21.15.32:0/3766674222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a440095f0 con 0x7f7a540ff150 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.683+0000 7f7a51d9b700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a54100350 0x7f7a54196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:36:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.683+0000 7f7a5259c700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 0x7f7a54195ae0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400bda0 tx=0x7f7a4400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.683+0000 7f7a437fe700 1 -- 172.21.15.32:0/3766674222 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4401d070 con 0x7f7a540ff150 2024-05-06T21:36:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.683+0000 7f7a437fe700 1 -- 172.21.15.32:0/3766674222 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a44004c50 con 0x7f7a540ff150 2024-05-06T21:36:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.683+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5419b1d0 con 0x7f7a540ff150 2024-05-06T21:36:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.683+0000 7f7a437fe700 1 -- 172.21.15.32:0/3766674222 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4400f690 con 0x7f7a540ff150 2024-05-06T21:36:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.683+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5419b6c0 con 0x7f7a540ff150 2024-05-06T21:36:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.684+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a54108da0 con 0x7f7a540ff150 2024-05-06T21:36:17.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.685+0000 7f7a437fe700 1 -- 172.21.15.32:0/3766674222 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7a440229b0 con 0x7f7a540ff150 2024-05-06T21:36:17.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.685+0000 7f7a437fe700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7a3c06e200 0x7f7a3c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:17.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.685+0000 7f7a437fe700 1 -- 172.21.15.32:0/3766674222 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f7a4408f9b0 con 0x7f7a540ff150 2024-05-06T21:36:17.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.685+0000 7f7a51d9b700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7a3c06e200 0x7f7a3c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:17.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.685+0000 7f7a51d9b700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7a3c06e200 0x7f7a3c0706b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a48005fd0 tx=0x7f7a48005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:17.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.690+0000 7f7a437fe700 1 -- 172.21.15.32:0/3766674222 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7a4405c710 con 0x7f7a540ff150 2024-05-06T21:36:17.874 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:17 smithi032 ceph-mon[76650]: pgmap v286: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:17.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.940+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a54104ca0 con 0x7f7a3c06e200 2024-05-06T21:36:17.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.941+0000 7f7a437fe700 1 -- 172.21.15.32:0/3766674222 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f7a54104ca0 con 0x7f7a3c06e200 2024-05-06T21:36:17.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7a3c06e200 msgr2=0x7f7a3c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7a3c06e200 0x7f7a3c0706b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a48005fd0 tx=0x7f7a48005dc0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 msgr2=0x7f7a54195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 0x7f7a54195ae0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400bda0 tx=0x7f7a4400be80 comp rx=0 tx=0).stop 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 shutdown_connections 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7a3c06e200 0x7f7a3c0706b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a540ff150 0x7f7a54195ae0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 --2- 172.21.15.32:0/3766674222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a54100350 0x7f7a54196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 >> 172.21.15.32:0/3766674222 conn(0x7f7a540fa700 msgr2=0x7f7a54103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 shutdown_connections 2024-05-06T21:36:17.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:17.944+0000 7f7a58b8e700 1 -- 172.21.15.32:0/3766674222 wait complete. 2024-05-06T21:36:18.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.054+0000 7f65c7845700 1 -- 172.21.15.32:0/465801414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01003d0 msgr2=0x7f65c0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.054+0000 7f65c7845700 1 --2- 172.21.15.32:0/465801414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01003d0 0x7f65c0100840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009910 tx=0x7f65b0009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:18.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.054+0000 7f65c7845700 1 -- 172.21.15.32:0/465801414 shutdown_connections 2024-05-06T21:36:18.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.054+0000 7f65c7845700 1 --2- 172.21.15.32:0/465801414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c01003d0 0x7f65c0100840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.054+0000 7f65c7845700 1 --2- 172.21.15.32:0/465801414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c00ff130 0x7f65c00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.054+0000 7f65c7845700 1 -- 172.21.15.32:0/465801414 >> 172.21.15.32:0/465801414 conn(0x7f65c00fa780 msgr2=0x7f65c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:18.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.054+0000 7f65c7845700 1 -- 172.21.15.32:0/465801414 shutdown_connections 2024-05-06T21:36:18.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.054+0000 7f65c7845700 1 -- 172.21.15.32:0/465801414 wait complete. 2024-05-06T21:36:18.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.055+0000 7f65c7845700 1 Processor -- start 2024-05-06T21:36:18.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.055+0000 7f65c7845700 1 -- start start 2024-05-06T21:36:18.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.055+0000 7f65c7845700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c00ff130 0x7f65c0195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.055+0000 7f65c7845700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c01003d0 0x7f65c0196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.055+0000 7f65c7845700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0196650 con 0x7f65c00ff130 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.055+0000 7f65c7845700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0196790 con 0x7f65c01003d0 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.055+0000 7f65c55e1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c00ff130 0x7f65c0195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.055+0000 7f65c55e1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c00ff130 0x7f65c0195af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56494/0 (socket says 172.21.15.32:56494) 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.055+0000 7f65c55e1700 1 -- 172.21.15.32:0/3755447978 learned_addr learned my addr 172.21.15.32:0/3755447978 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65c4de0700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c01003d0 0x7f65c0196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65c55e1700 1 -- 172.21.15.32:0/3755447978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c01003d0 msgr2=0x7f65c0196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65c55e1700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c01003d0 0x7f65c0196030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65c55e1700 1 -- 172.21.15.32:0/3755447978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00095f0 con 0x7f65c00ff130 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65c55e1700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c00ff130 0x7f65c0195af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00b4b0 tx=0x7f65bc00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65b67fc700 1 -- 172.21.15.32:0/3755447978 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65bc011800 con 0x7f65c00ff130 2024-05-06T21:36:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c019b240 con 0x7f65c00ff130 2024-05-06T21:36:18.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65b67fc700 1 -- 172.21.15.32:0/3755447978 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f65bc011e10 con 0x7f65c00ff130 2024-05-06T21:36:18.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65b67fc700 1 -- 172.21.15.32:0/3755447978 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65bc00f2e0 con 0x7f65c00ff130 2024-05-06T21:36:18.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.056+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c019b790 con 0x7f65c00ff130 2024-05-06T21:36:18.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.057+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c0108dd0 con 0x7f65c00ff130 2024-05-06T21:36:18.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.058+0000 7f65b67fc700 1 -- 172.21.15.32:0/3755447978 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f65bc010380 con 0x7f65c00ff130 2024-05-06T21:36:18.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.058+0000 7f65b67fc700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f65ac06e200 0x7f65ac0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:18.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.058+0000 7f65b67fc700 1 -- 172.21.15.32:0/3755447978 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f65bc08deb0 con 0x7f65c00ff130 2024-05-06T21:36:18.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.059+0000 7f65c4de0700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f65ac06e200 0x7f65ac0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:18.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.059+0000 7f65c4de0700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f65ac06e200 0x7f65ac0706b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65b0006010 tx=0x7f65b000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.065+0000 7f65b67fc700 1 -- 172.21.15.32:0/3755447978 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f65bc05ab60 con 0x7f65c00ff130 2024-05-06T21:36:18.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:17 smithi154 ceph-mon[63622]: pgmap v286: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:18.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.288+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f65c019be30 con 0x7f65ac06e200 2024-05-06T21:36:18.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.299+0000 7f65b67fc700 1 -- 172.21.15.32:0/3755447978 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f65c019be30 con 0x7f65ac06e200 2024-05-06T21:36:18.295 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:36:18.295 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (19s) 13s ago 17m 16.7M - 0.25.0 c8568f914cd2 e589f3449d48 2024-05-06T21:36:18.295 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (78s) 13s ago 18m 8140k - 19.0.0-2497-gf273489c 3b8ac54a9a71 e2228993e952 2024-05-06T21:36:18.295 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (73s) 51s ago 17m 7532k - 19.0.0-2497-gf273489c 3b8ac54a9a71 dba77ef37133 2024-05-06T21:36:18.295 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (6m) 13s ago 18m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:36:18.295 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (6m) 51s ago 17m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:36:18.295 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (16m) 13s ago 17m 86.9M - 9.4.7 954c08fa6188 fb800c42274d 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (2m) 13s ago 12m 70.0M - 19.0.0-2497-gf273489c 3b8ac54a9a71 6cd9ab5eb234 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (2m) 13s ago 12m 20.2M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5c54ca7e9a32 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (113s) 51s ago 12m 13.7M - 19.0.0-2497-gf273489c 3b8ac54a9a71 df23e8b47eff 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (93s) 51s ago 12m 16.0M - 19.0.0-2497-gf273489c 3b8ac54a9a71 12b4c06cf5bc 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (9m) 13s ago 19m 514M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (8m) 51s ago 16m 452M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (8m) 13s ago 19m 57.1M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (7m) 51s ago 16m 45.6M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (58s) 13s ago 18m 15.3M - 1.5.0 0da6a335fe13 2265cff718e2 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (54s) 51s ago 17m 3376k - 1.5.0 0da6a335fe13 4f95bf7624ed 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (6m) 13s ago 16m 167M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (5m) 13s ago 15m 125M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (5m) 13s ago 15m 102M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:36:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (4m) 51s ago 14m 105M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:36:18.297 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (4m) 51s ago 14m 103M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:36:18.297 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (3m) 51s ago 13m 99.3M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 8b513e97a420 2024-05-06T21:36:18.297 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (36s) 13s ago 17m 52.8M - 2.43.0 a07b618ecd1d 6907f55d469a 2024-05-06T21:36:18.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f65ac06e200 msgr2=0x7f65ac0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f65ac06e200 0x7f65ac0706b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65b0006010 tx=0x7f65b000b560 comp rx=0 tx=0).stop 2024-05-06T21:36:18.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c00ff130 msgr2=0x7f65c0195af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c00ff130 0x7f65c0195af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00b4b0 tx=0x7f65bc00b7c0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 shutdown_connections 2024-05-06T21:36:18.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f65ac06e200 0x7f65ac0706b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65c00ff130 0x7f65c0195af0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 --2- 172.21.15.32:0/3755447978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c01003d0 0x7f65c0196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 >> 172.21.15.32:0/3755447978 conn(0x7f65c00fa780 msgr2=0x7f65c0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:18.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 shutdown_connections 2024-05-06T21:36:18.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.302+0000 7f65c7845700 1 -- 172.21.15.32:0/3755447978 wait complete. 2024-05-06T21:36:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.410+0000 7f1e682fd700 1 -- 172.21.15.32:0/4136867611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 msgr2=0x7f1e601057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.410+0000 7f1e682fd700 1 --2- 172.21.15.32:0/4136867611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 0x7f1e601057b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009910 tx=0x7f1e50009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.410+0000 7f1e682fd700 1 -- 172.21.15.32:0/4136867611 shutdown_connections 2024-05-06T21:36:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.410+0000 7f1e682fd700 1 --2- 172.21.15.32:0/4136867611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 0x7f1e601057b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.410+0000 7f1e682fd700 1 --2- 172.21.15.32:0/4136867611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e60069b00 0x7f1e60102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.410+0000 7f1e682fd700 1 -- 172.21.15.32:0/4136867611 >> 172.21.15.32:0/4136867611 conn(0x7f1e600fa7a0 msgr2=0x7f1e600fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.410+0000 7f1e682fd700 1 -- 172.21.15.32:0/4136867611 shutdown_connections 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.410+0000 7f1e682fd700 1 -- 172.21.15.32:0/4136867611 wait complete. 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e682fd700 1 Processor -- start 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e682fd700 1 -- start start 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e682fd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 0x7f1e60195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e682fd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e60196330 0x7f1e6019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e682fd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60196830 con 0x7f1e60103330 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e682fd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e601969a0 con 0x7f1e60196330 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e66099700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 0x7f1e60195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e66099700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 0x7f1e60195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56510/0 (socket says 172.21.15.32:56510) 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e66099700 1 -- 172.21.15.32:0/1666863581 learned_addr learned my addr 172.21.15.32:0/1666863581 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e66099700 1 -- 172.21.15.32:0/1666863581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e60196330 msgr2=0x7f1e6019b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e65898700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e60196330 0x7f1e6019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e66099700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e60196330 0x7f1e6019b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e66099700 1 -- 172.21.15.32:0/1666863581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500095f0 con 0x7f1e60103330 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.411+0000 7f1e66099700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 0x7f1e60195df0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00c8f0 tx=0x7f1e5c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.412+0000 7f1e577fe700 1 -- 172.21.15.32:0/1666863581 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5c007a50 con 0x7f1e60103330 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.412+0000 7f1e577fe700 1 -- 172.21.15.32:0/1666863581 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e5c007bb0 con 0x7f1e60103330 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.412+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6019b940 con 0x7f1e60103330 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.412+0000 7f1e577fe700 1 -- 172.21.15.32:0/1666863581 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5c018630 con 0x7f1e60103330 2024-05-06T21:36:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.412+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6019be60 con 0x7f1e60103330 2024-05-06T21:36:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.413+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6018fc10 con 0x7f1e60103330 2024-05-06T21:36:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.413+0000 7f1e577fe700 1 -- 172.21.15.32:0/1666863581 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1e5c007d20 con 0x7f1e60103330 2024-05-06T21:36:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.414+0000 7f1e577fe700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1e4c06e200 0x7f1e4c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.414+0000 7f1e577fe700 1 -- 172.21.15.32:0/1666863581 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f1e5c08e2f0 con 0x7f1e60103330 2024-05-06T21:36:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.414+0000 7f1e65898700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1e4c06e200 0x7f1e4c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.414+0000 7f1e65898700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1e4c06e200 0x7f1e4c0706b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000b5c0 tx=0x7f1e50005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:18.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.419+0000 7f1e577fe700 1 -- 172.21.15.32:0/1666863581 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f1e5c05afa0 con 0x7f1e60103330 2024-05-06T21:36:18.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.725+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e60068ab0 con 0x7f1e60103330 2024-05-06T21:36:18.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.726+0000 7f1e577fe700 1 -- 172.21.15.32:0/1666863581 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f1e5c05ab30 con 0x7f1e60103330 2024-05-06T21:36:18.721 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:36:18.721 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 4 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:36:18.722 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:36:18.723 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 14 2024-05-06T21:36:18.723 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:36:18.723 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1e4c06e200 msgr2=0x7f1e4c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1e4c06e200 0x7f1e4c0706b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000b5c0 tx=0x7f1e50005960 comp rx=0 tx=0).stop 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 msgr2=0x7f1e60195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 0x7f1e60195df0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00c8f0 tx=0x7f1e5c00ccb0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 shutdown_connections 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f1e4c06e200 0x7f1e4c0706b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e60103330 0x7f1e60195df0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 --2- 172.21.15.32:0/1666863581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e60196330 0x7f1e6019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 >> 172.21.15.32:0/1666863581 conn(0x7f1e600fa7a0 msgr2=0x7f1e600fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 shutdown_connections 2024-05-06T21:36:18.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.728+0000 7f1e682fd700 1 -- 172.21.15.32:0/1666863581 wait complete. 2024-05-06T21:36:18.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.838+0000 7f2bb9a11700 1 -- 172.21.15.32:0/3228984586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4074d00 msgr2=0x7f2bb4073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.838+0000 7f2bb9a11700 1 --2- 172.21.15.32:0/3228984586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4074d00 0x7f2bb4073160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009910 tx=0x7f2ba4009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:18.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.838+0000 7f2bb9a11700 1 -- 172.21.15.32:0/3228984586 shutdown_connections 2024-05-06T21:36:18.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.838+0000 7f2bb9a11700 1 --2- 172.21.15.32:0/3228984586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb4073730 0x7f2bb4073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.838+0000 7f2bb9a11700 1 --2- 172.21.15.32:0/3228984586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4074d00 0x7f2bb4073160 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.838+0000 7f2bb9a11700 1 -- 172.21.15.32:0/3228984586 >> 172.21.15.32:0/3228984586 conn(0x7f2bb40fb7f0 msgr2=0x7f2bb40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.838+0000 7f2bb9a11700 1 -- 172.21.15.32:0/3228984586 shutdown_connections 2024-05-06T21:36:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.838+0000 7f2bb9a11700 1 -- 172.21.15.32:0/3228984586 wait complete. 2024-05-06T21:36:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.839+0000 7f2bb9a11700 1 Processor -- start 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.839+0000 7f2bb9a11700 1 -- start start 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.839+0000 7f2bb9a11700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4073730 0x7f2bb4197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.839+0000 7f2bb9a11700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb4074d00 0x7f2bb41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.839+0000 7f2bb9a11700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb41987f0 con 0x7f2bb4073730 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.839+0000 7f2bb9a11700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4198960 con 0x7f2bb4074d00 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4073730 0x7f2bb4197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4073730 0x7f2bb4197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56528/0 (socket says 172.21.15.32:56528) 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb2ffd700 1 -- 172.21.15.32:0/4152576352 learned_addr learned my addr 172.21.15.32:0/4152576352 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb27fc700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb4074d00 0x7f2bb41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb2ffd700 1 -- 172.21.15.32:0/4152576352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb4074d00 msgr2=0x7f2bb41981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb2ffd700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb4074d00 0x7f2bb41981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb2ffd700 1 -- 172.21.15.32:0/4152576352 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba40095f0 con 0x7f2bb4073730 2024-05-06T21:36:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb2ffd700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4073730 0x7f2bb4197cb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b5c0 tx=0x7f2ba400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb8a0f700 1 -- 172.21.15.32:0/4152576352 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba401d070 con 0x7f2bb4073730 2024-05-06T21:36:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb8a0f700 1 -- 172.21.15.32:0/4152576352 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ba400f460 con 0x7f2bb4073730 2024-05-06T21:36:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb419d390 con 0x7f2bb4073730 2024-05-06T21:36:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb8a0f700 1 -- 172.21.15.32:0/4152576352 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba4021640 con 0x7f2bb4073730 2024-05-06T21:36:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.840+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb419d880 con 0x7f2bb4073730 2024-05-06T21:36:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.841+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb410af70 con 0x7f2bb4073730 2024-05-06T21:36:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.842+0000 7f2bb8a0f700 1 -- 172.21.15.32:0/4152576352 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2ba400fa60 con 0x7f2bb4073730 2024-05-06T21:36:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.842+0000 7f2bb8a0f700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b9c06e200 0x7f2b9c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.843+0000 7f2bb8a0f700 1 -- 172.21.15.32:0/4152576352 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f2ba408f560 con 0x7f2bb4073730 2024-05-06T21:36:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.843+0000 7f2bb27fc700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b9c06e200 0x7f2b9c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.843+0000 7f2bb27fc700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b9c06e200 0x7f2b9c0706b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bb41991c0 tx=0x7f2ba800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:18.847+0000 7f2bb8a0f700 1 -- 172.21.15.32:0/4152576352 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2ba40586e0 con 0x7f2bb4073730 2024-05-06T21:36:19.025 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:18 smithi032 ceph-mon[76650]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:19.025 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:18 smithi032 ceph-mon[76650]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:19.025 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:18 smithi032 ceph-mon[76650]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:19.025 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:18 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1666863581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:19.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.114+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2bb419df80 con 0x7f2bb4073730 2024-05-06T21:36:19.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.115+0000 7f2bb8a0f700 1 -- 172.21.15.32:0/4152576352 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1951 (secure 0 0 0) 0x7f2ba405bda0 con 0x7f2bb4073730 2024-05-06T21:36:19.111 INFO:teuthology.orchestra.run.smithi032.stdout:e44 2024-05-06T21:36:19.111 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:36:19.111 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:36:19.111 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:36:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:36:19.111 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:36:19.111 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 44 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:34:55.428791+0000 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:36:19.112 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 95 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=34432,1=34452} 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:36:19.113 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:36:19.114 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 34432 members: 34432,34452 2024-05-06T21:36:19.114 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{0:34432} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:36:19.114 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{1:34452} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:36:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:36:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:36:19.114 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:36:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:36:19.114 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6824/171743146,v1:172.21.15.154:6825/171743146] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:36:19.114 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:44353} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6826/3609095923,v1:172.21.15.154:6827/3609095923] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:36:19.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:18 smithi154 ceph-mon[63622]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:19.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:18 smithi154 ceph-mon[63622]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:19.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:18 smithi154 ceph-mon[63622]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:19.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:18 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1666863581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b9c06e200 msgr2=0x7f2b9c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b9c06e200 0x7f2b9c0706b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bb41991c0 tx=0x7f2ba800b410 comp rx=0 tx=0).stop 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4073730 msgr2=0x7f2bb4197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4073730 0x7f2bb4197cb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b5c0 tx=0x7f2ba400bd70 comp rx=0 tx=0).stop 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 shutdown_connections 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f2b9c06e200 0x7f2b9c0706b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bb4073730 0x7f2bb4197cb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 --2- 172.21.15.32:0/4152576352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bb4074d00 0x7f2bb41981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 >> 172.21.15.32:0/4152576352 conn(0x7f2bb40fb7f0 msgr2=0x7f2bb41060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:19.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 shutdown_connections 2024-05-06T21:36:19.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.117+0000 7f2bb9a11700 1 -- 172.21.15.32:0/4152576352 wait complete. 2024-05-06T21:36:19.117 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 44 2024-05-06T21:36:19.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.228+0000 7f06cbbe5700 1 -- 172.21.15.32:0/3410052198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c41003f0 msgr2=0x7f06c4100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.228+0000 7f06cbbe5700 1 --2- 172.21.15.32:0/3410052198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c41003f0 0x7f06c4100860 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009910 tx=0x7f06b8009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:19.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.228+0000 7f06cbbe5700 1 -- 172.21.15.32:0/3410052198 shutdown_connections 2024-05-06T21:36:19.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.228+0000 7f06cbbe5700 1 --2- 172.21.15.32:0/3410052198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c41003f0 0x7f06c4100860 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.228+0000 7f06cbbe5700 1 --2- 172.21.15.32:0/3410052198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c40ff150 0x7f06c40ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.228+0000 7f06cbbe5700 1 -- 172.21.15.32:0/3410052198 >> 172.21.15.32:0/3410052198 conn(0x7f06c40fa7a0 msgr2=0x7f06c40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:19.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.228+0000 7f06cbbe5700 1 -- 172.21.15.32:0/3410052198 shutdown_connections 2024-05-06T21:36:19.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.228+0000 7f06cbbe5700 1 -- 172.21.15.32:0/3410052198 wait complete. 2024-05-06T21:36:19.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.229+0000 7f06cbbe5700 1 Processor -- start 2024-05-06T21:36:19.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.229+0000 7f06cbbe5700 1 -- start start 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.229+0000 7f06cbbe5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c40ff150 0x7f06c4069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.229+0000 7f06cbbe5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c41003f0 0x7f06c419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.229+0000 7f06cbbe5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c419b140 con 0x7f06c40ff150 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.229+0000 7f06cbbe5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c419b2b0 con 0x7f06c41003f0 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.229+0000 7f06c9981700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c40ff150 0x7f06c4069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.229+0000 7f06c9981700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c40ff150 0x7f06c4069950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56548/0 (socket says 172.21.15.32:56548) 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.229+0000 7f06c9981700 1 -- 172.21.15.32:0/559334882 learned_addr learned my addr 172.21.15.32:0/559334882 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06c9180700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c41003f0 0x7f06c419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06c9981700 1 -- 172.21.15.32:0/559334882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c41003f0 msgr2=0x7f06c419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06c9981700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c41003f0 0x7f06c419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06c9981700 1 -- 172.21.15.32:0/559334882 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b80095f0 con 0x7f06c40ff150 2024-05-06T21:36:19.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06c9981700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c40ff150 0x7f06c4069950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f06c000b4b0 tx=0x7f06c000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:19.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06b6ffd700 1 -- 172.21.15.32:0/559334882 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c0011800 con 0x7f06c40ff150 2024-05-06T21:36:19.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06b6ffd700 1 -- 172.21.15.32:0/559334882 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06c0011e10 con 0x7f06c40ff150 2024-05-06T21:36:19.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c419b590 con 0x7f06c40ff150 2024-05-06T21:36:19.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06b6ffd700 1 -- 172.21.15.32:0/559334882 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c000f2e0 con 0x7f06c40ff150 2024-05-06T21:36:19.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.230+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c419bae0 con 0x7f06c40ff150 2024-05-06T21:36:19.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.231+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c4068ab0 con 0x7f06c40ff150 2024-05-06T21:36:19.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.232+0000 7f06b6ffd700 1 -- 172.21.15.32:0/559334882 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f06c0010380 con 0x7f06c40ff150 2024-05-06T21:36:19.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.232+0000 7f06b6ffd700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06b006e200 0x7f06b00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:19.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.232+0000 7f06b6ffd700 1 -- 172.21.15.32:0/559334882 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f06c008df60 con 0x7f06c40ff150 2024-05-06T21:36:19.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.232+0000 7f06c9180700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06b006e200 0x7f06b00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:19.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.233+0000 7f06c9180700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06b006e200 0x7f06b00706b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06c4069eb0 tx=0x7f06b800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:19.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.237+0000 7f06b6ffd700 1 -- 172.21.15.32:0/559334882 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f06c00c2740 con 0x7f06c40ff150 2024-05-06T21:36:19.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.476+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06c4104de0 con 0x7f06b006e200 2024-05-06T21:36:19.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.477+0000 7f06b6ffd700 1 -- 172.21.15.32:0/559334882 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f06c4104de0 con 0x7f06b006e200 2024-05-06T21:36:19.472 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:36:19.472 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4", 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": true, 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [ 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "mds", 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "osd", 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "mon", 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph-exporter", 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "crash", 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr" 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": "18/23 daemons upgraded", 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "Currently upgrading grafana daemons", 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:36:19.473 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:36:19.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06b006e200 msgr2=0x7f06b00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06b006e200 0x7f06b00706b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06c4069eb0 tx=0x7f06b800b540 comp rx=0 tx=0).stop 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c40ff150 msgr2=0x7f06c4069950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c40ff150 0x7f06c4069950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f06c000b4b0 tx=0x7f06c000b870 comp rx=0 tx=0).stop 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 shutdown_connections 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f06b006e200 0x7f06b00706b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c40ff150 0x7f06c4069950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 --2- 172.21.15.32:0/559334882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c41003f0 0x7f06c419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 >> 172.21.15.32:0/559334882 conn(0x7f06c40fa7a0 msgr2=0x7f06c4103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 shutdown_connections 2024-05-06T21:36:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.479+0000 7f06cbbe5700 1 -- 172.21.15.32:0/559334882 wait complete. 2024-05-06T21:36:19.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.588+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3462559711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c780ff140 msgr2=0x7f8c780ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.588+0000 7f8c7d6e8700 1 --2- 172.21.15.32:0/3462559711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c780ff140 0x7f8c780ff550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009910 tx=0x7f8c68009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:19.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.588+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3462559711 shutdown_connections 2024-05-06T21:36:19.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.588+0000 7f8c7d6e8700 1 --2- 172.21.15.32:0/3462559711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c78100340 0x7f8c78100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.588+0000 7f8c7d6e8700 1 --2- 172.21.15.32:0/3462559711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c780ff140 0x7f8c780ff550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.588+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3462559711 >> 172.21.15.32:0/3462559711 conn(0x7f8c780fa6d0 msgr2=0x7f8c780fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:19.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.588+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3462559711 shutdown_connections 2024-05-06T21:36:19.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.588+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3462559711 wait complete. 2024-05-06T21:36:19.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.589+0000 7f8c7d6e8700 1 Processor -- start 2024-05-06T21:36:19.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.589+0000 7f8c7d6e8700 1 -- start start 2024-05-06T21:36:19.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.589+0000 7f8c7d6e8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c780ff140 0x7f8c78069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:19.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.589+0000 7f8c7d6e8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c78100340 0x7f8c7819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:19.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.589+0000 7f8c7d6e8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7819ae80 con 0x7f8c78100340 2024-05-06T21:36:19.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.589+0000 7f8c7d6e8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7819afc0 con 0x7f8c780ff140 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c767fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c78100340 0x7f8c7819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c767fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c78100340 0x7f8c7819a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56572/0 (socket says 172.21.15.32:56572) 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c767fc700 1 -- 172.21.15.32:0/3780556662 learned_addr learned my addr 172.21.15.32:0/3780556662 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c76ffd700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c780ff140 0x7f8c78069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c767fc700 1 -- 172.21.15.32:0/3780556662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c780ff140 msgr2=0x7f8c78069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c767fc700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c780ff140 0x7f8c78069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c767fc700 1 -- 172.21.15.32:0/3780556662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680095f0 con 0x7f8c78100340 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c767fc700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c78100340 0x7f8c7819a8b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000b4b0 tx=0x7f8c6000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c6ffff700 1 -- 172.21.15.32:0/3780556662 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c60011800 con 0x7f8c78100340 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7819b2a0 con 0x7f8c78100340 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c6ffff700 1 -- 172.21.15.32:0/3780556662 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c60011e10 con 0x7f8c78100340 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c6ffff700 1 -- 172.21.15.32:0/3780556662 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c6000f2e0 con 0x7f8c78100340 2024-05-06T21:36:19.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.590+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7819b7f0 con 0x7f8c78100340 2024-05-06T21:36:19.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.591+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c78107d10 con 0x7f8c78100340 2024-05-06T21:36:19.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.592+0000 7f8c6ffff700 1 -- 172.21.15.32:0/3780556662 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8c60010380 con 0x7f8c78100340 2024-05-06T21:36:19.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.593+0000 7f8c6ffff700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8c6406e200 0x7f8c640706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:19.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.593+0000 7f8c6ffff700 1 -- 172.21.15.32:0/3780556662 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f8c6008dff0 con 0x7f8c78100340 2024-05-06T21:36:19.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.593+0000 7f8c76ffd700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8c6406e200 0x7f8c640706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:19.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.593+0000 7f8c76ffd700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8c6406e200 0x7f8c640706b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c68006010 tx=0x7f8c6800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:19.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.597+0000 7f8c6ffff700 1 -- 172.21.15.32:0/3780556662 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8c600c2740 con 0x7f8c78100340 2024-05-06T21:36:19.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.902+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8c78107f30 con 0x7f8c78100340 2024-05-06T21:36:19.898 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:19 smithi032 ceph-mon[76650]: pgmap v287: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:19.898 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:19 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4152576352' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:36:19.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.902+0000 7f8c6ffff700 1 -- 172.21.15.32:0/3780556662 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8c6005ac00 con 0x7f8c78100340 2024-05-06T21:36:19.898 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:36:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.904+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8c6406e200 msgr2=0x7f8c640706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.904+0000 7f8c7d6e8700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8c6406e200 0x7f8c640706b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c68006010 tx=0x7f8c6800b540 comp rx=0 tx=0).stop 2024-05-06T21:36:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.904+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c78100340 msgr2=0x7f8c7819a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.904+0000 7f8c7d6e8700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c78100340 0x7f8c7819a8b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000b4b0 tx=0x7f8c6000b870 comp rx=0 tx=0).stop 2024-05-06T21:36:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.904+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 shutdown_connections 2024-05-06T21:36:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.904+0000 7f8c7d6e8700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8c6406e200 0x7f8c640706b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.904+0000 7f8c7d6e8700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c780ff140 0x7f8c78069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.904+0000 7f8c7d6e8700 1 --2- 172.21.15.32:0/3780556662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c78100340 0x7f8c7819a8b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.904+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 >> 172.21.15.32:0/3780556662 conn(0x7f8c780fa6d0 msgr2=0x7f8c78103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.905+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 shutdown_connections 2024-05-06T21:36:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:19.905+0000 7f8c7d6e8700 1 -- 172.21.15.32:0/3780556662 wait complete. 2024-05-06T21:36:20.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:19 smithi154 ceph-mon[63622]: pgmap v287: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:20.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:19 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4152576352' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:36:21.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:20 smithi032 ceph-mon[76650]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:21.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:20 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3780556662' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:36:21.038 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:36:21.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:20 smithi154 ceph-mon[63622]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:21.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:20 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3780556662' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:36:21.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:36:22.047 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:21 smithi032 ceph-mon[76650]: pgmap v288: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:22.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:21 smithi154 ceph-mon[63622]: pgmap v288: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:23.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:23 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:23.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:23 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:23.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:23 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:23.719 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:23 smithi032 ceph-mon[76650]: pgmap v289: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:23.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:23 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:23.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:23 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:23.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:23 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:23.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:23 smithi154 ceph-mon[63622]: pgmap v289: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:26.108 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:25 smithi032 ceph-mon[76650]: pgmap v290: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:26.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:25 smithi154 ceph-mon[63622]: pgmap v290: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:28.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:27 smithi154 ceph-mon[63622]: pgmap v291: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:28.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:27 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:28.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:27 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:28.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:27 smithi032 ceph-mon[76650]: pgmap v291: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:28.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:27 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:28.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:27 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:29.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:29.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:29 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:29.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:29 smithi032 ceph-mon[76650]: pgmap v292: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:29.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:29.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:29 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:29.863 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:29 smithi154 ceph-mon[63622]: pgmap v292: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:32.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:31 smithi154 ceph-mon[63622]: pgmap v293: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:32.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:31 smithi032 ceph-mon[76650]: pgmap v293: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:34.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:33 smithi154 ceph-mon[63622]: pgmap v294: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:34.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:33 smithi032 ceph-mon[76650]: pgmap v294: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:36.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: pgmap v295: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:36.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:36:36.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:36:36.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T21:36:36.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T21:36:36.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.115 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: Upgrade: Finalizing container_image settings 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-06T21:36:36.116 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-06T21:36:36.117 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: Upgrade: Complete! 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:36.118 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:36:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:36:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.119 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: pgmap v295: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:36.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.220 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: Upgrade: Finalizing container_image settings 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-06T21:36:36.221 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-06T21:36:36.222 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: Upgrade: Complete! 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:36.223 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:36:37.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:37.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:36:37.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:36:37.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:37.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:37.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:36:37.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:36:37.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:36:37.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:37.219 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:36:38.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:37 smithi154 ceph-mon[63622]: pgmap v296: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:38.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:37 smithi032 ceph-mon[76650]: pgmap v296: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:40.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:39 smithi154 ceph-mon[63622]: pgmap v297: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:40.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:39 smithi032 ceph-mon[76650]: pgmap v297: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:42.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:41 smithi154 ceph-mon[63622]: pgmap v298: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:42.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:41 smithi032 ceph-mon[76650]: pgmap v298: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:44.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:43 smithi154 ceph-mon[63622]: pgmap v299: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:44.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:43 smithi032 ceph-mon[76650]: pgmap v299: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:46.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:45 smithi154 ceph-mon[63622]: pgmap v300: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:46.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:45 smithi032 ceph-mon[76650]: pgmap v300: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:48.114 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:47 smithi154 ceph-mon[63622]: pgmap v301: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:48.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:47 smithi032 ceph-mon[76650]: pgmap v301: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:50.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.029+0000 7fae5c457700 1 -- 172.21.15.32:0/2366506704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae54100cd0 msgr2=0x7fae541030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:50.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.029+0000 7fae5c457700 1 --2- 172.21.15.32:0/2366506704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae54100cd0 0x7fae541030b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fae50009910 tx=0x7fae50009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.029+0000 7fae5c457700 1 -- 172.21.15.32:0/2366506704 shutdown_connections 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.029+0000 7fae5c457700 1 --2- 172.21.15.32:0/2366506704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae541035f0 0x7fae541059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.029+0000 7fae5c457700 1 --2- 172.21.15.32:0/2366506704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae54100cd0 0x7fae541030b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.029+0000 7fae5c457700 1 -- 172.21.15.32:0/2366506704 >> 172.21.15.32:0/2366506704 conn(0x7fae540fa6d0 msgr2=0x7fae540fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.029+0000 7fae5c457700 1 -- 172.21.15.32:0/2366506704 shutdown_connections 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.029+0000 7fae5c457700 1 -- 172.21.15.32:0/2366506704 wait complete. 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.030+0000 7fae5c457700 1 Processor -- start 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.030+0000 7fae5c457700 1 -- start start 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.030+0000 7fae5c457700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae54100cd0 0x7fae54195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.030+0000 7fae5c457700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae541035f0 0x7fae54195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.030+0000 7fae5c457700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae541965b0 con 0x7fae541035f0 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.030+0000 7fae5c457700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae541966f0 con 0x7fae54100cd0 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae599f2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae541035f0 0x7fae54195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae599f2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae541035f0 0x7fae54195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37520/0 (socket says 172.21.15.32:37520) 2024-05-06T21:36:50.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae599f2700 1 -- 172.21.15.32:0/2616808249 learned_addr learned my addr 172.21.15.32:0/2616808249 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:50.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae5a1f3700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae54100cd0 0x7fae54195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:50.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae599f2700 1 -- 172.21.15.32:0/2616808249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae54100cd0 msgr2=0x7fae54195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:50.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae599f2700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae54100cd0 0x7fae54195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:50.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae599f2700 1 -- 172.21.15.32:0/2616808249 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500095f0 con 0x7fae541035f0 2024-05-06T21:36:50.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae599f2700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae541035f0 0x7fae54195f90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae4400d8d0 tx=0x7fae4400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:50.028 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:49 smithi032 ceph-mon[76650]: pgmap v302: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:50.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae4b7fe700 1 -- 172.21.15.32:0/2616808249 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae440098a0 con 0x7fae541035f0 2024-05-06T21:36:50.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5419b1a0 con 0x7fae541035f0 2024-05-06T21:36:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae4b7fe700 1 -- 172.21.15.32:0/2616808249 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae44010460 con 0x7fae541035f0 2024-05-06T21:36:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.031+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5419b6f0 con 0x7fae541035f0 2024-05-06T21:36:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.032+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5418fc60 con 0x7fae541035f0 2024-05-06T21:36:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.033+0000 7fae4b7fe700 1 -- 172.21.15.32:0/2616808249 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae4400f5f0 con 0x7fae541035f0 2024-05-06T21:36:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.034+0000 7fae4b7fe700 1 -- 172.21.15.32:0/2616808249 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fae44009a00 con 0x7fae541035f0 2024-05-06T21:36:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.034+0000 7fae4b7fe700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fae4006e200 0x7fae400706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.034+0000 7fae4b7fe700 1 -- 172.21.15.32:0/2616808249 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fae4408e1b0 con 0x7fae541035f0 2024-05-06T21:36:50.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.034+0000 7fae5a1f3700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fae4006e200 0x7fae400706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:50.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.035+0000 7fae5a1f3700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fae4006e200 0x7fae400706b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae50006010 tx=0x7fae5000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:50.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.039+0000 7fae4b7fe700 1 -- 172.21.15.32:0/2616808249 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fae4405ae60 con 0x7fae541035f0 2024-05-06T21:36:50.112 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:49 smithi154 ceph-mon[63622]: pgmap v302: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:50.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.268+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae54061190 con 0x7fae4006e200 2024-05-06T21:36:50.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.269+0000 7fae4b7fe700 1 -- 172.21.15.32:0/2616808249 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fae54061190 con 0x7fae4006e200 2024-05-06T21:36:50.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fae4006e200 msgr2=0x7fae400706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:50.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fae4006e200 0x7fae400706b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae50006010 tx=0x7fae5000b540 comp rx=0 tx=0).stop 2024-05-06T21:36:50.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae541035f0 msgr2=0x7fae54195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:50.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae541035f0 0x7fae54195f90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae4400d8d0 tx=0x7fae4400dbe0 comp rx=0 tx=0).stop 2024-05-06T21:36:50.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 shutdown_connections 2024-05-06T21:36:50.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fae4006e200 0x7fae400706b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:50.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae54100cd0 0x7fae54195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:50.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 --2- 172.21.15.32:0/2616808249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae541035f0 0x7fae54195f90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:50.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 >> 172.21.15.32:0/2616808249 conn(0x7fae540fa6d0 msgr2=0x7fae540fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:50.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 shutdown_connections 2024-05-06T21:36:50.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:50.271+0000 7fae5c457700 1 -- 172.21.15.32:0/2616808249 wait complete. 2024-05-06T21:36:50.968 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:50 smithi032 ceph-mon[76650]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:50.968 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:36:50.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph orch ps' 2024-05-06T21:36:51.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:50 smithi154 ceph-mon[63622]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:51.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:36:51.262 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:36:51.968 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:51 smithi032 ceph-mon[76650]: pgmap v303: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:52.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:51 smithi154 ceph-mon[63622]: pgmap v303: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.013+0000 7f23c209b700 1 -- 172.21.15.32:0/3462532522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 msgr2=0x7f23bc104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.013+0000 7f23c209b700 1 --2- 172.21.15.32:0/3462532522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 0x7f23bc104e50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009910 tx=0x7f23a4009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.013+0000 7f23c209b700 1 -- 172.21.15.32:0/3462532522 shutdown_connections 2024-05-06T21:36:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.013+0000 7f23c209b700 1 --2- 172.21.15.32:0/3462532522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 0x7f23bc104e50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.013+0000 7f23c209b700 1 --2- 172.21.15.32:0/3462532522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc1004e0 0x7f23bc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.013+0000 7f23c209b700 1 -- 172.21.15.32:0/3462532522 >> 172.21.15.32:0/3462532522 conn(0x7f23bc0fbda0 msgr2=0x7f23bc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.013+0000 7f23c209b700 1 -- 172.21.15.32:0/3462532522 shutdown_connections 2024-05-06T21:36:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.013+0000 7f23c209b700 1 -- 172.21.15.32:0/3462532522 wait complete. 2024-05-06T21:36:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.014+0000 7f23c209b700 1 Processor -- start 2024-05-06T21:36:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.014+0000 7f23c209b700 1 -- start start 2024-05-06T21:36:53.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.014+0000 7f23c209b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc1004e0 0x7f23bc073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:53.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.014+0000 7f23c209b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 0x7f23bc073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:53.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.014+0000 7f23c209b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc073ad0 con 0x7f23bc100e80 2024-05-06T21:36:53.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.014+0000 7f23c209b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc073c10 con 0x7f23bc1004e0 2024-05-06T21:36:53.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.014+0000 7f23b2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 0x7f23bc073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:53.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.014+0000 7f23b2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 0x7f23bc073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53546/0 (socket says 172.21.15.32:53546) 2024-05-06T21:36:53.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.014+0000 7f23b2ffd700 1 -- 172.21.15.32:0/779448611 learned_addr learned my addr 172.21.15.32:0/779448611 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23bb7fe700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc1004e0 0x7f23bc073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23b2ffd700 1 -- 172.21.15.32:0/779448611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc1004e0 msgr2=0x7f23bc073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23b2ffd700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc1004e0 0x7f23bc073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23b2ffd700 1 -- 172.21.15.32:0/779448611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40095f0 con 0x7f23bc100e80 2024-05-06T21:36:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23b2ffd700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 0x7f23bc073590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f23a40092e0 tx=0x7f23a400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23b97fa700 1 -- 172.21.15.32:0/779448611 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a401d070 con 0x7f23bc100e80 2024-05-06T21:36:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23b97fa700 1 -- 172.21.15.32:0/779448611 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23a400f460 con 0x7f23bc100e80 2024-05-06T21:36:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc073e90 con 0x7f23bc100e80 2024-05-06T21:36:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23b97fa700 1 -- 172.21.15.32:0/779448611 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a40175d0 con 0x7f23bc100e80 2024-05-06T21:36:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.015+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc1a23c0 con 0x7f23bc100e80 2024-05-06T21:36:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.016+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc108850 con 0x7f23bc100e80 2024-05-06T21:36:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.017+0000 7f23b97fa700 1 -- 172.21.15.32:0/779448611 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f23a400f5d0 con 0x7f23bc100e80 2024-05-06T21:36:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.018+0000 7f23b97fa700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a806e200 0x7f23a80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.018+0000 7f23b97fa700 1 -- 172.21.15.32:0/779448611 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f23a408f7b0 con 0x7f23bc100e80 2024-05-06T21:36:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.018+0000 7f23bb7fe700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a806e200 0x7f23a80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.018+0000 7f23bb7fe700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a806e200 0x7f23a80706b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f23ac005950 tx=0x7f23ac00a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:53.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.023+0000 7f23b97fa700 1 -- 172.21.15.32:0/779448611 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f23a4058930 con 0x7f23bc100e80 2024-05-06T21:36:53.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.240+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f23bc061190 con 0x7f23a806e200 2024-05-06T21:36:53.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.251+0000 7f23b97fa700 1 -- 172.21.15.32:0/779448611 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f23bc061190 con 0x7f23a806e200 2024-05-06T21:36:53.247 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:36:53.249 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (54s) 25s ago 18m 16.7M - 0.25.0 c8568f914cd2 e589f3449d48 2024-05-06T21:36:53.249 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (113s) 25s ago 18m 8174k - 19.0.0-2497-gf273489c 3b8ac54a9a71 e2228993e952 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (108s) 86s ago 17m 7532k - 19.0.0-2497-gf273489c 3b8ac54a9a71 dba77ef37133 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (7m) 25s ago 18m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (7m) 86s ago 17m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (31s) 25s ago 18m 53.0M - 9.4.12 2bacad6d85d8 941541a1d40f 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (3m) 25s ago 12m 70.4M - 19.0.0-2497-gf273489c 3b8ac54a9a71 6cd9ab5eb234 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (2m) 25s ago 12m 21.3M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5c54ca7e9a32 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (2m) 86s ago 12m 13.7M - 19.0.0-2497-gf273489c 3b8ac54a9a71 df23e8b47eff 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (2m) 86s ago 12m 16.0M - 19.0.0-2497-gf273489c 3b8ac54a9a71 12b4c06cf5bc 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (9m) 25s ago 20m 521M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:36:53.250 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (9m) 86s ago 17m 452M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (8m) 25s ago 20m 57.6M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (8m) 86s ago 17m 45.6M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (93s) 25s ago 18m 15.3M - 1.5.0 0da6a335fe13 2265cff718e2 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (89s) 86s ago 17m 3376k - 1.5.0 0da6a335fe13 4f95bf7624ed 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (7m) 25s ago 16m 167M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (6m) 25s ago 16m 125M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (5m) 25s ago 15m 102M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (5m) 86s ago 15m 105M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (4m) 86s ago 14m 103M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (4m) 86s ago 14m 99.3M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 8b513e97a420 2024-05-06T21:36:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (71s) 25s ago 18m 60.6M - 2.43.0 a07b618ecd1d 6907f55d469a 2024-05-06T21:36:53.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a806e200 msgr2=0x7f23a80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:53.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a806e200 0x7f23a80706b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f23ac005950 tx=0x7f23ac00a300 comp rx=0 tx=0).stop 2024-05-06T21:36:53.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 msgr2=0x7f23bc073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:53.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 0x7f23bc073590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f23a40092e0 tx=0x7f23a400bd70 comp rx=0 tx=0).stop 2024-05-06T21:36:53.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 shutdown_connections 2024-05-06T21:36:53.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f23a806e200 0x7f23a80706b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:53.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23bc1004e0 0x7f23bc073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:53.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 --2- 172.21.15.32:0/779448611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23bc100e80 0x7f23bc073590 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:53.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 >> 172.21.15.32:0/779448611 conn(0x7f23bc0fbda0 msgr2=0x7f23bc0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:53.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 shutdown_connections 2024-05-06T21:36:53.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:53.253+0000 7f23c209b700 1 -- 172.21.15.32:0/779448611 wait complete. 2024-05-06T21:36:53.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph orch upgrade status' 2024-05-06T21:36:54.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:53 smithi154 ceph-mon[63622]: pgmap v304: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:54.113 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:53 smithi154 ceph-mon[63622]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:54.201 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:36:54.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:53 smithi032 ceph-mon[76650]: pgmap v304: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:54.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:53 smithi032 ceph-mon[76650]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:55.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.940+0000 7f24f435b700 1 -- 172.21.15.32:0/870091006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 msgr2=0x7f24ec1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:55.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.940+0000 7f24f435b700 1 --2- 172.21.15.32:0/870091006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 0x7f24ec1008b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009910 tx=0x7f24e8009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:55.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.940+0000 7f24f435b700 1 -- 172.21.15.32:0/870091006 shutdown_connections 2024-05-06T21:36:55.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.940+0000 7f24f435b700 1 --2- 172.21.15.32:0/870091006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec100e80 0x7f24ec104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:55.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.940+0000 7f24f435b700 1 --2- 172.21.15.32:0/870091006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 0x7f24ec1008b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:55.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.940+0000 7f24f435b700 1 -- 172.21.15.32:0/870091006 >> 172.21.15.32:0/870091006 conn(0x7f24ec0fbda0 msgr2=0x7f24ec0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:55.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.940+0000 7f24f435b700 1 -- 172.21.15.32:0/870091006 shutdown_connections 2024-05-06T21:36:55.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.940+0000 7f24f435b700 1 -- 172.21.15.32:0/870091006 wait complete. 2024-05-06T21:36:55.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.941+0000 7f24f435b700 1 Processor -- start 2024-05-06T21:36:55.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.941+0000 7f24f435b700 1 -- start start 2024-05-06T21:36:55.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f435b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 0x7f24ec195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:55.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f435b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec100e80 0x7f24ec196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:55.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f435b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec196a80 con 0x7f24ec1004e0 2024-05-06T21:36:55.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f435b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec196bc0 con 0x7f24ec100e80 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f20f7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 0x7f24ec195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f20f7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 0x7f24ec195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53558/0 (socket says 172.21.15.32:53558) 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f20f7700 1 -- 172.21.15.32:0/273122754 learned_addr learned my addr 172.21.15.32:0/273122754 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f18f6700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec100e80 0x7f24ec196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f20f7700 1 -- 172.21.15.32:0/273122754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec100e80 msgr2=0x7f24ec196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f20f7700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec100e80 0x7f24ec196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f20f7700 1 -- 172.21.15.32:0/273122754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e80095f0 con 0x7f24ec1004e0 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f20f7700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 0x7f24ec195ef0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f24e8006010 tx=0x7f24e800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24df7fe700 1 -- 172.21.15.32:0/273122754 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e801d070 con 0x7f24ec1004e0 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ec19a9b0 con 0x7f24ec1004e0 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24df7fe700 1 -- 172.21.15.32:0/273122754 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24e8004fb0 con 0x7f24ec1004e0 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24df7fe700 1 -- 172.21.15.32:0/273122754 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e8022ea0 con 0x7f24ec1004e0 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.942+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ec19aea0 con 0x7f24ec1004e0 2024-05-06T21:36:55.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.943+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ec1087f0 con 0x7f24ec1004e0 2024-05-06T21:36:55.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.944+0000 7f24df7fe700 1 -- 172.21.15.32:0/273122754 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f24e8022470 con 0x7f24ec1004e0 2024-05-06T21:36:55.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.944+0000 7f24df7fe700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f24d806e200 0x7f24d80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:55.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.945+0000 7f24df7fe700 1 -- 172.21.15.32:0/273122754 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f24e808f870 con 0x7f24ec1004e0 2024-05-06T21:36:55.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.945+0000 7f24f18f6700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f24d806e200 0x7f24d80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:55.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.945+0000 7f24f18f6700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f24d806e200 0x7f24d80706b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f24e0005ea0 tx=0x7f24e0005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:55.949+0000 7f24df7fe700 1 -- 172.21.15.32:0/273122754 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f24e8058aa0 con 0x7f24ec1004e0 2024-05-06T21:36:55.967 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:55 smithi032 ceph-mon[76650]: pgmap v305: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:56.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.181+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24ec19b180 con 0x7f24d806e200 2024-05-06T21:36:56.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.182+0000 7f24df7fe700 1 -- 172.21.15.32:0/273122754 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f24ec19b180 con 0x7f24d806e200 2024-05-06T21:36:56.177 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:36:56.177 INFO:teuthology.orchestra.run.smithi032.stdout: "target_image": null, 2024-05-06T21:36:56.177 INFO:teuthology.orchestra.run.smithi032.stdout: "in_progress": false, 2024-05-06T21:36:56.178 INFO:teuthology.orchestra.run.smithi032.stdout: "which": "", 2024-05-06T21:36:56.178 INFO:teuthology.orchestra.run.smithi032.stdout: "services_complete": [], 2024-05-06T21:36:56.178 INFO:teuthology.orchestra.run.smithi032.stdout: "progress": null, 2024-05-06T21:36:56.178 INFO:teuthology.orchestra.run.smithi032.stdout: "message": "", 2024-05-06T21:36:56.178 INFO:teuthology.orchestra.run.smithi032.stdout: "is_paused": false 2024-05-06T21:36:56.178 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f24d806e200 msgr2=0x7f24d80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f24d806e200 0x7f24d80706b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f24e0005ea0 tx=0x7f24e0005e30 comp rx=0 tx=0).stop 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 msgr2=0x7f24ec195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 0x7f24ec195ef0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f24e8006010 tx=0x7f24e800be20 comp rx=0 tx=0).stop 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 shutdown_connections 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f24d806e200 0x7f24d80706b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ec1004e0 0x7f24ec195ef0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 --2- 172.21.15.32:0/273122754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec100e80 0x7f24ec196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 >> 172.21.15.32:0/273122754 conn(0x7f24ec0fbda0 msgr2=0x7f24ec0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.184+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 shutdown_connections 2024-05-06T21:36:56.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:56.185+0000 7f24f435b700 1 -- 172.21.15.32:0/273122754 wait complete. 2024-05-06T21:36:56.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:55 smithi154 ceph-mon[63622]: pgmap v305: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:56.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph health detail' 2024-05-06T21:36:57.094 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:36:57.216 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:56 smithi032 ceph-mon[76650]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:57.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:56 smithi154 ceph-mon[63622]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:36:58.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:57 smithi032 ceph-mon[76650]: pgmap v306: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:58.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:57 smithi154 ceph-mon[63622]: pgmap v306: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:36:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.879+0000 7f00be5c5700 1 -- 172.21.15.32:0/1318944845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b8101c00 msgr2=0x7f00b810a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.879+0000 7f00be5c5700 1 --2- 172.21.15.32:0/1318944845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b8101c00 0x7f00b810a2d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009910 tx=0x7f00ac009c20 comp rx=0 tx=0).stop 2024-05-06T21:36:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.879+0000 7f00be5c5700 1 -- 172.21.15.32:0/1318944845 shutdown_connections 2024-05-06T21:36:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.879+0000 7f00be5c5700 1 --2- 172.21.15.32:0/1318944845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b8101c00 0x7f00b810a2d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.879+0000 7f00be5c5700 1 --2- 172.21.15.32:0/1318944845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b81012f0 0x7f00b81016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.879+0000 7f00be5c5700 1 -- 172.21.15.32:0/1318944845 >> 172.21.15.32:0/1318944845 conn(0x7f00b80fac60 msgr2=0x7f00b80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.879+0000 7f00be5c5700 1 -- 172.21.15.32:0/1318944845 shutdown_connections 2024-05-06T21:36:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.879+0000 7f00be5c5700 1 -- 172.21.15.32:0/1318944845 wait complete. 2024-05-06T21:36:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.880+0000 7f00be5c5700 1 Processor -- start 2024-05-06T21:36:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.880+0000 7f00be5c5700 1 -- start start 2024-05-06T21:36:58.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.880+0000 7f00be5c5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b81012f0 0x7f00b80ff120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.880+0000 7f00be5c5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8101c00 0x7f00b80ff660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.880+0000 7f00be5c5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80ffba0 con 0x7f00b81012f0 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.880+0000 7f00be5c5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80ffce0 con 0x7f00b8101c00 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b81012f0 0x7f00b80ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b81012f0 0x7f00b80ff120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53582/0 (socket says 172.21.15.32:53582) 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b7fff700 1 -- 172.21.15.32:0/4263246066 learned_addr learned my addr 172.21.15.32:0/4263246066 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b77fe700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8101c00 0x7f00b80ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b7fff700 1 -- 172.21.15.32:0/4263246066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8101c00 msgr2=0x7f00b80ff660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b7fff700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8101c00 0x7f00b80ff660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b7fff700 1 -- 172.21.15.32:0/4263246066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac0095f0 con 0x7f00b81012f0 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b77fe700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8101c00 0x7f00b80ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b7fff700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b81012f0 0x7f00b80ff120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00a800d900 tx=0x7f00a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b57fa700 1 -- 172.21.15.32:0/4263246066 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00a80041f0 con 0x7f00b81012f0 2024-05-06T21:36:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b57fa700 1 -- 172.21.15.32:0/4263246066 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00a8004cf0 con 0x7f00b81012f0 2024-05-06T21:36:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b81a2060 con 0x7f00b81012f0 2024-05-06T21:36:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00b57fa700 1 -- 172.21.15.32:0/4263246066 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00a800b750 con 0x7f00b81012f0 2024-05-06T21:36:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.881+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b81a2470 con 0x7f00b81012f0 2024-05-06T21:36:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.882+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b8107970 con 0x7f00b81012f0 2024-05-06T21:36:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.883+0000 7f00b57fa700 1 -- 172.21.15.32:0/4263246066 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f00a8004350 con 0x7f00b81012f0 2024-05-06T21:36:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.884+0000 7f00b57fa700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f00a006e200 0x7f00a00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:36:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.884+0000 7f00b77fe700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f00a006e200 0x7f00a00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:36:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.884+0000 7f00b57fa700 1 -- 172.21.15.32:0/4263246066 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f00a808e400 con 0x7f00b81012f0 2024-05-06T21:36:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.884+0000 7f00b77fe700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f00a006e200 0x7f00a00706b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f00ac006010 tx=0x7f00ac00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:36:58.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:58.889+0000 7f00b57fa700 1 -- 172.21.15.32:0/4263246066 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f00a8057580 con 0x7f00b81012f0 2024-05-06T21:36:59.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.191+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f00b8107350 con 0x7f00b81012f0 2024-05-06T21:36:59.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.192+0000 7f00b57fa700 1 -- 172.21.15.32:0/4263246066 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f00a805ac40 con 0x7f00b81012f0 2024-05-06T21:36:59.187 INFO:teuthology.orchestra.run.smithi032.stdout:HEALTH_OK 2024-05-06T21:36:59.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f00a006e200 msgr2=0x7f00a00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f00a006e200 0x7f00a00706b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f00ac006010 tx=0x7f00ac00b540 comp rx=0 tx=0).stop 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b81012f0 msgr2=0x7f00b80ff120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b81012f0 0x7f00b80ff120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00a800d900 tx=0x7f00a800dcc0 comp rx=0 tx=0).stop 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 shutdown_connections 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f00a006e200 0x7f00a00706b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00b81012f0 0x7f00b80ff120 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 --2- 172.21.15.32:0/4263246066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8101c00 0x7f00b80ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 >> 172.21.15.32:0/4263246066 conn(0x7f00b80fac60 msgr2=0x7f00b8104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 shutdown_connections 2024-05-06T21:36:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:36:59.194+0000 7f00be5c5700 1 -- 172.21.15.32:0/4263246066 wait complete. 2024-05-06T21:36:59.874 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph versions' 2024-05-06T21:37:00.090 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:37:00.213 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:59 smithi032 ceph-mon[76650]: pgmap v307: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:00.213 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:36:59 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4263246066' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:37:00.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:59 smithi154 ceph-mon[63622]: pgmap v307: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:00.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:36:59 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4263246066' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.806+0000 7f2462cb6700 1 -- 172.21.15.32:0/2472320464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 msgr2=0x7f245c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.806+0000 7f2462cb6700 1 --2- 172.21.15.32:0/2472320464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 0x7f245c100040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2448009910 tx=0x7f2448009c20 comp rx=0 tx=0).stop 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.806+0000 7f2462cb6700 1 -- 172.21.15.32:0/2472320464 shutdown_connections 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.806+0000 7f2462cb6700 1 --2- 172.21.15.32:0/2472320464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 0x7f245c100040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.806+0000 7f2462cb6700 1 --2- 172.21.15.32:0/2472320464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c104130 0x7f245c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.806+0000 7f2462cb6700 1 -- 172.21.15.32:0/2472320464 >> 172.21.15.32:0/2472320464 conn(0x7f245c075130 msgr2=0x7f245c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.806+0000 7f2462cb6700 1 -- 172.21.15.32:0/2472320464 shutdown_connections 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.806+0000 7f2462cb6700 1 -- 172.21.15.32:0/2472320464 wait complete. 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f2462cb6700 1 Processor -- start 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f2462cb6700 1 -- start start 2024-05-06T21:37:01.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f2462cb6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 0x7f245c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f2462cb6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c104130 0x7f245c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f2462cb6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c196b50 con 0x7f245c0ffbd0 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f2462cb6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c19a8e0 con 0x7f245c104130 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f2460a52700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 0x7f245c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f2460a52700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 0x7f245c195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53644/0 (socket says 172.21.15.32:53644) 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f2460a52700 1 -- 172.21.15.32:0/459649180 learned_addr learned my addr 172.21.15.32:0/459649180 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.807+0000 7f245bfff700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c104130 0x7f245c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f2460a52700 1 -- 172.21.15.32:0/459649180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c104130 msgr2=0x7f245c196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f2460a52700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c104130 0x7f245c196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f2460a52700 1 -- 172.21.15.32:0/459649180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480095f0 con 0x7f245c0ffbd0 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f245bfff700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c104130 0x7f245c196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:37:01.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f2460a52700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 0x7f245c195f30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f245000b4b0 tx=0x7f245000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:37:01.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f2459ffb700 1 -- 172.21.15.32:0/459649180 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2450011800 con 0x7f245c0ffbd0 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f2459ffb700 1 -- 172.21.15.32:0/459649180 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2450011e20 con 0x7f245c0ffbd0 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c19abc0 con 0x7f245c0ffbd0 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f2459ffb700 1 -- 172.21.15.32:0/459649180 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f245000f2e0 con 0x7f245c0ffbd0 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.808+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c19b110 con 0x7f245c0ffbd0 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.809+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c1086a0 con 0x7f245c0ffbd0 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.810+0000 7f2459ffb700 1 -- 172.21.15.32:0/459649180 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2450010380 con 0x7f245c0ffbd0 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.810+0000 7f2459ffb700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f244c06e200 0x7f244c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.810+0000 7f2459ffb700 1 -- 172.21.15.32:0/459649180 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f245008deb0 con 0x7f245c0ffbd0 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.810+0000 7f245bfff700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f244c06e200 0x7f244c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:37:01.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.811+0000 7f245bfff700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f244c06e200 0x7f244c0706b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f244800b5c0 tx=0x7f244801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:37:01.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:01.815+0000 7f2459ffb700 1 -- 172.21.15.32:0/459649180 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2450057030 con 0x7f245c0ffbd0 2024-05-06T21:37:02.112 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:01 smithi154 ceph-mon[63622]: pgmap v308: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:02.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.121+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f245c04f2a0 con 0x7f245c0ffbd0 2024-05-06T21:37:02.116 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:01 smithi032 ceph-mon[76650]: pgmap v308: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.121+0000 7f2459ffb700 1 -- 172.21.15.32:0/459649180 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f245005a6f0 con 0x7f245c0ffbd0 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:37:02.117 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:37:02.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:37:02.118 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:37:02.118 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 4 2024-05-06T21:37:02.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:37:02.118 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:37:02.118 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 14 2024-05-06T21:37:02.118 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:37:02.118 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:37:02.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f244c06e200 msgr2=0x7f244c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:37:02.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f244c06e200 0x7f244c0706b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f244800b5c0 tx=0x7f244801a040 comp rx=0 tx=0).stop 2024-05-06T21:37:02.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 msgr2=0x7f245c195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:37:02.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 0x7f245c195f30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f245000b4b0 tx=0x7f245000b870 comp rx=0 tx=0).stop 2024-05-06T21:37:02.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 shutdown_connections 2024-05-06T21:37:02.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f244c06e200 0x7f244c0706b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:37:02.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f245c0ffbd0 0x7f245c195f30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:37:02.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 --2- 172.21.15.32:0/459649180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f245c104130 0x7f245c196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:37:02.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 >> 172.21.15.32:0/459649180 conn(0x7f245c075130 msgr2=0x7f245c068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:37:02.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 shutdown_connections 2024-05-06T21:37:02.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:37:02.124+0000 7f2462cb6700 1 -- 172.21.15.32:0/459649180 wait complete. 2024-05-06T21:37:02.850 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-05-06T21:37:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:37:03.194 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:02 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/459649180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:37:03.320 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:02 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/459649180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:37:04.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:03 smithi032 ceph-mon[76650]: pgmap v309: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:04.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:03 smithi154 ceph-mon[63622]: pgmap v309: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:04.816 INFO:teuthology.orchestra.run.smithi032.stdout:wait for servicemap items w/ changing names to refresh 2024-05-06T21:37:05.471 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'sleep 60' 2024-05-06T21:37:05.694 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:37:06.147 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:05 smithi032 ceph-mon[76650]: pgmap v310: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:06.147 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:37:06.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:05 smithi154 ceph-mon[63622]: pgmap v310: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:06.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:37:08.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:07 smithi032 ceph-mon[76650]: pgmap v311: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:08.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:07 smithi154 ceph-mon[63622]: pgmap v311: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:10.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:09 smithi032 ceph-mon[76650]: pgmap v312: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:10.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:09 smithi154 ceph-mon[63622]: pgmap v312: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:12.112 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:11 smithi154 ceph-mon[63622]: pgmap v313: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:12.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:11 smithi032 ceph-mon[76650]: pgmap v313: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:14.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:13 smithi032 ceph-mon[76650]: pgmap v314: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:14.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:13 smithi154 ceph-mon[63622]: pgmap v314: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:16.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:15 smithi032 ceph-mon[76650]: pgmap v315: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:16.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:15 smithi154 ceph-mon[63622]: pgmap v315: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:18.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:17 smithi032 ceph-mon[76650]: pgmap v316: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:18.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:17 smithi154 ceph-mon[63622]: pgmap v316: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:20.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:19 smithi032 ceph-mon[76650]: pgmap v317: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:20.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:19 smithi154 ceph-mon[63622]: pgmap v317: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:21.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:20 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:37:21.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:20 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:37:22.112 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:21 smithi154 ceph-mon[63622]: pgmap v318: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:22.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:21 smithi032 ceph-mon[76650]: pgmap v318: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:24.013 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:23 smithi032 ceph-mon[76650]: pgmap v319: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:24.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:23 smithi154 ceph-mon[63622]: pgmap v319: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:26.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:25 smithi032 ceph-mon[76650]: pgmap v320: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:26.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:25 smithi154 ceph-mon[63622]: pgmap v320: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:28.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:27 smithi032 ceph-mon[76650]: pgmap v321: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:28.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:27 smithi154 ceph-mon[63622]: pgmap v321: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:30.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:29 smithi032 ceph-mon[76650]: pgmap v322: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:30.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:29 smithi154 ceph-mon[63622]: pgmap v322: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:32.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:31 smithi032 ceph-mon[76650]: pgmap v323: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:32.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:31 smithi154 ceph-mon[63622]: pgmap v323: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:34.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:33 smithi032 ceph-mon[76650]: pgmap v324: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:34.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:33 smithi154 ceph-mon[63622]: pgmap v324: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:36.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:35 smithi032 ceph-mon[76650]: pgmap v325: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:36.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:37:36.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:35 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:37:36.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:35 smithi154 ceph-mon[63622]: pgmap v325: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:36.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:37:36.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:35 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:37:37.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:37:37.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:37:37.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:37:37.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T21:37:37.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T21:37:37.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' 2024-05-06T21:37:38.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:37 smithi032 ceph-mon[76650]: pgmap v326: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:38.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:37 smithi154 ceph-mon[63622]: pgmap v326: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:40.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:39 smithi032 ceph-mon[76650]: pgmap v327: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:40.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:39 smithi154 ceph-mon[63622]: pgmap v327: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:42.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:41 smithi032 ceph-mon[76650]: pgmap v328: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:42.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:41 smithi154 ceph-mon[63622]: pgmap v328: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:44.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:43 smithi032 ceph-mon[76650]: pgmap v329: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:44.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:43 smithi154 ceph-mon[63622]: pgmap v329: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:46.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:45 smithi032 ceph-mon[76650]: pgmap v330: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:46.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:45 smithi154 ceph-mon[63622]: pgmap v330: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:48.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:47 smithi032 ceph-mon[76650]: pgmap v331: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:48.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:47 smithi154 ceph-mon[63622]: pgmap v331: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:50.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:49 smithi032 ceph-mon[76650]: pgmap v332: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:50.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:49 smithi154 ceph-mon[63622]: pgmap v332: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:51.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:50 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:37:51.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:50 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:37:52.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:51 smithi032 ceph-mon[76650]: pgmap v333: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:52.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:51 smithi154 ceph-mon[63622]: pgmap v333: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:54.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:53 smithi032 ceph-mon[76650]: pgmap v334: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:54.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:53 smithi154 ceph-mon[63622]: pgmap v334: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:56.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:55 smithi032 ceph-mon[76650]: pgmap v335: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:56.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:55 smithi154 ceph-mon[63622]: pgmap v335: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:58.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:57 smithi032 ceph-mon[76650]: pgmap v336: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:37:58.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:57 smithi154 ceph-mon[63622]: pgmap v336: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:00.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:37:59 smithi032 ceph-mon[76650]: pgmap v337: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:00.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:37:59 smithi154 ceph-mon[63622]: pgmap v337: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:02.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:01 smithi154 ceph-mon[63622]: pgmap v338: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:02.467 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:01 smithi032 ceph-mon[76650]: pgmap v338: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:04.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:03 smithi154 ceph-mon[63622]: pgmap v339: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:04.467 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:03 smithi032 ceph-mon[76650]: pgmap v339: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:06.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:05 smithi154 ceph-mon[63622]: pgmap v340: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:06.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:05 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:38:06.467 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:05 smithi032 ceph-mon[76650]: pgmap v340: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:06.468 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:05 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:38:08.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph orch ps' 2024-05-06T21:38:08.285 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:38:08.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:07 smithi154 ceph-mon[63622]: pgmap v341: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:08.411 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:07 smithi032 ceph-mon[76650]: pgmap v341: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:09.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.991+0000 7f2571b38700 1 -- 172.21.15.32:0/3833896382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c0ffbd0 msgr2=0x7f256c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:09.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.991+0000 7f2571b38700 1 --2- 172.21.15.32:0/3833896382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c0ffbd0 0x7f256c100040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2560009910 tx=0x7f2560009c20 comp rx=0 tx=0).stop 2024-05-06T21:38:09.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.991+0000 7f2571b38700 1 -- 172.21.15.32:0/3833896382 shutdown_connections 2024-05-06T21:38:09.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.991+0000 7f2571b38700 1 --2- 172.21.15.32:0/3833896382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c0ffbd0 0x7f256c100040 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:09.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.991+0000 7f2571b38700 1 --2- 172.21.15.32:0/3833896382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f256c104130 0x7f256c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:09.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.991+0000 7f2571b38700 1 -- 172.21.15.32:0/3833896382 >> 172.21.15.32:0/3833896382 conn(0x7f256c075130 msgr2=0x7f256c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:09.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.991+0000 7f2571b38700 1 -- 172.21.15.32:0/3833896382 shutdown_connections 2024-05-06T21:38:09.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.991+0000 7f2571b38700 1 -- 172.21.15.32:0/3833896382 wait complete. 2024-05-06T21:38:09.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f2571b38700 1 Processor -- start 2024-05-06T21:38:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f2571b38700 1 -- start start 2024-05-06T21:38:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f2571b38700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f256c0ffbd0 0x7f256c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f2571b38700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c104130 0x7f256c197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f2571b38700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c197860 con 0x7f256c104130 2024-05-06T21:38:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f2571b38700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c1979a0 con 0x7f256c0ffbd0 2024-05-06T21:38:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f256affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c104130 0x7f256c197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f256affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c104130 0x7f256c197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58080/0 (socket says 172.21.15.32:58080) 2024-05-06T21:38:09.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f256affd700 1 -- 172.21.15.32:0/1490879646 learned_addr learned my addr 172.21.15.32:0/1490879646 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:09.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.992+0000 7f256b7fe700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f256c0ffbd0 0x7f256c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:09.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.993+0000 7f256affd700 1 -- 172.21.15.32:0/1490879646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f256c0ffbd0 msgr2=0x7f256c196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:09.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.993+0000 7f256affd700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f256c0ffbd0 0x7f256c196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:09.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.993+0000 7f256affd700 1 -- 172.21.15.32:0/1490879646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600095f0 con 0x7f256c104130 2024-05-06T21:38:09.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.993+0000 7f256affd700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c104130 0x7f256c197180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2560000c00 tx=0x7f256000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:09.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.993+0000 7f2568ff9700 1 -- 172.21.15.32:0/1490879646 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f256001d070 con 0x7f256c104130 2024-05-06T21:38:09.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.993+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c19fcb0 con 0x7f256c104130 2024-05-06T21:38:09.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.993+0000 7f2568ff9700 1 -- 172.21.15.32:0/1490879646 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f256000f460 con 0x7f256c104130 2024-05-06T21:38:09.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.993+0000 7f2568ff9700 1 -- 172.21.15.32:0/1490879646 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2560005e20 con 0x7f256c104130 2024-05-06T21:38:09.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.993+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c1a0120 con 0x7f256c104130 2024-05-06T21:38:09.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.994+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c04f2a0 con 0x7f256c104130 2024-05-06T21:38:09.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.995+0000 7f2568ff9700 1 -- 172.21.15.32:0/1490879646 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f256000f5d0 con 0x7f256c104130 2024-05-06T21:38:09.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.995+0000 7f2568ff9700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f255406e200 0x7f25540706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:09.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.995+0000 7f2568ff9700 1 -- 172.21.15.32:0/1490879646 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f256008f810 con 0x7f256c104130 2024-05-06T21:38:09.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.995+0000 7f256b7fe700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f255406e200 0x7f25540706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:09.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:09.996+0000 7f256b7fe700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f255406e200 0x7f25540706b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f255c005950 tx=0x7f255c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:09.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.000+0000 7f2568ff9700 1 -- 172.21.15.32:0/1490879646 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2560058a50 con 0x7f256c104130 2024-05-06T21:38:10.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.220+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 --> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f256c0ff240 con 0x7f255406e200 2024-05-06T21:38:10.215 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:09 smithi032 ceph-mon[76650]: pgmap v342: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.232+0000 7f2568ff9700 1 -- 172.21.15.32:0/1490879646 <== mgr.34104 v2:172.21.15.32:6800/2910360300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f256c0ff240 con 0x7f255406e200 2024-05-06T21:38:10.226 INFO:teuthology.orchestra.run.smithi032.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:alertmanager.smithi032 smithi032 *:9093,9094 running (2m) 102s ago 19m 16.7M - 0.25.0 c8568f914cd2 e589f3449d48 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi032 smithi032 running (3m) 102s ago 20m 8174k - 19.0.0-2497-gf273489c 3b8ac54a9a71 e2228993e952 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-exporter.smithi154 smithi154 running (3m) 2m ago 19m 7532k - 19.0.0-2497-gf273489c 3b8ac54a9a71 dba77ef37133 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi032 smithi032 running (8m) 102s ago 20m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 4d3aecd7d89a 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:crash.smithi154 smithi154 running (8m) 2m ago 18m 6660k - 19.0.0-2497-gf273489c 3b8ac54a9a71 be0bdf869f5b 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:grafana.smithi032 smithi032 *:3000 running (108s) 102s ago 19m 53.0M - 9.4.12 2bacad6d85d8 941541a1d40f 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.fpdhzg smithi032 running (4m) 102s ago 14m 70.4M - 19.0.0-2497-gf273489c 3b8ac54a9a71 6cd9ab5eb234 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi032.jbgmwi smithi032 running (4m) 102s ago 14m 21.3M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5c54ca7e9a32 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.rizdbu smithi154 running (3m) 2m ago 14m 13.7M - 19.0.0-2497-gf273489c 3b8ac54a9a71 df23e8b47eff 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:mds.cephfs.smithi154.xfmqxf smithi154 running (3m) 2m ago 14m 16.0M - 19.0.0-2497-gf273489c 3b8ac54a9a71 12b4c06cf5bc 2024-05-06T21:38:10.227 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi032.ecoohh smithi032 *:8443,9283,8765 running (11m) 102s ago 21m 521M - 19.0.0-2497-gf273489c 3b8ac54a9a71 696a77c96250 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:mgr.smithi154.kilvol smithi154 *:8443,9283,8765 running (10m) 2m ago 18m 452M - 19.0.0-2497-gf273489c 3b8ac54a9a71 5fd5d26d412e 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi032 smithi032 running (9m) 102s ago 21m 57.6M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 6db9bd569f47 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:mon.smithi154 smithi154 running (9m) 2m ago 18m 45.6M 2048M 19.0.0-2497-gf273489c 3b8ac54a9a71 88f330a92df2 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi032 smithi032 *:9100 running (2m) 102s ago 19m 15.3M - 1.5.0 0da6a335fe13 2265cff718e2 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:node-exporter.smithi154 smithi154 *:9100 running (2m) 2m ago 18m 3376k - 1.5.0 0da6a335fe13 4f95bf7624ed 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 smithi032 running (8m) 102s ago 18m 167M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 d318ebed8be1 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 smithi032 running (7m) 102s ago 17m 125M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 00a59b6189e5 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 smithi032 running (7m) 102s ago 17m 102M 1217M 19.0.0-2497-gf273489c 3b8ac54a9a71 96de1dd57d13 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 smithi154 running (6m) 2m ago 16m 105M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 5cc938cf75ad 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 smithi154 running (5m) 2m ago 16m 103M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 75a59e4cc4c7 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 smithi154 running (5m) 2m ago 15m 99.3M 2240M 19.0.0-2497-gf273489c 3b8ac54a9a71 8b513e97a420 2024-05-06T21:38:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:prometheus.smithi032 smithi032 *:9095 running (2m) 102s ago 19m 60.6M - 2.43.0 a07b618ecd1d 6907f55d469a 2024-05-06T21:38:10.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f255406e200 msgr2=0x7f25540706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:10.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f255406e200 0x7f25540706b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f255c005950 tx=0x7f255c0058e0 comp rx=0 tx=0).stop 2024-05-06T21:38:10.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c104130 msgr2=0x7f256c197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:10.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c104130 0x7f256c197180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2560000c00 tx=0x7f256000be20 comp rx=0 tx=0).stop 2024-05-06T21:38:10.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 shutdown_connections 2024-05-06T21:38:10.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f255406e200 0x7f25540706b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:10.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f256c0ffbd0 0x7f256c196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:10.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 --2- 172.21.15.32:0/1490879646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f256c104130 0x7f256c197180 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:10.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 >> 172.21.15.32:0/1490879646 conn(0x7f256c075130 msgr2=0x7f256c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:10.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 shutdown_connections 2024-05-06T21:38:10.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:10.234+0000 7f2571b38700 1 -- 172.21.15.32:0/1490879646 wait complete. 2024-05-06T21:38:10.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:09 smithi154 ceph-mon[63622]: pgmap v342: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:10.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph versions' 2024-05-06T21:38:11.147 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:38:11.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:10 smithi032 ceph-mon[76650]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:38:11.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:10 smithi154 ceph-mon[63622]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T21:38:12.308 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:11 smithi032 ceph-mon[76650]: pgmap v343: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:12.316 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:11 smithi154 ceph-mon[63622]: pgmap v343: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:12.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.878+0000 7f09d80ec700 1 -- 172.21.15.32:0/66158403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d0104130 msgr2=0x7f09d0104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:12.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.878+0000 7f09d80ec700 1 --2- 172.21.15.32:0/66158403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d0104130 0x7f09d0104500 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009910 tx=0x7f09cc009c20 comp rx=0 tx=0).stop 2024-05-06T21:38:12.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.878+0000 7f09d80ec700 1 -- 172.21.15.32:0/66158403 shutdown_connections 2024-05-06T21:38:12.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.878+0000 7f09d80ec700 1 --2- 172.21.15.32:0/66158403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d00ffbd0 0x7f09d0100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:12.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.878+0000 7f09d80ec700 1 --2- 172.21.15.32:0/66158403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d0104130 0x7f09d0104500 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:12.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.878+0000 7f09d80ec700 1 -- 172.21.15.32:0/66158403 >> 172.21.15.32:0/66158403 conn(0x7f09d0075130 msgr2=0x7f09d0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:12.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.878+0000 7f09d80ec700 1 -- 172.21.15.32:0/66158403 shutdown_connections 2024-05-06T21:38:12.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.878+0000 7f09d80ec700 1 -- 172.21.15.32:0/66158403 wait complete. 2024-05-06T21:38:12.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d80ec700 1 Processor -- start 2024-05-06T21:38:12.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d80ec700 1 -- start start 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d80ec700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d00ffbd0 0x7f09d0196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d80ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d0104130 0x7f09d0197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d80ec700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d01977e0 con 0x7f09d00ffbd0 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d80ec700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0197920 con 0x7f09d0104130 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d5e88700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d00ffbd0 0x7f09d0196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d5e88700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d00ffbd0 0x7f09d0196c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54014/0 (socket says 172.21.15.32:54014) 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d5e88700 1 -- 172.21.15.32:0/3991464801 learned_addr learned my addr 172.21.15.32:0/3991464801 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d5687700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d0104130 0x7f09d0197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d5e88700 1 -- 172.21.15.32:0/3991464801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d0104130 msgr2=0x7f09d0197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d5e88700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d0104130 0x7f09d0197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d5e88700 1 -- 172.21.15.32:0/3991464801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0095f0 con 0x7f09d00ffbd0 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d5687700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d0104130 0x7f09d0197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.879+0000 7f09d5e88700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d00ffbd0 0x7f09d0196c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f09cc006010 tx=0x7f09cc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:12.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.880+0000 7f09c6ffd700 1 -- 172.21.15.32:0/3991464801 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09cc01d070 con 0x7f09d00ffbd0 2024-05-06T21:38:12.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.880+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d019fcc0 con 0x7f09d00ffbd0 2024-05-06T21:38:12.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.880+0000 7f09c6ffd700 1 -- 172.21.15.32:0/3991464801 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09cc004fb0 con 0x7f09d00ffbd0 2024-05-06T21:38:12.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.880+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d01a00d0 con 0x7f09d00ffbd0 2024-05-06T21:38:12.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.880+0000 7f09c6ffd700 1 -- 172.21.15.32:0/3991464801 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09cc00f630 con 0x7f09d00ffbd0 2024-05-06T21:38:12.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.881+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d01076a0 con 0x7f09d00ffbd0 2024-05-06T21:38:12.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.881+0000 7f09c6ffd700 1 -- 172.21.15.32:0/3991464801 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f09cc022470 con 0x7f09d00ffbd0 2024-05-06T21:38:12.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.882+0000 7f09c6ffd700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f09bc06e200 0x7f09bc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:12.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.882+0000 7f09d5687700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f09bc06e200 0x7f09bc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:12.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.882+0000 7f09c6ffd700 1 -- 172.21.15.32:0/3991464801 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f09cc08f9a0 con 0x7f09d00ffbd0 2024-05-06T21:38:12.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.882+0000 7f09d5687700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f09bc06e200 0x7f09bc0706b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f09c0005fd0 tx=0x7f09c0005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:12.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:12.887+0000 7f09c6ffd700 1 -- 172.21.15.32:0/3991464801 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f09cc058cf0 con 0x7f09d00ffbd0 2024-05-06T21:38:13.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.192+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f09d0107080 con 0x7f09d00ffbd0 2024-05-06T21:38:13.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.193+0000 7f09c6ffd700 1 -- 172.21.15.32:0/3991464801 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f09cc022720 con 0x7f09d00ffbd0 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": { 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": { 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 2 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": { 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 6 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2024-05-06T21:38:13.187 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 4 2024-05-06T21:38:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-06T21:38:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: "overall": { 2024-05-06T21:38:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)": 14 2024-05-06T21:38:13.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-06T21:38:13.188 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-06T21:38:13.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.195+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f09bc06e200 msgr2=0x7f09bc0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:13.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.195+0000 7f09d80ec700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f09bc06e200 0x7f09bc0706b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f09c0005fd0 tx=0x7f09c0005e20 comp rx=0 tx=0).stop 2024-05-06T21:38:13.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.195+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d00ffbd0 msgr2=0x7f09d0196c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:13.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.195+0000 7f09d80ec700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d00ffbd0 0x7f09d0196c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f09cc006010 tx=0x7f09cc00be20 comp rx=0 tx=0).stop 2024-05-06T21:38:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.195+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 shutdown_connections 2024-05-06T21:38:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.195+0000 7f09d80ec700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f09bc06e200 0x7f09bc0706b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.195+0000 7f09d80ec700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09d00ffbd0 0x7f09d0196c50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.195+0000 7f09d80ec700 1 --2- 172.21.15.32:0/3991464801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d0104130 0x7f09d0197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.195+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 >> 172.21.15.32:0/3991464801 conn(0x7f09d0075130 msgr2=0x7f09d00fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.196+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 shutdown_connections 2024-05-06T21:38:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:13.196+0000 7f09d80ec700 1 -- 172.21.15.32:0/3991464801 wait complete. 2024-05-06T21:38:13.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-05-06T21:38:14.097 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:38:14.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:13 smithi032 ceph-mon[76650]: pgmap v344: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:14.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:13 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3991464801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:38:14.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:13 smithi154 ceph-mon[63622]: pgmap v344: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:14.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:13 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3991464801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:38:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.758+0000 7f46baf3b700 1 -- 172.21.15.32:0/4244708163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 msgr2=0x7f46b41008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.758+0000 7f46baf3b700 1 --2- 172.21.15.32:0/4244708163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 0x7f46b41008b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009910 tx=0x7f46a8009c20 comp rx=0 tx=0).stop 2024-05-06T21:38:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.758+0000 7f46baf3b700 1 -- 172.21.15.32:0/4244708163 shutdown_connections 2024-05-06T21:38:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.758+0000 7f46baf3b700 1 --2- 172.21.15.32:0/4244708163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b4100e80 0x7f46b4104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.758+0000 7f46baf3b700 1 --2- 172.21.15.32:0/4244708163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 0x7f46b41008b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.758+0000 7f46baf3b700 1 -- 172.21.15.32:0/4244708163 >> 172.21.15.32:0/4244708163 conn(0x7f46b40fbda0 msgr2=0x7f46b40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.758+0000 7f46baf3b700 1 -- 172.21.15.32:0/4244708163 shutdown_connections 2024-05-06T21:38:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.758+0000 7f46baf3b700 1 -- 172.21.15.32:0/4244708163 wait complete. 2024-05-06T21:38:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46baf3b700 1 Processor -- start 2024-05-06T21:38:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46baf3b700 1 -- start start 2024-05-06T21:38:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46baf3b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 0x7f46b4195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46baf3b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b4100e80 0x7f46b41964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46baf3b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4196bb0 con 0x7f46b41004e0 2024-05-06T21:38:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46baf3b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b419a940 con 0x7f46b4100e80 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46b8cd7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 0x7f46b4195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46b8cd7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 0x7f46b4195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54028/0 (socket says 172.21.15.32:54028) 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46b8cd7700 1 -- 172.21.15.32:0/225660442 learned_addr learned my addr 172.21.15.32:0/225660442 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.759+0000 7f46b3fff700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b4100e80 0x7f46b41964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.760+0000 7f46b8cd7700 1 -- 172.21.15.32:0/225660442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b4100e80 msgr2=0x7f46b41964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.760+0000 7f46b8cd7700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b4100e80 0x7f46b41964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.760+0000 7f46b8cd7700 1 -- 172.21.15.32:0/225660442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80095f0 con 0x7f46b41004e0 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.760+0000 7f46b8cd7700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 0x7f46b4195f90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f46a8006010 tx=0x7f46a800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.760+0000 7f46b1ffb700 1 -- 172.21.15.32:0/225660442 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a801d070 con 0x7f46b41004e0 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.760+0000 7f46b1ffb700 1 -- 172.21.15.32:0/225660442 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46a800f460 con 0x7f46b41004e0 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.760+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b419abc0 con 0x7f46b41004e0 2024-05-06T21:38:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.760+0000 7f46b1ffb700 1 -- 172.21.15.32:0/225660442 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a8017610 con 0x7f46b41004e0 2024-05-06T21:38:15.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.760+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b419b0b0 con 0x7f46b41004e0 2024-05-06T21:38:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.761+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b41087f0 con 0x7f46b41004e0 2024-05-06T21:38:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.762+0000 7f46b1ffb700 1 -- 172.21.15.32:0/225660442 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f46a800f5d0 con 0x7f46b41004e0 2024-05-06T21:38:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.762+0000 7f46b1ffb700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f46a406e200 0x7f46a40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.762+0000 7f46b1ffb700 1 -- 172.21.15.32:0/225660442 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f46a808f890 con 0x7f46b41004e0 2024-05-06T21:38:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.762+0000 7f46b3fff700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f46a406e200 0x7f46a40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.763+0000 7f46b3fff700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f46a406e200 0x7f46a40706b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f46b41975b0 tx=0x7f46a0009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:15.767+0000 7f46b1ffb700 1 -- 172.21.15.32:0/225660442 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f46a8058a10 con 0x7f46b41004e0 2024-05-06T21:38:16.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.073+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f46b404f2a0 con 0x7f46b41004e0 2024-05-06T21:38:16.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.074+0000 7f46b1ffb700 1 -- 172.21.15.32:0/225660442 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f46a805c0d0 con 0x7f46b41004e0 2024-05-06T21:38:16.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f46a406e200 msgr2=0x7f46a40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:16.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f46a406e200 0x7f46a40706b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f46b41975b0 tx=0x7f46a0009190 comp rx=0 tx=0).stop 2024-05-06T21:38:16.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 msgr2=0x7f46b4195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:16.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 0x7f46b4195f90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f46a8006010 tx=0x7f46a800bd70 comp rx=0 tx=0).stop 2024-05-06T21:38:16.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 shutdown_connections 2024-05-06T21:38:16.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f46a406e200 0x7f46a40706b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:16.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46b41004e0 0x7f46b4195f90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:16.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 --2- 172.21.15.32:0/225660442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b4100e80 0x7f46b41964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:16.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 >> 172.21.15.32:0/225660442 conn(0x7f46b40fbda0 msgr2=0x7f46b40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:16.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 shutdown_connections 2024-05-06T21:38:16.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:16.076+0000 7f46baf3b700 1 -- 172.21.15.32:0/225660442 wait complete. 2024-05-06T21:38:16.080 INFO:teuthology.orchestra.run.smithi032.stdout:true 2024-05-06T21:38:16.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:16 smithi154 ceph-mon[63622]: pgmap v345: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:16.423 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:15 smithi032 ceph-mon[76650]: pgmap v345: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:16.789 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -e sha1=f273489c6dcd4bc88409993babd09dd99491162c -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-05-06T21:38:17.008 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:38:17.131 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:17 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/225660442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:38:17.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:17 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/225660442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:38:18.090 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:18 smithi032 ceph-mon[76650]: pgmap v346: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:18.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:18 smithi154 ceph-mon[63622]: pgmap v346: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:18.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.681+0000 7f9a42a60700 1 -- 172.21.15.32:0/486840020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 msgr2=0x7f9a3c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:18.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.681+0000 7f9a42a60700 1 --2- 172.21.15.32:0/486840020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 0x7f9a3c104e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9a30009910 tx=0x7f9a30009c20 comp rx=0 tx=0).stop 2024-05-06T21:38:18.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.681+0000 7f9a42a60700 1 -- 172.21.15.32:0/486840020 shutdown_connections 2024-05-06T21:38:18.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.681+0000 7f9a42a60700 1 --2- 172.21.15.32:0/486840020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 0x7f9a3c104e50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:18.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.681+0000 7f9a42a60700 1 --2- 172.21.15.32:0/486840020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a3c1004e0 0x7f9a3c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:18.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.681+0000 7f9a42a60700 1 -- 172.21.15.32:0/486840020 >> 172.21.15.32:0/486840020 conn(0x7f9a3c0fbda0 msgr2=0x7f9a3c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:18.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.681+0000 7f9a42a60700 1 -- 172.21.15.32:0/486840020 shutdown_connections 2024-05-06T21:38:18.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.682+0000 7f9a42a60700 1 -- 172.21.15.32:0/486840020 wait complete. 2024-05-06T21:38:18.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.682+0000 7f9a42a60700 1 Processor -- start 2024-05-06T21:38:18.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.682+0000 7f9a42a60700 1 -- start start 2024-05-06T21:38:18.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a42a60700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a3c1004e0 0x7f9a3c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:18.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a42a60700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 0x7f9a3c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:18.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a42a60700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c073ad0 con 0x7f9a3c100e80 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a42a60700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c073c10 con 0x7f9a3c1004e0 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a3b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 0x7f9a3c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a3b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 0x7f9a3c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54052/0 (socket says 172.21.15.32:54052) 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a3b7fe700 1 -- 172.21.15.32:0/2891945862 learned_addr learned my addr 172.21.15.32:0/2891945862 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a3bfff700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a3c1004e0 0x7f9a3c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a3b7fe700 1 -- 172.21.15.32:0/2891945862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a3c1004e0 msgr2=0x7f9a3c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a3b7fe700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a3c1004e0 0x7f9a3c073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a3b7fe700 1 -- 172.21.15.32:0/2891945862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a300095f0 con 0x7f9a3c100e80 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a3b7fe700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 0x7f9a3c073590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005f50 tx=0x7f9a3000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a397fa700 1 -- 172.21.15.32:0/2891945862 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3001d070 con 0x7f9a3c100e80 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a397fa700 1 -- 172.21.15.32:0/2891945862 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a3000f460 con 0x7f9a3c100e80 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.683+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c073e90 con 0x7f9a3c100e80 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.684+0000 7f9a397fa700 1 -- 172.21.15.32:0/2891945862 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a30017630 con 0x7f9a3c100e80 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.684+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c1a2410 con 0x7f9a3c100e80 2024-05-06T21:38:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.684+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c108850 con 0x7f9a3c100e80 2024-05-06T21:38:18.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.685+0000 7f9a397fa700 1 -- 172.21.15.32:0/2891945862 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9a3000f5d0 con 0x7f9a3c100e80 2024-05-06T21:38:18.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.685+0000 7f9a397fa700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9a2406e200 0x7f9a240706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:18.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.686+0000 7f9a397fa700 1 -- 172.21.15.32:0/2891945862 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f9a3008f900 con 0x7f9a3c100e80 2024-05-06T21:38:18.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.686+0000 7f9a3bfff700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9a2406e200 0x7f9a240706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:18.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.686+0000 7f9a3bfff700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9a2406e200 0x7f9a240706b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c005fd0 tx=0x7f9a2c00a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:18.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.690+0000 7f9a397fa700 1 -- 172.21.15.32:0/2891945862 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9a30058a80 con 0x7f9a3c100e80 2024-05-06T21:38:18.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.992+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a3c074670 con 0x7f9a3c100e80 2024-05-06T21:38:18.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.993+0000 7f9a397fa700 1 -- 172.21.15.32:0/2891945862 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f9a3005c140 con 0x7f9a3c100e80 2024-05-06T21:38:18.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.995+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9a2406e200 msgr2=0x7f9a240706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:18.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.995+0000 7f9a42a60700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9a2406e200 0x7f9a240706b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c005fd0 tx=0x7f9a2c00a560 comp rx=0 tx=0).stop 2024-05-06T21:38:18.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.995+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 msgr2=0x7f9a3c073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:18.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.995+0000 7f9a42a60700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 0x7f9a3c073590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005f50 tx=0x7f9a3000be20 comp rx=0 tx=0).stop 2024-05-06T21:38:18.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.995+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 shutdown_connections 2024-05-06T21:38:18.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.995+0000 7f9a42a60700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9a2406e200 0x7f9a240706b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:18.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.995+0000 7f9a42a60700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a3c1004e0 0x7f9a3c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:18.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.995+0000 7f9a42a60700 1 --2- 172.21.15.32:0/2891945862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a3c100e80 0x7f9a3c073590 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:18.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.995+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 >> 172.21.15.32:0/2891945862 conn(0x7f9a3c0fbda0 msgr2=0x7f9a3c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:18.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.996+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 shutdown_connections 2024-05-06T21:38:18.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:18.996+0000 7f9a42a60700 1 -- 172.21.15.32:0/2891945862 wait complete. 2024-05-06T21:38:19.000 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph version 19.0.0-2497-gf273489c (f273489c6dcd4bc88409993babd09dd99491162c) squid (dev)" 2024-05-06T21:38:19.355 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:19 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2891945862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:38:19.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:19 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2891945862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T21:38:19.733 DEBUG:teuthology.parallel:result is None 2024-05-06T21:38:19.733 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T21:38:19.748 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:38:19.748 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155ff30-0bed-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-06T21:38:19.974 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/mon.smithi032/config 2024-05-06T21:38:20.317 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:20 smithi032 ceph-mon[76650]: pgmap v347: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:20.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:20 smithi154 ceph-mon[63622]: pgmap v347: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:21.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:21 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:38:21.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:21 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:38:21.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.607+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/1088126556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac1038c0 msgr2=0x7fa2ac103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.607+0000 7fa2b0c7d700 1 --2- 172.21.15.32:0/1088126556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac1038c0 0x7fa2ac103c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa294009910 tx=0x7fa294009c20 comp rx=0 tx=0).stop 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.607+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/1088126556 shutdown_connections 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.607+0000 7fa2b0c7d700 1 --2- 172.21.15.32:0/1088126556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac0ff3d0 0x7fa2ac0ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.607+0000 7fa2b0c7d700 1 --2- 172.21.15.32:0/1088126556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac1038c0 0x7fa2ac103c90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.607+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/1088126556 >> 172.21.15.32:0/1088126556 conn(0x7fa2ac074930 msgr2=0x7fa2ac074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.607+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/1088126556 shutdown_connections 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.607+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/1088126556 wait complete. 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2b0c7d700 1 Processor -- start 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2b0c7d700 1 -- start start 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2b0c7d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac0ff3d0 0x7fa2ac196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2b0c7d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac1038c0 0x7fa2ac1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2b0c7d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1977d0 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2b0c7d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac197910 con 0x7fa2ac1038c0 2024-05-06T21:38:21.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2aa59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac0ff3d0 0x7fa2ac196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2aa59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac0ff3d0 0x7fa2ac196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54072/0 (socket says 172.21.15.32:54072) 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2aa59c700 1 -- 172.21.15.32:0/2143907277 learned_addr learned my addr 172.21.15.32:0/2143907277 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.608+0000 7fa2a9d9b700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac1038c0 0x7fa2ac1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.609+0000 7fa2aa59c700 1 -- 172.21.15.32:0/2143907277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac1038c0 msgr2=0x7fa2ac1971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.609+0000 7fa2aa59c700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac1038c0 0x7fa2ac1971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.609+0000 7fa2aa59c700 1 -- 172.21.15.32:0/2143907277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940095f0 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.609+0000 7fa2aa59c700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac0ff3d0 0x7fa2ac196c70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa29400bd70 tx=0x7fa29400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.609+0000 7fa2a37fe700 1 -- 172.21.15.32:0/2143907277 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa29401d070 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.609+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac19fce0 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.609+0000 7fa2a37fe700 1 -- 172.21.15.32:0/2143907277 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa294005dc0 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.609+0000 7fa2a37fe700 1 -- 172.21.15.32:0/2143907277 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa294017400 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.609+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac1a00f0 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.610+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac04f2a0 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.611+0000 7fa2a37fe700 1 -- 172.21.15.32:0/2143907277 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa29400f7f0 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.611+0000 7fa2a37fe700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa29806e200 0x7fa2980706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:21.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.611+0000 7fa2a9d9b700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa29806e200 0x7fa2980706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:21.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.611+0000 7fa2a37fe700 1 -- 172.21.15.32:0/2143907277 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fa29408f810 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.612+0000 7fa2a9d9b700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa29806e200 0x7fa2980706b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa29c005950 tx=0x7fa29c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:21.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.616+0000 7fa2a37fe700 1 -- 172.21.15.32:0/2143907277 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa294058990 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.878+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa2ac197ad0 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.878+0000 7fa2a37fe700 1 -- 172.21.15.32:0/2143907277 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1951 (secure 0 0 0) 0x7fa29405c050 con 0x7fa2ac0ff3d0 2024-05-06T21:38:21.873 INFO:teuthology.orchestra.run.smithi032.stdout:e44 2024-05-06T21:38:21.873 INFO:teuthology.orchestra.run.smithi032.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T21:38:21.873 INFO:teuthology.orchestra.run.smithi032.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T21:38:21.873 INFO:teuthology.orchestra.run.smithi032.stdout:legacy client fscid: 1 2024-05-06T21:38:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:21.873 INFO:teuthology.orchestra.run.smithi032.stdout:Filesystem 'cephfs' (1) 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:fs_name cephfs 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 44 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-06T21:23:50.198971+0000 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-06T21:34:55.428791+0000 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:tableserver 0 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:root 0 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:session_timeout 60 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:session_autoclose 300 2024-05-06T21:38:21.874 INFO:teuthology.orchestra.run.smithi032.stdout:max_file_size 1099511627776 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:max_xattr_size 65536 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:required_client_features {} 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure 0 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:last_failure_osd_epoch 95 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:max_mds 2 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:in 0,1 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:up {0=34432,1=34452} 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:failed 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:damaged 2024-05-06T21:38:21.875 INFO:teuthology.orchestra.run.smithi032.stdout:stopped 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:data_pools [3] 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:metadata_pool 2 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:inline_data disabled 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:balancer 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:bal_rank_mask -1 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:standby_count_wanted 1 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:qdb_cluster leader: 34432 members: 34432,34452 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.fpdhzg{0:34432} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.32:6826/1515774024,v1:172.21.15.32:6827/1515774024] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi032.jbgmwi{1:34452} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.32:6828/367153911,v1:172.21.15.32:6829/367153911] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:Standby daemons: 2024-05-06T21:38:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:21.877 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.rizdbu{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6824/171743146,v1:172.21.15.154:6825/171743146] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:38:21.877 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.cephfs.smithi154.xfmqxf{-1:44353} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.154:6826/3609095923,v1:172.21.15.154:6827/3609095923] compat {c=[1],r=[1],i=[1fff]}] 2024-05-06T21:38:21.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa29806e200 msgr2=0x7fa2980706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa29806e200 0x7fa2980706b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa29c005950 tx=0x7fa29c0058e0 comp rx=0 tx=0).stop 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac0ff3d0 msgr2=0x7fa2ac196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac0ff3d0 0x7fa2ac196c70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa29400bd70 tx=0x7fa29400be50 comp rx=0 tx=0).stop 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 shutdown_connections 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa29806e200 0x7fa2980706b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2ac0ff3d0 0x7fa2ac196c70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 --2- 172.21.15.32:0/2143907277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac1038c0 0x7fa2ac1971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 >> 172.21.15.32:0/2143907277 conn(0x7fa2ac074930 msgr2=0x7fa2ac102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 shutdown_connections 2024-05-06T21:38:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:21.881+0000 7fa2b0c7d700 1 -- 172.21.15.32:0/2143907277 wait complete. 2024-05-06T21:38:21.879 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 44 2024-05-06T21:38:22.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:22 smithi032 ceph-mon[76650]: pgmap v348: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:22.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:22 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2143907277' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:38:22.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:22 smithi154 ceph-mon[63622]: pgmap v348: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:22.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:22 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2143907277' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-06T21:38:22.559 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-05-06T21:38:22.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-06T21:38:22.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.684+0000 7fb20c60e640 1 -- 172.21.15.32:0/4168625485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204101390 msgr2=0x7fb204109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:22.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.684+0000 7fb20c60e640 1 --2- 172.21.15.32:0/4168625485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204101390 0x7fb204109880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009880 tx=0x7fb1f402bd70 comp rx=0 tx=0).stop 2024-05-06T21:38:22.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.684+0000 7fb20c60e640 1 -- 172.21.15.32:0/4168625485 shutdown_connections 2024-05-06T21:38:22.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.684+0000 7fb20c60e640 1 --2- 172.21.15.32:0/4168625485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204101390 0x7fb204109880 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.684+0000 7fb20c60e640 1 --2- 172.21.15.32:0/4168625485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb204100a80 0x7fb204100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.684+0000 7fb20c60e640 1 -- 172.21.15.32:0/4168625485 >> 172.21.15.32:0/4168625485 conn(0x7fb2040fa230 msgr2=0x7fb2040fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:22.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20c60e640 1 -- 172.21.15.32:0/4168625485 shutdown_connections 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20c60e640 1 -- 172.21.15.32:0/4168625485 wait complete. 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20c60e640 1 Processor -- start 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20c60e640 1 -- start start 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20c60e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204100a80 0x7fb204195510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20c60e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb204101390 0x7fb204195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20c60e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041960e0 con 0x7fb204100a80 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20c60e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb204199eb0 con 0x7fb204101390 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20a3aa640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204100a80 0x7fb204195510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20a3aa640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204100a80 0x7fb204195510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55000/0 (socket says 172.21.15.32:55000) 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.685+0000 7fb20a3aa640 1 -- 172.21.15.32:0/3466396168 learned_addr learned my addr 172.21.15.32:0/3466396168 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb209ba9640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb204101390 0x7fb204195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb20a3aa640 1 -- 172.21.15.32:0/3466396168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb204101390 msgr2=0x7fb204195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:22.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb20a3aa640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb204101390 0x7fb204195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb20a3aa640 1 -- 172.21.15.32:0/3466396168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4009560 con 0x7fb204100a80 2024-05-06T21:38:22.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb209ba9640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb204101390 0x7fb204195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:38:22.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb20a3aa640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204100a80 0x7fb204195510 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb20000b420 tx=0x7fb20000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:22.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb1fb7fe640 1 -- 172.21.15.32:0/3466396168 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb200011800 con 0x7fb204100a80 2024-05-06T21:38:22.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20419a190 con 0x7fb204100a80 2024-05-06T21:38:22.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb1fb7fe640 1 -- 172.21.15.32:0/3466396168 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb200011e20 con 0x7fb204100a80 2024-05-06T21:38:22.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb1fb7fe640 1 -- 172.21.15.32:0/3466396168 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb20000f2e0 con 0x7fb204100a80 2024-05-06T21:38:22.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.686+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20419a6f0 con 0x7fb204100a80 2024-05-06T21:38:22.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.687+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20404e000 con 0x7fb204100a80 2024-05-06T21:38:22.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.688+0000 7fb1fb7fe640 1 -- 172.21.15.32:0/3466396168 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb200010380 con 0x7fb204100a80 2024-05-06T21:38:22.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.688+0000 7fb1fb7fe640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb1f006e230 0x7fb1f00706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:22.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.688+0000 7fb1fb7fe640 1 -- 172.21.15.32:0/3466396168 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fb20008dc50 con 0x7fb204100a80 2024-05-06T21:38:22.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.688+0000 7fb209ba9640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb1f006e230 0x7fb1f00706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:22.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.689+0000 7fb209ba9640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb1f006e230 0x7fb1f00706e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb204196b20 tx=0x7fb1f4000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:22.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.693+0000 7fb1fb7fe640 1 -- 172.21.15.32:0/3466396168 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb200056dd0 con 0x7fb204100a80 2024-05-06T21:38:22.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.879+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb204196860 con 0x7fb204100a80 2024-05-06T21:38:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.881+0000 7fb1fb7fe640 1 -- 172.21.15.32:0/3466396168 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17351 (secure 0 0 0) 0x7fb20005a490 con 0x7fb204100a80 2024-05-06T21:38:22.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:22.876 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":95,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","created":"2024-05-06T21:16:43.886575+0000","modified":"2024-05-06T21:34:37.439760+0000","last_up_change":"2024-05-06T21:32:52.685273+0000","last_in_change":"2024-05-06T21:22:10.894148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T21:21:16.105413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-05-06T21:23:49.127155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-05-06T21:23:49.617433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0095c3fd-9b90-4d23-b192-98fd9a06c20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":90,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6803","nonce":2472907178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6805","nonce":2472907178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6809","nonce":2472907178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6807","nonce":2472907178}]},"public_addr":"172.21.15.32:6803/2472907178","cluster_addr":"172.21.15.32:6805/2472907178","heartbeat_back_addr":"172.21.15.32:6809/2472907178","heartbeat_front_addr":"172.21.15.32:6807/2472907178","state":["exists","up"]},{"osd":1,"uuid":"0d37de85-e43f-4094-ba6a-00a09047798a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":65,"up_thru":90,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6811","nonce":2235618236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6813","nonce":2235618236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6817","nonce":2235618236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6815","nonce":2235618236}]},"public_addr":"172.21.15.32:6811/2235618236","cluster_addr":"172.21.15.32:6813/2235618236","heartbeat_back_addr":"172.21.15.32:6817/2235618236","heartbeat_front_addr":"172.21.15.32:6815/2235618236","state":["exists","up"]},{"osd":2,"uuid":"e41022aa-de8c-45d9-aa0e-a1918b23fb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":71,"up_from":75,"up_thru":90,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6819","nonce":3106482767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6821","nonce":3106482767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6825","nonce":3106482767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6823","nonce":3106482767}]},"public_addr":"172.21.15.32:6819/3106482767","cluster_addr":"172.21.15.32:6821/3106482767","heartbeat_back_addr":"172.21.15.32:6825/3106482767","heartbeat_front_addr":"172.21.15.32:6823/3106482767","state":["exists","up"]},{"osd":3,"uuid":"11e127c4-f415-4261-9584-b53b7bfa8b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":76,"up_from":80,"up_thru":90,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6801","nonce":4072948236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6803","nonce":4072948236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6807","nonce":4072948236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6805","nonce":4072948236}]},"public_addr":"172.21.15.154:6801/4072948236","cluster_addr":"172.21.15.154:6803/4072948236","heartbeat_back_addr":"172.21.15.154:6807/4072948236","heartbeat_front_addr":"172.21.15.154:6805/4072948236","state":["exists","up"]},{"osd":4,"uuid":"190cd663-20cb-49b3-84b0-345f665e068e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":81,"up_from":85,"up_thru":90,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6809","nonce":3787543137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6811","nonce":3787543137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6815","nonce":3787543137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6813","nonce":3787543137}]},"public_addr":"172.21.15.154:6809/3787543137","cluster_addr":"172.21.15.154:6811/3787543137","heartbeat_back_addr":"172.21.15.154:6815/3787543137","heartbeat_front_addr":"172.21.15.154:6813/3787543137","state":["exists","up"]},{"osd":5,"uuid":"7655488e-f7b9-4902-b6d3-28f762d44a2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":86,"up_from":90,"up_thru":90,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6817","nonce":2230951688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6819","nonce":2230951688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6823","nonce":2230951688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6821","nonce":2230951688}]},"public_addr":"172.21.15.154:6817/2230951688","cluster_addr":"172.21.15.154:6819/2230951688","heartbeat_back_addr":"172.21.15.154:6823/2230951688","heartbeat_front_addr":"172.21.15.154:6821/2230951688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:14.221856+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:43.419480+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:12.732797+0000","dead_epoch":71},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:36.574751+0000","dead_epoch":76},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:02.167660+0000","dead_epoch":81},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:28.497477+0000","dead_epoch":86}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":3,"to":2}]},{"pgid":"2.5","mappings":[{"from":0,"to":2}]},{"pgid":"2.12","mappings":[{"from":0,"to":5},{"from":3,"to":2}]},{"pgid":"2.19","mappings":[{"from":0,"to":1}]},{"pgid":"2.1d","mappings":[{"from":3,"to":1}]},{"pgid":"3.b","mappings":[{"from":4,"to":2}]},{"pgid":"3.14","mappings":[{"from":3,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6827/2609692046":"2024-05-07T21:34:37.439729+0000","172.21.15.154:6826/2609692046":"2024-05-07T21:34:37.439729+0000","172.21.15.32:6829/1302339589":"2024-05-07T21:33:59.176616+0000","172.21.15.32:6828/1302339589":"2024-05-07T21:33:59.176616+0000","172.21.15.32:0/1427527157":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/3371897316":"2024-05-07T21:28:20.593033+0000","172.21.15.32:6801/559791322":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/2104181876":"2024-05-07T21:17:45.720027+0000","172.21.15.154:6828/2671631515":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/314356654":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/928947970":"2024-05-07T21:26:04.755904+0000","172.21.15.32:0/2913247857":"2024-05-07T21:18:57.579578+0000","172.21.15.154:0/574866439":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/679753640":"2024-05-07T21:28:20.593033+0000","172.21.15.154:0/3827385640":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/2077354807":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6826/403692088":"2024-05-07T21:24:06.865368+0000","172.21.15.154:0/1347448701":"2024-05-07T21:27:14.287554+0000","172.21.15.32:6827/403692088":"2024-05-07T21:24:06.865368+0000","172.21.15.32:0/1723093349":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/2720610700":"2024-05-07T21:17:12.681477+0000","172.21.15.154:0/3762142095":"2024-05-07T21:27:14.287554+0000","172.21.15.154:6829/2671631515":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/1406133666":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1230396006":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6801/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/3536478886":"2024-05-07T21:26:04.755904+0000","172.21.15.32:0/2992602151":"2024-05-07T21:28:20.593033+0000","172.21.15.154:0/3154197577":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/3688348585":"2024-05-07T21:26:04.755904+0000","172.21.15.32:0/1223764907":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6800/2162274499":"2024-05-07T21:26:04.755904+0000","172.21.15.154:0/2805675075":"2024-05-07T21:27:14.287554+0000","172.21.15.32:6801/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6801/2162274499":"2024-05-07T21:26:04.755904+0000","172.21.15.32:6801/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/3998200556":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/672629275":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/1033156191":"2024-05-07T21:26:04.755904+0000","172.21.15.32:6800/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6800/559791322":"2024-05-07T21:28:20.593033+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T21:38:22.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb1f006e230 msgr2=0x7fb1f00706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb1f006e230 0x7fb1f00706e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb204196b20 tx=0x7fb1f4000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204100a80 msgr2=0x7fb204195510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204100a80 0x7fb204195510 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb20000b420 tx=0x7fb20000b8e0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 shutdown_connections 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fb1f006e230 0x7fb1f00706e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb204101390 0x7fb204195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 --2- 172.21.15.32:0/3466396168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb204100a80 0x7fb204195510 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 >> 172.21.15.32:0/3466396168 conn(0x7fb2040fa230 msgr2=0x7fb204104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 shutdown_connections 2024-05-06T21:38:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:22.883+0000 7fb20c60e640 1 -- 172.21.15.32:0/3466396168 wait complete. 2024-05-06T21:38:22.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-06T21:21:16.105413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-05-06T21:23:49.127155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-05-06T21:23:49.617433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-06T21:38:22.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.002+0000 7fa0a2127640 1 -- 172.21.15.32:0/3586335341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c0fe7f0 msgr2=0x7fa09c0fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.002+0000 7fa0a2127640 1 --2- 172.21.15.32:0/3586335341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c0fe7f0 0x7fa09c0fec60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa090009880 tx=0x7fa09002bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.002+0000 7fa0a2127640 1 -- 172.21.15.32:0/3586335341 shutdown_connections 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.002+0000 7fa0a2127640 1 --2- 172.21.15.32:0/3586335341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c0fe7f0 0x7fa09c0fec60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.002+0000 7fa0a2127640 1 --2- 172.21.15.32:0/3586335341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c104800 0x7fa09c104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.002+0000 7fa0a2127640 1 -- 172.21.15.32:0/3586335341 >> 172.21.15.32:0/3586335341 conn(0x7fa09c0fa2f0 msgr2=0x7fa09c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.002+0000 7fa0a2127640 1 -- 172.21.15.32:0/3586335341 shutdown_connections 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.002+0000 7fa0a2127640 1 -- 172.21.15.32:0/3586335341 wait complete. 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa0a2127640 1 Processor -- start 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa0a2127640 1 -- start start 2024-05-06T21:38:22.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa0a2127640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c0fe7f0 0x7fa09c193440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa0a2127640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c104800 0x7fa09c193980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa0a2127640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c194010 con 0x7fa09c104800 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa0a2127640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c197de0 con 0x7fa09c0fe7f0 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa09affd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c104800 0x7fa09c193980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa09affd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c104800 0x7fa09c193980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55026/0 (socket says 172.21.15.32:55026) 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa09affd640 1 -- 172.21.15.32:0/2699955714 learned_addr learned my addr 172.21.15.32:0/2699955714 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa09b7fe640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c0fe7f0 0x7fa09c193440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa09affd640 1 -- 172.21.15.32:0/2699955714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c0fe7f0 msgr2=0x7fa09c193440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa09affd640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c0fe7f0 0x7fa09c193440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa09affd640 1 -- 172.21.15.32:0/2699955714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa090009560 con 0x7fa09c104800 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.003+0000 7fa09b7fe640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c0fe7f0 0x7fa09c193440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.004+0000 7fa09affd640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c104800 0x7fa09c193980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa090009230 tx=0x7fa090004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:23.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.004+0000 7fa098ff9640 1 -- 172.21.15.32:0/2699955714 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0900035f0 con 0x7fa09c104800 2024-05-06T21:38:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.004+0000 7fa098ff9640 1 -- 172.21.15.32:0/2699955714 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa090003c10 con 0x7fa09c104800 2024-05-06T21:38:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.004+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c198060 con 0x7fa09c104800 2024-05-06T21:38:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.004+0000 7fa098ff9640 1 -- 172.21.15.32:0/2699955714 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa090034440 con 0x7fa09c104800 2024-05-06T21:38:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.004+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c1985e0 con 0x7fa09c104800 2024-05-06T21:38:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.005+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c04e000 con 0x7fa09c104800 2024-05-06T21:38:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.005+0000 7fa098ff9640 1 -- 172.21.15.32:0/2699955714 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa090004fd0 con 0x7fa09c104800 2024-05-06T21:38:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.006+0000 7fa098ff9640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa084070380 0x7fa084072830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.006+0000 7fa09b7fe640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa084070380 0x7fa084072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.006+0000 7fa098ff9640 1 -- 172.21.15.32:0/2699955714 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fa0900b0780 con 0x7fa09c104800 2024-05-06T21:38:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.007+0000 7fa09b7fe640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa084070380 0x7fa084072830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa08c006fd0 tx=0x7fa08c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:23.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.011+0000 7fa098ff9640 1 -- 172.21.15.32:0/2699955714 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa090079900 con 0x7fa09c104800 2024-05-06T21:38:23.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.196+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa09c194790 con 0x7fa09c104800 2024-05-06T21:38:23.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.196+0000 7fa098ff9640 1 -- 172.21.15.32:0/2699955714 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa09007cfc0 con 0x7fa09c104800 2024-05-06T21:38:23.191 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-05-06T21:38:23.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa084070380 msgr2=0x7fa084072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa084070380 0x7fa084072830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa08c006fd0 tx=0x7fa08c008040 comp rx=0 tx=0).stop 2024-05-06T21:38:23.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c104800 msgr2=0x7fa09c193980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c104800 0x7fa09c193980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa090009230 tx=0x7fa090004040 comp rx=0 tx=0).stop 2024-05-06T21:38:23.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 shutdown_connections 2024-05-06T21:38:23.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa084070380 0x7fa084072830 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa09c104800 0x7fa09c193980 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 --2- 172.21.15.32:0/2699955714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c0fe7f0 0x7fa09c193440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 >> 172.21.15.32:0/2699955714 conn(0x7fa09c0fa2f0 msgr2=0x7fa09c0fbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:23.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 shutdown_connections 2024-05-06T21:38:23.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.198+0000 7fa0a2127640 1 -- 172.21.15.32:0/2699955714 wait complete. 2024-05-06T21:38:23.203 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:23 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3466396168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:38:23.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.318+0000 7fabb7e36640 1 -- 172.21.15.32:0/3668971938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb0104590 msgr2=0x7fabb0104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.318+0000 7fabb7e36640 1 --2- 172.21.15.32:0/3668971938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb0104590 0x7fabb0104960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabac009880 tx=0x7fabac02bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 -- 172.21.15.32:0/3668971938 shutdown_connections 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 --2- 172.21.15.32:0/3668971938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb00fe5b0 0x7fabb00fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 --2- 172.21.15.32:0/3668971938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb0104590 0x7fabb0104960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 -- 172.21.15.32:0/3668971938 >> 172.21.15.32:0/3668971938 conn(0x7fabb00743d0 msgr2=0x7fabb00747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 -- 172.21.15.32:0/3668971938 shutdown_connections 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 -- 172.21.15.32:0/3668971938 wait complete. 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 Processor -- start 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 -- start start 2024-05-06T21:38:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb00fe5b0 0x7fabb0195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb0104590 0x7fabb0195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0195ed0 con 0x7fabb00fe5b0 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.319+0000 7fabb7e36640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0199ca0 con 0x7fabb0104590 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb5bd2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb00fe5b0 0x7fabb0195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb5bd2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb00fe5b0 0x7fabb0195300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55034/0 (socket says 172.21.15.32:55034) 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb5bd2640 1 -- 172.21.15.32:0/531159303 learned_addr learned my addr 172.21.15.32:0/531159303 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb53d1640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb0104590 0x7fabb0195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb5bd2640 1 -- 172.21.15.32:0/531159303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb0104590 msgr2=0x7fabb0195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb5bd2640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb0104590 0x7fabb0195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb5bd2640 1 -- 172.21.15.32:0/531159303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac009560 con 0x7fabb00fe5b0 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb53d1640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb0104590 0x7fabb0195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb5bd2640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb00fe5b0 0x7fabb0195300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabac009230 tx=0x7fabac004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:23.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7faba6ffd640 1 -- 172.21.15.32:0/531159303 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac0035f0 con 0x7fabb00fe5b0 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7faba6ffd640 1 -- 172.21.15.32:0/531159303 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabac003c10 con 0x7fabb00fe5b0 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb0199f20 con 0x7fabb00fe5b0 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7faba6ffd640 1 -- 172.21.15.32:0/531159303 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac034440 con 0x7fabb00fe5b0 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.320+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb019a420 con 0x7fabb00fe5b0 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.321+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb004e000 con 0x7fabb00fe5b0 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.322+0000 7faba6ffd640 1 -- 172.21.15.32:0/531159303 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fabac004fd0 con 0x7fabb00fe5b0 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.323+0000 7faba6ffd640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab9c06e170 0x7fab9c070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.323+0000 7fabb53d1640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab9c06e170 0x7fab9c070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.323+0000 7faba6ffd640 1 -- 172.21.15.32:0/531159303 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fabac0b06f0 con 0x7fabb00fe5b0 2024-05-06T21:38:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.323+0000 7fabb53d1640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab9c06e170 0x7fab9c070620 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fabb0196910 tx=0x7faba0005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:23.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.327+0000 7faba6ffd640 1 -- 172.21.15.32:0/531159303 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fabac079890 con 0x7fabb00fe5b0 2024-05-06T21:38:23.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:23 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3466396168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:38:23.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.512+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fabb0196650 con 0x7fabb00fe5b0 2024-05-06T21:38:23.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.512+0000 7faba6ffd640 1 -- 172.21.15.32:0/531159303 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7fabac07cf50 con 0x7fabb00fe5b0 2024-05-06T21:38:23.507 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-05-06T21:38:23.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab9c06e170 msgr2=0x7fab9c070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab9c06e170 0x7fab9c070620 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fabb0196910 tx=0x7faba0005d30 comp rx=0 tx=0).stop 2024-05-06T21:38:23.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb00fe5b0 msgr2=0x7fabb0195300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb00fe5b0 0x7fabb0195300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabac009230 tx=0x7fabac004040 comp rx=0 tx=0).stop 2024-05-06T21:38:23.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 shutdown_connections 2024-05-06T21:38:23.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fab9c06e170 0x7fab9c070620 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb0104590 0x7fabb0195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 --2- 172.21.15.32:0/531159303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabb00fe5b0 0x7fabb0195300 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 >> 172.21.15.32:0/531159303 conn(0x7fabb00743d0 msgr2=0x7fabb0067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:23.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 shutdown_connections 2024-05-06T21:38:23.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.514+0000 7fabb7e36640 1 -- 172.21.15.32:0/531159303 wait complete. 2024-05-06T21:38:23.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-05-06T21:38:23.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.636+0000 7fa17e5b9640 1 -- 172.21.15.32:0/3888700650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178105690 msgr2=0x7fa178105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.636+0000 7fa17e5b9640 1 --2- 172.21.15.32:0/3888700650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178105690 0x7fa178105a60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa168009880 tx=0x7fa16802bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.636+0000 7fa17e5b9640 1 -- 172.21.15.32:0/3888700650 shutdown_connections 2024-05-06T21:38:23.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.636+0000 7fa17e5b9640 1 --2- 172.21.15.32:0/3888700650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa178067350 0x7fa1780677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.636+0000 7fa17e5b9640 1 --2- 172.21.15.32:0/3888700650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178105690 0x7fa178105a60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.636+0000 7fa17e5b9640 1 -- 172.21.15.32:0/3888700650 >> 172.21.15.32:0/3888700650 conn(0x7fa1780743d0 msgr2=0x7fa1780747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:23.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.636+0000 7fa17e5b9640 1 -- 172.21.15.32:0/3888700650 shutdown_connections 2024-05-06T21:38:23.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.636+0000 7fa17e5b9640 1 -- 172.21.15.32:0/3888700650 wait complete. 2024-05-06T21:38:23.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.637+0000 7fa17e5b9640 1 Processor -- start 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.637+0000 7fa17e5b9640 1 -- start start 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa17e5b9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178067350 0x7fa1781952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa17e5b9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa178105690 0x7fa1781957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa17e5b9640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178195e70 con 0x7fa178067350 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa17e5b9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178199c40 con 0x7fa178105690 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa177fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178067350 0x7fa1781952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa177fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178067350 0x7fa1781952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55052/0 (socket says 172.21.15.32:55052) 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa177fff640 1 -- 172.21.15.32:0/2784146354 learned_addr learned my addr 172.21.15.32:0/2784146354 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa177fff640 1 -- 172.21.15.32:0/2784146354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa178105690 msgr2=0x7fa1781957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa177fff640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa178105690 0x7fa1781957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa177fff640 1 -- 172.21.15.32:0/2784146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009560 con 0x7fa178067350 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa177fff640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178067350 0x7fa1781952a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa168009230 tx=0x7fa168004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa1757fa640 1 -- 172.21.15.32:0/2784146354 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1680035f0 con 0x7fa178067350 2024-05-06T21:38:23.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa178199ec0 con 0x7fa178067350 2024-05-06T21:38:23.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.638+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17819a440 con 0x7fa178067350 2024-05-06T21:38:23.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.639+0000 7fa1757fa640 1 -- 172.21.15.32:0/2784146354 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa168003c10 con 0x7fa178067350 2024-05-06T21:38:23.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.639+0000 7fa1757fa640 1 -- 172.21.15.32:0/2784146354 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa168005570 con 0x7fa178067350 2024-05-06T21:38:23.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.640+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa164005280 con 0x7fa178067350 2024-05-06T21:38:23.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.640+0000 7fa1757fa640 1 -- 172.21.15.32:0/2784146354 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa168004dd0 con 0x7fa178067350 2024-05-06T21:38:23.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.641+0000 7fa1757fa640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa16006e170 0x7fa160070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.641+0000 7fa1757fa640 1 -- 172.21.15.32:0/2784146354 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fa1680b0670 con 0x7fa178067350 2024-05-06T21:38:23.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.641+0000 7fa1777fe640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa16006e170 0x7fa160070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.641+0000 7fa1777fe640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa16006e170 0x7fa160070620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa16c005fd0 tx=0x7fa16c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.646+0000 7fa1757fa640 1 -- 172.21.15.32:0/2784146354 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa1680797f0 con 0x7fa178067350 2024-05-06T21:38:23.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.846+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa164005ab0 con 0x7fa178067350 2024-05-06T21:38:23.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.846+0000 7fa1757fa640 1 -- 172.21.15.32:0/2784146354 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa16807ceb0 con 0x7fa178067350 2024-05-06T21:38:23.841 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.848+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa16006e170 msgr2=0x7fa160070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.848+0000 7fa17e5b9640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa16006e170 0x7fa160070620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa16c005fd0 tx=0x7fa16c005850 comp rx=0 tx=0).stop 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.849+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178067350 msgr2=0x7fa1781952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.849+0000 7fa17e5b9640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178067350 0x7fa1781952a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa168009230 tx=0x7fa168004040 comp rx=0 tx=0).stop 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.849+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 shutdown_connections 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.849+0000 7fa17e5b9640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa16006e170 0x7fa160070620 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.849+0000 7fa17e5b9640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa178105690 0x7fa1781957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.849+0000 7fa17e5b9640 1 --2- 172.21.15.32:0/2784146354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa178067350 0x7fa1781952a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.849+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 >> 172.21.15.32:0/2784146354 conn(0x7fa1780743d0 msgr2=0x7fa1780fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.849+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 shutdown_connections 2024-05-06T21:38:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.849+0000 7fa17e5b9640 1 -- 172.21.15.32:0/2784146354 wait complete. 2024-05-06T21:38:23.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-06T21:38:23.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.966+0000 7f6d482c7640 1 -- 172.21.15.32:0/2677175371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 msgr2=0x7f6d401049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.966+0000 7f6d482c7640 1 --2- 172.21.15.32:0/2677175371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 0x7f6d401049a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009880 tx=0x7f6d3c02bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.966+0000 7f6d482c7640 1 -- 172.21.15.32:0/2677175371 shutdown_connections 2024-05-06T21:38:23.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.966+0000 7f6d482c7640 1 --2- 172.21.15.32:0/2677175371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d400fe5a0 0x7f6d400fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.966+0000 7f6d482c7640 1 --2- 172.21.15.32:0/2677175371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 0x7f6d401049a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.966+0000 7f6d482c7640 1 -- 172.21.15.32:0/2677175371 >> 172.21.15.32:0/2677175371 conn(0x7f6d40075270 msgr2=0x7f6d40075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:23.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.966+0000 7f6d482c7640 1 -- 172.21.15.32:0/2677175371 shutdown_connections 2024-05-06T21:38:23.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.966+0000 7f6d482c7640 1 -- 172.21.15.32:0/2677175371 wait complete. 2024-05-06T21:38:23.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.967+0000 7f6d482c7640 1 Processor -- start 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.967+0000 7f6d482c7640 1 -- start start 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.967+0000 7f6d482c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d400fe5a0 0x7f6d401951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.967+0000 7f6d482c7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 0x7f6d40195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.967+0000 7f6d482c7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d40195da0 con 0x7f6d401045d0 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.967+0000 7f6d482c7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d40199b70 con 0x7f6d400fe5a0 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.967+0000 7f6d45862640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 0x7f6d40195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.967+0000 7f6d45862640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 0x7f6d40195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55068/0 (socket says 172.21.15.32:55068) 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.967+0000 7f6d45862640 1 -- 172.21.15.32:0/3468464422 learned_addr learned my addr 172.21.15.32:0/3468464422 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.968+0000 7f6d45862640 1 -- 172.21.15.32:0/3468464422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d400fe5a0 msgr2=0x7f6d401951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.968+0000 7f6d45862640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d400fe5a0 0x7f6d401951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.968+0000 7f6d45862640 1 -- 172.21.15.32:0/3468464422 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c009560 con 0x7f6d401045d0 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.968+0000 7f6d45862640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 0x7f6d40195710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000c810 tx=0x7f6d3000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.968+0000 7f6d377fe640 1 -- 172.21.15.32:0/3468464422 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d300041f0 con 0x7f6d401045d0 2024-05-06T21:38:23.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.968+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d40199e50 con 0x7f6d401045d0 2024-05-06T21:38:23.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.968+0000 7f6d377fe640 1 -- 172.21.15.32:0/3468464422 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d30007e70 con 0x7f6d401045d0 2024-05-06T21:38:23.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.968+0000 7f6d377fe640 1 -- 172.21.15.32:0/3468464422 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d300049d0 con 0x7f6d401045d0 2024-05-06T21:38:23.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.968+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4019a430 con 0x7f6d401045d0 2024-05-06T21:38:23.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.969+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4004e000 con 0x7f6d401045d0 2024-05-06T21:38:23.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.970+0000 7f6d377fe640 1 -- 172.21.15.32:0/3468464422 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6d300079b0 con 0x7f6d401045d0 2024-05-06T21:38:23.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.970+0000 7f6d377fe640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6d2c06e230 0x7f6d2c0706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:23.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.970+0000 7f6d46063640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6d2c06e230 0x7f6d2c0706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:23.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.970+0000 7f6d377fe640 1 -- 172.21.15.32:0/3468464422 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f6d3008e110 con 0x7f6d401045d0 2024-05-06T21:38:23.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.971+0000 7f6d46063640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6d2c06e230 0x7f6d2c0706e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c036040 tx=0x7f6d3c000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:23.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:23.975+0000 7f6d377fe640 1 -- 172.21.15.32:0/3468464422 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f6d30057290 con 0x7f6d401045d0 2024-05-06T21:38:24.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.199+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d40196520 con 0x7f6d401045d0 2024-05-06T21:38:24.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.199+0000 7f6d377fe640 1 -- 172.21.15.32:0/3468464422 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5230 (secure 0 0 0) 0x7f6d3005a950 con 0x7f6d401045d0 2024-05-06T21:38:24.194 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:24.194 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44339,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/171743146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":171743146},{"type":"v1","addr":"172.21.15.154:6825","nonce":171743146}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44353,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6827/3609095923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3609095923},{"type":"v1","addr":"172.21.15.154:6827","nonce":3609095923}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:55.428791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34432,"mds_1":34452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34432":{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":0,"incarnation":38,"state":"up:active","state_seq":19,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34452":{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":1,"incarnation":43,"state":"up:active","state_seq":13,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34432,"qdb_cluster":[34432,34452]},"id":1}]} 2024-05-06T21:38:24.194 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 44 2024-05-06T21:38:24.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6d2c06e230 msgr2=0x7f6d2c0706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6d2c06e230 0x7f6d2c0706e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c036040 tx=0x7f6d3c000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 msgr2=0x7f6d40195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 0x7f6d40195710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000c810 tx=0x7f6d3000ccd0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 shutdown_connections 2024-05-06T21:38:24.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f6d2c06e230 0x7f6d2c0706e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d401045d0 0x7f6d40195710 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 --2- 172.21.15.32:0/3468464422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d400fe5a0 0x7f6d401951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 >> 172.21.15.32:0/3468464422 conn(0x7f6d40075270 msgr2=0x7f6d400fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:24.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 shutdown_connections 2024-05-06T21:38:24.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.201+0000 7f6d482c7640 1 -- 172.21.15.32:0/3468464422 wait complete. 2024-05-06T21:38:24.206 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:24 smithi032 ceph-mon[76650]: pgmap v349: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:24.206 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:24 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2699955714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:38:24.206 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:24 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/531159303' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-06T21:38:24.206 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:24 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2784146354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-06T21:38:24.207 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-05-06T21:38:24.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-05-06T21:38:24.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.318+0000 7fba294ce640 1 -- 172.21.15.32:0/872930881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24100830 msgr2=0x7fba24100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.318+0000 7fba294ce640 1 --2- 172.21.15.32:0/872930881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24100830 0x7fba24100c00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fba140098b0 tx=0x7fba1402bd60 comp rx=0 tx=0).stop 2024-05-06T21:38:24.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.318+0000 7fba294ce640 1 -- 172.21.15.32:0/872930881 shutdown_connections 2024-05-06T21:38:24.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.318+0000 7fba294ce640 1 --2- 172.21.15.32:0/872930881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba24101140 0x7fba24109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.318+0000 7fba294ce640 1 --2- 172.21.15.32:0/872930881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24100830 0x7fba24100c00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.318+0000 7fba294ce640 1 -- 172.21.15.32:0/872930881 >> 172.21.15.32:0/872930881 conn(0x7fba240fa060 msgr2=0x7fba240fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:24.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.318+0000 7fba294ce640 1 -- 172.21.15.32:0/872930881 shutdown_connections 2024-05-06T21:38:24.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.318+0000 7fba294ce640 1 -- 172.21.15.32:0/872930881 wait complete. 2024-05-06T21:38:24.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.319+0000 7fba294ce640 1 Processor -- start 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.319+0000 7fba294ce640 1 -- start start 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.319+0000 7fba294ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba24100830 0x7fba24195360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.319+0000 7fba294ce640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24101140 0x7fba241958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.319+0000 7fba294ce640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba24195f30 con 0x7fba24101140 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.319+0000 7fba294ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba24199d00 con 0x7fba24100830 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.319+0000 7fba227fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24101140 0x7fba241958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.319+0000 7fba227fc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24101140 0x7fba241958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55088/0 (socket says 172.21.15.32:55088) 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.319+0000 7fba227fc640 1 -- 172.21.15.32:0/1558080161 learned_addr learned my addr 172.21.15.32:0/1558080161 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba22ffd640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba24100830 0x7fba24195360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba227fc640 1 -- 172.21.15.32:0/1558080161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba24100830 msgr2=0x7fba24195360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba227fc640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba24100830 0x7fba24195360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba227fc640 1 -- 172.21.15.32:0/1558080161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba14009560 con 0x7fba24101140 2024-05-06T21:38:24.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba227fc640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24101140 0x7fba241958a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fba1800d6f0 tx=0x7fba1800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:24.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba0bfff640 1 -- 172.21.15.32:0/1558080161 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba18009a30 con 0x7fba24101140 2024-05-06T21:38:24.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba24199fe0 con 0x7fba24101140 2024-05-06T21:38:24.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba0bfff640 1 -- 172.21.15.32:0/1558080161 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba180054e0 con 0x7fba24101140 2024-05-06T21:38:24.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba0bfff640 1 -- 172.21.15.32:0/1558080161 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba18010460 con 0x7fba24101140 2024-05-06T21:38:24.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.320+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2419a540 con 0x7fba24101140 2024-05-06T21:38:24.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.321+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2404e000 con 0x7fba24101140 2024-05-06T21:38:24.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.322+0000 7fba0bfff640 1 -- 172.21.15.32:0/1558080161 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fba18009b90 con 0x7fba24101140 2024-05-06T21:38:24.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.323+0000 7fba0bfff640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fba0c06e170 0x7fba0c070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:24.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.323+0000 7fba0bfff640 1 -- 172.21.15.32:0/1558080161 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fba1808de90 con 0x7fba24101140 2024-05-06T21:38:24.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.323+0000 7fba22ffd640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fba0c06e170 0x7fba0c070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:24.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.323+0000 7fba22ffd640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fba0c06e170 0x7fba0c070620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba14036040 tx=0x7fba14005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:24.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.328+0000 7fba0bfff640 1 -- 172.21.15.32:0/1558080161 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fba18057010 con 0x7fba24101140 2024-05-06T21:38:24.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:24 smithi154 ceph-mon[63622]: pgmap v349: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:24.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:24 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2699955714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:38:24.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:24 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/531159303' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-06T21:38:24.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:24 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2784146354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-06T21:38:24.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.551+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fba24106ca0 con 0x7fba24101140 2024-05-06T21:38:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.551+0000 7fba0bfff640 1 -- 172.21.15.32:0/1558080161 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v44) v1 ==== 107+0+4876 (secure 0 0 0) 0x7fba18017090 con 0x7fba24101140 2024-05-06T21:38:24.546 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:24.546 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:26:11.972572+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14486,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi154.rizdbu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6825/345804530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":345804530},{"type":"v1","addr":"172.21.15.154:6825","nonce":345804530}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 19 2024-05-06T21:38:24.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.553+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fba0c06e170 msgr2=0x7fba0c070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.553+0000 7fba294ce640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fba0c06e170 0x7fba0c070620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba14036040 tx=0x7fba14005fd0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.553+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24101140 msgr2=0x7fba241958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.553+0000 7fba294ce640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24101140 0x7fba241958a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fba1800d6f0 tx=0x7fba1800dbb0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.554+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 shutdown_connections 2024-05-06T21:38:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.554+0000 7fba294ce640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fba0c06e170 0x7fba0c070620 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.554+0000 7fba294ce640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba24101140 0x7fba241958a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.554+0000 7fba294ce640 1 --2- 172.21.15.32:0/1558080161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba24100830 0x7fba24195360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.554+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 >> 172.21.15.32:0/1558080161 conn(0x7fba240fa060 msgr2=0x7fba24103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.554+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 shutdown_connections 2024-05-06T21:38:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.554+0000 7fba294ce640 1 -- 172.21.15.32:0/1558080161 wait complete. 2024-05-06T21:38:24.559 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-05-06T21:38:24.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.670+0000 7f83bc0a1640 1 -- 172.21.15.32:0/911706514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 msgr2=0x7f83b4105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.670+0000 7f83bc0a1640 1 --2- 172.21.15.32:0/911706514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 0x7f83b4105a50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009880 tx=0x7f83b002bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.670+0000 7f83bc0a1640 1 -- 172.21.15.32:0/911706514 shutdown_connections 2024-05-06T21:38:24.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.670+0000 7f83bc0a1640 1 --2- 172.21.15.32:0/911706514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b40ff670 0x7f83b40ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.670+0000 7f83bc0a1640 1 --2- 172.21.15.32:0/911706514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 0x7f83b4105a50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.670+0000 7f83bc0a1640 1 -- 172.21.15.32:0/911706514 >> 172.21.15.32:0/911706514 conn(0x7f83b40fb190 msgr2=0x7f83b40fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:24.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.670+0000 7f83bc0a1640 1 -- 172.21.15.32:0/911706514 shutdown_connections 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.670+0000 7f83bc0a1640 1 -- 172.21.15.32:0/911706514 wait complete. 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83bc0a1640 1 Processor -- start 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83bc0a1640 1 -- start start 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83bc0a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b40ff670 0x7f83b4072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83bc0a1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 0x7f83b4072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83bc0a1640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b4072fe0 con 0x7f83b4105680 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83bc0a1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b4073150 con 0x7f83b40ff670 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83b963c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 0x7f83b4072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83b963c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 0x7f83b4072aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55108/0 (socket says 172.21.15.32:55108) 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83b963c640 1 -- 172.21.15.32:0/1556171104 learned_addr learned my addr 172.21.15.32:0/1556171104 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83b963c640 1 -- 172.21.15.32:0/1556171104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b40ff670 msgr2=0x7f83b4072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83b963c640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b40ff670 0x7f83b4072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.671+0000 7f83b963c640 1 -- 172.21.15.32:0/1556171104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0009560 con 0x7f83b4105680 2024-05-06T21:38:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.672+0000 7f83b963c640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 0x7f83b4072aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f83a400b420 tx=0x7f83a400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.672+0000 7f83aaffd640 1 -- 172.21.15.32:0/1556171104 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a4011800 con 0x7f83b4105680 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.672+0000 7f83aaffd640 1 -- 172.21.15.32:0/1556171104 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83a4011e20 con 0x7f83b4105680 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.672+0000 7f83aaffd640 1 -- 172.21.15.32:0/1556171104 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a400f2e0 con 0x7f83b4105680 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.672+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b40733d0 con 0x7f83b4105680 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.672+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b41a19c0 con 0x7f83b4105680 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.673+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b404e000 con 0x7f83b4105680 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.673+0000 7f83aaffd640 1 -- 172.21.15.32:0/1556171104 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f83a4010380 con 0x7f83b4105680 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.674+0000 7f83aaffd640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f83a006e170 0x7f83a0070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.674+0000 7f83b9e3d640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f83a006e170 0x7f83a0070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:24.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.674+0000 7f83aaffd640 1 -- 172.21.15.32:0/1556171104 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f83a408db20 con 0x7f83b4105680 2024-05-06T21:38:24.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.675+0000 7f83b9e3d640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f83a006e170 0x7f83a0070620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83b0036040 tx=0x7f83b0000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:24.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.679+0000 7f83aaffd640 1 -- 172.21.15.32:0/1556171104 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f83a4056ca0 con 0x7f83b4105680 2024-05-06T21:38:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.905+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f83b4107b50 con 0x7f83b4105680 2024-05-06T21:38:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.905+0000 7f83aaffd640 1 -- 172.21.15.32:0/1556171104 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v44) v1 ==== 107+0+4877 (secure 0 0 0) 0x7f83a405a360 con 0x7f83b4105680 2024-05-06T21:38:24.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:24.900 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:27:07.836937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14486,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi154.rizdbu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6825/345804530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":345804530},{"type":"v1","addr":"172.21.15.154:6825","nonce":345804530}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 20 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f83a006e170 msgr2=0x7f83a0070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f83a006e170 0x7f83a0070620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83b0036040 tx=0x7f83b0000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 msgr2=0x7f83b4072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 0x7f83b4072aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f83a400b420 tx=0x7f83a400b8e0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 shutdown_connections 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f83a006e170 0x7f83a0070620 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b4105680 0x7f83b4072aa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 --2- 172.21.15.32:0/1556171104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b40ff670 0x7f83b4072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 >> 172.21.15.32:0/1556171104 conn(0x7f83b40fb190 msgr2=0x7f83b40fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 shutdown_connections 2024-05-06T21:38:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:24.908+0000 7f83bc0a1640 1 -- 172.21.15.32:0/1556171104 wait complete. 2024-05-06T21:38:24.913 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-05-06T21:38:25.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.025+0000 7fcc26390640 1 -- 172.21.15.32:0/16187830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 msgr2=0x7fcc200fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.025+0000 7fcc26390640 1 --2- 172.21.15.32:0/16187830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 0x7fcc200fea20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009880 tx=0x7fcc1402bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.025+0000 7fcc26390640 1 -- 172.21.15.32:0/16187830 shutdown_connections 2024-05-06T21:38:25.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.025+0000 7fcc26390640 1 --2- 172.21.15.32:0/16187830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 0x7fcc200fea20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.025+0000 7fcc26390640 1 --2- 172.21.15.32:0/16187830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc20104590 0x7fcc20104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.025+0000 7fcc26390640 1 -- 172.21.15.32:0/16187830 >> 172.21.15.32:0/16187830 conn(0x7fcc200743d0 msgr2=0x7fcc200747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:25.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.025+0000 7fcc26390640 1 -- 172.21.15.32:0/16187830 shutdown_connections 2024-05-06T21:38:25.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.025+0000 7fcc26390640 1 -- 172.21.15.32:0/16187830 wait complete. 2024-05-06T21:38:25.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.026+0000 7fcc26390640 1 Processor -- start 2024-05-06T21:38:25.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.026+0000 7fcc26390640 1 -- start start 2024-05-06T21:38:25.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.026+0000 7fcc26390640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 0x7fcc201941b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:25.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.026+0000 7fcc26390640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc20104590 0x7fcc201946f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.026+0000 7fcc26390640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20194d80 con 0x7fcc200fe5b0 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.026+0000 7fcc26390640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20198b50 con 0x7fcc20104590 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.026+0000 7fcc1ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 0x7fcc201941b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.026+0000 7fcc1ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 0x7fcc201941b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55126/0 (socket says 172.21.15.32:55126) 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.026+0000 7fcc1ffff640 1 -- 172.21.15.32:0/3876125638 learned_addr learned my addr 172.21.15.32:0/3876125638 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.027+0000 7fcc1f7fe640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc20104590 0x7fcc201946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.027+0000 7fcc1ffff640 1 -- 172.21.15.32:0/3876125638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc20104590 msgr2=0x7fcc201946f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.027+0000 7fcc1ffff640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc20104590 0x7fcc201946f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.027+0000 7fcc1ffff640 1 -- 172.21.15.32:0/3876125638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc14009560 con 0x7fcc200fe5b0 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.027+0000 7fcc1ffff640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 0x7fcc201941b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000eb00 tx=0x7fcc1000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.028+0000 7fcc1d7fa640 1 -- 172.21.15.32:0/3876125638 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc10013070 con 0x7fcc200fe5b0 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.028+0000 7fcc1d7fa640 1 -- 172.21.15.32:0/3876125638 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc1000bd80 con 0x7fcc200fe5b0 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.028+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc20198dd0 con 0x7fcc200fe5b0 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.028+0000 7fcc1d7fa640 1 -- 172.21.15.32:0/3876125638 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc10017410 con 0x7fcc200fe5b0 2024-05-06T21:38:25.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.028+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc20199380 con 0x7fcc200fe5b0 2024-05-06T21:38:25.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.029+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2004e000 con 0x7fcc200fe5b0 2024-05-06T21:38:25.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.029+0000 7fcc1d7fa640 1 -- 172.21.15.32:0/3876125638 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcc100046c0 con 0x7fcc200fe5b0 2024-05-06T21:38:25.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.030+0000 7fcc1d7fa640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcc0806e170 0x7fcc08070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:25.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.030+0000 7fcc1d7fa640 1 -- 172.21.15.32:0/3876125638 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fcc1008fca0 con 0x7fcc200fe5b0 2024-05-06T21:38:25.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.030+0000 7fcc1f7fe640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcc0806e170 0x7fcc08070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:25.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.030+0000 7fcc1f7fe640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcc0806e170 0x7fcc08070620 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc14006010 tx=0x7fcc14005dd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:25.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.034+0000 7fcc1d7fa640 1 -- 172.21.15.32:0/3876125638 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fcc10058e30 con 0x7fcc200fe5b0 2024-05-06T21:38:25.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:25 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3468464422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T21:38:25.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:25 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1558080161' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-05-06T21:38:25.218 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:25 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1556171104' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-05-06T21:38:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.257+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fcc20195500 con 0x7fcc200fe5b0 2024-05-06T21:38:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.257+0000 7fcc1d7fa640 1 -- 172.21.15.32:0/3876125638 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v44) v1 ==== 107+0+4891 (secure 0 0 0) 0x7fcc1005c4f0 con 0x7fcc200fe5b0 2024-05-06T21:38:25.252 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:25.252 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:31:02.916687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14486,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi154.rizdbu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6825/345804530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":345804530},{"type":"v1","addr":"172.21.15.154:6825","nonce":345804530}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[14486,24277]},"id":1}]} 2024-05-06T21:38:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 21 2024-05-06T21:38:25.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcc0806e170 msgr2=0x7fcc08070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcc0806e170 0x7fcc08070620 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc14006010 tx=0x7fcc14005dd0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 msgr2=0x7fcc201941b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 0x7fcc201941b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000eb00 tx=0x7fcc1000ef00 comp rx=0 tx=0).stop 2024-05-06T21:38:25.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 shutdown_connections 2024-05-06T21:38:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcc0806e170 0x7fcc08070620 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc20104590 0x7fcc201946f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 --2- 172.21.15.32:0/3876125638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc200fe5b0 0x7fcc201941b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 >> 172.21.15.32:0/3876125638 conn(0x7fcc200743d0 msgr2=0x7fcc200fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.259+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 shutdown_connections 2024-05-06T21:38:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.260+0000 7fcc26390640 1 -- 172.21.15.32:0/3876125638 wait complete. 2024-05-06T21:38:25.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-05-06T21:38:25.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:25 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3468464422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-06T21:38:25.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:25 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1558080161' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-05-06T21:38:25.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:25 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1556171104' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-05-06T21:38:25.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.375+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1275128164 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 msgr2=0x7ff938100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.375+0000 7ff93f6ab640 1 --2- 172.21.15.32:0/1275128164 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 0x7ff938100df0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff9340098b0 tx=0x7ff93402bd60 comp rx=0 tx=0).stop 2024-05-06T21:38:25.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.375+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1275128164 shutdown_connections 2024-05-06T21:38:25.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.375+0000 7ff93f6ab640 1 --2- 172.21.15.32:0/1275128164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff938101330 0x7ff938109820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.375+0000 7ff93f6ab640 1 --2- 172.21.15.32:0/1275128164 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 0x7ff938100df0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.375+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1275128164 >> 172.21.15.32:0/1275128164 conn(0x7ff9380fa250 msgr2=0x7ff9380fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:25.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.375+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1275128164 shutdown_connections 2024-05-06T21:38:25.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.375+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1275128164 wait complete. 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93f6ab640 1 Processor -- start 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93f6ab640 1 -- start start 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93f6ab640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 0x7ff938195580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93f6ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff938101330 0x7ff938195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93f6ab640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938196150 con 0x7ff938100a20 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93f6ab640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938199f20 con 0x7ff938101330 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93d447640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 0x7ff938195580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93d447640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 0x7ff938195580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55130/0 (socket says 172.21.15.32:55130) 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93d447640 1 -- 172.21.15.32:0/1954089685 learned_addr learned my addr 172.21.15.32:0/1954089685 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:25.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93cc46640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff938101330 0x7ff938195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93d447640 1 -- 172.21.15.32:0/1954089685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff938101330 msgr2=0x7ff938195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93d447640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff938101330 0x7ff938195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93d447640 1 -- 172.21.15.32:0/1954089685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934009560 con 0x7ff938100a20 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.376+0000 7ff93cc46640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff938101330 0x7ff938195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.377+0000 7ff93d447640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 0x7ff938195580 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff934009880 tx=0x7ff93402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.377+0000 7ff92e7fc640 1 -- 172.21.15.32:0/1954089685 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9340035f0 con 0x7ff938100a20 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.377+0000 7ff92e7fc640 1 -- 172.21.15.32:0/1954089685 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff934003c10 con 0x7ff938100a20 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.377+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93819a1a0 con 0x7ff938100a20 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.377+0000 7ff92e7fc640 1 -- 172.21.15.32:0/1954089685 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff934005690 con 0x7ff938100a20 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.377+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93819a700 con 0x7ff938100a20 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.378+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93804e000 con 0x7ff938100a20 2024-05-06T21:38:25.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.378+0000 7ff92e7fc640 1 -- 172.21.15.32:0/1954089685 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff934004ed0 con 0x7ff938100a20 2024-05-06T21:38:25.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.379+0000 7ff92e7fc640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff92406e170 0x7ff924070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:25.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.379+0000 7ff93cc46640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff92406e170 0x7ff924070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:25.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.379+0000 7ff92e7fc640 1 -- 172.21.15.32:0/1954089685 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7ff9340b0e10 con 0x7ff938100a20 2024-05-06T21:38:25.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.380+0000 7ff93cc46640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff92406e170 0x7ff924070620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff928005d00 tx=0x7ff928009550 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:25.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.384+0000 7ff92e7fc640 1 -- 172.21.15.32:0/1954089685 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff93407a010 con 0x7ff938100a20 2024-05-06T21:38:25.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.606+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7ff938066860 con 0x7ff938100a20 2024-05-06T21:38:25.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.607+0000 7ff92e7fc640 1 -- 172.21.15.32:0/1954089685 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v44) v1 ==== 107+0+4890 (secure 0 0 0) 0x7ff934043090 con 0x7ff938100a20 2024-05-06T21:38:25.601 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:25.602 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:31:11.981773+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14486,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi154.rizdbu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6825/345804530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":345804530},{"type":"v1","addr":"172.21.15.154:6825","nonce":345804530}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[24277,14486]},"id":1}]} 2024-05-06T21:38:25.602 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 22 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff92406e170 msgr2=0x7ff924070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff92406e170 0x7ff924070620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff928005d00 tx=0x7ff928009550 comp rx=0 tx=0).stop 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 msgr2=0x7ff938195580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 0x7ff938195580 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff934009880 tx=0x7ff93402c8d0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 shutdown_connections 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff92406e170 0x7ff924070620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff938101330 0x7ff938195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 --2- 172.21.15.32:0/1954089685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff938100a20 0x7ff938195580 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 >> 172.21.15.32:0/1954089685 conn(0x7ff9380fa250 msgr2=0x7ff938104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 shutdown_connections 2024-05-06T21:38:25.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.609+0000 7ff93f6ab640 1 -- 172.21.15.32:0/1954089685 wait complete. 2024-05-06T21:38:25.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-05-06T21:38:25.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.724+0000 7f8ec8df0640 1 -- 172.21.15.32:0/952589901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 msgr2=0x7f8ec4067720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.724+0000 7f8ec8df0640 1 --2- 172.21.15.32:0/952589901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 0x7f8ec4067720 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009c20 tx=0x7f8eb402c1b0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.725+0000 7f8ec8df0640 1 -- 172.21.15.32:0/952589901 shutdown_connections 2024-05-06T21:38:25.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.725+0000 7f8ec8df0640 1 --2- 172.21.15.32:0/952589901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec4067c60 0x7f8ec410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.725+0000 7f8ec8df0640 1 --2- 172.21.15.32:0/952589901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 0x7f8ec4067720 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.725+0000 7f8ec8df0640 1 -- 172.21.15.32:0/952589901 >> 172.21.15.32:0/952589901 conn(0x7f8ec40743d0 msgr2=0x7f8ec40747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:25.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.725+0000 7f8ec8df0640 1 -- 172.21.15.32:0/952589901 shutdown_connections 2024-05-06T21:38:25.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.725+0000 7f8ec8df0640 1 -- 172.21.15.32:0/952589901 wait complete. 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.725+0000 7f8ec8df0640 1 Processor -- start 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.725+0000 7f8ec8df0640 1 -- start start 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec8df0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 0x7f8ec41974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec8df0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec4067c60 0x7f8ec4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec8df0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec41980c0 con 0x7f8ec4067350 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec8df0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec419be90 con 0x7f8ec4067c60 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec259c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 0x7f8ec41974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec259c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 0x7f8ec41974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55154/0 (socket says 172.21.15.32:55154) 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec259c640 1 -- 172.21.15.32:0/1092610868 learned_addr learned my addr 172.21.15.32:0/1092610868 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec259c640 1 -- 172.21.15.32:0/1092610868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec4067c60 msgr2=0x7f8ec4197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec259c640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec4067c60 0x7f8ec4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec259c640 1 -- 172.21.15.32:0/1092610868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4009900 con 0x7f8ec4067350 2024-05-06T21:38:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec259c640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 0x7f8ec41974f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4037040 tx=0x7f8eb4032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ebb7fe640 1 -- 172.21.15.32:0/1092610868 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb4034820 con 0x7f8ec4067350 2024-05-06T21:38:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ebb7fe640 1 -- 172.21.15.32:0/1092610868 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8eb4003e30 con 0x7f8ec4067350 2024-05-06T21:38:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec419c110 con 0x7f8ec4067350 2024-05-06T21:38:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ebb7fe640 1 -- 172.21.15.32:0/1092610868 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb403f440 con 0x7f8ec4067350 2024-05-06T21:38:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.726+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec419c610 con 0x7f8ec4067350 2024-05-06T21:38:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.727+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec404e000 con 0x7f8ec4067350 2024-05-06T21:38:25.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.728+0000 7f8ebb7fe640 1 -- 172.21.15.32:0/1092610868 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8eb403b040 con 0x7f8ec4067350 2024-05-06T21:38:25.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.729+0000 7f8ebb7fe640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8eb006e170 0x7f8eb0070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:25.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.729+0000 7f8ec1d9b640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8eb006e170 0x7f8eb0070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:25.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.729+0000 7f8ebb7fe640 1 -- 172.21.15.32:0/1092610868 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f8eb40b1140 con 0x7f8ec4067350 2024-05-06T21:38:25.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.729+0000 7f8ec1d9b640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8eb006e170 0x7f8eb0070620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8eac005fd0 tx=0x7f8eac005c70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.733+0000 7f8ebb7fe640 1 -- 172.21.15.32:0/1092610868 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8eb407a2c0 con 0x7f8ec4067350 2024-05-06T21:38:25.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.961+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f8ec410ea20 con 0x7f8ec4067350 2024-05-06T21:38:25.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.962+0000 7f8ebb7fe640 1 -- 172.21.15.32:0/1092610868 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v44) v1 ==== 107+0+4890 (secure 0 0 0) 0x7f8eb407d980 con 0x7f8ec4067350 2024-05-06T21:38:25.956 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:25.956 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:32:53.719760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14486,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi154.rizdbu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6825/345804530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":345804530},{"type":"v1","addr":"172.21.15.154:6825","nonce":345804530}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[14486,24277]},"id":1}]} 2024-05-06T21:38:25.957 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 23 2024-05-06T21:38:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8eb006e170 msgr2=0x7f8eb0070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8eb006e170 0x7f8eb0070620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8eac005fd0 tx=0x7f8eac005c70 comp rx=0 tx=0).stop 2024-05-06T21:38:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 msgr2=0x7f8ec41974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 0x7f8ec41974f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4037040 tx=0x7f8eb4032b60 comp rx=0 tx=0).stop 2024-05-06T21:38:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 shutdown_connections 2024-05-06T21:38:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f8eb006e170 0x7f8eb0070620 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec4067c60 0x7f8ec4197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 --2- 172.21.15.32:0/1092610868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ec4067350 0x7f8ec41974f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:25.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 >> 172.21.15.32:0/1092610868 conn(0x7f8ec40743d0 msgr2=0x7f8ec40fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 shutdown_connections 2024-05-06T21:38:25.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:25.964+0000 7f8ec8df0640 1 -- 172.21.15.32:0/1092610868 wait complete. 2024-05-06T21:38:25.969 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-05-06T21:38:25.970 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-05-06T21:38:26.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.080+0000 7fde625fd640 1 -- 172.21.15.32:0/4187677392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c0fdab0 msgr2=0x7fde5c0fdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.080+0000 7fde625fd640 1 --2- 172.21.15.32:0/4187677392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c0fdab0 0x7fde5c0fdf20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fde50009880 tx=0x7fde5002bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.080+0000 7fde625fd640 1 -- 172.21.15.32:0/4187677392 shutdown_connections 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.080+0000 7fde625fd640 1 --2- 172.21.15.32:0/4187677392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c0fdab0 0x7fde5c0fdf20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.080+0000 7fde625fd640 1 --2- 172.21.15.32:0/4187677392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde5c104590 0x7fde5c104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.080+0000 7fde625fd640 1 -- 172.21.15.32:0/4187677392 >> 172.21.15.32:0/4187677392 conn(0x7fde5c074970 msgr2=0x7fde5c074d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.080+0000 7fde625fd640 1 -- 172.21.15.32:0/4187677392 shutdown_connections 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.080+0000 7fde625fd640 1 -- 172.21.15.32:0/4187677392 wait complete. 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde625fd640 1 Processor -- start 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde625fd640 1 -- start start 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde625fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde5c0fdab0 0x7fde5c195320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde625fd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c104590 0x7fde5c195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde625fd640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c195ef0 con 0x7fde5c104590 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde625fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c199cc0 con 0x7fde5c0fdab0 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde5b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c104590 0x7fde5c195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde5b7fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c104590 0x7fde5c195860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55170/0 (socket says 172.21.15.32:55170) 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde5b7fe640 1 -- 172.21.15.32:0/4217126594 learned_addr learned my addr 172.21.15.32:0/4217126594 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde5bfff640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde5c0fdab0 0x7fde5c195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde5b7fe640 1 -- 172.21.15.32:0/4217126594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde5c0fdab0 msgr2=0x7fde5c195320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.081+0000 7fde5b7fe640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde5c0fdab0 0x7fde5c195320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.082+0000 7fde5b7fe640 1 -- 172.21.15.32:0/4217126594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50009560 con 0x7fde5c104590 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.082+0000 7fde5bfff640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde5c0fdab0 0x7fde5c195320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.082+0000 7fde5b7fe640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c104590 0x7fde5c195860 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fde50000c00 tx=0x7fde5002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.082+0000 7fde597fa640 1 -- 172.21.15.32:0/4217126594 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde50004520 con 0x7fde5c104590 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.082+0000 7fde597fa640 1 -- 172.21.15.32:0/4217126594 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde50003ab0 con 0x7fde5c104590 2024-05-06T21:38:26.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.082+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c199f40 con 0x7fde5c104590 2024-05-06T21:38:26.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.082+0000 7fde597fa640 1 -- 172.21.15.32:0/4217126594 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde50034440 con 0x7fde5c104590 2024-05-06T21:38:26.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.082+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c19a440 con 0x7fde5c104590 2024-05-06T21:38:26.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.083+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c04e000 con 0x7fde5c104590 2024-05-06T21:38:26.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.083+0000 7fde597fa640 1 -- 172.21.15.32:0/4217126594 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fde50003c20 con 0x7fde5c104590 2024-05-06T21:38:26.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.084+0000 7fde597fa640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fde4406e170 0x7fde44070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:26.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.084+0000 7fde5bfff640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fde4406e170 0x7fde44070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:26.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.084+0000 7fde597fa640 1 -- 172.21.15.32:0/4217126594 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fde500b06d0 con 0x7fde5c104590 2024-05-06T21:38:26.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.085+0000 7fde5bfff640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fde4406e170 0x7fde44070620 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0058c0 tx=0x7fde4c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:26.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.089+0000 7fde597fa640 1 -- 172.21.15.32:0/4217126594 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fde50079850 con 0x7fde5c104590 2024-05-06T21:38:26.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.314+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fde5c196670 con 0x7fde5c104590 2024-05-06T21:38:26.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.314+0000 7fde597fa640 1 -- 172.21.15.32:0/4217126594 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v44) v1 ==== 107+0+4886 (secure 0 0 0) 0x7fde5007cf10 con 0x7fde5c104590 2024-05-06T21:38:26.309 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:26.309 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:32:54.719550+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14486,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi154.rizdbu","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.154:6825/345804530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":345804530},{"type":"v1","addr":"172.21.15.154:6825","nonce":345804530}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[14486]},"id":1}]} 2024-05-06T21:38:26.310 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 24 2024-05-06T21:38:26.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.316+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fde4406e170 msgr2=0x7fde44070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.316+0000 7fde625fd640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fde4406e170 0x7fde44070620 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0058c0 tx=0x7fde4c005850 comp rx=0 tx=0).stop 2024-05-06T21:38:26.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.316+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c104590 msgr2=0x7fde5c195860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.316+0000 7fde625fd640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c104590 0x7fde5c195860 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fde50000c00 tx=0x7fde5002c850 comp rx=0 tx=0).stop 2024-05-06T21:38:26.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.316+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 shutdown_connections 2024-05-06T21:38:26.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.317+0000 7fde625fd640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fde4406e170 0x7fde44070620 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.317+0000 7fde625fd640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5c104590 0x7fde5c195860 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.317+0000 7fde625fd640 1 --2- 172.21.15.32:0/4217126594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde5c0fdab0 0x7fde5c195320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.317+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 >> 172.21.15.32:0/4217126594 conn(0x7fde5c074970 msgr2=0x7fde5c0fb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:26.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.317+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 shutdown_connections 2024-05-06T21:38:26.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.317+0000 7fde625fd640 1 -- 172.21.15.32:0/4217126594 wait complete. 2024-05-06T21:38:26.321 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:26 smithi032 ceph-mon[76650]: pgmap v350: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:26.321 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:26 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3876125638' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-05-06T21:38:26.321 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:26 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1954089685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-05-06T21:38:26.321 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:26 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1092610868' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-05-06T21:38:26.322 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-05-06T21:38:26.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-05-06T21:38:26.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:26 smithi154 ceph-mon[63622]: pgmap v350: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:26.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:26 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3876125638' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-05-06T21:38:26.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:26 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1954089685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-05-06T21:38:26.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:26 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1092610868' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.432+0000 7f5a18506640 1 -- 172.21.15.32:0/2770519835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 msgr2=0x7f5a100fe780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.432+0000 7f5a18506640 1 --2- 172.21.15.32:0/2770519835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 0x7f5a100fe780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009880 tx=0x7f5a0c02bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.432+0000 7f5a18506640 1 -- 172.21.15.32:0/2770519835 shutdown_connections 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.432+0000 7f5a18506640 1 --2- 172.21.15.32:0/2770519835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a100fed50 0x7f5a1010ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.432+0000 7f5a18506640 1 --2- 172.21.15.32:0/2770519835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 0x7f5a100fe780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.432+0000 7f5a18506640 1 -- 172.21.15.32:0/2770519835 >> 172.21.15.32:0/2770519835 conn(0x7f5a100fa060 msgr2=0x7f5a100fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.432+0000 7f5a18506640 1 -- 172.21.15.32:0/2770519835 shutdown_connections 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.432+0000 7f5a18506640 1 -- 172.21.15.32:0/2770519835 wait complete. 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a18506640 1 Processor -- start 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a18506640 1 -- start start 2024-05-06T21:38:26.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a18506640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 0x7f5a101974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a18506640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a100fed50 0x7f5a10197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a18506640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a101980a0 con 0x7f5a100fe3b0 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a18506640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1019be70 con 0x7f5a100fed50 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a162a2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 0x7f5a101974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a162a2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 0x7f5a101974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55182/0 (socket says 172.21.15.32:55182) 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a162a2640 1 -- 172.21.15.32:0/1056487812 learned_addr learned my addr 172.21.15.32:0/1056487812 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.433+0000 7f5a15aa1640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a100fed50 0x7f5a10197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.434+0000 7f5a162a2640 1 -- 172.21.15.32:0/1056487812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a100fed50 msgr2=0x7f5a10197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.434+0000 7f5a162a2640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a100fed50 0x7f5a10197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.434+0000 7f5a162a2640 1 -- 172.21.15.32:0/1056487812 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c009560 con 0x7f5a100fe3b0 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.434+0000 7f5a162a2640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 0x7f5a101974d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009230 tx=0x7f5a0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.434+0000 7f5a077fe640 1 -- 172.21.15.32:0/1056487812 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c0037c0 con 0x7f5a100fe3b0 2024-05-06T21:38:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.434+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1019c0f0 con 0x7f5a100fe3b0 2024-05-06T21:38:26.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.434+0000 7f5a077fe640 1 -- 172.21.15.32:0/1056487812 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a0c005d50 con 0x7f5a100fe3b0 2024-05-06T21:38:26.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.434+0000 7f5a077fe640 1 -- 172.21.15.32:0/1056487812 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c034440 con 0x7f5a100fe3b0 2024-05-06T21:38:26.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.434+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1019c5f0 con 0x7f5a100fe3b0 2024-05-06T21:38:26.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.435+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1004e000 con 0x7f5a100fe3b0 2024-05-06T21:38:26.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.436+0000 7f5a077fe640 1 -- 172.21.15.32:0/1056487812 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5a0c004dd0 con 0x7f5a100fe3b0 2024-05-06T21:38:26.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.436+0000 7f5a077fe640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f59fc06e170 0x7f59fc070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:26.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.436+0000 7f5a077fe640 1 -- 172.21.15.32:0/1056487812 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f5a0c0b0710 con 0x7f5a100fe3b0 2024-05-06T21:38:26.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.436+0000 7f5a15aa1640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f59fc06e170 0x7f59fc070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:26.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.437+0000 7f5a15aa1640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f59fc06e170 0x7f59fc070620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5a00005fd0 tx=0x7f5a00005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:26.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.441+0000 7f5a077fe640 1 -- 172.21.15.32:0/1056487812 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5a0c079890 con 0x7f5a100fe3b0 2024-05-06T21:38:26.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.662+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f5a10109100 con 0x7f5a100fe3b0 2024-05-06T21:38:26.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.663+0000 7f5a077fe640 1 -- 172.21.15.32:0/1056487812 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v44) v1 ==== 107+0+4887 (secure 0 0 0) 0x7f5a0c0056b0 con 0x7f5a100fe3b0 2024-05-06T21:38:26.658 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:26.658 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:33:02.310844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14486,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi154.rizdbu","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.154:6825/345804530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":345804530},{"type":"v1","addr":"172.21.15.154:6825","nonce":345804530}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[14486]},"id":1}]} 2024-05-06T21:38:26.658 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 25 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f59fc06e170 msgr2=0x7f59fc070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f59fc06e170 0x7f59fc070620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5a00005fd0 tx=0x7f5a00005850 comp rx=0 tx=0).stop 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 msgr2=0x7f5a101974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 0x7f5a101974d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009230 tx=0x7f5a0c004270 comp rx=0 tx=0).stop 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 shutdown_connections 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f59fc06e170 0x7f59fc070620 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a100fed50 0x7f5a10197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 --2- 172.21.15.32:0/1056487812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a100fe3b0 0x7f5a101974d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 >> 172.21.15.32:0/1056487812 conn(0x7f5a100fa060 msgr2=0x7f5a100fb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 shutdown_connections 2024-05-06T21:38:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.665+0000 7f5a18506640 1 -- 172.21.15.32:0/1056487812 wait complete. 2024-05-06T21:38:26.670 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-05-06T21:38:26.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-05-06T21:38:26.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 -- 172.21.15.32:0/2224085421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff010100890 msgr2=0x7ff010100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 --2- 172.21.15.32:0/2224085421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff010100890 0x7ff010100c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff000009880 tx=0x7ff00002bd70 comp rx=0 tx=0).stop 2024-05-06T21:38:26.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 -- 172.21.15.32:0/2224085421 shutdown_connections 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 --2- 172.21.15.32:0/2224085421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0101011a0 0x7ff010109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 --2- 172.21.15.32:0/2224085421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff010100890 0x7ff010100c60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 -- 172.21.15.32:0/2224085421 >> 172.21.15.32:0/2224085421 conn(0x7ff0100fa060 msgr2=0x7ff0100fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 -- 172.21.15.32:0/2224085421 shutdown_connections 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 -- 172.21.15.32:0/2224085421 wait complete. 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 Processor -- start 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.782+0000 7ff0165f0640 1 -- start start 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff0165f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100890 0x7ff0101952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff0165f0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0101011a0 0x7ff010195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff0165f0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff010195eb0 con 0x7ff0101011a0 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff0165f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff010199c80 con 0x7ff010100890 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff007fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0101011a0 0x7ff010195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff007fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0101011a0 0x7ff010195820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55196/0 (socket says 172.21.15.32:55196) 2024-05-06T21:38:26.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff007fff640 1 -- 172.21.15.32:0/3112384263 learned_addr learned my addr 172.21.15.32:0/3112384263 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff00ffff640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100890 0x7ff0101952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff007fff640 1 -- 172.21.15.32:0/3112384263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100890 msgr2=0x7ff0101952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff007fff640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100890 0x7ff0101952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff007fff640 1 -- 172.21.15.32:0/3112384263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000009560 con 0x7ff0101011a0 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff00ffff640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100890 0x7ff0101952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff007fff640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0101011a0 0x7ff010195820 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feff800e970 tx=0x7feff800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff00dffb640 1 -- 172.21.15.32:0/3112384263 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff800cc90 con 0x7ff0101011a0 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff00dffb640 1 -- 172.21.15.32:0/3112384263 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feff800cdf0 con 0x7ff0101011a0 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff00dffb640 1 -- 172.21.15.32:0/3112384263 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff8010430 con 0x7ff0101011a0 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff010199f60 con 0x7ff0101011a0 2024-05-06T21:38:26.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.783+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01019a470 con 0x7ff0101011a0 2024-05-06T21:38:26.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.784+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01004e000 con 0x7ff0101011a0 2024-05-06T21:38:26.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.785+0000 7ff00dffb640 1 -- 172.21.15.32:0/3112384263 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7feff80046c0 con 0x7ff0101011a0 2024-05-06T21:38:26.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.785+0000 7ff00dffb640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7feffc06e170 0x7feffc070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:26.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.786+0000 7ff00ffff640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7feffc06e170 0x7feffc070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:26.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.786+0000 7ff00dffb640 1 -- 172.21.15.32:0/3112384263 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7feff8014070 con 0x7ff0101011a0 2024-05-06T21:38:26.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.786+0000 7ff00ffff640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7feffc06e170 0x7feffc070620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff000006010 tx=0x7ff000000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:26.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:26.790+0000 7ff00dffb640 1 -- 172.21.15.32:0/3112384263 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7feff8057a50 con 0x7ff0101011a0 2024-05-06T21:38:27.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.012+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7ff010106c40 con 0x7ff0101011a0 2024-05-06T21:38:27.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.013+0000 7ff00dffb640 1 -- 172.21.15.32:0/3112384263 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v44) v1 ==== 107+0+4091 (secure 0 0 0) 0x7feff805b110 con 0x7ff0101011a0 2024-05-06T21:38:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:27.008 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:33:27.312354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14486},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[14486]},"id":1}]} 2024-05-06T21:38:27.008 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 26 2024-05-06T21:38:27.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7feffc06e170 msgr2=0x7feffc070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7feffc06e170 0x7feffc070620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff000006010 tx=0x7ff000000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0101011a0 msgr2=0x7ff010195820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0101011a0 0x7ff010195820 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feff800e970 tx=0x7feff800ed70 comp rx=0 tx=0).stop 2024-05-06T21:38:27.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 shutdown_connections 2024-05-06T21:38:27.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7feffc06e170 0x7feffc070620 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0101011a0 0x7ff010195820 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 --2- 172.21.15.32:0/3112384263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100890 0x7ff0101952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 >> 172.21.15.32:0/3112384263 conn(0x7ff0100fa060 msgr2=0x7ff010103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:27.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 shutdown_connections 2024-05-06T21:38:27.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.015+0000 7ff0165f0640 1 -- 172.21.15.32:0/3112384263 wait complete. 2024-05-06T21:38:27.021 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-05-06T21:38:27.021 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-05-06T21:38:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.132+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/375783619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c081045b0 msgr2=0x7f7c08104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.132+0000 7f7c0d2b6640 1 --2- 172.21.15.32:0/375783619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c081045b0 0x7f7c08104980 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009880 tx=0x7f7bf802bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.132+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/375783619 shutdown_connections 2024-05-06T21:38:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.132+0000 7f7c0d2b6640 1 --2- 172.21.15.32:0/375783619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c080fe580 0x7f7c080fe9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.132+0000 7f7c0d2b6640 1 --2- 172.21.15.32:0/375783619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c081045b0 0x7f7c08104980 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.132+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/375783619 >> 172.21.15.32:0/375783619 conn(0x7f7c080fa060 msgr2=0x7f7c080fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.132+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/375783619 shutdown_connections 2024-05-06T21:38:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.132+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/375783619 wait complete. 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7c0d2b6640 1 Processor -- start 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7c0d2b6640 1 -- start start 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7c0d2b6640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c080fe580 0x7f7c08196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7c0d2b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c081045b0 0x7f7c08196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7c0d2b6640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08196c70 con 0x7f7c080fe580 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7c0d2b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08196db0 con 0x7f7c081045b0 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7c06ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c080fe580 0x7f7c08196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7c06ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c080fe580 0x7f7c08196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55220/0 (socket says 172.21.15.32:55220) 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7c06ffd640 1 -- 172.21.15.32:0/3767771426 learned_addr learned my addr 172.21.15.32:0/3767771426 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.133+0000 7f7bfffff640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c081045b0 0x7f7c08196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7c06ffd640 1 -- 172.21.15.32:0/3767771426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c081045b0 msgr2=0x7f7c08196650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7c06ffd640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c081045b0 0x7f7c08196650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7c06ffd640 1 -- 172.21.15.32:0/3767771426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8009560 con 0x7f7c080fe580 2024-05-06T21:38:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7bfffff640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c081045b0 0x7f7c08196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:38:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7c06ffd640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c080fe580 0x7f7c08196110 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009230 tx=0x7f7bf8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7c04ff9640 1 -- 172.21.15.32:0/3767771426 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf80035f0 con 0x7f7c080fe580 2024-05-06T21:38:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7c04ff9640 1 -- 172.21.15.32:0/3767771426 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bf8003c10 con 0x7f7c080fe580 2024-05-06T21:38:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0819f180 con 0x7f7c080fe580 2024-05-06T21:38:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7c04ff9640 1 -- 172.21.15.32:0/3767771426 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf8005670 con 0x7f7c080fe580 2024-05-06T21:38:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.134+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0819f5a0 con 0x7f7c080fe580 2024-05-06T21:38:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.135+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0804e000 con 0x7f7c080fe580 2024-05-06T21:38:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.135+0000 7f7c04ff9640 1 -- 172.21.15.32:0/3767771426 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7bf8004dd0 con 0x7f7c080fe580 2024-05-06T21:38:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.136+0000 7f7c04ff9640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7bf406e170 0x7f7bf4070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.136+0000 7f7c04ff9640 1 -- 172.21.15.32:0/3767771426 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f7bf80b05f0 con 0x7f7c080fe580 2024-05-06T21:38:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.136+0000 7f7bfffff640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7bf406e170 0x7f7bf4070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.137+0000 7f7bfffff640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7bf406e170 0x7f7bf4070620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00058c0 tx=0x7f7bf0005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:27.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.141+0000 7f7c04ff9640 1 -- 172.21.15.32:0/3767771426 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7bf80797f0 con 0x7f7c080fe580 2024-05-06T21:38:27.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.364+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f7c0810b980 con 0x7f7c080fe580 2024-05-06T21:38:27.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.365+0000 7f7c04ff9640 1 -- 172.21.15.32:0/3767771426 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v44) v1 ==== 107+0+4873 (secure 0 0 0) 0x7f7bf807ceb0 con 0x7f7c080fe580 2024-05-06T21:38:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:27.359 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/2817324625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2817324625},{"type":"v1","addr":"172.21.15.32:6827","nonce":2817324625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":44297,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/1058144183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1058144183},{"type":"v1","addr":"172.21.15.154:6825","nonce":1058144183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:33:27.312354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14486},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[14486]},"id":1}]} 2024-05-06T21:38:27.360 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 27 2024-05-06T21:38:27.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.366+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7bf406e170 msgr2=0x7f7bf4070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.366+0000 7f7c0d2b6640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7bf406e170 0x7f7bf4070620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00058c0 tx=0x7f7bf0005850 comp rx=0 tx=0).stop 2024-05-06T21:38:27.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.366+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c080fe580 msgr2=0x7f7c08196110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.366+0000 7f7c0d2b6640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c080fe580 0x7f7c08196110 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009230 tx=0x7f7bf8004040 comp rx=0 tx=0).stop 2024-05-06T21:38:27.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.367+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 shutdown_connections 2024-05-06T21:38:27.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.367+0000 7f7c0d2b6640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f7bf406e170 0x7f7bf4070620 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.367+0000 7f7c0d2b6640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c081045b0 0x7f7c08196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.367+0000 7f7c0d2b6640 1 --2- 172.21.15.32:0/3767771426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c080fe580 0x7f7c08196110 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.367+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 >> 172.21.15.32:0/3767771426 conn(0x7f7c080fa060 msgr2=0x7f7c080fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:27.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.367+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 shutdown_connections 2024-05-06T21:38:27.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.367+0000 7f7c0d2b6640 1 -- 172.21.15.32:0/3767771426 wait complete. 2024-05-06T21:38:27.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:27 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4217126594' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-05-06T21:38:27.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:27 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1056487812' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-05-06T21:38:27.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:27 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3112384263' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-05-06T21:38:27.371 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:27 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4217126594' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-05-06T21:38:27.371 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:27 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1056487812' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-05-06T21:38:27.371 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:27 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3112384263' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-05-06T21:38:27.372 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-05-06T21:38:27.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-05-06T21:38:27.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.482+0000 7f81ae036640 1 -- 172.21.15.32:0/3657536593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a80fe5b0 msgr2=0x7f81a80fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.482+0000 7f81ae036640 1 --2- 172.21.15.32:0/3657536593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a80fe5b0 0x7f81a80fea20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f819c009880 tx=0x7f819c02bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.483+0000 7f81ae036640 1 -- 172.21.15.32:0/3657536593 shutdown_connections 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.483+0000 7f81ae036640 1 --2- 172.21.15.32:0/3657536593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a80fe5b0 0x7f81a80fea20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.483+0000 7f81ae036640 1 --2- 172.21.15.32:0/3657536593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a8104590 0x7f81a8104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.483+0000 7f81ae036640 1 -- 172.21.15.32:0/3657536593 >> 172.21.15.32:0/3657536593 conn(0x7f81a80743d0 msgr2=0x7f81a80747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.483+0000 7f81ae036640 1 -- 172.21.15.32:0/3657536593 shutdown_connections 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.483+0000 7f81ae036640 1 -- 172.21.15.32:0/3657536593 wait complete. 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.483+0000 7f81ae036640 1 Processor -- start 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.483+0000 7f81ae036640 1 -- start start 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81ae036640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80fe5b0 0x7f81a81952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81ae036640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a8104590 0x7f81a8195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81ae036640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8195eb0 con 0x7f81a8104590 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81ae036640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8199c80 con 0x7f81a80fe5b0 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81a6ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a8104590 0x7f81a8195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81a6ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a8104590 0x7f81a8195820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55230/0 (socket says 172.21.15.32:55230) 2024-05-06T21:38:27.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81a6ffd640 1 -- 172.21.15.32:0/3804198195 learned_addr learned my addr 172.21.15.32:0/3804198195 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81a77fe640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80fe5b0 0x7f81a81952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81a6ffd640 1 -- 172.21.15.32:0/3804198195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80fe5b0 msgr2=0x7f81a81952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81a6ffd640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80fe5b0 0x7f81a81952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81a6ffd640 1 -- 172.21.15.32:0/3804198195 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c009560 con 0x7f81a8104590 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81a6ffd640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a8104590 0x7f81a8195820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f819c009230 tx=0x7f819c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.484+0000 7f81a4ff9640 1 -- 172.21.15.32:0/3804198195 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819c0044a0 con 0x7f81a8104590 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.485+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a8199f00 con 0x7f81a8104590 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.485+0000 7f81a4ff9640 1 -- 172.21.15.32:0/3804198195 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f819c003ab0 con 0x7f81a8104590 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.485+0000 7f81a4ff9640 1 -- 172.21.15.32:0/3804198195 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819c0055f0 con 0x7f81a8104590 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.485+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a819a480 con 0x7f81a8104590 2024-05-06T21:38:27.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.485+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a804e000 con 0x7f81a8104590 2024-05-06T21:38:27.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.486+0000 7f81a4ff9640 1 -- 172.21.15.32:0/3804198195 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f819c004e60 con 0x7f81a8104590 2024-05-06T21:38:27.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.487+0000 7f81a4ff9640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f819006e170 0x7f8190070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:27.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.487+0000 7f81a77fe640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f819006e170 0x7f8190070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:27.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.487+0000 7f81a4ff9640 1 -- 172.21.15.32:0/3804198195 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f819c0b0770 con 0x7f81a8104590 2024-05-06T21:38:27.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.487+0000 7f81a77fe640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f819006e170 0x7f8190070620 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8198009bd0 tx=0x7f8198005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:27.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.492+0000 7f81a4ff9640 1 -- 172.21.15.32:0/3804198195 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f819c079900 con 0x7f81a8104590 2024-05-06T21:38:27.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.728+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f81a810b7c0 con 0x7f81a8104590 2024-05-06T21:38:27.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.729+0000 7f81a4ff9640 1 -- 172.21.15.32:0/3804198195 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v44) v1 ==== 107+0+4094 (secure 0 0 0) 0x7f819c07cfc0 con 0x7f81a8104590 2024-05-06T21:38:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:27.724 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":44297,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/1058144183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1058144183},{"type":"v1","addr":"172.21.15.154:6825","nonce":1058144183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:33:27.312354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14486},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[14486]},"id":1}]} 2024-05-06T21:38:27.724 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 28 2024-05-06T21:38:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f819006e170 msgr2=0x7f8190070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f819006e170 0x7f8190070620 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8198009bd0 tx=0x7f8198005f90 comp rx=0 tx=0).stop 2024-05-06T21:38:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a8104590 msgr2=0x7f81a8195820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a8104590 0x7f81a8195820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f819c009230 tx=0x7f819c005e50 comp rx=0 tx=0).stop 2024-05-06T21:38:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 shutdown_connections 2024-05-06T21:38:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f819006e170 0x7f8190070620 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81a8104590 0x7f81a8195820 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 --2- 172.21.15.32:0/3804198195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80fe5b0 0x7f81a81952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 >> 172.21.15.32:0/3804198195 conn(0x7f81a80743d0 msgr2=0x7f81a8067390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:27.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 shutdown_connections 2024-05-06T21:38:27.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.731+0000 7f81ae036640 1 -- 172.21.15.32:0/3804198195 wait complete. 2024-05-06T21:38:27.737 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-05-06T21:38:27.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-05-06T21:38:27.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.847+0000 7f36c69fd640 1 -- 172.21.15.32:0/3130423100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 msgr2=0x7f36c00ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.847+0000 7f36c69fd640 1 --2- 172.21.15.32:0/3130423100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 0x7f36c00ffce0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009880 tx=0x7f36b402bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.847+0000 7f36c69fd640 1 -- 172.21.15.32:0/3130423100 shutdown_connections 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.847+0000 7f36c69fd640 1 --2- 172.21.15.32:0/3130423100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 0x7f36c00ffce0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.847+0000 7f36c69fd640 1 --2- 172.21.15.32:0/3130423100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0105880 0x7f36c0105c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.847+0000 7f36c69fd640 1 -- 172.21.15.32:0/3130423100 >> 172.21.15.32:0/3130423100 conn(0x7f36c00fb370 msgr2=0x7f36c00fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.847+0000 7f36c69fd640 1 -- 172.21.15.32:0/3130423100 shutdown_connections 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.847+0000 7f36c69fd640 1 -- 172.21.15.32:0/3130423100 wait complete. 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36c69fd640 1 Processor -- start 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36c69fd640 1 -- start start 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36c69fd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 0x7f36c0195560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:27.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36c69fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0105880 0x7f36c0195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36c69fd640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c01960a0 con 0x7f36c00ff870 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36c69fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c0196210 con 0x7f36c0105880 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36bffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 0x7f36c0195560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36bffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 0x7f36c0195560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55244/0 (socket says 172.21.15.32:55244) 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36bffff640 1 -- 172.21.15.32:0/3754219947 learned_addr learned my addr 172.21.15.32:0/3754219947 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36bf7fe640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0105880 0x7f36c0195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36bffff640 1 -- 172.21.15.32:0/3754219947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0105880 msgr2=0x7f36c0195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36bffff640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0105880 0x7f36c0195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.848+0000 7f36bffff640 1 -- 172.21.15.32:0/3754219947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4009560 con 0x7f36c00ff870 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.849+0000 7f36bffff640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 0x7f36c0195560 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c8f0 tx=0x7f36b000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.849+0000 7f36bd7fa640 1 -- 172.21.15.32:0/3754219947 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b00041f0 con 0x7f36c00ff870 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.849+0000 7f36bd7fa640 1 -- 172.21.15.32:0/3754219947 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36b0007e10 con 0x7f36c00ff870 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.849+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c019a0a0 con 0x7f36c00ff870 2024-05-06T21:38:27.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.849+0000 7f36bd7fa640 1 -- 172.21.15.32:0/3754219947 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b000f450 con 0x7f36c00ff870 2024-05-06T21:38:27.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.849+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c019a5d0 con 0x7f36c00ff870 2024-05-06T21:38:27.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.850+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c004e000 con 0x7f36c00ff870 2024-05-06T21:38:27.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.850+0000 7f36bd7fa640 1 -- 172.21.15.32:0/3754219947 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f36b0007950 con 0x7f36c00ff870 2024-05-06T21:38:27.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.851+0000 7f36bd7fa640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f36a806e170 0x7f36a8070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:27.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.851+0000 7f36bd7fa640 1 -- 172.21.15.32:0/3754219947 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f36b0013070 con 0x7f36c00ff870 2024-05-06T21:38:27.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.851+0000 7f36bf7fe640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f36a806e170 0x7f36a8070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:27.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.851+0000 7f36bf7fe640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f36a806e170 0x7f36a8070620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36b4006010 tx=0x7f36b402cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:27.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:27.856+0000 7f36bd7fa640 1 -- 172.21.15.32:0/3754219947 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f36b0057530 con 0x7f36c00ff870 2024-05-06T21:38:28.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.080+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f36c0066860 con 0x7f36c00ff870 2024-05-06T21:38:28.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.080+0000 7f36bd7fa640 1 -- 172.21.15.32:0/3754219947 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v44) v1 ==== 107+0+4941 (secure 0 0 0) 0x7f36b005abf0 con 0x7f36c00ff870 2024-05-06T21:38:28.075 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:28.075 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44297,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/1058144183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1058144183},{"type":"v1","addr":"172.21.15.154:6825","nonce":1058144183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:33:27.312354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14486},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi032.jbgmwi","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6829/1302339589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1302339589},{"type":"v1","addr":"172.21.15.32:6829","nonce":1302339589}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[14486]},"id":1}]} 2024-05-06T21:38:28.075 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 29 2024-05-06T21:38:28.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.082+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f36a806e170 msgr2=0x7f36a8070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.082+0000 7f36c69fd640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f36a806e170 0x7f36a8070620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36b4006010 tx=0x7f36b402cf90 comp rx=0 tx=0).stop 2024-05-06T21:38:28.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.082+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 msgr2=0x7f36c0195560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.082+0000 7f36c69fd640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 0x7f36c0195560 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c8f0 tx=0x7f36b000cdb0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.082+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 shutdown_connections 2024-05-06T21:38:28.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.082+0000 7f36c69fd640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f36a806e170 0x7f36a8070620 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.082+0000 7f36c69fd640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0105880 0x7f36c0195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.082+0000 7f36c69fd640 1 --2- 172.21.15.32:0/3754219947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36c00ff870 0x7f36c0195560 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.082+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 >> 172.21.15.32:0/3754219947 conn(0x7f36c00fb370 msgr2=0x7f36c00fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:28.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.083+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 shutdown_connections 2024-05-06T21:38:28.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.083+0000 7f36c69fd640 1 -- 172.21.15.32:0/3754219947 wait complete. 2024-05-06T21:38:28.088 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-05-06T21:38:28.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.199+0000 7fe727fbe640 1 -- 172.21.15.32:0/3770964408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 msgr2=0x7fe7200ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.199+0000 7fe727fbe640 1 --2- 172.21.15.32:0/3770964408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 0x7fe7200ffce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe710009880 tx=0x7fe71002bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.199+0000 7fe727fbe640 1 -- 172.21.15.32:0/3770964408 shutdown_connections 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.199+0000 7fe727fbe640 1 --2- 172.21.15.32:0/3770964408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 0x7fe7200ffce0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.199+0000 7fe727fbe640 1 --2- 172.21.15.32:0/3770964408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720105880 0x7fe720105c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.199+0000 7fe727fbe640 1 -- 172.21.15.32:0/3770964408 >> 172.21.15.32:0/3770964408 conn(0x7fe7200fb370 msgr2=0x7fe7200fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.199+0000 7fe727fbe640 1 -- 172.21.15.32:0/3770964408 shutdown_connections 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.199+0000 7fe727fbe640 1 -- 172.21.15.32:0/3770964408 wait complete. 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe727fbe640 1 Processor -- start 2024-05-06T21:38:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe727fbe640 1 -- start start 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe727fbe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 0x7fe720195580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe727fbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720105880 0x7fe720195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe727fbe640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe720196150 con 0x7fe7200ff870 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe727fbe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe720199f20 con 0x7fe720105880 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe725d5a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 0x7fe720195580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe725d5a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 0x7fe720195580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55262/0 (socket says 172.21.15.32:55262) 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe725d5a640 1 -- 172.21.15.32:0/389090096 learned_addr learned my addr 172.21.15.32:0/389090096 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.200+0000 7fe725559640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720105880 0x7fe720195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe725d5a640 1 -- 172.21.15.32:0/389090096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720105880 msgr2=0x7fe720195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe725d5a640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720105880 0x7fe720195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe725d5a640 1 -- 172.21.15.32:0/389090096 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710009560 con 0x7fe7200ff870 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe725559640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720105880 0x7fe720195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:38:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe725d5a640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 0x7fe720195580 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00d8d0 tx=0x7fe71c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe716ffd640 1 -- 172.21.15.32:0/389090096 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe71c009a30 con 0x7fe7200ff870 2024-05-06T21:38:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72019a200 con 0x7fe7200ff870 2024-05-06T21:38:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe716ffd640 1 -- 172.21.15.32:0/389090096 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe71c009b90 con 0x7fe7200ff870 2024-05-06T21:38:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe716ffd640 1 -- 172.21.15.32:0/389090096 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe71c00f680 con 0x7fe7200ff870 2024-05-06T21:38:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.201+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72019a760 con 0x7fe7200ff870 2024-05-06T21:38:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.202+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72004e000 con 0x7fe7200ff870 2024-05-06T21:38:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.203+0000 7fe716ffd640 1 -- 172.21.15.32:0/389090096 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe71c009d00 con 0x7fe7200ff870 2024-05-06T21:38:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.203+0000 7fe716ffd640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe70c06e170 0x7fe70c070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.203+0000 7fe716ffd640 1 -- 172.21.15.32:0/389090096 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fe71c08e150 con 0x7fe7200ff870 2024-05-06T21:38:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.203+0000 7fe725559640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe70c06e170 0x7fe70c070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.204+0000 7fe725559640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe70c06e170 0x7fe70c070620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe720196b90 tx=0x7fe71002cb40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:28.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.208+0000 7fe716ffd640 1 -- 172.21.15.32:0/389090096 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe71c0572d0 con 0x7fe7200ff870 2024-05-06T21:38:28.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:28 smithi154 ceph-mon[63622]: pgmap v351: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:28.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:28 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3767771426' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-05-06T21:38:28.363 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:28 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3804198195' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-05-06T21:38:28.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.437+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fe720066860 con 0x7fe7200ff870 2024-05-06T21:38:28.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.438+0000 7fe716ffd640 1 -- 172.21.15.32:0/389090096 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v44) v1 ==== 107+0+4142 (secure 0 0 0) 0x7fe71c05a990 con 0x7fe7200ff870 2024-05-06T21:38:28.432 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:28.432 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44297,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/1058144183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1058144183},{"type":"v1","addr":"172.21.15.154:6825","nonce":1058144183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:33:59.176923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:28.433 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 30 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe70c06e170 msgr2=0x7fe70c070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe70c06e170 0x7fe70c070620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe720196b90 tx=0x7fe71002cb40 comp rx=0 tx=0).stop 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 msgr2=0x7fe720195580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 0x7fe720195580 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00d8d0 tx=0x7fe71c00dd90 comp rx=0 tx=0).stop 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 shutdown_connections 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe70c06e170 0x7fe70c070620 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720105880 0x7fe720195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 --2- 172.21.15.32:0/389090096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7200ff870 0x7fe720195580 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 >> 172.21.15.32:0/389090096 conn(0x7fe7200fb370 msgr2=0x7fe7200fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 shutdown_connections 2024-05-06T21:38:28.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.440+0000 7fe727fbe640 1 -- 172.21.15.32:0/389090096 wait complete. 2024-05-06T21:38:28.444 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:28 smithi032 ceph-mon[76650]: pgmap v351: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:28.444 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:28 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3767771426' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-05-06T21:38:28.445 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:28 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3804198195' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-05-06T21:38:28.446 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-05-06T21:38:28.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-05-06T21:38:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 -- 172.21.15.32:0/3201175233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 msgr2=0x7f38b0105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 --2- 172.21.15.32:0/3201175233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 0x7f38b0105a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009880 tx=0x7f38a002bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 -- 172.21.15.32:0/3201175233 shutdown_connections 2024-05-06T21:38:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 --2- 172.21.15.32:0/3201175233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b00ff670 0x7f38b00ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 --2- 172.21.15.32:0/3201175233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 0x7f38b0105a50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 -- 172.21.15.32:0/3201175233 >> 172.21.15.32:0/3201175233 conn(0x7f38b00fb190 msgr2=0x7f38b00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 -- 172.21.15.32:0/3201175233 shutdown_connections 2024-05-06T21:38:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 -- 172.21.15.32:0/3201175233 wait complete. 2024-05-06T21:38:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 Processor -- start 2024-05-06T21:38:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.557+0000 7f38b4d54640 1 -- start start 2024-05-06T21:38:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38b4d54640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b00ff670 0x7f38b0072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38b4d54640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 0x7f38b0072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38b4d54640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b0072fe0 con 0x7f38b0105680 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38b4d54640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b0073150 con 0x7f38b00ff670 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a7fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 0x7f38b0072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a7fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 0x7f38b0072aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55276/0 (socket says 172.21.15.32:55276) 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a7fff640 1 -- 172.21.15.32:0/572222136 learned_addr learned my addr 172.21.15.32:0/572222136 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38ae59c640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b00ff670 0x7f38b0072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a7fff640 1 -- 172.21.15.32:0/572222136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b00ff670 msgr2=0x7f38b0072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a7fff640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b00ff670 0x7f38b0072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a7fff640 1 -- 172.21.15.32:0/572222136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a0009560 con 0x7f38b0105680 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a7fff640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 0x7f38b0072aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f389800b420 tx=0x7f389800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a77fe640 1 -- 172.21.15.32:0/572222136 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3898011800 con 0x7f38b0105680 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a77fe640 1 -- 172.21.15.32:0/572222136 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3898011e20 con 0x7f38b0105680 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b00733d0 con 0x7f38b0105680 2024-05-06T21:38:28.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.558+0000 7f38a77fe640 1 -- 172.21.15.32:0/572222136 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f389800f2e0 con 0x7f38b0105680 2024-05-06T21:38:28.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.559+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b01a19e0 con 0x7f38b0105680 2024-05-06T21:38:28.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.559+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b004e000 con 0x7f38b0105680 2024-05-06T21:38:28.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.560+0000 7f38a77fe640 1 -- 172.21.15.32:0/572222136 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3898010380 con 0x7f38b0105680 2024-05-06T21:38:28.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.560+0000 7f38a77fe640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f389c06e170 0x7f389c070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:28.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.561+0000 7f38ae59c640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f389c06e170 0x7f389c070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:28.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.561+0000 7f38a77fe640 1 -- 172.21.15.32:0/572222136 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f389808da50 con 0x7f38b0105680 2024-05-06T21:38:28.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.561+0000 7f38ae59c640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f389c06e170 0x7f389c070620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006010 tx=0x7f38a0000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:28.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.565+0000 7f38a77fe640 1 -- 172.21.15.32:0/572222136 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3898056c50 con 0x7f38b0105680 2024-05-06T21:38:28.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.788+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f38b0107b50 con 0x7f38b0105680 2024-05-06T21:38:28.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.789+0000 7f38a77fe640 1 -- 172.21.15.32:0/572222136 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v44) v1 ==== 107+0+4153 (secure 0 0 0) 0x7f389805a310 con 0x7f38b0105680 2024-05-06T21:38:28.783 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:28.784 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44297,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/1058144183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1058144183},{"type":"v1","addr":"172.21.15.154:6825","nonce":1058144183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:33:59.181103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":0,"incarnation":31,"state":"up:replay","state_seq":2,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:28.784 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 31 2024-05-06T21:38:28.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f389c06e170 msgr2=0x7f389c070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f389c06e170 0x7f389c070620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006010 tx=0x7f38a0000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 msgr2=0x7f38b0072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 0x7f38b0072aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f389800b420 tx=0x7f389800b8e0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 shutdown_connections 2024-05-06T21:38:28.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f389c06e170 0x7f389c070620 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38b0105680 0x7f38b0072aa0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 --2- 172.21.15.32:0/572222136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b00ff670 0x7f38b0072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 >> 172.21.15.32:0/572222136 conn(0x7f38b00fb190 msgr2=0x7f38b00fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:28.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 shutdown_connections 2024-05-06T21:38:28.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.791+0000 7f38b4d54640 1 -- 172.21.15.32:0/572222136 wait complete. 2024-05-06T21:38:28.796 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-05-06T21:38:28.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-05-06T21:38:28.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.908+0000 7f17f891a640 1 -- 172.21.15.32:0/1247590218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 msgr2=0x7f17f4105c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.908+0000 7f17f891a640 1 --2- 172.21.15.32:0/1247590218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 0x7f17f4105c50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009880 tx=0x7f17e402bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.908+0000 7f17f891a640 1 -- 172.21.15.32:0/1247590218 shutdown_connections 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.908+0000 7f17f891a640 1 --2- 172.21.15.32:0/1247590218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17f40ff870 0x7f17f40ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.908+0000 7f17f891a640 1 --2- 172.21.15.32:0/1247590218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 0x7f17f4105c50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.908+0000 7f17f891a640 1 -- 172.21.15.32:0/1247590218 >> 172.21.15.32:0/1247590218 conn(0x7f17f40fb370 msgr2=0x7f17f40fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.908+0000 7f17f891a640 1 -- 172.21.15.32:0/1247590218 shutdown_connections 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.908+0000 7f17f891a640 1 -- 172.21.15.32:0/1247590218 wait complete. 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17f891a640 1 Processor -- start 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17f891a640 1 -- start start 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17f891a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17f40ff870 0x7f17f41955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17f891a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 0x7f17f4195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17f891a640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41961a0 con 0x7f17f4105880 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17f891a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4199f70 con 0x7f17f40ff870 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17ebfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 0x7f17f4195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17ebfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 0x7f17f4195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55292/0 (socket says 172.21.15.32:55292) 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17ebfff640 1 -- 172.21.15.32:0/2422471289 learned_addr learned my addr 172.21.15.32:0/2422471289 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17ebfff640 1 -- 172.21.15.32:0/2422471289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17f40ff870 msgr2=0x7f17f41955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17ebfff640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17f40ff870 0x7f17f41955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.909+0000 7f17ebfff640 1 -- 172.21.15.32:0/2422471289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4009560 con 0x7f17f4105880 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.910+0000 7f17ebfff640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 0x7f17f4195b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00b420 tx=0x7f17dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.910+0000 7f17eb7fe640 1 -- 172.21.15.32:0/2422471289 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17dc011800 con 0x7f17f4105880 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.910+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f419a250 con 0x7f17f4105880 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.910+0000 7f17eb7fe640 1 -- 172.21.15.32:0/2422471289 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17dc011e20 con 0x7f17f4105880 2024-05-06T21:38:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.910+0000 7f17eb7fe640 1 -- 172.21.15.32:0/2422471289 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17dc00f2e0 con 0x7f17f4105880 2024-05-06T21:38:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.910+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f419a830 con 0x7f17f4105880 2024-05-06T21:38:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.911+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f404e000 con 0x7f17f4105880 2024-05-06T21:38:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.911+0000 7f17eb7fe640 1 -- 172.21.15.32:0/2422471289 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f17dc010380 con 0x7f17f4105880 2024-05-06T21:38:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.912+0000 7f17eb7fe640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f17e006e170 0x7f17e0070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.912+0000 7f17eb7fe640 1 -- 172.21.15.32:0/2422471289 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f17dc08dc50 con 0x7f17f4105880 2024-05-06T21:38:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.912+0000 7f17f259c640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f17e006e170 0x7f17e0070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.912+0000 7f17f259c640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f17e006e170 0x7f17e0070620 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f17e4036040 tx=0x7f17e4000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:28.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:28.916+0000 7f17eb7fe640 1 -- 172.21.15.32:0/2422471289 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f17dc056dd0 con 0x7f17f4105880 2024-05-06T21:38:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.141+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f17f4066860 con 0x7f17f4105880 2024-05-06T21:38:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.141+0000 7f17eb7fe640 1 -- 172.21.15.32:0/2422471289 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v44) v1 ==== 107+0+4158 (secure 0 0 0) 0x7f17dc05a490 con 0x7f17f4105880 2024-05-06T21:38:29.136 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:29.136 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44297,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/1058144183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1058144183},{"type":"v1","addr":"172.21.15.154:6825","nonce":1058144183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:06.284521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":152,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 32 2024-05-06T21:38:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f17e006e170 msgr2=0x7f17e0070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f17e006e170 0x7f17e0070620 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f17e4036040 tx=0x7f17e4000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 msgr2=0x7f17f4195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 0x7f17f4195b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00b420 tx=0x7f17dc00b8e0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 shutdown_connections 2024-05-06T21:38:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f17e006e170 0x7f17e0070620 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17f4105880 0x7f17f4195b10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 --2- 172.21.15.32:0/2422471289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17f40ff870 0x7f17f41955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 >> 172.21.15.32:0/2422471289 conn(0x7f17f40fb370 msgr2=0x7f17f40fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:29.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 shutdown_connections 2024-05-06T21:38:29.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.144+0000 7f17f891a640 1 -- 172.21.15.32:0/2422471289 wait complete. 2024-05-06T21:38:29.148 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:29 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3754219947' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-05-06T21:38:29.148 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:29 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/389090096' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-05-06T21:38:29.148 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:29 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/572222136' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-05-06T21:38:29.149 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-05-06T21:38:29.150 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-05-06T21:38:29.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 -- 172.21.15.32:0/1014488644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42340fe5b0 msgr2=0x7f42340fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 --2- 172.21.15.32:0/1014488644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42340fe5b0 0x7f42340fea20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4224009880 tx=0x7f422402bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 -- 172.21.15.32:0/1014488644 shutdown_connections 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 --2- 172.21.15.32:0/1014488644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42340fe5b0 0x7f42340fea20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 --2- 172.21.15.32:0/1014488644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4234104590 0x7f4234104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 -- 172.21.15.32:0/1014488644 >> 172.21.15.32:0/1014488644 conn(0x7f42340743d0 msgr2=0x7f42340747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 -- 172.21.15.32:0/1014488644 shutdown_connections 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 -- 172.21.15.32:0/1014488644 wait complete. 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 Processor -- start 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.260+0000 7f423c621640 1 -- start start 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f423c621640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42340fe5b0 0x7f4234195290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f423c621640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4234104590 0x7f42341957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f423c621640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4234195e60 con 0x7f4234104590 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f423c621640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4234199c30 con 0x7f42340fe5b0 2024-05-06T21:38:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f4239bbc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4234104590 0x7f42341957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f4239bbc640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4234104590 0x7f42341957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55298/0 (socket says 172.21.15.32:55298) 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f4239bbc640 1 -- 172.21.15.32:0/4058643546 learned_addr learned my addr 172.21.15.32:0/4058643546 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f423a3bd640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42340fe5b0 0x7f4234195290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f4239bbc640 1 -- 172.21.15.32:0/4058643546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42340fe5b0 msgr2=0x7f4234195290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f4239bbc640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42340fe5b0 0x7f4234195290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f4239bbc640 1 -- 172.21.15.32:0/4058643546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224009560 con 0x7f4234104590 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f423a3bd640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42340fe5b0 0x7f4234195290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f4239bbc640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4234104590 0x7f42341957d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4224009230 tx=0x7f4224004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f422b7fe640 1 -- 172.21.15.32:0/4058643546 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42240035f0 con 0x7f4234104590 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f422b7fe640 1 -- 172.21.15.32:0/4058643546 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4224003c10 con 0x7f4234104590 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4234199eb0 con 0x7f4234104590 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.261+0000 7f422b7fe640 1 -- 172.21.15.32:0/4058643546 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4224005670 con 0x7f4234104590 2024-05-06T21:38:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.262+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423419a430 con 0x7f4234104590 2024-05-06T21:38:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.263+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423404e000 con 0x7f4234104590 2024-05-06T21:38:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.263+0000 7f422b7fe640 1 -- 172.21.15.32:0/4058643546 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4224004dd0 con 0x7f4234104590 2024-05-06T21:38:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.264+0000 7f422b7fe640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f422006e170 0x7f4220070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.264+0000 7f422b7fe640 1 -- 172.21.15.32:0/4058643546 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f42240b0690 con 0x7f4234104590 2024-05-06T21:38:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.264+0000 7f423a3bd640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f422006e170 0x7f4220070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.264+0000 7f423a3bd640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f422006e170 0x7f4220070620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f42300058c0 tx=0x7f4230005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:29.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.268+0000 7f422b7fe640 1 -- 172.21.15.32:0/4058643546 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f42240797f0 con 0x7f4234104590 2024-05-06T21:38:29.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:29 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3754219947' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-05-06T21:38:29.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:29 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/389090096' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-05-06T21:38:29.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:29 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/572222136' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-05-06T21:38:29.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.494+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f42341965e0 con 0x7f4234104590 2024-05-06T21:38:29.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.495+0000 7f422b7fe640 1 -- 172.21.15.32:0/4058643546 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v44) v1 ==== 107+0+4999 (secure 0 0 0) 0x7f422407ceb0 con 0x7f4234104590 2024-05-06T21:38:29.489 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:29.490 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44297,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/1058144183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1058144183},{"type":"v1","addr":"172.21.15.154:6825","nonce":1058144183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:06.909308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":153,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 33 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f422006e170 msgr2=0x7f4220070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f422006e170 0x7f4220070620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f42300058c0 tx=0x7f4230005850 comp rx=0 tx=0).stop 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4234104590 msgr2=0x7f42341957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4234104590 0x7f42341957d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4224009230 tx=0x7f4224004040 comp rx=0 tx=0).stop 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 shutdown_connections 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f422006e170 0x7f4220070620 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4234104590 0x7f42341957d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 --2- 172.21.15.32:0/4058643546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42340fe5b0 0x7f4234195290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 >> 172.21.15.32:0/4058643546 conn(0x7f42340743d0 msgr2=0x7f4234102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 shutdown_connections 2024-05-06T21:38:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.497+0000 7f423c621640 1 -- 172.21.15.32:0/4058643546 wait complete. 2024-05-06T21:38:29.503 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-05-06T21:38:29.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-05-06T21:38:29.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.613+0000 7fee966d7640 1 -- 172.21.15.32:0/1939461694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee901011a0 msgr2=0x7fee90109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.613+0000 7fee966d7640 1 --2- 172.21.15.32:0/1939461694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee901011a0 0x7fee90109690 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fee84009880 tx=0x7fee8402bd70 comp rx=0 tx=0).stop 2024-05-06T21:38:29.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.613+0000 7fee966d7640 1 -- 172.21.15.32:0/1939461694 shutdown_connections 2024-05-06T21:38:29.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.613+0000 7fee966d7640 1 --2- 172.21.15.32:0/1939461694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee901011a0 0x7fee90109690 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.613+0000 7fee966d7640 1 --2- 172.21.15.32:0/1939461694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee90100890 0x7fee90100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.613+0000 7fee966d7640 1 -- 172.21.15.32:0/1939461694 >> 172.21.15.32:0/1939461694 conn(0x7fee900fa040 msgr2=0x7fee900fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:29.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.613+0000 7fee966d7640 1 -- 172.21.15.32:0/1939461694 shutdown_connections 2024-05-06T21:38:29.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.613+0000 7fee966d7640 1 -- 172.21.15.32:0/1939461694 wait complete. 2024-05-06T21:38:29.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.614+0000 7fee966d7640 1 Processor -- start 2024-05-06T21:38:29.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.614+0000 7fee966d7640 1 -- start start 2024-05-06T21:38:29.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.614+0000 7fee966d7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee90100890 0x7fee900fe4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:29.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.614+0000 7fee966d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901011a0 0x7fee900fea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:29.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.614+0000 7fee966d7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee900fef60 con 0x7fee90100890 2024-05-06T21:38:29.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.614+0000 7fee966d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee900ff0d0 con 0x7fee901011a0 2024-05-06T21:38:29.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee90100890 0x7fee900fe4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8ffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee90100890 0x7fee900fe4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55308/0 (socket says 172.21.15.32:55308) 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8ffff640 1 -- 172.21.15.32:0/1532382962 learned_addr learned my addr 172.21.15.32:0/1532382962 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8f7fe640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901011a0 0x7fee900fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8ffff640 1 -- 172.21.15.32:0/1532382962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901011a0 msgr2=0x7fee900fea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8ffff640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901011a0 0x7fee900fea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8ffff640 1 -- 172.21.15.32:0/1532382962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84009560 con 0x7fee90100890 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8ffff640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee90100890 0x7fee900fe4e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c8a0 tx=0x7fee8000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8d7fa640 1 -- 172.21.15.32:0/1532382962 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee80007b80 con 0x7fee90100890 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8d7fa640 1 -- 172.21.15.32:0/1532382962 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee80007ce0 con 0x7fee90100890 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee901a1510 con 0x7fee90100890 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee8d7fa640 1 -- 172.21.15.32:0/1532382962 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee80018810 con 0x7fee90100890 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.615+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee901a1880 con 0x7fee90100890 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.616+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9004e000 con 0x7fee90100890 2024-05-06T21:38:29.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.617+0000 7fee8d7fa640 1 -- 172.21.15.32:0/1532382962 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fee80018970 con 0x7fee90100890 2024-05-06T21:38:29.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.617+0000 7fee8d7fa640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fee7806e170 0x7fee78070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:29.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.617+0000 7fee8d7fa640 1 -- 172.21.15.32:0/1532382962 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fee8008e390 con 0x7fee90100890 2024-05-06T21:38:29.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.617+0000 7fee8f7fe640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fee7806e170 0x7fee78070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:29.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.618+0000 7fee8f7fe640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fee7806e170 0x7fee78070620 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee84006010 tx=0x7fee84005b50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:29.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.622+0000 7fee8d7fa640 1 -- 172.21.15.32:0/1532382962 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fee800574f0 con 0x7fee90100890 2024-05-06T21:38:29.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.848+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fee90106c60 con 0x7fee90100890 2024-05-06T21:38:29.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.849+0000 7fee8d7fa640 1 -- 172.21.15.32:0/1532382962 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v44) v1 ==== 107+0+5008 (secure 0 0 0) 0x7fee8005abb0 con 0x7fee90100890 2024-05-06T21:38:29.844 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:29.844 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44297,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/1058144183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1058144183},{"type":"v1","addr":"172.21.15.154:6825","nonce":1058144183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:08.913072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":0,"incarnation":31,"state":"up:active","state_seq":154,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-05-06T21:38:29.844 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 34 2024-05-06T21:38:29.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fee7806e170 msgr2=0x7fee78070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fee7806e170 0x7fee78070620 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee84006010 tx=0x7fee84005b50 comp rx=0 tx=0).stop 2024-05-06T21:38:29.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee90100890 msgr2=0x7fee900fe4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee90100890 0x7fee900fe4e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c8a0 tx=0x7fee8000cd60 comp rx=0 tx=0).stop 2024-05-06T21:38:29.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 shutdown_connections 2024-05-06T21:38:29.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fee7806e170 0x7fee78070620 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901011a0 0x7fee900fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 --2- 172.21.15.32:0/1532382962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee90100890 0x7fee900fe4e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 >> 172.21.15.32:0/1532382962 conn(0x7fee900fa040 msgr2=0x7fee90103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:29.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 shutdown_connections 2024-05-06T21:38:29.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.851+0000 7fee966d7640 1 -- 172.21.15.32:0/1532382962 wait complete. 2024-05-06T21:38:29.856 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-05-06T21:38:29.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-05-06T21:38:29.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.966+0000 7fa00daa1640 1 -- 172.21.15.32:0/3970964437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 msgr2=0x7fa0080ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.966+0000 7fa00daa1640 1 --2- 172.21.15.32:0/3970964437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 0x7fa0080ffbd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009c20 tx=0x7f9ff802c1b0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.966+0000 7fa00daa1640 1 -- 172.21.15.32:0/3970964437 shutdown_connections 2024-05-06T21:38:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.966+0000 7fa00daa1640 1 --2- 172.21.15.32:0/3970964437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008100110 0x7fa008108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.966+0000 7fa00daa1640 1 --2- 172.21.15.32:0/3970964437 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 0x7fa0080ffbd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.966+0000 7fa00daa1640 1 -- 172.21.15.32:0/3970964437 >> 172.21.15.32:0/3970964437 conn(0x7fa008073d20 msgr2=0x7fa008074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.966+0000 7fa00daa1640 1 -- 172.21.15.32:0/3970964437 shutdown_connections 2024-05-06T21:38:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.967+0000 7fa00daa1640 1 -- 172.21.15.32:0/3970964437 wait complete. 2024-05-06T21:38:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.967+0000 7fa00daa1640 1 Processor -- start 2024-05-06T21:38:29.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.967+0000 7fa00daa1640 1 -- start start 2024-05-06T21:38:29.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.967+0000 7fa00daa1640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 0x7fa0081952b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:29.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.967+0000 7fa00daa1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008100110 0x7fa0081957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:29.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.967+0000 7fa00daa1640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa008195df0 con 0x7fa0080ff800 2024-05-06T21:38:29.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.967+0000 7fa00daa1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa008195f60 con 0x7fa008100110 2024-05-06T21:38:29.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 0x7fa0081952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 0x7fa0081952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55336/0 (socket says 172.21.15.32:55336) 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa0077fe640 1 -- 172.21.15.32:0/1095912210 learned_addr learned my addr 172.21.15.32:0/1095912210 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa006ffd640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008100110 0x7fa0081957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa0077fe640 1 -- 172.21.15.32:0/1095912210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008100110 msgr2=0x7fa0081957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa0077fe640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008100110 0x7fa0081957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa0077fe640 1 -- 172.21.15.32:0/1095912210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8009900 con 0x7fa0080ff800 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa006ffd640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008100110 0x7fa0081957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa0077fe640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 0x7fa0081952b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8032b60 tx=0x7f9ff8032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa004ff9640 1 -- 172.21.15.32:0/1095912210 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff8034820 con 0x7fa0080ff800 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa008199d90 con 0x7fa0080ff800 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa004ff9640 1 -- 172.21.15.32:0/1095912210 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ff8003e30 con 0x7fa0080ff800 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa004ff9640 1 -- 172.21.15.32:0/1095912210 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff803f440 con 0x7fa0080ff800 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.968+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00819a310 con 0x7fa0080ff800 2024-05-06T21:38:29.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.969+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00804e000 con 0x7fa0080ff800 2024-05-06T21:38:29.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.970+0000 7fa004ff9640 1 -- 172.21.15.32:0/1095912210 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9ff803b040 con 0x7fa0080ff800 2024-05-06T21:38:29.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.970+0000 7fa004ff9640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9ff006e170 0x7f9ff0070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:29.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.970+0000 7fa004ff9640 1 -- 172.21.15.32:0/1095912210 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f9ff80b10c0 con 0x7fa0080ff800 2024-05-06T21:38:29.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.970+0000 7fa006ffd640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9ff006e170 0x7f9ff0070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:29.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.971+0000 7fa006ffd640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9ff006e170 0x7f9ff0070620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc005e10 tx=0x7f9ffc005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:29.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:29.975+0000 7fa004ff9640 1 -- 172.21.15.32:0/1095912210 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9ff807a240 con 0x7fa0080ff800 2024-05-06T21:38:30.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.200+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fa008107150 con 0x7fa0080ff800 2024-05-06T21:38:30.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.200+0000 7fa004ff9640 1 -- 172.21.15.32:0/1095912210 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v44) v1 ==== 107+0+4226 (secure 0 0 0) 0x7f9ff807d900 con 0x7fa0080ff800 2024-05-06T21:38:30.195 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:30.196 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:08.913072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":0,"incarnation":31,"state":"up:active","state_seq":154,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-05-06T21:38:30.196 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 35 2024-05-06T21:38:30.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.202+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9ff006e170 msgr2=0x7f9ff0070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.202+0000 7fa00daa1640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9ff006e170 0x7f9ff0070620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc005e10 tx=0x7f9ffc005da0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.202+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 msgr2=0x7fa0081952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.202+0000 7fa00daa1640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 0x7fa0081952b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8032b60 tx=0x7f9ff8032b90 comp rx=0 tx=0).stop 2024-05-06T21:38:30.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.202+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 shutdown_connections 2024-05-06T21:38:30.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.202+0000 7fa00daa1640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9ff006e170 0x7f9ff0070620 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.202+0000 7fa00daa1640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008100110 0x7fa0081957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.202+0000 7fa00daa1640 1 --2- 172.21.15.32:0/1095912210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0080ff800 0x7fa0081952b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.202+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 >> 172.21.15.32:0/1095912210 conn(0x7fa008073d20 msgr2=0x7fa0080ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:30.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.203+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 shutdown_connections 2024-05-06T21:38:30.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.203+0000 7fa00daa1640 1 -- 172.21.15.32:0/1095912210 wait complete. 2024-05-06T21:38:30.207 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:30 smithi032 ceph-mon[76650]: pgmap v352: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:30.207 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:30 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2422471289' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-05-06T21:38:30.207 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:30 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4058643546' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-05-06T21:38:30.207 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:30 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1532382962' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-05-06T21:38:30.208 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-05-06T21:38:30.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-05-06T21:38:30.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 -- 172.21.15.32:0/269878534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 msgr2=0x7fa3e8104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 --2- 172.21.15.32:0/269878534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 0x7fa3e8104960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009880 tx=0x7fa3e402bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 -- 172.21.15.32:0/269878534 shutdown_connections 2024-05-06T21:38:30.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 --2- 172.21.15.32:0/269878534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3e80fe5b0 0x7fa3e80fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 --2- 172.21.15.32:0/269878534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 0x7fa3e8104960 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 -- 172.21.15.32:0/269878534 >> 172.21.15.32:0/269878534 conn(0x7fa3e80743d0 msgr2=0x7fa3e80747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 -- 172.21.15.32:0/269878534 shutdown_connections 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 -- 172.21.15.32:0/269878534 wait complete. 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 Processor -- start 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.319+0000 7fa3efed7640 1 -- start start 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3efed7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3e80fe5b0 0x7fa3e8100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3efed7640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 0x7fa3e8100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3efed7640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8101080 con 0x7fa3e8104590 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3efed7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81011c0 con 0x7fa3e80fe5b0 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3ed472640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 0x7fa3e8100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3ed472640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 0x7fa3e8100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55344/0 (socket says 172.21.15.32:55344) 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3ed472640 1 -- 172.21.15.32:0/1891907139 learned_addr learned my addr 172.21.15.32:0/1891907139 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:30.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3edc73640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3e80fe5b0 0x7fa3e8100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3ed472640 1 -- 172.21.15.32:0/1891907139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3e80fe5b0 msgr2=0x7fa3e8100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3ed472640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3e80fe5b0 0x7fa3e8100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3ed472640 1 -- 172.21.15.32:0/1891907139 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4009560 con 0x7fa3e8104590 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3edc73640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3e80fe5b0 0x7fa3e8100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3ed472640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 0x7fa3e8100ab0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800b420 tx=0x7fa3d800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.320+0000 7fa3deffd640 1 -- 172.21.15.32:0/1891907139 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d8011800 con 0x7fa3e8104590 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.321+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e81a1590 con 0x7fa3e8104590 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.321+0000 7fa3deffd640 1 -- 172.21.15.32:0/1891907139 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3d8011e20 con 0x7fa3e8104590 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.321+0000 7fa3deffd640 1 -- 172.21.15.32:0/1891907139 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d800f2e0 con 0x7fa3e8104590 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.321+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e81a19c0 con 0x7fa3e8104590 2024-05-06T21:38:30.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.321+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e804e000 con 0x7fa3e8104590 2024-05-06T21:38:30.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.322+0000 7fa3deffd640 1 -- 172.21.15.32:0/1891907139 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa3d8010380 con 0x7fa3e8104590 2024-05-06T21:38:30.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.322+0000 7fa3deffd640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa3d406e170 0x7fa3d4070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:30.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.323+0000 7fa3deffd640 1 -- 172.21.15.32:0/1891907139 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fa3d808dc50 con 0x7fa3e8104590 2024-05-06T21:38:30.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.323+0000 7fa3edc73640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa3d406e170 0x7fa3d4070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:30.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.323+0000 7fa3edc73640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa3d406e170 0x7fa3d4070620 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4005ec0 tx=0x7fa3e4005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.327+0000 7fa3deffd640 1 -- 172.21.15.32:0/1891907139 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa3d8056dd0 con 0x7fa3e8104590 2024-05-06T21:38:30.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:30 smithi154 ceph-mon[63622]: pgmap v352: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:30.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:30 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2422471289' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-05-06T21:38:30.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:30 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4058643546' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-05-06T21:38:30.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:30 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1532382962' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-05-06T21:38:30.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.553+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7fa3e810b9f0 con 0x7fa3e8104590 2024-05-06T21:38:30.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.554+0000 7fa3deffd640 1 -- 172.21.15.32:0/1891907139 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v44) v1 ==== 107+0+5073 (secure 0 0 0) 0x7fa3d805a490 con 0x7fa3e8104590 2024-05-06T21:38:30.549 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:30.549 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44339,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/171743146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":171743146},{"type":"v1","addr":"172.21.15.154:6825","nonce":171743146}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:08.913072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi154.xfmqxf","rank":0,"incarnation":31,"state":"up:active","state_seq":154,"addr":"172.21.15.154:6827/2609692046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2609692046},{"type":"v1","addr":"172.21.15.154:6827","nonce":2609692046}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-05-06T21:38:30.549 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 36 2024-05-06T21:38:30.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa3d406e170 msgr2=0x7fa3d4070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa3d406e170 0x7fa3d4070620 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4005ec0 tx=0x7fa3e4005fd0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 msgr2=0x7fa3e8100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 0x7fa3e8100ab0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800b420 tx=0x7fa3d800b8e0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 shutdown_connections 2024-05-06T21:38:30.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fa3d406e170 0x7fa3d4070620 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3e8104590 0x7fa3e8100ab0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 --2- 172.21.15.32:0/1891907139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3e80fe5b0 0x7fa3e8100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 >> 172.21.15.32:0/1891907139 conn(0x7fa3e80743d0 msgr2=0x7fa3e81027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:30.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.556+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 shutdown_connections 2024-05-06T21:38:30.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.557+0000 7fa3efed7640 1 -- 172.21.15.32:0/1891907139 wait complete. 2024-05-06T21:38:30.562 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-05-06T21:38:30.562 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-05-06T21:38:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.672+0000 7f8866cce640 1 -- 172.21.15.32:0/3025963318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 msgr2=0x7f8860100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.672+0000 7f8866cce640 1 --2- 172.21.15.32:0/3025963318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 0x7f8860100c00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f88540098b0 tx=0x7f885402bd60 comp rx=0 tx=0).stop 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.672+0000 7f8866cce640 1 -- 172.21.15.32:0/3025963318 shutdown_connections 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.672+0000 7f8866cce640 1 --2- 172.21.15.32:0/3025963318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8860101140 0x7f8860109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.672+0000 7f8866cce640 1 --2- 172.21.15.32:0/3025963318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 0x7f8860100c00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.672+0000 7f8866cce640 1 -- 172.21.15.32:0/3025963318 >> 172.21.15.32:0/3025963318 conn(0x7f88600fa060 msgr2=0x7f88600fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.672+0000 7f8866cce640 1 -- 172.21.15.32:0/3025963318 shutdown_connections 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.672+0000 7f8866cce640 1 -- 172.21.15.32:0/3025963318 wait complete. 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8866cce640 1 Processor -- start 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8866cce640 1 -- start start 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8866cce640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 0x7f8860195360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8866cce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8860101140 0x7f88601958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8866cce640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860195f30 con 0x7f8860100830 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8866cce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860199d00 con 0x7f8860101140 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8864a6a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 0x7f8860195360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8864a6a640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 0x7f8860195360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55366/0 (socket says 172.21.15.32:55366) 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8864a6a640 1 -- 172.21.15.32:0/1772362288 learned_addr learned my addr 172.21.15.32:0/1772362288 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f885ffff640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8860101140 0x7f88601958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8864a6a640 1 -- 172.21.15.32:0/1772362288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8860101140 msgr2=0x7f88601958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8864a6a640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8860101140 0x7f88601958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f8864a6a640 1 -- 172.21.15.32:0/1772362288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854009560 con 0x7f8860100830 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.673+0000 7f885ffff640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8860101140 0x7f88601958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.674+0000 7f8864a6a640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 0x7f8860195360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8854009880 tx=0x7f885402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.674+0000 7f885dffb640 1 -- 172.21.15.32:0/1772362288 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88540035f0 con 0x7f8860100830 2024-05-06T21:38:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.674+0000 7f885dffb640 1 -- 172.21.15.32:0/1772362288 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8854003c10 con 0x7f8860100830 2024-05-06T21:38:30.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.674+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8860199f80 con 0x7f8860100830 2024-05-06T21:38:30.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.674+0000 7f885dffb640 1 -- 172.21.15.32:0/1772362288 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8854005690 con 0x7f8860100830 2024-05-06T21:38:30.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.674+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886019a4e0 con 0x7f8860100830 2024-05-06T21:38:30.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.675+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886004e000 con 0x7f8860100830 2024-05-06T21:38:30.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.676+0000 7f885dffb640 1 -- 172.21.15.32:0/1772362288 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8854004ed0 con 0x7f8860100830 2024-05-06T21:38:30.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.676+0000 7f885dffb640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f885006e120 0x7f88500705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:30.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.676+0000 7f885ffff640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f885006e120 0x7f88500705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:30.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.676+0000 7f885dffb640 1 -- 172.21.15.32:0/1772362288 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f88540b0e60 con 0x7f8860100830 2024-05-06T21:38:30.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.677+0000 7f885ffff640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f885006e120 0x7f88500705d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8860196970 tx=0x7f884c005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:30.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.681+0000 7f885dffb640 1 -- 172.21.15.32:0/1772362288 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f885407a100 con 0x7f8860100830 2024-05-06T21:38:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.906+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f8860106ca0 con 0x7f8860100830 2024-05-06T21:38:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.907+0000 7f885dffb640 1 -- 172.21.15.32:0/1772362288 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v44) v1 ==== 107+0+4269 (secure 0 0 0) 0x7f8854043090 con 0x7f8860100830 2024-05-06T21:38:30.901 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44339,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/171743146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":171743146},{"type":"v1","addr":"172.21.15.154:6825","nonce":171743146}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:37.440019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:30.902 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 37 2024-05-06T21:38:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f885006e120 msgr2=0x7f88500705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f885006e120 0x7f88500705d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8860196970 tx=0x7f884c005e50 comp rx=0 tx=0).stop 2024-05-06T21:38:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 msgr2=0x7f8860195360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 0x7f8860195360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8854009880 tx=0x7f885402c8d0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 shutdown_connections 2024-05-06T21:38:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f885006e120 0x7f88500705d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8860101140 0x7f88601958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 --2- 172.21.15.32:0/1772362288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860100830 0x7f8860195360 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 >> 172.21.15.32:0/1772362288 conn(0x7f88600fa060 msgr2=0x7f8860103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:30.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 shutdown_connections 2024-05-06T21:38:30.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:30.909+0000 7f8866cce640 1 -- 172.21.15.32:0/1772362288 wait complete. 2024-05-06T21:38:30.915 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-05-06T21:38:30.915 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-05-06T21:38:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.025+0000 7f9d3996e640 1 -- 172.21.15.32:0/3901835676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 msgr2=0x7f9d340fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.025+0000 7f9d3996e640 1 --2- 172.21.15.32:0/3901835676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 0x7f9d340fec60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009880 tx=0x7f9d2802bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.025+0000 7f9d3996e640 1 -- 172.21.15.32:0/3901835676 shutdown_connections 2024-05-06T21:38:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.025+0000 7f9d3996e640 1 --2- 172.21.15.32:0/3901835676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 0x7f9d340fec60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.025+0000 7f9d3996e640 1 --2- 172.21.15.32:0/3901835676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d34104800 0x7f9d34104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.025+0000 7f9d3996e640 1 -- 172.21.15.32:0/3901835676 >> 172.21.15.32:0/3901835676 conn(0x7f9d340fa2f0 msgr2=0x7f9d340fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.025+0000 7f9d3996e640 1 -- 172.21.15.32:0/3901835676 shutdown_connections 2024-05-06T21:38:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.025+0000 7f9d3996e640 1 -- 172.21.15.32:0/3901835676 wait complete. 2024-05-06T21:38:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.025+0000 7f9d3996e640 1 Processor -- start 2024-05-06T21:38:31.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d3996e640 1 -- start start 2024-05-06T21:38:31.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d3996e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 0x7f9d34100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:31.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d3996e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d34104800 0x7f9d34100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:31.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d3996e640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d34100e80 con 0x7f9d340fe7f0 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d3996e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d34100fc0 con 0x7f9d34104800 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 0x7f9d34100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 0x7f9d34100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55380/0 (socket says 172.21.15.32:55380) 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d32ffd640 1 -- 172.21.15.32:0/1727428829 learned_addr learned my addr 172.21.15.32:0/1727428829 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d327fc640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d34104800 0x7f9d34100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d32ffd640 1 -- 172.21.15.32:0/1727428829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d34104800 msgr2=0x7f9d34100940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d32ffd640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d34104800 0x7f9d34100940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.026+0000 7f9d32ffd640 1 -- 172.21.15.32:0/1727428829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d28009560 con 0x7f9d340fe7f0 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.027+0000 7f9d32ffd640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 0x7f9d34100400 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400c8f0 tx=0x7f9d2400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.027+0000 7f9d3896c640 1 -- 172.21.15.32:0/1727428829 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d240041f0 con 0x7f9d340fe7f0 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.027+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d34101250 con 0x7f9d340fe7f0 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.027+0000 7f9d3896c640 1 -- 172.21.15.32:0/1727428829 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d24007e10 con 0x7f9d340fe7f0 2024-05-06T21:38:31.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.027+0000 7f9d3896c640 1 -- 172.21.15.32:0/1727428829 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d2400f450 con 0x7f9d340fe7f0 2024-05-06T21:38:31.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.027+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d341a1b30 con 0x7f9d340fe7f0 2024-05-06T21:38:31.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.028+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3404e000 con 0x7f9d340fe7f0 2024-05-06T21:38:31.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.028+0000 7f9d3896c640 1 -- 172.21.15.32:0/1727428829 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9d24007950 con 0x7f9d340fe7f0 2024-05-06T21:38:31.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.029+0000 7f9d3896c640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9d1c06e170 0x7f9d1c070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:31.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.029+0000 7f9d3896c640 1 -- 172.21.15.32:0/1727428829 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f9d24013070 con 0x7f9d340fe7f0 2024-05-06T21:38:31.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.029+0000 7f9d327fc640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9d1c06e170 0x7f9d1c070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:31.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.029+0000 7f9d327fc640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9d1c06e170 0x7f9d1c070620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9d28036040 tx=0x7f9d28005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:31.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.033+0000 7f9d3896c640 1 -- 172.21.15.32:0/1727428829 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9d240575c0 con 0x7f9d340fe7f0 2024-05-06T21:38:31.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:31 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1095912210' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-05-06T21:38:31.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:31 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1891907139' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-05-06T21:38:31.217 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:31 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1772362288' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-05-06T21:38:31.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.258+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f9d34066860 con 0x7f9d340fe7f0 2024-05-06T21:38:31.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.259+0000 7f9d3896c640 1 -- 172.21.15.32:0/1727428829 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v44) v1 ==== 107+0+4348 (secure 0 0 0) 0x7f9d2405ac80 con 0x7f9d340fe7f0 2024-05-06T21:38:31.254 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:31.254 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44339,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/171743146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":171743146},{"type":"v1","addr":"172.21.15.154:6825","nonce":171743146}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:37.445186+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34432},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34432":{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:31.254 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 38 2024-05-06T21:38:31.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9d1c06e170 msgr2=0x7f9d1c070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9d1c06e170 0x7f9d1c070620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9d28036040 tx=0x7f9d28005fd0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 msgr2=0x7f9d34100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 0x7f9d34100400 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400c8f0 tx=0x7f9d2400cdb0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 shutdown_connections 2024-05-06T21:38:31.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9d1c06e170 0x7f9d1c070620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d34104800 0x7f9d34100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 --2- 172.21.15.32:0/1727428829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d340fe7f0 0x7f9d34100400 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 >> 172.21.15.32:0/1727428829 conn(0x7f9d340fa2f0 msgr2=0x7f9d340684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:31.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 shutdown_connections 2024-05-06T21:38:31.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.261+0000 7f9d3996e640 1 -- 172.21.15.32:0/1727428829 wait complete. 2024-05-06T21:38:31.266 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-05-06T21:38:31.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-05-06T21:38:31.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:31 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1095912210' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-05-06T21:38:31.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:31 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1891907139' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-05-06T21:38:31.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:31 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1772362288' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-05-06T21:38:31.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.377+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/1178343341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 msgr2=0x7f9ef4104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.377+0000 7f9ef8dd0640 1 --2- 172.21.15.32:0/1178343341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 0x7f9ef4104bd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009880 tx=0x7f9ee402bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.377+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/1178343341 shutdown_connections 2024-05-06T21:38:31.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.377+0000 7f9ef8dd0640 1 --2- 172.21.15.32:0/1178343341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ef40fe7f0 0x7f9ef40fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.377+0000 7f9ef8dd0640 1 --2- 172.21.15.32:0/1178343341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 0x7f9ef4104bd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.377+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/1178343341 >> 172.21.15.32:0/1178343341 conn(0x7f9ef40fa2f0 msgr2=0x7f9ef40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:31.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.377+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/1178343341 shutdown_connections 2024-05-06T21:38:31.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.377+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/1178343341 wait complete. 2024-05-06T21:38:31.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef8dd0640 1 Processor -- start 2024-05-06T21:38:31.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef8dd0640 1 -- start start 2024-05-06T21:38:31.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef8dd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ef40fe7f0 0x7f9ef4196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:31.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef8dd0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 0x7f9ef4196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef8dd0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4196e30 con 0x7f9ef4104800 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef8dd0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4196fa0 con 0x7f9ef40fe7f0 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef1d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 0x7f9ef4196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef1d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 0x7f9ef4196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55400/0 (socket says 172.21.15.32:55400) 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef1d9b640 1 -- 172.21.15.32:0/2252397566 learned_addr learned my addr 172.21.15.32:0/2252397566 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.378+0000 7f9ef259c640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ef40fe7f0 0x7f9ef4196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.379+0000 7f9ef1d9b640 1 -- 172.21.15.32:0/2252397566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ef40fe7f0 msgr2=0x7f9ef4196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.379+0000 7f9ef1d9b640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ef40fe7f0 0x7f9ef4196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.379+0000 7f9ef1d9b640 1 -- 172.21.15.32:0/2252397566 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee4009560 con 0x7f9ef4104800 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.379+0000 7f9ef1d9b640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 0x7f9ef4196860 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c810 tx=0x7f9ee800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.379+0000 7f9ee37fe640 1 -- 172.21.15.32:0/2252397566 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee80041f0 con 0x7f9ef4104800 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.379+0000 7f9ee37fe640 1 -- 172.21.15.32:0/2252397566 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ee8007e70 con 0x7f9ef4104800 2024-05-06T21:38:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.379+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef419f390 con 0x7f9ef4104800 2024-05-06T21:38:31.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.379+0000 7f9ee37fe640 1 -- 172.21.15.32:0/2252397566 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee80049d0 con 0x7f9ef4104800 2024-05-06T21:38:31.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.379+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef419f8c0 con 0x7f9ef4104800 2024-05-06T21:38:31.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.380+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef404e000 con 0x7f9ef4104800 2024-05-06T21:38:31.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.381+0000 7f9ee37fe640 1 -- 172.21.15.32:0/2252397566 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9ee80079b0 con 0x7f9ef4104800 2024-05-06T21:38:31.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.381+0000 7f9ee37fe640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9edc06e170 0x7f9edc070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:31.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.381+0000 7f9ef259c640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9edc06e170 0x7f9edc070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:31.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.381+0000 7f9ee37fe640 1 -- 172.21.15.32:0/2252397566 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f9ee808e120 con 0x7f9ef4104800 2024-05-06T21:38:31.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.382+0000 7f9ef259c640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9edc06e170 0x7f9edc070620 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006010 tx=0x7f9ee4000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:31.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.386+0000 7f9ee37fe640 1 -- 172.21.15.32:0/2252397566 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9ee80572a0 con 0x7f9ef4104800 2024-05-06T21:38:31.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.612+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f9ef4066860 con 0x7f9ef4104800 2024-05-06T21:38:31.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.613+0000 7f9ee37fe640 1 -- 172.21.15.32:0/2252397566 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v44) v1 ==== 107+0+4352 (secure 0 0 0) 0x7f9ee805a960 con 0x7f9ef4104800 2024-05-06T21:38:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:31.607 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44339,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/171743146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":171743146},{"type":"v1","addr":"172.21.15.154:6825","nonce":171743146}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:44.707046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34432},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34432":{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":0,"incarnation":38,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:31.608 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 39 2024-05-06T21:38:31.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9edc06e170 msgr2=0x7f9edc070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9edc06e170 0x7f9edc070620 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006010 tx=0x7f9ee4000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 msgr2=0x7f9ef4196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 0x7f9ef4196860 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c810 tx=0x7f9ee800ccd0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 shutdown_connections 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f9edc06e170 0x7f9edc070620 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ef4104800 0x7f9ef4196860 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 --2- 172.21.15.32:0/2252397566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ef40fe7f0 0x7f9ef4196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 >> 172.21.15.32:0/2252397566 conn(0x7f9ef40fa2f0 msgr2=0x7f9ef40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 shutdown_connections 2024-05-06T21:38:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.615+0000 7f9ef8dd0640 1 -- 172.21.15.32:0/2252397566 wait complete. 2024-05-06T21:38:31.620 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-05-06T21:38:31.620 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-05-06T21:38:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.731+0000 7f77208ce640 1 -- 172.21.15.32:0/3350722637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 msgr2=0x7f771c109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.731+0000 7f77208ce640 1 --2- 172.21.15.32:0/3350722637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 0x7f771c109630 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f77100098b0 tx=0x7f771002bd60 comp rx=0 tx=0).stop 2024-05-06T21:38:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.731+0000 7f77208ce640 1 -- 172.21.15.32:0/3350722637 shutdown_connections 2024-05-06T21:38:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.731+0000 7f77208ce640 1 --2- 172.21.15.32:0/3350722637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 0x7f771c109630 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.731+0000 7f77208ce640 1 --2- 172.21.15.32:0/3350722637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c100830 0x7f771c100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.731+0000 7f77208ce640 1 -- 172.21.15.32:0/3350722637 >> 172.21.15.32:0/3350722637 conn(0x7f771c0fa060 msgr2=0x7f771c0fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:31.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.731+0000 7f77208ce640 1 -- 172.21.15.32:0/3350722637 shutdown_connections 2024-05-06T21:38:31.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.731+0000 7f77208ce640 1 -- 172.21.15.32:0/3350722637 wait complete. 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.732+0000 7f77208ce640 1 Processor -- start 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.732+0000 7f77208ce640 1 -- start start 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.732+0000 7f77208ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c100830 0x7f771c195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.732+0000 7f77208ce640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 0x7f771c1958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.732+0000 7f77208ce640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c195f40 con 0x7f771c101140 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.732+0000 7f77208ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c199d10 con 0x7f771c100830 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.732+0000 7f7719d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 0x7f771c1958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f7719d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 0x7f771c1958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55286/0 (socket says 172.21.15.32:55286) 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f7719d9b640 1 -- 172.21.15.32:0/4122176572 learned_addr learned my addr 172.21.15.32:0/4122176572 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:31.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f771a59c640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c100830 0x7f771c195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f7719d9b640 1 -- 172.21.15.32:0/4122176572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c100830 msgr2=0x7f771c195370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f7719d9b640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c100830 0x7f771c195370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f7719d9b640 1 -- 172.21.15.32:0/4122176572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710009560 con 0x7f771c101140 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f7719d9b640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 0x7f771c1958b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f771002c2a0 tx=0x7f771002c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f770b7fe640 1 -- 172.21.15.32:0/4122176572 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77100035f0 con 0x7f771c101140 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f770b7fe640 1 -- 172.21.15.32:0/4122176572 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7710003c10 con 0x7f771c101140 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771c199f90 con 0x7f771c101140 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f770b7fe640 1 -- 172.21.15.32:0/4122176572 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7710005690 con 0x7f771c101140 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.733+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771c19a4f0 con 0x7f771c101140 2024-05-06T21:38:31.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.734+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771c04e000 con 0x7f771c101140 2024-05-06T21:38:31.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.735+0000 7f770b7fe640 1 -- 172.21.15.32:0/4122176572 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7710004ed0 con 0x7f771c101140 2024-05-06T21:38:31.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.735+0000 7f770b7fe640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f770406e110 0x7f77040705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:31.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.735+0000 7f770b7fe640 1 -- 172.21.15.32:0/4122176572 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f77100b0e90 con 0x7f771c101140 2024-05-06T21:38:31.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.735+0000 7f771a59c640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f770406e110 0x7f77040705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:31.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.736+0000 7f771a59c640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f770406e110 0x7f77040705c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f770c005fd0 tx=0x7f770c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:31.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.740+0000 7f770b7fe640 1 -- 172.21.15.32:0/4122176572 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f771007a010 con 0x7f771c101140 2024-05-06T21:38:31.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.966+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f771c106ca0 con 0x7f771c101140 2024-05-06T21:38:31.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.967+0000 7f770b7fe640 1 -- 172.21.15.32:0/4122176572 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v44) v1 ==== 107+0+5199 (secure 0 0 0) 0x7f771007d6d0 con 0x7f771c101140 2024-05-06T21:38:31.962 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:31.962 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44339,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/171743146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":171743146},{"type":"v1","addr":"172.21.15.154:6825","nonce":171743146}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44353,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6827/3609095923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3609095923},{"type":"v1","addr":"172.21.15.154:6827","nonce":3609095923}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:44.927495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34432},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34432":{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":0,"incarnation":38,"state":"up:rejoin","state_seq":18,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-06T21:38:31.962 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 40 2024-05-06T21:38:31.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f770406e110 msgr2=0x7f77040705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f770406e110 0x7f77040705c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f770c005fd0 tx=0x7f770c00b390 comp rx=0 tx=0).stop 2024-05-06T21:38:31.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 msgr2=0x7f771c1958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:31.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 0x7f771c1958b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f771002c2a0 tx=0x7f771002c8d0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 shutdown_connections 2024-05-06T21:38:31.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f770406e110 0x7f77040705c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f771c101140 0x7f771c1958b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 --2- 172.21.15.32:0/4122176572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c100830 0x7f771c195370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:31.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 >> 172.21.15.32:0/4122176572 conn(0x7f771c0fa060 msgr2=0x7f771c103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:31.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 shutdown_connections 2024-05-06T21:38:31.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:31.969+0000 7f77208ce640 1 -- 172.21.15.32:0/4122176572 wait complete. 2024-05-06T21:38:31.975 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-05-06T21:38:31.975 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 41 2024-05-06T21:38:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.086+0000 7f3c88e8f640 1 -- 172.21.15.32:0/526894629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c840fe580 msgr2=0x7f3c840fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.086+0000 7f3c88e8f640 1 --2- 172.21.15.32:0/526894629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c840fe580 0x7f3c840fe9f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009880 tx=0x7f3c7802bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.086+0000 7f3c88e8f640 1 -- 172.21.15.32:0/526894629 shutdown_connections 2024-05-06T21:38:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.086+0000 7f3c88e8f640 1 --2- 172.21.15.32:0/526894629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c840fe580 0x7f3c840fe9f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.086+0000 7f3c88e8f640 1 --2- 172.21.15.32:0/526894629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c841045b0 0x7f3c84104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.086+0000 7f3c88e8f640 1 -- 172.21.15.32:0/526894629 >> 172.21.15.32:0/526894629 conn(0x7f3c840fa040 msgr2=0x7f3c840fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.086+0000 7f3c88e8f640 1 -- 172.21.15.32:0/526894629 shutdown_connections 2024-05-06T21:38:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.086+0000 7f3c88e8f640 1 -- 172.21.15.32:0/526894629 wait complete. 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c88e8f640 1 Processor -- start 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c88e8f640 1 -- start start 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c88e8f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c840fe580 0x7f3c84194280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c88e8f640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c841045b0 0x7f3c841947c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c88e8f640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c84194e50 con 0x7f3c841045b0 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c88e8f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c84198c20 con 0x7f3c840fe580 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c81d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c841045b0 0x7f3c841947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c81d9b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c841045b0 0x7f3c841947c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55306/0 (socket says 172.21.15.32:55306) 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c81d9b640 1 -- 172.21.15.32:0/3657242821 learned_addr learned my addr 172.21.15.32:0/3657242821 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.087+0000 7f3c8259c640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c840fe580 0x7f3c84194280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c81d9b640 1 -- 172.21.15.32:0/3657242821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c840fe580 msgr2=0x7f3c84194280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c81d9b640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c840fe580 0x7f3c84194280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c81d9b640 1 -- 172.21.15.32:0/3657242821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009560 con 0x7f3c841045b0 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c8259c640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c840fe580 0x7f3c84194280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c81d9b640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c841045b0 0x7f3c841947c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009230 tx=0x7f3c78004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c737fe640 1 -- 172.21.15.32:0/3657242821 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c780035f0 con 0x7f3c841045b0 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c737fe640 1 -- 172.21.15.32:0/3657242821 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c78003c10 con 0x7f3c841045b0 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c84198ea0 con 0x7f3c841045b0 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c737fe640 1 -- 172.21.15.32:0/3657242821 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c7803b440 con 0x7f3c841045b0 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.088+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c84199420 con 0x7f3c841045b0 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.089+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8404e000 con 0x7f3c841045b0 2024-05-06T21:38:32.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.089+0000 7f3c737fe640 1 -- 172.21.15.32:0/3657242821 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3c78004fd0 con 0x7f3c841045b0 2024-05-06T21:38:32.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.090+0000 7f3c737fe640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3c6c06e170 0x7f3c6c070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:32.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.090+0000 7f3c737fe640 1 -- 172.21.15.32:0/3657242821 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f3c780b2560 con 0x7f3c841045b0 2024-05-06T21:38:32.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.090+0000 7f3c8259c640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3c6c06e170 0x7f3c6c070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:32.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.090+0000 7f3c8259c640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3c6c06e170 0x7f3c6c070620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009930 tx=0x7f3c74008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:32.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.095+0000 7f3c737fe640 1 -- 172.21.15.32:0/3657242821 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3c7807b6e0 con 0x7f3c841045b0 2024-05-06T21:38:32.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.328+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f3c8410b870 con 0x7f3c841045b0 2024-05-06T21:38:32.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.329+0000 7f3c737fe640 1 -- 172.21.15.32:0/3657242821 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v44) v1 ==== 107+0+5208 (secure 0 0 0) 0x7f3c7807eda0 con 0x7f3c841045b0 2024-05-06T21:38:32.324 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:32.324 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44339,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/171743146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":171743146},{"type":"v1","addr":"172.21.15.154:6825","nonce":171743146}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44353,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6827/3609095923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3609095923},{"type":"v1","addr":"172.21.15.154:6827","nonce":3609095923}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:46.929097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34432},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34432":{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":0,"incarnation":38,"state":"up:active","state_seq":19,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34432,"qdb_cluster":[34432]},"id":1}]} 2024-05-06T21:38:32.324 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 41 2024-05-06T21:38:32.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3c6c06e170 msgr2=0x7f3c6c070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3c6c06e170 0x7f3c6c070620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009930 tx=0x7f3c74008040 comp rx=0 tx=0).stop 2024-05-06T21:38:32.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c841045b0 msgr2=0x7f3c841947c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c841045b0 0x7f3c841947c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009230 tx=0x7f3c78004040 comp rx=0 tx=0).stop 2024-05-06T21:38:32.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 shutdown_connections 2024-05-06T21:38:32.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f3c6c06e170 0x7f3c6c070620 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c841045b0 0x7f3c841947c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 --2- 172.21.15.32:0/3657242821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c840fe580 0x7f3c84194280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 >> 172.21.15.32:0/3657242821 conn(0x7f3c840fa040 msgr2=0x7f3c840fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:32.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 shutdown_connections 2024-05-06T21:38:32.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.331+0000 7f3c88e8f640 1 -- 172.21.15.32:0/3657242821 wait complete. 2024-05-06T21:38:32.335 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:32 smithi032 ceph-mon[76650]: pgmap v353: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:32.335 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:32 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1727428829' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-05-06T21:38:32.335 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:32 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2252397566' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-05-06T21:38:32.336 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:32 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/4122176572' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-05-06T21:38:32.336 DEBUG:tasks.fs:max_mds reduced in epoch 41 2024-05-06T21:38:32.337 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 42 2024-05-06T21:38:32.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:32 smithi154 ceph-mon[63622]: pgmap v353: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:32.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:32 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1727428829' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-05-06T21:38:32.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:32 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2252397566' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-05-06T21:38:32.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:32 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/4122176572' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-05-06T21:38:32.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 -- 172.21.15.32:0/3071738453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 msgr2=0x7fc75c104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 --2- 172.21.15.32:0/3071738453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 0x7fc75c104960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009880 tx=0x7fc74c02bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 -- 172.21.15.32:0/3071738453 shutdown_connections 2024-05-06T21:38:32.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 --2- 172.21.15.32:0/3071738453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75c0fe5b0 0x7fc75c0fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 --2- 172.21.15.32:0/3071738453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 0x7fc75c104960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 -- 172.21.15.32:0/3071738453 >> 172.21.15.32:0/3071738453 conn(0x7fc75c0743d0 msgr2=0x7fc75c0747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:32.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 -- 172.21.15.32:0/3071738453 shutdown_connections 2024-05-06T21:38:32.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 -- 172.21.15.32:0/3071738453 wait complete. 2024-05-06T21:38:32.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 Processor -- start 2024-05-06T21:38:32.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.447+0000 7fc761cb9640 1 -- start start 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc761cb9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75c0fe5b0 0x7fc75c1941a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc761cb9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 0x7fc75c1946e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc761cb9640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c194d70 con 0x7fc75c104590 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc761cb9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c198b40 con 0x7fc75c0fe5b0 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc752ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 0x7fc75c1946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc752ffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 0x7fc75c1946e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55326/0 (socket says 172.21.15.32:55326) 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc752ffd640 1 -- 172.21.15.32:0/357082266 learned_addr learned my addr 172.21.15.32:0/357082266 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc75b7fe640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75c0fe5b0 0x7fc75c1941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc752ffd640 1 -- 172.21.15.32:0/357082266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75c0fe5b0 msgr2=0x7fc75c1941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc752ffd640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75c0fe5b0 0x7fc75c1941a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.448+0000 7fc752ffd640 1 -- 172.21.15.32:0/357082266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c009560 con 0x7fc75c104590 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.449+0000 7fc752ffd640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 0x7fc75c1946e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d8d0 tx=0x7fc74400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.449+0000 7fc7597fa640 1 -- 172.21.15.32:0/357082266 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc744009c00 con 0x7fc75c104590 2024-05-06T21:38:32.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.449+0000 7fc7597fa640 1 -- 172.21.15.32:0/357082266 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc744009d60 con 0x7fc75c104590 2024-05-06T21:38:32.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.449+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c198e20 con 0x7fc75c104590 2024-05-06T21:38:32.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.449+0000 7fc7597fa640 1 -- 172.21.15.32:0/357082266 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7440049d0 con 0x7fc75c104590 2024-05-06T21:38:32.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.449+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c199380 con 0x7fc75c104590 2024-05-06T21:38:32.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.450+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c04e000 con 0x7fc75c104590 2024-05-06T21:38:32.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.450+0000 7fc7597fa640 1 -- 172.21.15.32:0/357082266 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc744004c40 con 0x7fc75c104590 2024-05-06T21:38:32.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.451+0000 7fc7597fa640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc74806e170 0x7fc748070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:32.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.451+0000 7fc7597fa640 1 -- 172.21.15.32:0/357082266 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fc74408df80 con 0x7fc75c104590 2024-05-06T21:38:32.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.451+0000 7fc75b7fe640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc74806e170 0x7fc748070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:32.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.451+0000 7fc75b7fe640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc74806e170 0x7fc748070620 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc74c006010 tx=0x7fc74c005dd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:32.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.456+0000 7fc7597fa640 1 -- 172.21.15.32:0/357082266 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc744057180 con 0x7fc75c104590 2024-05-06T21:38:32.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.692+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7fc75c1954f0 con 0x7fc75c104590 2024-05-06T21:38:32.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.693+0000 7fc7597fa640 1 -- 172.21.15.32:0/357082266 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v44) v1 ==== 107+0+5208 (secure 0 0 0) 0x7fc74405a840 con 0x7fc75c104590 2024-05-06T21:38:32.687 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:32.687 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44339,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/171743146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":171743146},{"type":"v1","addr":"172.21.15.154:6825","nonce":171743146}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44353,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6827/3609095923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3609095923},{"type":"v1","addr":"172.21.15.154:6827","nonce":3609095923}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:53.423226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34432},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34432":{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":0,"incarnation":38,"state":"up:active","state_seq":19,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34432,"qdb_cluster":[34432]},"id":1}]} 2024-05-06T21:38:32.688 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 42 2024-05-06T21:38:32.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc74806e170 msgr2=0x7fc748070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc74806e170 0x7fc748070620 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc74c006010 tx=0x7fc74c005dd0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 msgr2=0x7fc75c1946e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 0x7fc75c1946e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d8d0 tx=0x7fc74400dd90 comp rx=0 tx=0).stop 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 shutdown_connections 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fc74806e170 0x7fc748070620 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc75c104590 0x7fc75c1946e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 --2- 172.21.15.32:0/357082266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75c0fe5b0 0x7fc75c1941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 >> 172.21.15.32:0/357082266 conn(0x7fc75c0743d0 msgr2=0x7fc75c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 shutdown_connections 2024-05-06T21:38:32.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.695+0000 7fc761cb9640 1 -- 172.21.15.32:0/357082266 wait complete. 2024-05-06T21:38:32.701 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 43 2024-05-06T21:38:32.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.812+0000 7fd762450640 1 -- 172.21.15.32:0/1201979649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 msgr2=0x7fd75c0fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.812+0000 7fd762450640 1 --2- 172.21.15.32:0/1201979649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 0x7fd75c0fea20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd744009880 tx=0x7fd74402bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.812+0000 7fd762450640 1 -- 172.21.15.32:0/1201979649 shutdown_connections 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.812+0000 7fd762450640 1 --2- 172.21.15.32:0/1201979649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 0x7fd75c0fea20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.812+0000 7fd762450640 1 --2- 172.21.15.32:0/1201979649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c104590 0x7fd75c104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.812+0000 7fd762450640 1 -- 172.21.15.32:0/1201979649 >> 172.21.15.32:0/1201979649 conn(0x7fd75c0743d0 msgr2=0x7fd75c0747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.812+0000 7fd762450640 1 -- 172.21.15.32:0/1201979649 shutdown_connections 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.812+0000 7fd762450640 1 -- 172.21.15.32:0/1201979649 wait complete. 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd762450640 1 Processor -- start 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd762450640 1 -- start start 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd762450640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 0x7fd75c1952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd762450640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c104590 0x7fd75c195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd762450640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c195eb0 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd762450640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c199c80 con 0x7fd75c104590 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd75bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 0x7fd75c1952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:32.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd75bfff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 0x7fd75c1952e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55346/0 (socket says 172.21.15.32:55346) 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd75bfff640 1 -- 172.21.15.32:0/3479864357 learned_addr learned my addr 172.21.15.32:0/3479864357 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd75bfff640 1 -- 172.21.15.32:0/3479864357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c104590 msgr2=0x7fd75c195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd75bfff640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c104590 0x7fd75c195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd75bfff640 1 -- 172.21.15.32:0/3479864357 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744009560 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.813+0000 7fd75bfff640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 0x7fd75c1952e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00c8f0 tx=0x7fd74c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.814+0000 7fd759ffb640 1 -- 172.21.15.32:0/3479864357 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd74c007b80 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.814+0000 7fd759ffb640 1 -- 172.21.15.32:0/3479864357 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd74c0054e0 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.814+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c199f60 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.814+0000 7fd759ffb640 1 -- 172.21.15.32:0/3479864357 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd74c00f450 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.814+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c19a540 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.815+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c04e000 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.815+0000 7fd759ffb640 1 -- 172.21.15.32:0/3479864357 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd74c004f60 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.816+0000 7fd759ffb640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd74806e170 0x7fd748070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:32.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.816+0000 7fd759ffb640 1 -- 172.21.15.32:0/3479864357 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fd74c08e150 con 0x7fd75c0fe5b0 2024-05-06T21:38:32.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.816+0000 7fd753fff640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd74806e170 0x7fd748070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:32.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.816+0000 7fd753fff640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd74806e170 0x7fd748070620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd744036040 tx=0x7fd744000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:32.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:32.820+0000 7fd759ffb640 1 -- 172.21.15.32:0/3479864357 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd74c0572d0 con 0x7fd75c0fe5b0 2024-05-06T21:38:33.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.044+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7fd75c196630 con 0x7fd75c0fe5b0 2024-05-06T21:38:33.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.044+0000 7fd759ffb640 1 -- 172.21.15.32:0/3479864357 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v44) v1 ==== 107+0+5225 (secure 0 0 0) 0x7fd74c05a990 con 0x7fd75c0fe5b0 2024-05-06T21:38:33.039 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:33.039 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44339,"name":"cephfs.smithi154.rizdbu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6825/171743146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":171743146},{"type":"v1","addr":"172.21.15.154:6825","nonce":171743146}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44353,"name":"cephfs.smithi154.xfmqxf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6827/3609095923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3609095923},{"type":"v1","addr":"172.21.15.154:6827","nonce":3609095923}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-06T21:23:50.198971+0000","modified":"2024-05-06T21:34:54.423937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34432,"mds_1":34452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34432":{"gid":34432,"name":"cephfs.smithi032.fpdhzg","rank":0,"incarnation":38,"state":"up:active","state_seq":19,"addr":"172.21.15.32:6827/1515774024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1515774024},{"type":"v1","addr":"172.21.15.32:6827","nonce":1515774024}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34452":{"gid":34452,"name":"cephfs.smithi032.jbgmwi","rank":1,"incarnation":43,"state":"up:starting","state_seq":1,"addr":"172.21.15.32:6829/367153911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":367153911},{"type":"v1","addr":"172.21.15.32:6829","nonce":367153911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34432,"qdb_cluster":[34432]},"id":1}]} 2024-05-06T21:38:33.039 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 43 2024-05-06T21:38:33.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd74806e170 msgr2=0x7fd748070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd74806e170 0x7fd748070620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd744036040 tx=0x7fd744000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 msgr2=0x7fd75c1952e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 0x7fd75c1952e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00c8f0 tx=0x7fd74c00cdb0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 shutdown_connections 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd74806e170 0x7fd748070620 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75c104590 0x7fd75c195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 --2- 172.21.15.32:0/3479864357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd75c0fe5b0 0x7fd75c1952e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 >> 172.21.15.32:0/3479864357 conn(0x7fd75c0743d0 msgr2=0x7fd75c067310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 shutdown_connections 2024-05-06T21:38:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.047+0000 7fd762450640 1 -- 172.21.15.32:0/3479864357 wait complete. 2024-05-06T21:38:33.053 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-06T21:38:33.064 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-06T21:38:33.064 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:38:33.064 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T21:38:33.082 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-06T21:38:33.083 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T21:38:33.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-06T21:38:33.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.288+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/1213261642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 msgr2=0x7fdf940ffd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.288+0000 7fdf9bb3c640 1 --2- 172.21.15.32:0/1213261642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 0x7fdf940ffd10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009880 tx=0x7fdf8402bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/1213261642 shutdown_connections 2024-05-06T21:38:33.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 --2- 172.21.15.32:0/1213261642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 0x7fdf940ffd10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 --2- 172.21.15.32:0/1213261642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf941058b0 0x7fdf94105c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/1213261642 >> 172.21.15.32:0/1213261642 conn(0x7fdf940fb3a0 msgr2=0x7fdf940fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:33.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/1213261642 shutdown_connections 2024-05-06T21:38:33.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/1213261642 wait complete. 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 Processor -- start 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 -- start start 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 0x7fdf94195420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf941058b0 0x7fdf94195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94195ff0 con 0x7fdf940ff8a0 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.289+0000 7fdf9bb3c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94199dc0 con 0x7fdf941058b0 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf998d8640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 0x7fdf94195420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf998d8640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 0x7fdf94195420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55358/0 (socket says 172.21.15.32:55358) 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf998d8640 1 -- 172.21.15.32:0/3384874946 learned_addr learned my addr 172.21.15.32:0/3384874946 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf990d7640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf941058b0 0x7fdf94195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf998d8640 1 -- 172.21.15.32:0/3384874946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf941058b0 msgr2=0x7fdf94195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf998d8640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf941058b0 0x7fdf94195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf998d8640 1 -- 172.21.15.32:0/3384874946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84009560 con 0x7fdf940ff8a0 2024-05-06T21:38:33.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf998d8640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 0x7fdf94195420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000c8f0 tx=0x7fdf9000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:33.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf8affd640 1 -- 172.21.15.32:0/3384874946 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf900041f0 con 0x7fdf940ff8a0 2024-05-06T21:38:33.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf8affd640 1 -- 172.21.15.32:0/3384874946 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf90007e70 con 0x7fdf940ff8a0 2024-05-06T21:38:33.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf8affd640 1 -- 172.21.15.32:0/3384874946 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf900049d0 con 0x7fdf940ff8a0 2024-05-06T21:38:33.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9419a0a0 con 0x7fdf940ff8a0 2024-05-06T21:38:33.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.290+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9419a650 con 0x7fdf940ff8a0 2024-05-06T21:38:33.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.291+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9404e000 con 0x7fdf940ff8a0 2024-05-06T21:38:33.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.292+0000 7fdf8affd640 1 -- 172.21.15.32:0/3384874946 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdf90004350 con 0x7fdf940ff8a0 2024-05-06T21:38:33.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.292+0000 7fdf8affd640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdf8006e230 0x7fdf800706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:33.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.292+0000 7fdf8affd640 1 -- 172.21.15.32:0/3384874946 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fdf9008df40 con 0x7fdf940ff8a0 2024-05-06T21:38:33.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.292+0000 7fdf990d7640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdf8006e230 0x7fdf800706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:33.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.293+0000 7fdf990d7640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdf8006e230 0x7fdf800706e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf84006010 tx=0x7fdf84005b50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:33.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.297+0000 7fdf8affd640 1 -- 172.21.15.32:0/3384874946 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fdf900c2740 con 0x7fdf940ff8a0 2024-05-06T21:38:33.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:33 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3657242821' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-05-06T21:38:33.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:33 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/357082266' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-05-06T21:38:33.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:33 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3479864357' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-05-06T21:38:33.392 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:33 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3657242821' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-05-06T21:38:33.392 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:33 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/357082266' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-05-06T21:38:33.392 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:33 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3479864357' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-05-06T21:38:33.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.484+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf9410ca90 con 0x7fdf940ff8a0 2024-05-06T21:38:33.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.485+0000 7fdf8affd640 1 -- 172.21.15.32:0/3384874946 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17351 (secure 0 0 0) 0x7fdf9001d020 con 0x7fdf940ff8a0 2024-05-06T21:38:33.480 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:33.480 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":95,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","created":"2024-05-06T21:16:43.886575+0000","modified":"2024-05-06T21:34:37.439760+0000","last_up_change":"2024-05-06T21:32:52.685273+0000","last_in_change":"2024-05-06T21:22:10.894148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T21:21:16.105413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-05-06T21:23:49.127155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-05-06T21:23:49.617433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0095c3fd-9b90-4d23-b192-98fd9a06c20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":90,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6803","nonce":2472907178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6805","nonce":2472907178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6809","nonce":2472907178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6807","nonce":2472907178}]},"public_addr":"172.21.15.32:6803/2472907178","cluster_addr":"172.21.15.32:6805/2472907178","heartbeat_back_addr":"172.21.15.32:6809/2472907178","heartbeat_front_addr":"172.21.15.32:6807/2472907178","state":["exists","up"]},{"osd":1,"uuid":"0d37de85-e43f-4094-ba6a-00a09047798a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":65,"up_thru":90,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6811","nonce":2235618236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6813","nonce":2235618236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6817","nonce":2235618236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6815","nonce":2235618236}]},"public_addr":"172.21.15.32:6811/2235618236","cluster_addr":"172.21.15.32:6813/2235618236","heartbeat_back_addr":"172.21.15.32:6817/2235618236","heartbeat_front_addr":"172.21.15.32:6815/2235618236","state":["exists","up"]},{"osd":2,"uuid":"e41022aa-de8c-45d9-aa0e-a1918b23fb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":71,"up_from":75,"up_thru":90,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6819","nonce":3106482767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6821","nonce":3106482767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6825","nonce":3106482767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6823","nonce":3106482767}]},"public_addr":"172.21.15.32:6819/3106482767","cluster_addr":"172.21.15.32:6821/3106482767","heartbeat_back_addr":"172.21.15.32:6825/3106482767","heartbeat_front_addr":"172.21.15.32:6823/3106482767","state":["exists","up"]},{"osd":3,"uuid":"11e127c4-f415-4261-9584-b53b7bfa8b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":76,"up_from":80,"up_thru":90,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6801","nonce":4072948236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6803","nonce":4072948236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6807","nonce":4072948236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6805","nonce":4072948236}]},"public_addr":"172.21.15.154:6801/4072948236","cluster_addr":"172.21.15.154:6803/4072948236","heartbeat_back_addr":"172.21.15.154:6807/4072948236","heartbeat_front_addr":"172.21.15.154:6805/4072948236","state":["exists","up"]},{"osd":4,"uuid":"190cd663-20cb-49b3-84b0-345f665e068e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":81,"up_from":85,"up_thru":90,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6809","nonce":3787543137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6811","nonce":3787543137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6815","nonce":3787543137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6813","nonce":3787543137}]},"public_addr":"172.21.15.154:6809/3787543137","cluster_addr":"172.21.15.154:6811/3787543137","heartbeat_back_addr":"172.21.15.154:6815/3787543137","heartbeat_front_addr":"172.21.15.154:6813/3787543137","state":["exists","up"]},{"osd":5,"uuid":"7655488e-f7b9-4902-b6d3-28f762d44a2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":86,"up_from":90,"up_thru":90,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6817","nonce":2230951688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6819","nonce":2230951688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6823","nonce":2230951688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6821","nonce":2230951688}]},"public_addr":"172.21.15.154:6817/2230951688","cluster_addr":"172.21.15.154:6819/2230951688","heartbeat_back_addr":"172.21.15.154:6823/2230951688","heartbeat_front_addr":"172.21.15.154:6821/2230951688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:14.221856+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:43.419480+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:12.732797+0000","dead_epoch":71},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:36.574751+0000","dead_epoch":76},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:02.167660+0000","dead_epoch":81},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:28.497477+0000","dead_epoch":86}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":3,"to":2}]},{"pgid":"2.5","mappings":[{"from":0,"to":2}]},{"pgid":"2.12","mappings":[{"from":0,"to":5},{"from":3,"to":2}]},{"pgid":"2.19","mappings":[{"from":0,"to":1}]},{"pgid":"2.1d","mappings":[{"from":3,"to":1}]},{"pgid":"3.b","mappings":[{"from":4,"to":2}]},{"pgid":"3.14","mappings":[{"from":3,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6827/2609692046":"2024-05-07T21:34:37.439729+0000","172.21.15.154:6826/2609692046":"2024-05-07T21:34:37.439729+0000","172.21.15.32:6829/1302339589":"2024-05-07T21:33:59.176616+0000","172.21.15.32:6828/1302339589":"2024-05-07T21:33:59.176616+0000","172.21.15.32:0/1427527157":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/3371897316":"2024-05-07T21:28:20.593033+0000","172.21.15.32:6801/559791322":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/2104181876":"2024-05-07T21:17:45.720027+0000","172.21.15.154:6828/2671631515":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/314356654":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/928947970":"2024-05-07T21:26:04.755904+0000","172.21.15.32:0/2913247857":"2024-05-07T21:18:57.579578+0000","172.21.15.154:0/574866439":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/679753640":"2024-05-07T21:28:20.593033+0000","172.21.15.154:0/3827385640":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/2077354807":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6826/403692088":"2024-05-07T21:24:06.865368+0000","172.21.15.154:0/1347448701":"2024-05-07T21:27:14.287554+0000","172.21.15.32:6827/403692088":"2024-05-07T21:24:06.865368+0000","172.21.15.32:0/1723093349":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/2720610700":"2024-05-07T21:17:12.681477+0000","172.21.15.154:0/3762142095":"2024-05-07T21:27:14.287554+0000","172.21.15.154:6829/2671631515":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/1406133666":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1230396006":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6801/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/3536478886":"2024-05-07T21:26:04.755904+0000","172.21.15.32:0/2992602151":"2024-05-07T21:28:20.593033+0000","172.21.15.154:0/3154197577":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/3688348585":"2024-05-07T21:26:04.755904+0000","172.21.15.32:0/1223764907":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6800/2162274499":"2024-05-07T21:26:04.755904+0000","172.21.15.154:0/2805675075":"2024-05-07T21:27:14.287554+0000","172.21.15.32:6801/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6801/2162274499":"2024-05-07T21:26:04.755904+0000","172.21.15.32:6801/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/3998200556":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/672629275":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/1033156191":"2024-05-07T21:26:04.755904+0000","172.21.15.32:6800/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6800/559791322":"2024-05-07T21:28:20.593033+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T21:38:33.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdf8006e230 msgr2=0x7fdf800706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdf8006e230 0x7fdf800706e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf84006010 tx=0x7fdf84005b50 comp rx=0 tx=0).stop 2024-05-06T21:38:33.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 msgr2=0x7fdf94195420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 0x7fdf94195420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000c8f0 tx=0x7fdf9000cdb0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 shutdown_connections 2024-05-06T21:38:33.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fdf8006e230 0x7fdf800706e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf941058b0 0x7fdf94195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 --2- 172.21.15.32:0/3384874946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf940ff8a0 0x7fdf94195420 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 >> 172.21.15.32:0/3384874946 conn(0x7fdf940fb3a0 msgr2=0x7fdf940fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:33.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 shutdown_connections 2024-05-06T21:38:33.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.487+0000 7fdf9bb3c640 1 -- 172.21.15.32:0/3384874946 wait complete. 2024-05-06T21:38:33.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-06T21:21:16.105413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-05-06T21:23:49.127155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-05-06T21:23:49.617433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-06T21:38:33.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-06T21:38:33.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.606+0000 7ff3abe88640 1 -- 172.21.15.32:0/559124024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 msgr2=0x7ff3a41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.606+0000 7ff3abe88640 1 --2- 172.21.15.32:0/559124024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 0x7ff3a41098c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00098b0 tx=0x7ff3a002bd60 comp rx=0 tx=0).stop 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.606+0000 7ff3abe88640 1 -- 172.21.15.32:0/559124024 shutdown_connections 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.606+0000 7ff3abe88640 1 --2- 172.21.15.32:0/559124024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 0x7ff3a41098c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.606+0000 7ff3abe88640 1 --2- 172.21.15.32:0/559124024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a4100ac0 0x7ff3a4100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.606+0000 7ff3abe88640 1 -- 172.21.15.32:0/559124024 >> 172.21.15.32:0/559124024 conn(0x7ff3a40fa2f0 msgr2=0x7ff3a40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.606+0000 7ff3abe88640 1 -- 172.21.15.32:0/559124024 shutdown_connections 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.606+0000 7ff3abe88640 1 -- 172.21.15.32:0/559124024 wait complete. 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3abe88640 1 Processor -- start 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3abe88640 1 -- start start 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3abe88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a4100ac0 0x7ff3a4195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3abe88640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 0x7ff3a4195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3abe88640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4196330 con 0x7ff3a41013d0 2024-05-06T21:38:33.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3abe88640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4199000 con 0x7ff3a4100ac0 2024-05-06T21:38:33.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3a9423640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 0x7ff3a4195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:33.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3a9423640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 0x7ff3a4195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55370/0 (socket says 172.21.15.32:55370) 2024-05-06T21:38:33.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3a9423640 1 -- 172.21.15.32:0/3748325917 learned_addr learned my addr 172.21.15.32:0/3748325917 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:33.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3a9c24640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a4100ac0 0x7ff3a4195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:33.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3a9423640 1 -- 172.21.15.32:0/3748325917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a4100ac0 msgr2=0x7ff3a4195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3a9423640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a4100ac0 0x7ff3a4195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3a9423640 1 -- 172.21.15.32:0/3748325917 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0009560 con 0x7ff3a41013d0 2024-05-06T21:38:33.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.607+0000 7ff3a9423640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 0x7ff3a4195c50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009880 tx=0x7ff3a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:33.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.608+0000 7ff396ffd640 1 -- 172.21.15.32:0/3748325917 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a00037c0 con 0x7ff3a41013d0 2024-05-06T21:38:33.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.608+0000 7ff396ffd640 1 -- 172.21.15.32:0/3748325917 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3a0003de0 con 0x7ff3a41013d0 2024-05-06T21:38:33.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.608+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a4199280 con 0x7ff3a41013d0 2024-05-06T21:38:33.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.608+0000 7ff396ffd640 1 -- 172.21.15.32:0/3748325917 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a003e450 con 0x7ff3a41013d0 2024-05-06T21:38:33.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.608+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a41997e0 con 0x7ff3a41013d0 2024-05-06T21:38:33.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.609+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a404e000 con 0x7ff3a41013d0 2024-05-06T21:38:33.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.609+0000 7ff396ffd640 1 -- 172.21.15.32:0/3748325917 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff3a0004fd0 con 0x7ff3a41013d0 2024-05-06T21:38:33.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.610+0000 7ff396ffd640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff39006e170 0x7ff390070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:33.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.610+0000 7ff396ffd640 1 -- 172.21.15.32:0/3748325917 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7ff3a00b0f30 con 0x7ff3a41013d0 2024-05-06T21:38:33.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.610+0000 7ff3a9c24640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff39006e170 0x7ff390070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:33.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.610+0000 7ff3a9c24640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff39006e170 0x7ff390070620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff398009890 tx=0x7ff398008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:33.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.614+0000 7ff396ffd640 1 -- 172.21.15.32:0/3748325917 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff3a007a090 con 0x7ff3a41013d0 2024-05-06T21:38:33.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.797+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3a4196a60 con 0x7ff3a41013d0 2024-05-06T21:38:33.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.797+0000 7ff396ffd640 1 -- 172.21.15.32:0/3748325917 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3a00430a0 con 0x7ff3a41013d0 2024-05-06T21:38:33.792 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-05-06T21:38:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff39006e170 msgr2=0x7ff390070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff39006e170 0x7ff390070620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff398009890 tx=0x7ff398008040 comp rx=0 tx=0).stop 2024-05-06T21:38:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 msgr2=0x7ff3a4195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 0x7ff3a4195c50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009880 tx=0x7ff3a0004270 comp rx=0 tx=0).stop 2024-05-06T21:38:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 shutdown_connections 2024-05-06T21:38:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff39006e170 0x7ff390070620 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a41013d0 0x7ff3a4195c50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 --2- 172.21.15.32:0/3748325917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a4100ac0 0x7ff3a4195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 >> 172.21.15.32:0/3748325917 conn(0x7ff3a40fa2f0 msgr2=0x7ff3a4104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 shutdown_connections 2024-05-06T21:38:33.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.799+0000 7ff3abe88640 1 -- 172.21.15.32:0/3748325917 wait complete. 2024-05-06T21:38:33.805 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-05-06T21:38:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.917+0000 7fe0a39b2640 1 -- 172.21.15.32:0/3653388531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c101340 msgr2=0x7fe09c109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.917+0000 7fe0a39b2640 1 --2- 172.21.15.32:0/3653388531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c101340 0x7fe09c109830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0098b0 tx=0x7fe08c02bcd0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.917+0000 7fe0a39b2640 1 -- 172.21.15.32:0/3653388531 shutdown_connections 2024-05-06T21:38:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.917+0000 7fe0a39b2640 1 --2- 172.21.15.32:0/3653388531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c101340 0x7fe09c109830 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.917+0000 7fe0a39b2640 1 --2- 172.21.15.32:0/3653388531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c100a30 0x7fe09c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.917+0000 7fe0a39b2640 1 -- 172.21.15.32:0/3653388531 >> 172.21.15.32:0/3653388531 conn(0x7fe09c0fa260 msgr2=0x7fe09c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.917+0000 7fe0a39b2640 1 -- 172.21.15.32:0/3653388531 shutdown_connections 2024-05-06T21:38:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.917+0000 7fe0a39b2640 1 -- 172.21.15.32:0/3653388531 wait complete. 2024-05-06T21:38:33.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.918+0000 7fe0a39b2640 1 Processor -- start 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.918+0000 7fe0a39b2640 1 -- start start 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.918+0000 7fe0a39b2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c100a30 0x7fe09c195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.918+0000 7fe0a39b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c101340 0x7fe09c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.918+0000 7fe0a39b2640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c196160 con 0x7fe09c100a30 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.918+0000 7fe0a39b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c199f30 con 0x7fe09c101340 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.918+0000 7fe0a174e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c100a30 0x7fe09c195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.918+0000 7fe0a174e640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c100a30 0x7fe09c195590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55386/0 (socket says 172.21.15.32:55386) 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.918+0000 7fe0a174e640 1 -- 172.21.15.32:0/5648474 learned_addr learned my addr 172.21.15.32:0/5648474 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0a0f4d640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c101340 0x7fe09c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0a174e640 1 -- 172.21.15.32:0/5648474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c101340 msgr2=0x7fe09c195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0a174e640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c101340 0x7fe09c195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0a174e640 1 -- 172.21.15.32:0/5648474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c009560 con 0x7fe09c100a30 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0a0f4d640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c101340 0x7fe09c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:38:33.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0a174e640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c100a30 0x7fe09c195590 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe09800e970 tx=0x7fe09800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0927fc640 1 -- 172.21.15.32:0/5648474 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe09800cc90 con 0x7fe09c100a30 2024-05-06T21:38:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c19a210 con 0x7fe09c100a30 2024-05-06T21:38:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0927fc640 1 -- 172.21.15.32:0/5648474 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe09800cdf0 con 0x7fe09c100a30 2024-05-06T21:38:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0927fc640 1 -- 172.21.15.32:0/5648474 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe098010430 con 0x7fe09c100a30 2024-05-06T21:38:33.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.919+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c19a770 con 0x7fe09c100a30 2024-05-06T21:38:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.920+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c04e000 con 0x7fe09c100a30 2024-05-06T21:38:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.921+0000 7fe0927fc640 1 -- 172.21.15.32:0/5648474 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe0980046c0 con 0x7fe09c100a30 2024-05-06T21:38:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.921+0000 7fe0927fc640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe08806e170 0x7fe088070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.921+0000 7fe0927fc640 1 -- 172.21.15.32:0/5648474 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fe098014070 con 0x7fe09c100a30 2024-05-06T21:38:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.921+0000 7fe0a0f4d640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe08806e170 0x7fe088070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:33.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.922+0000 7fe0a0f4d640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe08806e170 0x7fe088070620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe08c036040 tx=0x7fe08c005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:33.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:33.927+0000 7fe0927fc640 1 -- 172.21.15.32:0/5648474 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe098057a60 con 0x7fe09c100a30 2024-05-06T21:38:34.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.115+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fe09c066860 con 0x7fe09c100a30 2024-05-06T21:38:34.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.116+0000 7fe0927fc640 1 -- 172.21.15.32:0/5648474 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe09805b120 con 0x7fe09c100a30 2024-05-06T21:38:34.111 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-05-06T21:38:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe08806e170 msgr2=0x7fe088070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe08806e170 0x7fe088070620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe08c036040 tx=0x7fe08c005fd0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c100a30 msgr2=0x7fe09c195590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c100a30 0x7fe09c195590 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe09800e970 tx=0x7fe09800ed70 comp rx=0 tx=0).stop 2024-05-06T21:38:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 shutdown_connections 2024-05-06T21:38:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fe08806e170 0x7fe088070620 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09c101340 0x7fe09c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 --2- 172.21.15.32:0/5648474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe09c100a30 0x7fe09c195590 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 >> 172.21.15.32:0/5648474 conn(0x7fe09c0fa260 msgr2=0x7fe09c103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:34.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 shutdown_connections 2024-05-06T21:38:34.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.118+0000 7fe0a39b2640 1 -- 172.21.15.32:0/5648474 wait complete. 2024-05-06T21:38:34.122 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:34 smithi032 ceph-mon[76650]: pgmap v354: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:34.123 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:34 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3384874946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:38:34.123 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:34 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3748325917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:38:34.124 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-05-06T21:38:34.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 -- 172.21.15.32:0/1507313585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e00ff650 msgr2=0x7f19e00ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 --2- 172.21.15.32:0/1507313585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e00ff650 0x7f19e00ffac0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009880 tx=0x7f19cc02bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 -- 172.21.15.32:0/1507313585 shutdown_connections 2024-05-06T21:38:34.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 --2- 172.21.15.32:0/1507313585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e00ff650 0x7f19e00ffac0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 --2- 172.21.15.32:0/1507313585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e0105660 0x7f19e0105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 -- 172.21.15.32:0/1507313585 >> 172.21.15.32:0/1507313585 conn(0x7f19e00fb170 msgr2=0x7f19e00fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 -- 172.21.15.32:0/1507313585 shutdown_connections 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 -- 172.21.15.32:0/1507313585 wait complete. 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 Processor -- start 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.236+0000 7f19e700b640 1 -- start start 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19e700b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e00ff650 0x7f19e01953f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19e700b640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e0105660 0x7f19e0195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19e700b640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e0195f30 con 0x7f19e0105660 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19e700b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e01960a0 con 0x7f19e00ff650 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19dffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e0105660 0x7f19e0195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19dffff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e0105660 0x7f19e0195930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55416/0 (socket says 172.21.15.32:55416) 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19dffff640 1 -- 172.21.15.32:0/3723400143 learned_addr learned my addr 172.21.15.32:0/3723400143 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19e4da7640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e00ff650 0x7f19e01953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19dffff640 1 -- 172.21.15.32:0/3723400143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e00ff650 msgr2=0x7f19e01953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19dffff640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e00ff650 0x7f19e01953f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19dffff640 1 -- 172.21.15.32:0/3723400143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc009560 con 0x7f19e0105660 2024-05-06T21:38:34.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19dffff640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e0105660 0x7f19e0195930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009230 tx=0x7f19cc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:34.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19ddffb640 1 -- 172.21.15.32:0/3723400143 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19cc0035f0 con 0x7f19e0105660 2024-05-06T21:38:34.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19ddffb640 1 -- 172.21.15.32:0/3723400143 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19cc003c10 con 0x7f19e0105660 2024-05-06T21:38:34.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e0199ed0 con 0x7f19e0105660 2024-05-06T21:38:34.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.237+0000 7f19ddffb640 1 -- 172.21.15.32:0/3723400143 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19cc034440 con 0x7f19e0105660 2024-05-06T21:38:34.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.238+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e019a3d0 con 0x7f19e0105660 2024-05-06T21:38:34.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.239+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e004e000 con 0x7f19e0105660 2024-05-06T21:38:34.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.239+0000 7f19ddffb640 1 -- 172.21.15.32:0/3723400143 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f19cc004fd0 con 0x7f19e0105660 2024-05-06T21:38:34.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.240+0000 7f19ddffb640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f19d006e170 0x7f19d0070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:34.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.240+0000 7f19ddffb640 1 -- 172.21.15.32:0/3723400143 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f19cc0b0690 con 0x7f19e0105660 2024-05-06T21:38:34.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.240+0000 7f19e4da7640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f19d006e170 0x7f19d0070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:34.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.240+0000 7f19e4da7640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f19d006e170 0x7f19d0070620 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19d40058c0 tx=0x7f19d4005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:34.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.245+0000 7f19ddffb640 1 -- 172.21.15.32:0/3723400143 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f19cc079890 con 0x7f19e0105660 2024-05-06T21:38:34.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:34 smithi154 ceph-mon[63622]: pgmap v354: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:34.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:34 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3384874946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:38:34.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:34 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3748325917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:38:34.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.426+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f19e0107b30 con 0x7f19e0105660 2024-05-06T21:38:34.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.426+0000 7f19ddffb640 1 -- 172.21.15.32:0/3723400143 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7f19cc07cf50 con 0x7f19e0105660 2024-05-06T21:38:34.421 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-05-06T21:38:34.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f19d006e170 msgr2=0x7f19d0070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f19d006e170 0x7f19d0070620 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19d40058c0 tx=0x7f19d4005850 comp rx=0 tx=0).stop 2024-05-06T21:38:34.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e0105660 msgr2=0x7f19e0195930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e0105660 0x7f19e0195930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009230 tx=0x7f19cc004040 comp rx=0 tx=0).stop 2024-05-06T21:38:34.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 shutdown_connections 2024-05-06T21:38:34.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f19d006e170 0x7f19d0070620 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e0105660 0x7f19e0195930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 --2- 172.21.15.32:0/3723400143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e00ff650 0x7f19e01953f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 >> 172.21.15.32:0/3723400143 conn(0x7f19e00fb170 msgr2=0x7f19e00fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:34.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 shutdown_connections 2024-05-06T21:38:34.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.428+0000 7f19e700b640 1 -- 172.21.15.32:0/3723400143 wait complete. 2024-05-06T21:38:34.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-06T21:38:34.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.549+0000 7fd83aff0640 1 -- 172.21.15.32:0/4290758559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 msgr2=0x7fd834100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.549+0000 7fd83aff0640 1 --2- 172.21.15.32:0/4290758559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 0x7fd834100e60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd8280098b0 tx=0x7fd82802bd60 comp rx=0 tx=0).stop 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.549+0000 7fd83aff0640 1 -- 172.21.15.32:0/4290758559 shutdown_connections 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.549+0000 7fd83aff0640 1 --2- 172.21.15.32:0/4290758559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8341013a0 0x7fd834109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.549+0000 7fd83aff0640 1 --2- 172.21.15.32:0/4290758559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 0x7fd834100e60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.549+0000 7fd83aff0640 1 -- 172.21.15.32:0/4290758559 >> 172.21.15.32:0/4290758559 conn(0x7fd8340fa2a0 msgr2=0x7fd8340fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.549+0000 7fd83aff0640 1 -- 172.21.15.32:0/4290758559 shutdown_connections 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.549+0000 7fd83aff0640 1 -- 172.21.15.32:0/4290758559 wait complete. 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd83aff0640 1 Processor -- start 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd83aff0640 1 -- start start 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd83aff0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 0x7fd834195470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:34.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd83aff0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8341013a0 0x7fd8341959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd83aff0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834196040 con 0x7fd834100a90 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd83aff0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834199e10 con 0x7fd8341013a0 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd838d8c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 0x7fd834195470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd838d8c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 0x7fd834195470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55436/0 (socket says 172.21.15.32:55436) 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd838d8c640 1 -- 172.21.15.32:0/2458985240 learned_addr learned my addr 172.21.15.32:0/2458985240 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.550+0000 7fd833fff640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8341013a0 0x7fd8341959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd838d8c640 1 -- 172.21.15.32:0/2458985240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8341013a0 msgr2=0x7fd8341959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd838d8c640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8341013a0 0x7fd8341959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd838d8c640 1 -- 172.21.15.32:0/2458985240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828009560 con 0x7fd834100a90 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd833fff640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8341013a0 0x7fd8341959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd838d8c640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 0x7fd834195470 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd82802c2a0 tx=0x7fd82802c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd831ffb640 1 -- 172.21.15.32:0/2458985240 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8280035f0 con 0x7fd834100a90 2024-05-06T21:38:34.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd831ffb640 1 -- 172.21.15.32:0/2458985240 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd828003c10 con 0x7fd834100a90 2024-05-06T21:38:34.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83419a090 con 0x7fd834100a90 2024-05-06T21:38:34.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd831ffb640 1 -- 172.21.15.32:0/2458985240 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd828005690 con 0x7fd834100a90 2024-05-06T21:38:34.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.551+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83419a5f0 con 0x7fd834100a90 2024-05-06T21:38:34.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.552+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83404e000 con 0x7fd834100a90 2024-05-06T21:38:34.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.553+0000 7fd831ffb640 1 -- 172.21.15.32:0/2458985240 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd828004ed0 con 0x7fd834100a90 2024-05-06T21:38:34.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.553+0000 7fd831ffb640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd82406e1e0 0x7fd824070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:34.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.554+0000 7fd833fff640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd82406e1e0 0x7fd824070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:34.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.554+0000 7fd831ffb640 1 -- 172.21.15.32:0/2458985240 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fd8280b0e80 con 0x7fd834100a90 2024-05-06T21:38:34.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.554+0000 7fd833fff640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd82406e1e0 0x7fd824070690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd834196a80 tx=0x7fd82000b5f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:34.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.558+0000 7fd831ffb640 1 -- 172.21.15.32:0/2458985240 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd82807a120 con 0x7fd834100a90 2024-05-06T21:38:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.755+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd834066860 con 0x7fd834100a90 2024-05-06T21:38:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.756+0000 7fd831ffb640 1 -- 172.21.15.32:0/2458985240 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v95) v1 ==== 81+0+2549 (secure 0 0 0) 0x7fd828043080 con 0x7fd834100a90 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:6827/2609692046 2024-05-07T21:34:37.439729+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:6826/2609692046 2024-05-07T21:34:37.439729+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6829/1302339589 2024-05-07T21:33:59.176616+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6828/1302339589 2024-05-07T21:33:59.176616+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1427527157 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/3371897316 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/559791322 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2104181876 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:6828/2671631515 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/314356654 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/928947970 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2913247857 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/574866439 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/679753640 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/3827385640 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2077354807 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6826/403692088 2024-05-07T21:24:06.865368+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/1347448701 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6827/403692088 2024-05-07T21:24:06.865368+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1723093349 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2720610700 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/3762142095 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:6829/2671631515 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1406133666 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1230396006 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/3609229440 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/3536478886 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2992602151 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/3154197577 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/3688348585 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1223764907 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/3609229440 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/2414450865 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/2162274499 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/2805675075 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:34.753 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/2414450865 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:34.754 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/2162274499 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:34.754 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/2729651169 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:34.754 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/3998200556 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:34.754 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/672629275 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:34.754 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1033156191 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:34.754 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/2729651169 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:34.754 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/559791322 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:34.755 INFO:teuthology.orchestra.run.smithi032.stderr:listed 43 entries 2024-05-06T21:38:34.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd82406e1e0 msgr2=0x7fd824070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd82406e1e0 0x7fd824070690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd834196a80 tx=0x7fd82000b5f0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 msgr2=0x7fd834195470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 0x7fd834195470 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd82802c2a0 tx=0x7fd82802c8d0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 shutdown_connections 2024-05-06T21:38:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fd82406e1e0 0x7fd824070690 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8341013a0 0x7fd8341959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 --2- 172.21.15.32:0/2458985240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd834100a90 0x7fd834195470 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 >> 172.21.15.32:0/2458985240 conn(0x7fd8340fa2a0 msgr2=0x7fd8341040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 shutdown_connections 2024-05-06T21:38:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:34.758+0000 7fd83aff0640 1 -- 172.21.15.32:0/2458985240 wait complete. 2024-05-06T21:38:34.764 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-06T21:38:34.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:34.764 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-06T21:38:34.791 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:38:34.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:34.792 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-06T21:38:34.855 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:38:34.856 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T21:38:34.876 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-06T21:38:34.876 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-06T21:38:34.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-06T21:38:35.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.046+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2743725516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c101020 msgr2=0x7ff19c1096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.046+0000 7ff1a47d0640 1 --2- 172.21.15.32:0/2743725516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c101020 0x7ff19c1096f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009880 tx=0x7ff18c02bd70 comp rx=0 tx=0).stop 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.046+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2743725516 shutdown_connections 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.046+0000 7ff1a47d0640 1 --2- 172.21.15.32:0/2743725516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c101020 0x7ff19c1096f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.046+0000 7ff1a47d0640 1 --2- 172.21.15.32:0/2743725516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff19c100710 0x7ff19c100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.046+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2743725516 >> 172.21.15.32:0/2743725516 conn(0x7ff19c075270 msgr2=0x7ff19c075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.046+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2743725516 shutdown_connections 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.046+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2743725516 wait complete. 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a47d0640 1 Processor -- start 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a47d0640 1 -- start start 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a47d0640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c100710 0x7ff19c195210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a47d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff19c101020 0x7ff19c195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a47d0640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c195d50 con 0x7ff19c100710 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a47d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c195ec0 con 0x7ff19c101020 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a256c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c100710 0x7ff19c195210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a256c640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c100710 0x7ff19c195210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55454/0 (socket says 172.21.15.32:55454) 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a256c640 1 -- 172.21.15.32:0/2716776911 learned_addr learned my addr 172.21.15.32:0/2716776911 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a1d6b640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff19c101020 0x7ff19c195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a256c640 1 -- 172.21.15.32:0/2716776911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff19c101020 msgr2=0x7ff19c195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a256c640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff19c101020 0x7ff19c195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a256c640 1 -- 172.21.15.32:0/2716776911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c009560 con 0x7ff19c100710 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.047+0000 7ff1a1d6b640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff19c101020 0x7ff19c195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.048+0000 7ff1a256c640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c100710 0x7ff19c195210 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c8a0 tx=0x7ff19800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.048+0000 7ff1937fe640 1 -- 172.21.15.32:0/2716776911 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff198007b80 con 0x7ff19c100710 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.048+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c199d50 con 0x7ff19c100710 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.048+0000 7ff1937fe640 1 -- 172.21.15.32:0/2716776911 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff198007ce0 con 0x7ff19c100710 2024-05-06T21:38:35.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.048+0000 7ff1937fe640 1 -- 172.21.15.32:0/2716776911 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1980187b0 con 0x7ff19c100710 2024-05-06T21:38:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.048+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c19a2b0 con 0x7ff19c100710 2024-05-06T21:38:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.049+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c04e000 con 0x7ff19c100710 2024-05-06T21:38:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.049+0000 7ff1937fe640 1 -- 172.21.15.32:0/2716776911 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff19800f450 con 0x7ff19c100710 2024-05-06T21:38:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.050+0000 7ff1937fe640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff18806e230 0x7ff1880706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.050+0000 7ff1a1d6b640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff18806e230 0x7ff1880706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.050+0000 7ff1937fe640 1 -- 172.21.15.32:0/2716776911 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7ff19808e4e0 con 0x7ff19c100710 2024-05-06T21:38:35.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.051+0000 7ff1a1d6b640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff18806e230 0x7ff1880706e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff18c036040 tx=0x7ff18c005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.055+0000 7ff1937fe640 1 -- 172.21.15.32:0/2716776911 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff198057660 con 0x7ff19c100710 2024-05-06T21:38:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.242+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff19c10c850 con 0x7ff19c100710 2024-05-06T21:38:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.243+0000 7ff1937fe640 1 -- 172.21.15.32:0/2716776911 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17351 (secure 0 0 0) 0x7ff19805ad20 con 0x7ff19c100710 2024-05-06T21:38:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-06T21:38:35.238 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":95,"fsid":"d155ff30-0bed-11ef-bc97-c7b262605968","created":"2024-05-06T21:16:43.886575+0000","modified":"2024-05-06T21:34:37.439760+0000","last_up_change":"2024-05-06T21:32:52.685273+0000","last_in_change":"2024-05-06T21:22:10.894148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T21:21:16.105413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-05-06T21:23:49.127155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-05-06T21:23:49.617433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0095c3fd-9b90-4d23-b192-98fd9a06c20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":90,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6803","nonce":2472907178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6805","nonce":2472907178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6809","nonce":2472907178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2472907178},{"type":"v1","addr":"172.21.15.32:6807","nonce":2472907178}]},"public_addr":"172.21.15.32:6803/2472907178","cluster_addr":"172.21.15.32:6805/2472907178","heartbeat_back_addr":"172.21.15.32:6809/2472907178","heartbeat_front_addr":"172.21.15.32:6807/2472907178","state":["exists","up"]},{"osd":1,"uuid":"0d37de85-e43f-4094-ba6a-00a09047798a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":65,"up_thru":90,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6811","nonce":2235618236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6813","nonce":2235618236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6817","nonce":2235618236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2235618236},{"type":"v1","addr":"172.21.15.32:6815","nonce":2235618236}]},"public_addr":"172.21.15.32:6811/2235618236","cluster_addr":"172.21.15.32:6813/2235618236","heartbeat_back_addr":"172.21.15.32:6817/2235618236","heartbeat_front_addr":"172.21.15.32:6815/2235618236","state":["exists","up"]},{"osd":2,"uuid":"e41022aa-de8c-45d9-aa0e-a1918b23fb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":71,"up_from":75,"up_thru":90,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6819","nonce":3106482767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6821","nonce":3106482767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6825","nonce":3106482767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3106482767},{"type":"v1","addr":"172.21.15.32:6823","nonce":3106482767}]},"public_addr":"172.21.15.32:6819/3106482767","cluster_addr":"172.21.15.32:6821/3106482767","heartbeat_back_addr":"172.21.15.32:6825/3106482767","heartbeat_front_addr":"172.21.15.32:6823/3106482767","state":["exists","up"]},{"osd":3,"uuid":"11e127c4-f415-4261-9584-b53b7bfa8b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":76,"up_from":80,"up_thru":90,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6801","nonce":4072948236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6803","nonce":4072948236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6807","nonce":4072948236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4072948236},{"type":"v1","addr":"172.21.15.154:6805","nonce":4072948236}]},"public_addr":"172.21.15.154:6801/4072948236","cluster_addr":"172.21.15.154:6803/4072948236","heartbeat_back_addr":"172.21.15.154:6807/4072948236","heartbeat_front_addr":"172.21.15.154:6805/4072948236","state":["exists","up"]},{"osd":4,"uuid":"190cd663-20cb-49b3-84b0-345f665e068e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":81,"up_from":85,"up_thru":90,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6809","nonce":3787543137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6811","nonce":3787543137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6815","nonce":3787543137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3787543137},{"type":"v1","addr":"172.21.15.154:6813","nonce":3787543137}]},"public_addr":"172.21.15.154:6809/3787543137","cluster_addr":"172.21.15.154:6811/3787543137","heartbeat_back_addr":"172.21.15.154:6815/3787543137","heartbeat_front_addr":"172.21.15.154:6813/3787543137","state":["exists","up"]},{"osd":5,"uuid":"7655488e-f7b9-4902-b6d3-28f762d44a2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":86,"up_from":90,"up_thru":90,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6817","nonce":2230951688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6819","nonce":2230951688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6823","nonce":2230951688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2230951688},{"type":"v1","addr":"172.21.15.154:6821","nonce":2230951688}]},"public_addr":"172.21.15.154:6817/2230951688","cluster_addr":"172.21.15.154:6819/2230951688","heartbeat_back_addr":"172.21.15.154:6823/2230951688","heartbeat_front_addr":"172.21.15.154:6821/2230951688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:14.221856+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:20:43.419480+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:12.732797+0000","dead_epoch":71},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:21:36.574751+0000","dead_epoch":76},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:02.167660+0000","dead_epoch":81},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T21:22:28.497477+0000","dead_epoch":86}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":3,"to":2}]},{"pgid":"2.5","mappings":[{"from":0,"to":2}]},{"pgid":"2.12","mappings":[{"from":0,"to":5},{"from":3,"to":2}]},{"pgid":"2.19","mappings":[{"from":0,"to":1}]},{"pgid":"2.1d","mappings":[{"from":3,"to":1}]},{"pgid":"3.b","mappings":[{"from":4,"to":2}]},{"pgid":"3.14","mappings":[{"from":3,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6827/2609692046":"2024-05-07T21:34:37.439729+0000","172.21.15.154:6826/2609692046":"2024-05-07T21:34:37.439729+0000","172.21.15.32:6829/1302339589":"2024-05-07T21:33:59.176616+0000","172.21.15.32:6828/1302339589":"2024-05-07T21:33:59.176616+0000","172.21.15.32:0/1427527157":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/3371897316":"2024-05-07T21:28:20.593033+0000","172.21.15.32:6801/559791322":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/2104181876":"2024-05-07T21:17:45.720027+0000","172.21.15.154:6828/2671631515":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/314356654":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/928947970":"2024-05-07T21:26:04.755904+0000","172.21.15.32:0/2913247857":"2024-05-07T21:18:57.579578+0000","172.21.15.154:0/574866439":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/679753640":"2024-05-07T21:28:20.593033+0000","172.21.15.154:0/3827385640":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/2077354807":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6826/403692088":"2024-05-07T21:24:06.865368+0000","172.21.15.154:0/1347448701":"2024-05-07T21:27:14.287554+0000","172.21.15.32:6827/403692088":"2024-05-07T21:24:06.865368+0000","172.21.15.32:0/1723093349":"2024-05-07T21:18:57.579578+0000","172.21.15.32:0/2720610700":"2024-05-07T21:17:12.681477+0000","172.21.15.154:0/3762142095":"2024-05-07T21:27:14.287554+0000","172.21.15.154:6829/2671631515":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/1406133666":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/1230396006":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6801/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/3536478886":"2024-05-07T21:26:04.755904+0000","172.21.15.32:0/2992602151":"2024-05-07T21:28:20.593033+0000","172.21.15.154:0/3154197577":"2024-05-07T21:27:14.287554+0000","172.21.15.32:0/3688348585":"2024-05-07T21:26:04.755904+0000","172.21.15.32:0/1223764907":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/3609229440":"2024-05-07T21:17:45.720027+0000","172.21.15.32:6800/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6800/2162274499":"2024-05-07T21:26:04.755904+0000","172.21.15.154:0/2805675075":"2024-05-07T21:27:14.287554+0000","172.21.15.32:6801/2414450865":"2024-05-07T21:18:57.579578+0000","172.21.15.32:6801/2162274499":"2024-05-07T21:26:04.755904+0000","172.21.15.32:6801/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:0/3998200556":"2024-05-07T21:17:45.720027+0000","172.21.15.32:0/672629275":"2024-05-07T21:28:20.593033+0000","172.21.15.32:0/1033156191":"2024-05-07T21:26:04.755904+0000","172.21.15.32:6800/2729651169":"2024-05-07T21:17:12.681477+0000","172.21.15.32:6800/559791322":"2024-05-07T21:28:20.593033+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff18806e230 msgr2=0x7ff1880706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff18806e230 0x7ff1880706e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff18c036040 tx=0x7ff18c005fd0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c100710 msgr2=0x7ff19c195210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c100710 0x7ff19c195210 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c8a0 tx=0x7ff19800cd60 comp rx=0 tx=0).stop 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 shutdown_connections 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7ff18806e230 0x7ff1880706e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff19c101020 0x7ff19c195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 --2- 172.21.15.32:0/2716776911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c100710 0x7ff19c195210 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 >> 172.21.15.32:0/2716776911 conn(0x7ff19c075270 msgr2=0x7ff19c103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 shutdown_connections 2024-05-06T21:38:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.245+0000 7ff1a47d0640 1 -- 172.21.15.32:0/2716776911 wait complete. 2024-05-06T21:38:35.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-06T21:21:16.105413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-05-06T21:23:49.127155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-05-06T21:23:49.617433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-06T21:38:35.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-06T21:38:35.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.365+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/424541961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 msgr2=0x7fcf68067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.365+0000 7fcf6d5a2640 1 --2- 172.21.15.32:0/424541961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 0x7fcf68067760 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009880 tx=0x7fcf5c02bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.365+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/424541961 shutdown_connections 2024-05-06T21:38:35.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.365+0000 7fcf6d5a2640 1 --2- 172.21.15.32:0/424541961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 0x7fcf68067760 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.365+0000 7fcf6d5a2640 1 --2- 172.21.15.32:0/424541961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf681055c0 0x7fcf68105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.365+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/424541961 >> 172.21.15.32:0/424541961 conn(0x7fcf680743d0 msgr2=0x7fcf680747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:35.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.365+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/424541961 shutdown_connections 2024-05-06T21:38:35.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.365+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/424541961 wait complete. 2024-05-06T21:38:35.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf6d5a2640 1 Processor -- start 2024-05-06T21:38:35.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf6d5a2640 1 -- start start 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf6d5a2640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 0x7fcf68195140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf6d5a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf681055c0 0x7fcf68195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf6d5a2640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68195d10 con 0x7fcf68067310 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf6d5a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68199ae0 con 0x7fcf681055c0 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 0x7fcf68195140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf67fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 0x7fcf68195140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55468/0 (socket says 172.21.15.32:55468) 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf67fff640 1 -- 172.21.15.32:0/1140123685 learned_addr learned my addr 172.21.15.32:0/1140123685 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf677fe640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf681055c0 0x7fcf68195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf67fff640 1 -- 172.21.15.32:0/1140123685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf681055c0 msgr2=0x7fcf68195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf67fff640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf681055c0 0x7fcf68195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf67fff640 1 -- 172.21.15.32:0/1140123685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c009560 con 0x7fcf68067310 2024-05-06T21:38:35.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.366+0000 7fcf677fe640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf681055c0 0x7fcf68195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-06T21:38:35.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.367+0000 7fcf67fff640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 0x7fcf68195140 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800d6f0 tx=0x7fcf5800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:35.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.367+0000 7fcf657fa640 1 -- 172.21.15.32:0/1140123685 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf58009a30 con 0x7fcf68067310 2024-05-06T21:38:35.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.367+0000 7fcf657fa640 1 -- 172.21.15.32:0/1140123685 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf580054e0 con 0x7fcf68067310 2024-05-06T21:38:35.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.367+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf68199dc0 con 0x7fcf68067310 2024-05-06T21:38:35.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.367+0000 7fcf657fa640 1 -- 172.21.15.32:0/1140123685 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf58010460 con 0x7fcf68067310 2024-05-06T21:38:35.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.367+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6819a320 con 0x7fcf68067310 2024-05-06T21:38:35.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.368+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6804e000 con 0x7fcf68067310 2024-05-06T21:38:35.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.368+0000 7fcf657fa640 1 -- 172.21.15.32:0/1140123685 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcf58009b90 con 0x7fcf68067310 2024-05-06T21:38:35.364 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:35 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/5648474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-06T21:38:35.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:35 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3723400143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-06T21:38:35.365 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:35 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2458985240' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T21:38:35.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.369+0000 7fcf657fa640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcf5006e170 0x7fcf50070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.369+0000 7fcf657fa640 1 -- 172.21.15.32:0/1140123685 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7fcf5808de90 con 0x7fcf68067310 2024-05-06T21:38:35.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.369+0000 7fcf677fe640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcf5006e170 0x7fcf50070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.369+0000 7fcf677fe640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcf5006e170 0x7fcf50070620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c036040 tx=0x7fcf5c005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:35.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.373+0000 7fcf657fa640 1 -- 172.21.15.32:0/1140123685 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fcf58057010 con 0x7fcf68067310 2024-05-06T21:38:35.467 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:35 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/5648474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-06T21:38:35.467 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:35 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3723400143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-06T21:38:35.467 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:35 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2458985240' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T21:38:35.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.557+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf6810c720 con 0x7fcf68067310 2024-05-06T21:38:35.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.558+0000 7fcf657fa640 1 -- 172.21.15.32:0/1140123685 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf580170a0 con 0x7fcf68067310 2024-05-06T21:38:35.552 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcf5006e170 msgr2=0x7fcf50070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcf5006e170 0x7fcf50070620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c036040 tx=0x7fcf5c005fd0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 msgr2=0x7fcf68195140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 0x7fcf68195140 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800d6f0 tx=0x7fcf5800dbb0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 shutdown_connections 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7fcf5006e170 0x7fcf50070620 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf681055c0 0x7fcf68195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 --2- 172.21.15.32:0/1140123685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf68067310 0x7fcf68195140 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 >> 172.21.15.32:0/1140123685 conn(0x7fcf680743d0 msgr2=0x7fcf680fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 shutdown_connections 2024-05-06T21:38:35.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.560+0000 7fcf6d5a2640 1 -- 172.21.15.32:0/1140123685 wait complete. 2024-05-06T21:38:35.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.679+0000 7f100ae84640 1 -- 172.21.15.32:0/2216535062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 msgr2=0x7f1004100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.679+0000 7f100ae84640 1 --2- 172.21.15.32:0/2216535062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 0x7f1004100ef0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009880 tx=0x7f0ff402bd70 comp rx=0 tx=0).stop 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.679+0000 7f100ae84640 1 -- 172.21.15.32:0/2216535062 shutdown_connections 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.679+0000 7f100ae84640 1 --2- 172.21.15.32:0/2216535062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1004101430 0x7f1004109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.679+0000 7f100ae84640 1 --2- 172.21.15.32:0/2216535062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 0x7f1004100ef0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.679+0000 7f100ae84640 1 -- 172.21.15.32:0/2216535062 >> 172.21.15.32:0/2216535062 conn(0x7f10040fa2f0 msgr2=0x7f10040fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.679+0000 7f100ae84640 1 -- 172.21.15.32:0/2216535062 shutdown_connections 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.679+0000 7f100ae84640 1 -- 172.21.15.32:0/2216535062 wait complete. 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.680+0000 7f100ae84640 1 Processor -- start 2024-05-06T21:38:35.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.680+0000 7f100ae84640 1 -- start start 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.680+0000 7f100ae84640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 0x7f10040fe770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.680+0000 7f100ae84640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1004101430 0x7f10040fecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.680+0000 7f100ae84640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040ff1f0 con 0x7f1004100b20 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.680+0000 7f100ae84640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040ff360 con 0x7f1004101430 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.680+0000 7f1008c20640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 0x7f10040fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.680+0000 7f1008c20640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 0x7f10040fe770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55472/0 (socket says 172.21.15.32:55472) 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.680+0000 7f1008c20640 1 -- 172.21.15.32:0/2984703120 learned_addr learned my addr 172.21.15.32:0/2984703120 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f1003fff640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1004101430 0x7f10040fecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f1008c20640 1 -- 172.21.15.32:0/2984703120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1004101430 msgr2=0x7f10040fecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f1008c20640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1004101430 0x7f10040fecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f1008c20640 1 -- 172.21.15.32:0/2984703120 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4009560 con 0x7f1004100b20 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f1008c20640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 0x7f10040fe770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009230 tx=0x7f0ff4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f1001ffb640 1 -- 172.21.15.32:0/2984703120 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff40037c0 con 0x7f1004100b20 2024-05-06T21:38:35.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10040ff580 con 0x7f1004100b20 2024-05-06T21:38:35.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f1001ffb640 1 -- 172.21.15.32:0/2984703120 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ff4004aa0 con 0x7f1004100b20 2024-05-06T21:38:35.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f1001ffb640 1 -- 172.21.15.32:0/2984703120 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff403e450 con 0x7f1004100b20 2024-05-06T21:38:35.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.681+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10041a1b90 con 0x7f1004100b20 2024-05-06T21:38:35.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.682+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100404e000 con 0x7f1004100b20 2024-05-06T21:38:35.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.683+0000 7f1001ffb640 1 -- 172.21.15.32:0/2984703120 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0ff4005060 con 0x7f1004100b20 2024-05-06T21:38:35.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.683+0000 7f1001ffb640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0fec06e170 0x7f0fec070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.683+0000 7f1001ffb640 1 -- 172.21.15.32:0/2984703120 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f0ff40b1180 con 0x7f1004100b20 2024-05-06T21:38:35.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.683+0000 7f1003fff640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0fec06e170 0x7f0fec070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.684+0000 7f1003fff640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0fec06e170 0x7f0fec070620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f10040fff60 tx=0x7f0ff8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:35.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.688+0000 7f1001ffb640 1 -- 172.21.15.32:0/2984703120 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0ff407a300 con 0x7f1004100b20 2024-05-06T21:38:35.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.871+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1004066860 con 0x7f1004100b20 2024-05-06T21:38:35.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.872+0000 7f1001ffb640 1 -- 172.21.15.32:0/2984703120 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0ff407d9c0 con 0x7f1004100b20 2024-05-06T21:38:35.866 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-05-06T21:38:35.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0fec06e170 msgr2=0x7f0fec070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0fec06e170 0x7f0fec070620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f10040fff60 tx=0x7f0ff8008040 comp rx=0 tx=0).stop 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 msgr2=0x7f10040fe770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 0x7f10040fe770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009230 tx=0x7f0ff4004270 comp rx=0 tx=0).stop 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 shutdown_connections 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f0fec06e170 0x7f0fec070620 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1004101430 0x7f10040fecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 --2- 172.21.15.32:0/2984703120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1004100b20 0x7f10040fe770 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 >> 172.21.15.32:0/2984703120 conn(0x7f10040fa2f0 msgr2=0x7f1004104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 shutdown_connections 2024-05-06T21:38:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.874+0000 7f100ae84640 1 -- 172.21.15.32:0/2984703120 wait complete. 2024-05-06T21:38:35.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-05-06T21:38:35.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.992+0000 7f5d91f55640 1 -- 172.21.15.32:0/585086580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 msgr2=0x7f5d8c104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.992+0000 7f5d91f55640 1 --2- 172.21.15.32:0/585086580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 0x7f5d8c104bd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009880 tx=0x7f5d7c02bce0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.992+0000 7f5d91f55640 1 -- 172.21.15.32:0/585086580 shutdown_connections 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.992+0000 7f5d91f55640 1 --2- 172.21.15.32:0/585086580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c0fe7f0 0x7f5d8c0fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.992+0000 7f5d91f55640 1 --2- 172.21.15.32:0/585086580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 0x7f5d8c104bd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.992+0000 7f5d91f55640 1 -- 172.21.15.32:0/585086580 >> 172.21.15.32:0/585086580 conn(0x7f5d8c0fa2f0 msgr2=0x7f5d8c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.992+0000 7f5d91f55640 1 -- 172.21.15.32:0/585086580 shutdown_connections 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.992+0000 7f5d91f55640 1 -- 172.21.15.32:0/585086580 wait complete. 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d91f55640 1 Processor -- start 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d91f55640 1 -- start start 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d91f55640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c0fe7f0 0x7f5d8c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d91f55640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 0x7f5d8c196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d91f55640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c196f60 con 0x7f5d8c104800 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d91f55640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c1970d0 con 0x7f5d8c0fe7f0 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d83fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 0x7f5d8c196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d83fff640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 0x7f5d8c196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55492/0 (socket says 172.21.15.32:55492) 2024-05-06T21:38:35.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d83fff640 1 -- 172.21.15.32:0/3277219214 learned_addr learned my addr 172.21.15.32:0/3277219214 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:35.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d83fff640 1 -- 172.21.15.32:0/3277219214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c0fe7f0 msgr2=0x7f5d8c196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:35.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d83fff640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c0fe7f0 0x7f5d8c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:35.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.993+0000 7f5d83fff640 1 -- 172.21.15.32:0/3277219214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c009560 con 0x7f5d8c104800 2024-05-06T21:38:35.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.994+0000 7f5d83fff640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 0x7f5d8c196990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400b420 tx=0x7f5d7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:35.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.994+0000 7f5d897fa640 1 -- 172.21.15.32:0/3277219214 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d74011800 con 0x7f5d8c104800 2024-05-06T21:38:35.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.994+0000 7f5d897fa640 1 -- 172.21.15.32:0/3277219214 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d74011e20 con 0x7f5d8c104800 2024-05-06T21:38:35.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.994+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c19f4c0 con 0x7f5d8c104800 2024-05-06T21:38:35.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.994+0000 7f5d897fa640 1 -- 172.21.15.32:0/3277219214 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d7400f2e0 con 0x7f5d8c104800 2024-05-06T21:38:35.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.994+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c19f9f0 con 0x7f5d8c104800 2024-05-06T21:38:35.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.995+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c04e000 con 0x7f5d8c104800 2024-05-06T21:38:35.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.995+0000 7f5d897fa640 1 -- 172.21.15.32:0/3277219214 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5d74010380 con 0x7f5d8c104800 2024-05-06T21:38:35.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.996+0000 7f5d897fa640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5d7806e170 0x7f5d78070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:35.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.996+0000 7f5d897fa640 1 -- 172.21.15.32:0/3277219214 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7f5d7408dc50 con 0x7f5d8c104800 2024-05-06T21:38:35.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.996+0000 7f5d8b7fe640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5d7806e170 0x7f5d78070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:35.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:35.996+0000 7f5d8b7fe640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5d7806e170 0x7f5d78070620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c02efd0 tx=0x7f5d7c000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:35.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.000+0000 7f5d897fa640 1 -- 172.21.15.32:0/3277219214 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5d74056dd0 con 0x7f5d8c104800 2024-05-06T21:38:36.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.184+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f5d8c106cd0 con 0x7f5d8c104800 2024-05-06T21:38:36.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.184+0000 7f5d897fa640 1 -- 172.21.15.32:0/3277219214 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7f5d7405a490 con 0x7f5d8c104800 2024-05-06T21:38:36.179 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5d7806e170 msgr2=0x7f5d78070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5d7806e170 0x7f5d78070620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c02efd0 tx=0x7f5d7c000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 msgr2=0x7f5d8c196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 0x7f5d8c196990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400b420 tx=0x7f5d7400b8e0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 shutdown_connections 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7f5d7806e170 0x7f5d78070620 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d8c104800 0x7f5d8c196990 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 --2- 172.21.15.32:0/3277219214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c0fe7f0 0x7f5d8c196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 >> 172.21.15.32:0/3277219214 conn(0x7f5d8c0fa2f0 msgr2=0x7f5d8c0fbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 shutdown_connections 2024-05-06T21:38:36.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.186+0000 7f5d91f55640 1 -- 172.21.15.32:0/3277219214 wait complete. 2024-05-06T21:38:36.191 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:36 smithi032 ceph-mon[76650]: pgmap v355: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:36.191 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:36 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2716776911' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:38:36.191 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:36 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/1140123685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:38:36.191 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:36 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:38:36.191 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:36 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/2984703120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-06T21:38:36.192 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-06T21:38:36.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 -- 172.21.15.32:0/3939442878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc101160 msgr2=0x7efccc109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:36.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 --2- 172.21.15.32:0/3939442878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc101160 0x7efccc109650 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efcb40098b0 tx=0x7efcb402bd60 comp rx=0 tx=0).stop 2024-05-06T21:38:36.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 -- 172.21.15.32:0/3939442878 shutdown_connections 2024-05-06T21:38:36.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 --2- 172.21.15.32:0/3939442878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc101160 0x7efccc109650 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 --2- 172.21.15.32:0/3939442878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efccc100850 0x7efccc100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 -- 172.21.15.32:0/3939442878 >> 172.21.15.32:0/3939442878 conn(0x7efccc075270 msgr2=0x7efccc075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:36.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 -- 172.21.15.32:0/3939442878 shutdown_connections 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 -- 172.21.15.32:0/3939442878 wait complete. 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 Processor -- start 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 -- start start 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.303+0000 7efcd18b9640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc100850 0x7efccc195320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efcd18b9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efccc101160 0x7efccc195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efcd18b9640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc195ef0 con 0x7efccc100850 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efcd18b9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc199cc0 con 0x7efccc101160 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efccaffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc100850 0x7efccc195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efccaffd640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc100850 0x7efccc195320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55518/0 (socket says 172.21.15.32:55518) 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efccaffd640 1 -- 172.21.15.32:0/22406457 learned_addr learned my addr 172.21.15.32:0/22406457 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efccaffd640 1 -- 172.21.15.32:0/22406457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efccc101160 msgr2=0x7efccc195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efccaffd640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efccc101160 0x7efccc195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efccaffd640 1 -- 172.21.15.32:0/22406457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4009560 con 0x7efccc100850 2024-05-06T21:38:36.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efccaffd640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc100850 0x7efccc195320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00b420 tx=0x7efcbc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:36.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efcd08b7640 1 -- 172.21.15.32:0/22406457 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcbc011800 con 0x7efccc100850 2024-05-06T21:38:36.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc199fa0 con 0x7efccc100850 2024-05-06T21:38:36.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efcd08b7640 1 -- 172.21.15.32:0/22406457 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcbc011e20 con 0x7efccc100850 2024-05-06T21:38:36.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efcd08b7640 1 -- 172.21.15.32:0/22406457 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcbc00f2e0 con 0x7efccc100850 2024-05-06T21:38:36.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.304+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc19a500 con 0x7efccc100850 2024-05-06T21:38:36.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.305+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc04e000 con 0x7efccc100850 2024-05-06T21:38:36.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.306+0000 7efcd08b7640 1 -- 172.21.15.32:0/22406457 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efcbc010380 con 0x7efccc100850 2024-05-06T21:38:36.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.306+0000 7efcd08b7640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7efcb806e230 0x7efcb80706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-06T21:38:36.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.306+0000 7efcd08b7640 1 -- 172.21.15.32:0/22406457 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6941+0+0 (secure 0 0 0) 0x7efcbc08dc50 con 0x7efccc100850 2024-05-06T21:38:36.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.306+0000 7efcc3fff640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7efcb806e230 0x7efcb80706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-06T21:38:36.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.307+0000 7efcc3fff640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7efcb806e230 0x7efcb80706e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efcb4036040 tx=0x7efcb4000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-06T21:38:36.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.311+0000 7efcd08b7640 1 -- 172.21.15.32:0/22406457 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7efcbc056dd0 con 0x7efccc100850 2024-05-06T21:38:36.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:36 smithi154 ceph-mon[63622]: pgmap v355: 65 pgs: 65 active+clean; 174 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-05-06T21:38:36.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:36 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2716776911' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T21:38:36.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:36 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/1140123685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T21:38:36.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:36 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T21:38:36.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:36 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/2984703120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-06T21:38:36.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.508+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efccc10c8e0 con 0x7efccc100850 2024-05-06T21:38:36.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.508+0000 7efcd08b7640 1 -- 172.21.15.32:0/22406457 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v95) v1 ==== 81+0+2549 (secure 0 0 0) 0x7efcbc05a490 con 0x7efccc100850 2024-05-06T21:38:36.503 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:6827/2609692046 2024-05-07T21:34:37.439729+0000 2024-05-06T21:38:36.503 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:6826/2609692046 2024-05-07T21:34:37.439729+0000 2024-05-06T21:38:36.503 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6829/1302339589 2024-05-07T21:33:59.176616+0000 2024-05-06T21:38:36.503 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6828/1302339589 2024-05-07T21:33:59.176616+0000 2024-05-06T21:38:36.503 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1427527157 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/3371897316 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/559791322 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2104181876 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:6828/2671631515 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/314356654 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/928947970 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2913247857 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/574866439 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/679753640 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/3827385640 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2077354807 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6826/403692088 2024-05-07T21:24:06.865368+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/1347448701 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:36.504 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6827/403692088 2024-05-07T21:24:06.865368+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1723093349 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2720610700 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/3762142095 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:6829/2671631515 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1406133666 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1230396006 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/3609229440 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/3536478886 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/2992602151 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/3154197577 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/3688348585 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1223764907 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/3609229440 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:36.505 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/2414450865 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/2162274499 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.154:0/2805675075 2024-05-07T21:27:14.287554+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/2414450865 2024-05-07T21:18:57.579578+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/2162274499 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6801/2729651169 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/3998200556 2024-05-07T21:17:45.720027+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/672629275 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:0/1033156191 2024-05-07T21:26:04.755904+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/2729651169 2024-05-07T21:17:12.681477+0000 2024-05-06T21:38:36.506 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32:6800/559791322 2024-05-07T21:28:20.593033+0000 2024-05-06T21:38:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:listed 43 entries 2024-05-06T21:38:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7efcb806e230 msgr2=0x7efcb80706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7efcb806e230 0x7efcb80706e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efcb4036040 tx=0x7efcb4000bc0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc100850 msgr2=0x7efccc195320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T21:38:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc100850 0x7efccc195320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00b420 tx=0x7efcbc00b8e0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 shutdown_connections 2024-05-06T21:38:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:6800/2910360300,v1:172.21.15.32:6801/2910360300] conn(0x7efcb806e230 0x7efcb80706e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efccc101160 0x7efccc195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 --2- 172.21.15.32:0/22406457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efccc100850 0x7efccc195320 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-06T21:38:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 >> 172.21.15.32:0/22406457 conn(0x7efccc075270 msgr2=0x7efccc103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T21:38:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 shutdown_connections 2024-05-06T21:38:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-06T21:38:36.510+0000 7efcd18b9640 1 -- 172.21.15.32:0/22406457 wait complete. 2024-05-06T21:38:36.516 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-06T21:38:36.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:36.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-06T21:38:36.551 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-05-06T21:38:36.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:36.551 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-06T21:38:36.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:36.622 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-05-06T21:38:36.639 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-06T21:38:36.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:36.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-06T21:38:36.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:36.707 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-05-06T21:38:36.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:36.811 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-05-06T21:38:36.828 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-06T21:38:36.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:36.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-06T21:38:36.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-06T21:38:36.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-05-06T21:38:36.985 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-06T21:38:37.000 INFO:tasks.cephadm:Teardown begin 2024-05-06T21:38:37.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T21:38:37.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T21:38:37.055 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-06T21:38:37.055 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-06T21:38:37.084 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-06T21:38:37.110 INFO:tasks.cephadm:Stopping all daemons... 2024-05-06T21:38:37.110 INFO:tasks.cephadm.mon.smithi032:Stopping mon.smithi032... 2024-05-06T21:38:37.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032 2024-05-06T21:38:37.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:37 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/3277219214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-06T21:38:37.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:37 smithi154 ceph-mon[63622]: from='client.? 172.21.15.32:0/22406457' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T21:38:37.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:37 smithi154 ceph-mon[63622]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:38:37.453 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:37 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/3277219214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-06T21:38:37.453 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:37 smithi032 ceph-mon[76650]: from='client.? 172.21.15.32:0/22406457' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T21:38:37.453 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:37 smithi032 ceph-mon[76650]: from='mgr.34104 172.21.15.32:0/1385386544' entity='mgr.smithi032.ecoohh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T21:38:37.453 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:37 smithi032 systemd[1]: Stopping Ceph mon.smithi032 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:38:37.717 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:37 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032[76641]: 2024-05-06T21:38:37.457+0000 7f60cc560700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi032 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:38:37.717 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:37 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032[76641]: 2024-05-06T21:38:37.457+0000 7f60cc560700 -1 mon.smithi032@0(leader) e3 *** Got Signal Terminated *** 2024-05-06T21:38:37.718 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:37 smithi032 podman[128173]: 2024-05-06 21:38:37.6314292 +0000 UTC m=+0.278018279 container died 6db9bd569f47ffa7da1fb144ef9da907e3fa8daa2fd9ed1cb5c94f4f0630317a (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-06T21:38:38.561 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:38 smithi032 podman[128173]: 2024-05-06 21:38:38.299803873 +0000 UTC m=+0.946392991 container cleanup 6db9bd569f47ffa7da1fb144ef9da907e3fa8daa2fd9ed1cb5c94f4f0630317a (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:38:38.561 INFO:journalctl@ceph.mon.smithi032.smithi032.stdout:May 06 21:38:38 smithi032 bash[128173]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi032 2024-05-06T21:38:38.739 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi032.service' 2024-05-06T21:38:38.792 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T21:38:38.793 INFO:tasks.cephadm.mon.smithi032:Stopped mon.smithi032 2024-05-06T21:38:38.793 INFO:tasks.cephadm.mon.smithi154:Stopping mon.smithi154... 2024-05-06T21:38:38.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi154 2024-05-06T21:38:39.088 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:38 smithi154 systemd[1]: Stopping Ceph mon.smithi154 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:38:39.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:39 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154[63618]: 2024-05-06T21:38:39.093+0000 7ff577057700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi154 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:38:39.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:39 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154[63618]: 2024-05-06T21:38:39.093+0000 7ff577057700 -1 mon.smithi154@1(peon) e3 *** Got Signal Terminated *** 2024-05-06T21:38:39.362 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:39 smithi154 podman[93507]: 2024-05-06 21:38:39.338498327 +0000 UTC m=+0.344094462 container died 88f330a92df2921a27f4a34198fdda2864150239453928c8a75e226c8dc4a75b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0) 2024-05-06T21:38:39.862 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:39 smithi154 podman[93507]: 2024-05-06 21:38:39.79435663 +0000 UTC m=+0.799952769 container cleanup 88f330a92df2921a27f4a34198fdda2864150239453928c8a75e226c8dc4a75b (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-06T21:38:39.862 INFO:journalctl@ceph.mon.smithi154.smithi154.stdout:May 06 21:38:39 smithi154 bash[93507]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-mon-smithi154 2024-05-06T21:38:40.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@mon.smithi154.service' 2024-05-06T21:38:40.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T21:38:40.267 INFO:tasks.cephadm.mon.smithi154:Stopped mon.smithi154 2024-05-06T21:38:40.267 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-06T21:38:40.267 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.0 2024-05-06T21:38:40.581 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:40 smithi032 systemd[1]: Stopping Ceph osd.0 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:38:40.967 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:40 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[83179]: 2024-05-06T21:38:40.586+0000 7fceb7712700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:38:40.968 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:40 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[83179]: 2024-05-06T21:38:40.586+0000 7fceb7712700 -1 osd.0 95 *** Got signal Terminated *** 2024-05-06T21:38:40.968 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:40 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0[83179]: 2024-05-06T21:38:40.586+0000 7fceb7712700 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:38:46.398 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:46 smithi032 podman[128371]: 2024-05-06 21:38:46.134243458 +0000 UTC m=+5.660991159 container died d318ebed8be1d4592248135c049ff54e3062e20932aa67d8c210c8567c9aa78f (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-06T21:38:46.718 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:46 smithi032 podman[128371]: 2024-05-06 21:38:46.629325889 +0000 UTC m=+6.156073644 container cleanup d318ebed8be1d4592248135c049ff54e3062e20932aa67d8c210c8567c9aa78f (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-05-06T21:38:46.718 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:46 smithi032 bash[128371]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0 2024-05-06T21:38:47.217 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:46 smithi032 podman[128388]: 2024-05-06 21:38:46.914419742 +0000 UTC m=+0.776797511 container remove d318ebed8be1d4592248135c049ff54e3062e20932aa67d8c210c8567c9aa78f (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240430, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-06T21:38:47.578 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:47 smithi032 podman[128480]: 2024-05-06 21:38:47.256956992 +0000 UTC m=+0.109589219 container create 4e0c23022b2c4370181470adc3a774474cec6866ed765cc57757f51d5b647bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-06T21:38:47.578 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:47 smithi032 podman[128480]: 2024-05-06 21:38:47.166805805 +0000 UTC m=+0.019438002 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:38:47.578 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:47 smithi032 podman[128480]: 2024-05-06 21:38:47.484411353 +0000 UTC m=+0.337043537 container init 4e0c23022b2c4370181470adc3a774474cec6866ed765cc57757f51d5b647bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-05-06T21:38:47.578 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:47 smithi032 podman[128480]: 2024-05-06 21:38:47.488189459 +0000 UTC m=+0.340821640 container start 4e0c23022b2c4370181470adc3a774474cec6866ed765cc57757f51d5b647bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:38:47.578 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:47 smithi032 podman[128480]: 2024-05-06 21:38:47.584290313 +0000 UTC m=+0.436922504 container attach 4e0c23022b2c4370181470adc3a774474cec6866ed765cc57757f51d5b647bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:38:47.967 INFO:journalctl@ceph.osd.0.smithi032.stdout:May 06 21:38:47 smithi032 podman[128480]: 2024-05-06 21:38:47.791390711 +0000 UTC m=+0.644022895 container died 4e0c23022b2c4370181470adc3a774474cec6866ed765cc57757f51d5b647bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-06T21:38:48.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.0.service' 2024-05-06T21:38:48.446 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T21:38:48.447 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-06T21:38:48.447 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-06T21:38:48.447 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.1 2024-05-06T21:38:48.673 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:48 smithi032 systemd[1]: Stopping Ceph osd.1 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:38:48.967 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:48 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[86504]: 2024-05-06T21:38:48.808+0000 7f9e730c2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:38:48.967 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:48 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[86504]: 2024-05-06T21:38:48.808+0000 7f9e730c2700 -1 osd.1 95 *** Got signal Terminated *** 2024-05-06T21:38:48.967 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:48 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1[86504]: 2024-05-06T21:38:48.808+0000 7f9e730c2700 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:38:54.445 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:54 smithi032 podman[128586]: 2024-05-06 21:38:54.152972951 +0000 UTC m=+5.470717138 container died 00a59b6189e52acadf0029424fc7f8150b03a6c908c40b9abd28b68843e61220 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-06T21:38:54.717 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:54 smithi032 podman[128586]: 2024-05-06 21:38:54.649943478 +0000 UTC m=+5.967687717 container cleanup 00a59b6189e52acadf0029424fc7f8150b03a6c908c40b9abd28b68843e61220 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:38:54.717 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:54 smithi032 bash[128586]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1 2024-05-06T21:38:55.217 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:54 smithi032 podman[128617]: 2024-05-06 21:38:54.926338342 +0000 UTC m=+0.764107165 container remove 00a59b6189e52acadf0029424fc7f8150b03a6c908c40b9abd28b68843e61220 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-05-06T21:38:55.528 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:55 smithi032 podman[128710]: 2024-05-06 21:38:55.18531488 +0000 UTC m=+0.018465613 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:38:55.528 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:55 smithi032 podman[128710]: 2024-05-06 21:38:55.285464426 +0000 UTC m=+0.118615148 container create c8db5f6a0a6a40ecb0be8d2f1535c95da73ef662c06079bd858428218b7b170e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T21:38:55.528 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:55 smithi032 podman[128710]: 2024-05-06 21:38:55.52995355 +0000 UTC m=+0.363104272 container init c8db5f6a0a6a40ecb0be8d2f1535c95da73ef662c06079bd858428218b7b170e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-06T21:38:55.529 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:55 smithi032 podman[128710]: 2024-05-06 21:38:55.533644275 +0000 UTC m=+0.366795006 container start c8db5f6a0a6a40ecb0be8d2f1535c95da73ef662c06079bd858428218b7b170e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:38:55.829 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:55 smithi032 podman[128710]: 2024-05-06 21:38:55.638562237 +0000 UTC m=+0.471712967 container attach c8db5f6a0a6a40ecb0be8d2f1535c95da73ef662c06079bd858428218b7b170e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-05-06T21:38:56.177 INFO:journalctl@ceph.osd.1.smithi032.stdout:May 06 21:38:55 smithi032 podman[128710]: 2024-05-06 21:38:55.835998955 +0000 UTC m=+0.669149676 container died c8db5f6a0a6a40ecb0be8d2f1535c95da73ef662c06079bd858428218b7b170e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-06T21:38:56.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.1.service' 2024-05-06T21:38:56.635 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T21:38:56.635 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-06T21:38:56.635 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-06T21:38:56.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.2 2024-05-06T21:38:56.931 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:38:56 smithi032 systemd[1]: Stopping Ceph osd.2 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:38:57.217 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:38:56 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[89793]: 2024-05-06T21:38:56.936+0000 7f9b4e5c2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:38:57.217 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:38:56 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[89793]: 2024-05-06T21:38:56.936+0000 7f9b4e5c2700 -1 osd.2 95 *** Got signal Terminated *** 2024-05-06T21:38:57.217 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:38:56 smithi032 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2[89793]: 2024-05-06T21:38:56.936+0000 7f9b4e5c2700 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:39:02.541 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:02 smithi032 podman[128815]: 2024-05-06 21:39:02.253667995 +0000 UTC m=+5.411727765 container died 96de1dd57d1352f18c368217cef96190e99b5011e56a9eedc610bd8435aaf5f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-06T21:39:02.824 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:02 smithi032 podman[128815]: 2024-05-06 21:39:02.762217993 +0000 UTC m=+5.920277775 container cleanup 96de1dd57d1352f18c368217cef96190e99b5011e56a9eedc610bd8435aaf5f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-06T21:39:02.825 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:02 smithi032 bash[128815]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2 2024-05-06T21:39:03.392 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:03 smithi032 podman[128832]: 2024-05-06 21:39:03.088762868 +0000 UTC m=+0.830898430 container remove 96de1dd57d1352f18c368217cef96190e99b5011e56a9eedc610bd8435aaf5f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:39:03.686 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:03 smithi032 podman[128919]: 2024-05-06 21:39:03.305219327 +0000 UTC m=+0.020289468 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:39:03.686 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:03 smithi032 podman[128919]: 2024-05-06 21:39:03.456472703 +0000 UTC m=+0.171542825 container create 004cd9c3059341475cfd90ea3489a7eaa717c895fb9ae5a6bc35e44da6ae7434 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T21:39:03.686 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:03 smithi032 podman[128919]: 2024-05-06 21:39:03.692412549 +0000 UTC m=+0.407482681 container init 004cd9c3059341475cfd90ea3489a7eaa717c895fb9ae5a6bc35e44da6ae7434 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:39:03.967 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:03 smithi032 podman[128919]: 2024-05-06 21:39:03.696006574 +0000 UTC m=+0.411076697 container start 004cd9c3059341475cfd90ea3489a7eaa717c895fb9ae5a6bc35e44da6ae7434 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS) 2024-05-06T21:39:03.968 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:03 smithi032 podman[128919]: 2024-05-06 21:39:03.78395886 +0000 UTC m=+0.499028994 container attach 004cd9c3059341475cfd90ea3489a7eaa717c895fb9ae5a6bc35e44da6ae7434 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=) 2024-05-06T21:39:04.453 INFO:journalctl@ceph.osd.2.smithi032.stdout:May 06 21:39:04 smithi032 podman[128919]: 2024-05-06 21:39:04.011550176 +0000 UTC m=+0.726620299 container died 004cd9c3059341475cfd90ea3489a7eaa717c895fb9ae5a6bc35e44da6ae7434 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430) 2024-05-06T21:39:04.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.2.service' 2024-05-06T21:39:04.686 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T21:39:04.686 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-06T21:39:04.686 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-06T21:39:04.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.3 2024-05-06T21:39:05.066 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:04 smithi154 systemd[1]: Stopping Ceph osd.3 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:39:05.362 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:05 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:39:05.071+0000 7fbe81ebb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:39:05.362 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:05 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:39:05.071+0000 7fbe81ebb700 -1 osd.3 95 *** Got signal Terminated *** 2024-05-06T21:39:05.362 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:05 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:39:05.071+0000 7fbe81ebb700 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:39:07.362 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:06 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:06.973+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:08.112 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:07 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:39:07.932+0000 7fbe7ecb0700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:42.405021+0000 front 2024-05-06T21:38:42.405103+0000 (oldest deadline 2024-05-06T21:39:07.105170+0000) 2024-05-06T21:39:08.112 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:07 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:07.926+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:08.612 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:08 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:08.140+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:09.362 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:09 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:09.111+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:09.362 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:08 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:39:08.933+0000 7fbe7ecb0700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:42.405021+0000 front 2024-05-06T21:38:42.405103+0000 (oldest deadline 2024-05-06T21:39:07.105170+0000) 2024-05-06T21:39:09.363 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:08 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:08.944+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:10.362 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:10 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:10.102+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:10.362 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:09 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3[68859]: 2024-05-06T21:39:09.931+0000 7fbe7ecb0700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:42.405021+0000 front 2024-05-06T21:38:42.405103+0000 (oldest deadline 2024-05-06T21:39:07.105170+0000) 2024-05-06T21:39:10.363 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:09 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:09.956+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:10.808 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:10 smithi154 podman[93630]: 2024-05-06 21:39:10.546110649 +0000 UTC m=+5.657261064 container died 5cc938cf75ad15dcb00ecd076fa8a658246949f8a2d0a4070ab56b7f4e394ccc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-06T21:39:11.100 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:10 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:10.990+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:11.101 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:10 smithi154 podman[93630]: 2024-05-06 21:39:10.905118872 +0000 UTC m=+6.016269280 container cleanup 5cc938cf75ad15dcb00ecd076fa8a658246949f8a2d0a4070ab56b7f4e394ccc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430) 2024-05-06T21:39:11.101 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:10 smithi154 bash[93630]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3 2024-05-06T21:39:11.362 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:11 smithi154 podman[93647]: 2024-05-06 21:39:11.18972014 +0000 UTC m=+0.636343774 container remove 5cc938cf75ad15dcb00ecd076fa8a658246949f8a2d0a4070ab56b7f4e394ccc (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240430) 2024-05-06T21:39:11.362 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:11 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:11.106+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:11.787 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:11 smithi154 podman[93736]: 2024-05-06 21:39:11.433138517 +0000 UTC m=+0.018622082 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:39:11.787 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:11 smithi154 podman[93736]: 2024-05-06 21:39:11.532155894 +0000 UTC m=+0.117639442 container create 82b92a0508b5458dac75be85509c194f5e87c44602f984b386e89b61017233d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.build-date=20240430, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T21:39:11.787 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:11 smithi154 podman[93736]: 2024-05-06 21:39:11.793496204 +0000 UTC m=+0.378979758 container init 82b92a0508b5458dac75be85509c194f5e87c44602f984b386e89b61017233d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-06T21:39:12.086 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:11 smithi154 podman[93736]: 2024-05-06 21:39:11.796878009 +0000 UTC m=+0.382361561 container start 82b92a0508b5458dac75be85509c194f5e87c44602f984b386e89b61017233d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:39:12.087 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:11 smithi154 podman[93736]: 2024-05-06 21:39:11.918735794 +0000 UTC m=+0.504219359 container attach 82b92a0508b5458dac75be85509c194f5e87c44602f984b386e89b61017233d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True) 2024-05-06T21:39:12.087 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:12 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:12.032+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:12.356 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:12 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:12.102+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:12.356 INFO:journalctl@ceph.osd.3.smithi154.stdout:May 06 21:39:12 smithi154 podman[93736]: 2024-05-06 21:39:12.093690128 +0000 UTC m=+0.679173677 container died 82b92a0508b5458dac75be85509c194f5e87c44602f984b386e89b61017233d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-06T21:39:12.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.3.service' 2024-05-06T21:39:12.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T21:39:12.788 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-06T21:39:12.788 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-06T21:39:12.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.4 2024-05-06T21:39:13.076 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:12 smithi154 systemd[1]: Stopping Ceph osd.4 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:39:13.327 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:13 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:13.101+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:13.327 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:13 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:13.158+0000 7fbae0e4a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:39:13.327 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:13 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:13.158+0000 7fbae0e4a700 -1 osd.4 95 *** Got signal Terminated *** 2024-05-06T21:39:13.327 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:13 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:13.158+0000 7fbae0e4a700 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:39:13.328 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:13 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:13.081+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:14.362 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:14 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:14.108+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:14.362 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:14 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:14.032+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:15.362 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:15 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:15.061+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:15.362 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:15 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:15.024+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:16.362 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:16 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:16.074+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:16.362 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:16 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:16.061+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:16.362 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:16 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:16.061+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:17.362 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:17 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:17.043+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:17.362 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:17 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:17.075+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:17.362 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:17 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:17.075+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:18.362 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:18 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4[71738]: 2024-05-06T21:39:18.047+0000 7fbad9c37700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:45.550760+0000 front 2024-05-06T21:38:45.550772+0000 (oldest deadline 2024-05-06T21:39:07.850751+0000) 2024-05-06T21:39:18.363 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:18 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:18.110+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:18.363 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:18 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:18.110+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:18.862 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:18 smithi154 podman[93853]: 2024-05-06 21:39:18.602370693 +0000 UTC m=+5.574388469 container died 75a59e4cc4c7288177cb552ec5872aac7aef6292d5739cdd3e2a6cc064808cae (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T21:39:19.156 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:18 smithi154 podman[93853]: 2024-05-06 21:39:18.952901409 +0000 UTC m=+5.924919219 container cleanup 75a59e4cc4c7288177cb552ec5872aac7aef6292d5739cdd3e2a6cc064808cae (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:39:19.156 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:18 smithi154 bash[93853]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4 2024-05-06T21:39:19.156 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:19 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:19.124+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:19.156 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:19 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:19.124+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:19.572 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:19 smithi154 podman[93871]: 2024-05-06 21:39:19.162473474 +0000 UTC m=+0.550126485 container remove 75a59e4cc4c7288177cb552ec5872aac7aef6292d5739cdd3e2a6cc064808cae (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489) 2024-05-06T21:39:19.862 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:19 smithi154 podman[93959]: 2024-05-06 21:39:19.481548068 +0000 UTC m=+0.018420890 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:39:19.862 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:19 smithi154 podman[93959]: 2024-05-06 21:39:19.588269051 +0000 UTC m=+0.125141888 container create 8593a610731d280c9e35ae82c62c76444430a35ece35cc39df4ca4b0570a9bc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T21:39:19.862 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:19 smithi154 podman[93959]: 2024-05-06 21:39:19.815786836 +0000 UTC m=+0.352659637 container init 8593a610731d280c9e35ae82c62c76444430a35ece35cc39df4ca4b0570a9bc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-06T21:39:19.862 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:19 smithi154 podman[93959]: 2024-05-06 21:39:19.819098911 +0000 UTC m=+0.355971708 container start 8593a610731d280c9e35ae82c62c76444430a35ece35cc39df4ca4b0570a9bc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430) 2024-05-06T21:39:20.166 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:19 smithi154 podman[93959]: 2024-05-06 21:39:19.89896563 +0000 UTC m=+0.435838427 container attach 8593a610731d280c9e35ae82c62c76444430a35ece35cc39df4ca4b0570a9bc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-05-06T21:39:20.166 INFO:journalctl@ceph.osd.4.smithi154.stdout:May 06 21:39:20 smithi154 podman[93959]: 2024-05-06 21:39:20.110682952 +0000 UTC m=+0.647555763 container died 8593a610731d280c9e35ae82c62c76444430a35ece35cc39df4ca4b0570a9bc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T21:39:20.416 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:20 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:20.172+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:20.417 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:20 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:20.172+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:20.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.4.service' 2024-05-06T21:39:20.805 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T21:39:20.806 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-06T21:39:20.806 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-06T21:39:20.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.5 2024-05-06T21:39:21.112 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:20 smithi154 systemd[1]: Stopping Ceph osd.5 for d155ff30-0bed-11ef-bc97-c7b262605968... 2024-05-06T21:39:21.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:21 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:21.134+0000 7f3846588700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T21:39:21.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:21 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:21.134+0000 7f3846588700 -1 osd.5 95 *** Got signal Terminated *** 2024-05-06T21:39:21.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:21 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:21.134+0000 7f3846588700 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T21:39:21.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:21 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:21.162+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:21.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:21 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:21.162+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:22.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:22 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:22.152+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:22.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:22 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:22.152+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:23.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:23 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:23.157+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:23.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:23 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:23.157+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:24.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:24 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:24.201+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:24.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:24 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:24.201+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:24.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:24 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:24.201+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6822 osd.2 since back 2024-05-06T21:38:59.752824+0000 front 2024-05-06T21:38:59.752843+0000 (oldest deadline 2024-05-06T21:39:23.252796+0000) 2024-05-06T21:39:25.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:25 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:25.173+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6806 osd.0 since back 2024-05-06T21:38:41.150667+0000 front 2024-05-06T21:38:41.150695+0000 (oldest deadline 2024-05-06T21:39:06.450583+0000) 2024-05-06T21:39:25.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:25 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:25.173+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6814 osd.1 since back 2024-05-06T21:38:52.351693+0000 front 2024-05-06T21:38:52.351555+0000 (oldest deadline 2024-05-06T21:39:15.151731+0000) 2024-05-06T21:39:25.612 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:25 smithi154 ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5[74654]: 2024-05-06T21:39:25.173+0000 7f384337d700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.32:6822 osd.2 since back 2024-05-06T21:38:59.752824+0000 front 2024-05-06T21:38:59.752843+0000 (oldest deadline 2024-05-06T21:39:23.252796+0000) 2024-05-06T21:39:27.074 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:26 smithi154 podman[94066]: 2024-05-06 21:39:26.679183503 +0000 UTC m=+5.650014437 container died 8b513e97a420166ee5eed3d968ffa7e746e14a5e82efc9e0b24a838bcd0cf38e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5, CEPH_POINT_RELEASE=, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240430) 2024-05-06T21:39:27.075 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:27 smithi154 podman[94066]: 2024-05-06 21:39:27.080882956 +0000 UTC m=+6.051713889 container cleanup 8b513e97a420166ee5eed3d968ffa7e746e14a5e82efc9e0b24a838bcd0cf38e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T21:39:27.362 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:27 smithi154 bash[94066]: ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5 2024-05-06T21:39:27.703 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:27 smithi154 podman[94086]: 2024-05-06 21:39:27.390468929 +0000 UTC m=+0.712567899 container remove 8b513e97a420166ee5eed3d968ffa7e746e14a5e82efc9e0b24a838bcd0cf38e (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-06T21:39:27.954 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:27 smithi154 podman[94179]: 2024-05-06 21:39:27.612733265 +0000 UTC m=+0.018159007 image pull 3b8ac54a9a71f867ae47697cf791455657f02ca8a0993d41dffff5745e2080fc quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4 2024-05-06T21:39:27.954 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:27 smithi154 podman[94179]: 2024-05-06 21:39:27.716146741 +0000 UTC m=+0.121572483 container create 6e3fd51911076182ff9269c60bf11298f0cc23b8f65196600c945b4e528b88f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=) 2024-05-06T21:39:27.954 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:27 smithi154 podman[94179]: 2024-05-06 21:39:27.960599908 +0000 UTC m=+0.366025655 container init 6e3fd51911076182ff9269c60bf11298f0cc23b8f65196600c945b4e528b88f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-06T21:39:28.262 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:27 smithi154 podman[94179]: 2024-05-06 21:39:27.963934785 +0000 UTC m=+0.369360534 container start 6e3fd51911076182ff9269c60bf11298f0cc23b8f65196600c945b4e528b88f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T21:39:28.262 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:28 smithi154 podman[94179]: 2024-05-06 21:39:28.0690482 +0000 UTC m=+0.474473951 container attach 6e3fd51911076182ff9269c60bf11298f0cc23b8f65196600c945b4e528b88f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-06T21:39:28.540 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 06 21:39:28 smithi154 podman[94179]: 2024-05-06 21:39:28.269134711 +0000 UTC m=+0.674560454 container died 6e3fd51911076182ff9269c60bf11298f0cc23b8f65196600c945b4e528b88f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:baeaaf28cdc15b9bf88f6cfb7a8a9e2882cfdd830f08e3dc5cccfb775b3500b4, name=ceph-d155ff30-0bed-11ef-bc97-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-yuriw11-testing-20240501.200505-squid-f273489, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, ceph=True) 2024-05-06T21:39:28.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155ff30-0bed-11ef-bc97-c7b262605968@osd.5.service' 2024-05-06T21:39:28.853 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T21:39:28.853 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-06T21:39:28.853 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d155ff30-0bed-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-06T21:39:29.020 INFO:teuthology.orchestra.run.smithi032.stdout:Deleting cluster with fsid: d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:39:53.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d155ff30-0bed-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-06T21:39:53.170 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:40:06.976 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T21:40:07.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T21:40:07.041 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-06T21:40:07.042 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568/remote/smithi032/crash 2024-05-06T21:40:07.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/crash -- . 2024-05-06T21:40:07.080 INFO:teuthology.orchestra.run.smithi032.stderr:tar: /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-06T21:40:07.080 INFO:teuthology.orchestra.run.smithi032.stderr:tar: Error is not recoverable: exiting now 2024-05-06T21:40:07.082 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568/remote/smithi154/crash 2024-05-06T21:40:07.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/crash -- . 2024-05-06T21:40:07.107 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-06T21:40:07.107 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-05-06T21:40:07.108 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-06T21:40:07.108 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-05-06T21:40:07.159 INFO:teuthology.orchestra.run.smithi032.stdout:2024-05-06T21:30:00.000215+0000 mon.smithi032 (mon.0) 295 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 13/366 objects degraded (3.552%), 3 pgs degraded 2024-05-06T21:40:07.160 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-05-06T21:40:07.160 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[SEC\]' /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-05-06T21:40:07.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]' /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-05-06T21:40:07.308 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[WRN\]' /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-05-06T21:40:07.382 INFO:teuthology.orchestra.run.smithi032.stdout:2024-05-06T21:30:00.000215+0000 mon.smithi032 (mon.0) 295 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 13/366 objects degraded (3.552%), 3 pgs degraded 2024-05-06T21:40:07.382 INFO:tasks.cephadm:Compressing logs... 2024-05-06T21:40:07.383 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-06T21:40:07.424 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-06T21:40:07.447 INFO:teuthology.orchestra.run.smithi032.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2024-05-06T21:40:07.447 INFO:teuthology.orchestra.run.smithi032.stderr: --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi032.jbgmwi.log 2024-05-06T21:40:07.447 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log 2024-05-06T21:40:07.447 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi032.jbgmwi.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-06T21:40:07.448 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-06T21:40:07.449 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mon.smithi032.log 2024-05-06T21:40:07.449 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-06T21:40:07.449 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mon.smithi032.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-06T21:40:07.455 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi032.log 2024-05-06T21:40:07.455 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-06T21:40:07.455 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi032.log: 87.9% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-06T21:40:07.455 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mgr.smithi032.ecoohh.log 2024-05-06T21:40:07.455 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.cephadm.log: 85.8% 94.0% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.cephadm.log.gz -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi032.log.gz 2024-05-06T21:40:07.455 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-05-06T21:40:07.455 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi032.fpdhzg.log 2024-05-06T21:40:07.455 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mgr.smithi032.ecoohh.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-06T21:40:07.455 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi032.fpdhzg.log: 91.4% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-06T21:40:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi154.log 2024-05-06T21:40:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:: No such file or directory 2024-05-06T21:40:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi154.log: /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mgr.smithi154.kilvol.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mgr.smithi154.kilvol.log: /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi154.xfmqxf.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-client.ceph-exporter.smithi154.log.gz/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi154.xfmqxf.log: 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mon.smithi154.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.4.log: 87.9% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.log.gzgzip 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi154.rizdbu.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-06T21:40:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi154.rizdbu.log: /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mon.smithi154.log: 91.5% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-06T21:40:07.467 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-06T21:40:07.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.cephadm.log: 85.6% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-06T21:40:07.468 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-06T21:40:07.479 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-06T21:40:07.481 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-volume.log: /var/log/ceph/cephadm.log: 91.7% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-06T21:40:07.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-volume.log: 91.9% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-06T21:40:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/cephadm.log: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-06T21:40:07.501 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mgr.smithi154.kilvol.log.gz 2024-05-06T21:40:07.516 INFO:teuthology.orchestra.run.smithi032.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-06T21:40:07.736 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mon.smithi154.log.gz 2024-05-06T21:40:07.743 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mgr.smithi032.ecoohh.log.gz 2024-05-06T21:40:08.603 INFO:teuthology.orchestra.run.smithi032.stderr: 90.7% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mon.smithi032.log.gz 2024-05-06T21:40:11.799 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-06T21:40:11.941 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-06T21:40:11.977 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi154.xfmqxf.log.gz 2024-05-06T21:40:12.186 INFO:teuthology.orchestra.run.smithi032.stderr: 95.2% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi032.fpdhzg.log.gz 2024-05-06T21:40:12.672 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-06T21:40:14.538 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-06T21:40:14.645 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-06T21:40:14.837 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-06T21:40:49.464 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi154.rizdbu.log.gz 2024-05-06T21:40:49.466 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-06T21:40:49.466 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m42.027s 2024-05-06T21:40:49.466 INFO:teuthology.orchestra.run.smithi154.stderr:user 1m3.751s 2024-05-06T21:40:49.467 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m2.122s 2024-05-06T21:40:59.124 INFO:teuthology.orchestra.run.smithi032.stderr: 93.1% -- replaced with /var/log/ceph/d155ff30-0bed-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi032.jbgmwi.log.gz 2024-05-06T21:40:59.126 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-05-06T21:40:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m51.689s 2024-05-06T21:40:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:user 1m12.390s 2024-05-06T21:40:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m2.047s 2024-05-06T21:40:59.127 INFO:tasks.cephadm:Archiving logs... 2024-05-06T21:40:59.127 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568/remote/smithi032/log 2024-05-06T21:40:59.128 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-06T21:41:09.247 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568/remote/smithi154/log 2024-05-06T21:41:09.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-06T21:41:18.573 INFO:tasks.cephadm:Removing cluster... 2024-05-06T21:41:18.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d155ff30-0bed-11ef-bc97-c7b262605968 --force 2024-05-06T21:41:18.740 INFO:teuthology.orchestra.run.smithi032.stdout:Deleting cluster with fsid: d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:41:19.104 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d155ff30-0bed-11ef-bc97-c7b262605968 --force 2024-05-06T21:41:19.263 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: d155ff30-0bed-11ef-bc97-c7b262605968 2024-05-06T21:41:19.609 INFO:tasks.cephadm:Removing cephadm ... 2024-05-06T21:41:19.609 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-06T21:41:19.627 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-06T21:41:19.643 INFO:tasks.cephadm:Teardown complete 2024-05-06T21:41:19.644 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-06T21:41:19.657 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-06T21:41:19.657 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-06T21:41:19.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-06T21:41:19.761 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-06T21:41:19.775 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-06T21:41:19.875 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T21:41:19.878 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T21:41:19.891 INFO:teuthology.orchestra.run.smithi032.stderr:bash: line 1: ntpq: command not found 2024-05-06T21:41:19.893 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-05-06T21:41:19.895 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T21:41:19.895 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2024-05-06T21:41:19.895 INFO:teuthology.orchestra.run.smithi032.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 64 +2075us[+2080us] +/- 41ms 2024-05-06T21:41:19.895 INFO:teuthology.orchestra.run.smithi032.stdout:^* hv02.front.sepia.ceph.com 3 6 377 61 -2118us[-2114us] +/- 63ms 2024-05-06T21:41:19.895 INFO:teuthology.orchestra.run.smithi032.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 -1036us[-1036us] +/- 71ms 2024-05-06T21:41:19.895 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:41:19.896 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T21:41:19.897 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-05-06T21:41:19.897 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 63 +2078us[+2078us] +/- 41ms 2024-05-06T21:41:19.897 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv02.front.sepia.ceph.com 3 6 377 64 -2111us[-1663us] +/- 63ms 2024-05-06T21:41:19.897 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -1035us[-1035us] +/- 71ms 2024-05-06T21:41:19.897 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T21:41:19.898 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-06T21:41:19.914 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-06T21:41:19.915 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-06T21:41:19.935 DEBUG:teuthology.orchestra.run.smithi032:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-06T21:41:20.024 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-06T21:41:20.099 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-06T21:41:20.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:41:20.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-06T21:41:20.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:41:20.159 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-06T21:41:20.171 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-06T21:41:20.202 INFO:teuthology.task.internal:Duration was 1930.380563 seconds 2024-05-06T21:41:20.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-06T21:41:20.244 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-06T21:41:20.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-06T21:41:20.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-06T21:41:20.285 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T21:41:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T21:41:20.766 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-06T21:41:20.766 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2024-05-06T21:41:20.766 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-06T21:41:20.830 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-05-06T21:41:20.830 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-06T21:41:20.854 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-06T21:41:20.854 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-06T21:41:20.873 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-06T21:41:20.921 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-06T21:41:20.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-06T21:41:20.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-06T21:41:21.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-06T21:41:21.627 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-06T21:41:21.627 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-06T21:41:21.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-06T21:41:21.682 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-06T21:41:21.701 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-06T21:41:21.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-06T21:41:21.725 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2024-05-06T21:41:21.750 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-05-06T21:41:21.759 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-06T21:41:21.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:41:21.799 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-06T21:41:21.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T21:41:21.815 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-06T21:41:21.828 INFO:teuthology.task.internal:Transferring archived files... 2024-05-06T21:41:21.828 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568/remote/smithi032 2024-05-06T21:41:21.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-06T21:41:21.900 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568/remote/smithi154 2024-05-06T21:41:21.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-06T21:41:21.938 INFO:teuthology.task.internal:Removing archive directory... 2024-05-06T21:41:21.938 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-06T21:41:21.941 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-06T21:41:21.987 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-06T21:41:22.001 INFO:teuthology.task.internal:Not uploading archives. 2024-05-06T21:41:22.001 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-06T21:41:22.045 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-06T21:41:22.046 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-06T21:41:22.048 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-06T21:41:22.061 INFO:teuthology.orchestra.run.smithi032.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 6 21:41 /home/ubuntu/cephtest 2024-05-06T21:41:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: 265332 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 6 21:41 /home/ubuntu/cephtest 2024-05-06T21:41:22.065 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-06T21:41:22.094 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-06T21:41:22.196 INFO:teuthology.nuke:Checking targets against current locks 2024-05-06T21:41:22.223 DEBUG:teuthology.nuke:shortname: smithi032 2024-05-06T21:41:22.223 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T21:41:22.243 DEBUG:teuthology.nuke:shortname: smithi154 2024-05-06T21:41:22.243 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T21:41:22.246 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 20:59:57.571793', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNbBQhysr2ZNdchvALranI8mrXZVH627Y+CFr60qEPuRY/DL66bDB4yrR9VJLDewTvziMSBydhh8aR7kLV6Zziw='} 2024-05-06T21:41:22.263 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-05-06_20:49:51-upgrade-wip-yuriw11-testing-20240501.200505-squid-distro-default-smithi/7694568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 20:59:57.570112', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvqmopsH+3IZd/XkjHnGn1ZG7jOLFSv/F3zd1q6Eg3IE0poXC0NidTIP/JH2VxzbbdAtT7I1uP5dAJnubE/ZU4='} 2024-05-06T21:41:22.295 INFO:teuthology.orchestra.console.smithi032:Power off 2024-05-06T21:41:22.296 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-06T21:41:22.322 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2024-05-06T21:41:22.322 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T21:41:22.337 INFO:teuthology.orchestra.console.smithi154:Power off 2024-05-06T21:41:22.338 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-06T21:41:22.348 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-05-06T21:41:22.367 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-05-06T21:41:22.367 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T21:41:22.391 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-05-06T21:41:26.349 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T21:41:26.392 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T21:41:26.458 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-05-06T21:41:26.501 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-05-06T21:41:30.462 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T21:41:30.502 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T21:41:30.572 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-05-06T21:41:30.611 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-05-06T21:41:30.674 INFO:teuthology.orchestra.console.smithi032:Power off completed 2024-05-06T21:41:30.712 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-05-06T21:41:30.817 INFO:teuthology.run:Summary data: description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1930.3805632591248 failure_reason: '"2024-05-06T21:30:00.000215+0000 mon.smithi032 (mon.0) 295 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 13/366 objects degraded (3.552%), 3 pgs degraded" in cluster log' flavor: default owner: scheduled_lflores@teuthology success: false 2024-05-06T21:41:30.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-06T21:41:30.897 INFO:teuthology.run:FAIL